Artificial general intelligence (AGI) is a kind of artificial intelligence (AI) that matches or goes beyond human cognitive abilities across a wide variety of cognitive tasks. This contrasts with narrow AI, which is limited to particular jobs. [1] Artificial superintelligence (ASI), on the other hand, describes AGI that considerably surpasses human cognitive abilities. AGI is considered one of the meanings of strong AI.
Creating AGI is a primary objective of AI research study and of companies such as OpenAI [2] and Meta. [3] A 2020 survey identified 72 active AGI research and advancement projects throughout 37 countries. [4]
The timeline for accomplishing AGI remains a topic of continuous debate among scientists and specialists. Since 2023, some argue that it might be possible in years or years; others keep it might take a century or longer; a minority believe it may never be accomplished; and another minority claims that it is already here. [5] [6] Notable AI researcher Geoffrey Hinton has revealed concerns about the quick development towards AGI, recommending it might be attained quicker than many anticipate. [7]
There is debate on the precise definition of AGI and concerning whether contemporary big language designs (LLMs) such as GPT-4 are early kinds of AGI. [8] AGI is a common subject in science fiction and futures studies. [9] [10]
Contention exists over whether AGI represents an existential threat. [11] [12] [13] Many specialists on AI have stated that alleviating the danger of human termination posed by AGI ought to be a global concern. [14] [15] Others discover the development of AGI to be too remote to present such a danger. [16] [17]
Terminology
AGI is also understood as strong AI, [18] [19] complete AI, [20] human-level AI, [5] human-level smart AI, or basic smart action. [21]
Some scholastic sources reserve the term "strong AI" for computer programs that experience life or awareness. [a] In contrast, weak AI (or narrow AI) is able to solve one particular issue however lacks basic cognitive capabilities. [22] [19] Some academic sources utilize "weak AI" to refer more broadly to any programs that neither experience awareness nor have a mind in the exact same sense as humans. [a]
Related ideas include artificial superintelligence and transformative AI. An artificial superintelligence (ASI) is a hypothetical kind of AGI that is a lot more generally smart than human beings, [23] while the idea of transformative AI associates with AI having a big impact on society, for example, comparable to the farming or commercial revolution. [24]
A framework for categorizing AGI in levels was proposed in 2023 by Google DeepMind researchers. They specify five levels of AGI: emerging, competent, specialist, virtuoso, and superhuman. For example, a proficient AGI is defined as an AI that outperforms 50% of experienced grownups in a large range of non-physical jobs, and a superhuman AGI (i.e. an artificial superintelligence) is similarly specified but with a limit of 100%. They think about big language designs like ChatGPT or LLaMA 2 to be circumstances of emerging AGI. [25]
Characteristics
Various popular definitions of intelligence have been proposed. One of the leading proposals is the Turing test. However, there are other popular definitions, and some scientists disagree with the more popular techniques. [b]
Intelligence qualities
Researchers usually hold that intelligence is required to do all of the following: [27]
factor, use technique, solve puzzles, and make judgments under uncertainty
represent knowledge, including good sense understanding
strategy
learn
- communicate in natural language
- if necessary, integrate these abilities in completion of any provided objective
Many interdisciplinary techniques (e.g. cognitive science, computational intelligence, and choice making) think about additional traits such as creativity (the ability to form novel mental images and ideas) [28] and autonomy. [29]
Computer-based systems that show a number of these abilities exist (e.g. see computational creativity, automated reasoning, decision support group, robot, evolutionary computation, intelligent representative). There is debate about whether modern-day AI systems have them to a sufficient degree.
Physical traits
Other abilities are considered desirable in intelligent systems, as they might impact intelligence or aid in its expression. These consist of: [30]
- the ability to sense (e.g. see, hear, and so on), and
- the capability to act (e.g. move and manipulate items, change area to check out, and so on).
This includes the capability to spot and react to hazard. [31]
Although the capability to sense (e.g. see, hear, etc) and the capability to act (e.g. move and control things, change place to explore, etc) can be desirable for some smart systems, [30] these physical capabilities are not strictly required for an entity to certify as AGI-particularly under the thesis that big language designs (LLMs) might already be or become AGI. Even from a less optimistic perspective on LLMs, there is no firm requirement for an AGI to have a human-like type; being a silicon-based computational system suffices, provided it can process input (language) from the external world in place of human senses. This interpretation aligns with the understanding that AGI has actually never ever been proscribed a specific physical personification and thus does not require a capability for locomotion or traditional "eyes and ears". [32]
Tests for human-level AGI
Several tests meant to confirm human-level AGI have actually been thought about, including: [33] [34]
The idea of the test is that the machine has to try and pretend to be a man, by answering questions put to it, and it will only pass if the pretence is reasonably convincing. A substantial portion of a jury, who should not be professional about makers, must be taken in by the pretence. [37]
AI-complete issues
A problem is informally called "AI-complete" or "AI-hard" if it is believed that in order to solve it, one would need to execute AGI, since the service is beyond the capabilities of a purpose-specific algorithm. [47]
There are numerous issues that have actually been conjectured to need basic intelligence to solve in addition to humans. Examples consist of computer vision, natural language understanding, and dealing with unexpected situations while fixing any real-world issue. [48] Even a specific job like translation requires a device to check out and write in both languages, follow the author's argument (factor), understand the context (knowledge), and consistently replicate the author's original intent (social intelligence). All of these issues need to be fixed concurrently in order to reach human-level device efficiency.
However, much of these tasks can now be carried out by modern-day big language models. According to Stanford University's 2024 AI index, AI has actually reached human-level performance on many standards for reading understanding and visual reasoning. [49]
History
Classical AI
Modern AI research study started in the mid-1950s. [50] The first generation of AI scientists were encouraged that synthetic basic intelligence was possible which it would exist in simply a couple of decades. [51] AI pioneer Herbert A. Simon composed in 1965: "devices will be capable, within twenty years, of doing any work a man can do." [52]
Their predictions were the motivation for Stanley Kubrick and Arthur C. Clarke's character HAL 9000, who embodied what AI researchers believed they could create by the year 2001. AI leader Marvin Minsky was an expert [53] on the task of making HAL 9000 as realistic as possible according to the agreement forecasts of the time. He said in 1967, "Within a generation ... the issue of creating 'expert system' will considerably be solved". [54]
Several classical AI jobs, such as Doug Lenat's Cyc job (that started in 1984), and Allen Newell's Soar task, were directed at AGI.
However, in the early 1970s, it ended up being obvious that researchers had actually grossly undervalued the trouble of the project. Funding agencies ended up being hesitant of AGI and put scientists under increasing pressure to produce useful "applied AI". [c] In the early 1980s, Japan's Fifth Generation Computer Project revived interest in AGI, setting out a ten-year timeline that consisted of AGI objectives like "bring on a casual conversation". [58] In response to this and the success of expert systems, both industry and government pumped cash into the field. [56] [59] However, self-confidence in AI amazingly collapsed in the late 1980s, and the objectives of the Fifth Generation Computer Project were never satisfied. [60] For the second time in 20 years, AI researchers who forecasted the impending achievement of AGI had been misinterpreted. By the 1990s, AI researchers had a reputation for making vain promises. They became reluctant to make forecasts at all [d] and prevented mention of "human level" synthetic intelligence for fear of being identified "wild-eyed dreamer [s]. [62]
Narrow AI research study
In the 1990s and early 21st century, mainstream AI attained commercial success and academic respectability by concentrating on specific sub-problems where AI can produce proven results and commercial applications, such as speech recognition and suggestion algorithms. [63] These "applied AI" systems are now utilized thoroughly throughout the innovation industry, and research study in this vein is greatly funded in both academia and market. Since 2018 [update], advancement in this field was thought about an emerging pattern, and a fully grown phase was anticipated to be reached in more than ten years. [64]
At the turn of the century, numerous mainstream AI researchers [65] hoped that strong AI might be established by combining programs that fix different sub-problems. Hans Moravec composed in 1988:
I am positive that this bottom-up path to artificial intelligence will one day satisfy the traditional top-down path over half method, prepared to offer the real-world competence and the commonsense understanding that has actually been so frustratingly elusive in thinking programs. Fully smart machines will result when the metaphorical golden spike is driven unifying the 2 efforts. [65]
However, even at the time, this was contested. For example, Stevan Harnad of Princeton University concluded his 1990 paper on the sign grounding hypothesis by stating:
The expectation has actually often been voiced that "top-down" (symbolic) approaches to modeling cognition will somehow satisfy "bottom-up" (sensory) approaches someplace in between. If the grounding considerations in this paper are valid, then this expectation is hopelessly modular and there is really only one feasible path from sense to signs: from the ground up. A free-floating symbolic level like the software level of a computer will never be reached by this route (or vice versa) - nor is it clear why we must even try to reach such a level, since it looks as if getting there would just amount to uprooting our signs from their intrinsic meanings (therefore simply decreasing ourselves to the functional equivalent of a programmable computer). [66]
Modern synthetic general intelligence research
The term "synthetic basic intelligence" was used as early as 1997, by Mark Gubrud [67] in a conversation of the ramifications of completely automated military production and operations. A mathematical formalism of AGI was proposed by Marcus Hutter in 2000. Named AIXI, the proposed AGI agent maximises "the capability to please objectives in a wide variety of environments". [68] This type of AGI, defined by the ability to maximise a mathematical definition of intelligence rather than display human-like behaviour, [69] was also called universal synthetic intelligence. [70]
The term AGI was re-introduced and popularized by Shane Legg and Ben Goertzel around 2002. [71] AGI research study activity in 2006 was described by Pei Wang and Ben Goertzel [72] as "producing publications and initial outcomes". The very first summer school in AGI was organized in Xiamen, China in 2009 [73] by the Xiamen university's Artificial Brain Laboratory and OpenCog. The first university course was given up 2010 [74] and 2011 [75] at Plovdiv University, Bulgaria by Todor Arnaudov. MIT provided a course on AGI in 2018, arranged by Lex Fridman and featuring a number of visitor speakers.
Since 2023 [update], a little number of computer researchers are active in AGI research, and many contribute to a series of AGI conferences. However, increasingly more scientists are interested in open-ended learning, [76] [77] which is the idea of enabling AI to continually learn and innovate like human beings do.
Feasibility
Since 2023, the development and prospective accomplishment of AGI stays a topic of intense dispute within the AI community. While standard consensus held that AGI was a far-off goal, current advancements have led some researchers and industry figures to claim that early types of AGI might already exist. [78] AI leader Herbert A. Simon speculated in 1965 that "devices will be capable, within twenty years, of doing any work a man can do". This forecast stopped working to come true. Microsoft co-founder Paul Allen believed that such intelligence is unlikely in the 21st century because it would need "unforeseeable and essentially unpredictable breakthroughs" and a "clinically deep understanding of cognition". [79] Writing in The Guardian, roboticist Alan Winfield declared the gulf between contemporary computing and human-level artificial intelligence is as wide as the gulf in between present area flight and useful faster-than-light spaceflight. [80]
An additional obstacle is the lack of clarity in defining what intelligence involves. Does it need awareness? Must it show the capability to set objectives as well as pursue them? Is it purely a matter of scale such that if model sizes increase sufficiently, intelligence will emerge? Are centers such as planning, reasoning, and causal understanding required? Does intelligence need clearly replicating the brain and its particular professors? Does it need feelings? [81]
Most AI scientists think strong AI can be attained in the future, however some thinkers, like Hubert Dreyfus and Roger Penrose, deny the possibility of attaining strong AI. [82] [83] John McCarthy is amongst those who think human-level AI will be achieved, but that the present level of development is such that a date can not precisely be anticipated. [84] AI experts' views on the feasibility of AGI wax and subside. Four polls performed in 2012 and 2013 suggested that the mean estimate among experts for when they would be 50% confident AGI would arrive was 2040 to 2050, depending on the poll, with the mean being 2081. Of the experts, 16.5% addressed with "never" when asked the exact same concern however with a 90% self-confidence instead. [85] [86] Further present AGI progress factors to consider can be discovered above Tests for validating human-level AGI.
A report by Stuart Armstrong and Kaj Sotala of the Machine Intelligence Research Institute found that "over [a] 60-year timespan there is a strong bias towards forecasting the arrival of human-level AI as in between 15 and 25 years from the time the forecast was made". They analyzed 95 predictions made between 1950 and 2012 on when human-level AI will come about. [87]
In 2023, Microsoft scientists released an in-depth assessment of GPT-4. They concluded: "Given the breadth and depth of GPT-4's capabilities, we think that it might reasonably be seen as an early (yet still incomplete) variation of a synthetic general intelligence (AGI) system." [88] Another study in 2023 reported that GPT-4 outshines 99% of humans on the Torrance tests of creativity. [89] [90]
Blaise Agüera y Arcas and Peter Norvig composed in 2023 that a significant level of general intelligence has actually currently been achieved with frontier models. They composed that reluctance to this view comes from four main factors: a "healthy uncertainty about metrics for AGI", an "ideological dedication to alternative AI theories or strategies", a "devotion to human (or biological) exceptionalism", or a "concern about the economic ramifications of AGI". [91]
2023 likewise marked the introduction of big multimodal designs (big language models efficient in processing or creating multiple methods such as text, audio, and images). [92]
In 2024, OpenAI released o1-preview, the very first of a series of designs that "spend more time believing before they react". According to Mira Murati, this capability to think before responding represents a brand-new, additional paradigm. It improves design outputs by spending more computing power when generating the response, whereas the model scaling paradigm enhances outputs by increasing the design size, training information and training calculate power. [93] [94]
An OpenAI employee, Vahid Kazemi, claimed in 2024 that the company had attained AGI, specifying, "In my opinion, we have already accomplished AGI and it's even more clear with O1." Kazemi clarified that while the AI is not yet "better than any human at any task", it is "much better than many people at most jobs." He likewise attended to criticisms that large language designs (LLMs) merely follow predefined patterns, comparing their learning process to the scientific method of observing, assuming, and confirming. These statements have sparked dispute, as they count on a broad and non-traditional meaning of AGI-traditionally understood as AI that matches human intelligence throughout all domains. Critics argue that, while OpenAI's designs show impressive adaptability, they might not fully meet this requirement. Notably, Kazemi's remarks came quickly after OpenAI eliminated "AGI" from the terms of its collaboration with Microsoft, triggering speculation about the business's strategic intents. [95]
Timescales
Progress in artificial intelligence has traditionally gone through periods of quick development separated by durations when progress appeared to stop. [82] Ending each hiatus were essential advances in hardware, software or both to create area for additional progress. [82] [98] [99] For example, the computer hardware offered in the twentieth century was not adequate to execute deep knowing, which requires big numbers of GPU-enabled CPUs. [100]
In the intro to his 2006 book, [101] Goertzel states that price quotes of the time required before a really flexible AGI is built vary from ten years to over a century. Since 2007 [upgrade], the agreement in the AGI research study community seemed to be that the timeline gone over by Ray Kurzweil in 2005 in The Singularity is Near [102] (i.e. in between 2015 and 2045) was possible. [103] Mainstream AI researchers have offered a large range of opinions on whether development will be this fast. A 2012 meta-analysis of 95 such viewpoints found a predisposition towards predicting that the start of AGI would occur within 16-26 years for contemporary and historical forecasts alike. That paper has actually been criticized for how it classified opinions as expert or non-expert. [104]
In 2012, Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton developed a neural network called AlexNet, which won the ImageNet competitors with a top-5 test error rate of 15.3%, substantially much better than the second-best entry's rate of 26.3% (the standard method used a weighted amount of scores from various pre-defined classifiers). [105] AlexNet was concerned as the preliminary ground-breaker of the present deep knowing wave. [105]
In 2017, scientists Feng Liu, Yong Shi, and Ying Liu carried out intelligence tests on openly available and freely available weak AI such as Google AI, Apple's Siri, and others. At the maximum, these AIs reached an IQ worth of about 47, which corresponds roughly to a six-year-old kid in first grade. A grownup concerns about 100 on average. Similar tests were carried out in 2014, with the IQ score reaching a maximum value of 27. [106] [107]
In 2020, OpenAI established GPT-3, a language model efficient in carrying out many varied jobs without particular training. According to Gary Grossman in a VentureBeat article, while there is agreement that GPT-3 is not an example of AGI, it is considered by some to be too advanced to be classified as a narrow AI system. [108]
In the exact same year, Jason Rohrer utilized his GPT-3 account to develop a chatbot, and offered a chatbot-developing platform called "Project December". OpenAI asked for changes to the chatbot to adhere to their security standards; Rohrer detached Project December from the GPT-3 API. [109]
In 2022, DeepMind established Gato, a "general-purpose" system capable of performing more than 600 various tasks. [110]
In 2023, Microsoft Research published a research study on an early variation of OpenAI's GPT-4, contending that it exhibited more basic intelligence than previous AI designs and demonstrated human-level performance in tasks spanning numerous domains, such as mathematics, coding, and law. This research triggered a debate on whether GPT-4 could be considered an early, incomplete version of synthetic basic intelligence, emphasizing the requirement for more expedition and assessment of such systems. [111]
In 2023, the AI researcher Geoffrey Hinton stated that: [112]
The concept that this stuff could actually get smarter than individuals - a couple of individuals thought that, [...] But the majority of people believed it was way off. And I believed it was method off. I thought it was 30 to 50 years and even longer away. Obviously, I no longer believe that.
In May 2023, Demis Hassabis likewise stated that "The progress in the last couple of years has been pretty incredible", which he sees no reason it would slow down, anticipating AGI within a years or perhaps a few years. [113] In March 2024, Nvidia's CEO, Jensen Huang, stated his expectation that within 5 years, AI would can passing any test at least in addition to humans. [114] In June 2024, the AI scientist Leopold Aschenbrenner, a former OpenAI worker, approximated AGI by 2027 to be "strikingly possible". [115]
Whole brain emulation
While the advancement of transformer models like in ChatGPT is considered the most promising course to AGI, [116] [117] whole brain emulation can act as an alternative technique. With whole brain simulation, a brain model is developed by scanning and mapping a biological brain in information, and after that copying and replicating it on a computer system or another computational gadget. The simulation design must be adequately devoted to the original, so that it acts in virtually the exact same way as the original brain. [118] Whole brain emulation is a type of brain simulation that is discussed in computational neuroscience and neuroinformatics, and for medical research purposes. It has actually been discussed in expert system research study [103] as a method to strong AI. Neuroimaging technologies that might provide the necessary comprehensive understanding are improving rapidly, and futurist Ray Kurzweil in the book The Singularity Is Near [102] forecasts that a map of adequate quality will appear on a comparable timescale to the computing power required to emulate it.
Early approximates
For low-level brain simulation, an extremely powerful cluster of computers or GPUs would be needed, provided the massive amount of synapses within the human brain. Each of the 1011 (one hundred billion) neurons has on typical 7,000 synaptic connections (synapses) to other nerve cells. The brain of a three-year-old child has about 1015 synapses (1 quadrillion). This number declines with age, supporting by the adult years. Estimates differ for an adult, ranging from 1014 to 5 × 1014 synapses (100 to 500 trillion). [120] A quote of the brain's processing power, based on a basic switch model for neuron activity, is around 1014 (100 trillion) synaptic updates per second (SUPS). [121]
In 1997, Kurzweil looked at various estimates for the hardware needed to equal the human brain and adopted a figure of 1016 calculations per 2nd (cps). [e] (For contrast, if a "calculation" was comparable to one "floating-point operation" - a step utilized to rate present supercomputers - then 1016 "computations" would be comparable to 10 petaFLOPS, accomplished in 2011, while 1018 was accomplished in 2022.) He used this figure to anticipate the essential hardware would be readily available at some point in between 2015 and 2025, if the exponential development in computer power at the time of writing continued.
Current research study
The Human Brain Project, an EU-funded initiative active from 2013 to 2023, has established a particularly in-depth and openly accessible atlas of the human brain. [124] In 2023, researchers from Duke University carried out a high-resolution scan of a mouse brain.
Criticisms of simulation-based methods
The synthetic nerve cell design presumed by Kurzweil and utilized in lots of existing synthetic neural network executions is easy compared to biological neurons. A brain simulation would likely need to catch the detailed cellular behaviour of biological neurons, presently understood just in broad overview. The overhead introduced by full modeling of the biological, chemical, and physical details of neural behaviour (specifically on a molecular scale) would need computational powers numerous orders of magnitude larger than Kurzweil's price quote. In addition, the estimates do not represent glial cells, which are understood to contribute in cognitive procedures. [125]
A fundamental criticism of the simulated brain approach stems from embodied cognition theory which asserts that human personification is an essential aspect of human intelligence and is required to ground significance. [126] [127] If this theory is right, any completely practical brain design will need to encompass more than just the neurons (e.g., a robotic body). Goertzel [103] proposes virtual embodiment (like in metaverses like Second Life) as a choice, however it is unidentified whether this would be adequate.
Philosophical viewpoint
"Strong AI" as specified in viewpoint
In 1980, philosopher John Searle coined the term "strong AI" as part of his Chinese space argument. [128] He proposed a difference in between two hypotheses about expert system: [f]
Strong AI hypothesis: A synthetic intelligence system can have "a mind" and "awareness".
Weak AI hypothesis: A synthetic intelligence system can (only) imitate it believes and has a mind and awareness.
The first one he called "strong" due to the fact that it makes a more powerful declaration: it assumes something unique has actually happened to the machine that goes beyond those abilities that we can test. The behaviour of a "weak AI" machine would be exactly similar to a "strong AI" device, but the latter would likewise have subjective mindful experience. This usage is also typical in scholastic AI research study and textbooks. [129]
In contrast to Searle and mainstream AI, some futurists such as Ray Kurzweil use the term "strong AI" to imply "human level artificial general intelligence". [102] This is not the same as Searle's strong AI, unless it is presumed that awareness is essential for human-level AGI. Academic thinkers such as Searle do not believe that holds true, and to most expert system scientists the concern is out-of-scope. [130]
Mainstream AI is most thinking about how a program acts. [131] According to Russell and Norvig, "as long as the program works, they do not care if you call it real or a simulation." [130] If the program can behave as if it has a mind, then there is no requirement to know if it really has mind - certainly, there would be no method to inform. For AI research, Searle's "weak AI hypothesis" is comparable to the statement "artificial basic intelligence is possible". Thus, according to Russell and Norvig, "most AI scientists take the weak AI hypothesis for granted, and do not care about the strong AI hypothesis." [130] Thus, for academic AI research, "Strong AI" and "AGI" are two various things.
Consciousness
Consciousness can have different meanings, and some elements play substantial roles in sci-fi and the ethics of expert system:
Sentience (or "extraordinary awareness"): The capability to "feel" understandings or emotions subjectively, instead of the ability to reason about perceptions. Some philosophers, such as David Chalmers, use the term "awareness" to refer specifically to sensational consciousness, which is roughly equivalent to life. [132] Determining why and how subjective experience arises is referred to as the difficult problem of awareness. [133] Thomas Nagel discussed in 1974 that it "feels like" something to be mindful. If we are not conscious, then it doesn't seem like anything. Nagel utilizes the example of a bat: we can smartly ask "what does it seem like to be a bat?" However, we are not likely to ask "what does it feel like to be a toaster?" Nagel concludes that a bat seems mindful (i.e., has consciousness) however a toaster does not. [134] In 2022, a Google engineer claimed that the business's AI chatbot, LaMDA, had attained sentience, though this claim was widely disputed by other experts. [135]
Self-awareness: To have conscious awareness of oneself as a separate individual, especially to be consciously familiar with one's own ideas. This is opposed to merely being the "subject of one's believed"-an operating system or debugger has the ability to be "familiar with itself" (that is, to represent itself in the exact same method it represents whatever else)-however this is not what individuals typically imply when they utilize the term "self-awareness". [g]
These qualities have an ethical measurement. AI life would offer increase to concerns of well-being and legal protection, similarly to animals. [136] Other aspects of awareness associated to cognitive capabilities are likewise pertinent to the principle of AI rights. [137] Determining how to incorporate advanced AI with existing legal and social frameworks is an emergent problem. [138]
Benefits
AGI might have a wide range of applications. If oriented towards such goals, AGI could help mitigate numerous problems in the world such as hunger, hardship and illness. [139]
AGI might enhance productivity and efficiency in a lot of jobs. For example, in public health, AGI could accelerate medical research, significantly versus cancer. [140] It might look after the senior, [141] and democratize access to rapid, high-quality medical diagnostics. It could offer enjoyable, inexpensive and individualized education. [141] The need to work to subsist might end up being outdated if the wealth produced is correctly rearranged. [141] [142] This also raises the concern of the place of human beings in a significantly automated society.
AGI might likewise assist to make logical decisions, and to prepare for and prevent catastrophes. It might likewise assist to profit of potentially devastating technologies such as nanotechnology or climate engineering, while preventing the associated risks. [143] If an AGI's primary objective is to avoid existential catastrophes such as human extinction (which might be tough if the Vulnerable World Hypothesis turns out to be true), [144] it might take measures to significantly decrease the risks [143] while minimizing the effect of these steps on our quality of life.
Risks
Existential threats
AGI may represent numerous types of existential risk, which are threats that threaten "the early termination of Earth-originating smart life or the long-term and extreme destruction of its capacity for desirable future development". [145] The threat of human termination from AGI has been the subject of numerous debates, however there is likewise the possibility that the advancement of AGI would lead to a completely problematic future. Notably, it could be utilized to spread out and protect the set of values of whoever develops it. If humanity still has ethical blind areas similar to slavery in the past, AGI might irreversibly entrench it, avoiding ethical development. [146] Furthermore, AGI might assist in mass surveillance and brainwashing, which could be used to produce a stable repressive worldwide totalitarian routine. [147] [148] There is also a danger for the devices themselves. If makers that are sentient or otherwise deserving of ethical factor to consider are mass created in the future, engaging in a civilizational path that indefinitely disregards their welfare and interests could be an existential disaster. [149] [150] Considering just how much AGI could enhance mankind's future and help in reducing other existential threats, Toby Ord calls these existential dangers "an argument for proceeding with due caution", not for "abandoning AI". [147]
Risk of loss of control and human termination
The thesis that AI presents an existential threat for people, and that this danger requires more attention, is questionable however has been backed in 2023 by numerous public figures, AI researchers and CEOs of AI companies such as Elon Musk, Bill Gates, Geoffrey Hinton, Yoshua Bengio, Demis Hassabis and Sam Altman. [151] [152]
In 2014, Stephen Hawking slammed extensive indifference:
So, dealing with possible futures of incalculable benefits and dangers, the experts are surely doing everything possible to ensure the very best outcome, right? Wrong. If a remarkable alien civilisation sent us a message saying, 'We'll arrive in a couple of decades,' would we simply reply, 'OK, call us when you get here-we'll leave the lights on?' Probably not-but this is more or less what is occurring with AI. [153]
The potential fate of humankind has actually often been compared to the fate of gorillas threatened by human activities. The comparison specifies that higher intelligence permitted humanity to dominate gorillas, which are now vulnerable in methods that they could not have actually expected. As a result, the gorilla has actually become a threatened species, not out of malice, however simply as a security damage from human activities. [154]
The skeptic Yann LeCun considers that AGIs will have no desire to dominate humankind which we must beware not to anthropomorphize them and interpret their intents as we would for human beings. He said that people won't be "clever adequate to create super-intelligent makers, yet ridiculously silly to the point of providing it moronic goals with no safeguards". [155] On the other side, the concept of crucial merging suggests that practically whatever their goals, intelligent agents will have factors to attempt to survive and acquire more power as intermediary actions to achieving these objectives. And that this does not need having emotions. [156]
Many scholars who are concerned about existential danger advocate for more research into fixing the "control issue" to answer the concern: what types of safeguards, algorithms, or architectures can programmers implement to maximise the probability that their recursively-improving AI would continue to behave in a friendly, instead of harmful, manner after it reaches superintelligence? [157] [158] Solving the control problem is made complex by the AI arms race (which could lead to a race to the bottom of security preventative measures in order to launch items before rivals), [159] and the use of AI in weapon systems. [160]
The thesis that AI can pose existential danger likewise has detractors. Skeptics generally state that AGI is not likely in the short-term, or that concerns about AGI sidetrack from other problems related to existing AI. [161] Former Google fraud czar Shuman Ghosemajumder considers that for many individuals outside of the technology market, existing chatbots and LLMs are already viewed as though they were AGI, leading to further misconception and fear. [162]
Skeptics sometimes charge that the thesis is crypto-religious, with an illogical belief in the possibility of superintelligence changing an illogical belief in an omnipotent God. [163] Some scientists believe that the interaction projects on AI existential danger by certain AI groups (such as OpenAI, Anthropic, DeepMind, and Conjecture) might be an at effort at regulative capture and to pump up interest in their items. [164] [165]
In 2023, the CEOs of Google DeepMind, OpenAI and Anthropic, in addition to other market leaders and scientists, released a joint statement asserting that "Mitigating the risk of termination from AI need to be a global concern together with other societal-scale dangers such as pandemics and nuclear war." [152]
Mass joblessness
Researchers from OpenAI approximated that "80% of the U.S. labor force might have at least 10% of their work tasks affected by the intro of LLMs, while around 19% of employees might see a minimum of 50% of their tasks impacted". [166] [167] They think about workplace employees to be the most exposed, for instance mathematicians, accounting professionals or web designers. [167] AGI could have a better autonomy, ability to make decisions, to user interface with other computer system tools, however likewise to control robotized bodies.
According to Stephen Hawking, the result of automation on the quality of life will depend on how the wealth will be rearranged: [142]
Everyone can delight in a life of elegant leisure if the machine-produced wealth is shared, or most individuals can wind up miserably bad if the machine-owners effectively lobby against wealth redistribution. So far, the trend appears to be towards the second option, with technology driving ever-increasing inequality
Elon Musk considers that the automation of society will need governments to adopt a universal fundamental income. [168]
See also
Artificial brain - Software and hardware with cognitive capabilities comparable to those of the animal or human brain
AI effect
AI safety - Research area on making AI safe and beneficial
AI alignment - AI conformance to the designated objective
A.I. Rising - 2018 film directed by Lazar Bodroža
Artificial intelligence
Automated artificial intelligence - Process of automating the application of artificial intelligence
BRAIN Initiative - Collaborative public-private research study effort announced by the Obama administration
China Brain Project
Future of Humanity Institute - Defunct Oxford interdisciplinary research centre
General video game playing - Ability of synthetic intelligence to play various video games
Generative expert system - AI system capable of producing material in action to triggers
Human Brain Project - Scientific research study project
Intelligence amplification - Use of infotech to augment human intelligence (IA).
Machine principles - Moral behaviours of man-made devices.
Moravec's paradox.
Multi-task learning - Solving multiple maker finding out jobs at the very same time.
Neural scaling law - Statistical law in device knowing.
Outline of expert system - Overview of and topical guide to artificial intelligence.
Transhumanism - Philosophical movement.
Synthetic intelligence - Alternate term for or kind of expert system.
Transfer learning - Machine knowing strategy.
Loebner Prize - Annual AI competition.
Hardware for expert system - Hardware specifically created and optimized for expert system.
Weak synthetic intelligence - Form of synthetic intelligence.
Notes
^ a b See below for the origin of the term "strong AI", and see the academic meaning of "strong AI" and weak AI in the short article Chinese room.
^ AI creator John McCarthy composes: "we can not yet identify in general what type of computational procedures we want to call smart. " [26] (For a discussion of some meanings of intelligence used by artificial intelligence scientists, see viewpoint of expert system.).
^ The Lighthill report specifically slammed AI's "grand goals" and led the taking apart of AI research in England. [55] In the U.S., DARPA ended up being figured out to fund only "mission-oriented direct research, instead of fundamental undirected research". [56] [57] ^ As AI creator John McCarthy writes "it would be a great relief to the remainder of the employees in AI if the creators of brand-new basic formalisms would express their hopes in a more safeguarded form than has actually in some cases been the case." [61] ^ In "Mind Children" [122] 1015 cps is used. More just recently, in 1997, [123] Moravec argued for 108 MIPS which would roughly correspond to 1014 cps. Moravec talks in regards to MIPS, not "cps", which is a non-standard term Kurzweil presented.
^ As specified in a standard AI textbook: "The assertion that devices could potentially act intelligently (or, possibly better, act as if they were smart) is called the 'weak AI' hypothesis by philosophers, and the assertion that makers that do so are in fact thinking (instead of simulating thinking) is called the 'strong AI' hypothesis." [121] ^ Alan Turing made this point in 1950. [36] References
^ Krishna, Sri (9 February 2023). "What is artificial narrow intelligence (ANI)?". VentureBeat. Retrieved 1 March 2024. ANI is developed to perform a single job.
^ "OpenAI Charter". OpenAI. Retrieved 6 April 2023. Our mission is to ensure that synthetic basic intelligence benefits all of humanity.
^ Heath, Alex (18 January 2024). "Mark Zuckerberg's brand-new objective is developing synthetic general intelligence". The Verge. Retrieved 13 June 2024. Our vision is to build AI that is better than human-level at all of the human senses.
^ Baum, Seth D. (2020 ). A Survey of Artificial General Intelligence Projects for Ethics, Risk, and Policy (PDF) (Report). Global Catastrophic Risk Institute. Retrieved 28 November 2024. 72 AGI R&D tasks were determined as being active in 2020.
^ a b c "AI timelines: What do specialists in artificial intelligence anticipate for the future?". Our World in Data. Retrieved 6 April 2023.
^ Metz, Cade (15 May 2023). "Some Researchers Say A.I. Is Already Here, Stirring Debate in Tech Circles". The New York City Times. Retrieved 18 May 2023.
^ "AI leader Geoffrey Hinton quits Google and warns of risk ahead". The New York Times. 1 May 2023. Retrieved 2 May 2023. It is difficult to see how you can prevent the bad actors from using it for bad things.
^ Bubeck, Sébastien; Chandrasekaran, Varun; Eldan, Ronen; Gehrke, Johannes; Horvitz, Eric (2023 ). "Sparks of Artificial General Intelligence: Early try outs GPT-4". arXiv preprint. arXiv:2303.12712. GPT-4 shows stimulates of AGI.
^ Butler, Octavia E. (1993 ). Parable of the Sower. Grand Central Publishing. ISBN 978-0-4466-7550-5. All that you touch you alter. All that you alter modifications you.
^ Vinge, Vernor (1992 ). A Fire Upon the Deep. Tor Books. ISBN 978-0-8125-1528-2. The Singularity is coming.
^ Morozov, Evgeny (30 June 2023). "The True Threat of Artificial Intelligence". The New York City Times. The genuine threat is not AI itself but the method we deploy it.
^ "Impressed by expert system? Experts state AGI is following, and it has 'existential' threats". ABC News. 23 March 2023. Retrieved 6 April 2023. AGI might pose existential dangers to humankind.
^ Bostrom, Nick (2014 ). Superintelligence: Paths, Dangers, Strategies. Oxford University Press. ISBN 978-0-1996-7811-2. The very first superintelligence will be the last development that humanity needs to make.
^ Roose, Kevin (30 May 2023). "A.I. Poses 'Risk of Extinction,' Industry Leaders Warn". The New York Times. Mitigating the threat of termination from AI must be an international top priority.
^ "Statement on AI Risk". Center for AI Safety. Retrieved 1 March 2024. AI professionals caution of risk of termination from AI.
^ Mitchell, Melanie (30 May 2023). "Are AI's Doomsday Scenarios Worth Taking Seriously?". The New York City Times. We are far from producing makers that can outthink us in basic methods.
^ LeCun, Yann (June 2023). "AGI does not present an existential danger". Medium. There is no factor to fear AI as an existential threat.
^ Kurzweil 2005, p. 260.
^ a b Kurzweil, Ray (5 August 2005), "Long Live AI", Forbes, archived from the initial on 14 August 2005: Kurzweil explains strong AI as "machine intelligence with the complete range of human intelligence.".
^ "The Age of Artificial Intelligence: George John at TEDxLondonBusinessSchool 2013". Archived from the initial on 26 February 2014. Retrieved 22 February 2014.
^ Newell & Simon 1976, This is the term they utilize for "human-level" intelligence in the physical symbol system hypothesis.
^ "The Open University on Strong and Weak AI". Archived from the original on 25 September 2009. Retrieved 8 October 2007.
^ "What is synthetic superintelligence (ASI)?|Definition from TechTarget". Enterprise AI. Retrieved 8 October 2023.
^ "Artificial intelligence is changing our world - it is on everybody to make sure that it works out". Our World in Data. Retrieved 8 October 2023.
^ Dickson, Ben (16 November 2023). "Here is how far we are to accomplishing AGI, according to DeepMind". VentureBeat.
^ McCarthy, John (2007a). "Basic Questions". Stanford University. Archived from the initial on 26 October 2007. Retrieved 6 December 2007.
^ This list of smart qualities is based upon the subjects covered by significant AI textbooks, including: Russell & Norvig 2003, Luger & Stubblefield 2004, Poole, Mackworth & Goebel 1998 and Nilsson 1998.
^ Johnson 1987.
^ de Charms, R. (1968 ). Personal causation. New York: Academic Press.
^ a b Pfeifer, R. and Bongard J. C., How the body forms the way we believe: a brand-new view of intelligence (The MIT Press, 2007). ISBN 0-2621-6239-3.
^ White, R. W. (1959 ). "Motivation reassessed: The idea of proficiency". Psychological Review. 66 (5 ): 297-333. doi:10.1037/ h0040934. PMID 13844397. S2CID 37385966.
^ White, R. W. (1959 ). "Motivation reassessed: The concept of skills". Psychological Review. 66 (5 ): 297-333. doi:10.1037/ h0040934. PMID 13844397. S2CID 37385966.
^ Muehlhauser, Luke (11 August 2013). "What is AGI?". Machine Intelligence Research Institute. Archived from the initial on 25 April 2014. Retrieved 1 May 2014.
^ "What is Artificial General Intelligence (AGI)?|4 Tests For Ensuring Artificial General Intelligence". Talky Blog. 13 July 2019. Archived from the original on 17 July 2019. Retrieved 17 July 2019.
^ Kirk-Giannini, Cameron Domenico; Goldstein, Simon (16 October 2023). "AI is closer than ever to passing the Turing test for 'intelligence'. What occurs when it does?". The Conversation. Retrieved 22 September 2024.
^ a b Turing 1950.
^ Turing, Alan (1952 ). B. Jack Copeland (ed.). Can Automatic Calculating Machines Be Said To Think?. Oxford: Oxford University Press. pp. 487-506. ISBN 978-0-1982-5079-1.
^ "Eugene Goostman is a real kid - the Turing Test says so". The Guardian. 9 June 2014. ISSN 0261-3077. Retrieved 3 March 2024.
^ "Scientists contest whether computer system 'Eugene Goostman' passed Turing test". BBC News. 9 June 2014. Retrieved 3 March 2024.
^ Jones, Cameron R.; Bergen, Benjamin K. (9 May 2024). "People can not identify GPT-4 from a human in a Turing test". arXiv:2405.08007 [cs.HC]
^ Varanasi, Lakshmi (21 March 2023). "AI models like ChatGPT and GPT-4 are acing whatever from the bar examination to AP Biology. Here's a list of challenging tests both AI variations have passed". Business Insider. Retrieved 30 May 2023.
^ Naysmith, Caleb (7 February 2023). "6 Jobs Artificial Intelligence Is Already Replacing and How Investors Can Take Advantage Of It". Retrieved 30 May 2023.
^ Turk, Victoria (28 January 2015). "The Plan to Replace the Turing Test with a 'Turing Olympics'". Vice. Retrieved 3 March 2024.
^ Gopani, Avi (25 May 2022). "Turing Test is unreliable. The Winograd Schema is obsolete. Coffee is the response". Analytics India Magazine. Retrieved 3 March 2024.
^ Bhaimiya, Sawdah (20 June 2023). "DeepMind's co-founder suggested evaluating an AI chatbot's ability to turn $100,000 into $1 million to determine human-like intelligence". Business Insider. Retrieved 3 March 2024.
^ Suleyman, Mustafa (14 July 2023). "Mustafa Suleyman: My new Turing test would see if AI can make $1 million". MIT Technology Review. Retrieved 3 March 2024.
^ Shapiro, Stuart C. (1992 ). "Expert System" (PDF). In Stuart C. Shapiro (ed.). Encyclopedia of Expert System (Second ed.). New York: John Wiley. pp. 54-57. Archived (PDF) from the original on 1 February 2016. (Section 4 is on "AI-Complete Tasks".).
^ Yampolskiy, Roman V. (2012 ). Xin-She Yang (ed.). "Turing Test as a Defining Feature of AI-Completeness" (PDF). Expert System, Evolutionary Computation and Metaheuristics (AIECM): 3-17. Archived (PDF) from the initial on 22 May 2013.
^ "AI Index: State of AI in 13 Charts". Stanford University Human-Centered Expert System. 15 April 2024. Retrieved 27 May 2024.
^ Crevier 1993, pp. 48-50.
^ Kaplan, Andreas (2022 ). "Artificial Intelligence, Business and Civilization - Our Fate Made in Machines". Archived from the original on 6 May 2022. Retrieved 12 March 2022.
^ Simon 1965, p. 96 priced estimate in Crevier 1993, p. 109.
^ "Scientist on the Set: An Interview with Marvin Minsky". Archived from the original on 16 July 2012. Retrieved 5 April 2008.
^ Marvin Minsky to Darrach (1970 ), priced quote in Crevier (1993, p. 109).
^ Lighthill 1973; Howe 1994.
^ a b NRC 1999, "Shift to Applied Research Increases Investment".
^ Crevier 1993, pp. 115-117; Russell & Norvig 2003, pp. 21-22.
^ Crevier 1993, p. 211, Russell & Norvig 2003, p. 24 and see likewise Feigenbaum & McCorduck 1983.
^ Crevier 1993, pp. 161-162, 197-203, 240; Russell & Norvig 2003, p. 25.
^ Crevier 1993, pp. 209-212.
^ McCarthy, John (2000 ). "Reply to Lighthill". Stanford University. Archived from the initial on 30 September 2008. Retrieved 29 September 2007.
^ Markoff, John (14 October 2005). "Behind Expert system, a Squadron of Bright Real People". The New York Times. Archived from the initial on 2 February 2023. Retrieved 18 February 2017. At its low point, some computer system scientists and software engineers prevented the term expert system for fear of being deemed wild-eyed dreamers.
^ Russell & Norvig 2003, pp. 25-26
^ "Trends in the Emerging Tech Hype Cycle". Gartner Reports. Archived from the original on 22 May 2019. Retrieved 7 May 2019.
^ a b Moravec 1988, p. 20
^ Harnad, S. (1990 ). "The Symbol Grounding Problem". Physica D. 42 (1-3): 335-346. arXiv: cs/9906002. Bibcode:1990 PhyD ... 42..335 H. doi:10.1016/ 0167-2789( 90 )90087-6. S2CID 3204300.
^ Gubrud 1997
^ Hutter, Marcus (2005 ). Universal Artificial Intelligence: Sequential Decisions Based Upon Algorithmic Probability. Texts in Theoretical Computer Science an EATCS Series. Springer. doi:10.1007/ b138233. ISBN 978-3-5402-6877-2. S2CID 33352850. Archived from the initial on 19 July 2022. Retrieved 19 July 2022.
^ Legg, Shane (2008 ). Machine Super Intelligence (PDF) (Thesis). University of Lugano. Archived (PDF) from the initial on 15 June 2022. Retrieved 19 July 2022.
^ Goertzel, Ben (2014 ). Artificial General Intelligence. Lecture Notes in Computer Technology. Vol. 8598. Journal of Artificial General Intelligence. doi:10.1007/ 978-3-319-09274-4. ISBN 978-3-3190-9273-7. S2CID 8387410.
^ "Who coined the term "AGI"?". goertzel.org. Archived from the original on 28 December 2018. Retrieved 28 December 2018., through Life 3.0: 'The term "AGI" was popularized by ... Shane Legg, Mark Gubrud and Ben Goertzel'
^ Wang & Goertzel 2007
^ "First International Summer School in Artificial General Intelligence, Main summer season school: June 22 - July 3, 2009, OpenCog Lab: July 6-9, 2009". Archived from the initial on 28 September 2020. Retrieved 11 May 2020.
^ "Избираеми дисциплини 2009/2010 - пролетен триместър" [Elective courses 2009/2010 - spring trimester] Факултет по математика и информатика [Faculty of Mathematics and Informatics] (in Bulgarian). Archived from the original on 26 July 2020. Retrieved 11 May 2020.
^ "Избираеми дисциплини 2010/2011 - зимен триместър" [Elective courses 2010/2011 - winter season trimester] Факултет по математика и информатика [Faculty of Mathematics and Informatics] (in Bulgarian). Archived from the initial on 26 July 2020. Retrieved 11 May 2020.
^ Shevlin, Henry; Vold, Karina; Crosby, Matthew; Halina, Marta (4 October 2019). "The limitations of device intelligence: Despite development in maker intelligence, artificial general intelligence is still a significant difficulty". EMBO Reports. 20 (10 ): e49177. doi:10.15252/ embr.201949177. ISSN 1469-221X. PMC 6776890. PMID 31531926.
^ Bubeck, Sébastien; Chandrasekaran, Varun; Eldan, Ronen; Gehrke, Johannes; Horvitz, Eric; Kamar, Ece; Lee, Peter; Lee, Yin Tat; Li, Yuanzhi; Lundberg, Scott; Nori, Harsha; Palangi, Hamid; Ribeiro, Marco Tulio; Zhang, Yi (27 March 2023). "Sparks of Artificial General Intelligence: Early experiments with GPT-4". arXiv:2303.12712 [cs.CL]
^ "Microsoft Researchers Claim GPT-4 Is Showing "Sparks" of AGI". Futurism. 23 March 2023. Retrieved 13 December 2023.
^ Allen, Paul; Greaves, Mark (12 October 2011). "The Singularity Isn't Near". MIT Technology Review. Retrieved 17 September 2014.
^ Winfield, Alan. "Artificial intelligence will not turn into a Frankenstein's monster". The Guardian. Archived from the initial on 17 September 2014. Retrieved 17 September 2014.
^ Deane, George (2022 ). "Machines That Feel and Think: The Role of Affective Feelings and Mental Action in (Artificial) General Intelligence". Artificial Life. 28 (3 ): 289-309. doi:10.1162/ artl_a_00368. ISSN 1064-5462. PMID 35881678. S2CID 251069071.
^ a b c Clocksin 2003.
^ Fjelland, Ragnar (17 June 2020). "Why basic expert system will not be recognized". Humanities and Social Sciences Communications. 7 (1 ): 1-9. doi:10.1057/ s41599-020-0494-4. hdl:11250/ 2726984. ISSN 2662-9992. S2CID 219710554.
^ McCarthy 2007b.
^ Khatchadourian, Raffi (23 November 2015). "The Doomsday Invention: Will expert system bring us paradise or damage?". The New Yorker. Archived from the initial on 28 January 2016. Retrieved 7 February 2016.
^ Müller, V. C., & Bostrom, N. (2016 ). Future development in expert system: A survey of skilled viewpoint. In Fundamental concerns of synthetic intelligence (pp. 555-572). Springer, Cham.
^ Armstrong, Stuart, and Kaj Sotala. 2012. "How We're Predicting AI-or Failing To." In Beyond AI: Artificial Dreams, modified by Jan Romportl, Pavel Ircing, Eva Žáčková, Michal Polák and Radek Schuster, 52-75. Plzeň: University of West Bohemia
^ "Microsoft Now Claims GPT-4 Shows 'Sparks' of General Intelligence". 24 March 2023.
^ Shimek, Cary (6 July 2023). "AI Outperforms Humans in Creativity Test". Neuroscience News. Retrieved 20 October 2023.
^ Guzik, Erik E.; Byrge, Christian; Gilde, Christian (1 December 2023). "The creativity of devices: AI takes the Torrance Test". Journal of Creativity. 33 (3 ): 100065. doi:10.1016/ j.yjoc.2023.100065. ISSN 2713-3745. S2CID 261087185.
^ Arcas, Blaise Agüera y (10 October 2023). "Artificial General Intelligence Is Already Here". Noema.
^ Zia, Tehseen (8 January 2024). "Unveiling of Large Multimodal Models: Shaping the Landscape of Language Models in 2024". Unite.ai. Retrieved 26 May 2024.
^ "Introducing OpenAI o1-preview". OpenAI. 12 September 2024.
^ Knight, Will. "OpenAI Announces a New AI Model, Code-Named Strawberry, That Solves Difficult Problems Step by Step". Wired. ISSN 1059-1028. Retrieved 17 September 2024.
^ "OpenAI Employee Claims AGI Has Been Achieved". Orbital Today. 13 December 2024. Retrieved 27 December 2024.
^ "AI Index: State of AI in 13 Charts". hai.stanford.edu. 15 April 2024. Retrieved 7 June 2024.
^ "Next-Gen AI: OpenAI and Meta's Leap Towards Reasoning Machines". Unite.ai. 19 April 2024. Retrieved 7 June 2024.
^ James, Alex P. (2022 ). "The Why, What, and How of Artificial General Intelligence Chip Development". IEEE Transactions on Cognitive and Developmental Systems. 14 (2 ): 333-347. arXiv:2012.06338. doi:10.1109/ TCDS.2021.3069871. ISSN 2379-8920. S2CID 228376556. Archived from the initial on 28 August 2022. Retrieved 28 August 2022.
^ Pei, Jing; Deng, Lei; Song, Sen; Zhao, Mingguo; Zhang, Youhui; Wu, Shuang; Wang, Guanrui; Zou, Zhe; Wu, Zhenzhi; He, Wei; Chen, Feng; Deng, Ning; Wu, Si;
