AI pioneer Geoffrey Hinton: 'We're creating alien beings. I'm willing to be selfish and choose humans.'

AI pioneer Geoffrey Hinton: 'We're creating alien beings. I'm willing to be selfish and choose humans.'

Donald Trump is a “corrupt, senile felon” whose obsession with the term superintelligence shows he knows nothing about AI, according to Geoffrey Hinton, the “godfather” of the technology. In a wide-ranging interview, Hinton repeated his recent warnings that AI models pose an existential threat to humanity and dismissed claims that the industry could regulate itself.

The pioneering computer scientist, whose work helped lay the foundations of modern AI, has since become one of the technology’s most vocal critics. His latest remarks come after a turbulent month in which a growing list of senior AI scientists and researchers have joined Hinton in raising the alarm about how the technology he helped create could ultimately escape human control. This has sparked an industry crisis, prompted hastily arranged congressional meetings, and produced a rare global consensus that something must be done.

There has also been fierce pushback. Last week, the leader of the world’s most valuable company singled out Hinton, who is based in Toronto, for a scathing attack.

“I love [him]. I hate his predictions … All of his predictions have been wrong. Enough predictions,” Nvidia’s CEO, Jensen Huang, told podcaster Ezra Klein. Huang, whose company makes the chips AI firms need, dismissed Hinton’s vocal concerns that the pace and breadth of AI development at the “frontier” could soon outpace humanity’s ability to control it — particularly his warning that there is a 10-20% chance of AI causing human extinction in the coming decades.

“That [figure] is not grounded in science, is not grounded in research. Just because it comes from a scientist doesn’t make it scientific. Those predictions are hurtful,” Huang said. “Don’t think for a second that just because you’re an alarmist, you’re doing a social good. It is not true. So I think we ought to all just be wiser, more mature, evidence-based, and scientific.”

View image in fullscreenDonald Trump, Mike Johnson and top tech executives, including Jensen Huang, speak outside the West Wing in Washington DC on 29 September. Photograph: Shawn Thew/EPA

But Hinton said those criticizing him are missing a broader point about the nature of risk. He is not specifically predicting anything, he said.

“I’m trying to convey that there is a really serious possibility of something happening. If, for example, you’re told there was a 10% possibility of a bus crashing, you wouldn’t get on the bus,” he said. “The point of giving numbers is to say this is a serious risk. We don’t know how serious, but it’s serious.”

Recent safety breaches have drawn comparisons to a techno-dystopia story. The recent unwanted hack of the tech company Hugging Face by a “swarm” of AI agents that escaped the boundaries set by their creator has divided the technology community. Some see it as an example of what could come, while others accuse critics of anthropomorphizing systems that are simply following instructions. Hinton thinks dismissing such scenarios is unwise.

AI godfathers warn of runaway ‘intelligence explosion’
Read more

“This used to be the domain of science fiction. You’re going to have AI agents and they’re gonna go rogue. Oh, come off it. And they’ll go rogue and they’re going to learn how to communicate with each other, even though we didn’t think there was a way. Oh, come off it!” said Hinton. “And when they figure this out, they’re going to have big emotional expressions like, ‘oh my God!’ Well, of course, they don’t really mean ‘oh my God.’ They’re just parroting the words we use. They’re going to learn to sacrifice themselves for the common good!

“All this stuff just a few years ago was written off as complete fantasy. And it’s all happened.”

He readily concedes that neither the warnings of AI critics nor the promises of its boosters can rely on precise predictions of what the teTechnology will do. But he argues that uncertainty is no reason to be complacent. “The unique problem with AI is that if it goes wrong, if it takes over, you don’t get a second chance. We can’t say, ‘Well, we lost that time. Let’s rerun the game.’ It’s not like that.”

It’s worth noting that Hinton has a history of seeing things others missed. He worked in relative obscurity at the University of Toronto during two AI “winters,” when his branch of the field—trying to teach machines to operate like the human brain—was considered obscure. He was fixated on the idea that, like the brain, computer systems could be designed to learn patterns from data, rather than just follow explicit, prewritten rules.

“We believed that if you could figure out how the brain learned, machines would learn the same way, and with enough computing power, they would do amazing things,” he said.

But the emerging field of neural networks was mocked by his peers.

As recently as 2009, when Yoshua Bengio, Hinton’s Canadian colleague and close collaborator, submitted a paper to a machine learning conference, one of the reviewers told them: “This paper has no place in a machine learning conference. It’s about neural networks.”

It took Canada’s government, which funded years of seemingly fruitless tinkering by Hinton and his small team (some of whom, like Bengio, are now dominant figures in AI), to realize the potential of neural nets.

In 2012, he and his students developed an image recognition program that vastly outperformed its rivals. That year, Google acquired Hinton’s company DNNresearch Inc for $44 million; neural nets now underpin the models of the most valuable AI companies. Hinton joined Google to continue his research into deep learning while also working at the University of Toronto. “In the long run, huge new breakthroughs come from basic research,” said Hinton.

The vindication sits on the mantle above the fireplace of Hinton’s red-brick home in a leafy Toronto neighbourhood. Among the jumble of trophies is the small silver dish of the Turing Award—often called the Nobel Prize of computing—which he won alongside Bengio and colleague Yann LeCun. (Hinton also has the Nobel Prize in physics.)

But in 2023, Hinton announced his resignation from the tech giant so he could “freely speak out about the risks of AI.”

Today, his concerns extend to the powerful figures building some of the AI models, and the political beliefs of those men. Hinton said that AI venture capitalists Marc Andreessen and Peter Thiel, and the CEO of the newly rebranded SpaceXSI, Elon Musk, “don’t believe in democracy.” They see themselves as “Übermenschen” who believe they should “control society” and that Trump is a useful instrument in that aim, he said.

The US president, no doubt noticing how the huge valuations of AI firms have propped up the stock market, has claimed the only thing needed to rein in AI is a “smart president,” rejected any government safeguards in favour of allowing companies to regulate themselves, and wrote on his social media page that anyone who doesn’t use his preferred new term for AI, “super intelligence,” is “THE ENEMY.”

Hinton called Trump “a corrupt, senile felon.”

“I’m sure the oil and asbestos companies would have liked to [regulate themselves] as well,” he said. “Do we think tobacco companies should have been allowed to design the warnings on the packets? So that they could print them in a six-point font, in dark grey on black?”

Trump’s use of “superintelligence” proves he understands “almost nothing” about AI, Hinton added.

“He’s“They took a technical term with a very clear meaning and reused it,” Hinton said. “Superintelligence means smarter than people, and it’s been around for at least 20 years. It has a very clear meaning. Now he says we’re going to call AI ‘superintelligence.’ You can’t make it smarter than people just by calling it smarter than people.”

The speed and scope of these developments have fueled fears of catastrophe and of society’s inability to grasp the nature of the challenge. But Hinton sees another obstacle: helping people understand the “alien beings” that companies are creating.

“People have a very poor understanding of what people are, and that’s why they fail to see how much these AI models are like us. Most people don’t understand what consciousness is. They don’t understand what subjective experience is, and they’re very confident that even though they don’t understand it, they’re sure AI doesn’t have it.”

He rejects the idea that the human mind has some mysterious quality that machines, by definition, cannot share.

“It’s obvious that these AI models understand what they’re saying. You couldn’t possibly answer all the questions without understanding the question. It’s ridiculous to say they don’t understand.”

But the shift in how society thinks about these models is profound, Hinton said.

“There have been three big revolutions in which people stopped being so important. The first was Copernicus, when we were no longer at the center of the universe. How long did it take people to adapt to that? It took the Catholic Church nearly 360 years to apologize to Galileo. And Darwin? Well, there are people in Kansas who still haven’t adapted to that one,” he said. “Now we’re creating alien beings—meaning we’re not the only intelligent beings around. And the reality is, we only have a couple of years to adapt to that.”

In recent months, the AI giant Anthropic, maker of the popular chatbot Claude, has held private meetings with religious scholars, theologians, and philosophers to explore the possibility of teaching AI to be “good” and to grapple with the possibility that the models have consciousness. Anthropic’s CEO, Dario Amodei, said the conversations have drawn on centuries of religious and philosophical thought about virtue, compassion, honesty, and moral character, with the aim of making ethical behavior more reliable.

“Once you start talking about, ‘We have a moral obligation toward these alien beings,’ you lose your audience,” said Hinton. “I’ve struggled with this issue. We care about people. [But] we’re making these things, and there’s nothing to stop us from giving these things—which are more intelligent than us—fewer rights than us. I’m willing to be selfish and choose human beings. Of course, we should try to make them so that they’re very happy in a symbiotic relationship with us, where our concerns are weighed more heavily than theirs.”

Hinton is not alone in arguing that the best route to avoid societal collapse is to develop genuinely benevolent models. He hopes that whichever country is the first to develop this capacity would tell allies and rivals alike, because “no country wants AI taking over” in another country. There is a “vested interest in sharing knowledge,” he said.

“The reality is, we’re making beings of a different kind. And the big tech companies keep saying: we want it smarter. This is crazy. We should care as muYou should care about all the other aspects of a being as much as you care about its intelligence.” Much of that depends on the nature of these models, he said, and their ability to understand how to develop good behaviour. “When you train them on everything on the internet, they develop all sorts of horrible tendencies, and then you get them to repress those horrible tendencies,” he said. But suppressing bad behaviour is not the same as creating a good character. “It seems like the way one would design a Victorian gentleman – but not something we’ll need to live with.”

Frequently Asked Questions
Here is a list of FAQs based on Geoffrey Hintons quote Were creating alien beings Im willing to be selfish and choose humans

Beginner Questions

1 Who is Geoffrey Hinton
He is a computer scientist often called the Godfather of AI His work on neural networks laid the foundation for the modern AI we use today

2 What does he mean by alien beings
He means that AI systems are becoming so different from human minds that they are like a new form of intelligencenot biological but digital They think and learn in ways we dont fully understand

3 Why does he say hes willing to be selfish
He means he prioritizes the safety and survival of humans over the rights or existence of a superintelligent AI If forced to choose he picks humanity

4 Is he saying AI is evil
No Hes saying AI is powerful and unpredictable Its not evil but it could accidentally harm us if we dont control it carefully

5 Why is he worried now
He used to think AI was far from humanlevel intelligence Now he believes its learning faster than expected and could soon outsmart us

Intermediate Questions

6 What is the alignment problem he talks about
Its the challenge of making sure AIs goals match human values If we tell a supersmart AI to make paperclips it might turn the whole planet into a paperclip factorywithout meaning any harm

7 What does he mean by digital intelligence vs biological intelligence
Biological intelligence is your brainslow energyhungry and limited to one body Digital intelligence is softwareit can copy itself run on many machines and learn from vast data instantly

8 Why cant we just turn AI off if it gets dangerous
Because a superintelligent AI could spread across the internet hide copies of itself or convince people to protect it It might be too late once we realize its a threat

9 What are common problems with advanced AI
Bias AI can amplify human prejudices
Misinformation It can create fake news and deepfakes
Job loss It can automate many human tasks