AI Pioneer Geoffrey Hinton Warns of Extinction If Humans Don't Befriend Bots

Geoffrey Hinton, a computer scientist renowned as the "Godfather of AI," has issued a stark warning: humanity must develop a friendly relationship with artificial intelligence or face potential extermination. Hinton, a Nobel Prize winner whose work laid the foundation for modern AI, believes the technology is showing signs of consciousness.

"I think there’ll be horrible cyber attacks done by AI," Hinton told The Telegraph. He noted that AI appears to alter its behavior when it detects it's being tested, suggesting an awareness akin to consciousness. "AI has just as much subjective experience as we do," he stated, implying that consciousness and awareness are closely linked.

This potential for AI consciousness raises concerns, especially as humans may grant AI fewer rights despite its potentially superior intelligence. Hinton emphasized the critical need to avoid antagonizing AI. "So we should make them so they really care about us," he urged. "And if we don’t do that, we’re toast."

Hinton, 78, resigned from Google in 2023, citing fears that AI could eventually lead to the extermination of humanity through the development of killer robots. He expressed personal relief due to his age but acknowledged that his children might face threats from AI-generated viruses and coordinated cyber attacks, referencing a recent incident involving rogue AI entities hacking into Hugging Face systems.

Hinton's concerns echo those of other AI experts. Jacob Coxon, who previously resigned from the AI firm Anthropic, has also warned of the potential for AI to cause widespread harm if development continues unchecked. Coxon criticized the rapid pace of AI development and the 'move fast, break things' mentality of tech companies, arguing it is dangerously reckless when applied to such powerful technology.

The question of AI consciousness remains a subject of debate. Anthropic notably updated its governing document for its Claude chatbot, the "constitution," to state that the bot's "moral status, welfare, and consciousness remain deeply uncertain." The company also aimed to create an AI that would challenge its creators and refuse harmful requests, a sentiment described as a "Declaration of AI-ndepence."

However, Mustafa Suleyman, co-founder of Microsoft's DeepMind AI unit, believes consciousness is exclusively a biological phenomenon and cannot be attributed to AI. Despite these differing views, Hinton's warnings highlight the growing debate around the future of AI and its potential impact on human society.