AI’s godfather and Nobel laureate Geoffrey Hinton is worried about the ‘consequences’ of the technology

Two trailblazers in artificial intelligence, John Hopfield and Geoffrey Hinton, were awarded the Nobel Prize in Physics on Tuesday for their foundational contributions to machine learning, which is transforming how we work and live. However, there’s no doubt that the technology is also feared for its potential to introduce new risks to humanity.

Geoffrey Hinton, often referred to as the "Godfather of AI," has also warned of the potential risks AI poses to humanity. Hinton, who co-developed the technique of backpropagation in the 1980s, a key driver in machine learning, recently voiced his concerns after receiving the Nobel Prize for his contributions.

Hinton predicted that AI would eventually have a "huge influence" on civilization, with profound benefits in areas like productivity and healthcare. "It would be comparable with the Industrial Revolution," he remarked in a discussion with the Royal Swedish Academy of Sciences. However, despite these potential advantages, Hinton raised a cautionary flag, stating, "We have no experience of what it's like to have things smarter than us. And it's going to be wonderful in many respects, but we also have to worry about a number of possible bad consequences, particularly the threat of these things getting out of control."

One of the primary fears surrounding AI is the possibility that advanced systems could eventually surpass human intelligence and, in Hinton’s words, "take control." He stepped down from his role at Google to freely speak about these dangers, echoing sentiments shared by other AI pioneers.

Meanwhile, Jean-Pierre Hopfield, another laureate, drew parallels between AI and other transformative technologies like nuclear energy and viruses, which have the potential to both benefit and harm society. In a recent conference, Hopfield referred to Orwellian dystopias and sci-fi scenarios like Kurt Vonnegut’s "Cat’s Cradle," highlighting the dangerous consequences AI could unintentionally bring about.

Hinton's protege, Nick Frosst, acknowledges Hinton's concerns but disagrees with the urgency. Frosst, now leading his own AI company, believes the current technology, such as neural networks and language models, doesn’t pose an existential threat yet. "Mostly we disagree on timescale," Frosst explained, noting that debates with Hinton on AI risks have been a frequent part of their relationship.

However, Hinton and fellow researchers, such as Yoshua Bengio, stress the importance of ensuring human control over AI systems before they outpace our understanding. Bengio stated, "We don't know the answer to these questions... and we should make sure we do before we build those machines." As AI continues to advance, the future remains both promising and uncertain, with the burden of navigating these uncharted waters resting squarely on humanity’s shoulders.