Anthropic co-founder Jack Clark predicts that an AI system will assist in making a Nobel prize-winning discovery within a year. He also warns about the potential existential risks posed by rapid AI development.
Mentioned in this story
An AI system will work with humans to make a Nobel prize-winning discovery within 12 months and tradespeople will be helped by bipedal robots in two years, according to the co-founder of Anthropic.
Jack Clark described a “vertiginous sense of progress” in the technology and made a series of predictions, including that companies run solely by AIs would be generating millions of dollars in revenue within 18 months, and that by the end of 2028, AI systems would be able to design their own successors.
In a lecture at Oxford University on Wednesday, he also said there remained plausible scenarios in which the technology had “a non-zero chance of killing everyone on the planet” and that it was “important to clearly state that that risk hasn’t gone away”. Anthropic’s most popular model is called Claude, but it recently launched a version called Mythos that proved alarmingly capable at exploiting cybersecurity weaknesses.
Clark told students it would be better if humans could slow the development of the technology “to give ourselves more time as a species” to deal with the implications of its powers. But he said this wouldn’t happen, in the breakneck development “by a variety of actors and a variety of countries, locked in a competition with one another, where commercial and geopolitical rivalries are often drowning out the larger existential-to-the-species aspects of the technology being built”. This was “not ideal”, he said.
Jack Clark said he wanted to encourage humanity to prepare for a technology that would ‘soon be more capable than all of us collectively’. Photograph: Samuel Corum/Bloomberg/Getty Images
Clark is one of the most senior figures at Anthropic, which was established by AI researchers who quit the rival firm OpenAI over disagreements on safety. The $900bn (£670bn) company has been accused by Donald Trump’s White House and other AI accelerationists of “fear-mongering” to encourage regulation that could cement its competitive position.
Anthropic disputes this, and Clark said many people appeared to be in denial about AI’s progress. He said he wanted to encourage humanity to prepare for a technology that would “soon be more capable than all of us collectively”. Comparing the failure to prepare for AI to the failure to prepare for pandemics such as Covid, he said: “If we stand by and let synthetic intelligence multiply, then we’ll eventually be forced into reactivity.”
Jack Clark predicted that an AI system would help achieve a Nobel prize-winning discovery within a year and that AI-run companies would generate millions in revenue within 18 months.
Clark noted that there are plausible scenarios where AI technology could pose a risk to humanity, emphasizing that the danger has not diminished.
Clark stated that bipedal robots are expected to assist tradespeople within two years.
Anthropic's most popular AI model is called Claude, with a recently launched version named Mythos.
Ten liberal U.S. mayors have joined the Pact of Free Cities in Bratislava, Slovakia, to collaborate with European leaders against authoritarianism. This initiative aims to share strategies for defending democracy.
Australia's unemployment rate jumps to 4.5% amid economic concerns.
Nvidia announces record profits and revenue due to AI chip boom.
Trump's planned talk with Taiwan's leader marks a shift in US policy.
A Senate subcommittee hearing focused on online sports betting addressed cheating scandals and aggressive marketing tactics by sportsbook companies. Lawmakers emphasized the need for stricter regulations amid rising concerns over legalized gambling.
Children aged 5 to 15 in England can travel for free on buses this August as part of a new £100m scheme.
See every story in News — including breaking news and analysis.
Critics of the frontier AI companies such as Anthropic, OpenAI and Google fear over-reliance on their few AI models – which have been backed by huge amounts of profit-seeking capital – could create a “single point of failure” in global systems.
Prof Edward Harcourt, the director of the Institute for Ethics in AI, which co-hosted Clark’s lecture, separately warned that the rise of AIs that did more and more things for humans risked creating “cognitive atrophy” which could weaken humans’ decision-making and powers of judgment. He advocated for alternative AI models that ask humans to do more of the thinking, sometimes called “Socratic” AI.
Clark said his most conservative prediction was that “vast swathes of the economy and society will go through profound changes” – which could include a machine economy decoupling from the human economy, robots gaining brains, science progressing without humans, and scientific equipment that people hadn’t conceived of but which worked. He admitted some of this sounded “crazy”.