Multiple current and former Anthropic employees warned — and admitted — on Tuesday that the researchers building new AI models believe the technology could lead to humanity’s destruction by the end of the decade, reflecting the industry’s frenzy over reining in rapid development. Jacob Coxon, a former AI researcher at Anthropic, wrote on X that he resigned from the company on Tuesday because he believed the Dario Amodei-led company and OpenAI, his former employer, were “gambling with our lives” in how they improved the technology. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible – but I hear the same people express fear privately.
No other human activity poses this level of danger.” Anthropic did not respond to an immediate request for comment, but Coxon’s warnings were surprisingly affirmed by Evan Hubinger, Anthropic’s alignment scene lead, and Samuel Marks, who runs the company‘s scalable oversight division. Hubinger wrote the company did “earnestly believe AI could kill all humans” and that he thought it was a greater than 10% risk “within the next desk.” “I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to,” he wrote on X. Marks’ own X post, which he said he wrote in his personal capacity, said that AI researchers continue building the technology despite the risk of “human extinction” because of a financial incentive and the fear the technology would be developed by AI developers who may abuse its capabilities.
Anthropic as a company has called for a development slowdown since June, while OpenAI paired its debut of GPT-6 Astra last week, which it claimed pushed the world into an era of artificial general intelligence, with several warnings by company leaders and researchers that a slowdown was needed to improve safety conditions. Still, the industry sentiment has received pushback from the Trump administration, which has argued that slowing down development risks ceding the AI arms race to a rapidly evolving China. If they were to pull ahead of us on AI, then nothing else matters.”
Extract — continue reading at the source.
