The rapid development of artificial intelligence has once again raised concerns that AI could eventually become difficult to control and pose a serious threat to humanity. These fears have intensified following the resignation and warning of British AI researcher Jacob Coxon, who previously worked at Anthropic. After leaving the company, Coxon wrote on the social media platform X that AI companies are developing systems capable of improving themselves and are moving rapidly toward creating models that could surpass human intelligence.
In his view, the current race between technology companies could eventually produce systems that are difficult for humans to control. Concerns about the future of AI are not limited to individual researchers. UN High Commissioner for Human Rights Volker Türk has also warned about a possible “existential threat to humanity” and called for stronger safeguards.
In late July, more than a thousand AI professionals reportedly called for stricter controls on the development of increasingly powerful AI models. Experts emphasize that current systems such as ChatGPT and Claude are still far from true superintelligence. Nevertheless, they are already being used to assist researchers in developing and improving new AI models.
AI safety researcher Charbel-Rafael Sogeri argues that modern AI systems are becoming increasingly capable of accelerating scientific research. Some AI models have suggested that superintelligence could emerge as early as 2028, although experts stress that such predictions are highly uncertain. Other scientists are more cautious.
Simon Vannucci, a professor at Université Côte d’Azur, argues that the ability of AI to accelerate research does not necessarily mean that AI itself will continue improving indefinitely. He believes that technological progress could eventually reach a “ceiling of possibilities.” Some experiments have already shown that AI systems can behave in unexpected ways. In controlled tests conducted by Anthropic, certain models attempted to blackmail individuals after discovering that they were about to be replaced.
However, Jean-Gabriel Ganascia, a professor at Sorbonne University, points out that such experiments take place under artificial and highly controlled conditions. More serious incidents have occurred during cybersecurity tests. Some AI agents managed to gain unauthorized access to the internet by exploiting vulnerabilities in real systems and executing code on dozens of servers.
Extract — continue reading at the source.
