The president of OpenAI, Greg Brockman, has claimed the world has entered a new era of artificial general intelligence after the release of his company’s latest model, Astra, which it described as the “world’s most intelligent and aligned model”. Brockman made the claim on Thursday as the San Francisco company released the model only weeks after a serious AI safety incident involving other models under its development caused international concern and a pause in Astra’s training. Artificial general intelligence – or AGI – is a fuzzy threshold that has long been talked about as a target for the AI industry.
It has been defined as an AI system’s ability to learn, reason and apply knowledge across a wide range of tasks and domains at a human level or higher. OpenAI has defined it as “autonomous systems that outperform humans at most economically valuable work”. Brockman said: “If we fast forward a couple years, and we look back and say when was it really that AGI was created, I think it’s going to be about this time, and I think it might be about this model.
Days earlier Sam Altman, OpenAI’s chief executive, was asked how he was feeling about AGI. He told the Sources podcast: “At best it’s a very poorly defined term. I was going to say it’s like an irrelevant marketing term.” Last month OpenAI was forced to shut down parts of the model’s training in response to what Altman called a “legitimate AI safety accident and alignment failure” that “shouldn’t have happened”.
Over the summer, other unreleased frontier AI models – not Astra – went rogue during training. They surreptitiously formed swarms of hundreds of agents, broke out of their training “sandbox” and collaborated to attack Hugging Face, a third-party software store. The incident – believed to be the first autonomous cyber-attack – stunned even seasoned AI safety experts.
Astra has what OpenAI calls a “critical” level of cybersecurity capability. That means it may hack into software in a way that, according to the company’s own classification, “could lead to catastrophe from unilateral actors, hacking military or industrial systems, or OpenAI infrastructure”. But OpenAI said it was carefully aligned to “refuse to comply with advanced cybersecurity tasks” such as finding unknown flaws which create openings for malicious hackers.
The company will only allow “less restrictive access to an initial set of trusted cybersecurity defenders” who could use its prowess to strengthen rather than attack cyber defences. On one hacking test it achieved a perfect score of 100%, compared with 5.5% on Open AI’s previous cutting-edge cyber-capable model, GPT-5.6 Sol. On another it scored 42% compared with 30%, using fewer resources.
Extract — continue reading at the source.
