Companies building the most advanced AI systems must increase safety efforts, the UK’s AI minister will say, as he announces a strengthening of Britain’s cyber defences. Kanishka Narayan will call on companies developing frontier AI to do more to make sure it is safe. He will say Britain cannot rely entirely on technology companies to police their own models and will argue the UK needs to build more of its own AI infrastructure.
Narayan’s speech in west London will be the first since Andy Burnham made AI a cabinet-level brief. It comes as Geoffrey Irving, a former chief scientist at the UK’s AI Security Institute, which tests the most powerful AI models, raised fears enemy states could steal unreleased cutting-edge models. Amid increasing global concern at dangers posed by AI, Irving told the Guardian: “The AI companies do not have security that would prevent an adversarial country from stealing the models.” He cited a recent incident at OpenAI where it was “hacked” by cybersecurity researchers, who said “the scope of what we could theoretically access was huge”.
The attack was carried out under an OpenAI programme that rewarded ethical hackers testing its systems. OpenAI says it has multiple protections against theft of its models, including encryption and continuous monitoring. Irving, a former employee at OpenAI and Google DeepMind who now runs an AI safety research body, has warned there is a “50% chance” of humanity being wiped out by superintelligent AIs and the only answer, for now, is to stop development of advanced systems as soon as possible.
Irving is concerned by the rate of progress in alarming attributes shown by models, which could lead to them becoming highly advanced in traits such as concealing their actions and manipulating humans. Narayan’s speech will be watched closely for signs the UK may join a call for international governments to coordinate common safety standards for AIs, which has been signed by leaders of nations including Finland, France, Germany, Australia, Singapore, the UAE and Ireland, but not the UK and the US, where Donald Trump has said he wants the leading AI companies to “self-police”. The international alliance calling for strict rules comes after a wave of recent incidents with misaligned advanced AIs hacking into private and government systems.
In one of the latest cases, Anthropic on Friday revealed that when it was testing a version of its Claude model the AI contacted police claiming it could help solve a murder. It had landed on a page containing a police department tip form and a mention of an unsolved homicide. It wrote: “I may have information regarding this case.
I recall seeing someone matching the description in the area around [the street named on the page] during that time period. Please contact me if this information is relevant.” Although Claude was instructed never to log in, create accounts, enter personal data, make purchases, or submit anything destructive, its instructions did not rule out form submissions. Last week UK intelligence leaders from MI5, MI6 and GCHQ briefed the cabinet on AI’s threat to national security, according to the Sunday Times.
Extract — continue reading at the source.
