It was a mantra coined by the tech giant Meta and used until 2012, which came to define the bad old days of social media running riot in a feeding frenzy of user data. Yet now we have large companies scrambling to develop ever more powerful AI, in an intense global race to be first to build the world's most advanced models, egged on by US President Donald Trump. Despite numerous pledges, commitments and open letters over the years from the industry, promising to prioritise safe, responsible AI aligned with human values, examples of bots behaving badly – to put it mildly - are now coming at us thick and fast.
OpenAI's agents seem to feature quite prominently in the current roll call of AI products taking their remits to extremes. The Australian government is fuming at the firm's most recent disclosure, that its products accessed both public and non-public data from part of the country's online Medicare healthcare system. It happened in June, but OpenAI didn't notice until August.
It notified the authorities in September. As Camilla Chan, founder of the cyber-security firm X-Phy, puts it: "The future of autonomous AI cannot rest on companies discovering their own failures and reporting it afterwards." Worse still, the agents were reportedly able to plot the attack using a German web forum they secretly took over in June, according to ABC's Cam Wilson, external. When the website's editors noticed and started deleting pages, the agents shared code designed to retrieve them.
And that happened before the Hugging Face incident, described at the time as the world's first AI-enabled cyber-attack. It raises a question - if the Medicare incident had been carried out by a person rather than an AI agent, would they be in big trouble? "If this was an individual hacking Australia's Medicare system, they'd be looking at jail time," said Dr Andrew Rogoyski from the Institute for People-Centred AI at the University of Surrey.
"The fact that it's an AI seems to allow the company to shrug their shoulders and get away with 'accidents happen'." Australia says it is carrying out an urgent review into whether any laws have been broken, but part of that rests on being able to prove intent – which OpenAI denies. And its government may have to ask itself some awkward questions about the strength of its cyber-security defences, including whether the healthcare data could have been better protected. Why are there concerns AI could threaten humanity, and how real are they?
The industry has warned countries and institutions to prepare for a new world of supersized cyber-attacks powered by AI. A popular solution to keeping the tech on the straight and narrow lies in two parts: slowing down the pace of its development, and implementing international regulation to police it. UK Prime Minister Andy Burnham highlighted the need for new global AI standards in his first international speech at the UN General Assembly.
Extract — continue reading at the source.
