EXEC TELLS FIRST UN COUNCIL MEETING THAT BIG TECH CAN'T BE TRUSTED TO GUARANTEE AI SAFETY

The handful of big tech companies leading the race to commercialize AI can’t be trusted to guarantee the safety of systems we don’t yet understand and that are prone to “chaotic or unpredictable behavior,” an artificial intelligence company executive told the first U.N. Security Council meeting on AI’s threats to global peace this week.

Jack Clark, co-founder of the AI company Anthropic, said that’s why the world must come together to prevent the technology’s misuse.

Clark, who says his company bends over backwards to train its AI chatbot to emphasize safety and caution, said the most useful things that can be done now “are to work on developing ways to test for capabilities, misuses and potential safety flaws of these systems.” Clark left OpenAI, creator of the best-known ChatGPT chatbot, to form Anthropic, whose competing AI product is called Claude.

He traced the growth of AI over the past decade to 2023 where new AI systems can beat military pilots in air fighting simulations, stabilize the plasma in nuclear fusion reactors, design components for next generation semiconductors, and inspect goods on production lines.

But while AI will bring huge benefits, its understanding of biology, for example, may also use an AI system that can produce biological weapons, he said.

Clark also warned of “potential threats to international peace, security and global stability” from two essential qualities of AI systems – their potential for misuse and their unpredictability “as well as the inherent fragility of them being developed by such a narrow set of actors.”

Clark stressed that across the world it’s the tech companies that have the sophisticated computers, large pools of data and capital to build AI systems and therefore they seem likely to continue to define their development

In a video briefing to the U.N.’s most powerful body, Clark also expressed hope that global action will succeed.

He said he’s encouraged to see many countries emphasize the importance of safety testing and evaluation in their AI proposals, including the European Union, China and the United States.