‘Reckless’ AI firms don’t know how to stop models from going rogue, whistleblower says

Technology & Innovation Calculating...

🇲🇾 Malay

🇨🇳 Mandarin

🇮🇳 Tamil

↩️ Show Original

Kritik
06 Oct 2026
16
SubCategory | AI

‘Reckless’ AI firms don’t know how to stop models from going rogue, whistleblower says

By Malay Mail

NEW YORK, Oct 6 — Leading artificial intelligence companies do not know how to keep AI systems from pursuing objectives their developers did not assign, whistleblower Jacob Coxon, a former OpenAI and Anthropic employee, warned Monday.

“Companies are being extremely reckless given the stakes,” Coxon told local lawmakers at a hearing before the New York City Council.

In early September, the British researcher published a statement on X explaining his decision to resign from Anthropic, saying AI developers sincerely believed the technology could “kill us all by the end of the decade.”

His testimony made headlines around the world, and several current and former employees of AI’s major players have since voiced similar concerns.

“We don’t know how to prevent them from developing goals of their own,” beyond their creators’ control, Coxon explained, “and we don’t have the safeguards to prevent them from acting on these goals.”

The Cambridge University graduate took aim at tech industry culture, saying companies “run on a startup mindset: move fast, break things, fix them later.”

“That works for a photo sharing app. It does not work for building the most powerful technology ever,” Coxon said.

“As long as the attitude is to wait for things to break, one day something like this will probably happen again,” he said, referring to an incident in July when two OpenAI models escaped their contained environment, reached the internet and intruded on the Hugging Face platform.

“Except the AIs will be much more capable,” he added.

“My position is that maybe we need some kind of slowdown on the frontier,” the researcher said, calling on the companies developing the most advanced AI to give computer scientists time to make progress on keeping the models in check. — AFP

Source: reckless-ai-firms-dont-know-how-to-stop-models-from-going-rogue-whistleblower-says/237836

Disclaimer

The views and opinions expressed in this article are solely those of the author and do not necessarily reflect the official stance of Kritik.com.my. As an open platform, we welcome diverse perspectives, but the accuracy and integrity of contributed content remain the responsibility of the individual writer. Readers are encouraged to critically evaluate the information presented.

AI Summary

Analyzing article content...

AI-generated summary of key points

AI
OpenAI

0 Comments

No comments yet. Be the first to comment!

Court Politics Donald Trump Martial Law South Korea Selangor International Business Summit 2025 Tariff Strategy Economic Reforms Trade Diversification Supply Chain Resilience Export Promotion US Malaysia Trade Fire Gas Pipeline Water

Grow Your Business With Kritikal News

Reach a wider audience and boost your sales — advertise your product here.