Scoopfeeds — Intelligent news, curated.
agentic-ai

A CERN for AI is a distraction; push for an IAEA instead

LessWrong · Jul 1, 2026, 6:30 AM

TL;DR: There are many conceivable versions of a “CERN for AI.” But the version that seems politically realistic (a new catch-up lab) probably would not do much for safety, while the versions that would materially improve safety (e.g., pause + merge of all companies) are probably unrealistic. So I see the CERN idea as a distraction, and not a particularly neglected one. I argue a better path is an international treaty with red lines now, with an IAEA-style verification body next: a sequencing that matches how the EU AI Act, the NPT/IAEA, and the Montreal Protocol actually developed. This is premised on the view that the main bottleneck in AI safety is enforcement and political will, not more R&D.Two premises underlie the rationale below:First, the bottleneck in AI safety is political will and the enforcement of best practices, not more R&D. With enough will, we move from Greenblatt's Plan D toward Plan A, achieving roughly an 80% risk reduction. Of course, the science of AI safety is far from mature, but we are also far from applying the best risk mitigation practices (see also the various other ratings, from SaferAI to FLI’s one) - of course, alignment is not solved, but also, xAI is still releasing Mecha Hitler…We already have sufficient verification mechanisms to get started. What's missing is the decision to use them (link).If you reject either premise, you might reach different conclusions.The CERN for AI is a distractionA recurring proposal in AI governance is to build a “CERN for AI”[1]. The CERN pitch is seductive. "Let's build together!" That's sexier than "we need to ban." You can leverage historical analogies (CERN for physics, NASA) and talk about national interest and science. It sounds like the smarter, more sophisticated play.[1]But I think that there are many problems with it.What do you even mean by CERN?Are you asking for:a) pausing AI development at OpenAI, etc, and on top of this pause, creating a new institution that conducts ALL the frontier dev

Article preview — originally published by LessWrong. Full story at the source.
Read full story on LessWrong → More top stories
Aggregated and edited by the Scoop newsroom. We surface news from LessWrong alongside other reporting so you can compare coverage in one place. Editorial policy · Corrections · About Scoop