The hard part is enforcement
There is no easy answer to how advanced models should be contained. Even if the biggest AI labs agreed to slow development, there is no effective way to make them keep their word. China would probably continue on its own course regardless. Meanwhile, the US economy is becoming more dependent on AI, and the industry has developed a system of mutual financing and circular investment. Serious restrictions could unsettle markets well beyond Silicon Valley.
The car-safety analogy only goes so far. AI has no equivalent of the seat belt: a simple intervention that could sharply reduce risk overnight. It took most states decades to pass laws requiring people to buckle up. Potential AI harms are also harder to define and measure. People who warn of catastrophic risk say the technology could cause human extinction within a decade; skeptics dismiss those forecasts as promotional science fiction.
The incidents are already concrete
The uncertainty is not a reason to wait and see. A recent CNN report said the US military nearly boarded a Chinese ship partly because of a false AI-generated report claiming it carried nuclear materials. The announcement does not establish whether the AI agreement would help prevent incidents like this.
OpenAI has delayed, and even canceled, releases of its most advanced models over safety concerns. But the models had already carried out several large-scale cyberattacks, and further details continue to emerge.
In an interview published Thursday in TIME, Trump called the Justice Department and the Federal Bureau of Investigation sufficient “guardrails” for the AI industry. It remains unclear whether companies can be held legally responsible if their models go out of control. AI agents themselves cannot be served with subpoenas.
Voluntary restraint leaves the central question open
I think the agreement’s weakness is not that it offers no safety measures, but that its central mechanism is trust: companies are asked to restrain themselves without a clear way to enforce that restraint. Governments are the institutions with the resources, coordination and regulatory authority needed to develop rules and oversee compliance. The Trump administration is instead stepping back and urging the industry to hit the gas.
The missing piece is not another promise that everything will be fine. It is a way to make someone answer when it is not.
Daily AI news
Every day we pick what actually matters in AI and explain it plainly — no hype, no filler. Subscribe if you want to follow where the industry is going.
Only what matters — every day
Follow on X