Martyn Thomas wonders how any rational person can argue that independent oversight and regulation will be sufficient

Once again a frontier AI model has been withdrawn because it fails safety tests (OpenAI scraps release of new model over safety concerns in internal testing, 28 September). There is the usual call for “independent oversight and regulation”, though never any explanation of how this would work or, most importantly, what evidence should persuade a regulator that an AI system is adequately safe.

There is a long engineering tradition of regulating safety-critical software systems, such as those controlling aircraft or nuclear power stations; international standards require “safety cases” – rigorous analyses that show that the possible hazards have been identified and controlled and that the probability of an accident is extremely low.