Charles tells AI chiefs to find controls before it is too late

King Charles III spent about 20 minutes on Thursday at Dumfries House in East Ayrshire telling the people who build large AI systems that control has to come before capability. "There seems urgency in adequately considering the existential dangers of such technologies falling into the wrong hands, and being used in potentially catastrophic ways," he said. "Surely we need sufficient means of control before it is all too late?"

The guest list was the point of the day. Nvidia founder Jensen Huang walked in with the king for the official photograph. Google DeepMind's Demis Hassabis sat with him. OpenAI sent chief financial officer Sarah Friar. Anthropic sent chief global affairs officer Tino Cuéllar. Britain's AI minister, Kanishka Narayan, was in the room. So was Paolo Benanti, a Franciscan who advises the Vatican on the same file. The Ditchley Foundation ran the discussion after the king left. The King's Trust, the King's Foundation and the Sustainable Markets Initiative co-hosted.

Prepared remarks released by Buckingham Palace set the register. "The decisions taken at this formative time will shape the world inherited by future generations. The task before you is not merely to advance technology, but to ensure that it remains firmly in the service of humanity, community and the natural world." In the hall he added praise for those "so deeply committed to harnessing Artificial Intelligence for good, so that we might see a future where human potential remains boundless, whilst technological development is carefully curated to enhance our success."

No document was signed. Delegates talked about whether a shared set of principles could be written. Palace language after the meeting stayed at that level: a conversation about whether an agreement was possible, not an agreement.

The timing was not accidental. Days earlier Anthropic chief executive Dario Amodei published an essay arguing that labs should slow capability gains on purpose. Sam Altman at OpenAI and Elon Musk at xAI both said they agreed with the direction of that argument. The Dumfries House session put four of the firms that would have to do the slowing in the same listed building as a minister and a papal adviser, under a monarch who cannot introduce a bill.

That constitutional limit is why the event matters less as policy and more as a record of who will sit in the same room. A British king can convene. He cannot regulate U.S. companies. Narayan can carry language back to Whitehall. He cannot bind California. Huang's presence is the hardest fact in the room, because Nvidia's chips sit under most of the training runs the other three firms care about. If a slowdown is real, it runs through his order book.

Charles has used Dumfries House for years as a stage for causes that sit next to politics without entering it: architecture, farming, young people's work. AI is a larger object. He called the pace of development "both intriguing and deeply concerning." That sentence will be quoted. The follow-up that counts is whether the firms leave Scotland with a draft they are willing to put their names under, or with a group photograph and the same training schedules they arrived with.

Friday morning the systems those executives own will still be taking queries. The king will still be barred from the Commons. The gap between those two facts is the whole of Thursday's event.