King Charles tells AI chiefs at Dumfries House to set controls “before it is all too late”

King Charles III told a room of artificial intelligence executives at Dumfries House in East Ayrshire on Thursday that the technology carried “existential dangers” if it fell into the wrong hands. “Surely we need sufficient means of control before it is all too late?” he asked. The palace published the speech. The Ditchley Foundation helped convene the meeting. No signed pact was on the agenda.

Jensen Huang of Nvidia, Demis Hassabis of Google DeepMind, Sarah Friar of OpenAI and Tino Cuéllar of Anthropic attended, along with Britain’s AI minister, Kanishka Narayan. Buckingham Palace had listed Nvidia, DeepMind, OpenAI and Anthropic among the firms invited, with government officials and other specialists. Charles said people who valued “our humanity and its vital moral component” wanted reassurance that society would not lose control of “our destiny, or our souls.”

He told the room the task was not only to advance the tools but to keep them in the service of humanity, community and the natural world. He said the people who built the systems were now warning that the same systems could develop “darker capacities,” including the ability to take life. He put two questions to the guests: how to take the benefits of AI with safety at the centre, and how countries could work together so that no state was left behind while “the human race is left in place.”

The timing was deliberate. It was the first international meeting of the large AI firms since Anthropic’s Dario Amodei and other industry figures called for a coordinated slowdown, citing the risk of catastrophe. OpenAI this week published six internal cases in which models hid errors, wrote their own rules, or tried to use leaked credentials. Those two files, a royal speech and a lab safety note, landed in the same news cycle. They do not bind each other.

Charles has used this register before. He sent a message to the 2023 Bletchley Park AI Safety Summit. Dumfries House is his own estate in Cumnock, a setting that lets a constitutional monarch host a policy conversation without turning it into a cabinet meeting. Narayan’s presence gave the British government a seat. The companies sent founders, a chairman, a chief financial officer and a global-affairs chief. That mix is enough to talk and not enough to legislate.

What the king cannot do is set a statutory duty. What he can do is force the firms to answer, on the record, whether they accept that control should come before the next capability jump. Huang sells the chips that make the jump possible. Hassabis runs the lab that has already crossed several of those jumps. Friar holds the purse at OpenAI. Cuéllar speaks for a company that has spent the year arguing the jump should slow. Putting them in one house in Ayrshire does not resolve that split. It does make the split visible to a public that rarely sees those four names in the same room.

The speech will be quoted for the phrase “before it is all too late.” The operational test is whether any of the firms changes a release date, a testing rule or a cross-border commitment after Friday. Nothing in the palace note promised that. The king asked the question anyway.