Key Highlights

  • OpenAI's Sam Altman, Anthropic's Dario Amodei and Hugging Face's Clement Delangue were due to brief the 15-member Security Council on AI risk.
  • The co-chair of the UN's Independent International Scientific Panel on AI also briefed, with France's foreign minister chairing.
  • Altman planned to urge benchmarks for measuring AI capabilities and assessing the safeguards companies put in place.
  • The US and China have discussed a notification system covering AI incidents that rise to a national security level.

Why the Council Is Involved

Executives from OpenAI, Anthropic and Hugging Face were due to brief the UN Security Council on Wednesday amid warnings that increasingly powerful AI systems could soon improve themselves, slip beyond human control and threaten international security. The session took place during the annual General Assembly gathering of world leaders.

OpenAI chief executive Sam Altman, Anthropic chief executive Dario Amodei and Hugging Face co-founder Clement Delangue were scheduled to address the 15-member council. Amodei was expected to appear remotely. French Foreign Minister Jean-Noel Barrot chaired the meeting, which France convened because, according to a French official, the security implications of AI had not received enough attention at the council.

A European diplomat said the aim was to highlight practical risks of AI losing control in ways that affect international security. The central question, the diplomat said, is whether algorithms interacting with each other could one day trigger a war.

What the Briefers Were Expected to Say

Altman planned to urge leaders to adopt benchmarks for measuring AI capabilities and for assessing the safeguards companies put in place, according to an OpenAI executive. The co-chair of the UN's Independent International Scientific Panel on AI, a Canadian researcher regarded as one of the field's pioneers, was also due to brief the council.

Council members, including the United States and China, were set to speak. Ahead of Xi Jinping's White House visit on Thursday, the two countries have discussed setting up a notification system for common goals and common threats covering AI incidents that rise to a national security level.

Hugging Face is itself the subject of an agreed Acquisition by Nvidia, a deal announced earlier this month.

Washington and the UN Diverge

Donald Trump told the General Assembly on Tuesday that he "rejects any attempt to construct a globalist scheme to control" AI. "We're going to encourage it, not rein it in," he said, adding that the technology would be watched closely through the Department of Justice.

UN Secretary-General Antonio Guterres has warned that rapidly advancing AI poses risks that cannot be ignored, a position at odds with Trump's. Guterres has long pushed for global AI governance and created a 39-member advisory body in 2023. The General Assembly then created the Independent International Scientific Panel last year. The Security Council first met on AI risks in 2023.