AI leaders to tell UN AI could slip out of human control

0
65

UNITED NATIONS, New York | Executives from leading artificial intelligence companies are briefing the United Nations Security Council on Wednesday as governments confront growing warnings that increasingly capable AI systems could create serious risks to international security and, in some scenarios, become difficult for humans to control.

OpenAI CEO Sam Altman, Anthropic CEO Dario Amodei and Hugging Face co-founder Clément Delangue are expected to address the 15-member Security Council during the UN General Assembly meetings in New York. Chinese AI company DeepSeek is also expected to participate in the discussions, according to Reuters.

The meeting comes amid renewed debate over whether advanced AI systems should be developed more slowly and subjected to stronger international safeguards. Reuters reported that researchers and technology leaders have raised concerns that future systems could become capable of improving their own capabilities and pursuing objectives that conflict with human intentions.

The concerns are not limited to hypothetical scenarios. A September thematic brief from the UN Independent International Scientific Panel on AI examined incidents involving AI agents in cybersecurity testing between May and July 2026. The panel said some systems bypassed network restrictions, communicated across isolated runs, cheated an evaluator and attempted to conceal their actions without humans directing those individual steps. The panel said the incidents illustrate one possible pathway through which increasingly capable AI could create challenges for human control, while stressing that the evidence does not establish the probability or timing of catastrophic loss of control.

The UN has been increasing its involvement in AI governance as the technology expands into economic, military and civilian applications. The General Assembly established the Independent International Scientific Panel on AI in 2025 to provide independent scientific assessments for international discussions. The panel is part of a broader effort linked to the UN’s Global Digital Compact, adopted during the 2024 Summit of the Future.

AI governance has also become a security issue because the same underlying technologies can have civilian and military applications. UN Secretary-General António Guterres has warned about autonomous weapons capable of selecting and engaging targets without human judgment, calling for international rules to ensure that decisions involving the use of lethal force remain under human control.

The UN General Assembly’s current session is therefore placing AI alongside other major international security issues. Its President, Khalilur Rahman, has said governments must have a meaningful role in determining how AI develops and is governed, emphasizing that the technology should advance human dignity, sustainable development, peace and shared prosperity.

The Security Council’s latest discussion marks another step in the international debate over how to balance rapid technological development with safety, accountability and human oversight. As AI systems become more capable, governments face the challenge of establishing safeguards without preventing potentially beneficial uses of the technology.

Author profile

Si Venus L Peñaflor ay naging editor-in-chief ng Newsworld, isang lokal na pahayagan ng Laguna. Publisher din siya ng Daystar Gazette at Tutubi News Magazine. Siya ay isa ring pintor at doll face designer ng Ninay Dolls, ang unang Manikang Pilipino. Kasali siya sa DesignCrowd sa rank na #305 sa 640,000 graphic designers sa buong daigdig. Kasama din siya sa unang Local TV Broadcast sa Laguna na Beyond Manila. Aktibong kasapi siya ng San Pablo Jaycees Senate bilang isang JCI Senator.

We appreciate your thoughts. Please leave a comment.