Governing Global Existential Al Risks: Lessons From The International Atomic Energy Agency

The rapid advancement of data-based systems (DS) offers unparalleled opportunities for societal progress but also poses significant existential risks. Evidence suggests that the potential dangers of DS surpass those of nuclear weapons, yet regulatory oversight remains insufficient. The lessons learned from the field of nuclear technology (NT) and the establishment of the International Atomic Energy Agency (IAEA) offer valuable insights into how global cooperation and regulatory mechanisms can effectively manage complex technological risks, while at the same time fostering equitable technological progress. Cognisant of disparities between DS and NT, this brief proposes the establishment of an International Data-Based Systems Agency (IDA) within the United Nations (UN) system in partnership with the Group of Twenty (G20). By establishing IDA at the UN as a central regulatory authority, the international community can proactively address existential Al risks while harnessing the transformative potential of DS to advance the sustainable development goals (SDGs).