Key AI governance, alignment, policy, and safety organizations
Thankfully there are organizations throughout the world dedicated to various aspects of the four pillars of AI, though each is unique in focus and approach.
80,000 Hours
80,000 Hours provides research and support to help talented people move into careers that tackle the world’s most pressing problems. After more than 10 years of research in key problem areas, we’re focused on helping people work on positively shaping the trajectory of AI because we think it presents the most serious and urgent challenges the world is facing right now.
Ada Lovelace Institute
The Ada Lovelace Institute is an independent research institute with a mission to ensure that data and AI work for people and society. We believe that a world where data and AI work for people and society is a world in which opportunities, benefits and privileges generated by data and AI are justly and equitably distributed and experienced.
AGORA
AGORA (AI GOvernance and Regulatory Archive) is a living collection of AI-relevant laws, regulations, standards, and other governance documents from the United States and around the world. Updated regularly, AGORA includes summaries, document text, thematic tags, and filters to help you quickly discover and analyze key developments in AI governance.
AI Alignment Forum
The AI Alignment Forum features a series of articles regarding AI alignment research. Top researchers in the field talk about cutting-edge ideas and potential solutions. These are the kinds of conversations that occur among colleagues working in labs or crossing paths at a research workshop. The forum also facilitates the onboarding of new researchers and contributors.
AI Now Institute
The AI Now Institute develops policy strategies to redirect away from the current trajectory: unbridled commercial surveillance, consolidation of power in very few companies, and a lack of public accountability. In the years since its founding, AI Now has set the bar for discourse-shaping work that focuses on the social consequences of AI and the industry behind it.
AISafety
AISafety, a community project, led by a few core members, aims to multiply global AI safety efforts through a centralized, comprehensive, and up-to-date resource hub. We work on this project because we care about AI safety. The two team members that receive compensation make project decisions based solely on what they believe will have the greatest impact. This approach has proven to be totally aligned with our funders’ goals.
The Alan Turing Institute
The Alan Turing Institute is the UK’s independent national institute for data science and artificial intelligence, with headquarters at the British Library
Data science and AI have the power to change the world. When the history of the 21st century is written, AI will have had as transformative an impact on society as any of the three previous phases of the industrial revolution.
Alignment Research Center
The Alignment Research Center (ARC) is a non-profit research organization whose mission is to align future machine learning systems with human interests. Our current research focus is developing a theoretical foundation for mechanistic explanations of neural network behavior.
Apollo Research
At Apollo Research, we investigate how scheming emerges, develop ways to detect it, and work to prevent the harm it could cause. AI systems will soon be deeply integrated into the global economy and everyday life. While this brings personal and societal benefits, it also introduces serious risks. We believe some of the most dangerous risks come from scheming frontier AI: advanced AI systems covertly pursuing misaligned objectives.
Center for AI Safety
The Center for AI Safety (CAIS) is a research and field-building nonprofit. We believe that artificial intelligence (AI) has the potential to profoundly benefit the world, provided that we can develop and use it safely. ur mission is to reduce societal-scale risks associated with AI by conducting safety research, building the field of AI safety researchers, and advocating for safety standards.
Center for Human-Compatible AI
The Center for Human-Compatible AI (CHAI) is a multi-institution research group with academic affiliates at a variety of other universities. Out goal is to develop the conceptual and technical wherewithal to reorient the general thrust of AI research towards provably beneficial systems.
Center for Long Term Cybersecurity
The Center for Long Term Cybersecurity (CLTC) is a premier hub for research and collaboration on public-interest cyber and AI security, housed within the University of California, Berkeley. Our community of students, researchers, and practitioners works to protect our shared digital life.
Center for Security and
Emerging Technology
The Center for Security and Emerging Technology (CSET), a policy research organization within Georgetown University’s Walsh School of Foreign Service, provides decision-makers with data-driven analysis on the security implications of emerging technologies.
Center for Strategic
& International Studies
The Center for Strategic & International Studies (CSIS) is a bipartisan, nonprofit policy research organization dedicated to advancing practical ideas to address the world’s greatest challenges. CSIS’s values work in concert toward the goal of making real-world impact.
Centre for the Study
of Existential Risk
The Centre for the Study of Existential Risk (CSER) fosters a reflective, global community of academics, technologists and policymakers, acting as a hub for those examining global catastrophic risks from many and often differing perspectives. This activity is focused on bringing the people together who can define where change needs to happen and then deliver this impact with the academic support CSER can provide.
Collective Intelligence Project
The Collective Intelligence Project (CIP) is an incubator for new governance models for transformative technology. Our mission is to direct technological development towards the collective good, and to that end, will focus on the research and development of collective intelligence capabilities.
Conjecture
Conjecture has a dedicated team of researchers and engineers working on current state of the art AI, building both our suite of state of the art LLMs and our vision of Cognitive Emulation atop this foundation. We are building the infrastructure that allows us to build scalable, auditable, controllable AI systems, and work to enable our customers to benefit from this new paradigm.
Distributed AI Research Institute
The Distributed AI Research Institute (DAIR) is an independent organization conducting community-rooted research. We are a globally distributed group of academics, activists, and engineers who believe in technology that benefits everyone. We believe that research should center the people most impacted by technology and should be rooted in community needs.
FAR.AI
At FAR.AI, we are motivated by the potential risks posed by rapid advances in AI capabilities. We work to ensure advanced AI is trustworthy, secure and beneficial for everyone. Our goal is to close the research-adoption gap by developing solutions to high-leverage technical safety challenges and scaling them to real-world deployment. Our approach emphasizes tight empirical feedback loops on real-world manifestations of large-scale AI risks.
Frontier Model Forum
The Frontier Model Forum (FMF) focuses primarily on managing significant risks to public safety and security, including from chemical, biological, radiological, nuclear (CBRN) and advanced cyber threats. By drawing on the technical and operational expertise of its member firms, the FMF seeks to ensure the most advanced AI systems remain safe and secure so that they can meet society’s most pressing needs.
Future of Life Institute
The Future of Life Institute (FLI) steers transformative technology towards benefiting life and away from extreme large-scale risks. We believe that the way powerful technology is developed and used will be the most important factor in determining the prospects for the future of life. This is why we have made it our mission to ensure that technology continues to improve those prospects.
Future of Life Foundation
The Future of Life Foundation (FLF) helps initiate projects that empower humanity in the age of AI. We think that by leveraging AI itself and shaping the new societal infrastructure that will emerge, humanity can dramatically improve our capability to navigate what’s ahead.
Global AI Narratives
The Global AI Narratives (GAIN) research project aims to understand how cultures beyond the Anglophone West imagine life with intelligent machines, and at the same time create a genuinely global community of scholars who can relate these diverse visions to pressing questions of AI ethics and governance.
Global Partnership on
Artificial Intelligence
The Global Partnership on Artificial Intelligence (GPAI) is an international initiative currently comprising 46 member countries and the European Union that promotes the responsible development and use of artificial intelligence. Informed by a multi-stakeholder expert community that brings together governments, industry, academia, and civil society, it seeks to advance human-centric and trustworthy AI.
Golden Gate Institute for AI
The Golden Gate Institute for AI is a think tank dedicated to addressing the most critical challenges of the transition to a world with powerful AI. We envision a future where institutions and experts across domains collaborate with urgency and humility to meet these oncoming challenges and opportunities, promoting security, democracy, and shared prosperity.
GovAI
GovAI is a think tank that aims to help decision-makers in government and industry navigate the transition to a world with advanced AI. We aim to help in two key ways. We produce relevant research to support informed decision-making. This includes both published work and bespoke analysis, produced through direct engagement.
INHUMAIN.AI
At INHUMAIN.AI, we document what happens when intelligence stops being human. Independent journalism and analysis tracking AI safety, corporate power, regulation, and the future of human agency.
Institute for AI Policy and Strategy
The Institute for AI Policy and Strategy (IAPS) is a nonpartisan think tank that produces policy research to address the implications of AI, from today’s most advanced models to potential AGI and superintelligence. Our work equips policymakers and industry leaders to protect innovation while navigating high-magnitude risks and opportunities at the intersection of AI, national security, and geopolitics.
LawZero
At LawZero we are building a multi-step pathway to safe advanced AI, so that future AI systems are developed and deployed responsibly, equitably, and as a global public good. Simply put, we are creating a fundamentally new form of advanced AI, designed to be trustworthy and safe.
Leverhulme Centre for the
Future of Intelligence
Leverhulme Centre for the Future of Intelligence (LCFI) is a highly interdisciplinary research centre exploring the nature, ethics and impact of artificial intelligence. CFI brings together academics from a variety of disciplines as diverse as machine learning, philosophy, history, literary studies, engineering, media studies and design in order to explore the possibilities of AI in both the short and long term.
London Initiative for Safe AI
The London Initiative for Safe AI (LISA) is an AI safety centre and ecosystem based in central London. We operate a world-class hub bringing together organisations, programmes, researchers and policymakers. We are backed by leading funders and led by a team combining deep AI safety expertise with operational experience.
Machine Intelligence
Research Institute
The Machine Intelligence Research Institute (MIRI) was among the first to recognize the future invention of artificial superintelligence as the most important—and potentially catastrophic—event in the twenty-first century. MIRI was the first organization to advocate for and work on ASI alignment as a technical problem, and has played a central role in building the field over the years.
MIT AI Risk Initiative
The MIT AI Risk Initiative (AIRI) provides authoritative data and frameworks to help decision-makers across the AI ecosystem identify, prioritize, and manage risks from AI. We work closely with researchers at The University of Queensland and a wide network of experts across government, industry, and academia.
Model Evaluation
& Threat Research
Model Evaluation & Threat Research (METR) evaluates frontier AI models to inform the public about their risks and capabilities. Most of our research consists of evaluations assessing the extent to which an AI system can autonomously carry out substantial tasks, including general-purpose tasks like conducting research or developing an app, and concerning capabilities such as conducting cyberattacks or making itself hard to shut down.
Oxford Martin AI
Governance Initiative
The Oxford Martin AI Governance Initiative (AIGI) aims to anticipate and mitigate lasting risks from AI through impactful research that is rigorously grounded in the social and computational science, decision-maker education campaigns, and training the next generations of technology governance leaders
Palisade Research
Palisade Research helps people and institutions build the understanding needed to avoid permanent disempowerment by strategic AI agents. We research frontier AI models, aiming to better understand why they do what they do.
Redwood Research
Redwood Research is a nonprofit AI safety and security research organization. Our research specifically addresses the risks that could arise if powerful AI systems purposefully act against the interests of their developers and human institutions broadly.
Windfall Trust
Windfall Trust brings together the policymakers, economists, and researchers who are choosing to prepare — testing assumptions in scenario workshops, mapping the tools already available, and measuring gaps in readiness. We are a policy accelerator for the age of Artificial Intelligence.