Machine Intelligence Research Institute

We are the Machine Intelligence Research Institute (MIRI), a 501©(3) nonprofit based in Berkeley, California, founded in 2000. Our focus is on artificial intelligence research, specifically developing the mathematical theory of trustworthy reasoning for advanced AI systems. We work to prevent human extinction from the development of artificial superintelligence (ASI).

Our technical and philosophical work helped establish the field of AI alignment. We initially started as the Singularity Institute for Artificial Intelligence, aiming to accelerate progress towards smarter-than-human AI. From 2000 to 2003, we shifted our research to ASI alignment, and in 2013, we changed our name to MIRI.

Between 2013 and 2018, our research focused on formalizing decision theory and instrumental convergence. We also ran a research fellowship program. By 2017, MIRI leadership became concerned about the potential for smarter-than-human AI to arrive in the near future. In 2020, we started a major shift due to slow progress in AI alignment. In 2021-2022, we discussed AI risks and held a workshop with other AI alignment researchers. As public discussion on AI extinction risk increased in 2023, we expanded our public communication efforts, including at political forums. In 2024, we began growing our communications team and launched a technical AI governance program.

Our mission is to understand and prepare for the challenges humanity will face with artificial superintelligence. We believe that the most likely outcome of artificial superintelligence (ASI) is human extinction, and survival depends on delaying its creation.

We advocate for a globally coordinated moratorium on ASI development, as soon as possible and for as long as needed. Our current priority is to inform the world about the situation and the necessary actions, as we believe the only reasonable response is to stop AI development until the alignment problem is solved.

MIRI has between 11 and 50 employees. Our work environment encourages a collaborative, self-directed team that aims to work quickly and produce impactful content.

For some roles, like those on the communications team, we prefer in-person work in Berkeley, though remote options are available. Occasional travel to California is required.