In futurology, an existential risk is a risk that is both global and terminal. Nick Bostrom defines an existential risk as a risk "where an adverse outcome would either annihilate Earth-originating intelligent life or permanently and drastically curtail its potential." The term is frequently used in transhumanist and Singularitarian communities to describe disaster scenarios caused by non-Friendly superintelligence, misuse of molecular nanotechnology, or other sources of danger.

Quote

Our approach to existential risks cannot be one of trial-and-error. There is no opportunity to learn from errors. The reactive approach – see what happens, limit damages, and learn from experience – is unworkable. Rather, we must take a proactive approach. This requires foresight to anticipate new types of threats and a willingness to take decisive preventive action and to bear the costs (moral and economic) of such actions.

-- Bostrom

External links

• Organizations formed to prevent existential risks
  • The Center for Responsible Nanotechnology
  • The Singularity Institute for Artificial Intelligence
• Essays
  • Existential Risks: Analyzing Human Extinction Scenarios - The original essay by Nick Bostrom
  • Immortalist Utilitarianism - An essay by Michael Anissimov, the 5th section of which concerns existential risks