Preventing an AI-related catastrophe

Search for:

Start here
Career guide
Research
- Problem profiles Find out about the world's biggest and most neglected problems.
  
  See all →
  Top areas to work on
  
  Preventing an AI-related catastrophe
  
  Catastrophic pandemics
  
  Nuclear war
  
  Great power war
  
  Climate change
  
  Capacity building
  
  Building effective altruism
  
  Global priorities research
  
  Improving decision making
  
  Other promising areas
  
  Civilisation resilience
  
  Artificial sentience
  
  Promoting positive values
  
  Space governance
  
  Risks of stable totalitarianism
  
  Factory farming
  
  Global health
  
  Wild animal suffering
  
  See all problem profiles →
- Skills The most useful skills for making a difference.
  
  See all →
  Top skills to build early in your career
  
  Policy and politics
  
  Organisation-building
  
  Research
  
  Communicating ideas
  
  Software and tech
  
  Engineering
  
  Experience with an emerging power
  
  Expertise relevant to a top problem
  
  See all our skills pages →
- Career reviews Learn about high-impact career paths.
  
  See all →
  Our list of top high-impact career paths
  
  AI safety technical research
  
  AI governance and policy
  
  Biorisk research, strategy, and policy
  
  Information security in high-impact areas
  
  Expert in AI hardware
  
  Helping build the effective altruism community
  
  China-related AI safety and governance
  
  Grantmaker
  
  Nuclear weapons safety and security
  
  Operations in high-impact organisations
  
  Research into global priorities
  
  More promising paths
  
  Be a founder
  
  Software engineering
  
  Journalism
  
  See more →
  
  How to build great career capital
  
  See our top recommendations →
  
  See all career reviews →
- Advanced series Our most important research findings.
  
  Read the full series →
  Introduction
  
  Your most important decision
  
  Foundations
  
  A definition of impact
  
  Longtermism
  
  Harmful jobs
  
  Global priorities
  
  Problem selection
  
  Existential risks
  
  Top problems list
  
  Contribution
  
  How to think about your contribution
  
  Effective solutions
  
  List of high-impact careers
  
  Personal fit
  
  Gut instinct
  
  Differences in productivity
  
  Comparative advantage
  
  Strategy
  
  Ambition
  
  Coordination
  
  Exploration
  
  Impact and satisfaction
  
  Accidental harm
  
  Read the full series →
- Browse all our content Pick a topic to explore or check out our most popular pieces.
  
  Career planning and decision making
  
  How to make your career plan
  
  All our other planning resources
  
  Selected topics
  
  Moral philosophy
  
  Career capital
  
  Job satisfaction
  
  Anonymous advice
  
  Unconventional advice
  
  Advocacy
  
  Existential risk
  
  Top-recommended careers
  
  See all topics →
  
  Top articles from outside our guides
  
  Best charities to donate to
  
  Misconceptions about effective altruism
  
  High-impact research questions
  
  What are your chances of getting elected to Congress, if you try?
  
  How many lives does a doctor save?
  
  What's the impact of voting?
  
  Advice for undergraduates
  
  All articles →
See all →
Top areas to work on

Preventing an AI-related catastrophe

Catastrophic pandemics

Nuclear war

Great power war

Climate change

Capacity building

Building effective altruism

Global priorities research

Improving decision making

Other promising areas

Civilisation resilience

Artificial sentience

Promoting positive values

Space governance

Risks of stable totalitarianism

Factory farming

Global health

Wild animal suffering

See all problem profiles →
See all →
Top skills to build early in your career

Policy and politics

Organisation-building

Research

Communicating ideas

Software and tech

Engineering

Experience with an emerging power

Expertise relevant to a top problem

See all our skills pages →
See all →
Our list of top high-impact career paths

AI safety technical research

AI governance and policy

Biorisk research, strategy, and policy

Information security in high-impact areas

Expert in AI hardware

Helping build the effective altruism community

China-related AI safety and governance

Grantmaker

Nuclear weapons safety and security

Operations in high-impact organisations

Research into global priorities

More promising paths

Be a founder

Software engineering

Journalism

See more →

How to build great career capital

See our top recommendations →

See all career reviews →
Read the full series →
Introduction

Your most important decision

Foundations

A definition of impact

Longtermism

Harmful jobs

Global priorities

Problem selection

Existential risks

Top problems list

Contribution

How to think about your contribution

Effective solutions

List of high-impact careers

Personal fit

Gut instinct

Differences in productivity

Comparative advantage

Strategy

Ambition

Coordination

Exploration

Impact and satisfaction

Accidental harm

Read the full series →
Career planning and decision making

How to make your career plan

All our other planning resources

Selected topics

Moral philosophy

Career capital

Job satisfaction

Anonymous advice

Unconventional advice

Advocacy

Existential risk

Top-recommended careers

See all topics →

Top articles from outside our guides

Best charities to donate to

Misconceptions about effective altruism

High-impact research questions

What are your chances of getting elected to Congress, if you try?

How many lives does a doctor save?

What's the impact of voting?

Advice for undergraduates

All articles →
Job board
Podcasts
- The 80,000 Hours Podcast
- 80k After Hours
- The 80,000 Hours Career Guide
- Effective Altruism: An Introduction
- Effective Altruism: Ten Global Problems
- On Artificial Intelligence
Get 1-1 advice
Newsletter

New releases
All articles
Work with us
About

Home World problems Preventing an AI-related catastrophe

Search for:

New releases
All articles
Work with us
About

Preventing an AI-related catastrophe

80,000 Hours

Copy and paste this URL into your WordPress site to embed

<blockquote class="wp-embedded-content" data-secret="E47T4cEZAV"><a href="https://80000hours.org/problem-profiles/artificial-intelligence/">Preventing an AI-related catastrophe</a></blockquote><iframe sandbox="allow-scripts" security="restricted" src="https://80000hours.org/problem-profiles/artificial-intelligence/embed/#?secret=E47T4cEZAV" width="600" height="400" title="&#8220;Preventing an AI-related catastrophe&#8221; &#8212; 80,000 Hours" data-secret="E47T4cEZAV" frameborder="0" marginwidth="0" marginheight="0" scrolling="no" class="wp-embedded-content"></iframe><script type="text/javascript">
/* <![CDATA[ */
/**
 * WordPress inline HTML embed
 *
 * @since 4.4.0
 * @output wp-includes/js/wp-embed.js
 *
 * Single line comments should not be used since they will break
 * the script when inlined in get_post_embed_html(), specifically
 * when the comments are not stripped out due to SCRIPT_DEBUG
 * being turned on.
 */
(function ( window, document ) {
	'use strict';

	/* Abort for ancient browsers. */
	if ( ! document.querySelector || ! window.addEventListener || typeof URL === 'undefined' ) {
		return;
	}

	/** @namespace wp */
	window.wp = window.wp || {};

	/* Abort if script was already executed. */
	if ( !! window.wp.receiveEmbedMessage ) {
		return;
	}

	/**
	 * Receive embed message.
	 *
	 * @param {MessageEvent} e
	 */
	window.wp.receiveEmbedMessage = function( e ) {
		var data = e.data;

		/* Verify shape of message. */
		if (
			! ( data || data.secret || data.message || data.value ) ||
			/[^a-zA-Z0-9]/.test( data.secret )
		) {
			return;
		}

		var iframes = document.querySelectorAll( 'iframe[data-secret="' + data.secret + '"]' ),
			blockquotes = document.querySelectorAll( 'blockquote[data-secret="' + data.secret + '"]' ),
			allowedProtocols = new RegExp( '^https?:$', 'i' ),
			i, source, height, sourceURL, targetURL;

		for ( i = 0; i < blockquotes.length; i++ ) {
			blockquotes[ i ].style.display = 'none';
		}

		for ( i = 0; i < iframes.length; i++ ) {
			source = iframes[ i ];

			if ( e.source !== source.contentWindow ) {
				continue;
			}

			source.removeAttribute( 'style' );

			if ( 'height' === data.message ) {
				/* Resize the iframe on request. */
				height = parseInt( data.value, 10 );
				if ( height > 1000 ) {
					height = 1000;
				} else if ( ~~height < 200 ) {
					height = 200;
				}

				source.height = height;
			} else if ( 'link' === data.message ) {
				/* Link to a specific URL on request. */
				sourceURL = new URL( source.getAttribute( 'src' ) );
				targetURL = new URL( data.value );

				if (
					allowedProtocols.test( targetURL.protocol ) &&
					targetURL.host === sourceURL.host &&
					document.activeElement === source
				) {
					window.top.location.href = data.value;
				}
			}
		}
	};

	function onLoad() {
		var iframes = document.querySelectorAll( 'iframe.wp-embedded-content' ),
			i, source, secret;

		for ( i = 0; i < iframes.length; i++ ) {
			/** @var {IframeElement} */
			source = iframes[ i ];

			secret = source.getAttribute( 'data-secret' );
			if ( ! secret ) {
				/* Add secret to iframe */
				secret = Math.random().toString( 36 ).substring( 2, 12 );
				source.src += '#?secret=' + secret;
				source.setAttribute( 'data-secret', secret );
			}

			/*
			 * Let post embed window know that the parent is ready for receiving the height message, in case the iframe
			 * loaded before wp-embed.js was loaded. When the ready message is received by the post embed window, the
			 * window will then (re-)send the height message right away.
			 */
			source.contentWindow.postMessage( {
				message: 'ready',
				secret: secret
			}, '*' );
		}
	}

	window.addEventListener( 'message', window.wp.receiveEmbedMessage, false );
	document.addEventListener( 'DOMContentLoaded', onLoad, false );
})( window, document );

/* ]]> */
</script>

Copy and paste this code into your site to embed

Join our newsletter

Get weekly updates on our research, plus jobs and other opportunities to get involved.

Get 1-1 advice

Want to tackle a pressing global problem with your career?

Speak to an advisor

Our research

Start here
Career guide
List of world problems
List of top skills
List of careers
Advanced series
New releases
All our research

Future generations
Artificial intelligence
Anonymous advice
College advice

Take action

Find a job
Get 1-1 advice
Make a career plan

About us

Why 80,000 Hours?
Meet the team
Our donors
What others say about us
Our mistakes
Our community
Translations of our content

80,000 Hours is an Effective Ventures project. Effective Ventures Foundation (UK) (EV UK) is a charity in England and Wales (with registered charity number 1149828, registered company number 07962181, and is also a Netherlands registered tax-deductible entity ANBI 825776867). Effective Ventures Foundation USA Inc. (EV US) is a section 501(c)(3) organization in the USA (EIN 47-1988398). EV UK and EV US are separate charities that collaborate closely under the “Effective Ventures” name.

Please contact us to suggest ideas, improvements, or corrections.

We do our best to provide useful information, but how you use the information is up to you. We don’t take responsibility for any loss that results from the use of information on the site. Please consult our full legal disclaimer and privacy policy. See also our cookie notice and adjust your .