#10 – Nick Beckstead on how to spend billions of dollars preventing human extinction

What if you were in a position to give away billions of dollars to improve the world? What would you do with it? This is the problem facing Program Officers at Open Philanthropy – people like Dr Nick Beckstead.

Following a PhD in philosophy, Nick works to figure out where money can do the most good. He’s been involved in major grants in a wide range of areas, including ending factory farming through technological innovation, safeguarding the world from advances in biotechnology and artificial intelligence, and spreading rational compassion.

This episode is a tour through some of the toughest questions ‘effective altruists’ face when figuring out how to best improve the world, including:

  • Should we mostly try to help people currently alive, or future generations? Nick studied this question for years in his PhD thesis, On the Overwhelming Importance of Shaping the Far Future. (The first 31 minutes is a snappier version of my conversation with Toby Ord.)
  • Is clean meat (aka in vitro meat) technologically feasible any time soon, or should we be looking for plant-based alternatives?
  • To stop malaria is it more cost-effective to use technology to eliminate mosquitos than to distribute bed nets?
  • What are the greatest risks to human civilisation continuing?
  • Should people who want to improve the future work for changes that will be very useful in a specific scenario, or just generally try to improve how well humanity makes decisions?
  • What specific jobs should our listeners take in order for Nick to be able to spend more money in useful ways to improve the world?
  • Should we expect the future to be better if the economy grows more quickly – or more slowly?

We also cover some more personal issues like:

  • Nick’s top book recommendations.
  • How he developed (what is in my view) exceptional judgement.
  • How he made his toughest career decisions.
  • Why he wants to see less dilettantism and more expertise in the effective altruism community.

Don’t miss it.

Continue reading →

New problem profile: Improving institutional decision-making

A few weeks ago we released a new problem profile focussed on improving decision-making in major societal institutions:

When powerful people make dumb choices it hurts us all. Here’s how to fix it.

In 2003, the United States chose to invade Iraq. Most now agree this decision was deeply flawed, costing trillions of dollars and thousands of lives.

Exactly what went wrong here is a contested and controversial issue. At best, the decision-making process severely lacked rigour, and at worst, it was heavily biased.

The government justified the invasion thanks to the intelligence community’s claim that it was “highly probable” that Iraq possessed Weapons of Mass Destruction (WMD) – but this statement was ambiguous. Policymakers took that to indicate near-100% certainty, and made decisions accordingly.1 But “highly probable” could easily also be interpreted as 80% certainty, or 70% – carrying very different practical implications. Those involved didn’t really think through the relevant probabilities, or consider how likely the estimates were to be wrong, or the implications if they were.

Others have suggested that the US had already decided to invade Iraq, and that this decision influenced intelligence collection – not the other way around. This a particularly extreme example of what’s known as motivated reasoning – a tendency to reason in ways that support whatever conclusion one wants to be true.

The call to invade hinged on the subjective impressions of a few key people – subjective impressions that later turned out to be wrong,

Continue reading →

New career review: Policy-oriented civil service (with a UK focus)

We have a new career review focussed on government jobs developing policy, with a focus on the UK:

Working in the government you can have a big impact on pressing global problems. Here’s how to get started.

On the Sunday after Labour’s landslide victory in 1997, Tony Blair rang Alan Milburn to tell him he was going to be a minister in the Department of Health. Blair said: ‘We haven’t got a health policy. Your job is to get us one.’1

Milburn ‘was hungry for ideas’1 and met with a civil servant: Graham Winyard, the Deputy Chief Medical Officer. According to Winyard, this meeting was where the National Institute for Health and Care Excellence (NICE) was born.1 NICE helps the National Health Service decide which treatments are evidence-based and cost-effective.

Although its approach is controversial,2 NICE is seen internationally as a role model for how to make evidence-based decisions about health spending.3 The editor of the British Medical Journal described it as ‘conquering the world’ and thought it might ‘prove to be one of Britain’s greatest cultural exports’.4

What if you could have this kind of impact?

There are civil servants working on some of the world’s most urgent problems, from how to prevent nuclear proliferation to encouraging economic growth in the developing world. Like Winyard, they often have opportunities to play a central role in solving these problems.

In this profile we cover why it’s possible to have a significant impact as a civil servant,

Continue reading →

#9 – Christine Peterson on how insecure computers could lead to global disaster, and how to fix it

Take a trip to Silicon Valley in the 70s and 80s, when going to space sounded like a good way to get around environmental limits, people started cryogenically freezing themselves, and nanotechnology looked like it might revolutionise industry – or turn us all into grey goo.

In this episode of the 80,000 Hours Podcast Christine Peterson takes us back to her youth in the Bay Area, the ideas she encountered there, and what the dreamers she met did as they grew up. We also discuss how she came up with the term ‘open source software’ (and how she had to get someone else to propose it).

Today Christine helps runs the Foresight Institute, which fills a gap left by for-profit technology companies – predicting how new revolutionary technologies could go wrong, and ensuring we steer clear of the downsides.

We dive into:

  • Can technology ‘move fast and break things’ without eventually breaking the world? Would it be better for technology to advance more quickly, or more slowly?
  • Whether the poor security of computer systems poses a catastrophic risk for the world.
  • Could all our essential services be taken down at once? And if so, what can be done about it? Christine makes a radical proposal for solving the problem.
  • Will AIs designed for wide-scale automated hacking make computers more or less secure?
  • Would it be good to radically extend human lifespan? Is it sensible to cryogenically freeze yourself in the hope of being resurrected in the future?
  • Could atomically precise manufacturing (nanotechnology) really work? Why was it initially so controversial and why did people stop worrying about it?
  • Should people who try to do good in their careers work long hours and take low salaries? Or should they take care of themselves first of all?
  • How she thinks the the effective altruism community resembles the scene she was involved with when she was young, and where it might be going wrong.

Continue reading →

#8 – Lewis Bollard on how to end factory farming in our lifetimes

Every year tens of billions of animals are raised in terrible conditions in factory farms before being killed for human consumption. Despite the enormous scale of suffering this causes, the issue is largely neglected, with only about $50 million dollars spent each year tackling the problem globally.

Over the last two years Lewis Bollard – Project Officer for Farm Animal Welfare at Open Philanthropy – has conducted extensive research into the best ways to eliminate animal suffering in farms as soon as possible.

This has resulted in $30 million in grants, making Open Philanthropy one of the largest funders in the area.

Our conversation covers almost every approach being taken, which ones work, how individuals can best contribute through their careers, as well as:

  • How young people can set themselves up to contribute to scientific research into meat alternatives
  • How genetic manipulation of chickens has caused them to suffer much more than their ancestors, but could also be used to make them better off
  • Why Lewis is skeptical of vegan advocacy
  • Open Phil’s grants to improve animal welfare in China, India and South America
  • Why Lewis thinks insect farming would be worse than the status quo, and whether we should look for ‘humane’ insecticides
  • Why Lewis doubts that much can be done to tackle factory farming through legal advocacy or electoral politics
  • Which species of farm animals is best to focus on first
  • Whether fish and crustaceans are conscious, and if so what can be done for them
  • Many other issues

Listening to this episode is among the fastest ways to get up to speed on how animals are mistreated and the best ways to help them.

Continue reading →

#7 – Julia Galef on making humanity more rational, what EA does wrong, and why Twitter isn't all bad

The scientific revolution in the 16th century was one of the biggest societal shifts in human history, driven by the discovery of new and better methods of figuring out who was right and who was wrong.

Julia Galef – a well-known writer and researcher focused on improving human judgment, especially about high stakes questions – believes that if we could develop new techniques to resolve disagreements, predict the future and make sound decisions together, we could again dramatically improve the world. We brought her in to talk about her ideas.

Julia has hosted the Rationally Speaking podcast since 2010, co-founded the Center for Applied Rationality in 2012, and is currently working for Open Philanthropy on an investigation of expert disagreements.

This interview complements a new detailed review of whether and how to follow Julia’s career path

We ended up speaking about a wide range of topics, including:

  • Her research on how people can have productive intellectual disagreements.
  • Why she once planned on becoming an urban designer.
  • Why she doubts people are more rational than 200 years ago.
  • What the effective altruism community is doing wrong.
  • What makes her a fan of Twitter (while I think it’s dystopian).
  • Whether more people should write books.
  • Whether it’s a good idea to run a podcast, and how she grew her audience.
  • Why saying you don’t believe X often won’t convince people you don’t.
  • Why she started a PhD in economics but then quit.
  • Whether she would recommend an unconventional ‘public intellectual’ career like her own.
  • Whether the incentives in the intelligence community actually support sound thinking.
  • Whether big institutions will actually pick up new tools for improving decision-making if they are developed.
  • How to start out pursuing a career in which you also try to enhance human judgement and foresight.

Continue reading →

#6 – Toby Ord on why the long-term future matters more than anything else & what to do about it

Of all the people whose well-being we should care about, only a small fraction are alive today. The rest are members of future generations who are yet to exist. Whether they’ll be born into a world that is flourishing or disintegrating – and indeed, whether they will ever be born at all – is in large part up to us. As such, the welfare of future generations should be our number one moral concern.

This conclusion holds true regardless of whether your moral framework is based on common sense, consequences, rules of ethical conduct, cooperating with others, virtuousness, keeping options open – or just a sense of wonder about the universe we find ourselves in.

That’s the view of Dr Toby Ord, a philosophy Fellow at the University of Oxford and co-founder of the effective altruism community. In this episode of the 80,000 Hours podcast Dr Ord makes the case that aiming for a positive long-term future is likely the best way to improve the world.

We then discuss common objections to long-termism, such as the idea that benefits to future generations are less valuable than those to people alive now, or that we can’t meaningfully benefit future generations beyond taking the usual steps to improve the present.

Later the conversation turns to how individuals can and have changed the course of history, what could go wrong and why, and whether plans to colonise Mars would actually put humanity in a safer position than it is today.

This episode goes deep into one of the most distinctive features of 80,000 Hours’ advice on doing good. It’s likely the most in-depth discussion of how we and the effective altruism community think about the long term future, and why we so often give it top priority.

book cover

If you prefer a book, Dr Toby Ord, an Oxford philosopher and advisor to 80,000 Hours, has recently published The Precipice: Existential Risk and the Future of Humanity which gives an overview of the moral importance of future generations, and what we can do to help them today.

We’ll mail you the book, for free

Join the 80,000 Hours newsletter and we’ll send you a free copy of the book.

We’ll also send you updates on our latest research, opportunities to work on existential risk, and news from the author.

If you’re already on our newsletter, email us at [email protected] to get a copy.

Continue reading →

#5 – Alex Gordon-Brown on how to donate millions in your 20s working in quantitative trading

Quantitative financial trading is one of the highest paying parts of the world’s highest paying industry. 25 to 30 year olds with outstanding maths skills can earn millions a year in an obscure set of ‘quant trading’ firms, where they program computers with predefined algorithms to trade very quickly and effectively.

This makes it an attractive workplace for people who want to ‘earn to give’, and we know several people who are able to donate over a million dollars a year to effective charities by working in quant trading. Who are these people? What is the job like? And is there a risk that their trading work directly harms the world?

To learn about all this I spoke at length with Alexander Gordon-Brown, a Giving What We Can member who has worked as a quant trader in London for the last three and a half years and donated hundreds of thousands of pounds. We covered:

  • What quant traders do and how much they earn;
  • Whether their work is beneficial or harmful for the world;
  • How to figure out if you’re a good fit for quant trading, and if so how to break into the industry;
  • Whether Alex enjoys the work and finds it motivating, as well as what alternatives careers he considered;
  • What variety of positions are on offer in quant trading, and what the culture is like in the various firms;
  • How he decides where to donate, and whether he has persuaded his colleagues to join him in becoming major philanthropists.

Continue reading →

#4 – Howie Lempel on pandemics that kill hundreds of millions and how to stop them

What natural disaster is most likely to kill more than 10 million human beings in the next 20 years?

Terrorism? Famine? An asteroid?

Actually it’s probably a pandemic: a deadly new disease that spreads out of control. We’ve recently seen the risks with Ebola and swine flu, but they pale in comparison to the Spanish flu which killed 3% of the world’s population in 1918 to 1920. If a pandemic of that scale happened again today, 200 million would die.

Looking back further, the Black Death killed 30 to 60% of Europe’s population, which would today be two to four billion globally.

The world is woefully unprepared to deal with new diseases. Many countries have weak or non-existent health services. Diseases can spread worldwide in days due to air travel. And international efforts to limit the spread of new diseases are slow, if they happen at all.

Even more worryingly, scientific advances are making it easier to create diseases much worse than anything nature could throw at us – whether by accident or deliberately.

In this in-depth interview I speak to Howie Lempel, who spent years studying pandemic preparedness for Open Philanthropy. We spend the first 20 minutes covering his work as a foundation grant-maker, then discuss how bad the pandemic problem is, why it’s probably getting worse, and what can be done about it. In the second half of the interview we go through what you personally could study and where you could work to tackle one of the worst threats facing humanity.

Continue reading →

#3 – Dario Amodei on OpenAI and how AI will change the world for good and ill

Just two years ago OpenAI didn’t exist. It’s now among the most elite groups of machine learning researchers. They’re trying to make an AI that’s smarter than humans and have $1b at their disposal.

Even stranger for a Silicon Valley start-up, it’s not a business, but rather a nonprofit founded by Elon Musk and Sam Altman among others, to ensure the benefits of AI are distributed broadly to all of society.

I did a long interview with one of its first machine learning researchers, Dr Dario Amodei, to learn about:

  • OpenAI’s latest plans and research progress.
  • His paper Concrete Problems in AI Safety, which outlines five specific ways machine learning algorithms can act in dangerous ways their designers don’t intend – something OpenAI has to work to avoid.
  • How listeners can best go about pursuing a career in machine learning and AI development themselves.

Continue reading →

Which professions are paid too much given their value to society?

Many jobs have spillover effects on the rest of society. For instance, the value of new treatments discovered by biomedical researchers is far greater than what they or their employers get paid, so they have positive spillovers. Other jobs have negative spillovers, such as those that generate pollution.

A forthcoming paper, by economists at UPenn and Yale, reports a survey of the economic literature on these spillover benefits for the 11 highest-earning professions.

There’s very little literature, so all these estimates are very, very uncertain, and should be not be taken literally. But it’s interesting reading – it represents a survey of what economists think they know about this topic, and it’s surprisingly little.

Here are the bottom lines – see more detail on the estimates below. (Note that we already discussed an older version of this paper, but the estimates have been updated since then.)

We calculated mean income for 2005 in an earlier article. We increased income by 30% to account for nominal wage growth since then.

The paper uses the expressions spillover and ‘externality’. An ‘externality’ is a technical term for a ‘cost or benefit that affects a party who did not choose to incur that cost or benefit.’ The authors of the paper call it an ‘externality’ when someone who buys a service does (or does not) benefit after taking account of the cost of purchasing it. This is a nonstandard usage,

Continue reading →

#2 – David Spiegelhalter on risk, stats and improving understanding of science

My colleague Jess Whittlestone and I spoke with Prof David Spiegelhalter, the Winton Professor of the Public Understanding of Risk at the University of Cambridge.

Prof Spiegelhalter tries to help people prioritise and respond to the many hazards we face, like getting cancer or dying in a car crash. To make the vagaries of life more intuitive he has had to invent concepts like the microlife, or a 30-minute change in life expectancy. He’s regularly in the UK media explaining the numbers that appear in the news, trying to assist both ordinary people and politicians to make sensible decisions based in the best evidence available.

We wanted to learn whether he thought a lifetime of work communicating science had actually had much impact on the world, and what advice he might have for people planning their careers today.

Continue reading →

The Schwarzman Scholarship: An exciting opportunity to learn more about China and get a Masters in Global Affairs

Co-authored with Helen Toner.

In general, living in a foreign country – for example, by studying there – is a great way to learn about the country, its language, people, and culture.

There’s one country in particular we think it would be very valuable for some of our readers to become knowledgable about: China. It’s the world’s largest country by population, and gets closer every year to being the largest global economy too. On the international stage, China is the probably world’s second most influential country. Its influence in economic, geopolitical, and cultural terms looks set to continue to grow throughout the course of the 21st century.

All of this means that China is likely to play a larger and larger role in all kinds of areas, including topics we care a great deal about, like factory farming, pandemic preparedness, preserving international peace and cooperation, and AI research. Being familiar with China is likely to provide unique and high-value opportunities to people working in those areas. What’s more, there aren’t yet many westerners with deep (or even passing) familiarity with China, which suggests that now is an especially valuable time to be learning more.

If you’d like to become knowledgable about China, there is a promising new way to do that: the Schwarzman Scholarship program.

Modelled on the Rhodes Scholarship, the Schwarzman Scholarship is targeted at high achieving students from around the world with an interest in leadership,

Continue reading →

#1 – Miles Brundage on the world's desperate need for AI strategists and policy experts

If a smarter-than-human AI system were developed, who would decide when it was safe to deploy? How can we discourage organisations from deploying such a technology prematurely to avoid being beaten to the post by a competitor? Should we expect the world’s top militaries to try to use AI systems for strategic advantage – and if so, do we need an international treaty to prevent an arms race?

Questions like this are the domain of AI policy experts.

We recently launched a detailed guide to pursuing careers in AI policy and strategy, put together by Miles Brundage at the University of Oxford’s Future of Humanity Institute.

It complements our article outlining the importance of positively shaping artificial intelligence and a podcast with Dr Dario Amodei of OpenAI on more technical artificial intelligence safety work which builds on this one. If you are considering a career in artificial intelligence safety, they’re all essential reading.

I interviewed Miles to ask remaining questions I had after he finished his career guide. We discuss the main career paths; what to study; where to apply; how to get started; what topics are most in need of research; and what progress has been made in the field so far.

Continue reading →

How much do hedge fund traders earn?

Hedge fund trading may be the highest paying job in the world, so to learn more, we spoke with a former manager at one of the world’s leading hedge funds. They gave us the following information, which allowed us to make a rough estimate of the typical earnings of hedge fund traders.

We also ran this document past several other people in the industry and asked them to point out mistakes.

We found that junior traders typically earn $300k – $3m per year, and it’s possible to reach these roles in 4 – 8 years. Senior portfolio managers can easily earn over $10m per year, though average earnings are probably lower. Read on for the details.

How do hedge funds make money and how is it shared among the employees?

Hedge funds trade in financial markets on behalf of clients in exchange for annual fees, and a cut of the profits. They’re similar to mutual funds but face fewer restrictions on what they can invest in, and can only be used by accredited investors.

The revenue of a hedge fund comes from the fees on the assets it manages. The typical fund charges a fee of 2% of assets under management per year, plus a performance fee. The performance fee is typically 20% of any returns it makes for the clients over and above the 2% base fee. So, if a fund makes 10% returns in a year, then the performance fee is 20% of (10% –

Continue reading →

Most people report believing it’s incredibly cheap to save lives in the developing world

One way that people can have a social impact with their career is to donate money to effective charities. We mention this path in our career guide, suggesting that people donate to evidence-backed charities such as the Against Malaria Foundation, which is estimated by GiveWell to save the lives of children in the developing world for around $7,500 [Update: now $2,300 as of 2020].

Alyssa Vance told me that many people may see this as highly ineffective relatively to their optimistic expectations about how much it costs to improve the lives of people. I thought the reverse would be true – folks would be skeptical that charities in the developing world were effective at all. Fortunately Amazon Mechanical Turk makes it straightforward to survey public opinion at a low cost, so there was no need for us to sit around speculating. I suggested a survey on this question to someone in the effective altruism community with a lot of experience using Mechanical Turk – Spencer Greenberg of Clearer Thinking – and he went ahead and conducted one in just a few hours.

You can work through the survey people took yourself here and we’ve put the data and some details about the method in a footnote. The results clearly vindicated Alyssa:

It turns out that most Americans believe a child can be prevented from dying of preventable diseases for very little –

Continue reading →

How accurately does anyone know the global distribution of income?

World income distributionHow much should you believe the numbers in figures like this?

People in the effective altruism community often refer to the global income distribution to make various points:

  • The richest people in the world are many times richer than the poor.
  • People earning professional salaries in countries like the US are usually in the top 5% of global earnings and fairly often in the top 1%. This gives them a disproportionate ability to improve the world.
  • Many people in the world live in serious absolute poverty, surviving on as little as one hundredth the income of the upper-middle class in the US.

Measuring the global income distribution is very difficult and experts who attempt to do so end up with different results. However, these core points are supported by every attempt to measure the global income distribution that we’ve seen so far.

The rest of this post will discuss the global income distribution data we’ve referred to, the uncertainty inherent in that data, and why we believe our bottom lines hold up anyway.

Will MacAskill had a striking illustration of global individual income distribution in his book Doing Good Better, that has ended up in many other articles online, including our own career guide:
 
 

 
The data in this graph was put together back in 2012 using an approach suggested by Branko Milanovic,

Continue reading →

What skills are effective altruist organisations short of? Results from our survey.

Note we’ve replaced this survey with one that’s more comprehensive and up-to-date.

In August 2016, we surveyed 16 organisations in the effective altruism community about their hiring needs, and to what extent they are constrained by talent compared to funding.

What follows is a summary of the results, grouped by question asked. You can see the list of organisations surveyed in the footnotes.

Note that since the survey was carried out over six months ago, some of the information may no longer be up to date. We intend to repeat the survey in August 2017, and will report back on how the situation has changed.

What types of talent does your organisation need?

Here are the options provided on the survey, along with the number of organisations which stated that they were looking to hire people for these roles:

(Note that this table is not weighted by budget or team size, although we do not expect that this would materially affect the results.)

In open feedback, several respondents also mentioned that the community is most in need of specialist researchers rather than generalist researchers. Some other skill sets which were not included as options, but which were mentioned more than twice in the open feedback include:

  1. Economists, in 3 cases.
  2. Math and AI researchers, in 2 cases.
  3. Policy experts, in 2 cases.
  4. Scientists, especially biologists,

Continue reading →

5 reasons not to go into education

First published June 2015. Updated February 2017.

When we first speak to people interested in doing good with their careers, they often say they want to get involved in education in the US or the UK. This could mean donating to a school, doing education policy work, or becoming a teacher.

However, we haven’t prioritised careers in education at 80,000 Hours. We don’t dispute that education is a highly important problem – a more educated population could enable us to solve many other global challenges, as well as yield major economic benefits. The problem is that it doesn’t seem to be very easy to solve or neglected (important elements of our problem framework). So, it looks harder to have a large impact in education compared to many other areas. In the rest of this post, we’ll give five reasons why.

The following isn’t the result of in-depth research; it’s just meant to explain why we’ve deprioritised education so far. Our views could easily change. Note that in this post we’re not discussing education in the developing world.

1. It’s harder to help people in the US or UK

Everyone in the US or UK is rich by global standards: the poorest 5% of Americans are richer than the richest 5% of Indians (and that’s adjusted for the difference in purchasing power, see an explanation and the full data).

Continue reading →

The effective altruism guide to donating this giving season

People in the effective altruism community aim to use evidence and careful reasoning to work out how to best promote the wellbeing of all. To find the highest-impact charities this giving season, they’ve done tens of thousands of hours of research and published over 50,000 words of analysis this month. We read it all, and summed up the main recommendations by area.

But which of the 9 problem areas listed should you personally give to? We’ve got you covered here too. This tool asks you six questions and adjusts the ranking based on your beliefs:1

Quiz: Which problem should you give to? →

In the full post, you can find (i) how we came up with the list, (ii) more advice on how to narrow down the list, (iii) more information on each charity.

Continue reading →