Guide to working in AI policy and strategy

Written by Miles Brundage a researcher who works on AI policy at the University of Oxford’s Future of Humanity Institute, with help from the 80,000 Hours team and others acknowledged below.
Why we wrote this
80,000 Hours’ research suggests that one of the highest-impact opportunities to improve the world may be by positively shaping the development of artificial intelligence. The issue is large in scale and neglected by most people. Recent experience suggests it’s possible to make steady progress in reducing the risks. See our profile of the problem for further explanation of why we believe this.
The last few years have seen dramatic growth in the number of people doing technical research to figure out how we can safely program an artificial general intelligence, and we have a guide for people who are considering doing this kind of work.
There is another topic that is just as important and has become relatively more neglected: improving AI policy and strategy. This includes questions like how can we avoid a dangerous arms race to develop powerful AI systems; how can the benefits of advanced AI systems be widely distributed; and how open should AI research be? If we handle these issues badly, it could lead to disaster, even if we can solve the technical challenges associated with controlling a machine intelligence.
We need answers to AI policy and strategy questions urgently because i) implementing solutions could take a long time,





How much should you believe the numbers in figures like this?







