Should we stop interviewing people?

Our discussion of the reliability of interviews and years of experience has been superseded by the analysis in our career guide article on personal fit, which suggests interviews are more reliable and years of experience less reliable.

“Going with your gut” – part 1

Would you hire this guy?

Most employers rely heavily on interviews in recruiting. However, there’s evidence that the method of choosing candidates based on general impressions from an interview is barely more accurate than a coin toss.¹ Evaluations of interviews conducted in the Israeli Defence Forces to assign soldiers to various branches, for example, suggested that the procedure was almost completely useless at predicting the future success of recruits. ²

Multiple studies indicate that the interview process is far from perfect : that interview performance is a poor predictor of job performance ³, and that it’s often overvalued relative to other assessment methods (such as aptitude tests and references) ⁴. This is pretty worrying when we think about how much difference hiring the best candidate for an important job can make. It might sound crazy, but maybe we should stop interviewing people…

Why can interviewing lead to bad hiring decisions?

Judging which candidate has the best chance of success in a job is far from easy. We have to consider a huge number of different factors and then combine them together in the right way. This is difficult even in theory, let alone in practice! This means interviewers tend to rely on shortcuts to make their decisions.

There’s a more general problem being highlighted here. When faced with uncertainty, people often resort to following their intuitions: which can lead to bad decisions.

Going with your gut

Interviews encourage “going with your gut” – hiring the candidate who just “feels right.” Evidence suggests that interviewers often make decisions in the first few minutes of meeting a candidate! ⁵ And lasting impressions of candidates can massively influence the decisions that are made post-interview.

This is partly explained by what’s known as the affect heuristic: we tend to let our emotions influence our decisions more than perhaps we should. Rather than attempt to answer the difficult question “Which candidate will be better at the job?”, many people instead opt to answer the much simpler one, “Which candidate do I like more?” But the most likeable candidate isn’t always the one who’ll do the job best.

Who would you hire?

Suppose you’re looking to fill a postdoctoral position in a high impact research area like vaccine development. The search has been narrowed down to the following two candidates:

1. Sarah has just completed her PhD. She gave a sparkling and enthusiastic interview performance, blowing everyone away. However, she has no substantial track record of productive research.

2. Ruth has held a postdoctoral research position for the past three years. She has been incredibly productive during this time, and her research record is excellent. However, her interview performance was less sparkling than Sarah’s and she came across as very shy.

Who would you choose? For many people, intuition favours Sarah. She left a stronger impression and was more likeable; it’s hard not to be swayed by this. So let’s say you give the position to Sarah. You’re disappointed to find that once she starts her research, she’s not quite as exceptional as you thought she might be. (Although you should really have predicted this, if you knew anything about regression toward the mean) Her inexperience means it takes her a while to get into the swing of research. She does a pretty good job regardless, helping to develop a vaccine which ends up saving hundreds of lives per year.

What if you’d hired Ruth instead? Perhaps you were put off by her shyness initially. However, you probably would have soon realised it didn’t matter much in research. Her experience would probably have made her slightly more productive than Sarah, and she wouldn’t have needed the same time to get into the swing of things ⁶. So she might have sped up the development of the vaccine by, say, a couple of months. This may not seem like a huge difference, but it might mean saving an extra 50 odd lives. No big deal?

The danger of first impressions

Not only can they be vastly inaccurate, but first impressions can taint any further judgements we make of someone. If our first impression of someone is good, we’re more likely to rate them highly in other ways. Sarah’s immediate likeability may mean we judge her as more motivated and hardworking than she really is, for example.

The problem with gut judgements

Choosing who to hire is hard because we can’t be sure how accurately we’ve judged each candidate, or predict who will really do the best job. What makes it even harder is that it may be months or even years down the line until we can tell whether our decision was a good one or not. So we can’t even learn from mistakes very easily.

There are a lot of situations like this in everyday life: where it’s hard to predict things because there’s so much to consider, and it’s a long time before we’ll know whether we were right or not. Other examples include predicting:

• your grades at the end of the year
• how likely a new business is to succeed
• how likely criminals are to reoffend
• who’ll win the football match
• how much that bottle of Bordeaux will be worth in a few years

There’s a lot of evidence that “gut feelings” aren’t much use in situations like this ⁷. There’s just too much uncertainty and unpredictability. (More accurately, we can use our gut, but we have to be careful how we do it – we’ll talk about this in the next couple of posts)

What does this mean for your career?

Choosing a career has a lot in common with the examples given above. There are a lot of different factors to consider, a huge number of unknowns, and it can be a long time before we get any kind of feedback on whether our decision was a good one or not. So we’d expect our intuitions to be similarly unreliable. In the next few posts I’ll discuss:

• Why a simple model might sometimes be better
• When going with your gut might still be useful
• What all this means for your career decisions

You might also be interested in…

Do you really know what job will make you happy?

Biases in career choice: Don’t be misled by the category “high impact career”

Don’t “do what you’re passionate about

References and Notes