Carmel Fisher, founder and Managing Director

Carmel Fisher: 'Experts' put in their place

15 comments
What's more, anyone can improve their forecasting skills so all of us can be as good as the experts who command our attention. Photo / Getty Images
What's more, anyone can improve their forecasting skills so all of us can be as good as the experts who command our attention. Photo / Getty Images

I've written before about my disdain for so-called experts who are given guru or celebrity status when it is often undeserved.

Forecasters and commentators, whose views are bold and offered repeatedly, often become revered by the masses.

If someone expresses a confident view and provides a comment on anything and everything, well, he must be right.

Unfortunately, as the Economist noted recently, today's world is based on eminence rather than evidence.

Experts happily provide predictions and forecasts on all manner of things, influencing the opinions and behaviour of government and business leaders, investors and society as a whole.

They are frequently wrong, yet there is no post-forecast analysis to determine their success rate. Rather, the opinions of the same individuals who have been famously wrong are sought over and over, cementing their fame, irrespective of their accuracy.

If only the non-expert masses realised their opinions and forecasts can be just as accurate, and sometimes more so, than the professionals.

In the book Superforecasting: the Art and Science of Prediction, author Philip Tetlock demonstrates that amateurs outperform experts in finance, politics and even national intelligence when it comes to prediction.

What's more, anyone can improve their forecasting skills so all of us can be as good as the experts who command our attention.

Tetlock, a psychologist and professor of management at the University of Pennsylvania, identified common behavioural traits and a successful forecasting methodology after launching a competition in 2011 pitting 2800 volunteers against some of the world's most prominent and elite forecasters.

Participants were asked questions on diverse topics including future gold prices, expectations of Opec's global production and the stability or otherwise of political regimes.

The competition is still running today - you can check out your forecasting prowess by visiting The Good Judgment Project and the results continue to confirm the ability of amateurs to deliver more confident and accurate forecasts than so-called experts.

On average, the best-performing amateur forecasters were 30 per cent more accurate than the experts, even when experts had access to classified and scientific information.

Some members of the top 2 per cent of participants, referred to by Tetlock as the "superforecasters", do not hold the educational or professional qualifications that one might expect. Among this elite group of scientists, professors and engineers were a housewife, a welfare case worker, a Pilates instructor and an underwater-hockey coach.

Tetlock summarised the key traits of the superforecasters as being careful, curious, open-minded, persistent and self-critical. He says experts can be limited by their tendency to have closed minds, quick to arrive at a view and slow to question or change it.

It seems what you think is much less important than how you think. Tetlock says it pays to look at the world not in a binary way ("it must be x or y") but in terms of probabilities ("is there a greater than 50:50 chance of it being x and not y?").

He lists the lessons for those wanting to be superforecasters as:

1. Begin by gathering as much information as possible.

2. Nurture and develop the habit of thinking in terms of probabilities.

3. Consult with others to improve your odds of being correct.

4. Regularly keep score of your projections.

5. Be willing to admit error and quickly change course.

We won't all achieve superforecaster status, but we should take comfort knowing our opinions are as likely to be right as those of the experts.

Three cheers for the amateur.

Debate on this article is now closed.

- NZ Herald

Get the news delivered straight to your inbox

Receive the day’s news, sport and entertainment in our daily email newsletter

SIGN UP NOW
Carmel Fisher, founder and Managing Director

Sort by
  • Oldest

© Copyright 2016, NZME. Publishing Limited

Assembled by: (static) on production apcf04 at 30 Sep 2016 03:37:46 Processing Time: 1366ms