Customize Consent Preferences

We use cookies to help you navigate efficiently and perform certain functions. You will find detailed information about all cookies under each consent category below.

The cookies that are categorized as "Necessary" are stored on your browser as they are essential for enabling the basic functionalities of the site. ... 

Always Active

Necessary cookies are required to enable the basic features of this site, such as providing secure log-in or adjusting your consent preferences. These cookies do not store any personally identifiable data.

No cookies to display.

Functional cookies help perform certain functionalities like sharing the content of the website on social media platforms, collecting feedback, and other third-party features.

No cookies to display.

Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics such as the number of visitors, bounce rate, traffic source, etc.

No cookies to display.

Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.

No cookies to display.

Advertisement cookies are used to provide visitors with customized advertisements based on the pages you visited previously and to analyze the effectiveness of the ad campaigns.

No cookies to display.

Loading...
Most Recent Stories

Can We Identify Good & Bad Forecasters?

Forecasting is part of life.  And it’s certainly part of economics and finance.  Anyone who puts together a view of the economy or an investment portfolio has to make some forward looking assumptions.  They have to make forecasts about how the future might play out even if they’re just making vague implicit forecasts (for instance, you might be a buy and hold investor because, historically, stocks go up, therefore, you think they’ll continue to go up).  Some people do this in rather intelligent ways while others do this in biased and rather unintelligent ways.

I got to thinking about this as I read this nice post by Noah Smith on the difficulties of forecasting and the trouble with identifying good forecasters.   Noah says:

Obviously, these warnings would have zero informational content about actual inflation. But how would you go about differentiating between such a bot and a real human being? Is there some kind of Turing Test for macroeconomic forecasters?

 

In the meantime, our tools for identifying unreliable forecasters are rather primitive — a combination of reputation, bluster, excuses, insults and counter-insults. It’s all a bit silly, and it generates a lot of bad feelings all around. But what else can we do?

 So, how can we differentiate between the two?  How do we identify good forecasters and bad forecasters?  Well, there’s certainly no sure-fire way to eliminate the good from the bad, but I do think we can identify some red flags about forecasters by focusing on common behavioral biases:
  1. Does the forecaster work from a political perspective of the world?  If so, they are likely biased in their views and instead of viewing the world for what it is, they are making forecasts based on how they want the world to be.  We saw this consistently around QE forecasts when people who are politically against the Federal Reserve, made repeated predictions about impending doom.  Political bias is probably the most common and destructive bias that impacts forecasting.  Avoid politically biased forecasters at all costs.
  2. Beware of optimism/pessimism bias.  This often stems from political bias, but we tend to find that people in economics and finance are highly biased towards one view, either optimistic or pessimistic.  This will tend to cloud their thinking and lead them to conclude that any sort of policy or economic variable will naturally conform to their broader biased perspective.  People with a long track record of one consistent optimistic or pessimistic view should be ignored.  Classic examples include permabulls like Jeremy Siegel or permabears like Marc Faber.
  3. Beware the fallacy of composition.  People who can’t think in terms of the big picture are often biased in terms of their narrow views.  We are highly prone to thinking about finance and economics as it pertains to our lives at a personal level, but what’s good/bad for you at a personal level might not be true at the aggregate level.

We’ll never identify perfect forecasters (because they don’t exist).  But we can, with a high probability, eliminate the largely useless forecasters from the more valuable forecasters.  And identifying common behavioral biases is often one of the best ways to achieve that.  More importantly, when making your own forecasts, rather than relying on some talking head, ensure that you aren’t falling for these common biases yourself….