The problem with statistical models and forecasting
Share Now on:
If you really what to know what’s going on in any even-remotely quantifiable discipline, nothing paints a clearer picture than the numbers, right? They end arguments. They can help forecast what’s going to happen. They are, simply put, the facts. Not always.
In his new book, “The Signal and the Noise,” author Nate Silver argues that numbers are part of the challenge of painting a clear picture of the American economy. The first example that Silver uses to illustrate his point is the housing crisis.
“You had these credit rating agencies who were taking these very novel types of debt instruments, mortgage-backed securities, and giving them very high ratings — implying that they had almost no chance of defaulting when there really wasn’t much reason to believe that if you actually sorted through the details of these,” he says.
Writing this book, Silver says he learned that people have too much trust in statistical models and not enough cognizance to realize just how noisy the data can be. In his book, he stresses the importance of communicating uncertainty. He says that numbers can be misread and that the American economy is constantly changing — making it difficult to forecast.
“It is very difficult, for example, to measure the effects of different types of stimulus. The reason is that you’re going back and saying, ‘Well when the economy was bad before, what happened to it?’ But there were different economic policies attempted in every one of those recessions,” he says. “So it’s never a total experiment where you’re just sitting there and observing things. You’re trying to intervene in the economy and make it better.”
Read more from Silver at his political forecasting blog FiveThirtyEight, which currently appears on the website of the New York Times. And listen to our full interview with him by clicking play on the audio player above.
If you’re a member of your local public radio station, we thank you — because your support helps those stations keep programs like Marketplace on the air. But for Marketplace to continue to grow, we need additional investment from those who care most about what we do: superfans like you.
Your donation — as little as $5 — helps us create more content that matters to you and your community, and to reach more people where they are – whether that’s radio, podcasts or online.
When you contribute directly to Marketplace, you become a partner in that mission: someone who understands that when we all get smarter, everybody wins.