Working Paper

The perils of working with Big Data and a SMALL framework you can use to avoid them

Abstract: The use of “Big Data” to explain fluctuations in the broader economy or guide the business decisions of a firm is now so commonplace that in some instances it has even begun to rival more traditional government statistics and business analytics. Big data sources can very often provide advantages when compared to these more traditional data sources, but with these advantages also comes the potential for pitfalls. We lay out a framework called SMALL that we have developed in order to help interested parties as they navigate the big data minefield. Based on a set of five questions, the SMALL framework should help users of big data spot concerns in their own work and that of others who rely on such data to draw conclusions with actionable public policy or business implications. To demonstrate, we provide several case studies that show a healthy dose of skepticism can be warranted when working with and interpreting these new big data sources.

Keywords: big data; economic statistics; business analytics; forecasting;

JEL Classification: C53; C55; C80; C81;

https://doi.org/10.21033/wp-2020-35

Bibliographic Information

Provider: Federal Reserve Bank of Chicago

Part of Series: Working Paper Series

Publication Date: 2020-12-22

Number: WP-2020-35

Related Works

• Working Paper Original (2020-12-22) : You are here.
• Working Paper Revision (2020-03-02) : The perils of working with Big Data and a SMALL framework you can use to avoid them