Search Results
Working Paper
Total Recall? Evaluating the Macroeconomic Knowledge of Large Language Models
Crane, Leland D.; Karra, Akhil; Soto, Paul E.
(2025-06-25)
We evaluate the ability of large language models (LLMs) to estimate historical macroeconomic variables and data release dates. We find that LLMs have precise knowledge of some recent statistics, but performance degrades as we go farther back in history. We highlight two particularly important kinds of recall errors: mixing together first print data with subsequent revisions (i.e., smoothing across vintages) and mixing data for past and future reference periods (i.e., smoothing within vintages). We also find that LLMs can often recall individual data release dates accurately, but aggregating ...
Finance and Economics Discussion Series
, Paper 2025-044
Working Paper
The perils of working with Big Data and a SMALL framework you can use to avoid them
Fogarty, Michael; Butters, R. Andrew; Brave, Scott A.
(2020-03-02)
The use of “Big Data” to explain fluctuations in the broader economy or guide the business decisions of a firm is now so commonplace that in some instances it has even begun to rival more traditional government statistics and business analytics. Big data sources can very often provide advantages when compared to these more traditional data sources, but with these advantages also comes the potential for pitfalls. We lay out a framework called SMALL that we have developed in order to help interested parties as they navigate the big data minefield. Based on a set of five questions, the SMALL ...
Working Paper Series
, Paper WP-2020-35
Working Paper
Speaking for Herself: Changing Gender Roles in Survey Response
Minhas, Sabrina; Oksol, Amy
(2019-02-28)
Among married and cohabiting couples, the percentage of female respondents has increased substantially in the PSID (Panel Study of Income Dynamics) from 9% in 1968 to 60% in 2015. This shift in gender composition has taken place despite a formal policy that historically designated male heads of household as respondents. We use this shift as a case study to explore which characteristics are associated with women responding to the PSID and how different respondent gender compositions may affect data quality. First, we find that women are increasingly less likely to respond as their husband?s ...
Research Working Paper
, Paper RWP 19-1
Report
Fed Transparency and Policy Expectation Errors: A Text Analysis Approach
Fischer, Eric; McCaughrin, Rebecca; Prazad, Saketh; Vandergon, Mark
(2023-11-01)
This paper seeks to estimate the extent to which market-implied policy expectations could be improved with further information disclosure from the FOMC. Using text analysis methods based on large language models, we show that if FOMC meeting materials with five-year lagged release dates—like meeting transcripts and Tealbooks—were accessible to the public in real time, market policy expectations could substantially improve forecasting accuracy. Most of this improvement occurs during easing cycles. For instance, at the six-month forecasting horizon, the market could have predicted as much ...
Staff Reports
, Paper 1081
Working Paper
Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say \"Usually Not\"
Li, Phillip; Chang, Andrew C.
(2015-09-04)
Finance and Economics Discussion Series
, Paper 2015-83
Speech
Remarks at the fifth Data Management Strategies and Technologies Workshop
McAndrews, James J.
(2014-02-04)
Remarks at the Fifth Data Management Strategies and Technologies Workshop, Federal Reserve Bank of New York, New York City
Speech
, Paper 129
Working Paper
Shedding Light on Survey Accuracy—A Comparison between SHED and Census Bureau Survey Results
Dasgupta, Kabir; Shaalan, Fatimah; Zabek, Mike
(2025-02-06)
The annual Survey of Household Economics and Decisionmaking (SHED) receives substantial research attention for topics related to household finances and economic well-being. To assess the reliability of data from the SHED, we compare aggregate statistics from the SHED with prominent, nationally representative surveys that use different survey designs, sample methodologies, and interview modes. Specifically, we compare recent statistics from the SHED with similar questions in U.S. Census Bureau surveys, including the Current Population Survey (CPS) and the American Community Survey (ACS). ...
Finance and Economics Discussion Series
, Paper 2025-010
Working Paper
Estimating U.S. Cross-Border Securities Positions: New Data and New Methods
Judson, Ruth; Bertaut, Carol C.
(2014-08-13)
The role of capital flows in the buildup to the global financial crisis and the potential vulnerabilities posed by capital flows to emerging market economies highlight the importance of reliable and timely measures of cross-border investment activity to better monitor developments as they unfold. We present new monthly estimates of U.S. cross-border securities investment, combining information from detailed annual Treasury International Capital (TIC) surveys with new information from the TIC form SLT. We also show how changes in the new monthly data can be decomposed into flows, estimated ...
International Finance Discussion Papers
, Paper 1113
Report
Measuring the US Employment Situation Using Online Panels: The Yale Labor Survey
Foote, Christopher L.; Hounshell, Tyler; Nordhaus, William D.; Rivers, Douglas; Torola, Pamela
(2021-12-01)
This report presents the results of a rapid, low-cost survey that collects labor market data for individuals in the United States. The Yale Labor Survey (YLS) used an online panel from YouGov to replicate statistics from the Current Population Survey (CPS), the government’s source of household labor market statistics. The YLS’s advantages include its timeliness, low cost, and ability to develop new questions quickly to study labor market patterns during the coronavirus (COVID-19) pandemic. Although YLS estimates of unemployment and participation rates mirrored the broad trends in CPS ...
Current Policy Perspectives
Working Paper
The perils of working with Big Data and a SMALL framework you can use to avoid them
Fogarty, Michael; Butters, R. Andrew; Brave, Scott A.
(2020-12-22)
The use of “Big Data” to explain fluctuations in the broader economy or guide the business decisions of a firm is now so commonplace that in some instances it has even begun to rival more traditional government statistics and business analytics. Big data sources can very often provide advantages when compared to these more traditional data sources, but with these advantages also comes the potential for pitfalls. We lay out a framework called SMALL that we have developed in order to help interested parties as they navigate the big data minefield. Based on a set of five questions, the SMALL ...
Working Paper Series
, Paper WP-2020-35
FILTER BY year
FILTER BY Bank
Board of Governors of the Federal Reserve System (U.S.) 11 items
Federal Reserve Bank of New York 3 items
Federal Reserve Bank of Chicago 2 items
Federal Reserve Bank of Dallas 2 items
Federal Reserve Bank of Kansas City 2 items
Federal Reserve Bank of Philadelphia 2 items
Federal Reserve Bank of Boston 1 items
Federal Reserve Bank of Minneapolis 1 items
show more (3)
show less
FILTER BY Series
Finance and Economics Discussion Series 8 items
International Finance Discussion Papers 3 items
Research Working Paper 2 items
Speech 2 items
Working Paper Series 2 items
Working Papers 2 items
Current Policy Perspectives 1 items
Globalization Institute Working Papers 1 items
Opportunity and Inclusive Growth Institute Working Papers 1 items
Staff Papers 1 items
Staff Reports 1 items
show more (6)
show less
FILTER BY Content Type
FILTER BY Author
Brave, Scott A. 2 items
Butters, R. Andrew 2 items
Fogarty, Michael 2 items
Lundgaard Hansen, Anne 2 items
McAndrews, James J. 2 items
Allen, Jeffrey 1 items
Andersen, Torben G. 1 items
Backer-Peral, Veronica 1 items
Batarseh, Feras A. 1 items
Bertaut, Carol C. 1 items
Boldin, Michael D. 1 items
Butler, Courtney 1 items
Chang, Andrew C. 1 items
Cheremukhin, Anton A. 1 items
Coglianese, John 1 items
Couture, Victor 1 items
Crane, Leland D. 1 items
Currier, Brett 1 items
Dasgupta, Kabir 1 items
Devlin-Foltz, Sebastian 1 items
Dingel, Jonathan 1 items
Dobrev, Dobrislav 1 items
Fischer, Eric 1 items
Foote, Christopher L. 1 items
Gopinath, Munisamy 1 items
Green, Allison 1 items
Grossman, Valerie 1 items
Handbury, Jessie 1 items
Hounshell, Tyler 1 items
Judson, Ruth 1 items
Karra, Akhil 1 items
Li, Phillip 1 items
Lillard, Kira 1 items
Mack, Adrienne 1 items
Martinez-Garcia, Enrique 1 items
McCaughrin, Rebecca 1 items
Meursault, Vitaly 1 items
Minhas, Sabrina 1 items
Monken, Anderson 1 items
Murray, Seth 1 items
Nekarda, Christopher J. 1 items
Nordhaus, William D. 1 items
Oksol, Amy 1 items
Prazad, Saketh 1 items
Rivers, Douglas 1 items
Sabelhaus, John Edward 1 items
Schaumburg, Ernst 1 items
Severen, Christopher 1 items
Shaalan, Fatimah 1 items
Soto, Paul E. 1 items
Torola, Pamela 1 items
Vandergon, Mark 1 items
Williams, Kevin 1 items
Wright, Jonathan H. 1 items
Zabek, Mike 1 items
show more (50)
show less
FILTER BY Jel Classification
C81 4 items
C18 3 items
C53 3 items
C55 3 items
C15 2 items
C22 2 items
C45 2 items
C82 2 items
C83 2 items
D10 2 items
E01 2 items
E20 2 items
G10 2 items
R40 2 items
B40 1 items
B41 1 items
C11 1 items
C14 1 items
C40 1 items
C87 1 items
C88 1 items
D80 1 items
E00 1 items
E24 1 items
E37 1 items
E42 1 items
E43 1 items
E52 1 items
E58 1 items
E66 1 items
F13 1 items
F17 1 items
F30 1 items
F60 1 items
J01 1 items
J10 1 items
J16 1 items
N32 1 items
N72 1 items
R10 1 items
Y8 1 items
show more (37)
show less
FILTER BY Keywords
Machine learning 3 items
COVID-19 2 items
Computational techniques 2 items
Consumer Credit Panel (CCP) 2 items
Economic measurement 2 items
Employment 2 items
Sentiment 2 items
Unstructured data 2 items
big data 2 items
business analytics 2 items
data innovation 2 items
data stewardship 2 items
economic statistics 2 items
forecasting 2 items
ACS 1 items
AI 1 items
Artificial intelligence 1 items
Bayesian analysis 1 items
Boosting 1 items
CPS 1 items
Capital flows 1 items
Census Bureau: CPS 1 items
Code Preservation 1 items
Consumption 1 items
Coronavirus 1 items
Data Preservation 1 items
Data mining 1 items
Demographic 1 items
Economic Journals 1 items
Entity Linking 1 items
Food insufficiency 1 items
Forecasting 1 items
Fraud detection 1 items
Functional filtering 1 items
Health insurance 1 items
High-frequency data 1 items
Homeownership 1 items
Household Surveys 1 items
Immigration 1 items
Imports and exports 1 items
Inference on integrated variance 1 items
Inference on jumps 1 items
Integrated quarticity 1 items
International trade 1 items
Labor force 1 items
Large language models 1 items
Layout Parsing 1 items
MIDAS 1 items
Multimodal LLM 1 items
OCR 1 items
Outlier events 1 items
Output gap 1 items
Panel Study of Income Dynamics 1 items
Payment cards 1 items
Population 1 items
Prediction 1 items
Quarterly Report on Household Debt and Credit 1 items
Real-time data 1 items
Robust neighborhood truncation estimator 1 items
SHED 1 items
Simulation 1 items
Survey of Consumer Expectations 1 items
Survey of Consumer Expectations (SCE) 1 items
U.S. treasuries 1 items
Unemployment 1 items
Vehicle Adoption 1 items
Weather 1 items
Yale Labor Survey 1 items
central banks and their policies 1 items
economic potential 1 items
emerging market economies 1 items
employment data 1 items
estimation 1 items
interest rates 1 items
labor markets 1 items
lifecycle 1 items
monetary policy 1 items
online panels 1 items
portfolio investment 1 items
seasonal adjustment 1 items
sentiment analysis 1 items
survey methodology 1 items
synthetic cohort 1 items
treasury international capital 1 items
show more (79)
show less