Search Results
Working Paper
Total Recall? Evaluating the Macroeconomic Knowledge of Large Language Models
We evaluate the ability of large language models (LLMs) to estimate historical macroeconomic variables and data release dates. We find that LLMs have precise knowledge of some recent statistics, but performance degrades as we go farther back in history. We highlight two particularly important kinds of recall errors: mixing together first print data with subsequent revisions (i.e., smoothing across vintages) and mixing data for past and future reference periods (i.e., smoothing within vintages). We also find that LLMs can often recall individual data release dates accurately, but aggregating ...
Discussion Paper
Firms and Artificial Intelligence: A Regional Update
Similar to past technological developments, the productivity implications, labor market implications, and thus economic implications of Artificial Intelligence (AI) will evolve over time. A lot depends on who is using AI tools, when they are using them, and how they are using them.In the Richmond Fed's December business surveys — which were fielded between Dec. 1 and Dec. 17 — we asked firms if they have adopted AI and if so, how they were using it. Businesses reported that they were increasingly providing employees with access to AI tools to complete tasks but were less likely to have ...
Working Paper
Explaining Machine Learning by Bootstrapping Partial Marginal Effects and Shapley Values
Machine learning and artificial intelligence are often described as “black boxes.” Traditional linear regression is interpreted through its marginal relationships as captured by regression coefficients. We show that the same marginal relationship can be described rigorously for any machine learning model by calculating the slope of the partial dependence functions, which we call the partial marginal effect (PME). We prove that the PME of OLS is analytically equivalent to the OLS regression coefficient. Boot- strapping provides standard errors and confidence intervals around the point ...
Report
How Retrainable Are AI-Exposed Workers?
We document the extent to which workers in AI-exposed occupations can successfully retrain for AI-intensive work. We assemble a new workforce development dataset spanning over 1.6 million job training participation spells from all U.S. Workforce Investment and Opportunity Act programs from 2012-2023 linked with occupational measures of AI exposure. Using earnings records observed before and after training, we compare high AI exposure trainees to a matched sample of similar workers who only received job search assistance. We find that AI-exposed workers have high earnings returns from training ...
Working Paper
Artificial Intelligence Innovation by Financial Innovators: Evidence from US Patents
This paper examines the evolution of artificial intelligence (AI) patent rates (i.e., the number of AI patents/number of firms of the same type) and concentration metrics (i.e., the Herfindahl-Hirschman Index (HHI) and Gini coefficient) among financial market participants from 2000 to 2020. It documents the historical trajectories of AI innovation for regulated banking entities and less-regulated firms, revealing that nonfinancial companies exhibit the highest baseline AI patent rate, while banks show the highest growth in AI patent rate over time. Banks have the highest HHI, and nonfinancial ...
Working Paper
Artificial Intelligence and Inflation Forecasts
We explore the ability of Large Language Models (LLMs) to produce in-sample conditional inflation forecasts during the 2019-2023 period. We use a leading LLM (Google AI's PaLM) to produce distributions of conditional forecasts at different horizons and compare these forecasts to those of a leading source, the Survey of Professional Forecasters (SPF). We find that LLM forecasts generate lower mean-squared errors overall in most years, and at almost all horizons. LLM forecasts exhibit slower reversion to the 2% inflation anchor.
Working Paper
Artificial Intelligence and Inflation Forecasts
We explore the ability of Large Language Models (LLMs) to produce conditional inflation forecasts during the 2019-2023 period. We use a leading LLM (Google AI's PaLM) to produce distributions of conditional forecasts at different horizons and compare these forecasts to those of a leading source, the Survey of Professional Forecasters (SPF). We find that LLM forecasts generate lower mean-squared errors overall in most years, and at almost all horizons. LLM forecasts exhibit slower reversion to the 2% inflation anchor. We argue that this method of generating forecasts is inexpensive and can be ...
Discussion Paper
AI and the Labor Market: Will Firms Hire, Fire, or Retrain?
The rapid rise in Artificial Intelligence (AI) has the potential to dramatically change the labor market, and indeed possibly even the nature of work itself. However, how firms are adjusting their workforces to accommodate this emerging technology is not yet clear. Our August regional business surveys asked manufacturing and service firms special topical questions about their use of AI, and how it is changing their workforces. Most firms that report expected AI use in the next six months plan to retrain their workforces, with far fewer reporting adjustments to planned headcounts.
Journal Article
Machine Learning a Ramsey Plan
We use a Python program to calculate a pair of infinite sequences of money creation and price level inflation rates that maximize a benevolent time 0 government’s quadratic objective function for a linear-quadratic version of Calvo (1978). The program computes an open-loop representation of the optimal plan and an associated monotonically declining, bounded from below sequence of continuation values whose limit is a worst continuation value that is associated with a “timeless perspective”. We run some least squares regressions on fake data to try to learn about the structure of the ...
Discussion Paper
By Degree(s): Measuring Employer Demand for AI Skills by Educational Requirements
The rapid advancement of artificial intelligence (AI) has prompted widespread interest and discussion about its potential to transform the labor market. For workforce development practitioners, a key issue is how AI is changing the nature of work, mainly through changes in the skills workers need to be competitive for the jobs of today and of the future. In this Workforce Currents, we explore the growth of employer demand for AI skills in online job postings data between 2010 and 2024. Lightcast, a labor analytics firm, provides job postings data that includes several useful features of ...