Search Results
Working Paper
Validating Large Language Model Annotations
Lundgaard Hansen, Anne
(2026-03-30)
This paper proposes a validation framework for LLM-generated measurements when reliable benchmarks are unavailable. Validity is established by testing whether an LLM can reconstruct passages from annotated labels while maintaining semantic consistency with the original text. The framework avoids circular reasoning by establishing testable prerequisite properties that must be met for a validation to be considered successful. Application to news article data demonstrates that the framework serves as a practical alternative to human benchmarking, which offers advantages in objectivity, ...
Finance and Economics Discussion Series
, Paper 2026-020
Working Paper
Simpler Bootstrap Estimation of the Asymptotic Variance of U-statistic Based Estimators
Hu, Luojia; Honore, Bo E.
(2015-09-15)
The bootstrap is a popular and useful tool for estimating the asymptotic variance of complicated estimators. Ironically, the fact that the estimators are complicated can make the standard bootstrap computationally burdensome because it requires repeated re-calculation of the estimator. In Honor and Hu (2015), we propose a computationally simpler bootstrap procedure based on repeated re-calculation of one-dimensional estimators. The applicability of that approach is quite general. In this paper, we propose an alternative method which is specific to extremum estimators based on U-statistics. ...
Working Paper Series
, Paper WP-2015-7
Report
OLS Limit Theory for Drifting Sequences of Parameters on the Explosive Side of Unity
Magdalinos, Tassos; Petrova, Katerina
(2024-08-01)
A limit theory is developed for the least squares estimator for mildly and purely explosive autoregressions under drifting sequences of parameters with autoregressive roots ρn satisfyingρn → ρ ∈ (—∞, —1] ∪ [1, ∞) and n (|ρn| —1) → ∞.Drifting sequences of innovations and initial conditions are also considered. A standard specification of a short memory linear process for the autoregressive innovations is extended to a triangular array formulation both for the deterministic weights and for the primitive innovations of the linear process, which are allowed to be ...
Staff Reports
, Paper 1113
Report
Nonlinear Binscatter Methods
Cattaneo, Matias D.; Crump, Richard K.; Feng, Yingjie; Farrell, Max H.
(2024-08-01)
Binscatters are a powerful tool for empirical work in the social, behavioral, and biomedical sciences. Available tools rely on least squares estimation of the conditional mean. We introduce novel binscatter methods based on nonlinear, possibly nonsmooth M-estimation, covering generalized linear, robust, and quantile regression models. We provide theoretical results and practical tools, including optimal bin selection, confidence bands, and statistical tests regarding functional form or shape restrictions. We demonstrate our methods by studying the relationship of income and (lack of) health ...
Staff Reports
, Paper 1110
Working Paper
Composition-Adjusted Wage Growth: A Robust Measure from Microdata
Honore, Bo E.; Hu, Luojia
(2025-07)
Wage growth is a key indicator of labor market conditions, but common measures often conflate individual wage changes with shifts in workforce composition. This paper develops a composition-adjusted measure of wage growth using nonparametric decomposition and program evaluation methods. The adjusted measure tracks unadjusted growth in stable periods but diverges during disruptions: during the Covid-19 pandemic, wage growth falls from 12% to 6% after adjustment. The method accommodates rich covariates, is robust to data quality issues such as rounding, heaping and top-coding, and enables ...
Working Paper Series
, Paper WP 2025-14
Working Paper
Understanding Models and Model Bias with Gaussian Processes
Palmer, Nathan M.; Cook, Thomas R.
(2023-06-15)
Despite growing interest in the use of complex models, such as machine learning (ML) models, for credit underwriting, ML models are difficult to interpret, and it is possible for them to learn relationships that yield de facto discrimination. How can we understand the behavior and potential biases of these models, especially if our access to the underlying model is limited? We argue that counterfactual reasoning is ideal for interpreting model behavior, and that Gaussian processes (GP) can provide approximate counterfactual reasoning while also incorporating uncertainty in the underlying ...
Research Working Paper
, Paper RWP 23-07
Working Paper
The Income-Achievement Gap and Adult Outcome Inequality
Nielsen, Eric R.
(2015-05-14)
This paper discusses various methods for assessing group differences in academic achievement using only the ordinal content of achievement test scores. Researchers and policymakers frequently draw conclusions about achievement differences between various populations using methods that rely on the cardinal comparability of test scores. This paper shows that such methods can lead to erroneous conclusions in an important application: measuring changes over time in the achievement gap between youth from high- and low-income households. Commonly-employed, cardinal methods suggest that this ...
Finance and Economics Discussion Series
, Paper 2015-41
Working Paper
Robust Bayesian Analysis for Econometrics
Giacomini, Raffaella; Read, Matthew; Kitagawa, Toru
(2021-08-23)
We review the literature on robust Bayesian analysis as a tool for global sensitivity analysis and for statistical decision-making under ambiguity. We discuss the methods proposed in the literature, including the different ways of constructing the set of priors that are the key input of the robust Bayesian analysis. We consider both a general set-up for Bayesian statistical decisions and inference and the special case of set-identified structural models. We provide new results that can be used to derive and compute the set of posterior moments for sensitivity analysis and to compute the ...
Working Paper Series
, Paper WP-2021-11
Working Paper
Easy Bootstrap-Like Estimation of Asymptotic Variances
Hu, Luojia; Honore, Bo E.
(2018-06-29)
The bootstrap is a convenient tool for calculating standard errors of the parameter estimates of complicated econometric models. Unfortunately, the bootstrap can be very time-consuming. In a recent paper, Honor and Hu (2017), we propose a ?Poor (Wo)man's Bootstrap? based on one-dimensional estimators. In this paper, we propose a modified, simpler method and illustrate its potential for estimating asymptotic variances.
Working Paper Series
, Paper WP-2018-11
Working Paper
Finding Needles in Haystacks: Multiple-Imputation Record Linkage Using Machine Learning
Abowd, John M.; Abramowitz, Joelle Hillary; Levenstein, Margaret Catherine; McCue, Kristin; Patki, Dhiren; Raghunathan, Trivellore; Rodgers, Ann Michelle; Shapiro, Matthew D.; Wasi, Nada; Zinsser, Dawn
(2021-10-01)
This paper considers the problem of record linkage between a household-level survey and an establishment-level frame in the absence of unique identifiers. Linkage between frames in this setting is challenging because the distribution of employment across establishments is highly skewed. To address these difficulties, this paper develops a probabilistic record linkage methodology that combines machine learning (ML) with multiple imputation (MI). This ML-MI methodology is applied to link survey respondents in the Health and Retirement Study to their workplaces in the Census Business Register. ...
Working Papers
, Paper 22-11
FILTER BY year
FILTER BY Bank
Board of Governors of the Federal Reserve System (U.S.) 8 items
Federal Reserve Bank of Chicago 5 items
Federal Reserve Bank of Kansas City 4 items
Federal Reserve Bank of Dallas 3 items
Federal Reserve Bank of New York 3 items
Federal Reserve Bank of Boston 2 items
Federal Reserve Bank of Philadelphia 1 items
Federal Reserve Bank of Richmond 1 items
Federal Reserve Bank of San Francisco 1 items
Federal Reserve Bank of St. Louis 1 items
show more (5)
show less
FILTER BY Series
Finance and Economics Discussion Series 7 items
Working Paper Series 6 items
Working Papers 4 items
Research Working Paper 3 items
Staff Reports 3 items
Globalization Institute Working Papers 2 items
International Finance Discussion Papers 1 items
Regional Research Working Paper 1 items
Staff Papers 1 items
Working Paper 1 items
show more (5)
show less
FILTER BY Content Type
FILTER BY Author
Cook, Thomas R. 5 items
Palmer, Nathan M. 5 items
Honore, Bo E. 4 items
Hu, Luojia 4 items
Modig, Zach 3 items
Cattaneo, Matias D. 2 items
Chudik, Alexander 2 items
Crump, Richard K. 2 items
Farrell, Max H. 2 items
Lundgaard Hansen, Anne 2 items
Pesaran, M. Hashem 2 items
Smith, Ron P. 2 items
Abowd, John M. 1 items
Abramowitz, Joelle Hillary 1 items
Beltran, Daniel O. 1 items
Bognanni, Mark 1 items
Cheremukhin, Anton A. 1 items
Chung, Hess T. 1 items
Crawley, Edmund S. 1 items
Draper, David 1 items
Feng , Yingjie 1 items
Feng, Yingjie 1 items
Fuentes-Albero, Cristina 1 items
Giacomini, Raffaella 1 items
Gupton, Greg 1 items
Hale, Galina 1 items
Herbst, Edward 1 items
Jackson, Osborne 1 items
Kitagawa, Toru 1 items
Krainer, John 1 items
Levenstein, Margaret Catherine 1 items
Magdalinos, Tassos 1 items
Majerovitz, Jeremy 1 items
McCarthy, Erin 1 items
McCue, Kristin 1 items
Nielsen, Eric R. 1 items
Patki, Dhiren 1 items
Paustian, Matthias 1 items
Petrova, Katerina 1 items
Pfajfar, Damjan 1 items
Pinto, Santiago 1 items
Raghunathan, Trivellore 1 items
Read, Matthew 1 items
Rodgers, Ann Michelle 1 items
Sarte, Pierre-Daniel G. 1 items
Sastry, Karthik 1 items
Shapiro, Matthew D. 1 items
Sharp, Robert 1 items
Shin, Minchul 1 items
Wasi, Nada 1 items
Zinsser, Dawn 1 items
show more (46)
show less
FILTER BY Jel Classification
C14 8 items
C52 7 items
C45 6 items
C10 5 items
C15 4 items
C21 4 items
C11 3 items
C80 3 items
B4 2 items
C12 2 items
C32 2 items
C33 2 items
C5 2 items
C13 1 items
C22 1 items
C23 1 items
C26 1 items
C46 1 items
C53 1 items
C81 1 items
C83 1 items
D12 1 items
D31 1 items
D80 1 items
D91 1 items
E01 1 items
E21 1 items
E3 1 items
E32 1 items
E4 1 items
E5 1 items
E66 1 items
F16 1 items
F41 1 items
G21 1 items
G28 1 items
I21 1 items
I24 1 items
J15 1 items
J24 1 items
J31 1 items
R12 1 items
R23 1 items
show more (39)
show less
FILTER BY Keywords
Machine learning 5 items
bootstrap 3 items
inference 3 items
Artificial intelligence 2 items
Computational techniques 2 items
Economic measurement 2 items
Explainable machine learning 2 items
Gaussian process 2 items
Model interpretation 2 items
Sentiment 2 items
Shapley values 2 items
Unstructured data 2 items
binning selection 2 items
error cross-sectional dependence 2 items
great ratios 2 items
heterogeneous panels 2 items
model bias 2 items
models 2 items
robust bias correction 2 items
standard error 2 items
two-way long-run causality 2 items
uniform inference 2 items
Achievement inequality 1 items
Agent loops 1 items
Autoresearch 1 items
Bayesian Analysis 1 items
Bayesian estimation 1 items
Bayesian robustness 1 items
Cauchy distribution 1 items
Consumption 1 items
Current Population Survey (CPS) 1 items
Data decomposition 1 items
Decomposition 1 items
Diffusion Index 1 items
Double decomposition 1 items
Econometric modeling 1 items
Economic Uncertainty 1 items
Euro Area 1 items
Forecast combination 1 items
House prices 1 items
Income 1 items
Kalman filter 1 items
Kalman smoother 1 items
Likelihood 1 items
Linear models 1 items
Local identifcation 1 items
MCMC 1 items
Output gap 1 items
Policy-relevant parameters 1 items
Prior-versus-posterior comparison 1 items
Qualitative Data 1 items
Regime-Switching Models 1 items
Researcher degrees of freedom 1 items
Responsible AI 1 items
Selection 1 items
Sensitivity analysis 1 items
Sequential Monte Carlo 1 items
Shock decomposition 1 items
Specification search 1 items
Statistical inference 1 items
Time Aggregation 1 items
U-statistics 1 items
Vector Autoregressions 1 items
Wage growth 1 items
administrative data 1 items
ambiguity 1 items
anchoring 1 items
applied econometrics 1 items
arbitrage conditions 1 items
biases 1 items
binned scatter plot 1 items
censored regression 1 items
cointegration 1 items
conditional heteroskedasticity 1 items
economic potential 1 items
episodic cointegration 1 items
estimation 1 items
explosive autoregression 1 items
human capital 1 items
identifying restrictions 1 items
latent variables 1 items
linear process 1 items
machine learning 1 items
measurement of inequality 1 items
mixingale 1 items
multiple imputation 1 items
multiple priors 1 items
multiracial 1 items
nonparametric regressions 1 items
numerical derivatives 1 items
ordinal statistics 1 items
parametric estimation 1 items
partition-based semi-linear estimators 1 items
partitioning estimators 1 items
piecewise polynomials 1 items
probabilistic record linkage 1 items
quantile regression 1 items
racial identity 1 items
regional data 1 items
regressogram 1 items
shift-share instruments 1 items
statistical decision theory 1 items
structural models 1 items
structural vector autoregressions 1 items
survey data 1 items
treatment effect estimation 1 items
triangular array 1 items
two-step estimation 1 items
show more (103)
show less