Search Results
Discussion Paper
Measuring and Managing COVID-19 Model Risk
Jensen, Mark J.
(2020-06-18)
One of the many lessons learned from the financial crisis is the increased awareness of model risk. In this article, I apply the best practices of model risk management found in SR 11-7 (which offers regulatory guidance on the best practices for managing model risk) to COVID-19 models. In particular, I investigate the Institute of Health Metrics and Evaluation's (IHME) model to see if it has been effectively challenged with a critical assessment of its conceptual soundness, ongoing monitoring, and outcomes analysis.
Policy Hub*
, Paper 2020-07
Discussion Paper
Measuring and Managing COVID-19 Model Risk
Jensen, Mark J.
(2020-06-18)
One of the many lessons learned from the financial crisis is the increased awareness of model risk. In this article, I apply the best practices of model risk management found in SR 11-7 (which offers regulatory guidance on the best practices for managing model risk) to COVID-19 models. In particular, I investigate the Institute of Health Metrics and Evaluation’s (IHME) model to see if it has been effectively challenged with a critical assessment of its conceptual soundness, ongoing monitoring, and outcomes analysis.
Policy Hub*
, Paper 2020-7
Journal Article
Measuring and Managing COVID-19 Model Risk
Jensen, Mark J.
(2020-06-18)
One of the many lessons learned from the financial crisis is the increased awareness of model risk. In this article, I apply the best practices of model risk management found in SR 11-7 (which offers regulatory guidance on the best practices for managing model risk) to COVID-19 models. In particular, I investigate the Institute of Health Metrics and Evaluation's (IHME) model to see if it has been effectively challenged with a critical assessment of its conceptual soundness, ongoing monitoring, and outcomes analysis.
Policy Hub
, Volume 2020
, Issue 7
, Pages 12
Working Paper
A Uniformly Valid Test for Instrument Exogeneity
Gospodinov, Nikolay; Dovonon, Prosper
(2025-09-25)
This paper studies the limiting behavior of the test for instrument exogeneity in linear models when there is uncertainty about the strength of the identification signal. We consider the test for conditional moment restrictions with an expanding set of constructed instruments. We establish the uniform validity of the standard normal asymptotic approximation, under the null, of this specification test over all possible degrees of model identification. As a result, this allows the researcher to use standard inference for testing instrument exogeneity without the need of any prior knowledge if ...
FRB Atlanta Working Paper
, Paper 2025-9
Working Paper
On Model Aggregation and Forecast Combination
Massoumi, Esfandiar; Gospodinov, Nikolay
(2025-10-09)
Policy makers express their views and decisions via the lens of a particular model or theory. But since any model is a highly stylized representation of the unknowable object of interest, all these models are inherently misspecified, and the resulting ambiguity injects uncertainty in the decision-making process. We argue that entropy-based aggregation is a convenient device to confront this uncertainty and summarize relevant information from a set of candidate models and forecasts. The proposed aggregation tends to robustify the decision-making process to various sources of risks and ...
FRB Atlanta Working Paper
, Paper 2025-12
Working Paper
Misspecification-robust inference in linear asset pricing models with irrelevant risk factors
Robotti, Cesare; Gospodinov, Nikolay; Kan, Raymond
(2013-10-01)
We show that in misspecified models with useless factors (for example, factors that are independent of the returns on the test assets), the standard inference procedures tend to erroneously conclude, with high probability, that these irrelevant factors are priced and the restrictions of the model hold. Our proposed model selection procedure, which is robust to useless factors and potential model misspecification, restores the standard inference and proves to be effective in eliminating factors that do not improve the model's pricing ability. The practical relevance of our analysis is ...
FRB Atlanta Working Paper
, Paper 2013-09
Working Paper
General Aggregation of Misspecified Asset Pricing Models
Maasoumi, Esfandiar; Gospodinov, Nikolay
(2017-11-01)
This paper proposes an entropy-based approach for aggregating information from misspecified asset pricing models. The statistical paradigm is shifted away from parameter estimation of an optimally selected model to stochastic optimization based on a risk function of aggregation across models. The proposed method relaxes the perfect substitutability of the candidate models, which is implicitly embedded in the linear pooling procedures, and ensures that the aggregation weights are selected with a proper (Hellinger) distance measure that satisfies the triangle inequality. The empirical results ...
FRB Atlanta Working Paper
, Paper 2017-10
Working Paper
The Anatomy of Out-of-Sample Forecasting Accuracy
Goulet Coulombe, Philippe; Rapach, David E.; Schwenk-Nebbe, Sander; Montes Schütte, Erik Christian; Borup, Daniel
(2024-02-21)
We introduce the performance-based Shapley value (PBSV) to measure the contributions of individual predictors to the out-of-sample loss for time-series forecasting models. Our new metric allows a researcher to anatomize out-of-sample forecasting accuracy, thereby providing valuable information for interpreting time-series forecasting models. The PBSV is model agnostic—so it can be applied to any forecasting model, including "black box" models in machine learning, and it can be used for any loss function. We also develop the TS-Shapley-VI, a version of the conventional Shapley value that ...
FRB Atlanta Working Paper
, Paper 2022-16b
Working Paper
How Magic a Bullet Is Machine Learning for Credit Analysis? An Exploration with FinTech Lending Data
Wang, J. Christina; Perkins, Charles B.
(2019-10-14)
FinTech online lending to consumers has grown rapidly in the post-crisis era. As argued by its advocates, one key advantage of FinTech lending is that lenders can predict loan outcomes more accurately by employing complex analytical tools, such as machine learning (ML) methods. This study applies ML methods, in particular random forests and stochastic gradient boosting, to loan-level data from the largest FinTech lender of personal loans to assess the extent to which those methods can produce more accurate out-of-sample predictions of default on future loans relative to standard regression ...
Working Papers
, Paper 19-16
Working Paper
Testing for Differences in Path Forecast Accuracy: Forecast-Error Dynamics Matter
Martinez, Andrew
(2017-11-02)
Although the trajectory and path of future outcomes plays an important role in policy decisions, analyses of forecast accuracy typically focus on individual point forecasts. However, it is important to examine the path forecasts errors since they include the forecast dynamics. We use the link between path forecast evaluation methods and the joint predictive density to propose a test for differences in system path forecast accuracy. We also demonstrate how our test relates to and extends existing joint testing approaches. Simulations highlight both the advantages and disadvantages of path ...
Working Papers (Old Series)
, Paper 1717
FILTER BY YEAR
FILTER BY BANK
Federal Reserve Bank of St. Louis 20 items
Federal Reserve Bank of Dallas 18 items
Board of Governors of the Federal Reserve System (U.S.) 14 items
Federal Reserve Bank of Atlanta 8 items
Federal Reserve Bank of Cleveland 8 items
Federal Reserve Bank of Kansas City 8 items
Federal Reserve Bank of San Francisco 8 items
Federal Reserve Bank of Philadelphia 7 items
Federal Reserve Bank of New York 5 items
Federal Reserve Bank of Chicago 3 items
Federal Reserve Bank of Boston 1 items
Federal Reserve Bank of Richmond 1 items
show more (7)
show less
FILTER BY SERIES
Working Papers 43 items
Finance and Economics Discussion Series 12 items
Working Paper Series 11 items
Research Working Paper 8 items
Globalization Institute Working Papers 6 items
FRB Atlanta Working Paper 5 items
Staff Reports 4 items
Working Papers (Old Series) 4 items
International Finance Discussion Papers 2 items
Policy Hub* 2 items
Liberty Street Economics 1 items
Policy Hub 1 items
Review 1 items
Working Paper 1 items
show more (9)
show less
FILTER BY CONTENT TYPE
FILTER BY AUTHOR
McCracken, Michael W. 21 items
Kilian, Lutz 11 items
Chudik, Alexander 6 items
Gospodinov, Nikolay 6 items
Pesaran, M. Hashem 6 items
Amburgey, Aaron 5 items
Inoue, Atsushi 5 items
Gonçalves, Sílvia 4 items
Owyang, Michael T. 4 items
Sharifvaghefi, Mahrad 4 items
Bognanni, Mark 3 items
Freyaldenhoven, Simon 3 items
González-Astudillo, Manuel 3 items
Herbst, Edward P. 3 items
Jensen, Mark J. 3 items
Kurozumi, Takushi 3 items
Lusompa, Amaze 3 items
McGillicuddy, Joseph 3 items
Sekhposyan, Tatevik 3 items
Shin, Minchul 3 items
Van Zandweghe, Willem 3 items
Yao, Yongxu 3 items
Çakır Melek, Nida 3 items
Calomiris, Charles W. 2 items
Chib, Siddhartha 2 items
Clark, Todd E. 2 items
Cook, Thomas R. 2 items
Crump, Richard K. 2 items
Gelain, Paolo 2 items
Gordy, Michael B. 2 items
Hirose, Yasuo 2 items
Jordà, Òscar 2 items
Kapetanios, George 2 items
Lopez, Jose A. 2 items
Mamaysky, Harry 2 items
McNeil, Alexander J. 2 items
Modig, Zach 2 items
Palmer, Nathan M. 2 items
Schorfheide, Frank 2 items
Schularick, Moritz 2 items
Taylor, Alan M. 2 items
Zhou, Xiaoqing 2 items
Barcelona, William 1 items
Barreto, César 1 items
Bertheau, Antoine 1 items
Borup, Daniel 1 items
Brown, Jason 1 items
Cascaldi-Garcia, Danilo 1 items
Cheng, Xu 1 items
Christensen, Jens H. E. 1 items
Chung, Hess T. 1 items
Del Negro, Marco 1 items
Dennis, Richard 1 items
Dovonon, Prosper 1 items
Ericsson, Neil R. 1 items
Ferreira, Miguel A. 1 items
Foroni, Claudia 1 items
Fuentes-Albero, Cristina 1 items
Furlanetto, Francesco 1 items
Giacomini, Raffaella 1 items
Giannoni, Marc 1 items
Goulet Coulombe, Philippe 1 items
Grover, Sean P. 1 items
Gulumser, Dogan 1 items
Hale, Galina 1 items
Hansen, Christian 1 items
Hijzen, Alexander 1 items
Ho, Paul 1 items
Hoek, Jasper 1 items
Hoesch, Lukas 1 items
Hubrich, Kirstin 1 items
Johannsen, Benjamin K. 1 items
Kan, Raymond 1 items
Kitagawa, Toru 1 items
Krainer, John 1 items
Kunze, Astrid 1 items
Lachowska, Marta 1 items
Lassen, Anne Sophie 1 items
Lattanzio, Salvatore 1 items
Liao, Zhipeng 1 items
Liu, Weiling 1 items
Lochner, Benjamin 1 items
Lombardi, Stefano 1 items
Lopez Gaffney, Ignacio 1 items
Lubik, Thomas A. 1 items
Maasoumi, Esfandiar 1 items
Marcellino, Massimiliano 1 items
Marquez, Jaime R. 1 items
Martinez, Andrew 1 items
Massoumi, Esfandiar 1 items
Matschke, Johannes 1 items
Matthes, Christian 1 items
McCarthy, Erin 1 items
Meekes, Jordy 1 items
Melosi, Leonardo 1 items
Moench, Emanuel 1 items
Montes Schütte, Erik Christian 1 items
Muraközy, Balázs 1 items
Nicolo, Giovanni 1 items
Nordström Skans, Oskar 1 items
Oishi, Ryohei 1 items
Palladino, Marco 1 items
Paustian, Matthias 1 items
Perez Perez, Jorge 1 items
Perkins, Charles B. 1 items
Perron, Benoit 1 items
Pfajfar, Damjan 1 items
Rapach, David E. 1 items
Read, Matthew 1 items
Roberts, John M. 1 items
Robotti, Cesare 1 items
Rossi, Barbara 1 items
Rudebusch, Glenn D. 1 items
Sanjani, Marzie 1 items
Sattiraju, Sai 1 items
Sbordone, Argia M. 1 items
Schindler, John W. 1 items
Schor, Nathan 1 items
Schwenk-Nebbe, Sander 1 items
Shapiro, Jesse 1 items
Simoni, Anna 1 items
Skudelny, Frauke 1 items
Smith, Simon C. 1 items
Van Leemput, Eva 1 items
Wang, J. Christina 1 items
show more (120)
show less
FILTER BY JEL CLASSIFICATION
C53 32 items
C32 28 items
C12 21 items
C11 18 items
C22 18 items
E31 11 items
E32 11 items
C55 9 items
C38 8 items
Q43 8 items
C13 7 items
C14 7 items
C18 7 items
E37 7 items
E52 6 items
G12 6 items
Q41 5 items
C15 4 items
C36 4 items
G21 4 items
C1 3 items
C10 3 items
C45 3 items
C50 3 items
C51 3 items
E3 3 items
E4 3 items
E5 3 items
G17 3 items
Q47 3 items
C23 2 items
C26 2 items
C58 2 items
C62 2 items
E43 2 items
E44 2 items
E51 2 items
G14 2 items
G28 2 items
G32 2 items
N10 2 items
N20 2 items
C33 1 items
C54 1 items
D83 1 items
E27 1 items
E50 1 items
F32 1 items
F41 1 items
F42 1 items
F44 1 items
G01 1 items
G10 1 items
G11 1 items
G18 1 items
G23 1 items
G41 1 items
J24 1 items
J31 1 items
J71 1 items
show more (56)
show less