Search Results

SORT BY: PREVIOUS / NEXT
Author:Borup, Daniel 

Working Paper
The Anatomy of Out-of-Sample Forecasting Accuracy

We introduce the performance-based Shapley value (PBSV) to measure the contributions of individual predictors to the out-of-sample loss for time-series forecasting models. Our new metric allows a researcher to anatomize out-of-sample forecasting accuracy, thereby providing valuable information for interpreting time-series forecasting models. The PBSV is model agnostic—so it can be applied to any forecasting model, including "black box" models in machine learning, and it can be used for any loss function. We also develop the TS-Shapley-VI, a version of the conventional Shapley value that ...
FRB Atlanta Working Paper , Paper 2022-16b

Working Paper
The Anatomy of Out-of-Sample Forecasting Accuracy

We develop metrics based on Shapley values for interpreting time-series forecasting models, including“black-box” models from machine learning. Our metrics are model agnostic, so that they are applicable to any model (linear or nonlinear, parametric or nonparametric). Two of the metrics, iShapley-VI and oShapley-VI, measure the importance of individual predictors in fitted models for explaining the in-sample and out-of-sample predicted target values, respectively. The third metric is the performance-based Shapley value (PBSV), our main methodological contribution. PBSV measures the ...
FRB Atlanta Working Paper , Paper 2022-16

FILTER BY year

FILTER BY Bank

FILTER BY Series

FILTER BY Content Type

FILTER BY Jel Classification

C22 2 items

C45 2 items

C53 2 items

E37 2 items

C52 1 items

E31 1 items

show more (2)

FILTER BY Keywords

PREVIOUS / NEXT