Quantile Regression using Random Forest Proximities

TL;DR

This paper introduces a novel method for quantile regression using random forest proximities, improving the accuracy and efficiency of uncertainty estimation in financial market predictions.

Contribution

The paper presents a new approach to compute quantile regressions from random forests leveraging learned proximities, enhancing performance and computational efficiency.

Findings

Superior approximation of conditional distributions and prediction intervals.

Significant computational efficiency over traditional QRF methods.

Effective application to bond volume forecasting.

Abstract

Due to the dynamic nature of financial markets, maintaining models that produce precise predictions over time is difficult. Often the goal isn't just point prediction but determining uncertainty. Quantifying uncertainty, especially the aleatoric uncertainty due to the unpredictable nature of market drivers, helps investors understand varying risk levels. Recently, quantile regression forests (QRF) have emerged as a promising solution: Unlike most basic quantile regression methods that need separate models for each quantile, quantile regression forests estimate the entire conditional distribution of the target variable with a single model, while retaining all the salient features of a typical random forest. We introduce a novel approach to compute quantile regressions from random forests that leverages the proximity (i.e., distance metric) learned by the model and infers the conditional distribution of the target variable. We evaluate the proposed methodology using publicly available datasets and then apply it towards the problem of forecasting the average daily volume of corporate bonds. We show that using quantile regression using Random Forest proximities demonstrates superior performance in approximating conditional target distributions and prediction intervals to the original version of QRF. We also demonstrate that the proposed framework is significantly more computationally efficient than traditional approaches to quantile regressions.