The Meta-Learning Gap: Combining Hydra and Quant for Large-Scale Time Series Classification

TL;DR

This paper explores combining two efficient time series classifiers, Hydra and Quant, to improve accuracy while maintaining computational feasibility, revealing significant potential and challenges in meta-learning for large-scale datasets.

Contribution

It introduces combined ensemble configurations of Hydra and Quant, analyzes their performance on large datasets, and highlights the gap between theoretical potential and practical meta-learning strategies.

Findings

Strongest ensemble improves accuracy from 0.829 to 0.836

Prediction ensembles capture only 11% of oracle potential

Feature-concatenation surpasses oracle bounds by learning new decision boundaries

Abstract

Time series classification faces a fundamental trade-off between accuracy and computational efficiency. While comprehensive ensembles like HIVE-COTE 2.0 achieve state-of-the-art accuracy, their 340-hour training time on the UCR benchmark renders them impractical for large-scale datasets. We investigate whether targeted combinations of two efficient algorithms from complementary paradigms can capture ensemble benefits while maintaining computational feasibility. Combining Hydra (competing convolutional kernels) and Quant (hierarchical interval quantiles) across six ensemble configurations, we evaluate performance on 10 large-scale MONSTER datasets (7,898 to 1,168,774 training instances). Our strongest configuration improves mean accuracy from 0.829 to 0.836, succeeding on 7 of 10 datasets. However, prediction-combination ensembles capture only 11% of theoretical oracle potential, revealing a substantial meta-learning optimization gap. Feature-concatenation approaches exceeded oracle bounds by learning novel decision boundaries, while prediction-level complementarity shows moderate correlation with ensemble gains. The central finding: the challenge has shifted from ensuring algorithms are different to learning how to combine them effectively. Current meta-learning strategies struggle to exploit the complementarity that oracle analysis confirms exists. Improved combination strategies could potentially double or triple ensemble gains across diverse time series classification applications.