Energy-Arena: A Dynamic Benchmark for Operational Energy Forecasting

TL;DR

Energy-Arena introduces a dynamic, standardized benchmarking platform for operational energy forecasting, enabling consistent progress measurement and transparency through continuous evaluation and open submissions.

Contribution

It presents a novel, open API-based platform that standardizes energy forecasting challenges and moves from retrospective to forward-looking benchmarking.

Findings

Provides a publicly available platform at Energy-Arena.org

Enforces standardized challenge definitions and evaluation protocols

Improves transparency and comparability in energy forecasting research

Abstract

Energy forecasting research faces a persistent comparability gap that makes it difficult to measure consistent progress over time. Reported accuracy gains are often not directly comparable because models are evaluated under study-specific datasets, time periods, information sets, and scoring setups, while widely used benchmarks and competition datasets are typically tied to fixed historical windows. This paper introduces the Energy-Arena, a dynamic benchmarking platform for operational energy time series forecasting that provides a continuously updated reference point as energy systems evolve. The platform operates as an open, API-based submission system and standardizes challenge definitions and submission deadlines aligned with operational constraints. Performance is reported on rolling evaluation windows via persistent leaderboards. By moving from retrospective backtesting to forward-looking benchmarking, the Energy-Arena enforces standardized ex-ante submission and ex-post evaluation, thereby improving transparency by preventing information leakage and retroactive tuning. The platform is publicly available at Energy-Arena.org.