Success Stories from a Democratized Experimentation Platform

TL;DR

This paper showcases how democratizing experimentation and efficient computation in a platform enables the development of advanced models that solve diverse business problems, fostering innovation and continuous improvement.

Contribution

It introduces a modular experimentation platform supporting four novel models, demonstrating how democratization accelerates methodological and business innovation.

Findings

Successful implementation of four new models on the platform

Enhanced collaboration between users and developers

Continuous methodological improvements driven by user contributions

Abstract

We demonstrate the effectiveness of democratization and efficient computation as key concepts of our experimentation platform (XP) by presenting four new models supported by the platform: 1) Weighted least squares, 2) Quantile bootstrapping, 3) Bayesian shrinkage, and 4) Dynamic treatment effects. Each model is motivated by a specific business problem but is generalizable and extensible. The modular structure of our platform allows independent innovation on statistical and computational methods. In practice, a technical symbiosis is created where increasingly advanced user contributions inspire innovations to the software that in turn enable further methodological improvements. This cycle adds further value to how the XP contributes to business solutions.