Structured Hybrid Mechanistic Models for Robust Estimation of Time-Dependent Intervention Outcomes

TL;DR

This paper introduces a hybrid mechanistic-data-driven modeling approach for estimating time-dependent intervention outcomes, combining mechanistic insights with data learning to improve robustness, especially in out-of-distribution scenarios.

Contribution

The paper presents a novel hybrid modeling framework that decomposes system dynamics into parametric and nonparametric parts, with a two-stage training process for cases with unknown mechanistic parameters.

Findings

Outperforms purely data-driven models in out-of-distribution tests.

Demonstrates effectiveness on pharmacokinetic and pendulum systems.

Provides a robust method for intervention outcome estimation.

Abstract

Estimating intervention effects in dynamical systems is crucial for outcome optimization. In medicine, such interventions arise in physiological regulation (e.g., cardiovascular system under fluid administration) and pharmacokinetics, among others. Propofol administration is an anesthetic intervention, where the challenge is to estimate the optimal dose required to achieve a target brain concentration for anesthesia, given patient characteristics, while avoiding under- or over-dosing. The pharmacokinetic state is characterized by drug concentrations across tissues, and its dynamics are governed by prior states, patient covariates, drug clearance, and drug administration. While data-driven models can capture complex dynamics, they often fail in out-of-distribution (OOD) regimes. Mechanistic models on the other hand are typically robust, but might be oversimplified. We propose a hybrid mechanistic-data-driven approach to estimate time-dependent intervention outcomes. Our approach decomposes the dynamical system's transition operator into parametric and nonparametric components, further distinguishing between intervention-related and unrelated dynamics. This structure leverages mechanistic anchors while learning residual patterns from data. For scenarios where mechanistic parameters are unknown, we introduce a two-stage procedure: first, pre-training an encoder on simulated data, and subsequently learning corrections from observed data. Two regimes with incomplete mechanistic knowledge are considered: periodic pendulum and Propofol bolus injections. Results demonstrate that our hybrid approach outperforms purely data-driven and mechanistic approaches, particularly OOD. This work highlights the potential of hybrid mechanistic-data-driven models for robust intervention optimization in complex, real-world dynamical systems.