Anchored Variational Inference for Personalized Sequential Latent-State Models

TL;DR

This paper introduces an anchored variational inference method for efficient approximate inference in sequential latent-variable models with subject-specific effects, reducing computational costs while maintaining accuracy.

Contribution

It proposes a novel anchored variational EM framework that simplifies inference in models with random effects, applicable to hidden Markov and state-space models.

Findings

Achieves accurate parameter estimation with reduced computational time.

The anchored approach maintains local inference quality in sequential models.

Simulation studies demonstrate the method's effectiveness and efficiency.

Abstract

Sequential latent-variable models with subject-specific random effects provide a flexible framework for modeling temporally structured data with both local latent dynamics and stable between-subject heterogeneity. In such models, conditional inference for the local latent process is often tractable, but integrating over subject-specific random effects can be computationally demanding. We propose an anchored variational inference framework for efficient approximate inference in this setting. The central idea is to replace the full conditional posterior of the local latent process with its evaluation at a representative value of the subject-specific latent effect, called the anchor point, thereby preserving tractable local inference while substantially reducing computational cost. This approximation is especially appealing in sequential settings, where the posterior distribution of the random effect becomes increasingly concentrated as the sequence length grows. Under suitable conditions, we show that the posterior mean is a nearly optimal anchor point and that the resulting anchored variational EM (AVEM) algorithm approximately preserves the local monotonicity behavior of standard variational inference. We instantiate the framework in two representative classes of sequential latent-variable models, namely mixed hidden Markov models and mixed-effects state-space models, derive the corresponding AVEM algorithms, and use simulation studies to indicate that the resulting methods achieve accurate estimation with substantial computational gains. We also discuss a partially anchored variant of the framework, in which only the components of the subject-specific latent effect whose posteriors are well concentrated are anchored.