Gluformer: Transformer-Based Personalized Glucose Forecasting with Uncertainty Quantification
Renat Sergazinov, Mohammadreza Armandpour, Irina Gaynanova

TL;DR
Gluformer introduces a Transformer-based model for personalized blood glucose forecasting that effectively quantifies uncertainty, improving prediction accuracy especially for complex, multi-modal trajectories, facilitating clinical adoption.
Contribution
The paper presents a novel Transformer-based approach modeling glucose trajectories as infinite mixture distributions to incorporate uncertainty quantification.
Findings
Outperforms existing methods in accuracy on benchmark datasets.
Provides reliable uncertainty estimates for glucose predictions.
Demonstrates effectiveness on synthetic and real data.
Abstract
Deep learning models achieve state-of-the art results in predicting blood glucose trajectories, with a wide range of architectures being proposed. However, the adaptation of such models in clinical practice is slow, largely due to the lack of uncertainty quantification of provided predictions. In this work, we propose to model the future glucose trajectory conditioned on the past as an infinite mixture of basis distributions (i.e., Gaussian, Laplace, etc.). This change allows us to learn the uncertainty and predict more accurately in the cases when the trajectory has a heterogeneous or multi-modal distribution. To estimate the parameters of the predictive distribution, we utilize the Transformer architecture. We empirically demonstrate the superiority of our method over existing state-of-the-art techniques both in terms of accuracy and uncertainty on the synthetic and benchmark glucose…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsDiabetes Management and Research · Metabolomics and Mass Spectrometry Studies · Machine Learning in Healthcare
MethodsMulti-Head Attention · Attention Is All You Need · Linear Layer · Position-Wise Feed-Forward Layer · Byte Pair Encoding · Adam · Softmax · Absolute Position Encodings · Dropout · Dense Connections
