Deep Representation Learning of Tissue Metabolome and Computed Tomography Images Annotates Non-invasive Classification and Prognosis Prediction of NSCLC
Marc Boubnovski Martell, Kristofer Linton-Reid, Sumeet Hindocha,, Mitchell Chen, OCTAPUS-AI, Paula Moreno, Marina \'Alvarez-Benito, \'Angel, Salvatierra, Richard Lee, Joram M. Posma, Marco A Calzado, Eric O Aboagye

TL;DR
This study introduces a deep learning framework that integrates tissue metabolomics and CT imaging to non-invasively classify NSCLC histology and predict patient prognosis, outperforming traditional radiomics and clinical models.
Contribution
The paper presents a novel deep learning approach that embeds metabolomic information into CT images, enabling non-invasive histology classification and prognosis prediction in NSCLC.
Findings
Achieved F1-score of 0.78 for histology classification.
Attained a c-index of 0.72 for prognosis prediction.
Surpassed radiomics and clinical models in performance.
Abstract
The rich chemical information from tissue metabolomics provides a powerful means to elaborate tissue physiology or tumor characteristics at cellular and tumor microenvironment levels. However, the process of obtaining such information requires invasive biopsies, is costly, and can delay clinical patient management. Conversely, computed tomography (CT) is a clinical standard of care but does not intuitively harbor histological or prognostic information. Furthermore, the ability to embed metabolome information into CT to subsequently use the learned representation for classification or prognosis has yet to be described. This study develops a deep learning-based framework -- tissue-metabolomic-radiomic-CT (TMR-CT) by combining 48 paired CT images and tumor/normal tissue metabolite intensities to generate ten image embeddings to infer metabolite-derived representation from CT alone. In…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsRadiomics and Machine Learning in Medical Imaging · Medical Imaging Techniques and Applications · Advanced X-ray and CT Imaging
