Learning Tumor Growth via Follow-Up Volume Prediction for Lung Nodules

TL;DR

This paper introduces NoFoNet, a deep learning framework that predicts lung nodule growth and risk level from follow-up scans, improving accuracy and interpretability over existing methods.

Contribution

The study presents a novel unified deep learning model that predicts future nodule displacement and texture, incorporating time-aware and shape-aware features for better risk stratification.

Findings

NoFoNet outperforms U-Net in visual quality of predictions.

It accurately differentiates high- and low-risk nodules.

The method shows promise for aiding lung nodule management.

Abstract

Follow-up serves an important role in the management of pulmonary nodules for lung cancer. Imaging diagnostic guidelines with expert consensus have been made to help radiologists make clinical decision for each patient. However, tumor growth is such a complicated process that it is difficult to stratify high-risk nodules from low-risk ones based on morphologic characteristics. On the other hand, recent deep learning studies using convolutional neural networks (CNNs) to predict the malignancy score of nodules, only provides clinicians with black-box predictions. To this end, we propose a unified framework, named Nodule Follow-Up Prediction Network (NoFoNet), which predicts the growth of pulmonary nodules with high-quality visual appearances and accurate quantitative results, given any time interval from baseline observations. It is achieved by predicting future displacement field of each voxel with a WarpNet. A TextureNet is further developed to refine textural details of WarpNet outputs. We also introduce techniques including Temporal Encoding Module and Warp Segmentation Loss to encourage time-aware and shape-aware representation learning. We build an in-house follow-up dataset from two medical centers to validate the effectiveness of the proposed method. NoFoNet significantly outperforms direct prediction by a U-Net in terms of visual quality; more importantly, it demonstrates accurate differentiating performance between high- and low-risk nodules. Our promising results suggest the potentials in computer aided intervention for lung nodule management.