Generative Modelling of 3D in-silico Spongiosa with Controllable Micro-Structural Parameters

TL;DR

This paper introduces a novel GAN-based method to generate realistic 3D in-silico bone micro-structures with controllable properties, enabling cost-effective research and therapy simulation.

Contribution

It adapts style-transfer techniques within a volumetric GAN framework to produce customizable bone micro-structure samples from limited data.

Findings

Generated bone patches match real data distribution.

Controlled micro-structure properties are achievable via latent space optimization.

Simulated effects of osteoporosis therapies on bone micro-structure.

Abstract

Research in vertebral bone micro-structure generally requires costly procedures to obtain physical scans of real bone with a specific pathology under study, since no methods are available yet to generate realistic bone structures in-silico. Here we propose to apply recent advances in generative adversarial networks (GANs) to develop such a method. We adapted style-transfer techniques, which have been largely used in other contexts, in order to transfer style between image pairs while preserving its informational content. In a first step, we trained a volumetric generative model in a progressive manner using a Wasserstein objective and gradient penalty (PWGAN-GP) to create patches of realistic bone structure in-silico. The training set contained 7660 purely spongeous bone samples from twelve human vertebrae (T12 or L1) with isotropic resolution of 164um and scanned with a high resolution peripheral quantitative CT (Scanco XCT). After training, we generated new samples with tailored micro-structure properties by optimizing a vector z in the learned latent space. To solve this optimization problem, we formulated a differentiable goal function that leads to valid samples while compromising the appearance (content) with target 3D properties (style). Properties of the learned latent space effectively matched the data distribution. Furthermore, we were able to simulate the resulting bone structure after deterioration or treatment effects of osteoporosis therapies based only on expected changes of micro-structural parameters. Our method allows to generate a virtually infinite number of patches of realistic bone micro-structure, and thereby likely serves for the development of bone-biomarkers and to simulate bone therapies in advance.