Deep Q-learning of global optimizer of multiply model parameters for viscoelastic imaging

TL;DR

This paper introduces DQMP, a deep reinforcement learning method for global optimization of multiple model parameters in viscoelastic imaging, effectively avoiding local minima and achieving high accuracy.

Contribution

The paper presents a novel Deep Q-learning approach for global parameter optimization in complex imaging tasks, outperforming existing methods in accuracy and reliability.

Findings

DQMP yields less than 2% error in parameter estimation.

DQMP demonstrates strong potential in biological tissue imaging.

The method is effective in avoiding local minima in non-convex optimization.

Abstract

Objective: Estimation of the global optima of multiple model parameters is valuable in imaging to form a reliable diagnostic image. Given non convexity of the objective function, it is challenging to avoid from different local minima. Methods: We first formulate the global searching of multiply parameters to be a k-D move in the parametric space, and convert parameters updating to be state-action decision-making problem. We proposed a novel Deep Q-learning of Model Parameters (DQMP) method for global optimization of model parameters by updating the parameter configurations through actions that maximize a Q-value, which employs a Deep Reward Network designed to learn global reward values from both visible curve fitting errors and hidden parameter errors. Results: The DQMP method was evaluated by viscoelastic imaging on soft matter by Kelvin-Voigt fractional derivative (KVFD) modeling. In comparison to other methods, imaging of parameters by DQMP yielded the smallest errors (< 2%) to the ground truth images. DQMP was applied to viscoelastic imaging on biological tissues, which indicated a great potential of imaging on physical parameters in diagnostic applications. Conclusions: DQMP method is able to achieve global optima, yielding accurate model parameter estimates in viscoelastic imaging. Assessment of DQMP by simulation imaging and ultrasound breast imaging demonstrated the consistency, reliability of the imaged parameters, and powerful global searching ability of DQMP. Significance: DQMP method is promising for imaging of multiple parameters, and can be generalized to global optimization for many other complex nonconvex functions and imaging of physical parameters.