Joint phase reconstruction and magnitude segmentation from velocity-encoded MRI data
Veronica Corona, Martin Benning, Lynn F. Gladden, Andi Reci, Andrew J., Sederman, Carola-Bibiane Schoenlieb

TL;DR
This paper introduces a joint optimization method using non-convex Bregman iteration to simultaneously estimate velocity, magnitude, and segmentation in velocity-encoded MRI, enhancing accuracy over traditional sequential methods.
Contribution
The work presents a novel joint estimation algorithm for velocity, magnitude, and segmentation in velocity-encoded MRI data, improving upon classical approaches.
Findings
Joint model outperforms sequential methods in accuracy
Numerical experiments validate the approach on synthetic and real data
Method effectively estimates dynamic flow components in bubbly flow imaging
Abstract
Velocity-encoded MRI is an imaging technique used in different areas to assess flow motion. Some applications include medical imaging such as cardiovascular blood flow studies, and industrial settings in the areas of rheology, pipe flows, and reactor hydrodynamics, where the goal is to characterise dynamic components of some quantity of interest. The problem of estimating velocities from such measurements is a nonlinear dynamic inverse problem. To retrieve time-dependent velocity information, careful mathematical modelling and appropriate regularisation is required. In this work, we propose an optimisation algorithm based on non-convex Bregman iteration to jointly estimate velocity-, magnitude- and segmentation-information for the application of bubbly flow imaging. Furthermore, we demonstrate through numerical experiments on synthetic and real data that the joint model improves…
| \svhline Sequential | 0.0019 | 0.0028 | 0.0032 | 0.0059 |
| Joint | 0.0011 | 0.0012 | 0.0018 | 0.0051 |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsReservoir Engineering and Simulation Methods · Hydraulic Fracturing and Reservoir Analysis · Drilling and Well Engineering
11institutetext: Veronica Corona, Carola-Bibiane Schönlieb 22institutetext: Department of Applied Mathematics and Theoretical Physics, University of Cambridge, UK, 22email: {vc324, cbs31}@cam.ac.uk 33institutetext: Martin Benning 44institutetext: School of Mathematical Sciences, Queen Mary University of London, UK 44email: [email protected] 55institutetext: Lynn F. Gladden, Andi Reci, Andrew J. Sederman 66institutetext: Department of Chemical Engineering and Biotechnology, University of Cambridge, UK 66email: {lfg1, ar622, ajs40}@cam.ac.uk
Joint phase reconstruction and magnitude segmentation from velocity-encoded MRI data
Veronica Corona
Martin Benning
Lynn F. Gladden
Andi Reci
Andrew J. Sederman
Carola-Bibiane Schönlieb
Abstract
Velocity-encoded MRI is an imaging technique used in different areas to assess flow motion. Some applications include medical imaging such as cardiovascular blood flow studies, and industrial settings in the areas of rheology, pipe flows, and reactor hydrodynamics, where the goal is to characterise dynamic components of some quantity of interest. The problem of estimating velocities from such measurements is a nonlinear dynamic inverse problem. To retrieve time-dependent velocity information, careful mathematical modelling and appropriate regularisation is required. In this work, we propose an optimisation algorithm based on non-convex Bregman iteration to jointly estimate velocity-, magnitude- and segmentation-information for the application of bubbly flow imaging. Furthermore, we demonstrate through numerical experiments on synthetic and real data that the joint model improves velocity, magnitude and segmentation over a classical sequential approach.
1 Introduction
Magnetic resonance imaging (MRI) is an imaging technique that allows to visualise the chemical composition of patients or materials in a non-invasive fashion. Besides resolving in great detail the morphology of the object under consideration, MRI is intrinsically sensitive to motion, flow and diffusion Burt19821044 ; Axel1984 . This means that in a single experiment, MRI can produce both structural and functional information. By designing the acquisition protocol appropriately, MRI can provide flow and motion estimation. This technique is known as MR velocimetry or phase-encoded MR velocity imaging Callaghan ; doi:10.1146/annurev.fluid.31.1.95 ; Elkins2007 ; GLADDEN20132 . In this work, we will focus on the dynamic inverse problem involved in recovering velocities from this kind of data.
In many MRI applications, the goal is not only to extract the structure of the object of interest, but also to estimate some functional features. An example is flow imaging, in which the aim is to reconstruct the velocity of the fluid that is moving in some structure. In order to acquire the velocity information and assess flow motion, phase-encoded MR velocity imaging is widely used in different areas. In medical imaging, this is used for example in cardiovascular blood flow studies to assess the distribution and variation in flow in blood vessels around the heart Gatehouse2005 . Other industrial applications include the study the rheology of complex fluids Callaghan1999 , liquids and gases flowing through packed beds Sederman1998 ; Sankey2009 ; Holland2010 , granular flows Fukushima99 ; Holland2008 and multiphase turbulence Tayler2012 .
MRI scanners use strong magnetic fields and radio waves to excite subatomic particles (like protons) that subsequently emit radio frequency signals which can be measured by the radio frequency coils. Because the local magnetisation of the spins is a vector quantity, it is possible to derive both magnitude and phase images from the signal. Furthermore, for appropriately designed experiments, the velocity information can be estimated from the phase image. The problem of retrieving magnitude and phase (and therefore velocities) from such measurements is non-linear. Many standard approaches reduce this inverse problem to a complex but linear inverse problem, where magnitude and phase are estimated subsequently. With this strategy, however, it is impossible to impose regularity on the velocity information. In this work, we therefore propose a joint framework to simultaneously estimate magnitude and phase from undersampled velocity-encoded MRI. Based on Corona , we additionally introduce a third task, that is the segmentation on the magnitude, to improve the overall reconstruction quality. The main motivation is that by estimating edges simultaneously from the data, both magnitude and segmentation are reconstructed more accurately. By enhancing the magnitude reconstruction, we expect in turn to improve the corresponding phase image and therefore the final velocity estimation.
Contributions
In this work we consider the problem of estimating flow, magnitude and segmentation of regions of interest from undersampled velocity-encoded MRI data. The problem is of great interest in different areas including cardiovascular blood flow analysis in medical imaging and rheology of complex fluids in industrial applications. To this end, we propose a joint variational model for undersampled velocity-encoded MRI. The significance of our approach is that by tackling the phase and magnitude reconstruction jointly, we can exploit their strong correlation and finally impose regularity on the velocity component. This is further assisted by the introduction of a segmentation term as additional prior to enhance edges of the regions of interest. Our main contributions are
- •
A description of the forward and inverse problem of velocity-encoded MRI in the setting of bubbly flow estimation.
- •
A joint variational framework for the approximation of the non-linear inverse problem of velocity estimation. We show that by exploiting the strong correlation in the data, our joint method yields an accurate estimation of the underlying flow, alongside a magnitude reconstruction that preserves and enhances intrinsic structures and edges, due to a joint segmentation approach. Moreover, we achieve an accurate segmentation to discern between different areas of interest, e.g. fluid and air.
- •
An alternating Bregman iteration method for non-convex optimisation problems.
- •
Numerical experiments on synthetic and real data in which we demonstrate the suitability and potential of our approach and provide a comparison with sequential approach.
Organisation of the paper
This paper is organised as follows. In Section 2 we describe the derivation of the inverse problem of velocity-encoded MRI from the acquisition process to the spin proton density estimation. In Section 3 we present our joint variational model to jointly estimate phase and magnitude reconstruction and its segmentation. In Section 4 we propose an optimisation scheme to solve the non-convex and non-linear problem using Bregman iteration. To conclude, in Section 5 we demonstrate the performance of our proposed joint method in comparison with a sequential approach for synthetic and real MRI data.
2 Velocity-encoded MRI
In the following we will briefly describe the mathematics of the acquisition process involved in MRI velocimetry. Subsequently we are going to see that finding the unknown spin proton density basically leads to solving the inverse problem of the Fourier transform.
2.1 From the Bloch equations to the inverse problem
The magnetisation of a so-called spin isochromat can be described by the Bloch equations
[TABLE]
Here is the nuclear magnetisation (of the spin isochromat), is the gyromagnetic ratio, denotes the magnetic field experienced by the nuclei, is the longitudinal and the transverse relaxation time and the magnetisation in thermal equilibrium. If we define and , we can rewrite (13) to
[TABLE]
with denoting the complex conjugate of .
If we assume for instance that is just a constant magnetic field in -direction, (14) reduces to the decoupled equations
[TABLE]
It is easy to see that this system of equations (15) has the unique solution
[TABLE]
for denoting the Lamor frequency, and , being the initial magnetisations at time .
2.2 Signal recovery
The key idea to enable spatially resolved nuclear magnetic resonance spectrometry is to add a magnetic field to the constant magnetic field in -direction that varies spatially over time. Then, (15a) changes to
[TABLE]
if we ensure . If now denotes the spatial location of a considered spin isochromat at time , we can write as , with a function that describes the influence of the magnetic field gradient over time.
If a radio-frequency (RF) pulse that has been used to induce magnetisation in the --plane is subsequently turned off at time and thus, and for , the same coils that have been used to induce the RF pulse can be used to measure the - magnetisation. Using (16a) and assuming for all , this gives rise to the following model-equation:
[TABLE]
In the following we assume that can be approximated reasonably well via its Taylor approximation around , i.e.
[TABLE]
which yields
[TABLE]
It is well-known that appropriate application of gradients (i.e. appropriate design of ) enables the approximation of individual moments of (19). If we further assume that the system to be observed does only contain zero- and first-order moments, we can assume
[TABLE]
where is now short for and is the corresponding velocity information.
In order to turn (18) into a useful mathematical model we need to encode velocity information and remove the temporal dependency of . In order to do so, the gradient coils need to be programmed to first enable the encoding of velocity information via a function that satisfies
[TABLE]
for time and a function . Subsequently, the gradients need to be programmed to encode spatial information by choosing with
[TABLE]
for and a function . Since the RF-coils measure a volume of the whole - net-magnetisation, the acquired signal then equals
[TABLE]
with denoting the spin-proton density at a specific spatial coordinate . Note that for we observe that is just the Fourier transform of the complex signal with magnitude and phase .
2.3 Removal of background magnetic field
Our goal is to recover the velocity information from . Assuming that we do not know , we can alternatively conduct two experiments, where the setup is identical apart from the velocity-encoding gradients having opposite polarities, i.e. we measure
[TABLE]
Hence, if we denote and , we immediately observe
[TABLE]
The inverse problem of (22) is to recover and from and .
2.4 Zero-flow experiment
A zero-flow experiment that allows for the removal of additional artefacts is also conducted. This experiment is to account for imperfections in the measurement system which cause an added signal between the positive and negative experiments even in the absence of flow, and enables a correction that allows direct quantification of flow and tissue motion. We refer to this technique as flow compensation, which consists of acquiring a reference scan, with any flow switched-off, with vanishing zero and first gradient moments, before the actual velocity encoding scan with added bipolar gradients is performed. In this way, we obtain background phase images from the reference scan, and velocity sensitivity with the second flow-sensitive scan. In practice, this means that in addition to (22), the following two measurements are taken:
[TABLE]
so that the actual velocity information can be recovered via
[TABLE]
The inverse problem is to recover and from (22) and (23) via (24). More details on phase-encoded MR velocity imaging can be found in Markl20061VE .
In other words, for a given direction of the velocity to be measured (, or ), the corresponding component velocity map (, or ) is acquired by applying repeatedly a pulse sequence with the velocity-encoding gradient in the respective direction (, or ) and with alternating polarity between consecutive pulse sequences (from to ). The difference between the phase of the MRI image reconstructed from the acquired k-space data of consecutive pulse sequences, and the reference to a zero flow experiment, yields the component velocity map.
2.5 Sampling
The MRI signal is acquired by sampling the continuous signals of , , and at discrete points in time. Hence, for each phase the data acquisition reads as
[TABLE]
for and where denotes the sampling function or distribution. If we for example assume , where denotes the Dirac delta distribution, and that is constant w.r.t. time, then (25) simplifies to
[TABLE]
We want to denote the sub-sampled Fourier transform with , and therefore rewrite (26) to
[TABLE]
where denotes the vector of k-space samples. Sampling strategies are very important to reduce the acquisition times and therefore to be able to image dynamic systems using velocity-encoded MRI through fast imaging techniques. The main idea is to exploit redundancy in some specific domain of the measured data. This approach is strongly related to the theory of compressed sensing (CS) Candes2004 ; Donoho2006 ; Lustig2007 and many image reconstruction techniques have been proposed Holland2010 ; Tayler2012 ; Jung2008 ; Paciok2011 ; Paulsen2010 ; Parasoglou2009 .
Depending on whether is sampled on a uniform or non-uniform grid, can be realised via the Fast Fourier Transform (FFT) fft or via a non-uniform Fourier Transform such as NUFFT NUFFT .
2.6 Dynamic inverse problem
We want to highlight that every and in (27) implicitly depends on an initial time , which becomes evident from the derivation in Section 2.2. Hence, if we take measurements for a sequence with , we are introducing a discrete temporal dimension to our inverse problem that potentially allows us to exploit any temporal correlation between frames and . However, we will only consider the reconstruction of individual frames throughout this work for reasons that we are going to address later.
In the following we will refer to an individual frame of the dynamic inverse problem for velocity-encoded MRI in the discrete setting and under the presence of noise making use of the notation of the discrete Fourier transform operator.
3 Mathematical modelling
In this section we first present the velocity-encoded MRI reconstruction inverse problem in the presence of noise and discuss a sequential variational regularisation scheme to approximate the solution. Secondly, we introduce our joint reconstruction and segmentation approach in a Bregman iteration framework to jointly estimate phase, magnitude and segmentation.
3.1 Indirect phase-encoded MR velocity imaging
The velocity-encoded MRI image reconstruction problem is described as follows. Let be the proton density or magnitude image and correspondent phase image, respectively, in a discretised image domain , with . The vector with are the measured Fourier coefficients obtained from (27). Based on (27) the forward model for noisy data is given by
[TABLE]
where and is Gaussian noise with zero mean and standard deviation . For brevity we will follow the notation . As explained in the previous section, velocity information is encoded in the phase image. However, during the acquisition the phase is perturbed by an error due to field inhomogeneity and chemical shift. To account for this error, usually different measurements corresponding to different polarities of encoding flow gradients are acquired. Then the velocity (in one direction) at one particular time will be estimated as in (24), where is a constant known from the acquisition setting.
Given the presence of noise and partial observation of the data due to undersampling, the problem described in (28) is ill-posed. A simple strategy to obtain an approximated solution is to replace with zero the missing Fourier coefficients and compute the so-called zero-filling solution
[TABLE]
where . However, these reconstructed images will present aliasing artefacts because of the undersampling. A classical approach to solve this problem is to compute approximate solutions of (28) using a variational regularisation approach. We consider a Tikhonov-type regularisation approach that reads
[TABLE]
for being the different measurements, where the first term is the data fidelity that imposes consistency between the reconstruction and the given measurements , the second term is the regularisation, which incorporates some prior knowledge of the solution. The parameter is a regularisation parameter that balances the two terms in the variational scheme. In this setting, the survey proposed in BenningGladdenHollandEtAl2014 describes different choices for the regularisation functional , including wavelets and higher-order total variation (TV) schemes. Subsequently, the phases can be extracted from these complex images as
[TABLE]
More recently, other reconstruction approaches have been proposed to regularise the phase of the image Fessler2004 ; Zibetti2010 ; Zhao2012 ; valkonen2014primal ; Zibetti:2017 . All these methods rely on modelling separately prior knowledge on the magnitude and on phase images and differ on the optimisation schemes involved in the non-convex and non-linear problem. However, while it is possible to exploit information about the velocity from fluid mechanics, it is in general hard to assume specific knowledge on the individual phases. As explained in the previous section and described in (24), velocities are computed as phase differences of different MR measurements and therefore the regularisation needs to be imposed on the phase difference rather than individual phases. In this work, we step away from the approach of only regularising individual phases and propose instead to regularise the velocity as difference of phases. In the following we describe our choice of regularisation and algorithmic framework for velocity-encoded MRI.
3.2 Joint variational model
In many industrial applications, velocity-encoded MRI is used to estimate flow of different chemical species in different physical status, such as gas-liquid systems Gladden2017 . In this case, one aims at recovering a piecewise constant image or an image with sharp edges to facilitate further analysis such as identification of regions of interest. It was proposed in Corona to use a segmentation task as additional regularisation on the reconstruction to impose regularity in terms of sharp edges. It was shown there that this is highly beneficial for very low undersampling rates in MRI. In this work, we expand this idea to the phase-encoded MR velocity imaging data, where the idea is to jointly solve for magnitude, segmentation and phase improving performances on the three tasks.
Following the work in Corona , we are interested in the joint model to recover magnitude and velocity components through the measured phases from undersampled MRI data and to estimate a segmentation on the magnitude images. As described in the previous section, we are dealing with four MRI measurements to obtain one component velocity image. Defining the shorthand notations , and , this joint model reads as
[TABLE]
The first term in (32) describes the reconstruction fidelity term for the magnitudes and phases for the given data . The second term represents the segmentation problem to find partitions of the images in two disjoint regions that have mean intensity values close to the constants and Chant2001 ; Chan2006 . The parameter weighs the effect of the segmentation onto the reconstruction. The underlying idea is to exploit structure and redundancy in the data, estimating edges simultaneously from the data, ultimately improving the reconstruction. By incorporating prior knowledge of the regions of interest we impose additional regularity of the solution.
The joint cost function (32) is non-convex. While sub-problems in and (leaving the other parameters fixed) are convex, the sub-problems in are non-linear and non-convex. In the next section we present a unified framework based on non-convex Bregman iterations to solve the joint model.
4 Optimisation
There are many ways of minimising (32). We want to pursue a strategy that guarantees smooth velocity-components, piecewise-constant segmentations and magnitude images with sharp transitions in an inverse scale-space fashion. In order to achieve those features, we aim to approximate minimisers of (32) via an alternating Bregman proximal method or Bregman iteration of the form
[TABLE]
for , , and . Here , and are proper, lower semi-continuous and convex functions and , and are the corresponding generalised Bregman distances bregman1967relaxation ; kiwiel1997proximal with arguments and corresponding subgradients , and . A generalised Bregman distance is the distance between a function evaluated at argument and its linearisation around argument , i.e.
[TABLE]
for a subgradient . Note that algorithm (33) has update rules for the subgradients, as , and are allowed to be non-smooth, which makes the selection of particular subgradients necessary.
The algorithm is a hybrid of the algorithms proposed in Benning2017 and Corona . For both algorithms global convergence results, motivated by xu2013block ; bolte2014proximal , have been established. Since we deal with imperfect data potentially corrupted by measurement noise and numerical errors, we will, however, use (33) in combination with an early-stopping criterion in order not to converge to a minimiser of (32) but to approximate the solution of (28) via iterative regularisation.
The crucial part for the application of (33) are the choices of the underlying functions , and of the corresponding Bregman distances. We want both the magnitude images and the segmentations to maintain sharp discontinuities and therefore want to penalise their discretised, isotropic, total variation. On the other hand, we want to guarantee smooth components of our velocity field, which is why we penalise them with the two-norm of a discretised gradient. In particular, we choose
[TABLE]
to be the isotropic total variation with weights and , where denotes a forward finite-difference approximation of the gradient, the Euclidean vector norm and the pixel-wise one-norm. Further, we choose in a way that allows to enable an -norm-type smoothing on the difference of the phases, i.e.
[TABLE]
where denotes another weight. Note that all convex sub-optimisation-problems in (33) are solved numerically with a primal-dual hybrid gradient (PDHG) method zhu2008efficient ; pock2009algorithm ; esser2010general ; chambolle2011first . Once we have approximated the magnitudes, labels and phases with this iterative regularisation strategy, we can compute the velocity components via (24).
5 Numerical results
In this section we present numerical results of our method for the specific application of bubble burst hydrodynamics using MR velocimetry. The hydrodynamics of bursting bubbles is important in many different areas such as geophysical processes and bioreactor design. We refer to Reci for an overview on the field and the description of results on the first experimental measurement of the liquid velocity field map during the burst of a bubble at the liquid surface interface.
5.1 Case-study on simulated dataset
To quantitatively evaluate our method, we consider the simulated k-space data of a rising spherical bubble in an infinite fluid during Stoke’s flow regime. The simulated data consists of 32 time frames, but for the sake of compactness we will show some visual outputs for one time step .
We assess the performance of our approach for velocity and magnitude estimation by comparing our solutions with respect to the groundtruth and using the mean squared error (MSE) defined as , where is the number of pixels in the image.
We also present a comparison with a sequential approach, where the magnitude is obtained with a classic CS TV-regularised approach and the phase is subsequently estimated using the method proposed in Benning2017 and presented in Reci for the evaluation of bubbly flow estimation.
In Fig. 1 we can see the results for the sequential approach compared to the joint approach when sampling only 11% of the k-space data. Although visually there is not significant change, the MSE shows a big improvement for the joint approach. This confirms that using our joint model is relevant for the problem of velocity-encoded MRI. For the 32 frames, we report the average MSE for magnitude and phase in Table 5.1 where can see a drastic improvement compared to the sequential approach.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] C.T. Burt. NMR measurements and flow. Journal of Nuclear Medicine , 23(11):1044–1045, 1982. cited By 6.
- 2[2] L Axel. Blood flow effects in magnetic resonance imaging. American Journal of Roentgenology , 143(6):1157–1166, dec 1984.
- 3[3] P. T. Callaghan. Translational Dynamics and Magnetic Resonance . Oxford University Press, 2011.
- 4[4] Eiichi Fukushima. Nuclear magnetic resonance as a tool to study flow. Annual Review of Fluid Mechanics , 31(1):95–123, 1999.
- 5[5] Christopher J. Elkins and Marcus T. Alley. Magnetic resonance velocimetry: applications of magnetic resonance imaging in the measurement of fluid motion. Experiments in Fluids , 43(6):823–858, Dec 2007.
- 6[6] Lynn F. Gladden and Andrew J. Sederman. Recent advances in flow MRI. Journal of Magnetic Resonance , 229:2 – 11, 2013. Frontiers of In Vivo and Materials MRI Research.
- 7[7] Peter D. Gatehouse, Jennifer Keegan, Lindsey A. Crowe, Sharmeen Masood, Raad H. Mohiaddin, Karl-Friedrich Kreitner, and David N. Firmin. Applications of phase-contrast flow and velocity imaging in cardiovascular mri. European Radiology , 15(10):2172–2184, Oct 2005.
- 8[8] Paul T Callaghan. Rheo-NMR: nuclear magnetic resonance and the rheology of complex fluids. Reports on Progress in Physics , 62(4):599, 1999.
