Three- dimensional self super- resolution for pelvic floor MRI using a convolutional neural network with multi- orientation data training
Feng, Fei; Ashton-Miller, James A.; DeLancey, John O.L.; Luo, Jiajia
2022-02
Citation
Feng, Fei; Ashton-Miller, James A. ; DeLancey, John O.L.; Luo, Jiajia (2022). "Three- dimensional self super- resolution for pelvic floor MRI using a convolutional neural network with multi- orientation data training." Medical Physics 49(2): 1083-1096.
Abstract
PurposeHigh- resolution pelvic magnetic resonance (MR) imaging is important for the high- resolution and high- precision evaluation of pelvic floor disorders (PFDs), but the data acquisition time is long. Because high- resolution three- dimensional (3D) MR data of the pelvic floor are difficult to obtain, MR images are usually obtained in three orthogonal planes: axial, sagittal, and coronal. The in- plane resolution of the MR data in each plane is high, but the through- plane resolution is low. Thus, we aimed to achieve 3D super- resolution using a convolutional neural network (CNN) approach to capture the intrinsic similarity of low- resolution 3D MR data from three orientations.MethodsWe used a two- dimensional (2D) super- resolution CNN model to solve the 3D super- resolution problem. The residual- in- residual dense block network (RRDBNet) was used as our CNN backbone. For a given set of low through- plane resolution pelvic floor MR data in the axial or coronal or sagittal scan plane, we applied the RRDBNet sequentially to perform super- resolution on its two projected low- resolution views. Three datasets were used in the experiments, including two private datasets and one public dataset. In the first dataset (dataset 1), MR data acquired from 34 subjects in three planes were used to train our super- resolution model, and low- resolution MR data from nine subjects were used for testing. The second dataset (dataset 2) included a sequence of relatively high- resolution MR data acquired in the coronal plane. The public MR dataset (dataset 3) was used to demonstrate the generalization ability of our model. To show the effectiveness of RRDBNet, we used datasets 1 and 2 to compare RRDBNet with interpolation and enhanced deep super- resolution (EDSR) methods in terms of peak signal- to- noise ratio (PSNR) and structural similarity (SSIM) index. As 3D MR data from one view have two projected low- resolution views, different super- resolution orders were compared in terms of PSNR and SSIM. Finally, to demonstrate the impact of super- resolution on the image analysis task, we used datasets 2 and 3 to compare the performance of our method with interpolation on the 3D geometric model reconstruction of the urinary bladder.ResultsA CNN- based method was used to learn the intrinsic similarity among MR acquisitions from different scan planes. Through- plane super- resolution for pelvic MR images was achieved without using high- resolution 3D data, which is useful for the analysis of PFDs.Publisher
Wiley Periodicals, Inc. Springer International Publishing
ISSN
0094-2405 2473-4209
Other DOIs
Types
Article
Metadata
Show full item recordCollections
Remediation of Harmful Language
The University of Michigan Library aims to describe library materials in a way that respects the people and communities who create, use, and are represented in our collections. Report harmful or offensive language in catalog records, finding aids, or elsewhere in our collections anonymously through our metadata feedback form. More information at Remediation of Harmful Language.
Accessibility
If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.