A 3D Image Segmentation Study of U-Net on CT Images of the Human Aorta with Morphologically Diverse Anatomy

For the machine learning -assisted diagnosis of cardiac diseases, such as thoracic aortic aneurysm, the geometries of the heart and blood vessels need to be reconstructed from medical images, which is usually done by image segmentation followed by meshing. In this study, we applied U-Net (2D and 3D versions), a deep neural network with a U-shaped architecture, to segment human aorta from CT images. From our experiments, we have the following observations: (1) 2D U-Net, which segments each of the 2D slices of a 3D CT image independently, produced erroneous fragments (e.g., missing part of the aorta) and boundaries (i.e., aortic walls) in 3D; (2) 3D U-Net, which does segmentation in 3D regions of a 3D CT image, performed much better than 2D U-Net. We also observe the major weakness of the 3D U-Net: the reconstructed geometries of the aortic wall had large errors (measured by HD95) for some cases. The 3D U-Net in this study serves as a baseline for developing more advanced architectures of deep neural networks for more accurate geometry reconstruction of human aorta.