Abstract Search

ISEF | Projects Database | Finalist Abstract

Back to Search Results | Print PDF

Integration of Deep Learning Into Automatic Volumetric Cardiovascular Dissection and Reconstruction in Simulated 3D Space for Medical Practice

Booth Id:

Systems Software


Finalist Names:
Nguyen, Le Quoc Bao (School: Le Hong Phong High School for the Gifted)
Le, Tuan Hy (School: Le Hong Phong High School for the Gifted)

Accurate and efficient analysis of cardiac images is essential for diagnosing and treating cardiovascular disease, a major cause of mortality globally, including Vietnam. However, this task is time-consuming, labor-intensive, and prone to errors. The 2D data complicates analysis due to the anatomical complexity and diverse cardiovascular pathologies. To address these challenges, we developed a comprehensive software solution tailored to cardiac data of patients. We assembled an intricate Vietnamese Heart Segmentation and Cardiovascular Disease Dataset (VHSCDD) from local hospitals, ensuring practical application. Our research explored advanced neural network architectures, including CNN-based and Transformer-based models, with different novel attention mechanisms and loss functions. Specifically, by redesigning the feature extraction layers, attention mechanism, and upsampling method out of TransUNet, we introduced RotCAtt-TransUNet++, which outperforms current state-of-the-art models for cardiac segmentation. Furthermore, we optimized the Marching Cubes algorithm for rapid, detailed 3D reconstruction of cardiac structures. To enhance diagnostic capabilities, we developed innovative algorithms integrating multivariable calculus and 3D Fenwick trees for quantitative post-reconstruction analysis. Furthermore, our software features a virtual reality simulation enabling experts to multidimensionally interact with 3D cardiac models, perform measurements, and simulate surgical scenarios. This comprehensive system automates segmentation and disease prediction while facilitating data storage on cloud databases. Expert evaluations confirm that our software significantly improves cardiac defect observation, making it highly applicable in medical practice and anatomy education.