Mixed reality interactive visualization of cardiovascular anatomy in interventional lab – clinical implementation in transvascular patent ductus arteriosus closure. (25th November 2020)

• Record Type: Journal Article
• Authors: Kasprzak, J.D; Kierepka, M; Zlahoda-Huzior, A; Stanuch, M; Zolna, D; Serafin, J; Kasprzak, J.I; Witowski, J; Lipiec, P; Wdowiak-Okrojek, K; Peruga, J.Z
• Is Part Of: European heart journal. Volume 41:(2020)Supplement 2
• Publication Date: 2020-11-25
• Subjects: Image Processing and Imaging Standards; Cardiology -- Periodicals; Heart -- Diseases -- Periodicals; 616.12005
• DOI: 10.1093/ehjci/ehaa946.3437
• Languages: English
• ISSNs: 0195-668X

Abstract

Abstract: Aim: Three-dimensional (3D) noninvasively acquired datasets containing anatomical information about the heart are a modern option for procedural support during percutaneous cardiac interventions. We present initial experience of patent ductus arteriosus (PDA) closure with workflow integrated with innovative mixed reality display (MRD) to improve 3D perception and navigation in 3D computed tomography angiographic (CTA) datasets. Methods: We report incorporation of intraprocedural mixed-reality display of segmented CTA (computed tomography angiography) data using a voice- and gesture controlled head-mounted display during routine percutaneous occlusions of PDA in adults. A dedicated software pathway was used for files conversion, real-time Wi-Fi streaming of 3D rendering from PC to device and manipulation of spatial data during the procedures. Results: Pre-recorded CTA studies of aorta and ductus were manually segmented and uploaded into custom designed 3D DICOM for realtime export to MRD device. 3D holograms were successfully displayed during the procedure by commercially available head-mounted display allowing touchless control and image sharing within cath-lab. Wiring of PDA aortic orifice was assisted by 3D hologram controlled by the imaging specialist and shared by the operator. Thus, MRD using evolving versions of custom software was successfully executed with segmented data presented as a semitransparent cubic hologram positioned in a convenient part of visual field allowing real-world action and with touchless control by medical team. Operator appreciated the use of MRD hologram realistically visualizing spatial relationships as practical aid to establish anatomical relationships and facilitate entry into ductus orifice. Procedures were successfully completed using arteriovenous guidewire loop to implant vascular occluders. Conclusions: We demonstrate the methodology and software evolution (segmentation, data fusion) allowing practical implementation of intraprocedural mixed reality display of 3D CTA data, with sterile, touchless control of holographic image shared by interventional and imaging team to support percutaneous PDA closure. Funding Acknowledgement: Type of funding source: Private company. Main funding source(s): MEDAPP