- Open Access
- Open Peer Review
Virtual reality 3D echocardiography in the assessment of tricuspid valve function after surgical closure of ventricular septal defect
Cardiovascular Ultrasoundvolume 5, Article number: 8 (2007)
This study was done to investigate the potential additional role of virtual reality, using three-dimensional (3D) echocardiographic holograms, in the postoperative assessment of tricuspid valve function after surgical closure of ventricular septal defect (VSD).
12 data sets from intraoperative epicardial echocardiographic studies in 5 operations (patient age at operation 3 weeks to 4 years and bodyweight at operation 3.8 to 17.2 kg) after surgical closure of VSD were included in the study. The data sets were analysed as two-dimensional (2D) images on the screen of the ultrasound system as well as holograms in an I-space virtual reality (VR) system. The 2D images were assessed for tricuspid valve function. In the I-Space, a 6 degrees-of-freedom controller was used to create the necessary projectory positions and cutting planes in the hologram. The holograms were used for additional assessment of tricuspid valve leaflet mobility.
All data sets could be used for 2D as well as holographic analysis. In all data sets the area of interest could be identified. The 2D analysis showed no tricuspid valve stenosis or regurgitation. Leaflet mobility was considered normal. In the virtual reality of the I-Space, all data sets allowed to assess the tricuspid leaflet level in a single holographic representation. In 3 holograms the septal leaflet showed restricted mobility that was not appreciated in the 2D echocardiogram. In 4 data sets the posterior leaflet and the tricuspid papillary apparatus were not completely included.
This report shows that dynamic holographic imaging of intraoperative postoperative echocardiographic data regarding tricuspid valve function after VSD closure is feasible. Holographic analysis allows for additional tricuspid valve leaflet mobility analysis. The large size of the probe, in relation to small size of the patient, may preclude a complete data set. At the moment the requirement of an I-Space VR system limits the applicability in virtual reality 3D echocardiography in clinical practice.
As recently described the mental conceptualization and evaluation of the intracardiac anatomy from multiple two-dimensional (2D) echocardiographic images, is complicated by cardiac dynamics [1–4]. Three-dimensional (3D) echocardiography facilitates simplification of this process by offering a direct representation of the cardiac anatomy throughout the cardiac cycle . To appreciate the full 3D potential of these datasets, virtual reality technology can be applied and used for further interpretation of the data of cardiac echocardiography [4–9]. In this regard we applied holographic analysis of intraoperative epicardial echocardiography in order to further contribute to the discussion of tricuspid valve function after surgical closure of ventricular septal defect (VSD) [10–13].
Patients and data sets
12 data sets from intraoperative epicardial echocardiographic studies in 5 operations (patient age at operation 3, 6, 7 weeks, 9 months and 4 years and bodyweight at operation 3.8, 3.9, 4.5, 5.2 and 17.2 kg.) were included in the study. Epicardial echo was indicated in these patients on clinical grounds to obtain additional 2D imaging on top of the pre-operative echo assessment. During the epicardial echocardiography, the 3D data sets were obtained as well.
All operations concerned closure of VSD, in 1/5 as isolated defect, in 3/5 in the setting of correction of tetralogy of Fallot, in 1/5 in combination with a double-chambered right ventricle. In none of the operations the technique of temporary tricuspid detachment was used. In 3 of the operations sutures of the VSD patch were anchored in the base of the tricuspid valve annulus. The postcorrection epicardial echocardiography was performed as previously described .
Three-dimensional echocardiographic data acquisition
In the setting described previously  the data sets were acquired with the iE33 ultrasound system equipped with 3D data acquisition software (Philips Medical Systems, Andover, MA, USA), using an X3-1 broadband matrix array transducer (Philips Medical Systems, Andover, MA, USA) that was used epicardially after the surgical correction. Epicardial echocardiography took 4–5 minutes in each patient and included 2D echo analysis and acquisition of the 3D data sets. The echocardiographic study, including real-time 3D acquisition, was done with ECG gating.
Data processing consisted of the creation of a Cartesian volume in DICOM 3.0 format by interpolating the original data using the export module of the Q-lab ultrasound data analysis application (Philips Medical Systems, Andover, MA, USA), using the highest quality settings.
The 3D image data were transferred to an SGI Prism computer (Silicon Graphics, Mountain View, CA, USA) driving the I-space virtual reality (VR) system. A simple format conversion was required to be able to load the data in the I-Space software. In total the processing and the conversion only took 1–2 minutes per dataset. Holographic analysis took 15–18 minutes for a single data set
Visualisation in the virtual reality environment
The BARCO I-space (Barco, Kortrijk, Belgium) installed at the Erasmus MC (Erasmus MC, Rotterdam, The Netherlands) is a so-called four-walled CAVE™-like VR system . In the I-Space researchers are surrounded by computer-generated stereo images, which are projected by 4 high quality DLP-projectors on three walls and the floor of the projection room [see Additional file 1]. The CAVORE volume rendering application  is used to investigate 3D ultrasound images during the cardiac cycle . In the I-Space, this results in an animated hologram of the dataset being visualised, floating in space in front of the viewers. The viewers wear a pair of lightweight glasses with polarising lenses that allows seeing the hologram with depth [see Additional files 1]. A wireless 6 degrees-of-freedom (DOF) controller which emits a virtual pointer is used for manipulation of and interaction with this hologram. A cutting plane attached to the pointer allows assessment of the interior of the heart. A transfer function widget operated by the pointer controls the contrast and transparency of the rendered image. The cardiothoracic surgeon performed the virtual reality 3D echo analysis.
In the 2D representation of the datasets the area of interest could adequately be visualized in all of the 12 data sets. The data sets were used intraoperatively for clinical assessment of the result of the operation. In none of the data sets 2D analysis showed tricuspid stenosis or regurgitation. Mobility of the anterior and septal tricuspid valve leaflets was considered to be normal in all data sets. In 4 data sets, the posterior leaflet was not included, because of the limitations of epicardial access of a large probe in a small patient. In the other 8 data sets no abnormalities of posterior leaflet motion were noted.
All the 3D datasets could be adequately analyzed in the I-Space. Virtual reality of the datasets allowed a complete assessment of the area of interest and easy investigation of the area of the reconstruction. The holograms of the area of closure of the VSD were adequately visualised from the right side of the ventricular septum.
Assessment of the tricuspid valve leaflet motion could well be accomplished from a right atrial view. In 3 data sets (in 3 different patients) a restriction of the mobility of the septal leaflet was noted, that was not appreciated in the 2D analyses. In all these 3 patients the VSD patch was anchored in the base of the septal leaflet of the tricuspid valve. No abnormalities in anterior leaflet motion were noted. In the limited nearfield of the epicardial echocardiography only 8 posterior leaflets could be assessed, their mobility was considered normal. The holograms confirmed that the papillary apparatus in these 4 data sets was incompletely acquired.
A virtual reality approach is presented to analyse the results of surgery for congenital VSD. The 3D echocardiographic data sets acquired epicardially and generated by a commercially available echo system were used to construct a dynamic hologram inside an I-Space. All the datasets could be adequately analyzed in the I-Space, in which a single 3D dataset is sufficient to create every view of interest.
Currently, large-scale VR facilities like the I-Space are only available in a limited number of research centres throughout the world. Desktop applications are being developed, for instance the Personal Space Station PSS™ (Personal Space Technologies, Amsterdam, The Netherlands). Therefore, the representation and analysis of diagnostic 3D echocardiography by virtual reality has only been described very recently . As a new application, this experience is extended to postoperative control of the results of surgery for congenital VSD, in datasets derived epicardially. This is a relevant topic because in closure of a VSD, the sutures of the patch are often anchored in the base of the septal and anterior tricuspid valve leaflet and sometimes the tricuspid valve may be temporarily detached in the area of the septal and anterior leaflets in order to optimise the surgical approach [10–12]. Until now, tricuspid valve function was shown not to be affected by these techniques [10, 11]. Recently, temporary tricuspid detachment was even advocated to avoid early postoperative tricuspid valve function due to inadvertent traction . As a consequence tricuspid valve function and growth are matters of interest in this regard.
However, because the area of interest is in the nearfield of the echoprobe, a complete data set may be precluded, especially because of the large size of the probe that was available at the time of the study in relation to the small size of the patients and the limited exposure of the heart in them. Although no tricuspid valve stenosis or regurgitation was found in our series by 2D analysis of the data sets, in 3 of them a restricted mobility of the septal leaflet was found by holographic analysis. This suggests that holographic analysis may provide additional data beyond conventional analysis. In general, differences in interpretation between 2D and 3D echo can well be explained . In 2D echocardiography, tricuspid valve analysis only allows analysis of two leaflets per image plane. Usually these are the anterior and septal leaflets, or the anterior and posterior leaflets. Hardly ever the posterior and septal leaflets can be visualized in one image plane and never all three leaflets. In contrast, 3D echocardiography allows all three leaflets to be seen in one view.
The virtual reality analysis can be done by the anatomy-expert, for instance the cardiothoracic surgeon performing the operation, and depends to a lesser extent on the echocardiography-expert, for instance the cardiologist making the diagnosis.
Virtual reality in this regard provides an additional resource for postoperative quality control as well as for education with regard to the intracardiac repair of congenital VSD.
With the I-Space technology the complex postoperative cardiac anatomy of the closed congenital VSD, in relation to tricuspid valve function, can be appropriately visualised in virtual reality. Unfortunately, at present the colour-Doppler data cannot yet be transferred to the I-Space, as the data is only available in a proprietary format.
For the clinical practice, virtual reality 3D echocardiography should be implemented on smaller systems, like desktop displays or single screen projection systems, to allow bedside use or application in the operating theatre or conference room.
In conclusion, epicardially derived data sets may be incomplete for nearfield structures, especially when probe size mismatches with patient size. Still, the resulting 3D data sets nicely provide holographic data, which may provide additional information on tricuspid valve function after VSD closure
Bruining N, Roelandt JR, Grunst G, Berlage T, Waldinger J, Mumm B: Three-Dimensional Echocardiography: The Gateway to Virtual Reality!. Echocardiography. 1999, 16 (5): 417-423.
Bruining N, Lancee C, Roelandt JR, Bom N: Three-dimensional echocardiography paves the way toward virtual reality. Ultrasound Med Biol. 2000, 26 (7): 1065-1074.
Agati L: Three-dimensional echocardiography: the virtual reality in cardiology--luxury or useful technique?. Eur Heart J. 1996, 17 (4): 487-489.
van den Bosch AE, Koning AH, Meijboom FJ, McGhie JS, Simoons ML, van der Spek PJ, Bogers AJ: Dynamic 3D echocardiography in virtual reality. Cardiovasc Ultrasound. 2005, 3 (1): 37-
Gallagher AG, Cates CU: Virtual reality training for the operating room and cardiac catheterisation laboratory. Lancet. 2004, 364 (9444): 1538-1540.
Salustri A, Roelandt JR: Three-dimensional echocardiography: where we are, where we are going. Ital Heart J. 2000, 1 (1): 26-32.
Yambe T, Yoshizawa M, Tabayashi K, Takeda H, Nitta S: Virtual percutaneous transluminal coronary angioplasty system for an educational support system. Artif Organs. 1998, 22 (8): 710-713.
Klein LW: Computerized patient simulation to train the next generation of interventional cardiologists: can virtual reality take the place of real life?. Catheter Cardiovasc Interv. 2000, 51 (4): 528-
Issenberg SB, Gordon MS, Gordon DL, Safford RE, Hart IR: Simulation and new learning technologies. Med Teach. 2001, 23 (1): 16-23.
Bol-Raap G, Bogers AJ, Boersma H, De Jong PL, Hess J, Bos E: Temporary tricuspid valve detachment in closure of congenital ventricular septal defect. Eur J Cardiothorac Surg. 1994, 8 (3): 145-148.
Bol-Raap G, Weerheim J, Kappetein AP, Witsenburg M, Bogers AJ: Follow-up after surgical closure of congenital ventricular septal defect. Eur J Cardiothorac Surg. 2003, 24 (4): 511-515.
Sasson L, Katz MG, Ezri T, Tamir A, Herman A, Bove EL, Schachner A: Indications for tricuspid valve detachment in closure of ventricular septal defect in children. Ann Thorac Surg. 2006, 82 (3): 958-63; discussion 963.
Sondheimer HM, Rahimi-Alangi K: Current management of ventricular septal defect. Cardiology in the Young. 2006, 16 (Supplement S3): 131-135.
van Herwerden LA, Gussenhoven EJ, Roelandt JR, Haalebos MM, Mochtar B, Ligtvoet KM, Bos E: Intraoperative two-dimensional echocardiography in complicated infective endocarditis of the aortic valve. J Thorac Cardiovasc Surg. 1987, 93 (4): 587-591.
Cruz-Neira C, Sandin DJ, Defanti T: Surround-screen projection-based virtual reality: the design and implementation of the CAVE . Proceedings of the 20th annual conference on Computer graphics and interactive techniques. 1993, 135-142. New York , ACM Press
Koning AHJ: Applications of volume rendering in the CAVE. Simulation and Visualization on the Grid. Edited by: Engquist B, Johnsson L, Hammill M, Short F. 1999, 112-121. Berlin , Springer Verlag
Dall'Agata A, Cromme-Dijkhuis AH, Meijboom FJ, McGhie JS, Bol-Raap G, Nosir YF, Roelandt JR, Bogers AJ: Three-dimensional echocardiography enhances the assessment of ventricular septal defect. Am J Cardiol. 1999, 83 (11): 1576-9, A8.
We greatly acknowledge Gerard van Burken en Hans Bosch of the Thoraxcenter Department of Biomedical Engineering for the data conversion with the Q-Lab system.
The author(s) declare that they have no competing interests.
GBR conceived the study, participated in analysis of the data and drafted the manuscript. AHJK imported the 3D datasets into the virtual reality system, participated analysis of the data and contributed to the drafting of the manuscript. TS participated in acquisition and analysis of the data and participated in revising the manuscript. DJH, FJM, APK and PJS revised the manuscript with important intellectual content. AJJCB conceived the study, participated in analysis of the data, revised the manuscript with important intellectual content and gave final approval of the version to be published. All authors read and approved the final manuscript.