3-D Visualization in Biomedical Applications

Annual Review of Biomedical Engineering - Tập 1 Số 1 - Trang 377-399 - 1999
Richard A. Robb1
1Mayo Foundation/Clinic, Rochester, Minnesota 55905, USA.

Tóm tắt

▪ Abstract  Visualizable objects in biology and medicine extend across a vast range of scale, from individual molecules and cells through the varieties of tissue and interstitial interfaces to complete organs, organ systems, and body parts. These objects include functional attributes of these systems, such as biophysical, biomechanical, and physiological properties. Visualization in three dimensions of such objects and their functions is now possible with the advent of high-resolution tomographic scanners and imaging systems. Medical applications include accurate anatomy and function mapping, enhanced diagnosis, accurate treatment planning and rehearsal, and education/training. Biologic applications include study and analysis of structure-to-function relationships in individual cells and organelles. The potential for revolutionary innovation in the practice of medicine and in biologic investigations lies in direct, fully immersive, real-time multisensory fusion of real and virtual information data streams into online, real-time visualizations available during actual clinical procedures or biological experiments. Current high-performance computing, advanced image processing, and high-fidelity rendering capabilities have facilitated major progress toward realization of these goals. With these advances in hand, there are several important applications of three-dimensional visualization that will have a significant impact on the practice of medicine and on biological research.

Từ khóa


Tài liệu tham khảo

Ackerman MJ. 1998. The visible human project.Proc. IEEE86(3):504–11

Bates LM, Hanson DP, Kall BA, Meyer FB, Robb RA. 1998. Implementation of an oblique sectioning visualization tool for “line-of-sight” stereotactic neurosurgical navigation using the AVW toolkit. Presented at SPIE Med. Imaging ‘98, San Diego, CA, Feb. 21–26

Blumenfeld SM. 1996. A glimpse at the surgery of the next century. See Ref. 66a, p. 319

Bourland JD, Camp JJ, Robb RA. 1992. Volume rendering: application in static field conformal radiosurgery.Proc. Conf. Visualization Biomed. Comput., 2nd, Chapel Hill, NC,1808:584–87. Bellingham, WA: SPIE

Brinkmann BH, Robb RA, O’Brien TJ, O’Connor MK, Mullan BP. 1998. Multimodality imaging for epilepsy diagnosis and surgical focus localization: three-dimensional image correlation and dual isotope SPECT.Med. Image Computing Computer-Assisted Intervention—MICCAI ’98, Cambridge, MA,1496:1087–98. Berlin: Springer-Verlag

Cabral B, Cam N, Foran J. 1994. Accelerated volume rendering and tomographic reconstruction using texture mapping hardware.Proc. ACM/IEEE Symp. Volume Visualization, Washington, DC,pp. 91–98. Piscataway, NJ: IEEE

Cameron B, Manduca A, Robb RA. 1996. Patient-specific anatomic models: geometric surface generation from three-dimensional medical images using a specified polygonal budget. InHealthcare in the Information Age: Future Tools for Transforming Medicine,ed. S Weghorst, H Sieburg, K Morgan, pp. 447–60. Amsterdam: IOS and Ohmsha

10.1002/sca.4950190402

Chan RC, Johnson SB, Seward JB, Packer DL. 1995. Initial experience with left ventricular endocardial catheter manipulation guided by intracardiac ultrasound visualization: improved accuracy over fluoroscopic imaging.J. Am. Coll. Cardiol.25:A41

Colchester ACF, Zhao J, Holton-Tainter KS, Henri CJ, Maitland N, et al. 1996. Development and preliminary evaluation of VISLAN, a surgical planning and guidance system using intra-operative video imaging.Med. Image Anal.1(1):73–90

Drebin R, Carpenter L, Harrahan P. 1988. Volume rendering.SIGGRAPH ‘88, Atlanta, GA,pp. 665–74. Reading, MA: Addison-Wesley

Fuchs H, Livingston MA, Raskar R, Colucci D, Keller K, et al. 1998. Augmented reality visualization for laparoscopic surgery.Med. Image Computing Computer-Assisted Intervention—MICCAI ’98, Cambridge, MA,1496:934–43. Berlin: Springer-Verlag

1994, Sci. Am., 270, 72

Ge J, Erbel R. 1998. Intravascular ultrasound imaging of ruptured plaques. InIntravascular Ultrasound,ed. R Erbel, J Roelandt, J Ge, et al, pp. 105–13. St. Louis: Mosby

Gibson S, Fyock C, Grimson E, Kanade T, Kikinis R, et al. 1998. Volumetric object modeling for surgical simulation.Med. Image Anal.2(2):121–32

Glenn WV Jr, Johnson RJ, Morton PE, Dwyer SJ III. 1975. Image generation and display techniques for CT scan data: thin transverse and reconstructed coronal and sagittal planes.Invest. Radiol.10:403–16

10.1016/S0165-1838(98)00054-X

Hara AK, Johnson CD, Reed JE, Ahlquist DA, Nelson H, et al. 1996. Detection of colorectal polyps by computed tomographic colography: Feasibility of a novel technique.Gastroenterology110:284–90

10.1117/12.944935

10.1109/TMI.1985.4307690

10.1097/00004728-197701000-00018

Higgins WE, Spyra WJT, Karwoski RA, Ritman EL. 1996. System for analyzing high-resolution three-dimensional coronary angiograms.IEEE Trans. Med. Imaging 15(3):377–85

Hohne KH, Bomans M, Pommert A, Tiede U, Weibeck G. 1990. Rendering tomographic volume data: adequacy of methods for different modalities and organs. In3-D Imaging in Medicine, NATO ASI Ser.ed. KH Hohne, et al, F60:197–215. Berlin: Springer-Verlag

Holmes D III, Robb RA. 1998. Processing, segmentation, and visualization of pre- and post-stent coronary arteries using intra-vascular ultrasound. Presented at SPIE Med. Imaging ’98, San Diego, CA, Feb. 21–26

1992, Proc. Natl. Cancer Inst. Workshop, 27, 326

Kaufman AE, Cohen D, Yagel R. 1993. Volume graphics.IEEE Comput.26(7):51–64

Kay P, Robb RA, Myers RP, King BF. 1996. Creation and validation of patient specific anatomical models for prostate surgery planning using virtual reality.Proc. Conf. Visualization Biomed. Comput., 4th, Hamburg, Ger.1131:547–52. Berlin: Springer-Verlag

Kay PA, Robb RA, Bostwick DG. 1998. Prostate cancer microvessels: a novel method for three-dimensional reconstruction and analysis.Prostate37:270–77

Kikinis R, Gleason PL, Jolesz FA. 1995. Surgical planning using computer-assisted three-dimensional reconstructions. InComputer Integrated Surgery,ed. R Taylor, S Lavalle, G Burdea, R Mosges, pp. 147–54. Cambridge, MA: MIT

10.1093/brain/121.5.875

Levoy M. 1988. Display of surfaces from volume data.IEEE Comput. Graph. Appl.8(5):29–37

Lin W, Robb RA. 1999. Dynamic volume texture mapping and model deformation for visually realistic surgical simulation. InMedicine Meets Virtual Reality,ed. JD Westwood, H Hoffman, R Robb, et al, pp. 198–204. Amsterdam: IOS

Liu AK, Belliveau JW, Dale AM. 1998. Visualizing spatial resolution of linear estimation techniques of electromagnetic brain activity localization.Med. Image Computing Computer-Assisted Intervention—MICCAI ’98, Cambridge, MA,1496:670–78. Berlin: Springer-Verlag

Lorensen FA, Jolesz WE, Kikinis R. 1995. The exploration of cross-sectional data with a virtual endoscope. InInteractive Technology and the New Paradigm for Healthcare,ed. K Morgan, R Satava, K Morgan, H Sieburg, et al, pp. 221–30. Amsterdam: IOS and Ohmsha

Lorensen WE, Cline HE. 1987. Marching cubes: a high-resolution 3-D surface construction algorithm.Comput. Graph.21(3):163–69

Masters BR. 1996. Optical tomography of thein vivohuman lens: three-dimensional visualization of cataracts.J. Biomed. Opt.1(3):289–95

Maurer CR Jr, Hill DLG, Maciunas RJ, Barwise JA, Fitzpatrick JM, Wang MY. 1998. Measurement of intraoperative brain surface deformation under a craniotomy.Med. Image Computing Computer-Assisted Intervention—MICCAI ’98, Cambridge, MA,1496:51–62. Berlin: Springer-Verlag

10.1117/12.208689

Miller SM, Schmalz P, Ermilov L, Tarara J, Ma R, et al. 1992. Three-dimensional structure of neurons from peripheral autonomic ganglia using confocal microscope images.Proc. Conf. Vis. Biomed. Comput., 2nd, Chapel Hill, NC,1808:640–50. Berlin: Springer-Verlag

Mori K, Hasegawa J, Suenaga Y, Toriwaki J, Anno H, Katada K. 1998. Automated labeling of bronchial branches in virtual bronchoscopy system.Med. Image Computing Computed-Assisted Intervention—MICCAI ’98, Cambridge, MA,1496:870–78. Berlin: Springer-Verlag

10.1126/science.7569924

Napel SA. 1995. Basic principles of spiral CT. InPrinciples and Techniques of 3-D Spiral CT Angiography,ed. EK Fishman, RB Jeffrey, pp. 167–82. New York: Raven

Nishimura RA, Edwards WD, Warnes CA, Reeder GS, Holmes DR Jr, et al. 1990. Intravascular ultrasound imaging: in vitro validation and pathologic correlation.J. Am. Coll. Cardiol.16:145–54

Packer DL, Aharon S, Johnson SB, Camp JJ, Robb RA. 1998. Feasibility of virtual anatomy-based three-dimensional mapping in a canine model.J. Am. Coll. Cardiol.31(2):A181–82

Packer DL, Seward JB, Chan RC, Johnson SB. 1995. The utility of a new integrated high resolution intracardiac ultrasound/ablation system in a canine model.J. Am. Coll. Cardiol.25:A353

Peters T, Davey B, Munger P, Comeau R, Evans A, Olivier A. 1996. Three-dimensional multimodal image-guidance for neurosurgery.IEEE Trans. Med. Imaging15(2):121–28

Petroll WM, Jester JV, Cavanagh HD. 1996. Quantitative three-dimensional confocal imaging of the cornea in situ and in vivo: system design and calibration.Scanning18:45–49

Pflesser B, Tiede U, Hohne KH. 1998. Specification, modelling and visualization of arbitrarily shaped cut surfaces in the volume model.Med. Image Computing Computer-Assisted Intervention—MICCAI ’98, Cambridge, MA,1496:853–60. Berlin: Springer-Verlag

Preminger GM, Babayan RK, Merril GL, Raju R, Millman A, Merril JR. 1996. Virtual reality surgical simulation in endoscopic urologic surgery. See Ref. 66a, p. 157

Ramaswamy K, Higgins WE. 1996. Endoscopic exploration and measurement in 3-D radiological images.SPIE Med. Imaging 1996, Newport Beach, CA,2710:511–23. Bellingham, WA: SPIE

10.1097/00004728-198010000-00015

Robb RA. 1983. High-speed three-dimensional x-ray computed tomography: the Dynamic Spatial Reconstructor.Proc. IEEE71:308–19

Robb RA. 1994.Three-Dimensional Biomedical Imaging—Principles and Practice.New York: VCH. 282 pp.

Robb RA. 1994. Visualization methods for analysis of multimodality images. InFunctional Neuroimaging: Technical Foundations,ed. RW Thatcher, M Hallett, T Zeffiro, et al, pp. 181–90. San Diego, CA: Academic

Robb RA. 1996. Virtual reality assisted surgery planning using patient specific anatomic models.IEEE Eng. Med. Biol.15(2):60–69

Robb RA, Barillot C. 1989. Interactive display and analysis of 3-D medical images.IEEE Trans. Med. Imaging8(3):217–26

Robb RA, Hanson DP. 1995. The ANALYZE software system for visualization and analysis in surgery simulation. InComputer Integrated Surgery,ed. S Lavallee, R Taylor, G Burdea, R Mosges, pp. 175–90. Cambridge, MA: MIT

Robb RA, Hanson DP, Camp JJ. 1996. Computer-aided surgery planning and rehearsal at Mayo Clinic.Computer29(1):39–47

Robb RA, Satava RM. 1994. Virtual endoscopy: applications of 3-D visualization to medical diagnosis.Presence6(2):179–97

Rosen J. 1992. From computer-aided design to computer-aided surgery.Proc. Medicine Meets Virtual Reality, San Diego,Off. Contin. Educ., Univ. Calif.

Rubin GD, Beaulieu CF, Argiro V, Ringl H, Norbash AM, et al. 1996. Perspective volume rendering of CT and MR images: applications for endoscopic imaging.Radiology199:321–30

1989, Surg. Endosc., 171, 269

Schmalz PF, Miller SM, Szurszewski JH. 1997. Three-dimensional imaging of neurons in living preparations of peripheral autonomic ganglia.Gastroenterology112(4):A729 (Abstr. 44)

Serra L, Nowinski WL, Poston T, Hern N, Meng LC, et al. 1997. The brain bench: virtual tools for stereotactic frame neurosurgery.Med. Image Anal.1(4):317–29

Sher LD. 1977. Graphics in space: see it now.Proc. Natl. Comput. Graph. Assoc.3:101–60

10.1161/01.CIR.96.6.2016

Sieburg H, Weghorst S, Morgan K, eds. 1996.Health Care in the Information Age.Amsterdam: IOS and Ohmsha

Skrinjar O, Spencer D, Duncan J. 1998. Brain shift modeling for use in neurosurgery.Med. Image Computing Computer-Assisted Intervention—MICCAI ’98, Cambridge, MA,1496:641–49. Berlin: Springer-Verlag

Starney TA, McNeal JE. 1992. Adenocarcinoma of the prostate. InCampbell’s Urology,ed. PC Walsh, AB Retik, TA Starney, ED Vaughan Jr, 2:1159–221. Philadelphia, PA: Saunders. 6th ed.

Stary HC, Chandler AB, Dinsmore RE, Fuster V, Glagov S, et al. 1995. A definition of advanced types of atherosclerotic lesions and a histological classification of atherosclerosis: a report from the Committee on Vascular Lesions of the Council on Arteriosclerosis, American Heart Association.Circulation92(5):1355–74

Suzuki N, Hattori A, Takatsu A, Kumano T, Ikemoto A, et al. 1998. Virtual surgery system using deformable organ models and force feedback system with three fingers.Med. Image Computing Computer-Assisted Intervention—MICCAI ’98, Cambridge, MA,1496:397–403. Berlin: Springer-Verlag

Thompson PM, Toga AW. 1997. Detection, visualization and animation of abnormal anatomic structure with a deformable probabilistic brain atlas based on random vector field transformations.Med. Image Anal.1(4):271–94

Vining DJ, Gelfand DW. 1994. Noninvasive colonoscopy using helical CT scanning, 3-D reconstruction, and virtual reality. InSGR Sci. Prog.p. 70 (Abstr.)

1994, Br. Med. J., 30, 193

10.1117/12.238445

Zeng J, Kaplan C, Bauer J, Sesterhenn I, Moul J, Mun SK. 1998. Visualization and evaluation of prostate needle biopsy.Med. Image Computing Computer-Assisted Intervention—MICCAI ’98, Cambridge, MA,1496:285–92. Berlin: Springer-Verlag