Skip to Main Content
 

Global Search Box

 
 
 
 

Files

File List


Dissertation_Final_Mela_Christopher.pdf (6.1 MB)

ETD Abstract Container

Abstract Header

MULTIMODAL IMAGING, COMPUTER VISION, AND AUGMENTED REALITY FOR MEDICAL GUIDANCE

Mela, Christopher Andrew
http://rave.ohiolink.edu/etdc/view?acc_num=akron1542642892866467

Abstract Details

2018, Doctor of Philosophy, University of Akron, Biomedical Engineering.
Surgery is one of the primary treatment options for many types of diseases. Traditional methods of surgical planning and intraoperative lesion identification rely on sight as well as physical palpitation of the suspect region. Since these methods are of low specificity, doctors have begun relying upon medical imaging technologies to make diagnoses and to help plan and guide surgical procedures. Preoperative imaging technologies such as Magnetic Resonance Imaging (MRI) and X-ray Computed Tomography (CT) do well to aid in diagnostics and operative planning. However, compact technologies with high specificity and resolution that are convenient for intraoperative use are needed to aid in surgical guidance. Methods including fluorescence imaging, intraoperative microscopy and ultrasound have gained significant recent attention towards these ends. Discussed in this dissertation is the initial design, construction, programming, testing and expanding of a platform technology integrating multimodal medical imaging, computer vision and augmented reality. The platform combines a real-time, head-mounted stereoscopic fluorescence imaging system in-line with a near-eye display. The compact and light-weight assembly provides the user with a wide field-of-view, line-of-sight imaging system that simulates natural binocular vision. Additionally, an ultrasound imaging module is connected and incorporated into the display, along with a portable fiber microscopy system. Lastly, pre-operative MRI/CT imaging models are incorporated into the system for intraoperative registration and display onto the surgical scene. Novel software algorithms were developed to enhance system operations. Fluorescence detection while using a wearable imaging platform was improved through the incorporation of an optical point tracking regime with pulsatile illumination. Optical fiducial marker identification was added to aid in ultrasound and tomographic image registration. Additionally, stereoscopic depth-of-field measurements were used towards the implementation of a fluorescence-to-color video rate co-registration scheme. System testing was conducted on multiple fronts. Fluorescence imaging sensitivity was evaluated to determine minimum detectable concentrations of fluorescent dye. Surgical and medical diagnostic simulations were also conducted using optical tissue phantoms to evaluate device performance in relation to traditional methods, and to identify areas of improvement. System resolution was also analyzed both in planar spatial coordinates as well as depth-of-field measurements. The performance of various augmented reality displays was tested with respect to fidelity of fluorescence identification and resolution. Lastly, the system was tested for registration accuracy. In summary, we have developed a platform integrating intraoperative multimodal imaging, computer vision, and augmented reality, for guiding surgeries and other medical applications.
Yang Liu (Advisor)
Rebecca Willits (Committee Member)
Brian Davis (Committee Member)
Ajay Mahajan (Committee Member)
Yi Pang (Committee Member)
Jiahua Zhu (Committee Member)
240 p.
Biomedical Engineering; Electrical Engineering
Medical Imaging; Intraoperative Imaging; Fluorescence; Ultrasound; Multimodal Imaging; Augmented Reality; Computer Vision

Recommended Citations

Citations

  • Mela, C. A. (2018). MULTIMODAL IMAGING, COMPUTER VISION, AND AUGMENTED REALITY FOR MEDICAL GUIDANCE [Doctoral dissertation, University of Akron]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=akron1542642892866467

    APA Style (7th edition)

  • Mela, Christopher. MULTIMODAL IMAGING, COMPUTER VISION, AND AUGMENTED REALITY FOR MEDICAL GUIDANCE. 2018. University of Akron, Doctoral dissertation. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=akron1542642892866467.

    MLA Style (8th edition)

  • Mela, Christopher. "MULTIMODAL IMAGING, COMPUTER VISION, AND AUGMENTED REALITY FOR MEDICAL GUIDANCE." Doctoral dissertation, University of Akron, 2018. http://rave.ohiolink.edu/etdc/view?acc_num=akron1542642892866467

    Chicago Manual of Style (17th edition)

akron1542642892866467
664
© 2018, all rights reserved.
This open access ETD is published by University of Akron and OhioLINK.