Skip to Main Content
 

Global Search Box

 
 
 
 

Files

File List


Subhadra Tummalapally.pdf (1.31 MB)

ETD Abstract Container

Abstract Header

Augment the Multi-Modal Interaction Capabilities of HoloLens Through Networked Sensory Devices

Tummalapally, Subhadra
http://rave.ohiolink.edu/etdc/view?acc_num=wright154756489614826

Abstract Details

2018, Master of Science (MS), Wright State University, Computer Science.
Augmented Reality (AR) places virtual contents along with real objects to enhance user perception in the physical environment. It is a technology that has shown great potential in many industries such as medicine, education and transportation. AR devices, such as Microsoft HoloLens, come with multi-modal interaction capabilities, such as voice, gesture and gaze, to support intuitive and reliable human-computer interactions. However, HoloLens gesture support is limited to simple gestures like tap, bloom and hold, it stops short to support meaningful interaction through full hand gesture and motion tracking, which may be critical in field operations of various industry practices in noisy environments, such as maintenance, repair, surgical operation and training. This thesis research intends to augment the HoloLens with fully-fledged hand gesture and motion tracking capabilities by interconnecting it with a Leap motion controller through the Internet, resulting in a functional prototype AR device capable of hand gesture/motion controlled operation. This prototype also enables the use of AR as a training device for skills that require hand operations, such as in surgery, repair, maintenance and etc. In this thesis, we present our system design and prototype implementation and testing, and also present a use case to illustrate its usage and value in real world working environments.
Yong Pei, Ph.D. (Advisor)
Mateen Rizki, Ph.D. (Advisor)
Paul Bender, Ph.D. (Committee Member)
42 p.
Computer Science
Augmented Reality; HoloLens; Leap Motion Controller; Gestures; Integration; Real-time applications

Recommended Citations

Citations

  • Tummalapally, S. (2018). Augment the Multi-Modal Interaction Capabilities of HoloLens Through Networked Sensory Devices [Master's thesis, Wright State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=wright154756489614826

    APA Style (7th edition)

  • Tummalapally, Subhadra. Augment the Multi-Modal Interaction Capabilities of HoloLens Through Networked Sensory Devices. 2018. Wright State University, Master's thesis. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=wright154756489614826.

    MLA Style (8th edition)

  • Tummalapally, Subhadra. "Augment the Multi-Modal Interaction Capabilities of HoloLens Through Networked Sensory Devices." Master's thesis, Wright State University, 2018. http://rave.ohiolink.edu/etdc/view?acc_num=wright154756489614826

    Chicago Manual of Style (17th edition)

wright154756489614826
465
© 2018, some rights reserved.Creative Commons License Augment the Multi-Modal Interaction Capabilities of HoloLens Through Networked Sensory Devices by Subhadra Tummalapally is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License. Based on a work at etd.ohiolink.edu.
This open access ETD is published by Wright State University and OhioLINK.