At this point, VR, AR and MR technologies are thriving in different industries and business. They are increasing substantial productivity for large enterprises like Boeing and Ford at this point. Therefore, it’s well recognised that in future, VR, AR and MR will dive deeper into people's life, especially in to-business area. With VR, AR and MR being applied deeperly, more use cases and scenarios will show up. However, from interaction design and user experience perspective, current interactions for VR, AR and MR is still very primitive and not user-centered enough along with several major problems. Problems include limited accessibility, being harmful to muscles, violations to social norms, lack of measurable precsions and so on. This might keep VR/MR from further influencing the industries and the world. This project aims to offer an emerging gesture interaction system in VR that can help users manipulate virtual objects more confidently, more efficiently and more fluently with natural gestures and hand-tracking ability. More importantly, this project serves as an interaction template for different industries, that different industries can create their own interaction systems in terms of vertical needs based off this project. Final design aims to help define the next level of VR and MR user experience.

Library of Congress Subject Headings

Virtual reality--Design; Gesture recognition (Computer science); User interfaces (Computer systems)

Publication Date


Document Type


Student Type


Degree Name

Visual Communication Design (MFA)

Department, Program, or Center

School of Design (CAD)


Adam Smith

Advisor/Committee Member

Mike Strobert


RIT – Main Campus

Plan Codes