Abstract
Tasks in augmented reality (AR), such as 3D interaction and instructional comprehension, are often designed for users with uniform sensory abilities. Such an approach, however, can overlook the more nuanced needs of Deaf and Hard of Hearing (DHH) users who might have reduced auditory perception. To better understand these challenges, our study utilized the single-player AR game Angry Birds AR as a probe to explore how 11 DHH participants and 15 hearing participants experienced AR interactions. Our findings highlight that DHH users prefer interaction based on context, effective haptic cues, audio cue substitutes, and clear instructional design. We, therefore, propose the following design recommendations to enhance the accessibility of AR for DHH users. This includes customizable UI options, modular feedback systems, and virtual avatars for sign language instructions.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Publication Date
4-25-2025
Document Type
Conference Paper
Department, Program, or Center
Information, School of
College
Golisano College of Computing and Information Sciences
Recommended Citation
Sanzida Mojib Luna, Jiangnan Xu, Garreth W. Tigwell, Nicolas LaLone, Michael Saker, Alan Chamberlain, David I Schwartz, and Konstantinos Papangelis. 2025. Exploring Deaf And Hard of Hearing Peoples' Perspectives On Tasks In Augmented Reality: Interacting With 3D Objects And Instructional Comprehension. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25). Association for Computing Machinery, New York, NY, USA, Article 1052, 1–14. https://doi.org/10.1145/3706598.3713678
Campus
RIT – Main Campus
