Overview
(This project is led by Vishnu Nair and advised by Prof. Brian Smith. Team involved Hannah Huddleston, Karen Lin, Mason Hayes, Matthew Donnelly, Ricardo E Gonzalez, Yicheng He)
In this project, we investigated diverse methods of communicating spatial information in games through auditory channels, thus enabling blind accessibility in traditional 3D video games. This was a multi-semester long project. In the first semester, we implemented and studied the use of a Directional Scanner (NavStick) that announced the names of objects in a game environment. In the second semester, we investigated the use of many types of tools to recreate the functionality of a Visual Minimap.
Lab webpage on this project is available here. UIST demo paper is available here.

Key Contributions
- Implemented NavStick distance communication functionality in Unity.
- Performed and participated in studies involving Visually impaired gamers in investigating the effectiveness of NavStick.
- Came up with idea of using "Key-Lock" metaphor/game structure such that the controlled study environment was enjoyable to play as a game. Architecture was used in study and results are under review at CHI.
- Came up with idea of using a Audio Menu as a status quo acoustic minimap tool, enabling comparison of new tools to currently existing solution. This idea was used in the final study submitted to CHI.
- Provided assistance to other members of the team in using various functions of Unity.
- Performed and participated in studies involving visually impaired gamers in investigating the various tools and importance of various minimap affordances.
- Performed thematic analysis on quotes transcribed during study.
- As second author, wrote significant portions of demo paper published at UIST and final paper submitted to CHI.​​​​​​​
Back to Top