Autonomous Vehicle Human-Machine Interface Design for Visually Impaired Users
Peer-reviewed and published in the Proceedings of the Human Factors and Ergonomics Society Annual Meeting (HFES)
-
Focus: Accessibility in autonomous vehicle HMIs
Method: Between-subjects experimental usability study
Participants: 24 participants (3 user conditions)
Objective: Evaluate how multimodal feedback affects trust and navigation confidence
-
How does multimodal (audio-visual) feedback influence trust, navigation confidence, and usability for visually impaired autonomous rideshare passengers?
-
UX Researcher
Designed experimental protocol
Conducted literature review
Ran usability testing sessions
Problem
Autonomous rideshare interfaces rely heavily on visual interaction, creating accessibility barriers for visually impaired users. These barriers limit users’ ability to confidently navigate rideshare experiences and ultimately reduce the independence that autonomous transportation could provide.
Research Question
How does multimodal feedback influence trust, usability, and navigation confidence for visually impaired riders in autonomous rideshare systems?
1
RESEARCH & PLANNING
Research Question
How does multimodal feedback influence trust, usability, and navigation confidence for visually impaired riders in autonomous rideshare systems?
Literature Review
The team conducted a literature review of 27 academic papers to better understand the limitations faced by visually impaired individuals and their perceptions and acceptance of autonomous vehicles (AVs). A secondary objective of the review was to examine the types of assistive and autonomous technologies currently available, as well as evaluate their effectiveness in supporting mobility, accessibility, and user confidence for visually impaired populations.
Design opportunity
Provide audio feedback to reduce reliance on vision
Improve route transparency and trip awareness
Enable independent vehicle and destination confirmation
Offer clear emergency communication pathways
Key Painpoints
-
Many visually impaired users express skepticism due to past experiences with technology that failed to account for their needs. While users were excited about the independence autonomous vehicles could provide, they worried that AV systems may not be designed inclusively and could overlook accessibility requirements.
-
Visually impaired riders often struggle to understand where they are, what the vehicle is doing, and what will happen next during a trip.
Users want:
Continuous route progress updates
Environmental cues and landmarks
Notifications when approaching destinations
-
A common challenge for visually impaired riders is confirming they are entering the correct vehicle and arriving at the correct destination.
-
Participants expressed concerns about what would happen during unexpected events, such as system failures or crashes. Since visually impaired users cannot take manual control of the vehicle, they worry about:
Accessing emergency assistance
Understanding why the vehicle is making certain decisions
Knowing when the system encounters problems
-
Many existing autonomous vehicle interfaces rely heavily on visual displays and alerts, which are ineffective for visually impaired users.
Research shows that:
Visual warnings can be easily missed
Visual interfaces do not support accessibility
Visual information alone cannot provide sufficient feedback
2
Prototype Design
-
![]()
1. Interface Set Up
The prototype was designed to mirror a traditional rideshare experience, with the rider seated in the back seat. Visual interfaces and audio interactions were positioned in the back to ensure accessibility and support rider engagement.
-
![]()
2. Rider verification
To address concerns surrounding correctly identifying the assigned rideshare vehicle, the team designed a verification module that welcomes the rider and confirms they have entered the correct vehicle. This feature incorporates both visual and audio interactions to confirm trip details and provide reassurance to the rider.
-
![]()
3. Destination Confirmation
To address concerns about riders traveling to the correct destination, the team designed a destination confirmation module. This feature also incorporates both visual and audio interactions.
-
![]()
4. Default Screen
The default screen paired visual and tactile features to support rider safety and accessibility. The interface displayed important ride information using WCAG-compliant contrasting colors, alongside physical buttons riders could press during emergencies or when immediate assistance was needed. This design aimed to reduce uncertainty and provide reassurance in emergency situations.
-
![]()
5. Event: traffic light
When approaching a traffic light, the system keeps riders informed of the situation, this is designed to help them maintain situational awareness throughout the ride and feel more confident in the vehicle’s actions.
-
![]()
6. Event: Obstacle Detection & Avoidance
When the vehicle encounters an obstacle and changes routes, the system keeps riders informed to maintain situational awareness and confidence throughout the ride.
