Improving Autonomous Ridesharing Accessibility
A UX research study evaluating multimodal HMI feedback for visually impaired users.
UX research study examining how audio and tactile feedback can improve accessibility in autonomous ridesharing, contributing to a peer-reviewed publication and recommendations for more inclusive vehicle interfaces.
My role
UX Researcher
Methods
Literature Review · Experimental Usability Testing · Moderated Sessions
outcome
Peer-Reviewed Publication · Accessibility Recommendations
Jump to…
01/ INTRO
Problem
Accessibility: Autonomous rideshare interfaces rely heavily on visual interaction, creating accessibility barriers for visually impaired users.
Exclusion: These barriers limit users’ ability to confidently navigate rideshare experiences
Quality of Life: This reduces independence that autonomous transportation could provide and they lose out on opportunities for socialization and employment.
The CURRENT Autonomous Rideshare Experience
Design Opportunity:
How might we help visually impaired riders feel confident, oriented, and independent during autonomous rideshare experiences?
02/ RESEARCH AND PLANNING
1. Literature Review
Reviewed 27 academic papers to understand:
✓ accessibility barriers in AV systems
✓ user trust and confidence in AV systems
✓ effectiveness of assistive technologies
✓ opportunities for multimodal interaction
2. Painpoints Revealed
Lack of Trust:
Many visually impaired users expressed skepticism toward autonomous vehicles due to past experiences with inaccessible technology.
Situational Awareness:
Riders reported difficulty maintaining awareness during trips and wanted clearer route updates, environmental cues, and destination alerts.
COnfirmation Difficulty:
A common challenge for visually impaired riders is confirming they are entering the correct vehicle and arriving at the correct destination.
safety concerns:
Users expressed safety concerns around system failures, particularly how they would access help, understand vehicle behavior, and respond to system issues.
reliance on visuals
Many autonomous vehicle interfaces rely heavily on visual displays, creating accessibility barriers for visually impaired users. Research showed that visual warnings are often missed and visual-only feedback is insufficient for navigation and awareness.
Reduce reliance on vision through multimodal audio feedback
Increase trip awareness with route progress and environmental cues
Support independent navigation through vehicle and destination confirmation
Improve safety and trust with clear emergency communication pathways
3. Design Requirements
4. Accessibility Framework
Design requirements were guided by WCAG’s POUR principles to ensure the interface remained perceivable, operable, understandable, and robust for visually impaired users.
03/ PROTOTYPE DESIGN
04/ TESTING AND RESULTS
Based on prior literature, we hypothesized that multimodal feedback would improve confidence, usability, and accessibility outcomes.
Hypothesis
Audio feedback improves navigation confidence and route awareness for visually impaired riders.
h1
Multimodal feedback enables visually impaired users to perform comparably to non-visually impaired riders.
h2
Removing audio feedback decreases rider trust and situational awareness.
h3
Testing
Study Design
Between-subjects experimental study
24 participants across 3 conditions to reduce learning effects.
Participant Groups
NVI: No visual impairment + audio cues
VI: Simulated visual impairment + audio cues
VIX: Simulated visual impairment + no audio cues
Impairment was simulated by Cambridge Disability Simulator which was used to simulated visual impairment at 20/200 acuity blur
experiment
Participants completed a simulated rideshare experience and were asked to:
1.identify the correct vehicle
2.navigate route progression
3.exit and orient themselves
Simulation used for usability testing, replicating the rear-seat AV environment with synchronized audio and visual output.
measuing usability
After the testing, participants completed a 5-point Likert scale measuring:
1. confidence
2. satisfaction
3. usability
Statistical analysis was conducted using the Kruskal–Wallis test with post-hoc testing to identify significant differences between groups.
Findings
Key finding: visually impaired participants using multimodal feedback performed comparably to non-visually impaired riders
Across key rideshare tasks, including vehicle identification, route navigation, and exit orientation; the VI group preformed comparably to the NVI group. These findings suggest that multimodal feedback can meaningfully improve confidence, situational awareness, and usability for visually impaired autonomous rideshare users, reinforcing the importance of accessibility-centered HMI design in reducing barriers to independent travel.
h1
h2
h3
05/ CONCLUSION
Key Takeaway
multimodal interfaces can significantly improve accessibility and independence.
This research challenged my assumptions about what makes an interface intuitive. I learned that relying primarily on visual interaction can unintentionally exclude users, particularly in high-stakes environments like autonomous mobility. As a designer, this project strengthened my belief that inclusive systems should prioritize multimodal feedback, clear communication, and trust-building throughout the user experience.
Future Design Opportunities
1. Introduce haptic feedback
Explore seat vibration and localized speakers to create tri-modal feedback and improve accessibility for users with combined sensory impairments.
2. Support personalized experiences
Allow riders to customize audio verbosity, tone, pacing, and cue frequency to better support individual comfort and anxiety levels.
3. Expand multimodal testing
Evaluate how audio feedback impacts both visually impaired and sighted users to better understand broader usability benefits.