Improving Autonomous Ridesharing Accessibility

A UX research study evaluating multimodal HMI feedback for visually impaired users.

UX research study examining how audio and tactile feedback can improve accessibility in autonomous ridesharing, contributing to a peer-reviewed publication and recommendations for more inclusive vehicle interfaces.


My role

UX Researcher

Methods

Literature Review · Experimental Usability Testing · Moderated Sessions

outcome

Peer-Reviewed Publication · Accessibility Recommendations

Jump to…

01/ INTRO

Problem

Accessibility: Autonomous rideshare interfaces rely heavily on visual interaction, creating accessibility barriers for visually impaired users.

Exclusion: These barriers limit users’ ability to confidently navigate rideshare experiences

Quality of Life: This reduces independence that autonomous transportation could provide and they lose out on opportunities for socialization and employment.

The CURRENT Autonomous Rideshare Experience

Design Opportunity:

How might we help visually impaired riders feel confident, oriented, and independent during autonomous rideshare experiences?

02/ RESEARCH AND PLANNING

1. Literature Review

Reviewed 27 academic papers to understand:

✓ accessibility barriers in AV systems
✓ user trust and confidence in AV systems
✓ effectiveness of assistive technologies
✓ opportunities for multimodal interaction

2. Painpoints Revealed

Lack of Trust:

Many visually impaired users expressed skepticism toward autonomous vehicles due to past experiences with inaccessible technology.

Situational Awareness:

Riders reported difficulty maintaining awareness during trips and wanted clearer route updates, environmental cues, and destination alerts.

COnfirmation Difficulty:

A common challenge for visually impaired riders is confirming they are entering the correct vehicle and arriving at the correct destination.

safety concerns:

Users expressed safety concerns around system failures, particularly how they would access help, understand vehicle behavior, and respond to system issues.

reliance on visuals

Many autonomous vehicle interfaces rely heavily on visual displays, creating accessibility barriers for visually impaired users. Research showed that visual warnings are often missed and visual-only feedback is insufficient for navigation and awareness.

  • Reduce reliance on vision through multimodal audio feedback

  • Increase trip awareness with route progress and environmental cues

  • Support independent navigation through vehicle and destination confirmation

  • Improve safety and trust with clear emergency communication pathways

3. Design Requirements

4. Accessibility Framework

Design requirements were guided by WCAG’s POUR principles to ensure the interface remained perceivable, operable, understandable, and robust for visually impaired users.

03/ PROTOTYPE DESIGN

04/ TESTING AND RESULTS

Based on prior literature, we hypothesized that multimodal feedback would improve confidence, usability, and accessibility outcomes.

Hypothesis

Audio feedback improves navigation confidence and route awareness for visually impaired riders.

h1

Multimodal feedback enables visually impaired users to perform comparably to non-visually impaired riders.

h2

Removing audio feedback decreases rider trust and situational awareness.

h3


Testing

Study Design

Between-subjects experimental study
24 participants across 3 conditions to reduce learning effects.

Participant Groups

NVI: No visual impairment + audio cues

VI: Simulated visual impairment + audio cues

VIX: Simulated visual impairment + no audio cues

Impairment was simulated by Cambridge Disability Simulator which was used to simulated visual impairment at 20/200 acuity blur

experiment

Participants completed a simulated rideshare experience and were asked to:

1.identify the correct vehicle

2.navigate route progression

3.exit and orient themselves

Simulation used for usability testing, replicating the rear-seat AV environment with synchronized audio and visual output.

measuing usability

After the testing, participants completed a 5-point Likert scale measuring:

1. confidence

2. satisfaction

3. usability

Statistical analysis was conducted using the Kruskal–Wallis test with post-hoc testing to identify significant differences between groups.


Findings

Key finding:‍‍ ‍ ‍visually impaired participants using multimodal feedback performed comparably to non-visually impaired riders

Across key rideshare tasks, including vehicle identification, route navigation, and exit orientation; the VI group preformed comparably to the NVI group. These findings suggest that multimodal feedback can meaningfully improve confidence, situational awareness, and usability for visually impaired autonomous rideshare users, reinforcing the importance of accessibility-centered HMI design in reducing barriers to independent travel.

h1

h2

h3

05/ CONCLUSION

Key Takeaway

multimodal interfaces can significantly improve accessibility and independence.

This research challenged my assumptions about what makes an interface intuitive. I learned that relying primarily on visual interaction can unintentionally exclude users, particularly in high-stakes environments like autonomous mobility. As a designer, this project strengthened my belief that inclusive systems should prioritize multimodal feedback, clear communication, and trust-building throughout the user experience.

Future Design Opportunities

1. Introduce haptic feedback
Explore seat vibration and localized speakers to create tri-modal feedback and improve accessibility for users with combined sensory impairments.

2. Support personalized experiences
Allow riders to customize audio verbosity, tone, pacing, and cue frequency to better support individual comfort and anxiety levels.

3. Expand multimodal testing
Evaluate how audio feedback impacts both visually impaired and sighted users to better understand broader usability benefits.

Previous
Previous

AI for Team Collaboration