Wes, A.I. Companion

Project Description

A conversational AI audio-navigation that provides independent way-finding for visually impaired guests at Century City Mall.

Problem

Century City Mall is a beautiful, modern and very large mall. Sighted people get lost due to its size and complex layout, but they are able to use the interactive directories to navigate to their desired stores or services. However, the directories are not accessible to vision-impaired guests, making it impossible for them to navigate the mall due to the lack of accessible way-finding.

Insights

During our interviews we discovered that visually impaired people not only lack accessible way-finding, but they also lack independence. Some interviewees also mentioned that completing a task independently boosts their confidence level.

Solutions

Wes: an AI assistant integrated into the existing Westfield app. Wes combines the built-in GPS capability found in virtually every smartphone today with a map of the mall to accurately pinpoint a guest's location. Using that information, Wes provides conversational audio directions and environmental descriptions. Wes also takes the guest’s walking speed into consideration, so visitors don’t feel rushed, can easily find their destination and be informed of their surroundings, thus creating a much more accessible and enjoyable mall experience.