USHER with IBM Watson AI
“Making museums matter”
USHER built on IBM technologies, is an Intelligent touring guide that helps you to give an immersive experience based on your location, locomotion, and is intelligent enough to help you out for your all un-answered queries. Touring is fun when you have right company; USHER also helps in detecting a friend inside a geo-located space.
GOALS
Create an optimal museum tour experience by leveraging Watson API, Bluezen and Mobile ID. No more brochures or tour guide are needed. Jin, the Semi Art Historian can do museum tour on her own pace.
IMPACT & AWARDS
“First Runner up and Best Cognitive App”
Mobile First Platform Hackathon 2Q2014, IBM Impact 2014Usher was showcased at many internal and external IBM events in 2014- 2015.
MY CONTRIBUTION
Creating museum tour concept and presented compelling user stories, flow, low and mid fidelity mockups to highlight key features of the application for IBM Mobile Hackday.
TEAM USHER
Yojin Leem, Richa Sehgal, Saurabh Srivastava, Parikshit Sharma, Shubham Toshniwal
Duration
4 weeks
Different museum tour options are available.
Map Tour shows museum map and guides the user thru map UI. Collections allows a customized tour based on the user’s interest.
USHER welcomes the users and starts audio stream to start the tour.
Once Jin enters the museum, USHER welcomes her and describes the information about a particular section of the museum. It will toast a recommendation to wear headphones for the enhanced experience.
Heatmap and Notification
Jin can avoid avoid a crowded gallery and return back when it is cleared. Not all places inside a Museum are allowed to be photographed. USHER helps Jin in avoiding and recommending the places where she can click!
Usher understands precisely where the user is and response to user’s behavior.
Walking by “The Muse, by Susan Walker Morse”, Usher will describe the painting “showing a girl sitting with a sketchbook in her lap and pencil in hand with her eyes raised in contemplation." Based on Jin’s location and locomotion, USHER automatically plays, pause or navigate the audio streaming about the artifacts. In case of a query, Jin can speak or type questions on USHER and it gives relevant answers.Depends on the questions posed to it, it will understand Jin’s interests and provide insightful information.
Museum store and tour Albums
Add text here
Lesson learned
During my first mobile project, I gained valuable insights into the workings of APIs and Watson AI. It was a great opportunity for me to exercise my creativity by selecting the most suitable technology for the project. Overall, I learned a lot from this experience and it was a fantastic way to enhance my knowledge and skills.
Implementation
This was a big project done in 4 weeks and USHER was publicized outside IBM. USHER was showcased in museums in Washington DC and many technology conferences in year of 2014-2015.