My Museum Guide

A mobile museum companion that identifies photographed exhibits and tells their stories through audio.

MobileAI

Three phone screens of My Museum Guide: picking a museum, the tour page for the Montreal Museum of Fine Arts, and the capture screen — The app running locally at iPhone size, shown in device frames: pick a museum, the tour page, and capture. Capture still shows a placeholder.

Status: Working prototype
Tools: React, Ionic, Capacitor, Supabase, ElevenLabs
Links: Source

My Museum Guide brings the guide into the visitor’s own route through a museum. A photo starts the interaction; a written story and spoken narration help the visitor spend time with the object, and the saved visit keeps what they encountered.

Onboarding to the first museum, recorded at phone size from a local run: language, depth, interests, then the tour and capture tabs.

Decisions

Let the visitor choose the depth

Onboarding distinguishes a curious introduction from a more informed or scholarly treatment. Language and interests shape the experience before the first artwork is captured.

Onboarding step asking how deep to go, with Curious, Informed and Scholarly options — The depth step in onboarding.

Connect the whole visit

Capture, the streamed story, cached audio and saved visits form one product flow. The mobile shell uses device capabilities through Capacitor; the backend identifies the artwork, narrates it and saves the visit.

Illustration in three panels: a visitor walks into a gallery, photographs a painting with the app, then listens to its story on headphones — Illustration of the visit the app is built around: walk in, photograph a work, listen to its story. Not an app screen.

Next project

Media Pipelines