Marsbot for AirPods

Marsbot for Airpods (opens in a new tab) is a contextual companion that speaks to you as you walk around leveraging Foursquare's location data and social graph.

I worked on voice synthesis, implemented the background audio, and integrated background location updates.

One of the more interesting challenges was triggering audio snippets (which were associated with GPS coordinates) at the "right" moment, ideally within line of sight or at least in the direction that the user was walking. I experimented with using a Kalman filter (opens in a new tab) to improve accuracy of location data and developed a debugging interface for viewing context audio snippets where played.