Below are some of the cool projects I’ve been involved with (that I’m allowed to talk about).
Mobile AR apps
We created a set of mobile apps and games that demonstrate new augmented reality interactions.
3D UI lets you feel manipulation gestures as you navigate a three dimensional user interface.
ARt: Augmented Reality Touch
ARt is a smart glasses experience that lets you feel liquid paint in mid air.
Remote Touch is a research prototype that lets you to feel virtual force illusions using only vibration and visual design. The goal is to let people communicate body language using a phone.
Digital Sensory Storytelling
At Cannes Lions, Digital Hollywood, and elsewhere, I have been presenting our point of view about how to use touch to tell stories. more →
To understand the business and UX opportunities associated with 360 video, we researched how people respond to 360 virtual content in a variety of contexts. The research culminated in the design of an app that aggregates and plays back 360 short-form videos and ads on mobile headsets.
Rich Chat and Live Streaming
Productizing our long experience in emotional digital communication, we provided several new chat features to our customers, including new kinds of stickers and emotional interactions. We integrated these with our partners who were part of the China Live Streaming phenomenon.
Diving deep on mobile payments, we researched the market and prevailing user experience conventions. We then designed a payments app with the goals of increasing user friendliness and confidence.
Tactile Illusions explored the possibility of creating illusions of materiality and physicality on a pressure-sensitive handset. more →
Watching video on mobile devices is more engaging when eyes, ears, and hands are all stimulated at once. We created a toolchain for mobile video ads that lets designers create haptic tracks for videos, and lets ad networks stream haptic media to end users.
Instinctive Alerts is a design framework that enables better notifications for wearable devices. more →
Wearable User Experience
In the early days of smartwatches we generated a set of use cases and interaction guidelines for wearable experiences. more →
Future of Wearables
Future of Wearables explored how context and body movement can be integrated into the wearable computing experience. more →
User Generated Content
This project looked at how people author sharable content on smartphones. Our research resulted in an app that lets you add tactile and visual effects to your own videos.
Haptic Video Prototyping
In order to “sketch” tactile experiences quickly and allow for design iteration, we created an innovative prototyping process that utilizes video and animation. more →
Integrator was a pervasive UI enhancement for Android adopted by several Android device manufacturers, including Fujitsu, NEC, Sharp, and Pantech.
This reference design for an innovative automotive UI introduced new touchscreen gestures for control of automotive interfaces with the goals of reducing glance time and increasing usability. more →
Neutrino was a miniature, self-contained prototyping platform that let designers “sketch” with hardware. more →
Enzo’s Pinball was a commercially released Android game that demonstrated a few new interaction ideas for mobile games. more →
Fuse concept phone
Fuse combined new sensors, actuators, and UI design to envision a futuristic mobile user interface. more →
Immersion Pinball demonstrates a tablet-based multiplayer game with immersive feedback. more →
Immersive Messaging is an app that lets you touch other people through the screen of a phone. more →
PowerSurface was one of the earliest solutions for inductive charging of mobile devices. more →
Rulers is a musical instrument I developed at a Stanford music technology workshop. It’s been through several design revisions, and compositions for Rulers have been performed in a few recitals. more →
WYSIWYG: Wearable, Sonic Instruments With Gesture
WYSIWYG was a collaboration among fiber artists, scientists, and musicians to develop interactive cloth that produces sound. more →
Breakflute is an electronic flute that plays breakbeat patterns. It demonstrates that new musical instrument designs are possible with an understanding of gesture and musical cognition. more →
Design of Input Devices for Music
Design of Input Devices for Music was a seminar I taught that offered hands-on experience with sensors, interfaces, and synthesis software. more →
Powerplant Family was group of 23 artists from various disciplines. We held an exhibition that explored the relationship between nature and technology. more →
Miniatures was an artistic collaboration among researchers and university faculty. We produced several sound recordings, videos, and performances. more →
I designed a Jitter-based system that turns dance into music. It was used by contemporary dancer Lucie Grégoire and composer Robert Normandeau in the Akousma concert series. more →
SensorWiki is an online resource hosted by McGill University that provides information about sensors and interface technologies. more →
Understanding musical interaction
Some of my research has focused on developing new design theories for musical devices. more →
Commotion + Contingence
Commotion + Contingence are two electronic instruments I created. They were played in several concerts, as well as on CBC Radio One. more →