Mixed-reality experience which allows users to bring the natural world into the virtual

Motivation

Having previously built a gesture-sensing AR interface for in-vehicle productivity, I wanted to explore how such a modality offered an opportunity for play. The result of my ideation became Living Rocks: a conceptual mixed-reality experience which combines gestural input and AR vision to bring to life pet rocks.  

In my imagination, users would first select a rock they’d like to ‘bring to life’. While wearing an AR or mixed-reality headset, they could scan their chosen rock and using 3D reconstruction, a virtual 3D model of the rock would be created, along with eyes, arms, hats and other silly characterizations. Using their hands, players could tickle, hold, and poke the pet rock inducing all kinds of silly interactions.

Storyboard.

Using storyboards and conceptual drawings, I sketched out the ideas which excited me the most.

Much of my enthusiasm towards AR comes from my deep enjoyment of tactile play and fascination with the natural world. Such interfaces encourage you to look at the beauty and mystery of the world around you, instead of through a screen.