
Mixed-reality experience which allows users to bring the natural world into the virtual
Motivation
Having previously built a gesture-sensing AR interface for in-vehicle productivity, I wanted to explore how such a modality offered an opportunity for play. The result of my ideation became Living Rocks: a conceptual mixed-reality experience which combines gestural input and AR vision to bring to life pet rocks.
In my imagination, users would first select a rock they’d like to ‘bring to life’. While wearing an AR or mixed-reality headset, they could scan their chosen rock and using 3D reconstruction, a virtual 3D model of the rock would be created, along with eyes, arms, hats and other silly characterizations. Using their hands, players could tickle, hold, and poke the pet rock inducing all kinds of silly interactions.
Storyboard.
Using storyboards and conceptual drawings, I sketched out the ideas which excited me the most.

I'm a big collector! This idea came to be while looking at the rocks I had brought back from a trip to the east coast of Canada. The irregular and beautiful shapes of the natural world are among my favourite inspirations.


Much of my enthusiasm towards AR comes from my deep enjoyment of tactile play and fascination with the natural world. Such interfaces encourage you to look at the beauty and mystery of the world around you, instead of through a screen.

Process work.

