Overview
In a collaborative cross-institutional project between the College for Creative Studies (CCS) and Oakland University’s Engineering School, we developed an interactive AR experience that bridged physical robotics with digital simulation.At the heart of the project was a digital twin—a virtual replica of a robot that navigated a mixed-reality environment in real time.
Reasearch
We designed an intuitive AR interaction system through a user-centered process—mapping the user journey, prototyping interfaces in Figma, and iteratively refining controls and spatial feedback in Unreal Engine to ensure real-time, responsive interaction with the robot’s digital twin.UI Components
UI Mockups
These UI mockups were integrated directly into the immersive environment developed by the CCS Game Design team for Terra Drive. The interface was designed to complement the world’s Solar Core and Succulent Plate aesthetic—an earthy, sci-fi fusion of bio-mechanical forms and radiant energy. Our goal was to create a UI system that felt native to the environment, blending seamlessly with the terrain while remaining functional and user-focused within the AR experience.