The Challenge
HMD interaction happens in two places at once: inside the headset and in the physical environment.
This makes real-world XR harder to observe, evaluate, and document than conventional screen-based interaction.
Making Interaction Observable
I combined the streamed HMD view with direct observation of the user’s physical behavior.
This made it possible to understand both:
- what the user sees and does inside XR
- how the user moves and reacts in the real environment
Field Evaluation
I used structured observation to record interaction success, hesitation, movement, confusion, and assistance without repeatedly interrupting the visitor.
The approach was reused across multiple museum XR studies and different HMD platforms.
Documenting XR in the Field
HMD experiences are also difficult to communicate through conventional video recording.
I led a small team to plan and capture field demos using participants, external cameras, in-headset recordings, and post-production to show both the digital interaction and its physical context.
My Role
Field Study Design · UX Evaluation · XR Documentation · Team Coordination
I developed and refined practical workflows for studying and communicating embodied XR interaction in real environments.
Applied in Practice
The workflow was used across different prototypes, exhibits, devices, and museum environments in the presentXR and LoGaCulture projects.