PhD Research · HMD-Based Augmented Reality · Cultural Heritage
Designing Reusable Interaction for Museum XR
A doctoral research project on interaction design for head-mounted augmented reality in museums — from first-time-user challenges and field prototypes to a parameterized and empirically evaluated interaction pattern language.
Research Journey
From Interaction Problems to Reusable Design Knowledge
The research developed through a sequence of empirical studies, prototype iterations, museum deployments, pattern abstraction, and validation.
Walk-up XR for Real-World Environments
Investigating first-time-user challenges and developing interaction approaches for accessible HMD-based museum experiences.
Game-Mechanic-Based Interaction Design
Exploring playful spatial interaction and introducing game mechanics into museum XR experiences.
Evaluating HMD Interaction in Museums
Developing practical field-observation methods and structured evaluation approaches for real museum environments.
A Composable Two-Level Pattern System for Museum XR
Abstracting recurring prototype interactions into reusable, adaptable, and composable design knowledge.
Empirical Validation of HMD-AR Interaction Design
Testing specific design parameters and examining pattern reuse across different museum contexts.
Immersion in Museum XR
Examining flow, narrative immersion, and spatial immersion in relation to museum learning and visitor experience.
Pattern System
A Two-Level Interaction Pattern Language
The research resulted in a reusable interaction design system that connects broader interaction purposes with concrete, parameterized solutions for HMD-based museum experiences.
THREE
Category-Level Patterns
Higher-level interaction structures describing recurring roles within the visitor journey.
NINE
Application-Level Patterns
Concrete interaction solutions that can be instantiated, adapted, and combined across museum scenarios.
Parameterized
Adaptable Design Knowledge
Explicit parameters describe which aspects of a pattern can change across exhibits, environments, and visitor situations.
Composable
Reusable Interaction Flows
Multiple patterns can be combined to construct larger visitor journeys rather than functioning as isolated UI elements.
Pattern Categories
Three Recurring Roles in the Museum Experience
Category-level patterns organize the interaction system around recurring visitor needs: reaching relevant content, discovering available AR experiences, and engaging with exhibit-related information.
Point of Interest Guide
Point of Interest Guide
PoI Guide, Route Guidance, Experience Navigation
Experience Indicator
Experience Indicator
Experience Indicator, AR Activation, Exhibit Discovery
Experience Presenter
Experience Presenter
Experience Presenter, Exhibit-Centred Content, AR Presentation
Empirical Foundation
Evidence Behind the Pattern System
The interaction patterns were developed and refined through complementary forms of evidence rather than through a single study.
Visitor Studies
HMD-based AR prototypes were evaluated with museum visitors and first-time users under realistic exhibition conditions.
Creator Evaluation
AR developers and cultural heritage practitioners examined the clarity, usability, and reuse potential of the pattern language.
Cross-Site Deployment
Related pattern compositions were adapted and deployed across different natural history museum environments.
Design-Parameter Studies
Specific dimensions, including semantic anchoring and spatial UI placement, were investigated through focused empirical studies.
Selected Publications
Research Behind the System
Selected publications documenting the development of the interaction pattern system, playful interaction strategies, and museum-based HMD-AR design research.
Resources
From Design Knowledge to Reusable Resources
Pattern Documentation
The portal documents interaction patterns, parameters, relationships, scenarios, and implementation-oriented guidance for reuse in future HMD-based AR projects.
Technology Resources
Unity-based reference implementations and reusable components are being prepared to support practical prototyping, replication, and further development.
Research Context
Developed Through Museum-Based Design Research
Doctoral Research
This portal presents the doctoral research of Yu Liu at Hochschule RheinMain, focusing on interaction design for head-mounted augmented reality in museums and cultural heritage environments.
Research Projects
The work was developed in the context of presentXR and the European LoGaCulture project, with iterative prototyping and deployment in natural history museum environments.
