Exploring Spatial UI Transition Mechanisms with Head-Worn Augmented Reality

Exploring Spatial UI Transition Mechanisms with Head-Worn Augmented Reality
Feiyu Lu, Yan Xu

CHI'22: ACM Conference on Human Factors in Computing Systems
Session: Augmented or Diminished Reality?

Abstract
Imagine in the future people comfortably wear augmented reality (AR) displays all day, how do we design interfaces that adapt to the contextual changes as people move around? In current operating systems, the majority of AR content defaults to staying at a fixed location until being manually moved by the users. However, this approach puts the burden of user interface (UI) transition solely on users. In this paper, we first ran a bodystorming design workshop to capture the limitations of existing manual UI transition approaches in spatially diverse tasks. Then we addressed these limitations by designing and evaluating three UI transition mechanisms with different levels of automation and controllability (low-effort manual, semi-automated, fully-automated). Furthermore, we simulated imperfect contextual awareness by introducing prediction errors with different costs to correct them. Our results provide valuable lessons about the trade-offs between UI automation levels, controllability, user agency, and the impact of prediction errors.

WEB:: https://chi2022.acm.org/

Pre-recorded presentations of CHI 2022