David Lindlbauer, Anna Maria Feit, Otmar Hilliges
We present an optimization-based approach for Mixed Reality (MR) systems to automatically control when and where appli cations are shown, and how much information they display. Currently, content creators design applications, and users then manually adjust which applications are visible and how much information they show. This choice has to be adjusted every time users switch context, i.e., whenever they switch their task or environment. Since context switches happen many times a day, we believe that MR interfaces require automation to alleviate this problem. We propose a real-time approach to automate this process based on users’ current cognitive load and knowledge about their task and environment. Our system adapts which applications are displayed, how much informa tion they show, and where they are placed. We formulate this problem as a mix of rule-based decision making and combina torial optimization which can be solved effciently in real-time. We present a set of proof-of-concept applications showing that our approach is applicable in a wide range of scenarios. Finally, we show in a dual-task evaluation that our approach decreased secondary tasks interactions by 36%. Author Keywords Mixed Reality, Context-Awareness, UI Optimization CCS Concepts •Human-centered computing → Mixed / augmented real ity; Virtual reality; User interface management systems; Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for proft or commercial advantage and that copies bear this notice and the full citation on the frst page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specifc permission and/or a fee. Request permissions from permissions@acm.org. UIST’19, The 32nd Annual ACM Symposium on User Interface Software and Tech nology, October 20–23, 2019. New Orleans, LA, USA © 2019 Copyright held by the owner/author(s). Publication rights licensed to ACM. ISBN 978-1-4503-6816-2/19/10...$15.00 DOI: 10.1145/3332165.3347945