Yi Fei Cheng
Virtual Reality (VR) has the potential to transform how we work: it enables fexible and personalized workspaces beyond what is possi ble in the physical world. However, while most VR applications are designed to operate in a single empty physical space, work environ ments are often populated with real-world objects and increasingly diverse due to the growing amount of work in mobile scenarios. In this paper, we present InteractionAdapt, an optimization-based method for adapting VR workspaces for situated use in varying everyday physical environments, allowing VR users to transition between real-world settings while retaining most of their personal ized VR environment for efcient interaction to ensure temporal consistency and visibility. InteractionAdapt leverages physical afor dances in the real world to optimize UI elements for the respectively most suitable input technique, including on-surface touch, mid-air touch and pinch, and cursor control. Our optimization term thereby models the trade-of across these interaction techniques based on Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for proft or commercial advantage and that copies bear this notice and the full citation on the frst page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specifc permission and/or a fee. Request permissions from permissions@acm.org. UIST ’23, October 29–November 01, 2023, San Francisco, CA, USA © 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM. ACM ISBN 979-8-4007-0132-0/23/10...$15.00 https://doi.org/10.1145/3586183.3606717 experimental fndings of 3D interaction in situated physical envi ronments. Our two evaluations of InteractionAdapt in a selection task and a travel planning task established its capability of support ing efcient interaction, during which it produced adapted layouts that participants preferred to several baselines. We further show case the versatility of our approach through applications that cover a wide range of use cases. CCS CONCEPTS • Human-centered computing → Mixed / augmented reality; Virtual reality; User interface management systems.