Hybrid Touch/Tangible Spatial Selection in Augmented Reality. (June 2022)

• Record Type: Journal Article
• Authors: Sereno, Mickael; Gosset, Stéphane; Besançon, Lonni; Isenberg, Tobias
• Is Part Of: Computer graphics forum. Volume 41:Number 3(2022)
• Page Start: 403
• Page End: 415
• Publication Date: 2022-06
• Subjects: CCS Concepts -- Human‐centered computing → Mixed / augmented reality -- Touch screens -- Scientific visualization; Computer graphics -- Periodicals; 006.605
• DOI: 10.1111/cgf.14550
• Languages: English
• ISSNs: 0167-7055

Abstract

Abstract: We study tangible touch tablets combined with Augmented Reality Head‐Mounted Displays (AR‐HMDs) to perform spatial 3D selections. We are primarily interested in the exploration of 3D unstructured datasets such as cloud points or volumetric datasets. AR‐HMDs immerse users by showing datasets stereoscopically, and tablets provide a set of 2D exploration tools. Because AR‐HMDs merge the visualization, interaction, and the users' physical spaces, users can also use the tablets as tangible objects in their 3D space. Nonetheless, the tablets' touch displays provide their own visualization and interaction spaces, separated from those of the AR‐HMD. This raises several research questions compared to traditional setups. In this paper, we theorize, discuss, and study different available mappings for manual spatial selections using a tangible tablet within an AR‐HMD space. We then study the use of this tablet within a 3D AR environment, compared to its use with a 2D external screen.