3.8 Proceedings Paper

HandPoseMenu: Hand Posture-Based Virtual Menus for Changing Interaction Mode in 3D Space

Publisher

ASSOC COMPUTING MACHINERY
DOI: 10.1145/3343055.3360752

Keywords

mixed reality; virtual reality; graphical menu; hand posture; gesture recognition; head-mounted display

Funding

  1. Ministry of Culture, Sports and Tourism (MCST)
  2. Korea Creative Content Agency (KOCCA) in the Culture Technology (CT) Research & Development Program [1375026932]
  3. [Development of participational AR platform for large-scale cultural space]

Ask authors/readers for more resources

A system control technique (changing the interaction mode) is needed to provide various spatial interaction techniques for virtual, augmented and mixed reality (VR/AR/MR) applications. We propose HandPoseMenu, a hand posture-based virtual menus system in 3D space. HandPoseMenu recognizes the non-dominant hand's posture using a depth sensor that is attached to a wearable display and presents the virtual menu corresponding to the hand posture beside the non-dominant hand. When the user selects a desired function among the presented menu as a dominant hand, the interaction mode changes. The combination of the two system controls (graphical menu and hand posture) makes it possible to display the menu that the user wants to use in 3D space. This paper describes the implementation of HandPoseMenu and its application.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

3.8
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available