ShapelineGuide - Teaching Mid-Air Gestures for Large Interactive Displays

We present ShapelineGuide, a dynamic visual guide that supports users of large interactive displays while performing midair gestures. Today, we find many examples of large displays supporting interaction through gestures performed in mid-air. Yet, approaches that support users in learning and executing these gestures are still scarce. Prior approaches require complex setups, are targeted towards the use of 2D gestures, or focus on the initial gestures only. Our work extends state-of-the-art by presenting a feedforward system that provides users constant updates on their gestures. We report on the design and implementation of the approach and present findings from an evaluation of the system in a lab study (N= 44), focusing on learning performance, accuracy, and errors. We found that ShapelineGuide helps users with regard to learning the gestures as well as decreases execution times and cognitive load.