Journal
JOURNAL OF REAL-TIME IMAGE PROCESSING
Volume 5, Issue 2, Pages 91-107Publisher
SPRINGER HEIDELBERG
DOI: 10.1007/s11554-009-0141-1
Keywords
Mixed reality; Design review; Human-computer interaction; Real-time collaborativeInteraction; Virtual reality
Categories
Funding
- Portuguese Foundation for Science and Technology [SFRH/BD/17574/2004, SFRH/BD/31020/2006]
- Fundação para a Ciência e a Tecnologia [SFRH/BD/17574/2004, SFRH/BD/31020/2006] Funding Source: FCT
Ask authors/readers for more resources
IMMIView is an interactive system that relies on multiple modalities and multi-user interaction to support collaborative design review. It was designed to offer natural interaction in visualization setups such as large-scale displays, head mounted displays or TabletPC computers. To support architectural design, our system provides content creation and manipulation, 3D scene navigation and annotations. Users can interact with the system using laser pointers, speech commands, body gestures and mobile devices. In this paper, we describe how we design a system to answer architectural user requirements. In particular, our system takes advantage of multiple modalities to provide a natural interaction for design review. We also propose a new graphical user interface adapted to architectural user tasks, such as navigation or annotations. The interface relies on a novel stroke-based interaction supported by simple laser pointers as input devices for large-scale displays. Furthermore, input devices such as speech and body tracking allow IMMIView to support multiple users. Moreover, they allow each user to select different modalities according to their preference and modality adequacy for the user task. We present a multi-modal fusion system developed to support multi-modal commands on a collaborative, co-located, environment, i.e. with two or more users interacting at the same time, on the same system. The multi-modal fusion system listens to inputs from all the IMMIView modules in order to model user actions and issue commands. The multiple modalities are fused based on a simple rule-based sub-module developed in IMMIView and presented in this paper. User evaluation performed over IMMIView is presented. The results show that users feel comfortable with the system and suggest that users prefer the multi-modal approach to more conventional interactions, such as mouse and menus, for the architectural tasks presented.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available