Journal
IEEE TRANSACTIONS ON MOBILE COMPUTING
Volume 16, Issue 3, Pages 872-885Publisher
IEEE COMPUTER SOC
DOI: 10.1109/TMC.2016.2567378
Keywords
Augmented reality; wearable computers; user interfaces; human computer interaction; mobile computing
Funding
- General Research Fund from Research Grants Council of Hong Kong [26211515]
- Innovation and Technology Fund from HongKong Innovation and Technology Commission [ITS/369/14FP]
Ask authors/readers for more resources
We describe a new set of interaction techniques that allow users to interact with physical objects through augmented reality (AR). Previously, to operate a smart device, physical touch is generally needed and a graphical interface is normally involved. These become limitations and prevent the user from operating a device out of reach or operating multiple devices at once. Ubii (Ubiquitous interface and interaction) is an integrated interface system that connects a network of smart devices together, and allows users to interact with the physical objects using hand gestures. The user wears a smart glass which displays the user interface in an augmented reality view. Hand gestures are captured by the smart glass, and upon recognizing the right gesture input, Ubii will communicate with the connected smart devices to complete the designated operations. Ubii supports common inter-device operations such as file transfer, printing, projecting, as well as device pairing. To improve the overall performance of the system, we implement computation offloading to perform the image processing computation. Our user test shows that Ubii is easy to use and more intuitive than traditional user interfaces. Ubii shortens the operation time on various tasks involving operating physical devices. The novel interaction paradigm attains a seamless interaction between the physical and digital worlds.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available