Journal
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
Volume 27, Issue 11, Pages 4140-4149Publisher
IEEE COMPUTER SOC
DOI: 10.1109/TVCG.2021.3106494
Keywords
Keyboards; Biological system modeling; Task analysis; Reinforcement learning; Computational modeling; Solid modeling; Biomechanics; Reinforcement learning; virtual reality; user model
Categories
Funding
- EPSRC [EP/S027432/1]
- EPSRC [EP/S027432/1] Funding Source: UKRI
Ask authors/readers for more resources
The study shows that reinforcement learning can simulate user behavior in complex interaction tasks, especially in the use of virtual keyboards. The reinforcement learning model can effectively replicate high-level human typing behavior. This approach has the potential to replace or enhance human testing in the validation and development of virtual keyboards.
Accurately modelling user behaviour has the potential to significantly improve the quality of human-computer interaction. Traditionally, these models are carefully hand-crafted to approximate specific aspects of well-documented user behaviour. This limits their availability in virtual and augmented reality where user behaviour is often not yet well understood. Recent efforts have demonstrated that reinforcement learning can approximate human behaviour during simple goal-oriented reaching tasks. We build on these efforts and demonstrate that reinforcement learning can also approximate user behaviour in a complex mid-air interaction task: typing on a virtual keyboard. We present the first reinforcement learning-based user model for mid-air and surface-aligned typing on a virtual keyboard. Our model is shown to replicate high-level human typing behaviour. We demonstrate that this approach may be used to augment or replace human testing during the validation and development of virtual keyboards.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available