Teleoperation of a robot manipulator using a vision-based human-robot interface

Remote teleoperation of a robot manipulator by a human operator is often necessary in unstructured dynamic environments when human presence at the robot site is undesirable. Mechanical and other contacting interfaces used in teleoperation require unnatural human motions for object manipulation tasks or they may hinder human motion. Previous vision-based approaches have used only a few degrees of freedom for hand motion and have required hand motions that are unnatural for object manipulation tasks. This paper presents a noncontacting vision-based method of robot teleoperation that allows a human operator to communicate simultaneous six-degree-of-freedom, motion tasks to a robot manipulator by having the operator perform the three-dimensional human hand-arm motion that would naturally be used to complete an object manipulation task. A vision-based human-robot interface is used for communication of human motion to the robot and for feedback of the robot motion and environment to the human operator. Teleoperation under operator position control was performed with high accuracy in object placement on a target. Serni-autonomous traded and shared control using robot-vision guidance aided in achieving a more accurate positioning and orientation of the end-effector for object gripping tasks.