期刊
SENSORS
卷 21, 期 9, 页码 -出版社
MDPI
DOI: 10.3390/s21093208
关键词
visual servo; omni-directional mobile robot; Kalman filter; deep learning applications
资金
- Ministry of Science and Technology of Taiwan [MOST 103-2221-E-006-184]
This research developed a system to catch thrown balls using an omni-directional wheeled mobile robot and image processing system. The dynamic stereo vision camera tracked the ball's movement, while a Kalman filter with deep learning was used to estimate the ball's position and velocity, successfully predicting its future trajectory. The system's performance was verified through numerical simulation and experimental validation.
The ball-catching system examined in this research, which was composed of an omni-directional wheeled mobile robot and an image processing system that included a dynamic stereo vision camera and a static camera, was used to capture a thrown ball. The thrown ball was tracked by the dynamic stereo vision camera, and the omni-directional wheeled mobile robot was navigated through the static camera. A Kalman filter with deep learning was used to decrease the visual measurement noises and to estimate the ball's position and velocity. The ball's future trajectory and landing point was predicted by estimating its position and velocity. Feedback linearization was used to linearize the omni-directional wheeled mobile robot model and was then combined with a proportional-integral-derivative (PID) controller. The visual tracking algorithm was initially simulated numerically, and then the performance of the designed system was verified experimentally. We verified that the designed system was able to precisely catch a thrown ball.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据