期刊
AUTONOMOUS ROBOTS
卷 46, 期 1, 页码 175-199出版社
SPRINGER
DOI: 10.1007/s10514-021-10001-0
关键词
Deformable object manipulation; Model-based reinforcement learning; Self-supervised learning
资金
- NSF National Robotics Initiative [1734633]
- Siemens
- Amazon Robotics
- Toyota Research Institute
- Autodesk
- ABB
- Samsung
- Knapp
- Loccioni
- Intel
- Comcast
- Cisco
- Hewlett-Packard
- PhotoNeo
- NVidia
- Intuitive Surgical
- Graduate Fellowships for STEM Diversity
- NSF GRFP
Robotic fabric manipulation has applications in various fields, but existing techniques are often task-specific and hard to generalize. Researchers leverage the Visual Foresight framework to efficiently reuse learned fabric dynamics for different sequential fabric manipulation tasks.
Robotic fabric manipulation has applications in home robotics, textiles, senior care and surgery. Existing fabric manipulation techniques, however, are designed for specific tasks, making it difficult to generalize across different but related tasks. We build upon the Visual Foresight framework to learn fabric dynamics that can be efficiently reused to accomplish different sequential fabric manipulation tasks with a single goal-conditioned policy. We extend our earlier work on VisuoSpatial Foresight (VSF), which learns visual dynamics on domain randomized RGB images and depth maps simultaneously and completely in simulation. In this earlier work, we evaluated VSF on multi-step fabric smoothing and folding tasks against 5 baseline methods in simulation and on the da Vinci Research Kit surgical robot without any demonstrations at train or test time. A key finding was that depth sensing significantly improves performance: RGBD data yields an 80% improvement in fabric folding success rate in simulation over pure RGB data. In this work, we vary 4 components of VSF, including data generation, visual dynamics model, cost function, and optimization procedure. Results suggest that training visual dynamics models using longer, corner-based actions can improve the efficiency of fabric folding by 76% and enable a physical sequential fabric folding task that VSF could not previously perform with 90% reliability. Code, data, videos, and supplementarymaterial are available at https://sites.google.com/ view/ fabric- vsf/.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据