What Matters in Language Conditioned Robotic Imitation Learning Over Unstructured Data

Summary: This article presents an open-source simulated benchmark called CALVIN, which is used to learn long-horizon tasks. CALVIN tasks are more complex and support flexible specification of sensor suites. Evaluation of the agents shows that a baseline model based on multi-context imitation learning performs poorly on CALVIN.