Dataset

We open-source all data corresponding to the 80-task and 30-task datasets used in our multi-task experiments. They can be downloaded below. The two datasets contain 545M and 345M transitions, respectively.

Overview

We release two multi-task datasets with data from 80 and 30 tasks, respectively. The datasets are summarized below.

Domains Tasks Embodiments Episodes Transitions Size Link

DMControl + Meta-World
80 12 2.69M 545M 34GB Download

DMControl
30 11 690k 345M 20GB Download

These datasets are obtained from the replay buffers of 240 single-task TD-MPC2 agents, and thus contain a wide variety of behaviors ranging from random to expert policies. Multi-task agents trained on the above datasets, as well as checkpoints for each of the single-task agents, are available here.

Tasks

We list all 80 tasks in the dataset below, along with TD-MPC2 policy visualizations and summary statistics.

Task Observation Action
Acrobot Swingup 6 1
Cartpole Balance 5 1
Cartpole Balance Sparse 5 1
Cartpole Swingup 5 1
Cartpole Swingup Sparse 5 1
Cheetah Jump 17 6
Cheetah Run 17 6
Cheetah Run Back 17 6
Cheetah Run Backwards 17 6
Cheetah Run Front 17 6
Cup Catch 8 2
Cup Spin 8 2
Finger Spin 9 2
Finger Turn Easy 12 2
Finger Turn Hard 12 2
Fish Swim 24 5
Hopper Hop 15 4
Hopper Hop Backwards 15 4
Hopper Stand 15 4
Pendulum Spin 3 1
Pendulum Swingup 3 1
Reacher Easy 6 2
Reacher Hard 6 2
Reacher Three Easy 8 3
Reacher Three Hard 8 3
Walker Run 24 6
Walker Run Backwards 24 6
Walker Stand 24 6
Walker Walk 24 6
Walker Walk Backwards 24 6
Assembly 39 4
Basketball 39 4
Bin picking 39 4
Box Close 39 4
Button Press 39 4
Button Press Topdown 39 4
Button Press Topdown Wall 39 4
Button Press Wall 39 4
Coffee Button 39 4
Coffee Pull 39 4
Coffee Push 39 4
Dial Turn 39 4
Disassemble 39 4
Door Close 39 4
Door Lock 39 4
Door Open 39 4
Door Unlock 39 4
Drawer Close 39 4
Drawer Open 39 4
Faucet Close 39 4
Faucet Open 39 4
Hammer 39 4
Hand Insert 39 4
Handle Press 39 4
Handle Press Side 39 4
Handle Pull 39 4
Handle Pull Side 39 4
Lever pull 39 4
Peg Insert Side 39 4
Peg Unplug Side 39 4
Pick Out of Hole 39 4
Pick Place 39 4
Pick Place Wall 39 4
Plate Slide 39 4
Plate Slide Back 39 4
Plate Slide Back Side 39 4
Plate Slide Side 39 4
Push 39 4
Push Back 39 4
Push Wall 39 4
Reach 39 4
Reach Wall 39 4
Shelf Place 39 4
Soccer 39 4
Stick Pull 39 4
Stick Push 39 4
Sweep 39 4
Sweep Into 39 4
Window Close 39 4
Window Open 39 4