Video 01 · 4× playback
Mug → plate
“Please pick up the mug and place it on the plate on the wooden table.”
Download 4× videoLanguage-guided tasks
Cross-room dynamic pick-and-place
The robot explores each house from a language instruction. The target is moved after the robot first finds it. The robot then updates its memory, finds the object again, and delivers it to the requested plate or bowl.
How to read the videos. Left: external simulator view. Upper right: current head-camera observation. Lower right: observed semantic memory and navigation map; blue shows traveled motion and green shows the planned A* route. Videos play at 4× speed; the clock shows simulation time.
Video 02 · 4× playback
Mug → plate
“Please pick up the mug and place it on the plate on the wooden table.”
Download 4× videoVideo 03 · 4× playback
Egg → plate
“Please pick up the egg and place it on the plate on the wooden table.”
Download 4× videoVideo 04 · 4× playback
Mug → plate
“Please pick up the mug and place it on the plate on the wooden table.”
Download 4× videoVideo 05 · 4× playback
Bread → plate
“Please pick up the bread and put it on the plate on the white table.”
Download 4× videoVideo 06 · 4× playback
Egg → plate
“Please pick up the egg and place it on the plate on the wooden table.”
Download 4× videoVideo 07 · 4× playback
Egg → bowl
“Please pick up the egg and put it in the bowl on the white table.”
Download 4× videoVideo 08 · 4× playback
Egg → bowl
“Please pick up the egg and put it in the bowl on the white table.”
Download 4× videoVideo 09 · 4× playback
Tomato → bowl
“Please pick up the tomato and put it in the bowl on the white table.”
Download 4× videoVideo 10 · 4× playback
Bread → plate
“Please pick up the bread and put it on the plate on the white table.”
Download 4× video