Legs as Manipulator: Pushing Quadrupedal Agility Beyond Locomotion
Webpage:
Authors: Xuxin Cheng, Ashish Kumar, Deepak Pathak
Published at ICRA 2023
Locomotion has seen dramatic progress for walking or running across challenging terrains. However, robotic quadrupeds are still far behind their biological counterparts, such as dogs, which display a variety of agile skills and can use the legs beyond locomotion to perform several basic manipulation tasks like interacting with objects and climbing. In this paper, we take a step towards bridging this gap by training quadruped robots not only to walk but also to use the front legs to climb walls, press buttons, and perform object interaction in the real world. To handle this challenging optimization, we decouple the skill learning broadly into locomotion, which involves anything that involves movement whether via walking or climbing a wall, and manipulation, which involves using one leg to interact while balancing on the other three legs. These skills are trained in simulation using curriculum and transferred to the real world using our proposed sim2real variant that builds upon recent locomotion success. Finally, we combine these skills into a robust long-term plan by learning a behavior tree that encodes a high-level task hierarchy from one clean expert demonstration. We evaluate our method in both simulation and real-world showing successful executions of both short as well as long-range tasks and how robustness helps confront external perturbations.
3 views
104
50
3 days ago 00:05:21 1
FELLOWSHIP - Dawnbreaker (Official Video)
3 days ago 00:03:58 1
Ed Sheeran - Shivers [Official Video]
4 days ago 00:04:51 1
Rammstein - Radio (Official Video)
4 days ago 00:08:39 1
V Rising - BRUTAL Adam the Firstborn | No Hit, 10 Levels Lower, Frail | 1.0 Boss Kill
4 days ago 00:01:27 1
9MM x LOLI SHIGURE UI
4 days ago 00:00:30 1
Please Have Feelings for Međź’• #tiktok #beautiful #shorts
4 days ago 00:08:38 1
Friendly Highlights | Sligo Rovers 2-3 Celtic | Celts win in return to Ireland! 🟢⚪
4 days ago 00:28:01 1
MAIS QUI CONTRÔLE LES FACT CHECKEURS ?!
4 days ago 00:19:29 1
Top 50 Brutal Knockouts September 2024 #12 (MMA•Muay Thai•Boxing•Kun Khmer)
4 days ago 00:04:41 1
Rammstein - Ausländer (Official Video)
4 days ago 00:38:47 1
Wacky Races (NES) Playthrough
4 days ago 00:03:28 1
Me! | Noodle & Pals | Songs For Children
4 days ago 00:04:30 1
“Varyag“ — English subs and translation
4 days ago 00:00:00 1
Capturing Evidence of UFOs at Project Hessdalen Norway Ep 6
5 days ago 00:20:53 1
The Strange History of TYPE O NEGATIVE (they would be canceled)
5 days ago 00:19:01 1
DIY Miniature Cardboard House of Baba Yaga | Paper craft tutorial
5 days ago 00:39:21 1
So MUCH Work and SO Year Old White Oak Desk Restoration!
5 days ago 00:20:08 1
Standing Workout To Lose Weight As EASY as 2 WEEKS For Men
5 days ago 01:06:40 1
“THE MAN WHO BELONGED IN NEITHER HEAVEN NOR HELL” and More Strange Stories! #WeirdDarkness
5 days ago 00:04:17 1
. The Idol Official Music Video
5 days ago 00:32:59 1
Israel usa tropas da ONU como escudos humanos no LĂbano!
6 days ago 00:41:13 1
30 Min FULL BODY Workout at Home with Dumbbells + Abs
6 days ago 01:03:52 1
Ultimate 60-Min HIIT Super-Combo Workout for Rapid Weight Loss & Total Body Toning 🔥
6 days ago 00:49:00 1
Listen until the end for a complete rebalancing of the 7 chakras • Cosmic Ocean