AME-2: Agile and Generalized Legged Locomotion via Attention-Based Neural Map Encoding Figure 1
arXiv preprint2026

AME-2: Agile and Generalized Legged Locomotion via Attention-Based Neural Map Encoding

Chong Zhang, Victor Klemm, Fan Yang, Marco Hutter

Robotic Systems Lab, ETH Zurich, Switzerland, Secure, Reliable, and Intelligent Systems Lab, ETH Zurich, Switzerland, ETH AI Center, Switzerland

四足机器人机器人学习足式机器人运动控制敏捷运动

针对足式机器人在遮挡、稀疏落脚点和未知地形中难以同时保持敏捷性与泛化性的问题,AME-2将注意力地图编码嵌入强化学习控制器,结合局部/全局高程特征与本体感知,并配套不确定性感知的学习式建图与在线仿真训练。实验在四足和双足机器人上验证了其在仿真与真实未见地形中的敏捷通过能力和泛化表现。

Dual-Horizon Hybrid Internal Model for Low-Gravity Quadrupedal Jumping with Hardware-in-the-Loop Validation Figure 1
arXiv preprint2026

Dual-Horizon Hybrid Internal Model for Low-Gravity Quadrupedal Jumping with Hardware-in-the-Loop Validation

Haozhe Xu, Yifei Zhao, Wenhao Feng, Zhipeng Wang, Hongrui Sang, Cheng Cheng, Xiuxian Li, Zhen Yin, Bin He

四足机器人机器人学习足式机器人硬件设计跳跃

面向月球低重力下飞行时间长、触地稀疏导致连续四足跳跃难稳定的问题,论文提出双时间尺度 Hybrid Internal Model:短窗估计快速竖直动力学与竖直速度,长窗捕捉跨跳跃周期的水平趋势和质心高度,并配合阶段自适应奖励。作者还构建 MATRIX 混合现实硬件在环平台,用配重卸载重力并实时映射虚拟月面地形,展示了机器人在类月坑洼地形上的连续跳跃。

Energy Prediction on Sloping Ground for Quadruped Robots Figure 1
arXiv preprint2026

Energy Prediction on Sloping Ground for Quadruped Robots

Mohamed Ounally, Cyrille Pierre, Johann Laconte

四足机器人机器人学习足式机器人地形感知能耗建模

面向户外四足机器人续航受坡地影响、传统规划缺少实测能耗代价的问题,论文用商用四足的标准机载传感器标定一个仅依赖坡度与相对航向的紧凑能耗模型,可生成方向相关能量图用于路径级评估。野外实验显示等效力成本随坡角近似线性变化,横向行走成本更高,分段轨迹能耗近似可加,但跨速度、步态和平台的泛化仍待验证。

Jumping Control for a Quadrupedal Wheeled-Legged Robot via NMPC and DE Optimization Figure 1
arXiv preprint2026

Jumping Control for a Quadrupedal Wheeled-Legged Robot via NMPC and DE Optimization

Xuanqi Zeng, Lingwei Zhang, Linzhu Yue, Zhitao Song, Hongbo Zhang, Tianlin Zhang, Yun-Hui Liu

四足机器人机器人学习足式机器人跳跃轮足运动

面向轮足四足机器人因车轮额外自由度而难以实现动态跳跃的问题,论文设计小型轮足平台,并将基于质心动力学的 NMPC 用于助跑/速度准备,结合差分进化优化起跳阶段输入,利用轮式运动提升跳跃能力。仿真与实机验证了垂直跳、前跳和后空翻等动作,其中实机可越过 0.12 m 障碍并实现 0.5 m 垂直跳。

Learning Quadrupedal Locomotion for a Heavy Hydraulic Robot Using an Actuator Model Figure 1
arXiv preprint2026

Learning Quadrupedal Locomotion for a Heavy Hydraulic Robot Using an Actuator Model

Jin Tak, Jeong Hyun

Robotics and Artificial Intelligence Lab, KAIST, Daejeon, South Korea, Robotics Team, HYUNDAI Rotem, Uiwang, Gyeonggi-do, South Korea, Hydraulic Robot Laboratory, Human-Centric Robotics R&D Department, Korea Institue of Industrial Technology, Ansan, Gyeonggi-do, South Korea, Hydraulic Robot Laboratory, Human-Centric Robotics R&D Department, Korea Institue of Industrial Technology, Ansan, Gyeonggi-do, So

四足机器人机器人学习足式机器人运动控制硬件设计

针对重型液压四足因响应慢、流体耦合复杂而难以做强化学习 sim-to-real 的问题,论文将液压动力学简化为解析执行器模型,用少量实机行走数据拟合即可在微秒级预测 12 个关节力矩,并显式处理阻尼与冲击项。基于该模型训练的策略成功部署到 300kg 级液压四足,实现稳定指令跟踪和约 1m/s 行走,优于数据受限下的神经网络执行器模型。

MLM: Learning Multi-Task Loco-Manipulation Whole-Body Control for Quadruped Robot With Arm Figure 1
IEEE RA-L 20252026

MLM: Learning Multi-Task Loco-Manipulation Whole-Body Control for Quadruped Robot With Arm

Xin Liu, Bida Ma, Chenkun Qi, Yan Ding, Nuo Xu, Guorong Zhang, Pengan Chen, Kehui Liu, Zhongjie Jia, Chuyue Guan, Yule Mo, Jiaqi Liu, Feng Gao, Jiangwei Zhong, Bin Zhao, Xuelong Li

Jiangwei Zhong is with Lenovo Corporation, Shanghai, 201203, China, Xuelong Li is with Institute of Artificial Intelligence (TeleAI), China Telecom, Shanghai, 200233, China

四足机器人机器人学习足式机器人操作全身控制

面向带机械臂四足机器人难以用单一策略兼顾行走与多任务操作的问题,MLM将真实末端轨迹库引入仿真强化学习,用自适应课程采样平衡不同任务,并通过轨迹-速度预测网络在仅有历史观测的遥操作场景中补全未来运动线索。仿真消融验证这些设计有效,Go2+Airbot实机实现零样本迁移并完成多任务全身移动操作。

No Figure
IEEE RA-L 20262026

Reinforcement Learning for Robust Climbing Locomotion With Rope-Driven Legged Robot

Jihong Kim, Joonhyuk Kwon, Jihaeng Lee, Hwa Soo Kim, TaeWon Seo

School of Mechanical Engineering, Hanyang University, Seoul, South Korea, Hanyang University, Department of Mechanical System Design, Kyonggi University, Suwon, South Korea, Kyonggi University

四足机器人机器人学习足式机器人强化学习运动控制

全文短总结尚未生成。

No Figure
IEEE RA-L 20252026

START: Traversing Sparse Footholds With Terrain Reconstruction

Ruiqi Yu, Qianshi Wang, Hongyi Li, Zheng Jun, Zhicheng Wang, Jun Wu, Qiuguo Zhu

Institute of Cyber-Systems and Control, Zhejiang University, Hangzhou, China, Zhejiang University, MARMoT Lab, National University of Singapore, Singapore, National University of Singapore

四足机器人机器人学习地形感知

全文短总结尚未生成。

Teaching Robots Like Dogs: Learning Agile Navigation from Luring, Gesture, and Speech Figure 1
arXiv preprint2026

Teaching Robots Like Dogs: Learning Agile Navigation from Luring, Gesture, and Speech

Taerim Yoon, Dongho Kang, Jin Cheng, Fatemeh Zargarbashi, Yijiang Huang, Minsung Ahn, Stelian Coros, Sungjoon Choi

四足机器人机器人学习导航敏捷运动

这篇工作针对四足机器人仍依赖手柄、键盘等低自然度接口的问题,提出 LURE:像训犬“诱导”一样用教杆少量物理示教,并结合手势与语音控制;再在物理仿真中重建交互场景、聚合数据,并用 progressive goal cueing 缓解少样本带来的分布偏移。真实六类敏捷导航任务中,系统用总计少于 1 小时示教达到 97.15% 成功率。

Adaptive Non-linear Centroidal MPC with Stability Guarantees for Robust Locomotion of Legged Robots Figure 1
IEEE RA-L 20252025

Adaptive Non-linear Centroidal MPC with Stability Guarantees for Robust Locomotion of Legged Robots

Mohamed Elobaid, Giulio Turrisi, Lorenzo Rapetti, Giulio Romualdi, Stefano Dafarra, Tomohiro Kawakami, Tomohiro Chaki, Takahide Yoshiike, Claudio Semini, Daniele Pucci

Frontier Robotics, Innovative Research Excellence; Honda R&D, Saitama, Japan, Machine Learning and Optimisation, The University of Manchester, Manchester, United Kingdom

四足机器人机器人学习足式机器人全身控制运动控制

面向足式机器人在推搡、载荷等持续/未知扰动下缺少可证明稳定性的质心MPC问题,本文将受扰质心动量动力学视为参数纯反馈形式,引入自适应律与CLF稳定约束,并嵌入非线性MPC以保留摩擦锥和接触约束。实验在ergoCub人形与Aliengo四足上验证了对常值未测扰动的鲁棒行走,代码开源。

ADEPT: Adaptive Diffusion Environment for Policy Transfer Sim-to-Real Figure 1
arXiv preprint2025

ADEPT: Adaptive Diffusion Environment for Policy Transfer Sim-to-Real

Youwei Yu, Junhong Xu, Lantao Liu

Indiana University Bloomington, USA

四足机器人机器人学习仿真到现实仿真基准运动生成

面向野外/越野导航中强化学习策略依赖仿真环境多样性、而手工程序化地形真实度和覆盖度有限的问题,ADEPT用扩散模型按当前策略表现自适应生成训练环境,通过优化初始噪声在“相似但更难”和“更具新颖性”之间调节,并引入多层地图与立体视觉噪声仿真。实验显示其训练的四足导航策略比程序化或自然环境训练及多种导航基线收敛更快、泛化和零样本实机迁移表现更好。

Benchmarking Different QP Formulations and Solvers for Dynamic Quadrupedal Walking Figure 1
arXiv preprint2025

Benchmarking Different QP Formulations and Solvers for Dynamic Quadrupedal Walking

Franek Stark, Jakob Middelberg, Dennis Mronga, Shubham Vyas, Frank Kirchner

四足机器人机器人学习足式机器人运动控制仿真基准

面向四足机器人动态行走中 MPC/WBC 依赖 QP 且求解器、稠密/稀疏建模与硬件选择成本高的问题,论文在 Unitree Go2 控制框架下系统比较稀疏、部分凝聚、全凝聚 MPC QP 及多类求解器,并提出每瓦求解频率 SFPW 评估能效。结果给出不同 x86/ARM 平台上 formulation–solver 组合的选型建议,同时指出未来优化应更关注功耗约束下的板载实时求解效率。

Bipedalism for Quadrupedal Robots: Versatile Loco-Manipulation through Risk-Adaptive Reinforcement Learning Figure 1
arXiv preprint2025

Bipedalism for Quadrupedal Robots: Versatile Loco-Manipulation through Risk-Adaptive Reinforcement Learning

Yuyou Zhang, Radu Corcodel, Ding Zhao

Department of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, PA USA, Mitsubishi Electric Research Labs (MERL), Cambridge, MA USA

四足机器人机器人学习足式机器人强化学习操作

针对四足机器人加装机械臂会增加负载与复杂度、用单腿操作又削弱运动能力的问题,本文让四足机器人以后腿双足行走来释放前腿,并用基于回报分布不确定性的风险自适应强化学习在保守性与性能间动态权衡。仿真中优于基线,Unitree Go2 实机完成推车、探障和载物等操作,显示一定抗扰与泛化能力。

Bridging the Sim-to-Real Gap for Athletic Loco-Manipulation Figure 1
Preprint2025

Bridging the Sim-to-Real Gap for Athletic Loco-Manipulation

Nolan Fey, Gabriel Margolis, Pulkit Agrawal

Improbable AI Lab Massachusetts Institute of Technology , Cambridge , MA, Massachusetts Institute of Technology

四足机器人机器人学习操作仿真到现实敏捷运动

本文针对四足机械臂在投掷、举重、拖拽等敏捷操作中仅靠任务奖励易奖励黑客、仅跟踪参考又限制性能的问题,提出先用真实关节编码器数据训练无需力矩传感的 UAN 修正仿真执行器动力学,再以参考轨迹作探索提示进行预训练与任务微调。实验在 Unitree B2+Z1 Pro 上表明,该流程比默认仿真等更贴近真实轨迹,并能将动态全身操作较稳定迁移到实机。

CAIMAN: Causal Action Influence Detection for Sample Efficient Loco-manipulation Figure 1
arXiv preprint2025

CAIMAN: Causal Action Influence Detection for Sample Efficient Loco-manipulation

Núria Armengol

Department of Mechanical and Process Engineering, ETH Zurich, Switzerland, Department of Computer Science

四足机器人机器人学习操作

面向四足机器人非抓取式整身推物,论文针对稀疏奖励下探索困难和奖励塑形繁琐的问题,提出 CAIMAN:用因果动作影响作为内在奖励,引导机器人学习“控制”环境物体,并以运动学先验加残差动力学估计该影响。实验显示其在单物体、绕墙和多障碍推物中较启发式、RND 等基线更省样本且成功率更高,并可零微调迁移到真实四足机器人。

Disturbance-Aware Adaptive Compensation in Hybrid Force-Position Locomotion Policy for Legged Robots Figure 1
arXiv preprint2025

Disturbance-Aware Adaptive Compensation in Hybrid Force-Position Locomotion Policy for Legged Robots

Yang Zhang, Buqing Nie, Zhanxiang Cao, Yangqing Fu, Yue Gao

Yang Zhang is with Department of Automation, Shanghai Jiao Tong University, Shanghai, P

四足机器人机器人学习足式机器人运动控制

针对强化学习足式运动策略在真实部署中对载荷变化和外力扰动敏感的问题,论文将动作空间从单一关节位置扩展为位置与前馈力矩的混合控制,并引入基于扰动估计的 DAAC 力矩补偿,使策略能更直接地响应动力学变化。在 Unitree Go2 的仿真与实机粗糙地形实验中,该方法提升了承载能力和抗推扰稳定性,但理论稳定性保证仍未充分说明。

FACET: Force-Adaptive Control via Impedance Reference Tracking for Legged Robots Figure 1
arXiv preprint2025

FACET: Force-Adaptive Control via Impedance Reference Tracking for Legged Robots

Botian Xu, Haoyang Weng, Qingzhou Lu, Yang Gao, Huazhe Xu

Tsinghua University, Shanghai Qizhi Institute, Shanghai AI Lab

四足机器人机器人学习足式机器人

FACET针对足式机器人RL控制常忽略外力、表现僵硬且交互不安全的问题,将阻抗控制思想嵌入学习框架:用虚拟质-弹-阻尼参考模型在质心空间生成位置/速度目标,并把期望位置与弹簧阻尼增益作为接口调节顺应性。实验显示其在四足机上可承受最高200 Ns冲量、碰撞冲量降低约80%,实机可被动牵引并拖动约自重2/3负载,且可扩展到人形和腿臂系统。

Floating-Base Deep Lagrangian Networks Figure 1
arXiv preprint2025

Floating-Base Deep Lagrangian Networks

Juliano Decico, Vivian Suzano

Department of Computer Science, Technical University of Darmstadt, Germany, Mobile Robotics Group, São Carlos School of, Engineering, University of São Paulo (EESC-USP), Brazil, Dynamic Legged Systems Lab, Istituto Italiano di, German Research Center for AI (DFKI), Research Department: Systems AI for Robot Learning, Robotics Institute Germany (RIG)

四足机器人机器人学习

针对四足/人形等浮动基机器人中现有灰盒动力学模型忽略惯性矩阵稀疏性、输入独立性与复合空间惯量物理约束的问题,论文提出基于重排 Cholesky 分解的惯性参数化,并构建 FeLaN 将其嵌入 DeLaN 式拉格朗日学习。该方法仅需运动链先验,在仿真与 Unitree Go2、Spot、Talos、HyQReal2 等真实机器人数据上整体优于多种基线,同时提供更可解释的物理一致模型。

Generating Diverse Challenging Terrains for Legged Robots Using Quality-Diversity Algorithm Figure 1
arXiv preprint2025

Generating Diverse Challenging Terrains for Legged Robots Using Quality-Diversity Algorithm

Arthur Esquerre-Pourtère, Minsoo Kim, Jaeheung Park

Seoul National University of Science and Technology

四足机器人机器人学习足式机器人地形感知

针对足式机器人在非结构化地形上的鲁棒性难以靠人工或手工地形充分暴露的问题,本文将挑战性地形生成表述为 Quality-Diversity 搜索:把控制器视为黑盒,用不同失败惩罚作为描述子,维护多样化高难地形档案。在双足与四足仿真中,该方法发现了多类预期外失效模式,生成地形还可用于继续训练并提升 RL 控制器表现,但真实可通行性与地形现实性仍未充分保证。

Learned Perceptive Forward Dynamics Model for Safe and Platform-aware Robotic Navigation Figure 1
arXiv preprint2025

Learned Perceptive Forward Dynamics Model for Safe and Platform-aware Robotic Navigation

Pascal Roth, Jonas Frey, Cesar Cadena, Marco Hutter

ETH Zurich NVIDIA Max Planck Institute for Intelligent Systems

四足机器人机器人学习世界模型安全恢复导航

针对四足机器人在复杂粗糙地形中依赖手工代价与简化动力学导致安全性和泛化不足的问题,本文学习带感知的前向动力学模型,用周围几何与本体历史预测未来状态和失效概率,并嵌入零样本 MPPI 规划以简化代价调参。ANYmal 实验显示位置预测平均提升 41%,粗糙仿真导航成功率提高 27%,且展示了仿真预训练结合真实数据微调的迁移效果。

Learning coordinated badminton skills for legged manipulators Figure 1
Science Robotics2025

Learning coordinated badminton skills for legged manipulators

Yuntao Ma, Andrei Cramariuc, Farbod Farshidian, Marco Hutter

Robotic Systems Lab, ETH Zurich, Zurich, Switzerland, Currently at Robotics and AI Institute, Broadway, Cambridge MA, USA

四足机器人机器人学习足式机器人

该文瞄准羽毛球这类动态运动中足式移动操作器难以同时兼顾快速步态、上肢击球与机载视觉跟踪的问题,提出统一的全身视觉运动强化学习策略,并把基于真实相机数据的感知噪声、羽毛球轨迹预测、约束RL和系统辨识纳入训练与部署。实验显示机器人可在不同环境中预测来球、覆盖发球区域并与人类对打完成较精准回击。

Learning Unified Force and Position Control for Legged Loco-Manipulation Figure 1
arXiv preprint2025

Learning Unified Force and Position Control for Legged Loco-Manipulation

Peiyuan Zhi, Peiyang Li, Jianqin Yin, Baoxiong Jia, Siyuan Huang

State Key Laboratory of General Artificial Intelligence, BIGAI, Joint Laboratory of Embodied AI and Humanoid Robots, BIGAI & UniTree Robotics

四足机器人机器人学习足式机器人操作

面向擦拭、开柜等接触丰富的足式移动操作,单纯位置控制缺少力信息且常无力传感器。论文用仿真中的位置/力命令与外力扰动训练统一强化学习策略,从历史本体状态估计接触力并调整位姿/速度,实现位置跟踪、施力、力跟踪和柔顺交互。该策略在四足机械臂与人形机器人上验证,并将估计力用于模仿学习,使多项真实接触任务成功率相对位置基线提升约39.5%。

LEVA: A high-mobility logistic vehicle with legged suspension Figure 1
arXiv preprint2025

LEVA: A high-mobility logistic vehicle with legged suspension

Ádám Gyula

Robotic Systems Lab, ETH Zürich, Zurich University of Applied Sciences

四足机器人机器人学习足式机器人

面向仓储外的农业、施工和救援等非结构化物流,论文提出LEVA轮腿式重载平台:用并联四杆腿作为主动悬挂,结合可转向轮、强化学习越阶/爬楼控制,以及面向EuroBox的自主取放机构,在效率和越障间折中。实验显示其可载约85 kg,通过30°坡、草地/碎石、15 cm障碍和楼梯;取放测试总体成功率86%、剔除系统故障后97.7%,平地运输CoT最低约0.15。

Load-bearing Assessment for Safe Locomotion of Quadruped Robots on Collapsing Terrain Figure 1
IEEE RA-L 20252025

Load-bearing Assessment for Safe Locomotion of Quadruped Robots on Collapsing Terrain

Vivian S. Medeiros, Giovanni B. Dessy, Thiago Boaventura, Marcelo Becker, Claudio Semini, Victor Barasuol

Dynamic Legged Systems Lab, Istituto Italiano di Tecnologia (IIT), Genova, Italy, Italian Institute of Technology, Institute of Mathematics and Computer Science

四足机器人机器人学习足式机器人安全恢复运动控制

面向搜救、星球探测中外观平坦但可能承载不足的塌陷地形,本文让四足机器人先“试踩”再落足:由轨迹优化计算各腿所需地面反力包络,结合关节测量判断塌陷,无需足端力传感器或机械臂;MPC在支撑多边形稳定性与探测约束间权衡,状态机负责换落脚点和恢复。实验证明其可通过自制塌陷平台和岩石地形,并在有/无高程图条件下维持稳定、降低跌倒风险。

LocoTouch: Learning Dexterous Quadrupedal Transport with Tactile Sensing Figure 1
arXiv preprint2025

LocoTouch: Learning Dexterous Quadrupedal Transport with Tactile Sensing

Yuxin Ray

Carnegie Mellon University, University of Washington, Google DeepMind

四足机器人机器人学习足式机器人操作

针对四足机器人难以在持续动态接触中搬运未固定物体的问题,LocoTouch在机背布置221单元分布式触觉传感器,并用高保真触觉仿真、教师-学生两阶段学习和自适应步态奖励训练控制策略。该策略可零样本迁移到真实机器人,搬运不同尺寸、重量和材质的圆柱物体,在长距离、崎岖地面和强扰动下仍保持鲁棒。

Long-horizon Locomotion and Manipulation on a Quadrupedal Robot with Large Language Models Figure 1
arXiv preprint2025

Long-horizon Locomotion and Manipulation on a Quadrupedal Robot with Large Language Models

Yutao Ouyang, Jinhan Li, Yunfei Li, Zhongyu Li, Chao Yu, Koushil Sreenath, Yi Wu

Tsinghua University, Beijing, China, Shanghai Qi Zhi Institute, Shanghai, China, University of California, Berkeley, CA, USA

四足机器人机器人学习足式机器人操作运动控制

这篇论文针对四足机器人难以把单一运动/操作技能组合成长期任务的问题,提出分层系统:上层用多个 LLM 代理分别做语义规划、连续参数估计、代码生成与失败重规划,下层用强化学习训练行走、攀爬、双足操作等技能。系统在关灯、送包裹、搭桥、乘电梯等任务中实现十步以上技能链,仿真成功率超过 70%,并完成真实机器人部署。

MoRE: Unlocking Scalability in Reinforcement Learning for Quadruped Vision-Language-Action Models Figure 1
ICRA 20252025

MoRE: Unlocking Scalability in Reinforcement Learning for Quadruped Vision-Language-Action Models

Han Zhao, Wenxuan Song, Donglin Wang, Xinyang Tong, Pengxiang Ding, Xuelian Cheng, Zongyuan Ge

Zhejiang University, China, MiLAB, Westlake University, China, AIM Lab, Faculty of IT, Monash University, Australia, HKUST(GZ), China

四足机器人机器人学习足式机器人强化学习视觉语言动作

面向四足机器人在开放场景中按视觉与语言指令执行多技能任务时,传统 VLA 依赖专家模仿数据且难利用失败轨迹。MoRE 将多个 LoRA 作为稀疏激活机器人专家嵌入 MLLM,并把 VLA 训练为 Q 函数以吸收自动采集的混合质量数据。实验显示其在六类技能、OOD 场景和真实机器人上优于基线,但增益可能同时来自架构、RL 目标与数据规模。

MuJoCo Playground Figure 1
arXiv preprint2025

MuJoCo Playground

Jing Yuan

UC Berkeley Google DeepMind University of Toronto University of Cambridge

四足机器人机器人学习仿真基准地形感知

面向强化学习机器人从仿真到真机迭代慢、视觉训练和部署链条割裂的问题,MuJoCo Playground基于MJX把GPU物理、Madrona批量渲染与可复现实验环境整合为开源框架,使单GPU分钟级训练和端到端像素策略成为常规流程。论文在四足、类人、灵巧手和机械臂等六类真机平台展示状态与视觉策略的零样本迁移,但视觉渲染部分仍处早期,JAX静态形状也限制接触密集场景扩展。

Multi-Quadruped Cooperative Object Transport: Learning Decentralized Pinch-Lift-Move Figure 1
arXiv preprint2025

Multi-Quadruped Cooperative Object Transport: Learning Decentralized Pinch-Lift-Move

Aayam Kumar

Collaborative Robotics and Intelligent Systems Institute (CoRIS), Oregon State University, Corvallis, Oregon, 97331, USA

四足机器人机器人学习足式机器人操作多机器人协作

面向大件或不可抓取物体超出单机器人负载的场景,论文提出 decPLM,让带机械臂四足机器人在无通信、无中心控制、无刚性连接下仅靠接触完成夹持、抬升和搬运。核心是分层解耦底盘与手臂控制,并用“星座”奖励促使机器人像刚性连接一样保持相对位姿与同步。仿真显示策略可从2机训练泛化到2–10机、多形状和质量载荷,并在轻量物体上实现一定 sim2real。

NaVILA: Legged Robot Vision-Language-Action Model for Navigation Figure 1
arXiv preprint2025

NaVILA: Legged Robot Vision-Language-Action Model for Navigation

An-Chieh Cheng, Yandong Ji, Zhaojing Yang, Zaitian Gongye, Xueyan Zou, Jan Kautz, Hongxu Yin, Sifei Liu, Xiaolong Wang

UC San Diego USC NVIDIA

四足机器人机器人学习足式机器人视觉语言动作导航

NaVILA面向足式机器人按自然语言在未知、杂乱环境中导航,核心动机是避免将VLM推理直接压到低层关节动作。它把VLA输出设计成“前进75cm、右转30度”等带空间信息的中层语言指令,再由视觉强化学习步态策略实时执行与避障,从而解耦推理和控制并便于跨机器人迁移。实验中其在经典VLN基准成功率提升超过17%,在VLN-CE-Isaac与真实Unitree等机器人上也优于盲策略,真实25条指令成功率达88%。

NIL: No-data Imitation Learning by Leveraging Pre-trained Video Diffusion Models Figure 1
arXiv preprint2025

NIL: No-data Imitation Learning by Leveraging Pre-trained Video Diffusion Models

Mert Albaba, Chenhao Li, Markos Diomataris, Omid Taheri, Andreas Krause, Michael Black

ETH Zürich, Max Planck Institute for Intelligent Systems

四足机器人机器人学习模仿学习运动生成

针对传统强化学习需手工奖励、模仿学习依赖难获取的3D专家数据,NIL尝试用预训练视频扩散模型生成2D参考视频替代采集数据,并通过视频Transformer嵌入距离与分割掩码IoU构造仿真中奖励,让策略在物理约束下学习运动。实验覆盖多种双足和四足机器人,显示其在若干行走任务上可达到或超过使用3D动捕示范的基线,但效果仍受生成视频质量影响。

Obstacle-Avoidant Leader Following with a Quadruped Robot Figure 1
arXiv preprint2025

Obstacle-Avoidant Leader Following with a Quadruped Robot

Carmen Scheidemann, Lennart Werner, Victor Reijgwart, Andrei Cramariuc, Joris Chomarat, Jia-Ruei Chiu, Roland Siegwart, Marco Hutter

Robotic Systems Lab, ETH Zürich,Autonomous Systems Lab,Switzerland

四足机器人机器人学习足式机器人

这篇论文面向工业和助行场景中“边走边遥控”负担过高的问题,将四足机器人跟随建模为虚拟牵引绳:融合自研 AoA 射频信标、RGB-D 相机与 LiDAR,并用 EKF 跟踪领航者,同时把 waverider 局部规划改造到足式平台以避让静态和动态障碍。系统在 ANYmal 上完成真实环境验证,展示了在人群、遮挡和窄通道中的跟随鲁棒性与可用性。

Omni-Perception: Omnidirectional Collision Avoidance for Legged Locomotion in Dynamic Environments Figure 1
arXiv preprint2025

Omni-Perception: Omnidirectional Collision Avoidance for Legged Locomotion in Dynamic Environments

Zifan Wang, Teli Ma, Yufei Jia, Xun Yang, Jiaming Zhou, Wenlong Ouyang, Qiang Zhang, Junwei Liang

The Hong Kong University of Science and Technology (Guangzhou), The Hong Kong University of Science and Technology, Department of Eletronic Engineering, Tsinghua University, Beijing Innovation Center of Humanoid Robotics Co., Ltd, Beijing Innovation Center of Humanoid Robotics Co

四足机器人机器人学习足式机器人安全恢复运动控制

针对足式机器人在动态三维环境中仅靠本体感知或深度相机难以处理空中障碍、地面陷阱和移动物体的问题,Omni-Perception 将原始时序 LiDAR 点云直接接入端到端强化学习控制,并用 PD-RiskNet 分层评估近远场风险,同时构建带噪声建模和快速 raycasting 的 LiDAR 仿真工具。仿真与实机实验显示其可实现全向避障和速度跟踪,优于依赖中间地图或有限视野感知的方法。

Parkour in the Wild: Learning a General and Extensible Agile Locomotion Policy Using Multi-expert Distillation and RL Fine-tuning Figure 1
arXiv preprint2025

Parkour in the Wild: Learning a General and Extensible Agile Locomotion Policy Using Multi-expert Distillation and RL Fine-tuning

Nikita Rudin, Junzhe He, Joshua Aurand, Marco Hutter

Robotic Systems Lab, ETH Zurich, NVIDIA Switzerland

四足机器人机器人学习强化学习运动控制敏捷运动

面向四足机器人在救援等非结构环境中难以复用单项敏捷技能、泛化到新地形的问题,论文将地形专家策略经 DAgger 多专家蒸馏成统一基础策略,再在包含真实 3D 扫描的多地形上强化学习微调,并支持反复加入新技能;深度图直接作为感知输入。结果显示其优于层级/潜变量等融合方式,可在 ANYmal D 上穿越未见碎石、废墟等复杂场景。

Physics-Based Motion Imitation with Adversarial Differential Discriminators Figure 1
SIGGRAPH Asia 20252025

Physics-Based Motion Imitation with Adversarial Differential Discriminators

Ziyu Zhang, Sergey Bashkirov, Dun Yang, Yi Shi, Michael Taylor, Xue Bin Peng

Simon Fraser University, Burnaby, Canada, Simon Fraser University, Sony Playstation, San Maeto, USA, Sony Corporation (United States), Simon Fraser University, Burnaby, Canada and NVIDIA, Vancouver, Canada

四足机器人机器人学习模仿学习

针对物理仿真角色/机器人运动模仿中手工奖励和多目标权重调参成本高、且对精确轨迹复现不足的问题,论文提出对抗式差分判别器 ADD,用各目标误差组成的差分向量替代加权和,并仅以零误差向量作正样本来动态聚合目标。实验显示,该方法可让仿真人形与机器人复现多种敏捷、杂技式动作,效果接近手工设计奖励的先进跟踪方法,同时减少奖励工程依赖。

Primal-Dual iLQR for GPU-Accelerated Learning and Control in Legged Robots Figure 1
IEEE RA-L 20252025

Primal-Dual iLQR for GPU-Accelerated Learning and Control in Legged Robots

Lorenzo Amatucci, João Sousa-Pinto, Giulio Turrisi, Dominique Orban, Victor Barasuol, Claudio Semini

Dynamic Legged Systems Laboratory, Istituto Italiano di Tecnologia (IIT), Genova, Italy, Italian Institute of Technology

四足机器人机器人学习足式机器人模型预测控制

面向足式机器人 MPC 在线求解受预测时域、状态维度和多机器人规模限制的问题,论文将 SQP/iLQR 的 primal-dual KKT 求解改写为可在 GPU 上做时间、状态与控制维并行的关联扫描,并以 JAX 实现。实验显示相对 acados、crocoddyl,WB-MPC 运行时间最多降约 60%,SRBD-MPC 在变长时域下最高提升约 700%,且 16 台腿式机器人集中控制可在 25 ms 内求解。

QUART-Online: Latency-Free Large Multimodal Language Model for Quadruped Robot Learning Figure 1
arXiv preprint2025

QUART-Online: Latency-Free Large Multimodal Language Model for Quadruped Robot Learning

Xinyang Tong, Pengxiang Ding, Yiguo Fan, Donglin Wang, Wenjie Zhang, Can Cui, Mingyang Sun, Han Zhao, Hongyin Zhang, Yonghao Dang, Siteng Huang, Shangke Lyu

MiLAB, Westlake University, Hangzhou, 310030, China, Zhejiang University, Hangzhou, 310027, China

四足机器人机器人学习足式机器人

面向四足机器人中 MLLM 端到端控制难以实时闭环的问题,论文指出简单剪枝/减参会破坏语言基础模型在动作指令微调后的泛化能力。QUART-Online 的核心是用动作块离散化将连续动作序列压缩为少量代表性 token,再解码成轨迹,从而不改模型结构地提高输出频率。实验在 QUARD 导航与全身操作任务上实现与底层控制器同步的 50Hz 推理,平均成功率提升 65%。

RAMBO: RL-augmented Model-based Whole-body Control for Loco-manipulation Figure 1
IEEE RA-L 20252025

RAMBO: RL-augmented Model-based Whole-body Control for Loco-manipulation

Jin Cheng, Dongho Kang, Gabriele Fadini, Guanya Shi, Stelian Coros

Computational Robotics Lab in the Department of Computer Science, ETH Zurich, Zurich, Switzerland

四足机器人机器人学习强化学习操作全身控制

面向腿式机器人移动操作中“末端/接触力精确控制”和“对模型误差鲁棒”难以兼得的问题,RAMBO将QP形式的模型式全身控制作为前馈力矩生成器,并让强化学习策略只学习反馈修正以补偿未建模扰动。论文在四足平台上验证了推购物车、托盘平衡、抓持软物等任务,覆盖四足与双足行走,显示其能在保持动态步态鲁棒性的同时提升末端跟踪与操作精度。

Real-Time Out-of-Distribution Failure Prevention via Multi-Modal Reasoning Figure 1
arXiv preprint2025

Real-Time Out-of-Distribution Failure Prevention via Multi-Modal Reasoning

Di Lillo

Stanford University , Swiss Re , NVIDIA Research

四足机器人机器人学习

面向开放环境中机器人遇到分布外场景时难以及时、安全回退的问题,论文提出 FORTRESS:把慢速多模态基础模型的语义推理前置,用于生成候选回退目标和语义危险代价,运行时再结合动力学规划快速避开不安全区域。实验显示其在合成数据和 ANYmal 真实数据上安全分类优于即时提示推理模型,并在仿真与四旋翼硬件城市导航中提升规划成功率和安全性。

Sampling-Based System Identification with Active Exploration for Legged Robot Sim2Real Learning Figure 1
arXiv preprint2025

Sampling-Based System Identification with Active Exploration for Legged Robot Sim2Real Learning

Nikhil Sobanbabu, Guanqi He, Tairan He, Yuxiang Yang, Guanya Shi

Carnegie Mellon University, Google DeepMind

四足机器人机器人学习足式机器人仿真到现实系统辨识

针对足式机器人强化学习策略因质量、惯量、摩擦和执行器等参数失配而难以高精度 sim2real 的问题,论文提出 SPI-Active:先用并行采样最小化真实/仿真轨迹状态误差做白盒系统辨识,再通过最大化 Fisher 信息来优化预训练多行为策略的指令序列,主动采集更有辨识力的数据;在 Unitree Go2 和 G1 的跳跃、绕杆等真实任务中,相比域随机化和常规辨识基线提升约 42–63%。

Spatio-Temporal Motion Retargeting for Quadruped Robots Figure 1
T-RO 20252024

Spatio-Temporal Motion Retargeting for Quadruped Robots

Taerim Yoon, Dongho Kang, Seungmin Kim, Jin Cheng, Min Sung Ahn, Stelian Coros, Sungjoon Choi

RS-2019-II190079, Artificial Intelligence Graduate School Program Korea University

四足机器人机器人学习足式机器人模仿学习

针对动物/视频动作与四足机器人在形态、尺度和动力学上不匹配,导致模仿学习参考轨迹不可执行的问题,本文提出 STMR,将重定向拆为空间与时间两步:先从无全局坐标的关键点生成运动学可行全身轨迹,再通过含模型控制器的时间优化满足动力学约束。实验显示其能减少足滑、保持接触时序,并在 Go1、Go2、AlienGo、B2 等真实机器人上部署动态动作与箱上后空翻。

TAR: Teacher-Aligned Representations via Contrastive Learning for Quadrupedal Locomotion Figure 1
arXiv preprint2025

TAR: Teacher-Aligned Representations via Contrastive Learning for Quadrupedal Locomotion

Amr Mousa, Neil Karavis, Michele Caprio, Wei Pan, Richard Allmendinger

University of Manchester,United Kingdom, University of Manchester

四足机器人机器人学习足式机器人运动控制

本文针对四足运动中教师-学生范式的表征错位、行为克隆协变量偏移和部署后缺少特权信息难以自适应的问题,提出 TAR:在仿真中用对比学习将仅本体感知学生的潜空间对齐到特权教师,而非直接回归特征,并结合任务相关负样本。实验显示其达到峰值性能所需训练时间约减半,OOD 泛化平均提升约 40%,且可在无特权状态下继续离策略微调。

Towards Quadrupedal Jumping and Walking for Dynamic Locomotion using Reinforcement Learning Figure 1
IEEE RA-L 20262025

Towards Quadrupedal Jumping and Walking for Dynamic Locomotion using Reinforcement Learning

Jørgen Anker, Lars Rønhaug

the Autonomous Robots Lab, NTNU, O

四足机器人机器人学习足式机器人强化学习运动控制

面向四足机器人在复杂地形和潜在低重力场景中兼具行走与越障跳跃的需求,论文用课程式强化学习训练 Jumper 的水平、垂直跳跃及行走策略;关键在于用抛体运动规律稠密化稀疏跳跃奖励,并通过参考状态初始化提升探索,而不依赖参考轨迹。实机结果显示水平跳达 1.25 m 且厘米级落点精度,垂直跳达 1.0 m,行走策略也在多种地面上完成验证。

Unsupervised Skill Discovery as Exploration for Learning Agile Locomotion Figure 1
arXiv preprint2025

Unsupervised Skill Discovery as Exploration for Learning Agile Locomotion

Seungeun Rho, Kartik Garg, Morgan Byrd, Sehoon Ha

Georgia Institute of Technology

四足机器人机器人学习运动控制敏捷运动

针对四足机器人敏捷越障训练依赖手工奖励、示范或课程设计的问题,论文提出 SDAX,将无监督技能发现作为高层探索,并用双层优化自动调节多样性奖励权重,使探索只在有助于任务回报时增强。实验在跳跃、跨越、爬行和蹬墙跳等任务中学到多种敏捷行为,并完成真实硬件部署;但仍需手工指定用于探索的状态子空间。

Variable Stiffness for Robust Locomotion through Reinforcement Learning Figure 1
IFAC-PapersOnLine2025

Variable Stiffness for Robust Locomotion through Reinforcement Learning

Dario Spoljaric, Yan Yashuai, Dongheui Lee

Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Wessling, Germany

四足机器人机器人学习强化学习运动控制

针对强化学习四足运动中固定 PD 刚度需要大量手调、而力矩控制又训练困难的问题,论文把关节目标位置与可变刚度一起作为策略动作,并比较按关节、按腿和混合分组的刚度输出。结果显示按腿刚度在速度跟踪和抗推恢复上优于位置控制,混合分组更省能;仅在平地训练的策略还能迁移到户外多地形,但具体增益与分组设计的关系仍有一定经验性。

Versatile Legged Locomotion Adaptation through Vision-Language Grounding Figure 1
OpenReview preprint2025

Versatile Legged Locomotion Adaptation through Vision-Language Grounding

I Made Aswin Nahrendra, Seunghyun Lee, Dongkyu Lee, Hyun Myung, Senior Member

四足机器人机器人学习足式机器人视觉语言动作运动控制

针对足式机器人多依赖几何感知、难以理解人类指令和场景语义的问题,论文提出 LocoVLM:用 LLM 离线生成指令到运动描述的技能库,再由 VLM 通过混合精度检索给风格条件运动控制器提供实时建议,避免在线调用云端大模型。实验显示其可执行多样化四足步态,指令跟随准确率最高 87%,并在仿真中展示跨任务和向人形机器人的零样本泛化。

Versatile Loco-Manipulation through Flexible Interlimb Coordination Figure 1
arXiv preprint2025

Versatile Loco-Manipulation through Flexible Interlimb Coordination

Simon Le

RAI Institute, University of California, Berkeley, Cornell University

四足机器人机器人学习操作

面向非结构环境中四足移动操作常受固定肢体角色和任务特化限制的问题,本文提出 ReLIC,将操作生成与稳定步态维护解耦为模型控制与仿真强化学习策略的协同控制器,并按任务需求动态分配腿/臂用于支撑或操作;系统还接入目标、接触点和语言指令,在搭载机械臂的 Spot 上完成 12 个真实任务,平均成功率 78.9%。

VR-Robo: A Real-to-Sim-to-Real Framework for Visual Robot Navigation and Locomotion Figure 1
IEEE RA-L 20252025

VR-Robo: A Real-to-Sim-to-Real Framework for Visual Robot Navigation and Locomotion

Shaoting Zhu, Linzhan Mou, Derun Li, Baijun Ye, Runhan Huang, Hang Zhao

Institute for Interdisciplinary Information Sciences, Tsinghua University, China, Shanghai Qi Zhi Institute, Shanghai, China

四足机器人机器人学习运动控制导航仿真到现实

针对传统仿真难以同时还原真实视觉外观与复杂几何交互、导致四足机器人RGB导航策略难迁移的问题,VR-Robo用多视角RGB经3DGS重建场景,并以GS-mesh混合表示接入Isaac Sim,结合物体随机化和遮挡感知组合训练强化学习策略。实验显示其可在视觉目标跟踪任务中实现RGB-only零样本实机迁移,并支持新环境中的较快适应,但当前仍受静态室内场景、训练耗时和RGB重建网格质量限制。

Whole-Body End-Effector Pose Tracking Figure 1
arXiv preprint2025

Whole-Body End-Effector Pose Tracking

Tifanny Portela, Andrei Cramariuc, Mayank Mittal, Marco Hutter

Robotic Systems Lab, ETH Zurich, ETH AI center, NVIDIA

四足机器人机器人学习操作全身控制

面向四足移动操作中机械臂与机身耦合强、传统模型控制依赖假设且学习方法常限制工作空间/姿态跟踪的问题,论文提出全身强化学习末端6DoF位姿跟踪控制器,结合地形感知的初始状态与指令采样、游戏式课程扩展可达范围。在ANYmal加6DoF机械臂上,方法可在楼梯、斜坡等复杂地形保持大工作空间跟踪,实机误差达2.64 cm和3.64°,优于对比的MPC与RL基线。

No Figure
Preprint2024

A Study of Lightweight, Low-cost Quadrupedal Robot Body Based on a Coaxial Deformation Mechanism

Zexu Yun, Mengmeng Jing, Yueya Yu, Jiahui Yang, Yuxuan Yang, Shangyan Jiang, Hongwei Zhu, Zihan Yang

Tiangong University,School of Computer Science and Technology,Tianjin,China, Tianjin Polytechnic University, Tiangong University,School of Mechanical Engineering,Tianjin,China, Tiangong University,School of Electronics and Information Engineering,Tianjin,China, Tiangong University,School of Life Sciences,Tianjin,China

四足机器人机器人学习足式机器人硬件设计

全文短总结尚未生成。

Accelerating Model Predictive Control for Legged Robots through Distributed Optimization Figure 1
arXiv preprint2024

Accelerating Model Predictive Control for Legged Robots through Distributed Optimization

Lorenzo Amatucci, Giulio Turrisi, Angelo Bratta, Victor Barasuol, Claudio Semini

Dynamic Legged Systems Laboratory, Istituto Italiano di Tecnologia (IIT), Genova, Italy

四足机器人机器人学习足式机器人模型预测控制规划

针对足式机器人全身 MPC 在线求解随状态维度快速变慢、难以利用多核并行的问题,论文将机器人动力学拆成多个可并行子系统,每个子系统独立求解 OCP,并用共识 ADMM 保持解的一致性。数值仿真显示该分布式 MPC 可收敛到与集中式全身 MPC 接近的解,在四足及四足加 6DoF 机械臂场景中最高减少约 75% 计算时间,且加装机械臂对求解时间影响较小。

No Figure
Advanced Intelligent Systems2024

Accessorizing Quadrupedal Robots with Wearable Electronics

Min Sung Kim, Dhiya Eddine Belkadi, Henry Stellwag Mayer, Kyle Tong, Mahad Khalid Faruqi, Khaleel Ibrahim Hassan, Joo Min Kim, Wedyan Babatain, Hossain Mohammad Fahad, Muhammad Mustafa Hussain

mmh Labs (DREAM) Elmore Family Schools of Electrical and Computer Engineering Purdue University West Lafayette IN USA, mmh Labs (DREAM), Elmore Family Schools of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA, Purdue University West Lafayette, School of Electrical and Computer Engineering Carnegie Mellon University Pittsburgh PA USA, School of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, USA, Carnegie Mellon University, Department of Computer Science Columbia University New York NY USA, Department of Computer Science, Columbia University, New York, NY, USA, Columbia University, Media Lab Massachusetts Institute of Technology Cambridge MA USA, Media Lab, Massachusetts Institute of Technology, Cambridge, MA, USA, Massachusetts Institute of Technology

四足机器人机器人学习足式机器人

全文短总结尚未生成。

Agile But Safe: Learning Collision-Free High-Speed Legged Locomotion Figure 1
arXiv preprint2024

Agile But Safe: Learning Collision-Free High-Speed Legged Locomotion

Tairan He, Chong Zhang, Wenli Xiao, Guanqi He, Changliu Liu, Guanya Shi

四足机器人机器人学习足式机器人安全恢复运动控制

面向四足机器人在杂乱环境中“跑得快但不撞”的矛盾,论文提出 ABS 框架:用端到端敏捷策略负责高速避障,再以基于 reach-avoid 价值网络的风险评估切换到恢复策略,并用深度图到射线距离的外感知表示提升泛化。系统在仿真训练后可实机部署,在室内外静态和动态障碍中实现最高约 3.1 m/s 的无碰撞导航。

Arm-Constrained Curriculum Learning for Loco-Manipulation of the Wheel-Legged Robot Figure 1
arXiv preprint2024

Arm-Constrained Curriculum Learning for Loco-Manipulation of the Wheel-Legged Robot

Zifan Wang, Yufei Jia, Lu Shi, Haoyu Wang, Haizhou Zhao, Xueyang Li, Jinni Zhou, Jun Ma, Guyue Zhou

The Hong Kong University of Science and Technology (Guangzhou), Institute for AI Industry Research (AIR), Tsinghua University, Department of Electronic Engineering, Tsinghua University, Harbin Institute of Technology, Xi’an Jiaotong-Liverpool University, DISCOVER Robotics {\dagger}

四足机器人机器人学习足式机器人操作轮足运动

面向轮足机器人加装机械臂后带来的运动—操作耦合不稳定与奖励不一致问题,论文提出手臂约束的课程强化学习框架,将安全/稳定约束融入策略学习,并用 reward-aware 课程平衡底盘与机械臂训练进度。策略在 Isaac Gym 训练后迁移到实机,完成开门、拨风扇、接力棒拾取与跟随等动态抓取任务,显示可在运动中追逐并抓取目标。

Body Transformer: Leveraging Robot Embodiment for Policy Learning Figure 1
arXiv preprint2024

Body Transformer: Leveraging Robot Embodiment for Policy Learning

Carmelo Sferrazza, Dun-Ming Huang, Fangchen Liu, Jongmin Lee, Pieter Abbeel

UC Berkeley

四足机器人机器人学习

这篇论文针对机器人策略直接套用通用 Transformer、未利用机体结构的问题,提出 Body Transformer:将传感器和执行器建成身体图,并在注意力层中只允许节点关注自身及邻居,使信息随层数由局部汇聚到全局。实验覆盖模仿学习与强化学习,BoT 相比 MLP 和普通 Transformer 在任务完成率、泛化与 scaling 上更好,并通过稀疏注意力带来显著运行时间和 FLOPs 降低。

Cafe-Mpc: A Cascaded-Fidelity Model Predictive Control Framework with Tuning-Free Whole-Body Control Figure 1
T-RO 20242024

Cafe-Mpc: A Cascaded-Fidelity Model Predictive Control Framework with Tuning-Free Whole-Body Control

He Li, Patrick M. Wensing

University of Notre Dame, Notre Dame, IN USA

四足机器人机器人学习全身控制模型预测控制规划

面向四足机器人在奔跑中完成桶滚等高动态动作时,全身MPC计算过重、低层WBC又需大量调参的问题,本文提出沿预测时域逐步降低模型精度、放粗时间步并放松约束的 Cafe-MPC,并用混合系统 MS-iLQR 求解;同时以MPC动作价值函数构造免调参VWBC,把全身MPC与QP式WBC连接起来。实验表明该设计可在不显著增加计算量下改善跟踪与约束处理,并在 MIT Mini Cheetah 上实现首次硬件奔跑桶滚。

CaT: Constraints as Terminations for Legged Locomotion Reinforcement Learning Figure 1
arXiv preprint2024

CaT: Constraints as Terminations for Legged Locomotion Reinforcement Learning

Elliot Chane-Sane, Pierre-Alexandre Leziart, Thomas Flayols, Olivier Stasse, Philippe Souères, Nicolas Mansard

Artificial and Natural Intelligence Toulouse Institute, Toulouse, France

四足机器人机器人学习足式机器人强化学习运动控制

针对四足机器人强化学习中硬约束常被混入奖励、调参繁琐且缺乏满足保证的问题,CaT将约束违反转化为随机终止未来回报的概率,并通过折扣因子按违反程度缩减回报,可在PPO等现有算法中少量改动实现。实验在真实Solo四足机器人上验证了其能在楼梯、陡坡和高台等障碍中保持较好安全与步态约束。

Contrastive Initial State Buffer for Reinforcement Learning Figure 1
Preprint2024

Contrastive Initial State Buffer for Reinforcement Learning

Nico Messikommer, Yunlong Song, Davide Scaramuzza

University of Zurich,Robotics and Perception Group, Department of Informatics,Switzerland, University of Zurich

四足机器人机器人学习强化学习

这篇论文针对机器人强化学习中探索难、样本效率低的问题,提出把历史经验不仅用于更新策略,还用于选择后续 rollout 的初始状态。核心方法是用对比学习将观测映射到任务相关嵌入空间,再经 K-means 选取多样且有信息量的状态构成 Initial State Buffer,无需任务或环境先验。在四足崎岖地形行走中性能提升 18.3%、收敛更快;无人机竞速成功率从 0.2 提升到 0.9。

Convergent iLQR for Safe Trajectory Planning and Control of Legged Robots Figure 1
arXiv preprint2024

Convergent iLQR for Safe Trajectory Planning and Control of Legged Robots

James Zhu, J. Joe Payne, Aaron M. Johnson

the Department of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA

四足机器人机器人学习足式机器人安全恢复模型预测控制

面向跳跃、腾空和落地等足式机器人高动态动作,论文关注欠驱动阶段与混合碰撞会放大跟踪误差、导致恢复困难的问题。作者将扰动沿混合轨迹演化的基本解矩阵及其 2 范数作为最坏误差增长指标,并嵌入 iLQR,形成 χ-iLQR,在不改变 LQR 权重的情况下优化更易收敛的轨迹。仿真显示其相比标准 iLQR 具有更好扰动恢复、更低反馈控制 effort,并能降低大初始误差下的失败率。

CROSS-GAiT: Cross-Attention-Based Multimodal Representation Fusion for Parametric Gait Adaptation in Complex Terrains Figure 1
arXiv preprint2024

CROSS-GAiT: Cross-Attention-Based Multimodal Representation Fusion for Parametric Gait Adaptation in Complex Terrains

Mohamed Khalid M

Dept. of Electrical and Computer Engineering, University of Maryland, College Park, MD, USA, of Electrical and Computer Engineering, University of Maryland, College Park, MD, USA, of Computer Science, University of Maryland, College Park, MD, USA, James Clark School of Engineering, University of Maryland, College Park, MD, USA, of Aerospace Engineering, University of Maryland, College Park, MD, USA, Army Research Laboratory (ARL)

四足机器人机器人学习运动控制地形感知

面向四足机器人在密植被、沙地等难以绕开的复杂地形中固定步态能耗高、稳定性差的问题,CROSS-GAiT用交叉注意力融合相机、IMU与关节力矩时序表征,并连续调节抬腿高度和髋外展而非离散切换步态。Vision60实机显示其在复杂场景中成功率提升至少64.5%,关节总力矩降低27.3%,IMU能量密度降低7.04%,且可约60Hz实时运行。

Deep Compliant Control for Legged Robots Figure 1
Preprint2024

Deep Compliant Control for Legged Robots

Adrian Hartmann, Dongho Kang, Fatemeh Zargarbashi, Miguel Zamora

ETH Zurich,Computational Robotics Lab in the Department of Computer Science,Switzerland, ETH Zurich

四足机器人机器人学习足式机器人

本文针对深度强化学习足式控制器在外界扰动下常出现僵硬、高频且耗能的恢复动作,提出在训练中加入由随机扰动触发的显式恢复阶段:扰动期间弱化速度跟踪奖励、允许暂时偏离任务并强调能效与稳定。该策略无需外力传感,仅依赖本体历史状态学习柔顺响应。仿真与 Unitree Go1 实机实验显示,其抗推倒成功率略有提升,但更明显地降低扰动后的功率和力矩、减小碰撞作用力,并带来更平滑、安全的环境交互。

DexDribbler: Learning Dexterous Soccer Manipulation via Dynamic Supervision Figure 1
arXiv preprint2024

DexDribbler: Learning Dexterous Soccer Manipulation via Dynamic Supervision

Yutong Hu, Kehan Wen, Fisher Yu

VIS Group at ETH Zurich, Zurich, Switzerland. {}^{ } start_FLOATSUPERSCRIPT end_FLOATSUPERSCRIPT

四足机器人机器人学习操作感知

DexDribbler关注四足机器人用腿在支撑身体的同时持续控球这一被纯强化学习难以处理的动态操作问题。核心做法是在训练中引入基于反馈控制的身体运动参考,将球状态到机体运动的高层先验作为动态监督注入关节策略,并配合球动力学与状态估计改进实现 sim-to-real。实验显示其收敛更快,在平滑地面上能完成急停、急转等以往方法不足的足球盘带动作,并在多类腿式机器人与地形仿真中优于基线。

DiffuseLoco: Real-Time Legged Locomotion Control with Diffusion from Offline Datasets Figure 1
arXiv preprint2024

DiffuseLoco: Real-Time Legged Locomotion Control with Diffusion from Offline Datasets

Xue Bin

UC Berkeley Simon Fraser University

四足机器人机器人学习足式机器人运动控制仿真基准

针对足式机器人多技能控制难以用在线强化学习扩展、且单技能策略依赖大量交互的问题,DiffuseLoco用扩散模型直接从多源离线数据学习多模态运动分布,并结合滚动时域控制和延迟输入以满足实时部署。实验显示单一策略可完成四足步态、跳跃、双足行走等技能并平滑切换,能零样本上真机和边缘设备;在真实基准中稳定性与速度跟踪优于RL和非扩散BC基线,但部分增益可能主要来自数据规模与模型表达力。

DrEureka: Language Model Guided Sim-To-Real Transfer Figure 1
Preprint2024

DrEureka: Language Model Guided Sim-To-Real Transfer

Yecheng Ma, William Liang, Hung-Ju Wang, Yuke Zhu, Linxi Fan, Osbert Bastani, Dinesh Jayaraman

University of Pennsylvania, NVIDIA, University of Texas, Austin

四足机器人机器人学习仿真到现实

针对仿真到现实中需人工反复设计奖励函数和调参域随机化的瓶颈,DrEureka用LLM先生成带安全约束的奖励,再基于扰动仿真构建奖励感知物理先验,引导LLM生成域随机化配置。实机结果显示,其在四足行走速度和距离上较人工配置提升34%和20%,灵巧手方块旋转次数近3倍,并能迁移到瑜伽球行走等新任务。

DTC: Deep Tracking Control Figure 1
Science Robotics2024

DTC: Deep Tracking Control

Fabian Jenelten, Junzhe He, Farbod Farshidian, Marco Hutter

Robotic Systems Lab, ETH Zurich, Zurich, Switzerland, ETH Zurich

四足机器人机器人学习

四足机器人在稀疏落脚点地形中需要精确规划,又要抵抗打滑、软地面等模型误差;纯轨迹优化鲁棒性不足,纯强化学习又受稀疏奖励限制。DTC用在线轨迹优化生成落脚点等参考,在仿真中训练端到端深度跟踪控制器,将规划的前瞻性与学习策略的闭环恢复能力结合。实验显示其在间隙、踏石等稀疏地形上保持较高落脚精度,并在湿滑或可变形地面上较模型控制更稳健,还能泛化到训练时未见的优化器。

No Figure
Biomimetics2024

Dynamic Fall Recovery Control for Legged Robots via Reinforcement Learning

Sicen Li, Yiming Pang, Panju Bai, Shihao Hu, Liquan Wang, Gang Wang

College of Mechanical and Electrical Engineering, Harbin Engineering University, Harbin 150001, China, National Key Laboratory of Autonomous Marine Vehicle Technology, Harbin 150001, China, Harbin Engineering University, College of Shipbuilding Engineering, Harbin Engineering University, Harbin 150001, China

四足机器人机器人学习足式机器人强化学习安全恢复

全文短总结尚未生成。

Eurekaverse: Environment Curriculum Generation via Large Language Models Figure 1
arXiv preprint2024

Eurekaverse: Environment Curriculum Generation via Large Language Models

Yecheng Jason

GRASP Laboratory, University of Pennsylvania

四足机器人机器人学习仿真基准

针对机器人环境课程依赖人工设计、难以迁移到新任务的问题,Eurekaverse把环境变化视为可生成和演化的代码,利用LLM产生多样且逐步变难的训练场景,并与强化学习智能体交替共进化。在四足机器人跑酷中,该方法在20个留出仿真课程和真实场景中优于人工或固定LLM课程,表现出更好的泛化与 sim-to-real 鲁棒性。

Expert Composer Policy: Scalable Skill Repertoire for Quadruped Robots Figure 1
arXiv preprint2024

Expert Composer Policy: Scalable Skill Repertoire for Quadruped Robots

Guilherme Christmann, Ying-Sheng Luo, Wei-Chao Chen

Inventec Corporation, Taipei, Taiwan

四足机器人机器人学习足式机器人

面向四足机器人技能库不断扩展时“新增技能需重训、旧技能质量易受损”的问题,论文不再混合专家策略,而是独立训练一个可复用的 Expert Composer Policy,将任意两个单技能专家通过面向目标状态的平滑过渡串联起来。该方法在72组仿真转移中平均成功率达99.99%,较随机基线高10%以上;经域随机化后实机360次实验成功率为97.22%。

Fast Traversability Estimation for Wild Visual Navigation Figure 1
arXiv preprint2023

Fast Traversability Estimation for Wild Visual Navigation

Jonas Frey, Matias Mattamala, Nived Chebrolu, Cesar Cadena, Maurice Fallon, Marco Hutter

Max Planck Institute for Intelligent Systems, ETH Zurich, University of Oxford

四足机器人机器人学习导航感知

自然草地、森林中高草和灌木会让几何占据图把可通行区域误判为障碍,且离线语义模型难以适配新环境。本文提出 WVN,仅用视觉结合本体感知/控制反馈在线生成自监督标签,利用预训练 ViT 特征训练小网络,并把监督学习与异常检测结合做可通行性估计。ANYmal 实验显示系统可在少于 5 分钟人工示范后学会分割可通行地形,完成高草避障和 1.4 km 路径跟随。

GeRM: A Generalist Robotic Model with Mixture-of-experts for Quadruped Robot Figure 1
arXiv preprint2024

GeRM: A Generalist Robotic Model with Mixture-of-experts for Quadruped Robot

Wenxuan Song, Han Zhao, Pengxiang Ding, Can Cui, Shangke Lyu, Yaning Fan, Donglin Wang

MiLAB, Westlake University, China

四足机器人机器人学习足式机器人

面向四足机器人多任务学习中示教采集成本高、模仿学习受专家质量限制的问题,GeRM 将离线强化学习与 Transformer式 VLA 结合,并用稀疏 MoE 扩大模型容量、控制每次推理计算量,同时利用自动采集的含失败轨迹 QUARD-Auto 数据。实验称其在 99 个任务上优于对比方法,并显示更好的训练/推理效率和一定涌现技能,但具体增益可能同时来自 scaling 与数据。

Guided Reinforcement Learning for Robust Multi-Contact Loco-Manipulation Figure 1
OpenReview preprint2024

Guided Reinforcement Learning for Robust Multi-Contact Loco-Manipulation

Jean-Pierre Sleiman

ETH Zurich, ETH Zurich and NVIDIA

四足机器人机器人学习强化学习操作

针对轨迹优化/MPC在多接触移动操作中依赖精确模型、遇到滑移等扰动难恢复,而纯强化学习又需任务化奖励的问题,本文用每任务一条TO示范构造任务无关MDP,并引入状态相关的自适应相位动力学指导模仿训练。在推/拉弹簧门、开/关洗碗机四任务中,相比既有运动模仿RL成功率显著更高,并能在真机四足移动操作平台上处理漏抓、重抓和物体参数变化。

Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigation Figure 1
arXiv preprint2024

Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigation

Abdelrhman Werby, Chenguang Huang, Martin Büchner, Abhinav Valada, Wolfram Burgard

University of Freiburg, University of Technology Nuremberg

四足机器人机器人学习视觉语言动作导航地形感知

针对密集开放词汇地图在大规模、多楼层环境中存储开销高、难以处理“楼上浴室里的毛巾”等抽象语言目标的问题,HOV-SG 将视觉语言特征从点级地图抽象为楼层—房间—物体的层次化 3D 场景图,并结合跨楼层 Voronoi 导航图实现可执行查询。实验显示其在物体、房间、楼层语义精度上优于基线,表示规模较密集开放词汇地图减少约 75%,并完成真实多楼层长程语言导航。

Hybrid Internal Model: Learning Agile Legged Locomotion with Simulated Robot Response Figure 1
arXiv preprint2024

Hybrid Internal Model: Learning Agile Legged Locomotion with Simulated Robot Response

Junfeng Long, Zirui Wang, Quanyi Li, Jiawei Gao, Liu Cao, Jiangmiao Pang

start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT Tsinghua University

四足机器人机器人学习足式机器人运动控制敏捷运动

针对足式机器人只能获得带噪本体感知、难以估计摩擦和地形等外部状态的问题,HIM 将外部状态视为扰动,用历史本体观测经对比学习形成包含速度与稳定性的内部嵌入,并与 PPO 联合训练,避免教师学生式模仿的信息损失。实验在 Aliengo、A1、Go1 上显示,仅用关节编码器和 IMU、约 1 小时训练即可完成复杂地形与未见组合场景行走。

Identifying Terrain Physical Parameters from Vision - Towards Physical-Parameter-Aware Locomotion and Navigation Figure 1
IEEE RA-L 20242024

Identifying Terrain Physical Parameters from Vision - Towards Physical-Parameter-Aware Locomotion and Navigation

Jiaqi Chen, Jonas Frey, Ruyi Zhou, Takahiro Miki, Georg Martius, Marco Hutter

Robotic Systems Laboratory, ETH Zurich, Zurich, Switzerland, ETH Zurich, Max Planck Institute for Intelligent Systems Tübingen, Tübingen, Germany, TH Bingen University of Applied Sciences, Max Planck Institute for Intelligent Systems

四足机器人机器人学习运动控制导航地形感知

针对四足机器人在湿滑、松软等非几何风险中只能接触后感知的问题,本文将“视觉外观”与仿真中的摩擦、刚度参数对齐:先用本体感知和地形几何训练物理解码器,再用其为真实图像自监督标注并在线更新视觉网络。ANYmal 仿真与室内外实测显示,物理解码器优于基线,视觉模型可密集预测地形物性并较快适应新环境。

No Figure
Robotics2024

Learning Advanced Locomotion for Quadrupedal Robots: A Distributed Multi-Agent Reinforcement Learning Framework with Riemannian Motion Policies

Yuliu Wang, Ryusuke Sagawa, Yusuke Yoshiyasu

Intelligent and Mechanical Interaction System, University of Tsukuba, Tsukuba 305-8577, Ibaraki, Japan, University of Tsukuba, National Institute of Advanced Industrial Science and Technology

四足机器人机器人学习足式机器人强化学习运动控制

全文短总结尚未生成。

Learning Bipedal Walking on a Quadruped Robot via Adversarial Motion Priors Figure 1
arXiv preprint2024

Learning Bipedal Walking on a Quadruped Robot via Adversarial Motion Priors

Andromachi Maria

School of Mechanical Engineering, University of Leeds, UK, Department of Computer Science, University College London, UK

四足机器人机器人学习足式机器人运动控制

本文针对四足机器人若能用后腿双足行走即可释放前腿执行操作任务这一动机,研究其在点接触软足、后腿运动范围受限条件下的稳定控制。核心做法是将对抗运动先验与教师-学生特权学习结合,用基于 SRBD 轨迹优化生成的参考轨迹引导强化学习,并让学生策略从历史观测中补偿不可观测信息。结果显示,在 Isaac Gym 中 A1 可实现盲双足行走,并通过平地、楼梯和不平地形;但验证仍限于仿真,真实机迁移效果文中未充分说明。

Learning Force Control for Legged Manipulation Figure 1
arXiv preprint2024

Learning Force Control for Legged Manipulation

Tifanny Portela, Gabriel B. Margolis, Yandong Ji, Pulkit Agrawal

Author affiliations: Improbable AI Lab

四足机器人机器人学习足式机器人操作

针对足式操作中接触力通常由强化学习策略隐式产生、难以调节顺应性和安全性的问题,本文训练可直接接受末端力指令的全身策略,且不依赖力/力矩传感器,而用本体感知估计并调节接触力。系统部署在带机械臂四足机器人上,实现重力补偿、可变刚度阻抗控制和遥操作示教;实验显示位置约5 cm、力约5 N的跟踪精度,可支持拖拽和带负载动觉示教,但高精度任务仍受限。

Learning Quadruped Locomotion using Differentiable Simulation Figure 1
arXiv preprint2024

Learning Quadruped Locomotion using Differentiable Simulation

Yunlong Song

University of Zurich, Switzerland, MIT, USA

四足机器人机器人学习足式机器人运动控制仿真基准

针对四足运动学习中模型自由 RL 依赖大规模并行采样、梯度方差高的问题,论文提出用可微仿真训练策略,但不直接对接触丰富的全身动力学求梯度,而是以前向高保真非可微仿真保证状态真实,用简化单刚体代理模型反传平滑梯度并做状态对齐。结果显示单机可在数分钟学会行走,GPU 并行下可学习多步态和复杂地形,相比 PPO 样本效率更高,并展示了无需微调的实机迁移。

No Figure
Biomimetics2024

Learning Quadrupedal High-Speed Running on Uneven Terrain

Xinyu Han, Mingguo Zhao

Department of Automation, Tsinghua University, Beijing 100084, China, Tsinghua University, Beijing Innovation Center for Future Chips, Tsinghua University, Beijing 100084, China

四足机器人机器人学习足式机器人运动控制敏捷运动

全文短总结尚未生成。

Learning Risk-Aware Quadrupedal Locomotion using Distributional Reinforcement Learning Figure 1
arXiv preprint2024

Learning Risk-Aware Quadrupedal Locomotion using Distributional Reinforcement Learning

Lukas Schneider, Jonas Frey, Takahiro Miki, Marco Hutter

ETH Zurich, Robotic Systems Lab, ETH Zurich, Zurich, Switzerland, Max Planck Institute for Intelligent Systems, Tübingen, Germany

四足机器人机器人学习足式机器人强化学习运动控制

面向灾害等高风险场景,现有四足运动控制器通常不显式建模动作风险,安全行为还依赖繁琐奖励调参。论文将分布式强化学习引入 PPO,学习回报分布并用风险度量生成优势估计,使同一策略可通过单一风险参数在保守与冒险行为间切换。仿真和 ANYmal 实机台阶/障碍实验显示,该方法回报接近 PPO、优于 DSAC,并能产生可控的风险敏感步态。

Learning to walk in confined spaces using 3D representation Figure 1
arXiv preprint2024

Learning to walk in confined spaces using 3D representation

Takahiro Miki, Joonho Lee, Lorenz Wellhausen, Marco Hutter

Robotic Systems Lab, ETH Zurich

四足机器人机器人学习

针对四足机器人在粗糙地形与低矮、悬垂障碍并存的狭窄空间中难以稳健通行的问题,论文提出两层层级强化学习控制:低层跟踪速度、姿态和机身高度等 6D 指令,高层利用 3D 占据体素形成空间感知并调节姿态。结合程序化地形生成和教师-学生蒸馏,方法在仿真及真实坍塌建筑等场景中展示了穿越受限粗糙环境的能力。

Learning Visual Quadrupedal Loco-Manipulation from Demonstrations Figure 1
arXiv preprint2024

Learning Visual Quadrupedal Loco-Manipulation from Demonstrations

Zhengmao He, Kun Lei, Yanjie Ze, Koushil Sreenath, Zhongyu Li, Huazhe Xu

Shanghai Qi Zhi Institute, ShangHai JiAi Genetics & IVF Institute, University of California,Berkeley, University of California, Berkeley

四足机器人机器人学习足式机器人模仿学习操作

这篇工作针对四足机器人虽会走但在真实场景中仍依赖额外机械臂、腿部操作泛化和精度不足的问题,提出用四条腿直接完成移动操作。核心是分层学习:低层RL负责高动态全身/足端跟踪,高层基于视觉点云的扩散式行为克隆从仿真示教中生成参数化操作轨迹,从而衔接规划与控制。仿真和真机展示了边走边提篮、关洗碗机、按按钮和推门等需要移动与精细接触的任务。

Learning-based legged locomotion; state of the art and future perspectives Figure 1
The International Journal of Robotics Research2024

Learning-based legged locomotion; state of the art and future perspectives

Sehoon Ha, Joonho Lee, Michiel van de Panne, Zhaoming Xie, Wenhao Yu, Majid Khadiv

Georgia Institute of Technology, USA, University of British Columbia, Canada, The AI Institute, USA, Google DeepMind, USA, Technical University of Munich, Germany

四足机器人机器人学习足式机器人运动控制

面向足式机器人在真实场景中实现通用机动性的需求,本文梳理学习式运动控制为何在近年快速推进:低成本高性能硬件、GPU物理仿真与深度强化学习共同降低了从仿真到实机的门槛。核心洞察是将四足运动学习放在硬件、仿真、模型控制与DRL的演进链条中比较,并延伸到双足/人形机器人;主要结果是给出领域状态图、关键技术取舍与未解问题,而非提出单一新算法。

Legged Robot State Estimation With Invariant Extended Kalman Filter Using Neural Measurement Network Figure 1
arXiv preprint2024

Legged Robot State Estimation With Invariant Extended Kalman Filter Using Neural Measurement Network

Donghoon Youm, Hyunsik Oh, Suyoung Choi, Hyeongjun Kim, Seunghun Jeon, Jemin Hwangbo

Korea Advanced Institute of Science and Technology,Daejeon,Republic of Korea,34141, Korea Advanced Institute of Science and Technology

四足机器人机器人学习足式机器人状态估计

针对足式机器人仅依赖 IMU 和关节编码器时在打滑、软地形等非理想接触下易产生漂移的问题,本文将仿真训练的神经测量网络接入 IEKF,用其预测机体系线速度和足端接触概率,并通过早停、域随机化与平滑损失缓解 sim-to-real gap。四足机器人在平地、碎石、软地和湿滑地面实验中,相比纯模型 IEKF 明显降低位置漂移,气垫场景误差约减少三分之一。

LiteVLoc: Map-Lite Visual Localization for Image Goal Navigation Figure 1
arXiv preprint2024

LiteVLoc: Map-Lite Visual Localization for Image Goal Navigation

Jianhao Jiao, Jinhao He, Changkun Liu, Sebastian Aegidius, Xiangcheng Hu, Tristan Braud, Dimitrios Kanoulas

the Department of Computer Science and Engineering, HKUST, Hong Kong, China

四足机器人机器人学习导航感知

这篇论文针对传统视觉定位依赖稠密 3D/SfM 地图、存储和维护成本高的问题,提出 LiteVLoc:用稀疏拓扑-度量图表示环境,并通过全局检索、单参考图像的局部相对位姿估计和 Pose SLAM 融合里程计实现由粗到细的实时定位。实验显示,200m 路线地图可压到约 17MB,平均平移误差低于 0.25m,并在仿真与真实四足机器人图像目标导航中完成验证。

LoopSR: Looping Sim-and-Real for Lifelong Policy Adaptation of Legged Robots Figure 1
arXiv preprint2024

LoopSR: Looping Sim-and-Real for Lifelong Policy Adaptation of Legged Robots

Peilin Wu, Weiji Xie, Jiahang Cao, Hang Lai, Weinan Zhang

Shanghai Jiao Tong University, China

四足机器人机器人学习足式机器人

针对域随机化虽提升鲁棒性却可能牺牲特定真实环境性能、而直接真机强化学习又昂贵且不稳定的问题,LoopSR把部署后的真实轨迹编码到潜空间,用自编码与对比学习估计/检索仿真参数,重建近似数字孪生并在仿真中持续训练策略。实验显示其在sim-to-sim和真机四足运动中以较少真实数据优于强基线,但长期复杂场景与视觉扩展仍文中未充分说明。

ManyQuadrupeds: Learning a Single Locomotion Policy for Diverse Quadruped Robots Figure 1
arXiv preprint2024

ManyQuadrupeds: Learning a Single Locomotion Policy for Diverse Quadruped Robots

Milad Shafiee, Guillaume Bellegarda, Auke Ijspeert

the BioRobotics Laboratory, Ecole Polytechnique Federale de Lausanne (EPFL)

四足机器人机器人学习足式机器人运动控制

针对四足机器人策略通常随形态、质量和自由度变化而需重新训练的问题,本文借鉴动物运动控制,将DRL策略用于调制CPG的频率和幅值,并通过机器人特定的PF缩放与逆运动学映射到足端轨迹,从而保持统一观测/动作空间。单策略可在16种2–200kg、12/16自由度机器人上两小时内训练完成,并迁移到Go1/A1实机;A1在未训练负载下仍能携带15kg稳定小跑。

MEVIUS: A Quadruped Robot Easily Constructed through E-Commerce with Sheet Metal Welding and Machining Figure 1
arXiv preprint2024

MEVIUS: A Quadruped Robot Easily Constructed through E-Commerce with Sheet Metal Welding and Machining

Kento Kawaharazuka, Shintaro Inoue, Temma Suzuki, Sota Yuzaki, Shogo Sawaguchi, Kei Okada, Masayuki Inaba

The University of Tokyo

四足机器人机器人学习足式机器人

针对开源四足多为小型 3D 打印塑料机、难以承受户外粗糙地形且维护繁琐的问题,MEVIUS 将金属机身与腿部精简到约 10 类结构件,结合电商可购零件、机加工/钣金焊接和简单 CAN-USB 控制架构实现低门槛自制。实验表明,在考虑通信延迟的强化学习与 Sim2Real 控制下,该机器人可在多种崎岖户外地形行走。

Morphological Symmetries in Robotics Figure 1
The International Journal of Robotics Research2024

Morphological Symmetries in Robotics

Daniel Ordoñez Apraez, Vladimir Kostic, Mario Martin, Antonio Agudo, Francesc Moreno-Noguer, Massimiliano Pontil, Claudio Semini, Carlos Mastalli

Italian Institute of Technology, Institute of Informatics and Telematics, Heriot-Watt University, IHMC Robotics – Florida Institute for Human & Machine Cognition, Robot Motor Intelligence, Heriot-Watt University, Edinburgh, UK, IHMC Robotics – Florida Institute for Human & Machine Cognition, Pensacola, FL, USA, Florida Institute for Human and Machine Cognition

四足机器人机器人学习

针对机器人学习在建模、估计和控制中数据昂贵且泛化不足的问题,本文将由重复运动链与对称质量分布产生的“形态对称性”形式化为物理几何先验,说明其会诱导状态、传感观测、动力学方程和最优策略的等变性。作者进一步用数据增强/等变约束提升学习模型,并以抽象调和分析将对称机器人动力学分解为低维独立子系统;在双足与四足机器人实验中展示了样本效率、泛化和步态动力学解释性的收益。

MQE: Unleashing the Power of Interaction with Multi-agent Quadruped Environment Figure 1
arXiv preprint2024

MQE: Unleashing the Power of Interaction with Multi-agent Quadruped Environment

Ziyan Xiong, Bo Chen, Shiyu Huang, Wei-Wei Tu, Zhaofeng He, Yang Gao

Yang Gao is with Shanghai Artificial Intelligence Laboratory and Shanghai Qi Zhi Institute, Shanghai, China

四足机器人机器人学习足式机器人仿真基准多机器人协作

针对现有多智能体基准交互动力学过于简化、难以支撑四足多机器人真实协作的问题,MQE基于 Isaac Gym/legged_gym 构建多四足仿真环境,引入机器人—物体复杂接触、协作与竞争任务及分层策略接口。实验表明分层强化学习可降低部分任务学习难度,但先进 MARL 方法在更复杂场景仍表现吃力,凸显该基准对算法鲁棒交互能力的挑战。

Non-Gaited Legged Locomotion with Monte-Carlo Tree Search and Supervised Learning Figure 1
IEEE RA-L 20242024

Non-Gaited Legged Locomotion with Monte-Carlo Tree Search and Supervised Learning

Ilyass Taouil, Lorenzo Amatucci, Majid Khadiv, Angela Dai, Victor Barasuol, Giulio Turrisi, Claudio Semini

it 2 3D AI Laboratory, Technical University of Munich (TUM), Germany, de ATARI Laboratory, MIRMI, Technical University of Munich (TUM), Germany

四足机器人机器人学习足式机器人运动控制

针对四足机器人在线接触/步态规划中离散接触序列与连续时序组合爆炸、传统 MIP/NLP 难以实时上机的问题,论文将步态规划表述为 MDP,用 MCTS 搜索非预设步态,并以监督学习的价值函数替代大量 MPC rollout 来加速评估。作者还分析了仿真次数、视野和重规划频率等参数,指出约 12.5 Hz 更新是性能所需。方法在仿真和 22 kg 电动四足实机上,于不同地形、外力扰动下相较固定步态控制表现出更好的自适应性。

Obstacle-Aware Quadrupedal Locomotion With Resilient Multi-Modal Reinforcement Learning Figure 1
arXiv preprint2024

Obstacle-Aware Quadrupedal Locomotion With Resilient Multi-Modal Reinforcement Learning

I Made Aswin

Urban Robotics Lab, URobotics, Seoul, Republic of Korea, RS-2025-25424472) provided by Korea Forest Service (Korea Forestry Promotion Institute)

四足机器人机器人学习足式机器人强化学习运动控制

该工作针对四足机器人仅靠本体感知会以碰撞换取地形信息、而外感知方法又依赖精确地图的问题,提出 DreamWaQ++:在单阶段强化学习中融合本体与外感知,并用多模态 mixer、上下文适应和技能发现正则提升实时性与鲁棒性。实机 Unitree Go1 在粗糙地形、陡坡、高台阶等场景中实现敏捷越障,并在分布外情况保持一定稳定性。

Offline Adaptation of Quadruped Locomotion using Diffusion Models Figure 1
arXiv preprint2024

Offline Adaptation of Quadruped Locomotion using Diffusion Models

Reece O'Mahoney, Alexander L. Mitchell, Wanming Yu, Ingmar Posner, Ioannis Havoutis

the Oxford Robotics Institute, Department of Engineering Science, University of Oxford

四足机器人机器人学习足式机器人运动控制运动生成

针对四足运动中多技能策略常依赖分层训练、且训练后难以适配新目标的问题,论文将基于 SDE 的扩散策略用于轨迹生成,并用 classifier-free guidance 把未标注数据按速度跟踪回报离线引导成目标条件行为。方法可在单一模型中插值多种步态,且仅需少量采样即可在 ANYmal 机载 CPU 上运行;仿真与实机实验验证了多技能切换和离线适配的可行性。

Offline Diversity Maximization Under Imitation Constraints Figure 1
arXiv preprint2024

Offline Diversity Maximization Under Imitation Constraints

Marin Vlastelica, Jin Cheng, Georg Martius, Pavel Kolev

Max Planck Institute for Intelligent Systems, Tübingen, Germany, University of Tübingen, Tübingen, Germany

四足机器人机器人学习模仿学习

针对无监督技能发现依赖大量在线交互、难利用离线数据且缺少技能效用约束的问题,论文提出 DOI:在互信息多样性目标上加入基于状态占用 KL 的模仿约束,并用 Fenchel-Rockafellar 对偶估计占用比来离线训练技能策略。实验显示其能在 D4RL 上调节多样性—回报权衡,并在 Solo12 四足机器人数据上学到可迁移到真实机器人的多样化运动技能。

One Policy to Run Them All: an End-to-end Learning Approach to Multi-Embodiment Locomotion Figure 1
arXiv preprint2024

One Policy to Run Them All: an End-to-end Learning Approach to Multi-Embodiment Locomotion

Nico Bohlinger, Grzegorz Czechmanowski, Maciej Krupka, Piotr Kicki, Krzysztof Walas, Jan Peters, Davide Tateo

Department of Computer Science, Technical University of Darmstadt, Germany, Institute of Robotics and Machine Intelligence, Poznan University of Technology, Poland, German Research Center for AI (DFKI), Research Department: Systems AI for Robot Learning, Centre for Cognitive Science

四足机器人机器人学习运动控制

针对腿式机器人策略通常绑定特定关节数和形态、难以在四足/双足/六足/人形间复用的问题,论文提出形态无关的 URMA:用关节/足端描述向量与注意力编码器把可变观测映射到共享表征,再由通用解码器为任意关节输出动作。实验在16种仿真机器人上训练单一端到端强化学习策略,并可零样本迁移到未见仿真平台和3台真实机器人,显示其作为腿式运动“基础策略”的潜力。

No Figure
IEEE/ASME Transactions on Mechatronics2024

Online Hierarchical Planning for Multicontact Locomotion Control of Quadruped Robots

Hao Sun, Junjie Yang, Yinghao Jia, Changhong Wang

Research and Development Center, China Academy of Launch Vehicle Technology, Beijing, China, China Academy of Launch Vehicle Technology, Space Control and Inertial Technology Research Center, Harbin Institute of Technology, Harbin, China, Harbin Institute of Technology

四足机器人机器人学习足式机器人运动控制规划

全文短总结尚未生成。

OptiState: State Estimation of Legged Robots using Gated Networks with Transformer-based Vision and Kalman Filtering Figure 1
arXiv preprint2024

OptiState: State Estimation of Legged Robots using Gated Networks with Transformer-based Vision and Kalman Filtering

Alexander Schperberg, Yusuke Tanaka, Saviz Mowlavi, Feng Xu, Bharathan Balaji, Dennis Hong

S. Mowlavi is with the Mitsubishi Electric Research Laboratories (MERL), Cambridge, MA, 02139, USA, B. Balaji is with Amazon Science, Seattle, WA, 98109, USA, Work not related to Amazon Science, Mowlavi is with the Mitsubishi Electric Research Laboratories (MERL), Cambridge, MA, 02139, USA

四足机器人机器人学习足式机器人状态估计感知

针对足式机器人动态运动中视觉易模糊、腿部里程计受接触/打滑影响且估计需低延迟的问题,OptiState将关节编码器与IMU的卡尔曼滤波、复用凸MPC地面反力的单刚体模型、以及融合深度图ViT潜变量的GRU校正结合,用学习补偿模型和传感非线性误差并输出不确定性。硬件四足机器人多地形实验中,相比VIO SLAM基线RMSE降低约65%。

No Figure
Scientific Reports2024

Oscillating latent dynamics in robot systems during walking and reaching

Oiwi Parker Jones, Alexander L. Mitchell, Jun Yamada, Wolfgang Merkt, Mathieu Geisert, Ioannis Havoutis, Ingmar Posner

Applied AI Lab, Oxford Robotics Institute, University of Oxford, Oxford, UK, University of Oxford, Science Oxford, Dynamic Robot Systems Group, Oxford Robotics Institute, University of Oxford, Oxford, UK, Robotics Research (United States)

四足机器人机器人学习运动控制

全文短总结尚未生成。

Pedipulate: Enabling Manipulation Skills using a Quadruped Robot's Leg Figure 1
arXiv preprint2024

Pedipulate: Enabling Manipulation Skills using a Quadruped Robot's Leg

Philip Arm, Mayank Mittal, Hendrik Kolvenbach, Marco Hutter

ETH Zurich, Robotics Systems Lab; Leonhardstrasse 21, Zurich, Switzerland

四足机器人机器人学习足式机器人操作

针对四足机器人依赖额外机械臂带来的重量和复杂度问题,本文探索用腿完成操作的 pedipulation。核心是训练一个跟踪单足位置目标的强化学习低层控制器,使机器人通过全身姿态调整扩大工作空间,并在远目标下自然形成三足步态实现边走边操作。实机遥操作展示了开门、采样、推障碍和足端携带超过 2 kg 负载,并验证了对足端/机身扰动与滑移接触的鲁棒性。

PIE: Parkour With Implicit-Explicit Learning Framework for Legged Robots Figure 1
IEEE RA-L 20242024

PIE: Parkour With Implicit-Explicit Learning Framework for Legged Robots

Shixin Luo, Songbo Li, Ruiqi Yu, Zhicheng Wang, Jun Wu, Qiuguo Zhu

Institute of Cyber-Systems and Control, Zhejiang University, 310027, China

四足机器人机器人学习足式机器人跑酷

针对四足机器人跑酷中视觉深度相机存在噪声与延迟、两阶段训练易损失信息的问题,PIE提出单阶段端到端强化学习框架,将本体感知与外部视觉结合,并通过“隐式-显式”双层估计同时预测后继状态、物理量与潜变量。该方法在低成本Lite3上实现仿真到真实零样本部署,可越过约3倍身长沟壑、跳上/跳下约3倍身高台阶,并通过约1倍身高楼梯。

ProNav: Proprioceptive Traversability Estimation for Legged Robot Navigation in Outdoor Environments Figure 1
IEEE RA-L 20242024

ProNav: Proprioceptive Traversability Estimation for Legged Robot Navigation in Outdoor Environments

Adarsh Jagan

Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, USA, University of Maryland, College Park

四足机器人机器人学习足式机器人导航仿真基准

针对户外四足导航中视觉/激光在遮挡、弱光、植被、沙泥和负障碍下难以可靠评估可通行性的问题,ProNav利用关节编码器、力与电流等本体信号,用PCA在约1秒内估计地形稳定性和运动阻力,并预测打滑、绊倒、腿部缠陷等崩溃风险以自适应选择步态。与外感知导航结合后,在真实复杂地形中成功率最高提升40%,能耗最多降低15.1%。

Reinforcement Learning For Quadrupedal Locomotion: Current Advancements And Future Perspectives Figure 1
arXiv preprint2024

Reinforcement Learning For Quadrupedal Locomotion: Current Advancements And Future Perspectives

Prakash Kumar

Computer Science and Engineering, Vellore Institute of Technology,AP,Amaravati,India, Vellore Institute of Technology University, Electrical, Electronics and Computer Science, Indian Institute of Science,Bangalore,India, Indian Institute of Science Bangalore, COEP University,Pune,India, Savitribai Phule Pune University

四足机器人机器人学习足式机器人强化学习运动控制

面向四足机器人在复杂地形中对自适应运动控制的需求,本文综述强化学习替代或增强传统/MPC控制的研究进展。核心洞察是从状态—动作策略、奖励设计、课程训练、仿真环境到Sim-to-Real与状态估计,系统梳理有步态约束和无步态方法的取舍。主要结果是归纳RL控制器在鲁棒性、速度与地形适应性上的优势,并指出外感知、模型结合与在线学习仍是关键挑战。

Residual Policy Learning for Perceptive Quadruped Control Using Differentiable Simulation Figure 1
arXiv preprint2024

Residual Policy Learning for Perceptive Quadruped Control Using Differentiable Simulation

Jing Yuan

ETH Zurich,Switzerland, ETH Zurich, University of Zurich,Switzerland, University of Zurich, National University of Singapore

四足机器人机器人学习足式机器人仿真基准感知

针对一阶策略梯度在接触丰富的四足运动中虽样本高效但优化地形噪声大、易陷入不佳局部解的问题,本文在可微仿真中引入基于简单锚定控制器的残差策略学习,并分析其与零阶RL的差异。结果显示,FoPG-RPL主要提升最终回报而非样本效率;盲走中SHAC RPL较PPO/PPO RPL样本效率高35倍/6倍,点质量视觉避障可在秒级收敛,四足感知导航可端到端数分钟训练。

Rethinking Robustness Assessment: Adversarial Attacks on Learning-based Quadrupedal Locomotion Controllers Figure 1
arXiv preprint2024

Rethinking Robustness Assessment: Adversarial Attacks on Learning-based Quadrupedal Locomotion Controllers

Fan Shi, Chong Zhang, Takahiro Miki, Joonho Lee, Marco Hutter, Stelian Coros

Robotic Systems Lab, ETH Zurich, Computational Robotics Lab, ETH Zurich, ETH AI Center

四足机器人机器人学习足式机器人运动控制

针对学习型四足运动控制器虽经域随机化等训练却缺乏最坏情形安全评估的问题,论文将鲁棒性测试转化为高维时序空间中的顺序对抗攻击搜索,生成现实可遇的低幅值观测、指令和扰动序列。结果显示,标准随机推力测试难以触发失败,而学习到的攻击可在仿真及真机上击穿强鲁棒策略;将这些对抗场景闭环用于微调后,策略抗攻击能力提升且跟踪性能基本不变。

RL2AC: Reinforcement Learning-based Rapid Online Adaptive Control for Legged Robot Robust Locomotion Figure 1
Preprint2024

RL2AC: Reinforcement Learning-based Rapid Online Adaptive Control for Legged Robot Robust Locomotion

Shangke Lyu, Xin Lang, Han Zhao, Hongyin Zhang, Pengxiang Ding, Donglin Wang

Robotics: Science and Systems

四足机器人机器人学习足式机器人强化学习运动控制

针对强化学习足式运动策略在模型不确定性、外界扰动和 sim-to-real 差异下难以快速适应的问题,论文从类模型控制的前馈/反馈分解视角解释 RL 策略,并提出 RL2AC:在不与 RL 联合训练的情况下,以 1000Hz 在线自适应生成关节力矩补偿。仿真和实机结果显示,其在负载、单腿扰动、侧向力矩、地形变化等场景下提升四足机器人鲁棒行走,但对摆动相扰动和全新任务的泛化能力仍有限。

Robots with Attitude: Singularity-Free Quaternion-Based Model-Predictive Control for Agile Legged Robots Figure 1
arXiv preprint2024

Robots with Attitude: Singularity-Free Quaternion-Based Model-Predictive Control for Agile Legged Robots

Zixin Zhang, John Z. Zhang, Shuo Yang, Zachary Manchester

四足机器人机器人学习足式机器人敏捷运动模型预测控制

针对足式机器人在大角度姿态变化中使用欧拉角易遇奇异、导致MPC失效的问题,本文将单位四元数直接嵌入非线性单刚体MPC,并修改iLQR中的微分与线性化处理,以避免李群形式化的实现门槛。实验在四足与人形机器人仿真/硬件上展示了90度俯仰夹墙站立、任意姿态跟踪和空中抗扰等任务,相比欧拉角MPC稳定性更好。

Robust Ladder Climbing with a Quadrupedal Robot Figure 1
arXiv preprint2024

Robust Ladder Climbing with a Quadrupedal Robot

Dylan Vogel, Robert Baines, Joseph Church, Julian Lotzer, Karl Werner, Marco Hutter

Robotics Systems Lab,ETH Zurich,Zurich,Switzerland,8092, ETH Zurich

四足机器人机器人学习足式机器人攀爬

面向工业巡检中四足机器人难以通过常见梯子的瓶颈,论文将模型自由强化学习攀爬策略与可在梯级上承受拉压的钩形足端协同设计,使步态能从行走自然过渡到攀爬。仿真在多种梯角、横档半径和间距下成功率约96%,实机ANYmal零样本在70°–90°梯子上总体成功率90%,并能承受未建模扰动,速度显著快于既有机器人爬梯结果。

Similar but Different: A Survey of Ground Segmentation and Traversability Estimation for Terrestrial Robots Figure 1
International Journal of Control Automation and Systems2024

Similar but Different: A Survey of Ground Segmentation and Traversability Estimation for Terrestrial Robots

Hyungtae Lim, Minho Oh, Seungjae Lee, Seunguk Ahn, Hyun Myung

Korea Advanced Institute of Science and Technology

四足机器人机器人学习综述导航地形感知

面向四足等地面机器人进入粗糙、灾害等非结构化环境后,“地面”和“可通行区域”常被混用的问题,本文将地面分割定位为感知预处理,将可通行性估计定位为面向规划的认知判断,并从平台机动性、机器人所处位置、负障碍和可变形物体四个维度厘清二者边界。综述结果表明,两类任务的目标集合可明显不同,学习方法虽提升分类能力,但可通行性分析仍受跨环境泛化限制。

No Figure
Advanced Robotics2024

Simulation of autonomous rhythm and gait generation in quadrupedal locomotion with hindlegs

Hiroshi Kimura, Christophe Maufroy

Graduate School of Science and Technology, Kyoto Institute of Technology, Kyoto, Japan, Kyoto Institute of Technology, Department Biomechatronic Systems, Fraunhofer Institute IPA, Stuttgart, Germany, Fraunhofer Institute for Manufacturing Engineering and Automation

四足机器人机器人学习足式机器人运动控制仿真基准

全文短总结尚未生成。

No Figure
IEEE Transactions on Industrial Electronics2024

Skill Latent Space Based Multigait Learning for a Legged Robot

Xin Liu, Jinze Wu, Yufei Xue, Chenkun Qi, Guiyang Xin, Feng Gao

School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China, Shanghai Jiao Tong University, School of Biomedical Engineering, Dalian University of Technology, Dalian, China, Dalian University of Technology

四足机器人机器人学习足式机器人运动控制

全文短总结尚未生成。

SLR: Learning Quadruped Locomotion without Privileged Information Figure 1
arXiv preprint2024

SLR: Learning Quadruped Locomotion without Privileged Information

Fasih Ud Din

Tsinghua University, Shenzhen Technology University

四足机器人机器人学习足式机器人运动控制

针对四足强化学习常依赖仿真中特权信息、且需人工选择和估计物理参数的问题,论文提出 SLR,让策略在仅用本体感知历史的情况下,通过马尔可夫过程自学习环境潜变量。其核心洞察是手工特权量未必适合神经策略,反而可能干扰学习。作者将 SLR 嵌入多个已有开源 SOTA 仓库并保持原配置比较,报告其在仿真速度跟踪、平均回报及真实复杂地形穿越中普遍优于显式/隐式特权学习方法。

SoloParkour: Constrained Reinforcement Learning for Visual Locomotion from Privileged Experience Figure 1
arXiv preprint2024

SoloParkour: Constrained Reinforcement Learning for Visual Locomotion from Privileged Experience

Elliot Chane-Sane, Joseph Amigo, Thomas Flayols, Ludovic Righetti, Nicolas Mansard, Université de Toulouse

Machines in Motion Laboratory, New York University, USA, Artificial and Natural Intelligence Toulouse Institute, Toulouse, France

四足机器人机器人学习强化学习运动控制跑酷

SoloParkour面向轻量四足机器人在深度相机视野受限、感知延迟且硬件脆弱条件下的安全跑酷控制。其关键做法是把跑酷建模为带安全约束的强化学习,先用环境特权信息训练教师策略,再用其经验预热离策略像素端到端RL,而非直接蒸馏。论文在仿真和真实Solo-12上展示行走、攀爬、跳跃、匍匐等技能,可越过约1.5倍机身高度障碍。

Track2Act: Predicting Point Tracks from Internet Videos enables Diverse Zero-shot Robot Manipulation Figure 1
arXiv preprint2024

Track2Act: Predicting Point Tracks from Internet Videos enables Diverse Zero-shot Robot Manipulation

Homanga Bharadhwaj, Roozbeh Mottaghi, Abhinav Gupta, Shubham Tulsiani

四足机器人机器人学习操作

面向无需测试时适配的开放场景机器人操作,Track2Act 将策略分解为可由互联网人类/机器人视频学习的具身无关交互计划与少量机器人数据训练的残差闭环控制。其核心是预测目标条件下图像点未来轨迹,再结合深度估计物体刚体变换并转为末端位姿。论文在 Spot 真实机器人上展示了对未见任务、物体和场景的多样操作泛化,但任务仍以短时、单物体为主。

UMI on Legs: Making Manipulation Policies Mobile with Manipulation-Centric Whole-body Controllers Figure 1
arXiv preprint2024

UMI on Legs: Making Manipulation Policies Mobile with Manipulation-Centric Whole-body Controllers

Huy Ha, Yihuai Gao, Zipeng Fu, Jie Tan, Shuran Song

Stanford University, Columbia University, Google DeepMind

四足机器人机器人学习操作全身控制

针对四足移动操作中真实机器人采集昂贵且仿真任务建模困难的问题,UMI-on-Legs将手持夹爪采集的任务示教与仿真训练的全身控制器解耦,并以任务坐标系下末端轨迹作为跨本体接口。该设计让视觉操作策略专注生成轨迹、WBC负责四足执行与稳定,在抓取、推重物和动态投掷等真实任务上均达到70%以上成功率,并展示了固定机械臂策略到四足平台的零样本迁移。

No Figure
IEEE RA-L 20242024

Understanding URDF: A Dataset and Analysis

Daniella Tola, Peter Corke

Department of Electrical and Computer Engineering, Aarhus University, Aarhus, Denmark, Aarhus University, Centre for Robotics, Queensland University of Technology, Brisbane, QLD, Australia, Queensland University of Technology

四足机器人机器人学习仿真基准数据集/基准

全文短总结尚未生成。

ViPlanner: Visual Semantic Imperative Learning for Local Navigation Figure 1
arXiv preprint2024

ViPlanner: Visual Semantic Imperative Learning for Local Navigation

Pascal Roth, Julian Nubert, Fan Yang, Mayank Mittal, Marco Hutter

the Robotic Systems Lab, ETH Zürich, The author is with NVIDIA

四足机器人机器人学习导航感知规划

针对户外局部导航中纯几何规划难以区分泥地/混凝土等可通行性差异、也易把楼梯误判为障碍的问题,ViPlanner 将几何输入与30类语义表示融合,并用可微语义代价图和 Imperative Learning 端到端优化局部路径。其仅在仿真中训练,却在 ANYmal 等真实场景实现零样本迁移;相比几何 iPlanner,通行代价降低约38.02%,并表现出一定抗噪性。

Visual Whole-Body Control for Legged Loco-Manipulation Figure 1
arXiv preprint2024

Visual Whole-Body Control for Legged Loco-Manipulation

Minghuan Liu, Zixuan Chen, Xuxin Cheng, Yandong Ji, Rizhao Qiu, Ruihan Yang, Xiaolong Wang

UC San Diego

四足机器人机器人学习足式机器人操作全身控制

面向野外或复杂地形中的移动抓取,论文指出四足机器人的腿不应只负责移动,而可与机械臂协同扩展可达空间。VBC 采用分层策略:低层用全自由度跟踪机身速度与末端目标,高层由深度视觉规划命令,并通过仿真强化学习、教师策略和在线模仿实现零真人数据迁移。Unitree B1+Z1 实验显示,其在不同高度、位置和物体形状的拾取任务上优于静态高度等基线,并出现重试行为。

VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigation Figure 1
arXiv preprint2024

VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigation

Naoki Yokoyama, Sehoon Ha, Dhruv Batra, Jiuguang Wang, Bernadette Bucher

Boston Dynamics AI Institute, Georgia Institute of Technology

四足机器人机器人学习视觉语言动作导航感知

针对机器人在陌生环境中如何利用语义常识高效寻找目标物体的问题,VLFM将深度构建的占据/前沿地图与预训练视觉语言模型的图文相似度结合,生成语言条件价值地图来选择最有希望的探索前沿,避免依赖检测器转文本和LLM推理。在Gibson、HM3D、MP3D的ObjectNav上SPL达SOTA,并在Spot上零样本完成办公楼目标导航。

Adaptive Control Strategy for Quadruped Robots in Actuator Degradation Scenarios Figure 1
arXiv preprint2023

Adaptive Control Strategy for Quadruped Robots in Actuator Degradation Scenarios

Xinyuan Wu, Wentao Dong, Hang Lai, Yong Yu, Ying Wen

Shanghai Jiao Tong University, Shanghai

四足机器人机器人学习足式机器人硬件设计

面向四足机器人在电机老化或突发关节故障下难以及时维修、传统容错控制依赖专家调参且泛化弱的问题,论文提出基于强化学习的教师-学生框架 Adapt,用 Transformer 学习仅依赖本体传感的统一退化适应策略。仿真中处理不同程度执行器退化,并在 Unitree A1 上零样本部署,验证了真实机器人维持运动与任务执行的可行性。

No Figure
Applied Sciences2023

Adaptive Locomotion Learning for Quadruped Robots by Combining DRL with a Cosine Oscillator Based Rhythm Controller

Xiaoping Zhang, Yitong Wu, Huijiang Wang, Fumiya Iida, Li Wang

Department of Engineering, University of Cambridge, Cambridge CB2 PZ, UK, School of Electrical and Control Engineering, North China University of Technology, Beijing 100144, China, North China University of Technology, University of Cambridge

四足机器人机器人学习足式机器人运动控制

全文短总结尚未生成。

AMP in the wild: Learning robust, agile, natural legged locomotion skills Figure 1
arXiv preprint2023

AMP in the wild: Learning robust, agile, natural legged locomotion skills

作者信息待提取

Institute, Shanghai 200232, China

四足机器人机器人学习足式机器人运动控制敏捷运动

针对强化学习足式控制虽鲁棒但步态保守、不自然且依赖复杂奖励设计的问题,论文将基于真实动物运动数据的 AMP 对抗模仿分支嵌入 teacher-student sim-to-real 框架,使学生策略仅凭本体感知推断环境并保持动物式步态。仿真与真实四足机器人实验显示,该方法可通过楼梯、碎石和湿滑地面,并较基线呈现更敏捷、自然、节能的多样步态。

ANYmal Parkour: Learning Agile Navigation for Quadrupedal Robots Figure 1
Science Robotics2023

ANYmal Parkour: Learning Agile Navigation for Quadrupedal Robots

David Hoeller, Nikita Rudin, Dhionis Sako, Marco Hutter

ETH Zurich, NVIDIA

四足机器人机器人学习足式机器人导航敏捷运动

面向四足机器人在跑酷式复杂地形中高速、实时导航的难题,论文将感知重建、技能库式运动控制与高层导航策略分层学习结合,使策略显式利用各运动技能能力来选择行走、跳跃、攀爬、下蹲等动作。所有模块仅在仿真训练,并在 ANYmal D 上实现真实部署,可连续跨越多类障碍,速度最高约 2 m/s。

ARMP: Autoregressive Motion Planning for Quadruped Locomotion and Navigation in Complex Indoor Environments Figure 1
arXiv preprint2023

ARMP: Autoregressive Motion Planning for Quadruped Locomotion and Navigation in Complex Indoor Environments

Jeonghwan Kim, Tianyu Li, Sehoon Ha

四足机器人机器人学习足式机器人操作运动控制

面向四足机器人在复杂室内环境中导航时高维动力学规划昂贵、传统轨迹优化固定时域且难以接入视觉导航的问题,ARMP先用密集轨迹优化构建可行运动库,再以自回归混合专家网络学习运动流形,根据历史状态和高层指令生成任意长度计划。实验在Aliengo上展示了行走、转向、跳跃、爬楼梯等物理可复现运动,并可作为Habitat导航低层控制器完成跨楼层和越障目标导航;但运动库采集成本与复杂场景覆盖仍是主要限制。

ArtPlanner: Robust Legged Robot Navigation in the Field Figure 1
Field Robotics2023

ArtPlanner: Robust Legged Robot Navigation in the Field

Lorenz Wellhausen, Marco Hutter

Robotic Systems Lab, ETH Zürich, Switzerland, Robotic Technology (United States)

四足机器人机器人学习足式机器人导航规划

面向地下挑战中烟雾、狭窄通道和复杂地形对足式机器人导航的高可靠性需求,ArtPlanner在机器人中心高度图上结合几何可达性检查、学习到的落足安全评分与仿真训练的运动代价网络,并通过每次地图更新重建有界采样图来保证实时性。实测中该方法支撑4台ANYmal在DARPA SubT决赛约90分钟自主运行,未出现规划或运动失败,并优于对比规划器。

ASC: Adaptive Skill Coordination for Robotic Mobile Manipulation Figure 1
IEEE RA-L 20232023

ASC: Adaptive Skill Coordination for Robotic Mobile Manipulation

Naoki Yokoyama, Alex Clegg, Joanne Truong, Eric Undersander, Tsung-Yen Yang, Sergio Arnaud, Sehoon Ha, Dhruv Batra, Akshara Rai

Georgia Institute of Technology, Atlanta, GA, USA, Georgia Institute of Technology, Meta AI, Redwood City, CA, USA

四足机器人机器人学习操作

面向真实家庭整理中的长时程移动抓放,论文指出简单串联导航、抓取、放置技能易受交接误差和扰动累积影响。ASC 将学习到的视觉运动技能库、技能协调策略与越分布状态下的纠错策略结合,仅依赖机载感知、在仿真中训练并零样本部署到 Spot。真实八类新环境中展示可迁移性,两处定量测试达 59/60 成功率,优于顺序执行的 44/60,并对动态障碍、布局变化和硬件异常更稳健。

Barkour: Benchmarking Animal-level Agility with Quadruped Robots Figure 1
arXiv preprint2023

Barkour: Benchmarking Animal-level Agility with Quadruped Robots

Jose Enrique

Google DeepMind

四足机器人机器人学习足式机器人仿真基准数据集/基准

针对四足机器人敏捷性缺少统一、直观评测的问题,本文提出受犬类敏捷赛启发的 Barkour 基准,在 5m×5m 障碍赛道中用限时得分衡量速度、可控性与多技能组合能力,并给出专家策略加高层导航和 Locomotion-Transformer 通用策略两类基线。实机零样迁移中机器人可完成赛道,专家策略平均得分 0.77、约 24.6 秒,通用策略 0.73、约 25.8 秒,仍明显慢于约 9 秒满分完成的小型犬。

No Figure
IEEE RA-L 20232023

Barry: A High-Payload and Agile Quadruped Robot

Giorgio Valsecchi, Nikita Rudin, Lennart Nachtigall, Konrad Mayer, Fabian Tischhauser, Marco Hutter

Robotic Systems Lab, ETH Zurich, Zürich, Switzerland, ETH Zurich

四足机器人机器人学习足式机器人敏捷运动

全文短总结尚未生成。

Combining model-predictive control and predictive reinforcement learning for stable quadrupedal robot locomotion Figure 1
arXiv preprint2023

Combining model-predictive control and predictive reinforcement learning for stable quadrupedal robot locomotion

Vyacheslav Kovalev, Anna Shkromada, Henni Ouerdane, Pavel Osinenko

四足机器人机器人学习足式机器人强化学习运动控制

面向四足机器人稳定步态中 MPC 预测时域受算力限制、纯 RL 训练代价高的问题,论文将 MPC 与预测式强化学习结合,用代价 roll-out 并以神经网络 Q 函数作为尾项近似长时域价值。在 Unitree A1 设置中,该控制器可在线运行、无需预训练,并在短预测时域下实现稳定运动,基线 MPC 则失稳,同时累计运行代价更低。

Curiosity-Driven Learning of Joint Locomotion and Manipulation Tasks Figure 1
OpenReview preprint2023

Curiosity-Driven Learning of Joint Locomotion and Manipulation Tasks

作者信息待提取

Robotic Systems Lab, ETH Zurich, Switzerland

四足机器人机器人学习操作运动控制

面向四足/轮腿机器人在门、包裹等人类环境任务中需要同时运动与操作、且密集奖励和课程设计成本高的问题,本文用仅在任务完成时给 +1 的稀疏外部奖励,结合基于 RND 的好奇心内在奖励与“curiosity state”引导探索,学习端到端策略而非手工拆阶段。仿真中稀疏奖励或常规 RND难以稳定学会,所提设置在推门、拉门和包裹搬运上最高达 99%、92%、99% 成功率;真实轮腿机器人双足模式下连续推门 15 次、搬运包裹 5 次未失败。

DeepTransition: Viability Leads to the Emergence of Gait Transitions in Learning Anticipatory Quadrupedal Locomotion Skills Figure 1
arXiv preprint2023

DeepTransition: Viability Leads to the Emergence of Gait Transitions in Learning Anticipatory Quadrupedal Locomotion Skills

Milad Shafiee, Guillaume Bellegarda, Auke Ijspeert

四足机器人机器人学习足式机器人运动控制

本文针对四足动物为何随速度和地形切换步态这一未定问题,提出“可生存性/避免摔倒”可能比能耗或峰值力更基础。作者用结合 CPG、外感知与深度强化学习的仿生层级控制器,让步态转变在训练中自发出现;结果显示平地 walk-trot 同时改善可生存性和能效,而连续沟壑上 trot-pronk 主要为避免不可生存状态,并在 Unitree A1 上实现超过 1.3 m/s 跨越 30 cm 连续间隙。

DOC: Differentiable Optimal Control for Retargeting Motions onto Legged Robots Figure 1
ACM Transactions on Graphics2023

DOC: Differentiable Optimal Control for Retargeting Motions onto Legged Robots

Ruben Grandia, Farbod Farshidian, Espen Knoop, Christian Schumacher, Marco Hutter, Moritz Bächer

Disney Research Imagineering, Zurich, Switzerland, Walt Disney (Switzerland), ETH Zurich, Zurich, Switzerland, ETH Zurich

四足机器人机器人学习足式机器人模仿学习模型预测控制

针对将动物动捕或艺术动画迁移到比例、质量分布和自由度差异很大的足式机器人时需大量手工调参且难保物理可行的问题,论文提出可微最优控制 DOC,在最优状态/控制轨迹流形上优化重定向目标参数,并将其接入 MPC。结果显示,同一动作可迁移到多种四足形态,能适配扭矩等约束;实机 ANYmal 上仍能较贴近目标动作并在扰动后恢复跟踪。

Dojo: A Differentiable Physics Engine for Robotics Figure 1
arXiv preprint2023

Dojo: A Differentiable Physics Engine for Robotics

Simon Le

Stanford University, Stanford, CA 94305, USA, School of Computation, Information and Technology, Technical University of Munich, Munich, 80333, Germany, Department of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA, The Robotics Institute, Carnegie Mellon University, Pittsburgh, PA 15213, USA

四足机器人机器人学习

面向接触丰富机器人任务中仿真稳定性、物理真实性与可微优化难兼顾的问题,Dojo 将硬接触和摩擦建模为带二阶锥约束的非线性互补问题,并用定制原始-对偶内点法及隐式微分提供可调平滑梯度。实验显示其可在较低采样率下保持稳定接触仿真,支持轨迹优化、策略学习和系统辨识,并在多机器人基准及 xArm 6 硬件实验中评估了与 MuJoCo、Drake、Brax 等的性能和 sim-to-real 差距。

DreamWaQ: Learning Robust Quadrupedal Locomotion With Implicit Terrain Imagination via Deep Reinforcement Learning Figure 1
arXiv preprint2023

DreamWaQ: Learning Robust Quadrupedal Locomotion With Implicit Terrain Imagination via Deep Reinforcement Learning

I Made Aswin

Korea Advanced Institute of Science and Technology

四足机器人机器人学习足式机器人强化学习运动控制

针对四足机器人在复杂地形中过度依赖相机、LiDAR等外感知且纯本体感知方法长距离验证不足的问题,DreamWaQ用非对称actor-critic在仿真中训练策略,仅由IMU和关节等时序本体观测隐式“想象”高度、摩擦、障碍等地形属性,并用上下文估计器联合估计机体状态与环境潜变量。方法在Unitree A1上零样本迁移,优于已有学习式控制器,并在山坡、草地等户外非结构化环境中连续行走约十分钟。

DribbleBot: Dynamic Legged Manipulation in the Wild Figure 1
Preprint2023

DribbleBot: Dynamic Legged Manipulation in the Wild

Yandong Ji, Gabriel B. Margolis, Pulkit Agrawal

Massachusetts Institute of Technology,Improbable AI Lab,USA, Improbable AI Lab, Massachusetts Institute of Technology, USA, Massachusetts Institute of Technology

四足机器人机器人学习足式机器人操作

面向动态移动操作中“边运动边操控物体”的难题,DribbleBot以四足机器人野外带球为载体,结合仿真强化学习、随机化球-地面阻力模型、机载鱼眼相机球检测与跌倒恢复策略,避免依赖外部相机和光滑场地。实机在沙地、砾石、泥地、雪地等自然地形上完成感知驱动的连续带球,并能摔倒后起身找回球,表明现有四足平台可承担较复杂的全身动态操作任务。

Evaluation of Constrained Reinforcement Learning Algorithms for Legged Locomotion Figure 1
arXiv preprint2023

Evaluation of Constrained Reinforcement Learning Algorithms for Legged Locomotion

Joonho Lee, Lukas Schroth, Victor Klemm, Marko Bjelonic, Alexander Reske, Marco Hutter

四足机器人机器人学习足式机器人强化学习运动控制

针对足式机器人强化学习常把关节、扭矩、碰撞等物理限制混入奖励、导致仿真训练忽视约束的问题,本文将速度跟踪运动控制建模为 CMDP,并比较多种一阶约束策略优化算法,同时加入稳定训练的改动。实验表明,相比常规无约束 PPO 类方法,该框架能减少约束违规和真机运行错误,支持轮足机器人 sim-to-real,并降低奖励塑形负担。

Event Camera-based Visual Odometry for Dynamic Motion Tracking of a Legged Robot Using Adaptive Time Surface Figure 1
arXiv preprint2023

Event Camera-based Visual Odometry for Dynamic Motion Tracking of a Legged Robot Using Adaptive Time Surface

Shifan Zhu, Zhipeng Tang, Michael Yang, Erik Learned-Miller, Donghyun Kim

University of Massachusetts Amherst,U.S, University of Massachusetts Amherst, U.S, University of Massachusetts Amherst

四足机器人机器人学习足式机器人模仿学习状态估计

针对足式机器人跳跃、落地、后空翻等高速运动中 RGB 图像易模糊、传统 VO/VIO 易发散的问题,论文将事件相机与 RGB-D 直接稀疏里程计结合,提出按局部事件密度自适应衰减的时间表面、基于 ATS 的事件像素筛选,以及 RGB/事件联合 3D-2D 非线性优化。实验在公开数据和 Mini-Cheetah 数据集上显示,其在动态步态中位置误差小于 7 cm,并能稳定跟踪后空翻,而对比方法出现终止或发散。

Event-based Agile Object Catching with a Quadrupedal Robot Figure 1
arXiv preprint2023

Event-based Agile Object Catching with a Quadrupedal Robot

Benedek Forrai, Takahiro Miki, Daniel Gehrig, Marco Hutter, Davide Scaramuzza

ETH Zurich,Robotic Systems Lab,Department of Mechanical Engineering,Switzerland, Department of Mechanical Engineering, Robotic Systems Lab, ETH Zurich, Switzerland, ETH Zurich, Robotics and Perception Group, University of Zurich,Switzerland, Robotics and Perception Group, University of Zurich, Switzerland, Robotics Research (United States), University of Zurich

四足机器人机器人学习足式机器人敏捷运动

针对RGB相机/LiDAR在高速动态场景中的带宽—延迟瓶颈,本文将事件相机用于四足机器人板载接球:先从事件流中分割独立运动目标并拟合弹道抛物线,再由数据驱动控制策略驱动带网四足机动拦截。系统在Jetson Orin上以100Hz运行,可从4米外接住最高15m/s的飞行物,成功率83%。

Expanding Versatility of Agile Locomotion through Policy Transitions Using Latent State Representation Figure 1
arXiv preprint2023

Expanding Versatility of Agile Locomotion through Policy Transitions Using Latent State Representation

Jonathan Hans

Inventec Corporation, Taipei, Taiwan

四足机器人机器人学习运动控制敏捷运动

针对四足机器人技能库扩展时需重训、且不同步态间切换在真实环境中易失稳的问题,论文将各步态拆成独立策略,并用策略潜在状态表示训练 transition-net 判断可行切换时机,由元控制器统一调度。方法支持新增技能而不改旧策略,单个策略训练少于1小时,并在真实A1机器人上使困难切换对平均成功率较已有方法提升19%。

Extreme Parkour with Legged Robots Figure 1
arXiv preprint2023

Extreme Parkour with Legged Robots

Xuxin Cheng, Kexin Shi, Ananye Agarwal, Deepak Pathak

Carnegie Mellon University

四足机器人机器人学习足式机器人跑酷

论文针对四足机器人跑酷中感知噪声、执行滞后与动作精度要求极高的矛盾,放弃显式建图和规划,训练单个端到端策略直接由前视深度图输出电机控制。核心在于两阶段强化学习与双重蒸馏,使策略同时学会运动控制和自主调整朝向,并用统一内积奖励覆盖多种技能。实机 Unitree A1 可越过约自身 2 倍高度/长度的障碍与沟壑、上斜坡并前腿倒立行走。

From Data-Fitting to Discovery: Interpreting the Neural Dynamics of Motor Control through Reinforcement Learning Figure 1
arXiv preprint2023

From Data-Fitting to Discovery: Interpreting the Neural Dynamics of Motor Control through Reinforcement Learning

作者信息待提取

Department of Mechanical Engineering, University of Colorado Boulder

四足机器人机器人学习强化学习

本文针对运动神经科学中 RNN 多停留在数据拟合、缺少闭环具身验证的问题,用 Isaac Gym 中的 Anymal 四足机器人和带 LSTM 的强化学习控制器作为虚拟实验平台,分析其行走时的神经动力学。核心发现是,递归层在多种前进、侧向和转向速度下形成低缠结的周期轨迹,明显低于输入驱动的执行层,并可用速度轴解释轨迹分离;这支持灵长类行走/骑行实验中的低缠结原则,并展示 RL 具身模型可用于发现而非仅拟合神经动力学。

Geometric Mechanics of Contact-Switching Systems Figure 1
IEEE RA-L 20232023

Geometric Mechanics of Contact-Switching Systems

Hari Krishna Hari

start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT Animal Inspired Movement and Robotics Laboratory, Paul M

四足机器人机器人学习

针对腿式机器人周期性触地/离地导致传统几何力学难以直接处理多接触模式的问题,本文把步态建模为含连续摆腿与离散接触切换的混合形状空间,并用扩展 Stokes 定理得到“分层面板”离散曲率来估计平均位移。作者在双足玩具模型上给出带摆腿与切换代价的步态优化,并在三接触系统中展示复杂步态可分解与降维,说明方法可扩展到多足接触切换分析。

Grow Your Limits: Continuous Improvement with Real-World RL for Robotic Locomotion Figure 1
arXiv preprint2023

Grow Your Limits: Continuous Improvement with Real-World RL for Robotic Locomotion

Laura Smith, Yunhao Cao, Sergey Levine

Berkeley AI Research, UC Berkeley, University of California, Berkeley

四足机器人机器人学习强化学习运动控制

这篇论文针对真实四足机器人上端到端强化学习样本昂贵、易摔倒且后期性能停滞的问题,提出 APRL:用机器人已收集数据训练动力学模型,并以预测误差自适应调节动作正则化,使策略早期保守探索、熟悉环境后逐步放开动作,在动力学变化时收紧。实验在 Unitree Go1 上从零开始数分钟学会前进,并在持续训练后较基线速度提升约 1.4 倍,在斜坡、记忆海绵、草地等场景平均速度约提升 2 倍且可继续微调适应。

Guardians as You Fall: Active Mode Transition for Safe Falling Figure 1
arXiv preprint2023

Guardians as You Fall: Active Mode Transition for Safe Falling

Yikai Wang, Mengdi Xu, Guanya Shi, Ding Zhao

Carnegie Mellon University,Pittsburgh,PA,USA, Carnegie Mellon University

四足机器人机器人学习安全恢复

面向四足机器人高速运动、跳跃等高能任务中难以避免的摔倒风险,本文不再只做倒地后恢复,而提出 GYF 分层框架:高层规划器在任务策略、主动翻滚过渡控制器和恢复控制器间切换,使机器人在失稳前主动转移到站立、常规或背部朝地等稳定模式。仿真与实机显示,相比基线其机身最大加速度和 jerk 降低约 20%–73%,但更强安全约束的集成仍待进一步研究。

Hierarchical Experience-informed Navigation for Multi-modal Quadrupedal Rebar Grid Traversal Figure 1
arXiv preprint2023

Hierarchical Experience-informed Navigation for Multi-modal Quadrupedal Rebar Grid Traversal

Max Asselmeier, Jane Ivanova, Ziyi Zhou, Patricio A. Vela, Ye Zhao

Georgia Institute of Technology,School of Mechanical Engineering,Atlanta,GA,USA,30308, Georgia Institute of Technology, Georgia Institute of Technology,School of Electrical and Computer Engineering,Atlanta,GA,USA,30308

四足机器人机器人学习足式机器人导航

针对四足机器人在钢筋网格等受限环境中落足组合爆炸、同时满足动力学可行性困难的问题,论文将多模态规划中的经验启发引入接触序列搜索,用低层轨迹优化代价更新模式转移图,并加入躯干路径引导全局导航。实验显示该引导能显著减少离线试验次数、提高到达成功率,生成轨迹在仿真与 Skymul 四足硬件上得到验证。

No Figure
Nature Machine Intelligence2023

Identifying important sensory feedback for learning locomotion skills

Wanming Yu, Chuanyu Yang, Christopher McGreavy, Eleftherios Triantafyllidis, Guillaume Bellegarda, Milad Shafiee, Auke Jan Ijspeert, Zhibin Li

School of Informatics, University of Edinburgh, Edinburgh, UK, University of Edinburgh, Shenzhen Amigaga Technology, Shenzhen, China, Shenzhen Technology University, Department of Computer Science, University College London, London, UK, University College London

四足机器人机器人学习运动控制

全文短总结尚未生成。

No Figure
IEEE Access2023

Intelligent Control of Multilegged Robot Smooth Motion: A Review

Yongyong Zhao, Jinghua Wang, Guohua Cao, Yi Yuan, Xu Yao, Luqiang Qi

Changchun University of Science and Technology, Chongqing Research Institute, Changchun University of Science and Technology, Chongqing, China, Chongqing University of Science and Technology

四足机器人机器人学习足式机器人

全文短总结尚未生成。

iPlanner: Imperative Path Planning Figure 1
arXiv preprint2023

iPlanner: Imperative Path Planning

Fan Yang, Chen Wang, Cesar Cadena, Marco Hutter

四足机器人机器人学习导航规划

本文针对传统感知-建图-搜索式导航管线延迟高、误差易累积,以及端到端学习依赖标注或训练低效的问题,提出 iPlanner 的 Imperative Learning:用可微代价地图提供隐式任务监督,并通过网络预测与基于度量的轨迹优化构成双层优化,从单帧深度直接生成平滑避障路径。实验显示其规划约快于经典方法 4 倍,对定位噪声更稳健,并在未见环境中相对学习基线提升 26–87% SPL。

Language to Rewards for Robotic Skill Synthesis Figure 1
arXiv preprint2023

Language to Rewards for Robotic Skill Synthesis

Wenhao Yu, Nimrod Gileadi, Chuyuan Fu, Sean Kirmani, Kuang-Huei Lee, Montse Gonzalez Arenas, Hao-Tien Lewis Chiang, Tom Erez, Leonard Hasenclever, Jan Humplik, Brian Ichter, Ted Xiao, Peng Xu, Andy Zeng, Tingnan Zhang, Nicolas Heess, Dorsa Sadigh, Jie Tan, Yuval Tassa, Fei Xia

Google DeepMind

四足机器人机器人学习运动生成

这篇工作针对 LLM 难以直接生成硬件相关低层控制、而依赖人工技能库又限制表达能力的问题,提出让 LLM 将语言指令和反馈转成可优化的奖励参数,再由 MuJoCo MPC 实时合成动作。关键洞察是奖励比动作更接近语言中的行为目标且具组合性。仿真中在四足与灵巧手 17 个任务上成功约 90%,高于基于原语接口的 Code-as-Policies 基线 50%,并在真实机械臂上展示了非抓取推物等交互生成技能。

Layered Control for Cooperative Locomotion of Two Quadrupedal Robots: Centralized and Distributed Approaches Figure 1
T-RO 20232022

Layered Control for Cooperative Locomotion of Two Quadrupedal Robots: Centralized and Distributed Approaches

Kaveh Akbari

Department of Mechanical Engineering, Virginia Tech, Blacksburg, VA, USA, Department of Mechanical and Civil Engineering, California Institute of Technology, Pasadena, CA, USA, California Institute of Technology

四足机器人机器人学习足式机器人运动控制多机器人协作

面向两台四足机器人在搬运载荷等完整约束协作任务中的实时稳定行走,论文提出分层控制框架:上层以互联单刚体降阶模型做集中式/分布式 MPC 规划,下层用分布式非线性 QP/I-O 线性化跟踪全阶动力学。A1 实验和大量仿真显示,两种 MPC 均能在载荷、扰动和多地形下实现鲁棒协同行走,分布式方案成功率接近集中式但计算时间显著降低。

Learning a Single Policy for Diverse Behaviors on a Quadrupedal Robot using Scalable Motion Imitation Figure 1
arXiv preprint2023

Learning a Single Policy for Diverse Behaviors on a Quadrupedal Robot using Scalable Motion Imitation

Arnaud Klipfel, Nitish Sontakke, Ren Liu, Sehoon Ha

School of Interactive Computing, Georgia Institute of Technology,Atlanta,GA,USA,30308, Georgia Institute of Technology, Meta Platforms, Inc.,USA, Meta Platforms, Inc., USA, Meta (United States)

四足机器人机器人学习足式机器人模仿学习

针对四足机器人为行走、跳跃、坐卧等技能分别设计模型或奖励成本高的问题,论文将狗动作库重定向到 A1,并在 DeepMimic 式模仿学习上重设观测、动作与奖励,引入自适应动作采样以关注难轨迹并缓解遗忘。结果显示单一策略可跟踪 701 段、15 类动作及星形路径、多跳等分布外序列;消融表明 AMS 对覆盖全部技能关键,但尚未实机验证。

Learning Agility and Adaptive Legged Locomotion via Curricular Hindsight Reinforcement Learning Figure 1
Scientific Reports2023

Learning Agility and Adaptive Legged Locomotion via Curricular Hindsight Reinforcement Learning

Sicen Li, Gang Wang, Yiming Pang, Panju Bai, Shihao Hu, Zhaojin Liu, Liquan Wang, Jiawei Li

The College of Mechanical and Electrical Engineering, Harbin Engineering University, Harbin, 150001, China, Harbin Engineering University, The College of Shipbuilding Engineering, Harbin Engineering University, Harbin, 150001, China

四足机器人机器人学习足式机器人强化学习运动控制

针对四足机器人在野外高速转向、跌倒恢复和扰动后继续运动中难以稳定学习的问题,论文提出 CHRL:用自动课程调节指令范围、奖励权重和环境难度,并将 HER 改造到速度命令跟踪以复用旧经验。仿真训练的策略可零样本部署到实机,在草地、泥地等自然地形实现最高 3.45 m/s 前进、3.2 rad/s 转向,并能在碰撞、踩坑跌倒后约 1 秒内恢复。

Learning and Adapting Agile Locomotion Skills by Transferring Experience Figure 1
arXiv preprint2023

Learning and Adapting Agile Locomotion Skills by Transferring Experience

Xue Bin

Berkeley AI Research, UC Berkeley, University of California, Berkeley, Google Research, Google (United States), Georgia Institute of Technology, Simon Fraser University

四足机器人机器人学习运动控制敏捷运动

四足机器人敏捷跳跃、后腿行走等技能难以靠从零强化学习探索,且奖励塑形成本高。本文将问题转化为经验迁移:把已有但可能次优、来自不同目标或环境的源控制器数据并入离策略训练,作为新任务初始化。实验显示该框架能提升跨障碍连续跳跃、后腿导航和新环境适应的学习效率,并在真实 A1 上实现单次越过约 20 cm 障碍及后腿行走。

No Figure
IEEE RA-L 20232023

Learning Complex Motor Skills for Legged Robot Fall Recovery

Chuanyu Yang, Can Pu, Guiyang Xin, Jie Zhang, Zhibin Li

Shenzhen Amigaga Technology Company Ltd., Shenzhen, China, School of Optoelectronic Engineering and Instrumentation Science, Dalian University of Technology, Dalian, China, Dalian University of Technology, Dalian University, University of Science and Technology Beijing, Department of Computer Science, University College London, London, U.K, University College London

四足机器人机器人学习足式机器人安全恢复运动控制

全文短总结尚未生成。

Learning Low-Frequency Motion Control for Robust and Dynamic Robot Locomotion Figure 1
arXiv preprint2022

Learning Low-Frequency Motion Control for Robust and Dynamic Robot Locomotion

Siddhant Gangapurwala, Luigi Campanaro, Ioannis Havoutis

Oxford Robotics Institute, University of Oxford,Dynamic Robots Systems (DRS) group,UK, Dynamic Robots Systems (DRS) group, Oxford Robotics Institute, University of Oxford, UK, University of Oxford, Robotics Research (United States)

四足机器人机器人学习运动控制

论文质疑“腿式机器人控制频率越高越鲁棒”的常见假设,受动物低频感知-运动控制启发,用强化学习在 ANYmal C 上训练低频本体/感知运动策略。核心洞察是低频策略对执行延迟和动力学偏差更不敏感,甚至可减少动力学随机化与执行器建模依赖;实机在低至 8 Hz 下实现约 1.5 m/s 行走、越过不平地形并抵抗外部扰动。

Learning Multiple Gaits within Latent Space for Quadruped Robots Figure 1
arXiv preprint2023

Learning Multiple Gaits within Latent Space for Quadruped Robots

Jinze Wu, Yufei Xue, Chenkun Qi

四足机器人机器人学习足式机器人运动控制

针对四足机器人在不同速度、地形与用户步态指令下难以同时保持自然性、可控性和鲁棒性的问题,论文提出端到端强化学习框架,用步态编码器与生成器共同构建潜空间,并结合显式步态参数奖励与条件对抗运动先验学习多种步态。Go1 实验显示系统可在仅本体感知下实现行走、 trot、pace、pronking、bounding 等步态及平滑切换,并保持较强室外运动能力。

Learning Quadruped Locomotion using Bio-Inspired Neural Networks with Intrinsic Rhythmicity Figure 1
arXiv preprint2023

Learning Quadruped Locomotion using Bio-Inspired Neural Networks with Intrinsic Rhythmicity

Chuanyu Yang, Can Pu, Tianqi Wei, Cong Wang, Zhibin Li

四足机器人机器人学习足式机器人运动控制

面向四足机器人无需外部相位输入即可产生自适应节律步态的问题,论文将生物启发的 CPG 与感知反馈 MLP 结合,并把 CPG 内部状态显式化为可微无状态网络,使二者可用深度强化学习联合训练。仿真中策略能跟踪目标速度,在不平地形、楼梯、外载和外部推扰下保持运动,并随速度自调步频与步长;但尚未实机验证。

No Figure
Science Robotics2023

Learning quadrupedal locomotion on deformable terrain

Suyoung Choi, Gwanghyeon Ji, Jeongsoo Park, Hyeongjun Kim, Juhyeok Mun, Jeong Hyun Lee, Jemin Hwangbo

Robotics & Artificial Intelligence Lab, KAIST, Daejeon, Korea, Robotics Research (United States), Centre for Artificial Intelligence and Robotics

四足机器人机器人学习足式机器人运动控制地形感知

全文短总结尚未生成。

No Figure
IEEE RA-L 20232023

Learning Robust and Agile Legged Locomotion Using Adversarial Motion Priors

Jinze Wu, Guiyang Xin, Chenkun Qi, Yufei Xue

School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China, Shanghai Jiao Tong University, School of Biomedical Engineering, Dalian University of Technology, Dalian, China, Dalian University of Technology

四足机器人机器人学习足式机器人运动控制敏捷运动

全文短总结尚未生成。

No Figure
IEEE Access2023

Learning Robust Perception-Based Controller for Quadruped Robot

Fikih Muhamad, Jung-Su Kim, Jae-Han Park

Seoul National University of Science and Technology, AI Robot Research and Development Department, Korea Institute of Industrial Technology (KITECH), Ansan, South Korea, Korea Institute of Industrial Technology

四足机器人机器人学习足式机器人感知

全文短总结尚未生成。

Learning to Exploit Elastic Actuators for Quadruped Locomotion Figure 1
arXiv preprint2023

Learning to Exploit Elastic Actuators for Quadruped Locomotion

Antonin Raffin, Daniel Seidel, Jens Kober, Freek Stulp

四足机器人机器人学习足式机器人运动控制硬件设计

针对弹性驱动四足机器人虽具储能与顺应优势、但控制器设计依赖建模和调参的问题,本文在真实 DLR bert 上直接学习无模型控制:先用 CPG 与黑箱优化得到开环步态,再用强化学习学习残差反馈。实验表明小跑和原地跳跃会自然利用弹簧能量,训练约 1.5 小时内完成,并达到 bert 已记录最快行走速度 0.34 m/s,步态较自然且无需仿真到现实迁移。

Learning to Walk by Steering: Perceptive Quadrupedal Locomotion in Dynamic Environments Figure 1
arXiv preprint2023

Learning to Walk by Steering: Perceptive Quadrupedal Locomotion in Dynamic Environments

Mingyo Seo, Ryan Gupta, Yifeng Zhu, Alexy Skoutnev, Luis Sentis, Yuke Zhu

The University of Texas at Austin, Vanderbilt University

四足机器人机器人学习足式机器人运动控制仿真基准

面向人群与杂物共存的动态室内环境,论文指出端到端视觉到关节控制难以跨越仿真真实差距且样本开销高。PRELUDE将问题拆成高层RGB-D导航与低层步态执行:前者用可转向小车采集的人类示范做模仿学习,后者在仿真中用强化学习跟踪速度指令。实验显示其在仿真中较强化学习基线提升35.4%,并能迁移到四足实机,在未见场景中绕开行人与障碍。

Learning Whole-body Manipulation for Quadrupedal Robot Figure 1
IEEE RA-L 20232023

Learning Whole-body Manipulation for Quadrupedal Robot

Seunghun Jeon, Moonkyu Jung, Suyoung Choi, Beomjoon Kim, Jemin Hwangbo

Department of Mechanical Engineering, Robotics and Artificial Intelligence Laboratory, KAIST, Daejeon, Republic of Korea, Korea Advanced Institute of Science and Technology, Department of Kim Jaechul Graduate School of AI, Intelligent Mobile Manipulation Laboratory, KAIST, Seoul, Republic of Korea

四足机器人机器人学习足式机器人操作全身控制

针对四足机器人在工业场景中需移动大而重、不可抓取且物性未知物体的问题,本文用分层学习控制替代显式建模与优化规划:高层给速度指令,低层跟踪关节目标,并通过交互、本体感知和动作历史的潜变量嵌入隐式估计物体特性。仿真中对多类物体重定位/重定向成功率达93.6%,实机可推动19.2 kg水桶和15.3 kg箱体,接近机器人自重的70%。

Legs as Manipulator: Pushing Quadrupedal Agility Beyond Locomotion Figure 1
arXiv preprint2023

Legs as Manipulator: Pushing Quadrupedal Agility Beyond Locomotion

Xuxin Cheng, Ashish Kumar, Deepak Pathak

Carnegie Mellon University, UC Berkeley, Berkeley College, University of California, Berkeley

四足机器人机器人学习足式机器人运动控制

论文针对四足机器人虽能复杂地形行走、却难以像动物一样用腿完成交互的问题,提出将前腿作为“操作器”的学习框架:把技能拆成行走/爬墙等运动策略与单腿按按钮等操作策略,在仿真中用课程强化学习训练,并通过统一状态估计和在线自适应迁移到真实机器人,再用一次专家演示学习行为树串联长程任务。实验展示了真实场景中爬墙按门禁按钮、开门、踢球等短程与长程任务,并能在扰动下恢复执行。

Lifelike Agility and Play on Quadrupedal Robots using Reinforcement Learning and Generative Pre-trained Models Figure 1
arXiv preprint2023

Lifelike Agility and Play on Quadrupedal Robots using Reinforcement Learning and Generative Pre-trained Models

Lei Han, Qingxu Zhu, Jiapeng Sheng, Chong Zhang, Tingguang Li, Yizheng Zhang, He Zhang, Yuzhen Liu, Cheng Zhou, Rui Zhao, Jie Li, Yufeng Zhang, Rui Wang, Wanchao Chi, Xiong Li, Yonghui Zhu, Lingzhu Xiang, Xiao Teng, Zhengyou ZHANG

Tencent Robotics X, Shenzhen, China

四足机器人机器人学习足式机器人强化学习运动生成

为减少四足敏捷运动对精确模型和手工奖励的依赖,论文把动物运动先验、环境穿越能力和任务策略拆成可预训练复用的层级控制器;核心是用 VQ-PMC 从犬类动作中学习离散生成式运动表征,再由上层策略选择这些原语。实机 MAX 机器人展示了仿动物步态、钻越/跳跃障碍和多智能体追逐游戏中的敏捷行为,但对不同模块增益的来源仍需结合消融理解。

Mastering Diverse Domains through World Models Figure 1
arXiv preprint2023

Mastering Diverse Domains through World Models

Danijar Hafner, Jurgis Pasukonis, Jimmy Ba, Timothy Lillicrap

四足机器人机器人学习世界模型

论文针对强化学习跨领域迁移时高度依赖人工调参与专用算法的问题,提出 DreamerV3:以学习到的世界模型在潜在空间中想象未来,并用归一化、损失平衡和数值变换提升不同奖励尺度与任务形态下的稳定性。单一配置在 150 多个任务上超过多种专用方法,并在无人工数据和课程的情况下从零学会 Minecraft 挖钻石。

No Figure
IEEE Transactions on Automation Science and Engineering2023

Max: A Wheeled-Legged Quadruped Robot for Multimodal Agile Locomotion

Qinqin Zhou, Sicheng Yang, Xinyang Jiang, Dongsheng Zhang, Wanchao Chi, Ke Chen, Shenghao Zhang, Jie Li, Jingfan Zhang, Rui Wang, Jingchen Li, Yufeng Zhang, Haitao Wang, Shuai Wang, Lingzhu Xiang, Yu Zheng, Zhengyou Zhang

Tencent Robotics X, Tencent Binhai Building, Shenzhen, Guangdong, China, Tencent (China)

四足机器人机器人学习足式机器人运动控制敏捷运动

全文短总结尚未生成。

Multi-Contact Whole Body Force Control for Position-Controlled Robots Figure 1
IEEE RA-L 20242023

Multi-Contact Whole Body Force Control for Position-Controlled Robots

Quentin Rouxel, Serena Ivaldi, Jean-Baptiste Mouret

Centre National de la Recherche Scientifique, Centre Inria de l'Université de Lorraine

四足机器人机器人学习全身控制

面向多数人形/多足机器人仍采用位置控制、难以直接分配多接触力的问题,论文提出 SEIKO:显式利用关节/结构柔顺性,把位置指令与接触力变化联系起来,并用实时序贯 QP 统一处理全身重定向与力反馈。该方法在 Talos 实机上完成推压、远距离够取、爬楼梯和斜面落脚等多接触任务,显示出相较逐末端导纳更能在接近约束边界时维持可行性与鲁棒性,但仍受准静态假设和柔顺模型精度限制。

Not Only Rewards But Also Constraints: Applications on Legged Robot Locomotion Figure 1
T-RO 20242023

Not Only Rewards But Also Constraints: Applications on Legged Robot Locomotion

Yunho Kim, Hyunsik Oh, Jeonghyun Lee, Jinhyeok Choi, Gwanghyeon Ji, Moonkyu Jung, Donghoon Youm, Jemin Hwangbo

Robotics and Artificial Intelligence Lab, KAIST, Daejeon, South Korea

四足机器人机器人学习足式机器人运动控制

这篇论文针对足式机器人强化学习中过度依赖奖励工程、权重调参繁琐且跨平台泛化差的问题,提出把硬件限制、步态偏好等工程意图显式写成约束,并配套两类约束形式与低额外开销的策略优化算法。实验在多种四足和双足机器人、仿真与实机复杂地形上验证,该方法在基本保持鲁棒运动性能的同时,将调参负担显著降到少量奖励系数,体现出约束的可解释性和跨形态复用价值。

OPT-Mimic: Imitation of Optimized Trajectories for Dynamic Quadruped Behaviors Figure 1
arXiv preprint2023

OPT-Mimic: Imitation of Optimized Trajectories for Dynamic Quadruped Behaviors

Yuni Fuchioka, Zhaoming Xie, Michiel Van de Panne

The University of British Columbia,Faculty of Computer Science, Faculty of Computer Science, The University of British Columbia, University of British Columbia, Department of Computer Science, Stanford University, Stanford University

四足机器人机器人学习足式机器人模仿学习敏捷运动

该文针对纯 RL 四足敏捷动作奖励难调、轨迹优化又缺鲁棒反馈的问题,提出用单刚体轨迹优化生成参考,再以模仿强化学习在全模型中学习残差 PD 控制,并系统比较位置、速度、力矩等前馈信息的作用。结果在 Solo 8 上实现小跑、前跳、180 度后空翻和双足踏步等动作,均从仿真零微调迁移到实机;同时指出前馈设计会显著影响学习效率与 sim-to-real 稳定性。

No Figure
IEEE RA-L 20232023

ORBIT: A Unified Simulation Framework for Interactive Robot Learning Environments

Mayank Mittal, Calvin Yu, Qinxi Yu, Jingzhou Liu, Nikita Rudin, David Hoeller, Jia Lin Yuan, Ritvik Singh, Yunrong Guo, Hammad Mazhar, Ajay Mandlekar, Buck Babich, Gavriel State, Marco Hutter, Animesh Garg

Robotic Systems Lab, ETH Zurich, Zurich, Switzerland, NVIDIA, Santa Clara, CA, USA, ETH Zurich, Nvidia (United States), Vector Institute, University of Toronto, Toronto, ON, Canada, University of Toronto, Vector Institute

四足机器人机器人学习仿真基准

全文短总结尚未生成。

No Figure
Preprint2023

Orthrus: A Dual-arm Quadrupedal Robot for Mobile Manipulation and Entertainment Applications

Sankalp Yamsani, Sean Taylor, Kazuki Shin, Jooyoung Hong, Dhruv C. Mathur, Kevin Gim, Joohyung Kim

University of Illinois,KIMLAB (Kinetic Intelligent Machine LAB),Urbana,Champaign, KIMLAB (Kinetic Intelligent Machine LAB), University of Illinois, Urbana, Champaign, University of Illinois Urbana-Champaign

四足机器人机器人学习足式机器人操作

全文短总结尚未生成。

Perceptive Locomotion through Nonlinear Model Predictive Control Figure 1
T-RO 20232022

Perceptive Locomotion through Nonlinear Model Predictive Control

Ruben Grandia, Fabian Jenelten, Shaohui Yang, Farbod Farshidian, Marco Hutter

Department of Mechanical and Process Engineering, ETH Zurich, Zurich, Switzerland, ETH Zurich

四足机器人机器人学习运动控制模型预测控制感知

针对四足机器人在台阶、沟壑等复杂地形中需同时处理精确落足、避碰和欠驱动动力学的难题,论文将感知地形转化为局部凸落足约束与符号距离场,并嵌入全自由度非线性MPC,配合多重射击、实时迭代和滤波线搜索提升在线求解可靠性。方法在ANYmal仿真与实机的斜坡、空隙、踏脚石场景中验证,实现了动态攀爬和较高难度的感知运动控制。

Puppeteer and Marionette: Learning Anticipatory Quadrupedal Locomotion Based on Interactions of a Central Pattern Generator and Supraspinal Drive Figure 1
arXiv preprint2023

Puppeteer and Marionette: Learning Anticipatory Quadrupedal Locomotion Based on Interactions of a Central Pattern Generator and Supraspinal Drive

Milad Shafiee, Guillaume Bellegarda, Auke Ijspeert

Ecole Polytechnique Federale de Lausanne (EPFL),BioRobotics Laboratory, BioRobotics Laboratory, Ecole Polytechnique Federale de Lausanne (EPFL)

四足机器人机器人学习足式机器人运动控制

论文关注四足动物跨沟等预期性运动中,大脑下行驱动与脊髓 CPG 各自承担什么作用。作者用深度强化学习将神经网络作为“上位驱动”,比较其调制 CPG 频率/幅值与直接绕过 CPG 调整足端偏置的效果。结果显示,直接作用于执行信号是高成功率跨沟的关键,而 CPG 有助于步态平滑和能效;仅利用前足到沟边距离已足以学习,Go1 可在无显式动力学模型和 MPC 下跨越最高 20 cm 缝隙。

PyPose: A Library for Robot Learning with Physics-based Optimization Figure 1
arXiv preprint2023

PyPose: A Library for Robot Learning with Physics-based Optimization

Chen Wang, Dasong Gao, Kuan Xu, Junyi Geng, Yaoyu Hu, Yuheng Qiu, Bowen Li, Fan Yang, Brady Moon, Abhinav Pandey, Jiahe Xu, Tianhao Wu, Haonan He, Daning Huang, Zhongqiang Ren, Shibo Zhao, Taimeng Fu, Pranay Reddy, Xiao Lin, Wenshan Wang, Jingnan Shi, Rajat Talak, Kun Cao, Yi Du, Han Wang, Huai Yu, Shanzhao Wang, Siyu Chen, Ananth Kashyap, Rohan Bandaru

Carnegie Mellon University,Pittsburgh,PA,USA,15213, State University of New York, Buffalo, NY, USA, Carnegie Mellon University, University at Buffalo, State University of New York, Massachusetts Institute of Technology, Cambridge, MA, USA, Massachusetts Institute of Technology, Nanyang Technological University,Singapore,639798, Nanyang Technological University, ETH Zürich,Zürich,Switzerland,8092, Pennsylvania State University, University Park,PA,USA,16801, Pennsylvania State University, Delhi Technological University, Delhi, India

四足机器人机器人学习

针对机器人中深度感知与基于物理的优化常被割裂、跨 Python/C++ 调试和数据传输拖慢端到端研究的问题,PyPose 将李群/李代数运算、任意阶梯度和信赖域等二阶优化器集成到 PyTorch 中,使 SLAM、规划、控制和惯导等任务可在统一框架内可微建模。实验显示其相较现有库计算速度可超过 10×,但具体增益在不同任务中的来源仍需结合实现细节判断。

QUAR-VLA: Vision-Language-Action Model for Quadruped Robots Figure 1
arXiv preprint2023

QUAR-VLA: Vision-Language-Action Model for Quadruped Robots

Pengxiang Ding, Han Zhao, Wenjie Zhang, Wenxuan Song, Min Zhang, Siteng Huang, Ningxi Yang, Donglin Wang

Westlake University, Zhejiang University

四足机器人机器人学习足式机器人视觉语言动作

针对四足机器人中视觉感知与语言指令常被分开建模、难以支持细粒度组合任务的问题,论文提出 QUAR-VLA 范式,并构建 QUARD 多任务数据集与 QUART 模型,将第一视角图像和自然语言映射为包含速度、姿态与步态参数的可执行控制命令。实验表明该方法可获得有效策略并具备一定泛化能力,但具体增益可能主要来自数据规模与预训练视觉语言模型。

Reinforcement Learning for Legged Robots: Motion Imitation from Model-Based Optimal Control Figure 1
arXiv preprint2023

Reinforcement Learning for Legged Robots: Motion Imitation from Model-Based Optimal Control

作者信息待提取

四足机器人机器人学习足式机器人强化学习模仿学习

针对足式机器人中模型控制可解释但受建模/估计误差影响、纯强化学习又难调且依赖动作重定向的问题,论文提出 MIMOC:用模型最优控制在仿真中生成动态一致、机器人专属且含力矩的参考轨迹,仅用于奖励和初始化来训练策略。结果显示其可在 Mini-Cheetah 户外复杂地形部署、在 MIT Humanoid 仿真迁移,并在噪声状态估计和低摩擦场景下超过原模型控制器,力矩模仿对收敛和实机性能关键。

Resilient Legged Local Navigation: Learning to Traverse with Compromised Perception End-to-End Figure 1
arXiv preprint2023

Resilient Legged Local Navigation: Learning to Traverse with Compromised Perception End-to-End

Chong Zhang, Jin Jin, Jonas Frey, Nikita Rudin, Matías Mattamala, Cesar Cadena, Marco Hutter

ETH Zurich,Robotic Systems Lab,Zurich,Switzerland, Robotic Systems Lab, ETH Zurich, Zurich, Switzerland, ETH Zurich, the University of Oxford,Oxford Robotics Institute,UK, Oxford Robotics Institute, the University of Oxford, UK, University of Oxford

四足机器人机器人学习足式机器人导航感知

本文关注四足机器人在透明障碍、遮挡坑洞、恶劣天气等导致外感知失效时的局部导航问题。核心做法是把失效建模为“不可见”障碍/坑洞,用端到端强化学习结合本体感知、低层外感知与记忆,在潜空间补全环境并生成速度指令,而非依赖手工异常检测规则。仿真和 ANYmal 实机表明,在感知受损时成功率较启发式局部规划器提升超过 30%,全盲条件下仍能碰撞后侧移或从坑中恢复。

No Figure
Preprint2023

Responsive CPG-Based Locomotion Control for Quadruped Robots

Yihui Zhang, Cong Hu, Binbin Qiu, Ning Tan

School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China, Sun Yat-sen University, Guangxi Key Laboratory of Automatic Detecting Technology and Instruments, Guilin University of Electronic Technology, Guilin, China, Guilin University of Electronic Technology, School of Intelligent Systems Engineering, Sun Yat-sen University, Shenzhen, China

四足机器人机器人学习足式机器人运动控制

全文短总结尚未生成。

RL + Model-based Control: Using On-demand Optimal Control to Learn Versatile Legged Locomotion Figure 1
IEEE RA-L 20232023

RL + Model-based Control: Using On-demand Optimal Control to Learn Versatile Legged Locomotion

Dongho Kang, Jin Cheng, Miguel Zamora, Fatemeh Zargarbashi, Stelian Coros

Computational Robotics Lab in the Department of Computer Science, ETH Zurich, Zurich, Switzerland, ETH Zurich

四足机器人机器人学习足式机器人强化学习运动控制

针对模型最优控制依赖简化假设、RL又需繁琐奖励塑形的问题,本文将有限时域最优控制按需生成的多步态、多速度参考运动嵌入RL模仿学习,使策略从可控示范出发并在全身动力学仿真中弥补简化模型缺陷。实验在Unitree Go1与Aliengo上显示,该方法能保持不同步态、响应速度指令,并泛化到身体转动、崎岖地形等OCP难以覆盖的任务,且无需为不同尺寸机器人重调奖励和超参数。

RoboHive: A Unified Framework for Robot Learning Figure 1
NeurIPS 20232023

RoboHive: A Unified Framework for Robot Learning

Vikash Kumar, Rutav Shah, Gaoyue Zhou, Vincent Moens, Vittorio Caggiano, Jay Vakil, Abhishek Gupta

U.Washingtonι, UC Berkeleyλ, CMUγ, UT Austinδ, OpenAIκ, GoogleAIζ, Meta-AIϕ

四足机器人机器人学习

机器人学习长期受环境与接口碎片化、基准不统一影响,难以快速复现和比较。RoboHive的核心贡献是把灵巧手、机械臂、四足/双足运动、肌骨与可变形物体等任务整合到统一的Gym式接口中,并提供仿真/真机Robot-Class、遥操作、RoboSet专家数据、高保真物理与视觉随机化。结果上,它给多数环境配套指标、示范和基线,形成可用于强化学习、模仿学习和迁移研究的开放基准,但算法增益本身并非本文重点。

Robot Parkour Learning Figure 1
OpenReview preprint2023

Robot Parkour Learning

Chelsea Finn Hang Zhao

四足机器人机器人学习跑酷

面向低成本四足机器人在复杂环境中自主跑酷的需求,论文指出现有方法往往只能获得盲技能或单一视觉技能。其核心做法是用受直接配点启发的两阶段强化学习,先以可穿透障碍的软动力学约束缓解探索,再用真实硬约束微调,并通过 DAgger 将攀爬、跨越、匍匐、侧身穿缝和奔跑蒸馏为单一端到端深度视觉策略。实验证明该策略可在 A1 和 Go1 上仅靠机载感知、计算与供电完成最高 0.40m 障碍、0.60m 间隙等真实跑酷任务。

Robust Quadrupedal Locomotion via Risk-Averse Policy Learning Figure 1
arXiv preprint2023

Robust Quadrupedal Locomotion via Risk-Averse Policy Learning

Jiyuan Shi, Chenjia Bai, Haoran He, Lei Han, Dong Wang, Bin Zhao, Mingguo Zhao, Xiu Li, Xuelong Li

Tsinghua University,China, Tsinghua University, Shanghai Artificial Intelligence Laboratory,China, Beijing Academy of Artificial Intelligence, Shanghai Artificial Intelligence Laboratory, Tencent Robotics X,China, Tencent (China)

四足机器人机器人学习足式机器人运动控制

针对四足机器人在突发地形变化、外力冲击等不确定场景中易失稳的问题,论文提出 RALL:用分布式价值函数和分位数回归刻画环境偶然风险,并通过 CVaR 优化最差情形,同时以 IQR 估计风险水平以切换风险偏好策略。仿真与 Aliengo 实机实验显示,该方法无需外部传感器或大规模随机化,也能提升抗推扰、动态载荷和复杂地形通过能力。

Robust Recovery Motion Control for Quadrupedal Robots via Learned Terrain Imagination Figure 1
arXiv preprint2023

Robust Recovery Motion Control for Quadrupedal Robots via Learned Terrain Imagination

I Made Aswin

四足机器人机器人学习足式机器人安全恢复地形感知

面向四足机器人在楼梯、斜坡等杂乱地形中跌倒后难以人工扶正的问题,本文提出 DreamRiser,将基于本体感知的“地形想象”引入恢复策略,使控制器在无需外部建图的情况下根据隐含地形特征完成翻身与站立,并把全足接触作为稳定恢复条件。仿真和真实机器人多地形实验显示,该方法相比平地导向的恢复策略更稳健、恢复更安全快速。

Roll-Drop: accounting for observation noise with a single parameter Figure 1
arXiv preprint2023

Roll-Drop: accounting for observation noise with a single parameter

De Martini

Proceedings of Machine Learning Research vol XX:1–13, Department of Engineering Science, University of Oxford

四足机器人机器人学习系统辨识

针对四足机器人强化学习从仿真到真实部署时,传感观测噪声难以逐项建模、系统辨识成本高的问题,论文提出 Roll-Drop:在仿真 rollout 过程中以单一概率参数随机 dropout,使策略不过度依赖无噪声观测。实验显示其在观测注入最高 25% 噪声时仍有约 80% 成功率,约为 ERFI、无随机化和训练期 dropout 等基线的两倍,并在 Unitree A1 实机上验证了鲁棒性提升。

SafeSteps: Learning Safer Footstep Planning Policies for Legged Robots via Model-Based Priors Figure 1
arXiv preprint2023

SafeSteps: Learning Safer Footstep Planning Policies for Legged Robots via Model-Based Priors

Shafeef Omar, Lorenzo Amatucci, Victor Barasuol, Giulio Turrisi, Claudio Semini

the Dynamic Legged Systems Laboratory, Istituto Italiano di Tecnologia (IIT), Genova, Italy

四足机器人机器人学习足式机器人安全恢复规划

面向四足机器人在崎岖地形中既要自主选 foothold 又要在扰动下安全恢复的问题,SafeSteps 将视觉落足可行性、胫部碰撞和地形粗糙度等模型先验编码进策略状态,并用带动作掩码的 PPO 只允许选择安全落足点。仿真与电动四足实机实验表明,该方法在训练和部署中显著减少安全约束违规,同时减少奖励塑形项并提升最终性能与样本效率。

SayTap: Language to Quadrupedal Locomotion Figure 1
arXiv preprint2023

SayTap: Language to Quadrupedal Locomotion

Yujin Tang

Google DeepMind, The University of Tokyo

四足机器人机器人学习足式机器人运动控制

论文针对大语言模型难以直接理解关节目标、力矩等低层四足控制指令的问题,提出以四足触地时序的0/1接触模式作为语言与低层运动控制之间的中间接口。系统通过提示设计让LLM从自然语言生成接触模式,再用强化学习控制器在真实Unitree A1上跟踪这些模式。相比离散步态或正弦接口,该方法在30个任务中接触模式预测成功率高出50%以上,并多完成10个任务。

Scientific Exploration of Challenging Planetary Analog Environments with a Team of Legged Robots Figure 1
Science Robotics2023

Scientific Exploration of Challenging Planetary Analog Environments with a Team of Legged Robots

Philip Arm, Gabriel Waibel, Jan Preisig, Turcan Tuna, Ruyi Zhou, Valentin Bickel, Gabriela Ligeza, Takahiro Miki, Florian Kehl, Hendrik Kolvenbach, Marco Hutter

Robotic Systems Lab, ETH Zurich, Leonhardstrasse 21, Zurich 8092, Switzerland, ETH Zurich, State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150080, China, Harbin Institute of Technology, Center for Space and Habitability, University of Bern, Gesellschaftsstrasse 6, Bern 3012, Switzerland, Laboratory of Hydraulics, Hydrology, and Glaciology, ETH Zurich, Hönggerbergring 26, Zurich 8093, Switzerland, University of Bern, Department of Environmental Sciences, University of Basel, Basel 4056, Switzerland, University of Basel, Innovation Cluster Space and Aviation (UZH Space Hub), Air Force Center, University of Zurich, Dübendorf 8600, Switzerland, Institute of Medical Engineering, Space Biology Group, Lucerne University of Applied Sciences and Arts, Hergiswil 6052, Switzerland, ZHAW Zurich University of Applied Sciences

四足机器人机器人学习足式机器人仿真基准

针对月球/行星探测中轮式巡视器难以进入陡坡、松散颗粒土和非结构地形且单机效率与载荷能力有限的问题,论文提出由多台具互补科学载荷的四足机器人组成探测队伍,结合高效运动控制、在线建图、目标实例分割、远程/原位测量及带机械臂的精密采样测量。系统在ExoMars测试场、瑞士采石场和卢森堡Space Resources Challenge中验证,可通过超过25°颗粒坡面并在高延迟/断连通信下完成短时有效科学任务。

Skill Graph for Real-world Quadrupedal Robot Reinforcement Learning Figure 1
OpenReview preprint2023

Skill Graph for Real-world Quadrupedal Robot Reinforcement Learning

Anonymous authors, Paper under double-blind review

四足机器人机器人学习足式机器人强化学习

针对真实四足机器人强化学习样本效率低、遇到新环境泛化弱且需频繁人工重置的问题,论文将知识图谱思想扩展为“技能图”,用结构化三元组组织动态策略/价值网络等技能先验,涵盖2类机器人、5种环境和844个运动技能,并在下游任务中检索复用相关技能。真实机器人实验显示,该方法可将新技能学习与环境适应缩短到分钟级,但具体增益中数据规模与图结构各自贡献仍需进一步拆分说明。

No Figure
IEEE RA-L 20232023

SLoMo: A General System for Legged Robot Motion Imitation From Casual Videos

John Z. Zhang, Shuo Yang, Gengshan Yang, Arun L. Bishop, Swaminathan Gurumurthy, Deva Ramanan, Zachary Manchester

Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, USA, Carnegie Mellon University, Department of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA

四足机器人机器人学习足式机器人模仿学习

全文短总结尚未生成。

SYNLOCO: Synthesizing Central Pattern Generator and Reinforcement Learning for Quadruped Locomotion Figure 1
arXiv preprint2023

SYNLOCO: Synthesizing Central Pattern Generator and Reinforcement Learning for Quadruped Locomotion

Xinyu Zhang, Zhiyuan Xiao, Qingrui Zhang, Wei Pan

Sun Yat-sen University, The University of Manchester,Department of Computer Science,UK, University of Manchester

四足机器人机器人学习足式机器人强化学习运动控制

针对四足运动中 CPG 开环不适应环境、纯强化学习训练代价高且易陷入不自然步态的问题,SYNLOCO 将 CPG 步态规划与基于本体感知的 RL 反馈残差控制结合,并用动物运动克隆加强化学习的两阶段训练及性能驱动奖励降低学习难度。Unitree GO1 实验显示其在不同速度、地形和负载下保持较稳定、抬脚清晰的步态,且能承受超出训练设置的较大载荷。

Terrain-Aware Quadrupedal Locomotion via Reinforcement Learning Figure 1
arXiv preprint2023

Terrain-Aware Quadrupedal Locomotion via Reinforcement Learning

Max Q. -H

四足机器人机器人学习足式机器人强化学习运动控制

针对四足机器人在离散崎岖地形上仅靠本体感知易踩空、视觉分层方案又依赖模型控制器的问题,论文用强化学习将外感知地形信息与参数化轨迹生成器结合,让策略调节抬脚高度、频率并输出残差关节角;同时设计落足地形奖励和抬脚高度奖励以兼顾安全与能耗。仿真中可通过楼梯、踏石和杆状地形,实机验证了跨越约25 cm间隙的踏石行走。

No Figure
Preprint2023

Towards Legged Locomotion on Steep Planetary Terrain

Giorgio Valsecchi, Cedric Weibel, Hendrik Kolvenbach, Marco Hutter

ETH Zurich,Robotic Systems Laboratory,Zurich,Switzerland,8092, ETH Zurich

四足机器人机器人学习足式机器人运动控制地形感知

全文短总结尚未生成。

Tuning Legged Locomotion Controllers via Safe Bayesian Optimization Figure 1
arXiv preprint2023

Tuning Legged Locomotion Controllers via Safe Bayesian Optimization

作者信息待提取

ETH Zürich

四足机器人机器人学习足式机器人安全恢复运动控制

针对模型式足式运动控制在真实硬件上因模型简化而需反复、且可能损伤机器人的增益调参问题,论文将其表述为带安全约束的优化,并把 GOSAFEOPT 扩展到以步态参数为上下文的安全贝叶斯优化。方法在 Unitree Go1 仿真与实机中可在安全区域内样本高效寻找多种步态的反馈增益,实机约 50 步完成 trot/crawl 调参且无不安全交互,并提升跟踪与抗扰鲁棒性。

A Collision-Free MPC for Whole-Body Dynamic Locomotion and Manipulation Figure 1
ICRA 20222022

A Collision-Free MPC for Whole-Body Dynamic Locomotion and Manipulation

Jia-Ruei Chiu, Jean-Pierre Sleiman, Mayank Mittal, Farbod Farshidian, Marco Hutter

ETH Zurich,Robotic Systems Lab,Zurich,Switzerland,8092, ETH Zurich, NVIDIA

四足机器人机器人学习安全恢复操作全身控制

面向四足移动操作中基座与机械臂强耦合、易发生自碰和环境碰撞的问题,本文在统一全身动态 MPC 中加入碰撞软约束:用碰撞基元的有符号距离处理自碰,并借助 ESDF/FIESTA 查询距离与梯度避障。实验显示该方法只小幅增加 MPC 计算量,仍可实时运行,并在摆臂平衡、负重抛掷和自主开门等硬件任务中实现安全恢复与避障。

No Figure
IEEE RA-L 20212022

A Reconfigurable Leg for Walking Robots

Fang Nan, Hendrik Kolvenbach, Marco Hutter

Robotic Systems Lab (RSL), ETH Zurich, Zurich, Switzerland, ETH Zurich

四足机器人机器人学习运动控制

全文短总结尚未生成。

A Walk in the Park: Learning to Walk in 20 Minutes With Model-Free Reinforcement Learning Figure 1
arXiv preprint2022

A Walk in the Park: Learning to Walk in 20 Minutes With Model-Free Reinforcement Learning

Laura Smith, Ilya Kostrikov, Sergey Levine

四足机器人机器人学习强化学习

论文针对四足机器人强化学习长期依赖仿真、真实采样效率低的问题,验证是否能直接在真实环境中从零学习行走。核心洞察不是提出新算法,而是通过精心设计MDP、低层PD目标动作空间、机载状态估计与高效实现,让现有model-free RL可实用化。A1机器人在室内外多种地形约20分钟、约2万样本内稳定学会步态,并用仿真分析关键设计选择。

A Whole-Body Controller Based on a Simplified Template for Rendering Impedances in Quadruped Manipulators Figure 1
IROS 20222022

A Whole-Body Controller Based on a Simplified Template for Rendering Impedances in Quadruped Manipulators

Mattia Risiglione, Victor Barasuol, Darwin G. Caldwell, Claudio Semini

Italian Institute of Technology

四足机器人机器人学习足式机器人全身控制

面向四足机械臂在遥操作、人机交互和外力扰动下既要保持平衡又要具备柔顺性的需求,论文将笛卡尔阻抗控制嵌入QP全身控制,把基座与末端抽象为可独立整形惯量、刚度和阻尼的双质量弹簧阻尼模板,并同时处理摩擦锥、单边接触、关节和力矩约束。作者在90kg HyQ搭载7自由度机械臂的仿真中验证了末端受外力时的阻抗呈现,覆盖全支撑和动态小跑接触条件,显示步态接触会影响阻抗渲染效果。

Accelerated Policy Learning with Parallel Differentiable Simulation Figure 1
arXiv preprint2022

Accelerated Policy Learning with Parallel Differentiable Simulation

作者信息待提取

NVIDIA, Massachusetts Institute of Technology, University of Sydney, University of Toronto

四足机器人机器人学习仿真基准

本文针对模型无关强化学习在接触丰富、高维机器人控制中样本与时间成本高,而直接利用可微仿真又易陷入局部极小和梯度爆炸/消失的问题,提出并行 GPU 可微仿真与短视域 Actor-Critic(SHAC):用平滑 critic 近似噪声回报景观,并截断反传窗口稳定梯度。在 Cartpole、Ant、Humanoid 及肌肉驱动人形等任务上,SHAC 相比 PPO、SAC 和既有可微仿真方法显著提升样本效率与训练时间,高维肌肉行走训练时间减少超过 17 倍。

Accessibility-Based Clustering for Efficient Learning of Locomotion Skills Figure 1
ICRA 20222022

Accessibility-Based Clustering for Efficient Learning of Locomotion Skills

Chong Zhang, Wanming Yu, Zhibin Li

Tsinghua University,Department of Precision Instrument,Beijing,China,100084, Tsinghua University, School of Informatics, University of Edinburgh,Edinburgh,United Kingdom,EH8 AB, University of Edinburgh

四足机器人机器人学习运动控制

针对四足机器人跌倒恢复中强化学习初始状态设计导致的困难探索与冗余探索问题,论文提出以状态间“可达性”而非欧氏距离度量转移难度,并用 K-Access 聚类自动选取静态姿态中心作为训练初始状态。在 8-DoF Bittle 上,该方法使学习仅需约 60% 训练回合,测试中 99.4% 情况可在 3 秒内恢复站立,并展示到后空翻等技能的泛化。

Advanced Skills by Learning Locomotion and Local Navigation End-to-End Figure 1
IROS 20222022

Advanced Skills by Learning Locomotion and Local Navigation End-to-End

Nikita Rudin, David Hoeller, Marko Bjelonic, Marco Hutter

Robotic Systems Lab, ETH Zurich, NVIDIA, ETH Zurich

四足机器人机器人学习运动控制导航

针对四足机器人局部导航中“规划—跟踪—运动控制”分解会把策略限制在速度跟踪和固定步态的问题,本文将任务改为在给定时间末到达目标位置,并用端到端深度强化学习让策略自行选择路径、速度调制和步态。实验表明,相比速度跟踪和连续位置奖励,该时间依赖的终点奖励能学到跨沟、爬箱、避障等复杂行为,在真实 ANYmal 上实时部署,并降低失败率与能耗。

Advanced Skills through Multiple Adversarial Motion Priors in Reinforcement Learning Figure 1
arXiv preprint2022

Advanced Skills through Multiple Adversarial Motion Priors in Reinforcement Learning

Eric Vollenweider, Marko Bjelonic, Victor Klemm, Nikita Rudin, Joonho Lee, Marco Hutter

ETH Zürich,Robotic Systems Lab,Zürich,Switzerland,8092

四足机器人机器人学习强化学习

针对腿式机器人复杂技能往往依赖繁琐奖励设计、且单一 AMP 难以主动选择多种运动风格的问题,论文提出 Multi-AMP:为不同运动数据集配置可离散切换的对抗运动先验,并与任务奖励共同训练同一策略。实验在轮腿四足机器人上同时学习行走、钻桌、站起/双轮导航/坐下等技能;多技能策略最终性能接近单任务基线,反向播放站起轨迹还能帮助发现可行坐下动作,减少手工调参。

No Figure
IROS 20222022

Animal Motions on Legged Robots Using Nonlinear Model Predictive Control

Dongho Kang, Flavio De Vincenti, Naomi C. Adami, Stelian Coros

Institute for Intelligent Interactive Systems (IIIS), ETH Zurich,Computational Robotics Lab,Switzerland, Computational Robotics Lab, Institute for Intelligent Interactive Systems (IIIS), ETH Zurich, Switzerland, ETH Zurich, Institute for Biomedical Engineering, Biomechanics Institute of Valencia

四足机器人机器人学习足式机器人模仿学习模型预测控制

全文短总结尚未生成。

Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulation Figure 1
IROS 20222022

Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulation

Mayank Mittal, David Hoeller, Farbod Farshidian, Marco Hutter, Animesh Garg

ETH,Zürich,Switzerland, University of Toronto, Canada and Vector Institute, Vector Institute, University of Toronto

四足机器人机器人学习操作全身控制

面向家庭厨房等未知、动态环境中橱柜、烤箱等大型关节物体操作,论文将问题拆成物体中心的RGB-D交互计划生成与机器人中心的全身MPC跟踪避障。核心洞察是把物体可操作性与机器人动力学可执行性解耦,再用最优控制在线协调底盘和机械臂。仿真中相对IK/采样规划成功率提升134%、耗时降低26.5%,并在四足移动操作平台上完成真实厨房实验。

No Figure
IEEE RA-L 20222022

Bio-Inspired Rhythmic Locomotion for Quadruped Robots

Jiapeng Sheng, Yanyun Chen, Xing Fang, Wei Zhang, Ran Song, Yu Zheng, Yibin Li

School of Control Science and Engineering, Shandong University, Jinan, China, Shandong University, Tencent, Robotics X Lab, Shenzhen, China, Tencent (China)

四足机器人机器人学习足式机器人运动控制

全文短总结尚未生成。

Central pattern generators evolved for real-time adaptation Figure 1
arXiv preprint2022

Central pattern generators evolved for real-time adaptation

Alex Szorkovszky, Frank Veenstra, Kyrre Glette

四足机器人机器人学习

面向四足机器人在协作/社交场景中需随外部节律实时调整步态的问题,论文用多目标进化搜索非线性类生物 CPG,并再进化输入滤波神经层,使步频不再由显式周期参数固定,而由网络与刺激自组织耦合。仿真结果显示,多种控制器可随节律输入改变步态或频率,并能跨不同肢长形态实现协调和模仿式学习。

Cerberus: Low-Drift Visual-Inertial-Leg Odometry For Agile Locomotion Figure 1
arXiv preprint2022

Cerberus: Low-Drift Visual-Inertial-Leg Odometry For Agile Locomotion

Shuo Yang, Zixin Zhang, Zhengyu Fu, Zachary Manchester

Robotics Institute, Carnegie Mellon University,Department of Mechanical Engineering,Pittsburgh,PA,USA,15213, Carnegie Mellon University

四足机器人机器人学习运动控制状态估计敏捷运动

面向四足机器人在无 GPS、快速运动和冲击/遮挡条件下的低漂移状态估计,Cerberus 将双目、IMU、关节编码器与接触传感器融合为实时 VILO,并把腿部运动学参数在线标定和接触异常剔除纳入因子图,以针对足滑、滚动接触和模型误差。实机室内外实验显示,在线标定可将长距离高速运动漂移降至 1% 以下,450 m 跑道数据优于 KF、VINS 和未标定 VILO。

No Figure
2022 22nd International Conference on Control, Automation and Systems (ICCAS)2022

Collision-Backpropagation based Obstacle Avoidance Method for a Legged Robot Expressed as a Simplified Dynamics Model

Jinwon Kim, Heechan Shin, Sung-Eui Yoon

The Robotics Program, Korea Advanced Institute of Science and Technology (KAIST),Daejeon,Korea,34141, Korea Advanced Institute of Science and Technology, Korea Advanced Institute of Science and Technology (KAIST),Department of Computing Science,Daejeon,Korea,34141

四足机器人机器人学习足式机器人世界模型安全恢复

全文短总结尚未生成。

Coupling Vision and Proprioception for Navigation of Legged Robots Figure 1
CVPR 20222022

Coupling Vision and Proprioception for Navigation of Legged Robots

Zipeng Fu, Ashish Kumar, Ananye Agarwal, Haozhi Qi, Jitendra Malik, Deepak Pathak

Camegie Mellon University, UC Berkeley, Berkeley College, University of California, Berkeley

四足机器人机器人学习足式机器人导航感知

针对足式机器人在复杂地形中仅靠视觉难以感知玻璃障碍、湿滑或松软地面等因素,论文提出 VP-Nav,将视觉建图规划与本体感知反馈耦合:低层速度条件步态策略负责运动,安全顾问用关节状态和接触等信息在线更新障碍与速度约束。仿真中相比分离式规划控制基线提升约 7%–15%,并在四足机器人上完成机载实时部署。

CPG-RL: Learning Central Pattern Generators for Quadruped Locomotion Figure 1
IEEE RA-L 20222022

CPG-RL: Learning Central Pattern Generators for Quadruped Locomotion

Guillaume Bellegarda, Auke Ijspeert

BioRobotics Laboratory, Ecole Polytechnique Federale de Lausanne (EPFL), Lausanne, Switzerland

四足机器人机器人学习足式机器人强化学习运动控制

本文针对四足运动中传统 CPG 参数难调、步态僵硬,以及端到端强化学习动作不易约束和迁移困难的问题,将 CPG 振荡器嵌入 DRL,由策略在线调制各腿振幅、频率和运动方向,并弱化显式耦合以让协调从反馈中学习。方法在 Unitree A1 上实现仿真到现实迁移,可全向行走、过不平地形,并在未训练扰动下承受 13.75kg 动态负载;还显示仅用振荡器状态和接触信号也能部署。

Creating a Dynamic Quadrupedal Robotic Goalkeeper with Reinforcement Learning Figure 1
arXiv preprint2022

Creating a Dynamic Quadrupedal Robotic Goalkeeper with Reinforcement Learning

Xue Bin

University of California,Berkeley, University of California, Berkeley, Georgia Institute of Technology, Simon Fraser University

四足机器人机器人学习足式机器人强化学习敏捷运动

这篇论文面向四足机器人足球守门,将高速飞球拦截视为动态足式运动与非抓取式操控的耦合难题。核心做法是分层无模型强化学习:底层学习跳跃、扑救、侧移等可跟踪参数化末端轨迹的技能,高层根据来球选择技能与轨迹。在 Mini Cheetah 实机上,系统可在约 0.5–0.9 秒内反应,随机射门拦截率达 87.5%,明显优于模型规划和双技能版本。

DayDreamer: World Models for Physical Robot Learning Figure 1
OpenReview preprint2022

DayDreamer: World Models for Physical Robot Learning

Philipp Wu, Alejandro Escontrela

University of California, Berkeley

四足机器人机器人学习世界模型

针对深度强化学习在真实机器人上交互成本高、仿真迁移又易受现实差异影响的问题,本文直接将 Dreamer 世界模型用于无仿真、无示教的在线机器人学习:从回放数据学习潜在动力学,并在“想象”轨迹中训练 actor-critic。实验覆盖四足、机械臂和轮式机器人;四足可在约 1 小时内学会翻身、站立和行走,并能 10 分钟内适应推搡,机械臂视觉抓放接近人类遥操作水平,显示世界模型可作为真实机器人样本高效学习的强基线。

Deep Hierarchical Planning from Pixels Figure 1
arXiv preprint2022

Deep Hierarchical Planning from Pixels

Danijar Hafner, Kuang-Huei Lee

四足机器人机器人学习规划

针对像素输入下长时域、稀疏奖励任务难以靠扁平强化学习和人工子目标解决的问题,论文提出 Director:在学习到的世界模型潜空间中做分层规划,由高层选择离散潜在目标并结合探索奖励,低层学习达成目标,且目标可解码成图像解释。实验显示其在四足机器人第一视角 3D 迷宫等稀疏奖励任务上优于探索基线,并能迁移到 Atari、DMLab、视觉控制等环境。

Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotion Figure 1
arXiv preprint2022

Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotion

Zipeng Fu, Xuxin Cheng

Carnegie Mellon University

四足机器人机器人学习操作全身控制运动控制

论文针对四足机器人加机械臂后常见的“腿/臂分层控制”难以协调、工程量大且动作不自然的问题,提出用强化学习训练单一全身策略,同时输出腿和臂关节目标;关键在于用 Advantage Mixing 利用动作因果依赖缓解局部最优,并用正则化在线适应处理高自由度 Sim2Real。作者还搭建低成本无绳四足操作平台,展示了擦白板、拾取、按按钮、投掷等真实任务中的动态腿臂协同行为。

DMAP: a Distributed Morphological Attention Policy for Learning to Locomote with a Changing Body Figure 1
arXiv preprint2022

DMAP: a Distributed Morphological Attention Policy for Learning to Locomote with a Changing Body

Alberto Silvio, Alessandro Marin

四足机器人机器人学习

本文关注机器人在身体形态变化(肢段长度、粗细扰动)下的零样本行走适应问题。核心做法是提出受生物运动控制启发的 DMAP,将本体感觉的独立时序处理、按关节分布式控制器与关节-通道注意力门控结合,在不显式读取形态参数的情况下推断并调节控制。实验在 Ant、HalfCheetah、Walker、Hopper 上表明,普通本体感知策略表现较差,而 DMAP 可端到端训练,并在未见形态上达到或超过使用形态信息的 Oracle,优于更难端到端训练的 RMA/TCN 方案。

Elevation Mapping for Locomotion and Navigation using GPU Figure 1
IROS 20222022

Elevation Mapping for Locomotion and Navigation using GPU

Takahiro Miki, Lorenz Wellhausen, Ruben Grandia, Fabian Jenelten, Timon Homberger, Marco Hutter

ETH,Robotic Systems Lab,Zurich, Robotic Systems Lab, ETH, Zurich, ETH Zurich, Robotic Research (United States)

四足机器人机器人学习运动控制导航

面向四足机器人在粗糙、未知地形中的实时导航与感知运动控制,本文将2.5D高程图构建从CPU迁移到GPU,统一加速点云配准、射线清理、可通行性估计和法向计算,并加入高度漂移补偿、遮挡/悬空物处理、平滑与平面分割等后处理。硬件实验表明其较基线更高效且地图伪影更少,已支撑DARPA地下挑战和多项ANYmal复杂地形行走实验。

Factor Graph Fusion of Raw GNSS Sensing with IMU and Lidar for Precise Robot Localization without a Base Station Figure 1
arXiv preprint2022

Factor Graph Fusion of Raw GNSS Sensing with IMU and Lidar for Precise Robot Localization without a Base Station

Jonas Beuchert, Marco Camurri, Maurice Fallon

University of Oxford, Science Oxford, Faculty of Science & Technology, Free Univ. of Bozen-Bolzano, Italy, Free University of Bozen-Bolzano

四足机器人机器人学习感知

面向户外机器人在天空可见性变化、GNSS 断续或无基站条件下的长期定位问题,本文将原始 GNSS 伪距与载波相位因子同 IMU、可选激光雷达统一到因子图中,避免只融合接收机 fix 的松耦合损失,并利用载波相位提供平滑相对约束。实验覆盖公开城市驾驶、汽车与四足机器人森林/城市场景,全球坐标误差约 1–2 m,轨迹连续性优于两阶段方法,并接近含视觉的基线。

GenLoco: Generalized Locomotion Controllers for Quadrupedal Robots Figure 1
OpenReview preprint2022

GenLoco: Generalized Locomotion Controllers for Quadrupedal Robots

Xue Bin

University of California, Berkeley, The Chinese University of Hong Kong

四足机器人机器人学习足式机器人运动控制

四足机器人平台日益多样,但学习型运动控制器通常需为每个机型重新训练。GenLoco的核心思路是在仿真中程序化随机化机体尺寸、腿长、质量等形态与动力学,用历史观测和动作输入训练单一强化学习控制器。实验显示,该策略可直接迁移到未见过的仿真与真实A1、Mini Cheetah、Sirius等机器人,并较机型专用训练更利于sim-to-real,但仍受限于相同DoF和形态模板。

Hierarchical Adaptive Loco-manipulation Control for Quadruped Robots Figure 1
arXiv preprint2022

Hierarchical Adaptive Loco-manipulation Control for Quadruped Robots

Mohsen Sombolestan, Quan Nguyen

University of Southern California,Department of Aerospace and Mechanical Engineering,Los Angeles,CA,90089, University of Southern California

四足机器人机器人学习足式机器人操作

面向四足机器人在未知物体与未知地形上同时行走和推/拖重物的难题,论文提出分层自适应控制:上层估计物体质量、摩擦和坡度等不确定性并生成交互力,下层将该力纳入统一MPC以兼顾平衡与操作。Unitree A1实验中可操纵最高7 kg时变负载,并能推5 kg未知物体爬坡;基线行走MPC难以推动物体。

Hierarchical Decentralized Deep Reinforcement Learning Architecture for a Simulated Four-Legged Agent Figure 1
arXiv preprint2022

Hierarchical Decentralized Deep Reinforcement Learning Architecture for a Simulated Four-Legged Agent

W. Zai El

Machine Learning Group, Bielefeld University, Bielefeld, Germany, Bielefeld University

四足机器人机器人学习足式机器人强化学习多机器人协作

针对四足机器人常用集中式控制难以兼顾学习效率、泛化与稀疏目标任务的问题,论文借鉴生物运动控制,将层级时间抽象与按腿/模块分散控制结合,比较五种强化学习架构。实验表明,在层级各层引入去中心化模块可加速学习,提升能效与未见环境鲁棒性,并保留层级架构的迁移与技能复用优势。

Hierarchical Reinforcement Learning for Precise Soccer Shooting Skills using a Quadrupedal Robot Figure 1
IROS 20222022

Hierarchical Reinforcement Learning for Precise Soccer Shooting Skills using a Quadrupedal Robot

Xue Bin

University of California,Berkeley, University of California, Berkeley, Centre Universitaire de Mila

四足机器人机器人学习足式机器人强化学习

这篇论文针对四足机器人踢真实足球时同时面临机身稳定、快速摆腿控制、软球接触与滚动摩擦难建模的问题,提出分层无模型强化学习框架:底层学习可跟踪任意踢腿轨迹的全身控制策略,高层规划射门动作,并通过仿真刚球预训练、真实软球微调弥合差异。实验在 A1 四足机器人上验证其能在站立状态下对随机目标较可靠、较精确地射门。

No Figure
Nature Machine Intelligence2022

High-speed quadrupedal locomotion by imitation-relaxation reinforcement learning

Yongbin Jin, Xianwei Liu, Yecheng Shao, Hongtao Wang, Wei Yang

Center for X-Mechanics, Zhejiang University, Hangzhou, China, Institute of Applied Mechanics, Zhejiang University, Hangzhou, China, State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, China, ZJU-Hangzhou Global Scientific and Technological Innovation Center, Hangzhou, China, Zhejiang Institute of Mechanical and Electrical Engineering, Zhejiang University

四足机器人机器人学习足式机器人强化学习模仿学习

全文短总结尚未生成。

Human Motion Control of Quadrupedal Robots using Deep Reinforcement Learning Figure 1
arXiv preprint2022

Human Motion Control of Quadrupedal Robots using Deep Reinforcement Learning

Sunwoo Kim, Maks Sorokin, Jehee Lee, Sehoon Ha

Seoul National University, Georgia Institute of Technology

四足机器人机器人学习足式机器人强化学习

这篇论文面向灾害等未知场景中纯自主控制不可靠的问题,尝试让操作者用身体动作直观遥控四足机器人。核心做法是将人体动作经监督学习重定向为具语义的机器人参考动作,并用带课程学习、专家分层和一致性后处理的深度强化学习策略进行模仿控制。实验显示,该系统可在仿真和真实 A1 上完成站立、坐下、倾斜、行走、转向和操作等任务;消融分析表明一致性修正、课程学习和域随机化均有助于性能与实机稳定性。

Imitate and Repurpose: Learning Reusable Robot Movement Skills From Human and Animal Behaviors Figure 1
arXiv preprint2022

Imitate and Repurpose: Learning Reusable Robot Movement Skills From Human and Animal Behaviors

作者信息待提取

DeepMind, London, UK

四足机器人机器人学习

针对强化学习腿式运动常依赖奖励塑形且动作不自然、难安全上机的问题,论文用人/狗动捕作为先验,先在仿真中训练可复用的 NPMP 低层运动技能模块,再冻结并由下游策略输出潜在指令完成行走、轨迹跟随和带球等任务。结果在 ANYmal 四足和 OP3 人形上展示了自然运动、较少任务正则需求,并实现部分零样本 sim-to-real 部署。

Is Conditional Generative Modeling all you need for Decision-Making? Figure 1
arXiv preprint2022

Is Conditional Generative Modeling all you need for Decision-Making?

Anurag Ajay, Yilun Du, Abhi Gupta, Joshua Tenenbaum, Tommi Jaakkola, Pulkit Agrawal

Improbable AI Lab, Operations Research Center, Computer Science and Artificial Intelligence Lab, Massachusetts Institute of Technology

四足机器人机器人学习运动生成

这篇论文的动机是绕开离线强化学习中价值函数估计、动态规划和分布约束带来的不稳定性,把序列决策改写为轨迹的条件生成问题。作者提出 Decision Diffuser,用扩散模型按回报、约束或技能生成状态序列,并用 classifier-free guidance 与低温采样做类似规划的推断。结果显示其在 D4RL 标准任务上超过多种离线 RL 方法,并能在测试时组合多个约束或技能,但这种组合能力的边界仍需更多验证。

Just Round: Quantized Observation Spaces Enable Memory Efficient Learning of Dynamic Locomotion Figure 1
arXiv preprint2022

Just Round: Quantized Observation Spaces Enable Memory Efficient Learning of Dynamic Locomotion

Lev Grossman, Brian Plancher

Barnard College, Columbia University,New York,NY,USA, Barnard College, Columbia University, New York, NY, USA, Barnard College, Columbia University

四足机器人机器人学习运动控制敏捷运动

面向需要在边缘设备上持续适应环境的四足/动态运动学习,论文指出 DRL 训练内存主要被回放或 rollout 缓冲中的观测占用,因此提出对观测空间直接量化,而非减少样本数或压缩网络参数。在四个仿真运动任务上结合 PPO 与 SAC 测试后,量化最高将总体训练内存占用降低约 4.2 倍,同时基本不影响收敛速度和学习性能。

No Figure
Frontiers of Mechanical Engineering2022

Landing control method of a lightweight four-legged landing and walking robot

Ke Yin, Chenkun Qi, Yue Gao, Qiao Sun, Feng Gao

School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, China, Shanghai Jiao Tong University, Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China, Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China

四足机器人机器人学习足式机器人运动控制

全文短总结尚未生成。

Learning Agile Skills via Adversarial Imitation of Rough Partial Demonstrations Figure 1
arXiv preprint2022

Learning Agile Skills via Adversarial Imitation of Rough Partial Demonstrations

作者信息待提取

Max Planck Institute for Intelligent Systems, Germany, Robotic Systems Lab, ETH Zurich, Switzerland

四足机器人机器人学习模仿学习敏捷运动

论文针对四足机器人学习后空翻等敏捷技能时奖励设计困难、专家轨迹难获取的问题,提出 WASABI:用 Wasserstein 对抗模仿从手持、仅含机身局部运动且与真实动力学不完全兼容的粗糙示范中推断任务奖励,并配合少量任务无关正则训练策略。实验比较了 LSGAN 与 WGAN 形式,显示后者更稳健;学到的技能可在 Solo 8 上实机复现手持示范的后空翻等动作。

Learning and Deploying Robust Locomotion Policies with Minimal Dynamics Randomization Figure 1
arXiv preprint2022

Learning and Deploying Robust Locomotion Policies with Minimal Dynamics Randomization

Luigi Campanaro, Siddhant Gangapurwala, Wolfgang Merkt, Ioannis Havoutis

Dynamic Robot Systems Group (DRS), University of Oxford

四足机器人机器人学习运动控制

针对四足机器人强化学习控制从仿真到真实常依赖繁重系统辨识、动力学随机化和执行器建模的问题,论文提出 ERFI:在训练中仅加入逐步随机力扰动和每回合执行偏置,以近似动力学随机化并提升对质量、质心变化的鲁棒性。实验显示其相较 RFI 在质量变化下平均成功率提升约 53%,并在 ANYmal C 与 Unitree A1 上实现平地、户外不平地的盲/感知运动部署。

Learning Forward Dynamics Model and Informed Trajectory Sampler for Safe Quadruped Navigation Figure 1
arXiv preprint2022

Learning Forward Dynamics Model and Informed Trajectory Sampler for Safe Quadruped Navigation

Yunho Kim, Chanyoung Kim, Jemin Hwangbo

Korea Advanced Institute of Science and Technology (KAIST), Republic of Korea, Robotics: Science and Systems New York City, NY, USA, Korea Advanced Institute of Science and Technology

四足机器人机器人学习足式机器人世界模型安全恢复

该文针对四足机器人在狭窄、几何复杂环境中用传统航点式局部规划易碰撞、且学习策略缺少长时域规划的问题,提出学习前向动力学模型、采样式MPC与知情轨迹采样器结合的局部规划框架,用自监督模型快速评估速度指令序列并偏向高质量采样。仿真结果显示其较基线更安全、轨迹更平滑,并能对全局路径上的突发障碍作反应;真实迁移仍未验证。

Learning Free Gait Transition for Quadruped Robots via Phase-Guided Controller Figure 1
IEEE RA-L 20212022

Learning Free Gait Transition for Quadruped Robots via Phase-Guided Controller

Yecheng Shao, Yongbin Jin, Xianwei Liu, Weiyan He, Hongtao Wang, Wei Yang

Center for X-Mechanics, Zhejiang University, Hangzhou, China, Institute of Applied Mechanics, Zhejiang University, Hangzhou, China, State Key Laboratory of Fluid Power and Mechatronic System, Zhejiang University, Hangzhou, China, ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University, Hangzhou, China, Zhejiang University of Science and Technology, Zhejiang Institute of Mechanical and Electrical Engineering, Zhejiang University

四足机器人机器人学习足式机器人运动控制

针对四足机器人多步态学习与步态自由切换难以统一建模的问题,本文将四条腿的独立相位作为步态生成器与强化学习控制器之间的接口,把多任务学习转化为学习相位到足端运动的映射。通过相位引导的模仿强化学习,策略可复现 walk、trot、pace、bound 及其过渡,并在 Black Panther 实机上实现速度跟踪下的平滑、鲁棒运动。

Learning Modular Robot Visual-motor Locomotion Policies Figure 1
arXiv preprint2022

Learning Modular Robot Visual-motor Locomotion Policies

Julian Whitman, Howie Choset

四足机器人机器人学习运动控制感知

针对模块化机器人每换一种腿/轮组合或地形就需重训控制器的问题,本文将视觉-运动策略做成按模块复用的 GNN 结构,并用模型式强化学习在多设计、多地形上联合训练,引入外感知地形输入和课程难度。实验中,一个策略可零样本迁移到未见过的非对称设计与新台阶/路缘环境,优于手工 tripod 基线,并在真实机器人上展示了爬台阶和越路缘;但复杂地形的 sim-to-real 退化仍未充分量化。

No Figure
Science Robotics2022

Learning robust perceptive locomotion for quadrupedal robots in the wild

Takahiro Miki, Joonho Lee, Jemin Hwangbo, Lorenz Wellhausen, Vladlen Koltun, Marco Hutter

Robotic Systems Lab, ETH-Zürich, Zürich, Switzerland, ETH Zurich, Robotics & Artificial Intelligence Lab, KAIST, Daejeon, Korea, Robotics Research (United States), Centre for Artificial Intelligence and Robotics, Intelligent Systems Lab, Intel, Jackson, WY, USA, Intelligent Systems Research (United States)

四足机器人机器人学习足式机器人运动控制感知

全文短总结尚未生成。

Learning Torque Control for Quadrupedal Locomotion Figure 1
arXiv preprint2022

Learning Torque Control for Quadrupedal Locomotion

Shuxiao Chen, Bike Zhang, Mark W. Mueller, Akshara Rai, Koushil Sreenath

University of California,Department of Mechanical Engineering,Berkeley,CA,USA,94720, University of California, Berkeley, Meta AI, CA, USA, Meta AI,CA,USA,94025

四足机器人机器人学习足式机器人运动控制

本文针对四足强化学习常用“低频位置策略+高频PD”的范式与模型控制中转向力矩控制的不一致,提出端到端高频力矩策略,直接输出关节力矩以绕开PD调参和跟踪误差。作者在Isaac Gym训练并迁移到Unitree A1,200Hz板载运行;实验显示同一策略可在斜草地、碎石、柔性地面行走并抗踢扰动,相比位置控制在仿真奖励和大扰动鲁棒性上更有潜力。

Learning Visual Locomotion with Cross-Modal Supervision Figure 1
arXiv preprint2022

Learning Visual Locomotion with Cross-Modal Supervision

Antonio Loquercio, Ashish Kumar, Jitendra Malik

UC Berkeley, Berkeley College, University of California, Berkeley

四足机器人机器人学习运动控制感知

针对RGB视觉难以在仿真中可靠训练、盲走四足机器人缺少前方地形预判的问题,论文将运动策略仍放在仿真中训练,并用跨模态监督CMS在真实世界中以时间错位的本体感知监督单目视觉预测前方地形。该方法让策略可随实机经验持续改进,在少于30分钟数据下通过19cm台阶、35°斜坡、20cm路缘等地形,并能用少量数据适应视野偏移。

Legged Locomotion in Challenging Terrains using Egocentric Vision Figure 1
OpenReview preprint2022

Legged Locomotion in Challenging Terrains using Egocentric Vision

Jitendra Malik, Deepak Pathak

Carnegie Mellon University, UC Berkeley

四足机器人机器人学习足式机器人运动控制地形感知

针对四足机器人在台阶、路缘、踏脚石和间隙等复杂地形中依赖高程图与足点规划易受定位噪声和硬件限制影响的问题,本文提出用单前视深度相机和带记忆的端到端策略直接输出关节目标。训练上先用低成本 scandots 进行强化学习,再蒸馏到深度输入策略。实机 A1 可实时穿越多类室内外地形,在踏脚石、间隙和上楼等任务上显著优于盲走与噪声高程图基线。

Locomotion Policy Guided Traversability Learning using Volumetric Representations of Complex Environments Figure 1
IROS 20222022

Locomotion Policy Guided Traversability Learning using Volumetric Representations of Complex Environments

Jonas Frey, David Hoeller, Shehryar Khattak, Marco Hutter

NVIDIA

四足机器人机器人学习运动控制导航仿真基准

针对四足机器人在未知复杂环境中难以用手工代价和2.5D高度图可靠评估可通行性的问题,本文用与实机相同的运动策略在随机三维地形中大规模并行仿真,采集相当于57年经验的策略相关通行成本,并训练稀疏3D CNN直接从体素占据图预测风险,避免悬挂障碍、多楼层等场景的高度图失效。方法在ANYmal的室内与自然环境路径规划中实现实时可通行性估计并完成实机展示。

No Figure
Applied Sciences2022

Model Predictive Control of Quadruped Robot Based on Reinforcement Learning

Zhitong Zhang, Xu Chang, Hongxu Ma, Honglei An, Lin Lang

College of Intelligence Science and Technology, National University of Defense Technology, Changsha 410073, China, National University of Defense Technology

四足机器人机器人学习足式机器人强化学习模型预测控制

全文短总结尚未生成。

Monte Carlo Tree Search Gait Planner for Non-Gaited Legged System Control Figure 1
ICRA 20222022

Monte Carlo Tree Search Gait Planner for Non-Gaited Legged System Control

Lorenzo Amatucci, Joon-Ha Kim, Jemin Hwangbo, Hae-Won Park

Humanoid Robot Research Center, Korea Advanced Institute of Science and Technology,Korea, Dynamic Legged Systems Laboratory, Istituto Italiano di Tecnologia (IIT), Genova, Italy, Humanoid Robot Research Center, Korea Advanced Institute of Science and Technology, Korea, Korea Advanced Institute of Science and Technology, Italian Institute of Technology, Humanoid Robot Research Center, Korea Advanced Institute of Science and Technology,Daejeon,Korea,34141

四足机器人机器人学习足式机器人运动控制导航

针对足式机器人运动控制中预设步态和接触时序限制适应性、混合整数优化又难以实时求解的问题,本文将接触序列重构为决策搜索,用 MCTS 在优化仿真评估下生成步态,再交由 MPC 优化地面反力和落足点。仿真显示,该方法能产生常见周期步态,并在外力扰动、未知/变化地形及不同机器人布局下自适应调整接触序列。

Multi-Modal Legged Locomotion Framework With Automated Residual Reinforcement Learning Figure 1
IEEE RA-L 20222022

Multi-Modal Legged Locomotion Framework With Automated Residual Reinforcement Learning

Chen Yu, Andre Rosendo

School of Information Science and Technology, ShanghaiTech University, Shanghai, China, ShanghaiTech University

四足机器人机器人学习足式机器人强化学习运动控制

论文针对四足机器人稳定但任务适应性不如双足的问题,提出在现成四足机器人上加装轻量支撑结构,并用手工设计的模态切换序列配合自动残差强化学习(ARRL)学习双足控制。核心在于同时优化传统反馈控制器与残差RL策略,减少手调并保留控制结构。实验显示该方法在仿真中优于标准RL和参数优化器,实机Mini Cheetah可在四足与双足模式间切换并行走。

Neural Scene Representation for Locomotion on Structured Terrain Figure 1
IEEE RA-L 20222022

Neural Scene Representation for Locomotion on Structured Terrain

David Hoeller, Nikita Rudin, Christopher Choy, Animashree Anandkumar, Marco Hutter

Robotic Systems Lab, ETH Zurich, Zurich, Switzerland, NVIDIA, Santa Clara, CA, USA, ETH Zurich, Nvidia (United States), Caltech, Pasadena, CA, USA, California Institute of Technology, Robotic Systems Lab, ETH Zürich, Zurich, Switzerland

四足机器人机器人学习运动控制地形感知

面向四足机器人在城市结构化地形中因深度噪声、遮挡和机身盲区导致落脚地图不可靠的问题,本文用点云上的4D全卷积网络结合自回归反馈,从当前观测与历史地图中补全局部三维地形。模型仅用IsaacGym合成数据和强增强训练,并以稀疏张量实现上机运行;仿真与ANYmal实机实验表明,其在楼梯、箱体等场景中比Elevation Mapping、Voxblox等经典表示更稳健,可供学习式和模型式控制器使用。

Nonlinear Model Predictive Control for Quadrupedal Locomotion Using Second-Order Sensitivity Analysis Figure 1
arXiv preprint2022

Nonlinear Model Predictive Control for Quadrupedal Locomotion Using Second-Order Sensitivity Analysis

De Vincenti

四足机器人机器人学习足式机器人运动控制模型预测控制

针对四足机器人 NMPC 在线求解开销高、预设落足点限制机动性与抗扰性的痛点,论文将基座轨迹与未来落足点作为同一有限时域优化变量,并用二阶灵敏度分析与稀疏 Gauss-Newton 高效求导求解,可接入可变高倒立摆和单刚体等非线性模型。结果展示了 Unitree A1 仿真与初步硬件验证,并扩展到跨沟、踏石和多机器人任务,但完整对比和 SRBM 硬件验证文中未充分说明。

No Figure
IEEE RA-L 20222022

Online Kinematic Calibration for Legged Robots

Shuo Yang, Howie Choset, Zachary Manchester

Robotics Institute and Department of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, USA, Carnegie Mellon University

四足机器人机器人学习足式机器人

全文短总结尚未生成。

PI-ARS: Accelerating Evolution-Learned Visual-Locomotion with Predictive Information Representations Figure 1
IROS 20222022

PI-ARS: Accelerating Evolution-Learned Visual-Locomotion with Predictive Information Representations

Kuang-Huei Lee, Ofir Nachum, Tingnan Zhang, Sergio Guadarrama, Jie Tan, Wenhao Yu

Google Research,Mountain View,CA,United States,94043, Google (United States)

四足机器人机器人学习运动控制感知

本文针对进化策略在视觉运动控制中难以扩展到大规模 CNN、导致样本效率低的问题,提出 PI-ARS:用预测信息目标自监督训练感知编码器,将高维视觉/本体输入压缩后,再用 ARS 优化小型策略网络。该解耦思路在踏石、梅花桩、移动平台和室内导航等四足任务中提升训练速度与最终性能,并在真实踏石实验中达到 100% 成功率,优于此前 40%。

PrePARE: Predictive Proprioception for Agile Failure Event Detection in Robotic Exploration of Extreme Terrains Figure 1
IROS 20222022

PrePARE: Predictive Proprioception for Agile Failure Event Detection in Robotic Exploration of Extreme Terrains

Sharmita Dey, David Fan, Robin Schmid, Anushri Dixit, Kyohei Otsu, Thomas Touma, Arndt F. Schilling, Ali-Akbar Agha-Mohammadi

California Institute of Technology,NASA Jet Propulsion Laboratory,Pasadena,CA,USA, University of Goettingen, University Medical Center, Goettingen, Germany, NASA Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA, USA, University of Göttingen, Jet Propulsion Laboratory, Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, Atlanta, GA, USA, Georgia Institute of Technology, Control and Dynamical Systems, California Institute of Technology,Pasadena,CA,USA, Control and Dynamical Systems, California Institute of Technology, Pasadena, CA, USA, California Institute of Technology, Mechanical and Civil Engineering, California Institute of Technology,Pasadena,CA,USA, Mechanical and Civil Engineering, California Institute of Technology, Pasadena, CA, USA

四足机器人机器人学习敏捷运动地形感知

面向矿洞、洞穴等低光/低摩擦极端地形中四足机器人易打滑跌倒的问题,PrePARE主张仅用本体感知历史来提前预测失效,而不依赖视觉或激光;其关键是用异常检测加人工回放确认半监督标注滑移事件,再训练集成决策模型触发保守步态切换。Spot多场地数据与在线部署显示,滑移可最早提前约720 ms预测,平均精度超过0.95,F-score约0.82。

No Figure
2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)2022

Quadruped Reinforcement Learning without Explicit State Estimation

Qikai Li, Guiyu Dong, Ripeng Qin, Jiawei Chen, Kun Xu, Xilun Ding

Robotics Institute, Beihang University, School of Mechanical Engineering and Automation,Beijing,China,100191, Beihang University

四足机器人机器人学习足式机器人强化学习状态估计

全文短总结尚未生成。

Rapid and Reliable Quadruped Motion Planning with Omnidirectional Jumping Figure 1
ICRA 20222022

Rapid and Reliable Quadruped Motion Planning with Omnidirectional Jumping

Matthew Chignoli, Savva Morozov, Sangbae Kim

Massachusetts Institute of Technology,Department of Mechanical Engineering,Cambridge,MA,USA,02139, Massachusetts Institute of Technology, Massachusetts Institute of Technology,Department of Aeronautics and Astronautics,Cambridge,MA,USA,02139, American Institute of Aeronautics and Astronautics

四足机器人机器人学习足式机器人跳跃规划

面向多层、断续地形中四足机器人需要快速决定何时以及如何跳跃的问题,本文将可在线求解的全向跳跃轨迹优化嵌入分层导航框架,并用低维跳跃可行性分类器和鲁棒性度量在高层采样规划中筛选动态可行且抗过程噪声的动作。系统在 Mini Cheetah Vision 上实现前向、侧向和旋转跳跃,可登上接近髋高的平台,扩展了仅限平面跳跃规划的机动范围。

Rapid Locomotion via Reinforcement Learning Figure 1
RSS2022

Rapid Locomotion via Reinforcement Learning

Gabriel B Margolis, Ge Yang, Kartik Paigwar, Tao Chen, Pulkit Agrawal

MIT Improbable AI Lab, NSF AI Institute for Artificial Intelligence and Fundamental Interactions Massachusetts Institute of Technology, Cambridge, MA, The NSF AI Institute for Artificial Intelligence and Fundamental Interactions, Massachusetts Institute of Technology

四足机器人机器人学习强化学习运动控制

面向四足机器人在草地、冰面等自然地形上高速奔跑和急转时模型简化难、鲁棒性下降的问题,论文用仿真强化学习直接学习速度条件控制器,关键在于对线/角速度命令采用自适应课程,并结合在线系统辨识做 sim-to-real。单一网络仅依赖 IMU 与关节编码器,在 MIT Mini Cheetah 上实现 3.9 m/s 平地奔跑、3.4 m/s 粗糙地形 10 米冲刺和 5.7 rad/s 旋转。

Real-time Digital Double Framework to Predict Collapsible Terrains for Legged Robots Figure 1
IROS 20222022

Real-time Digital Double Framework to Predict Collapsible Terrains for Legged Robots

Yung Chuen, Meng Yee Michael

National University of Singapore (NUS), Singapore, Institute for Infocomm Research (I

四足机器人机器人学习足式机器人地形感知

针对四足机器人在泥沙、松软支撑等可塌陷地形上仅靠视觉难以判断承载性的痛点,论文提出实时“数字替身”:让仿真机器人以相同模型和控制器同步运行,并用真实与仿真在关节状态、机身姿态等传感量上的差异作为地形塌陷性线索。模型仅在仿真中训练,却能迁移到真实实验,以低延迟较准确地区分硬地、半塌陷与塌陷地形。

REvolveR: Continuous Evolutionary Models for Robot-to-robot Policy Transfer Figure 1
arXiv preprint2022

REvolveR: Continuous Evolutionary Models for Robot-to-robot Policy Transfer

作者信息待提取

四足机器人机器人学习仿真到现实

针对每个新机器人都从零训练策略导致样本低效、探索困难的问题,REvolveR将源机器人到目标机器人的形态和运动学参数建成连续演化路径,用一系列仿真中间机器人逐步微调策略,并结合局部随机演化与面向目标的奖励塑形。MuJoCo和灵巧手实验显示,该方法相比直接迁移和模仿学习更省样本,在稀疏奖励任务中优势更明显。

RLOC: Terrain-Aware Legged Locomotion using Reinforcement Learning and Optimal Control Figure 1
T-RO 20222022

RLOC: Terrain-Aware Legged Locomotion using Reinforcement Learning and Optimal Control

Siddhant Gangapurwala, Mathieu Geisert, Romeo Orsolino, Maurice Fallon, Ioannis Havoutis

Dynamic Robots Systems Group, Oxford Robotics Institute, University of Oxford, Oxford, U.K, Robotics Research (United States)

四足机器人机器人学习足式机器人强化学习运动控制

面向四足机器人在非平整地形上兼顾实时性与稳定性的难题,RLOC将学习式感知落脚点规划与模型最优/全身控制结合:RL策略利用本体与地形感知生成足步,在线由模型控制器跟踪,并辅以运动跟踪修正和跌倒恢复策略。实验在ANYmal B的楼梯、波浪、砖块等地形上较盲走和启发式感知规划成功率更高,且策略无需重训迁移到更重的ANYmal C。

RoLoMa: Robust Loco-Manipulation for Quadruped Robots with Arms Figure 1
Autonomous Robots2022

RoLoMa: Robust Loco-Manipulation for Quadruped Robots with Arms

Henrique Ferrolho, Vladimir Ivan, Wolfgang Merkt, Ioannis Havoutis, Sethu Vijayakumar

start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT Oxford Robotics Institute, University of Oxford, UK

四足机器人机器人学习足式机器人操作

面向带机械臂四足机器人在真实场景中受模型误差、传感噪声和外力扰动影响的问题,RoLoMa将鲁棒性前置到全身轨迹优化中,提出基于第一性原理的SUF指标,衡量任意方向可抵抗的最大外力,并结合完整动力学、接触稳定性和驱动限制规划行走-操作轨迹。实验显示,在给定接触序列下,该方法能完成转手轮、拉杆、坡上开门、拉绳提桶等任务,同时比对照轨迹承受更强最坏情况扰动。

Safe Reinforcement Learning for Legged Locomotion Figure 1
IROS 20222022

Safe Reinforcement Learning for Legged Locomotion

Tsung-Yen Yang, Tingnan Zhang, Linda Luu, Sehoon Ha, Jie Tan, Wenhao Yu

Princeton University, Google Research, Google (United States), Georgia Institute of Technology

四足机器人机器人学习足式机器人强化学习安全恢复

针对足式机器人在真实强化学习探索中易跌倒、人工复位成本高的问题,论文提出学习策略与安全恢复策略切换的框架:用安全触发集和近似质心动力学前向预测决定何时接管/交还控制,尽量减少对学习的干预,并给出模型误差下的性能界。仿真四类步态任务平均跌倒减少48.6%,真实四足机器人115分钟训练中跌倒少于5次,并带来能效、窄步态和双腿平衡时长提升。

Sample Efficient Dynamics Learning for Symmetrical Legged Robots:Leveraging Physics Invariance and Geometric Symmetries Figure 1
arXiv preprint2022

Sample Efficient Dynamics Learning for Symmetrical Legged Robots:Leveraging Physics Invariance and Geometric Symmetries

Geometric Symmetries

四足机器人机器人学习足式机器人

针对足式机器人动力学学习依赖大量数据、普通向量表示难以利用腿部对称与物理不变性的问题,论文将机器人状态按对称腿/图结构组织,并用群等变网络、SD-GNN/SDNN 显式编码置换等变、旋转和重力轴相关不变性。实验显示该表示在未见数据上预测更准、样本效率更高,并用于 Magneto 攀爬机器人的逆动力学控制时比 FFNN 更稳定地跟踪轨迹。

Saving the Limping: Fault-tolerant Quadruped Locomotion via Reinforcement Learning Figure 1
arXiv preprint2022

Saving the Limping: Fault-tolerant Quadruped Locomotion via Reinforcement Learning

Dikai Liu, Tianwei Zhang, Jianxiong Yin, Simon See

四足机器人机器人学习足式机器人强化学习运动控制

面向四足机器人在野外任务中可能遭遇关节锁死等硬件故障、现有控制器多只能停机保护的问题,论文提出在 Isaac Gym 中更真实地随机模拟关节锁定,并结合教师-学生强化学习训练仅依赖机载传感器的容错步态策略。该策略可零样本部署到 Unitree A1,无需实机微调;仿真和实机实验表明,机器人在运动中发生关节故障时仍能保持较稳定行走,显著提升 RL 控制器的硬件容错性。

State Estimation for Hybrid Locomotion of Driving-Stepping Quadrupeds Figure 1
arXiv preprint2022

State Estimation for Hybrid Locomotion of Driving-Stepping Quadrupeds

Mojtaba Hosseini, Diego Rodriguez, Sven Behnke

Autonomous Intelligent Systems University of Bonn,Germany, Autonomous Intelligent Systems University of Bonn, Germany, Intelligent Systems Research (United States), University of Bonn

四足机器人机器人学习足式机器人运动控制状态估计

针对轮式四足在平地高速高效行驶、遇障又需迈步时对机体状态估计不准的问题,本文将主动轮的几何、接触点速度和驱动贡献显式并入 Mini Cheetah 的运动学模型与卡尔曼滤波器,使原有 MPC/WBC 框架只需小改即可支持行驶-迈步混合运动。仿真和实机实验表明,该估计能保持地形高度变化下的姿态/高度一致性,并借助轮驱提高平均运动速度。

STEP: State Estimator for Legged Robots Using a Preintegrated foot Velocity Factor Figure 1
IEEE RA-L 20222022

STEP: State Estimator for Legged Robots Using a Preintegrated foot Velocity Factor

Eungchang Mason

Korea Advanced Institute of Science and Technology, Department of Mechanical Engineering, KAIST, Daejeon, Republic of Korea, Department of Electrical Engineering and KI-AI, KAIST, Daejeon, Republic of Korea

四足机器人机器人学习足式机器人

针对足式机器人在湿滑、崎岖地形中依赖足端不打滑假设和接触检测易失效的问题,STEP将双目相机估计的机体速度引入腿部运动学,构造预积分足端速度因子,使足端位姿在接触状态未知时仍可约束相邻图像帧。仿真与Mini Cheetah实机实验覆盖不平和打滑地面,结果显示其状态估计更稳健,减少了传统接触检测带来的误判风险。

No Figure
2022 13th Asian Control Conference (ASCC)2022

TROT-Q: Traversability and Obstacle Aware Target Tracking System for Quadruped Robots

Eungchang Mason Lee, Jinwoo Jeon, Hyun Myung

Korea Advanced Institute of Science and Technology,School of Electrical Engineering,Daejeon,South Korea, School of Electrical Engineering, Korea Advanced Institute of Science and Technology, Daejeon, South Korea, Korea Advanced Institute of Science and Technology

四足机器人机器人学习足式机器人导航

全文短总结尚未生成。

No Figure
ICRA 20222022

Unsupervised Learning of Terrain Representations for Haptic Monte Carlo Localization

Mikolaj Lysakowski, Michal R. Nowicki, Russell Buchanan, Marco Camurri, Maurice Fallon, Krzysztof Walas

Institute of Robotics and Machine Intelligence, Poznan University of Technology,Poznan,Poland, Institute of Robotics and Machine Intelligence, Poznan University of Technology, Poznan, Poland, Poznań University of Technology, Oxford Robotics Institute, University of Oxford,UK, Oxford Robotics Institute, University of Oxford, UK, University of Oxford

四足机器人机器人学习地形感知

全文短总结尚未生成。

VAE-Loco: Versatile Quadruped Locomotion by Learning a Disentangled Gait Representation Figure 1
T-RO 20232022

VAE-Loco: Versatile Quadruped Locomotion by Learning a Disentangled Gait Representation

Oiwi Parker

Mathieu Geisert is with Agility Robotics, U

四足机器人机器人学习足式机器人运动控制

针对传统四足步态规划难以在摆动相实时调整触地时序、摆高等参数而影响抗扰的问题,VAE-Loco用仅含单一小跑风格的数据训练VAE,学习可解释且解耦的潜空间,并用一维驱动信号在线连续调节 cadence、足端高度和全支撑时长。实验在ANYmal B与无需重训的ANYmal C真机上实现多种小跑风格平滑混合,并可用生成模型异常信号触发增频恢复扰动。

Versatile Real-Time Motion Synthesis via Kino-Dynamic MPC with Hybrid-Systems DDP Figure 1
arXiv preprint2022

Versatile Real-Time Motion Synthesis via Kino-Dynamic MPC with Hybrid-Systems DDP

He Li, Tingnan Zhang, Wenhao Yu, Patrick M. Wensing

University of Notre Dame,Notre Dame,IN,USA, University of Notre Dame, Notre Dame, IN, USA, University of Notre Dame, Robotics at Google,Mountain View,CA,USA, Robotics at Google, Mountain View, CA, USA, Google (United States)

四足机器人机器人学习模型预测控制运动生成规划

针对四足机器人常将常规步态MPC与跳跃等专项动作分开设计、难以实时切换的问题,论文提出基于混合运动-动力学模型的非线性MPC,并用受约束Hybrid-Systems DDP求解,通过接触状态切换腿部变量、DDP反馈 warm start 和对偶变量重初始化实现少量迭代在线重规划。该框架在Unitree A1与MIT Mini Cheetah上完成跑-跳-跑、混合步态跳跃和连续跳跃等序列,A1可从静止跳约0.5 m远和0.5 m高,显示一定通用性。

Versatile Skill Control via Self-supervised Adversarial Imitation of Unlabeled Mixed Motions Figure 1
arXiv preprint2022

Versatile Skill Control via Self-supervised Adversarial Imitation of Unlabeled Mixed Motions

Chenhao Li, Sebastian Blaes, Pavel Kolev, Marin Vlastelica, Jonas Frey, Georg Martius

Max Planck Institute for Intelligent Systems,Tübingen,Germany, Max Planck Institute for Intelligent Systems, ETH Zurich,Robotic Systems Lab,Zurich,Switzerland, Robotic Systems Lab, ETH Zurich, Zurich, Switzerland, ETH Zurich

四足机器人机器人学习模仿学习

本文针对混合、无标签运动数据中难以同时提取并可控模仿单个技能的问题,提出 CASSI:在 GAIL/AMP 框架中加入无监督技能发现,通过最大化潜变量技能的可辨识性,让策略与技能判别器协同形成多样行为。实验显示,单一四足机器人策略能从未标注参考中学习可切换的高层技能,并在 Solo 8 实机上无需额外适配地复现多种运动。

ViNL: Visual Navigation and Locomotion Over Obstacles Figure 1
arXiv preprint2022

ViNL: Visual Navigation and Locomotion Over Obstacles

Simar Kareer, Naoki Yokoyama, Dhruv Batra, Sehoon Ha, Joanne Truong

Georgia Institute of Technology

四足机器人机器人学习运动控制导航感知

针对室内四足机器人不能只在平整地面导航、还需像人/宠物一样跨过鞋子玩具等杂物的问题,ViNL将高层视觉导航与低层视觉步态控制解耦训练:前者在Habitat输出速度,后者在Isaac Gym中经特权高度图教师、杂物微调和视觉重建/LSTM蒸馏学习避踩障碍,并可零样本组合。实验中仅用自视角视觉在未知杂乱环境到达率达73.6%,较强基线成功率提升32.8%,碰撞每米减少4.42次。

No Figure
T-RO 20222022

ViTAL: Vision-Based Terrain-Aware Locomotion for Legged Robots

Shamel Fahmi, Victor Barasuol, Domingo Esteban, Octavio Villarreal, Claudio Semini

Dynamic Legged Systems Lab, Istituto Italiano di Tecnologia, Genoa, Italy, Dynamic Legged Systems Lab, Istituto Italiano di Tecnologia (IIT), Genova, Italy, Italian Institute of Technology

四足机器人机器人学习足式机器人运动控制地形感知

全文短总结尚未生成。

Walking in Narrow Spaces: Safety-critical Locomotion Control for Quadrupedal Robots with Duality-based Optimization Figure 1
arXiv preprint2022

Walking in Narrow Spaces: Safety-critical Locomotion Control for Quadrupedal Robots with Duality-based Optimization

Qiayuan Liao, Zhongyu Li, Akshay Thirugnanam, Jun Zeng, Koushil Sreenath

University of California,Berkeley,USA, University of California, Berkeley, USA, University of California, Berkeley

四足机器人机器人学习足式机器人安全恢复运动控制

面向四足机器人在杂乱窄空间中易因动力学不可行或球形保守避障而碰撞、停滞的问题,论文将指数离散控制屏障函数与基于对偶的多面体避障约束嵌入 NMPC,并结合 WBC,使机器人和障碍形状可更精细建模。消融显示多面体近似可通过更窄通道,CBF 使轨迹更平滑且计算开销增加很小;Unitree A1 实验验证了 0.32 m 宽机器人通过约 0.5 m 窄通道等场景。

No Figure
IEEE Access2021

A Review of Physics Simulators for Robotic Applications

Jack Collins, Shelvin Chand, Anthony Vanderkop, David Howard

Centre for Robotics, Queensland University of Technology, Brisbane, QLD, Australia, Commonwealth Scientific and Industrial Research Organisation, Queensland University of Technology

四足机器人机器人学习仿真基准

全文短总结尚未生成。

A Unified MPC Framework for Whole-Body Dynamic Locomotion and Manipulation Figure 1
IEEE RA-L 20212021

A Unified MPC Framework for Whole-Body Dynamic Locomotion and Manipulation

Maria Vittoria

Robotic Systems Lab, ETH Zurich, Zurich, Switzerland, Robotic Systems Lab, ETH-Zürich, Zürich, Switzerland, ETH Zurich

四足机器人机器人学习操作全身控制运动控制

针对腿式移动操作中行走与物体交互常被分开规划、难以实时协调的问题,本文将多接触全身运动统一为一个切换系统MPC,并把机器人质心动力学与被操作物体动力学联合建模,使步态和操作接触可用同一约束/代价描述。该框架在ANYmal加机械臂上实现约70 Hz在线规划,完成姿态/末端跟踪及推拉重门,并展示了对模型误差和外扰的鲁棒性。

Adaptive Force-based Control for Legged Robots Figure 1
IROS 20212021

Adaptive Force-based Control for Legged Robots

Mohsen Sombolestan, Yiyu Chen, Quan Nguyen

University of Southern California, Los Angeles, CA, University of Southern California

四足机器人机器人学习足式机器人

针对四足机器人在负载变化、外力扰动和粗糙地形下对精确动力学模型依赖强的问题,论文将 L1 自适应控制嵌入基于 QP 的地面反力控制框架,在保留摩擦约束、软接触和多步态适应性的同时补偿模型不确定性,并证明 ISS 稳定。仿真与 Unitree A1 实验显示,12 kg 机器人可负载 6 kg 行走、11 kg 四足站立且高度误差小于 5 cm,明显优于非自适应基线。

No Figure
Preprint2021

Circus ANYmal: A Quadruped Learning Dexterous Manipulation with Its Limbs

Fan Shi, Timon Homberger, Joonho Lee, Takahiro Miki, Moju Zhao, Farbod Farshidian, Kei Okada, Masayuki Inaba, Marco Hutter

Department of Creative-Infomatics, JSK Lab, The University of Tokyo, Bunkyo-ku, Tokyo, Japan, The University of Tokyo, Tokyo, Japan, The University of Tokyo, ETH Zürich, Zürich, Switzerland, Robotics Systems Lab, ETH Zürich, Zurich, ETH Zurich

四足机器人机器人学习足式机器人操作

全文短总结尚未生成。

CPG-ACTOR: Reinforcement Learning for Central Pattern Generators Figure 1
arXiv preprint2021

CPG-ACTOR: Reinforcement Learning for Central Pattern Generators

De Martini

Oxford Robotics Institute, Oxford, UK, Science Oxford, University of Oxford

四足机器人机器人学习强化学习

论文针对传统 CPG 步态控制难以融入复杂传感反馈、而纯神经网络 RL 又需从零学习周期运动的问题,提出将可微 Hopf CPG 直接作为 Actor-Critic 中的 actor,并与 MLP 反馈网络端到端用 PPO 训练。单腿 hopper 实验显示,相比把 CPG 放入环境的既有做法,训练回报约提升 6 倍;无反馈版本也接近以往带反馈结果,闭环版本可随训练继续改善跳跃行为。

No Figure
IEEE Transactions on Industrial Electronics2021

Development of a Quadruped Robot System With Torque-Controllable Modular Actuator Unit

Yoon Haeng Lee, Young Hun Lee, Hyunyong Lee, Hansol Kang, Jun Hyuk Lee, Luong Tin Phan, Sungmoon Jin, Yong Bum Kim, Dong-Yeop Seok, Seung Yeon Lee, Hyungpil Moon, Ja Choon Koo, Hyouk Ryeol Choi

School of Mechanical Engineering, Sungkyunkwan University, Suwon, South Korea, AIDIN ROBOTICS Inc. Suwon, Suwon, South Korea, Sungkyunkwan University, Research Institute, AIDIN ROBOTICS Inc. Suwon, Suwon, South Korea, Suwon Research Institute

四足机器人机器人学习足式机器人硬件设计

全文短总结尚未生成。

Dynamics Randomization Revisited:A Case Study for Quadrupedal Locomotion Figure 1
arXiv preprint2021

Dynamics Randomization Revisited:A Case Study for Quadrupedal Locomotion

作者信息待提取

四足机器人机器人学习足式机器人运动控制

针对足式机器人强化学习从仿真到真实迁移中“是否必须动力学随机化”的争议,本文以 Laikago 四足机器人重新审视该问题。核心洞察是随机化既非必要也非充分,应先通过 sim-to-sim 消融定位真实影响迁移的设计问题和参数,再有选择地随机化。实验显示在多种步态、速度和步频下,无随机化也可直接 sim-to-real,而无关参数随机化可能带来保守策略、鲁棒性增益有限。

Fast and Efficient Locomotion via Learned Gait Transitions Figure 1
arXiv preprint2021

Fast and Efficient Locomotion via Learned Gait Transitions

Yuxiang Yang, Tingnan Zhang, Erwin Coumans, Jie Tan, Byron Boots

University of Washington, Robotics at Google

四足机器人机器人学习运动控制

针对四足机器人固定手工步态难以兼顾高速与低能耗的问题,本文将高层步态策略学习与低层凸 MPC 解耦结合,用进化策略仅优化接触时序等少量步态参数,并以速度跟踪和能耗为奖励。实验显示策略可随速度自动从行走过渡到小跑和飞跑,在 Unitree A1 上零样本部署到地毯、草地和低障碍等环境,相比固定步态基线在宽速度范围内显著降低能耗。

GLiDE: Generalizable Quadrupedal Locomotion in Diverse Environments with a Centroidal Model Figure 1
arXiv preprint2021

GLiDE: Generalizable Quadrupedal Locomotion in Diverse Environments with a Centroidal Model

Zhaoming Xie, Xingye Da, Buck Babich, Animesh Garg, Michiel van de Panne

NVIDIA, Santa Clara, USA, University of British Columbia, Kelowna, Canada, University of British Columbia, Nvidia (United States), University of British Columbia, Okanagan Campus, University of Toronto, Vector Institute, Toronto, Canada, University of Toronto, Vector Institute

四足机器人机器人学习足式机器人全身控制运动控制

GLiDE针对四足RL依赖高保真全身仿真、奖励复杂且训练昂贵的问题,反向采用简化质心动力学训练策略:策略输出机体线/角加速度,再由QP转为地面反力,并用雅可比转置和摆腿跟踪落到全身机器人。结果显示该低阶模型足以学习具前瞻性的运动控制,在平地多步态、踏石、平衡木和双腿站立等任务上有效,平地训练约1–2小时,并在A1实机上实现直接sim-to-real迁移。

Imitation Learning by Reinforcement Learning Figure 1
arXiv preprint2021

Imitation Learning by Reinforcement Learning

作者信息待提取

四足机器人机器人学习强化学习模仿学习

针对对抗式模仿学习训练不稳定、奖励设计困难的问题,本文将确定性专家的模仿学习化约为一次普通强化学习:对专家轨迹中出现的状态-动作赋予固定内在奖励。核心贡献是给出有限专家数据下的高概率性能保证和专家/学习者占用分布的总变差界,并说明随机专家情形会失效。连续控制实验显示该简化方法在实现更容易的同时具备有竞争力的表现。

No Figure
DOI2021

Imitation Learning from MPC for Quadrupedal Multi-Gait Control

Alexander Reske, Jan Carius, Yuntao Ma, Farbod Farshidian, Marco Hutter

Robotic Systems Lab, ETH Zürich, Switzerland, ETH Zürich, ETH Zurich, ETH Zürich,Robotic Systems Lab,Switzerland

四足机器人机器人学习足式机器人模仿学习运动控制

全文短总结尚未生成。

No Figure
Robotics and Autonomous Systems2021

Jumping over obstacles with MIT Cheetah 2

Hae-Won Park, Patrick M. Wensing, Sangbae Kim

Mechanical Engineering, Korea Advanced Institute of Science and Technology, South Korea, Korea Advanced Institute of Science and Technology, Aerospace and Mechanical Engineering, University of Notre Dame, USA, University of Notre Dame, Mechanical Engineering, Massachusetts Institute of Technology, USA, Massachusetts Institute of Technology

四足机器人机器人学习跳跃

全文短总结尚未生成。

No Figure
DOI2021

Learning Agile Locomotion Skills with a Mentor

Atil Iscen, George Yu, Deepali Jain, Jie Tan, Ken Caluwaerts

Robotics at Google, Google (United States), Georgia Institute of Technology

四足机器人机器人学习运动控制敏捷运动

全文短总结尚未生成。

Learning Fast Adaptation with Meta Strategy Optimization Figure 1
IEEE RA-L 20202021

Learning Fast Adaptation with Meta Strategy Optimization

Wenhao Yu, Jie Tan, Yunfei Bai, Erwin Coumans, Sehoon Ha

Georgia Institute of Technology, Atlanta, USA, Robotics at Google, Mountain View, USA, Google (United States), Georgia Institute of Technology, Robotics at Google, X, Mountain View, USA

四足机器人机器人学习

面向四足机器人在现实中遭遇动力学变化、地形变化和仿真到真实差距时难以快速适应的问题,论文提出 Meta Strategy Optimization:在训练阶段就让策略经历与测试时相同的潜变量策略搜索过程,从而学习更适合少量试验调参的潜在策略空间。实验在 Minitaur 真实机器人和仿真任务上验证,可在约 15 次 rollout 内适应斜坡、弱化电机、负载等新情形,并优于域随机化和普通策略优化基线。

Learning multiple gaits of quadruped robot using hierarchical reinforcement learning Figure 1
arXiv preprint2021

Learning multiple gaits of quadruped robot using hierarchical reinforcement learning

Yunho Kim, Bukun Son, Dongjun Lee

四足机器人机器人学习足式机器人强化学习运动控制

针对端到端单策略四足速度跟踪往往在不同速度下收敛到同一种步态、可能牺牲能耗与跟踪精度的问题,本文提出层级强化学习控制器:高层以类似 CPG 的策略按速度选择步态参数,低层结合反馈与 PD 控制生成关节目标。实验显示 8 自由度四足在不同速度区间存在更优步态,层级控制可学到 pace、trot、bound 等多步态并优于单步态基线;但相位仍有手工设定,平滑切换与增益泛化仍未充分说明。

Learning to Jump from Pixels Figure 1
arXiv preprint2021

Learning to Jump from Pixels

Gabriel B. Margolis, Tao Chen

Massachusetts Institute of Technology, Arizona State University, University of Massachusetts Amherst

四足机器人机器人学习跳跃

论文针对四足机器人在沟壑等非连续地形上仅靠稳健行走难以提前规划跳跃的问题,提出 Depth-based Impulse Control:用深度相机和无模型强化学习生成高层机身速度/步态轨迹,再由模型化 WBIC/MPC 跟踪地面冲量。该层级设计在仿真和 Mini Cheetah 实机上实现连续跨越宽沟,且无需动力学随机化;但实机可迁移沟宽约 26cm,明显低于仿真 66cm,受硬件与接触优化限制。

Learning to Navigate Sidewalks in Outdoor Environments Figure 1
IEEE RA-L 20222021

Learning to Navigate Sidewalks in Outdoor Environments

Maks Sorokin, Jie Tan, C. Karen Liu, Sehoon Ha

Georgia Institute of Technology, Atlanta, GA, USA, Georgia Institute of Technology, Robotics, Google, Mountain View, CA, USA, Google (United States), Stanford University, Stanford, CA, USA, Stanford University

四足机器人机器人学习仿真基准

面向城市配送、巡逻等需要在人行道上按公共地图路线行走的户外导航任务,本文将“learning by cheating”扩展到四足机器人:先在抽象仿真中用鸟瞰特权信息训练教师,再用 DAgger 克隆到仅依赖相机、LiDAR、GPS 的学生策略,并针对语义感知、网络与训练流程分析和缓解 sim-to-real 差距。实机 AlienGo 在亚特兰大自然人行道累计行走 3.2 公里,少量人工接管,避开 17/19 个障碍。

Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learning Figure 1
arXiv preprint2021

Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learning

Nikita Rudin

ETH Zurich and NVIDIA, NVIDIA, ETH Zurich

四足机器人机器人学习强化学习

针对深度强化学习训练机器人策略常需数天且调参迭代昂贵的问题,论文将仿真、观测/奖励计算与PPO更新端到端放到单GPU上,在Isaac Gym中并行数千个ANYmal,并调整大规模并行下的批量与步长等超参数,加入按表现自动调难度的课程。结果在平地少于4分钟、复杂地形约20分钟训练出可迁移到真实四足机器人的行走策略,主要增益来自GPU端大规模并行与减少数据搬运。

Legged Robots that Keep on Learning: Fine-Tuning Locomotion Policies in the Real World Figure 1
ICRA 20222021

Legged Robots that Keep on Learning: Fine-Tuning Locomotion Policies in the Real World

Laura Smith, J. Chase Kew, Xue Bin Peng, Sehoon Ha, Jie Tan, Sergey Levine

Berkeley AI Research, UC Berkeley, University of California, Berkeley, Google Research, Google (United States), Georgia Institute of Technology

四足机器人机器人学习足式机器人运动控制

针对足式机器人难以在部署前穷尽所有地形、零样本鲁棒策略遇到新环境会失效的问题,论文提出在真实世界中持续微调运动策略的系统:先用仿真和动作模仿预训练,再结合板载状态估计、学习式跌倒恢复、多任务策略和样本高效的离策略RL自主收集数据并更新控制器。实验中,A1四足机器人能在草地、地毯、门垫缝隙和记忆海绵等环境中微调前后行走与侧移,显著减少摔倒并提高任务完成能力。

Minimizing Energy Consumption Leads to the Emergence of Gaits in Legged Robots Figure 1
arXiv preprint2021

Minimizing Energy Consumption Leads to the Emergence of Gaits in Legged Robots

Zipeng Fu, Ashish Kumar, Jitendra Malik, Deepak Pathak

Carnegie Mellon University, UC Berkeley

四足机器人机器人学习足式机器人运动控制能耗建模

针对预编程步态难以适应不同速度和复杂地形的问题,论文从生物能耗最小化出发,用端到端强化学习直接输出关节目标,并以机械功惩罚驱动步态自发形成。结果显示,A1 四足机器人在平地随速度出现 walk、trot、近似 gallop 的 bounce,能耗低于未显式优化能耗的 MPC;在崎岖地形则产生非周期、不规则步态,并通过仿真到真实迁移在实机验证。

No Figure
Preprint2021

Obstacle Overcoming Gait Design for Quadruped Robot with Vision and Tactile Sensing Feedback

Jinshan Xu, Xuan Wu, Rui Li, Xiaojie Wang

Institute of Automated Chongqing University of Posts and Telecommunications, Chongqing, China, Chongqing University of Posts and Telecommunications, Institute of Intelligent Machines, Hefei Institutes of Physical Science Chinese Academy of Sciences, Hefei, China, Institute of Intelligent Machines, Chinese Academy of Sciences, Hefei Institutes of Physical Science

四足机器人机器人学习足式机器人运动控制感知

全文短总结尚未生成。

No Figure
Preprint2021

Real-time Optimal Navigation Planning Using Learned Motion Costs

Bowen Yang, Lorenz Wellhausen, Takahiro Miki, Ming Liu, Marco Hutter

The Hong Kong University of Science and Technology,Robotics and Multi-Perception Laboratory, Robotics Institute,Hong Kong SAR,China, Robotics and Multi-Perception Laboratory, Robotics Institute, The Hong Kong University of Science and Technology, Hong Kong SAR, China, University of Hong Kong, Hong Kong University of Science and Technology, ETH Zürich,Robotic Systems Lab,Switzerland

四足机器人机器人学习导航规划

全文短总结尚未生成。

Reinforcement Learning with Evolutionary Trajectory Generator: A General Approach for Quadrupedal Locomotion Figure 1
IEEE RA-L 20222021

Reinforcement Learning with Evolutionary Trajectory Generator: A General Approach for Quadrupedal Locomotion

Max Q. -H

Chinese University of Hong Kong, Shenzhen, China, Chinese University of Hong Kong, Shenzhen, Department of Electronic Engineering, Chinese University of Hong Kong, Shenzhen, China, Southern University of Science and Technology

四足机器人机器人学习足式机器人强化学习运动控制

针对四足机器人在复杂地形中从零强化学习步态困难、固定轨迹先验依赖人工调参的问题,论文提出 ETG-RL:用进化策略在足端轨迹空间持续优化轨迹生成器,同时用强化学习学习残差控制,并交替训练以稳定耦合。实验显示该方法可在仿真中完成平衡木、洞穴、楼梯斜坡等任务,并通过 sim-to-real 部署到 12 自由度四足机器人,在多种真实场景中成功行走。

Representation-Free Model Predictive Control for Dynamic Motions in Quadrupeds Figure 1
T-RO 20212021

Representation-Free Model Predictive Control for Dynamic Motions in Quadrupeds

Yanran Ding, Abhishek Pandala, Chuanzheng Li, Young-Ha Shin, Hae-Won Park

University of Illinois Urbana-Champaign, Department of Mechanical Engineering, Virginia Polytechnic Institute and State University, VA, USA, Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, Daejeon, South Korea, Korea Advanced Institute of Science and Technology

四足机器人机器人学习足式机器人模型预测控制规划

针对四足机器人在翻转、近竖直姿态等大幅三维运动中欧拉角奇异、四元数存在表示歧义的问题,论文提出直接在旋转矩阵上建模的 representation-free MPC,并用变分线性化与仿射姿态误差将控制问题转为可实时求解的 QP。该方法在 Panther 上以 250 Hz 运行,完成周期步态和经过奇异姿态的受控后空翻,验证了其对动态机动的稳定能力。

RMA: Rapid Motor Adaptation for Legged Robots Figure 1
arXiv preprint2021

RMA: Rapid Motor Adaptation for Legged Robots

Ashish Kumar, Zipeng Fu, Deepak Pathak, Jitendra Malik

UC Berkeley, Carnegie Mellon University, UC Berkeley, Facebook

四足机器人机器人学习足式机器人

针对四足机器人在真实部署中遇到未知地形、载荷变化和磨损时难以及时适应的问题,RMA将带特权环境信息训练的基础策略与由近期本体状态/动作历史估计“外因”潜变量的适应模块解耦,在仿真中两阶段训练、实机异步运行,无需示教、足端模板或真实微调。A1在沙地、泥地、草丛、碎石、水泥堆和楼梯等未见场景中取得较高成功率,但仅依赖本体感知时对大扰动仍有限。

Robust High-speed Running for Quadruped Robots via Deep Reinforcement Learning Figure 1
IROS 20222021

Robust High-speed Running for Quadruped Robots via Deep Reinforcement Learning

Guillaume Bellegarda, Yiyu Chen, Zhuochen Liu, Quan Nguyen

University of Southern California (USC),Dynamic Robotics and Control Laboratory, Dynamic Robotics and Control Laboratory, University of Southern California (USC), Robotics Research (United States), University of Southern California

四足机器人机器人学习足式机器人强化学习运动控制

针对四足机器人高速奔跑在负载、地形扰动下难以兼顾速度与鲁棒性,论文将强化学习动作空间从关节或预设轨迹改为足端笛卡尔位置,并用笛卡尔 PD 转为力矩,减少奖励塑形和轨迹先验偏置。该策略在 PyBullet 训练后可迁移到 Gazebo 与 Unitree A1:仿真无载超过 4 m/s、10 kg 负载 3.5 m/s,实机 5 kg 负载下以 2 m/s bounding。

Search-based Kinodynamic Motion Planning for Omnidirectional Quadruped Robots Figure 1
arXiv preprint2021

Search-based Kinodynamic Motion Planning for Omnidirectional Quadruped Robots

Pei Wang, Xiaoyu Zhou, Qingteng Zhao, Jun Wu, Qiuguo Zhu

四足机器人机器人学习足式机器人规划

针对四足机器人传统几何搜索/采样规划常忽略动力学约束、导致轨迹难跟踪的问题,本文构建面向全向四足的两阶段导航框架:前端用 Kinodynamic A* 结合代价地图硬/软约束生成平滑、安全、时间近优且动力学可行的初始轨迹,后端用符合前后/横向运动能力差异的 TEB 优化。仿真与绝影 Mini 实机实验表明,该方法可在复杂环境中更灵活、快速地完成导航。

No Figure
Preprint2021

Simulation-Based Climbing Capability Analysis for Quadrupedal Robots

Kentaro Uno, Giorgio Valsecchi, Marco Hutter, Kazuya Yoshida

Space Robotics Lab (SRL), Department of Aerospace Engineering, Tohoku University, Sendai, Japan, Tohoku University, Robotic Systems Lab (RSL), ETH Zurich, Zürich, Switzerland, ETH Zurich

四足机器人机器人学习足式机器人仿真基准攀爬

全文短总结尚未生成。

Traversing Steep and Granular Martian Analog Slopes With a Dynamic Quadrupedal Robot Figure 1
Field Robotics2021

Traversing Steep and Granular Martian Analog Slopes With a Dynamic Quadrupedal Robot

Hendrik Kolvenbach, Philip Arm, Elias Hampp, Alexander Dietsche, Valentin Bickel, Benjamin Sun, Christoph Meyer, Marco Hutter

Robotic Systems Lab, ETH Zurich, Switzerland, ETH Zurich, Department of Earth Sciences, ETH Zurich, Switzerland

四足机器人机器人学习足式机器人敏捷运动地形感知

针对火星/月球松散颗粒坡面对轮式车易沉陷、打滑且限制陡坡探测的问题,论文以动态四足 SpaceBok 为平台,设计被动自适应大面积平足与 12 mm 防滑齿,并结合地形自适应步态控制。实验显示 110 cm² 足底可降低沉陷,防滑齿提升牵引 22%–66%,机器人首次在最高 25° 火星模拟颗粒坡上验证静态与动态行走;动态步态更省能但陡坡风险更高,平足近内摩擦角时能耗显著上升。

VILENS: Visual, Inertial, Lidar, and Leg Odometry for All-Terrain Legged Robots Figure 1
T-RO 20222021

VILENS: Visual, Inertial, Lidar, and Leg Odometry for All-Terrain Legged Robots

David Wisth, Marco Camurri, Maurice Fallon

Oxford Robotics Institute, University of Oxford, Oxford, UK

四足机器人机器人学习足式机器人状态估计地形感知

面向四足机器人在松散、泥泞、黑暗或几何退化环境中的状态估计失效问题,VILENS用因子图紧耦合视觉、IMU、激光和腿里程计,并为腿部预积分速度引入在线估计的线速度偏置,以补偿打滑和地形形变造成的系统漂移。在ANYmal约2小时、1.8公里实测中,相比松耦合方法平均平移误差降62%、旋转误差降51%,并接入感知控制与局部规划验证鲁棒性。

VILENS: Visual, Inertial, Lidar, and Leg Odometryfor All-Terrain Legged Robots Figure 1
arXiv preprint2021

VILENS: Visual, Inertial, Lidar, and Leg Odometryfor All-Terrain Legged Robots

David Wisth, Marco Camurri, Maurice Fallon

Oxford Robotics Institute, University of Oxford, Oxford, UK

四足机器人机器人学习足式机器人状态估计地形感知

面向四足机器人在松散、变形、湿滑及感知退化环境中的状态估计失效问题,VILENS用因子图紧耦合视觉、IMU、激光雷达与腿部里程计,并为腿部速度预积分引入在线估计的线速度偏置,以补偿接触非理想导致的系统漂移。在ANYmal多场景2小时、1.8公里实验中,相比松耦合方法平均平移误差降62%、旋转误差降51%,并可接入感知控制和局部规划。

No Figure
2021 IEEE International Conference on Robotics and Biomimetics (ROBIO)2021

Vision-based Terrain Perception of Quadruped Robots in Complex Environments

Kexin Wang, Teng Chen, Jian Bi, Yibin Li, Xuewen Rong

Shandong University,Center for Robotics, School of Control Science and Engineering,China, Center for Robotics, School of Control Science and Engineering, Shandong University, China, Shandong University

四足机器人机器人学习足式机器人仿真基准地形感知

全文短总结尚未生成。

Visual-Locomotion: Learning to Walk on Complex Terrains with Vision Figure 1
OpenReview preprint2021

Visual-Locomotion: Learning to Walk on Complex Terrains with Vision

Wenhao Yu, Deepali Jain, Alejandro Escontrela, Atil Iscen

Robotics at Google, United States, University of California, Berkeley, United States, Georgia Institute of Technology, United States

四足机器人机器人学习运动控制地形感知感知

针对四足机器人在台阶、踏石等复杂地形上依赖显式建图与人工足端规划、系统延迟和调参成本高的问题,本文将感知与规划合并为高层视觉策略,直接由双深度图和本体状态输出机身目标与落脚点,再由摆腿位置控制和支撑腿 MPC 执行。策略用深度强化学习在仿真训练,可通过随机踏石、楼梯、移动平台等场景,并在 Laikago 实机上零样本迁移完成跨缝和爬平台实验。

No Figure
IEEE RA-L 20202020

An Open Torque-Controlled Modular Robot Architecture for Legged Locomotion Research

Felix Grimminger, Avadesh Meduri, Majid Khadiv, Julian Viereck, Manuel Wuthrich, Maximilien Naveau, Vincent Berenz, Steve Heim, Felix Widmaier, Thomas Flayols, Jonathan Fiene, Alexander Badri-Sprowitz, Ludovic Righetti

Max Planck Institute for Intelligent Systems, Tübingen, Germany, Max Planck Institute for Intelligent Systems, Tandon School of Engineering, New York University, Brooklyn, USA, New York University, Max Planck Institute for Intelligent Systems, Stuttgart, Germany

四足机器人机器人学习足式机器人运动控制

全文短总结尚未生成。

Dream to Control: Learning Behaviors by Latent Imagination Figure 1
arXiv preprint2020

Dream to Control: Learning Behaviors by Latent Imagination

Danijar Hafner

University of Toronto, Toronto, Canada, University of Toronto, University College London, London, United Kingdom, University College London, Google (United States), Mountain View, United States, Google (United States)

四足机器人机器人学习

针对从图像输入学习长时序控制时,传统模型式方法受有限想象步长影响而短视、且常未利用可微动力学的问题,Dreamer在学习到的紧凑潜变量世界模型中训练actor-critic,通过价值函数补偿视野外回报,并将多步价值梯度反传到策略。实验在DeepMind Control Suite的20个视觉连续控制任务(含四足机器人)上显示,其在样本效率、计算时间和最终性能上均优于当时的模型式与无模型基线。

Dynamic equilibrium of climbing robots based on stability polyhedron for gravito-inertial acceleration Figure 1
Preprint2020

Dynamic equilibrium of climbing robots based on stability polyhedron for gravito-inertial acceleration

Warley Ribeiro, Kentaro Uno, Kazuya Yoshida, Kenji Nagaoka, A Del Prete, Anh Nguyen

Department of Aerospace Engineering, Tohoku University, Aoba 6-6-01, Aramaki-Aza, Aoba-ku, Sendai, Miyagi 980-8579, Japan, Tohoku University, Department of Mechanical and Control Engineering, Kyushu Institute of Technology, Sensuicho 1-1, Tobata-ku, Kitakyushu, Fukuoka 804-8550, Japan, Kyushu Institute of Technology

四足机器人机器人学习攀爬

面向月面、灾害现场等低重力或陡坡环境中的四足攀爬机器人,传统静态支撑多边形或依赖摩擦模型的方法难以处理惯性效应和多刺爪抓附。本文将重力与质心惯性合成为 gravito-inertial acceleration,并结合翻倒稳定性与夹爪最大保持力构造三维稳定多面体,用于判断脱附、滑移和可承受加速度/倾角裕度。仿真与实验显示该判据可评估攀爬姿态稳定性,但具体性能增益幅度文中未充分说明。

Dynamics-Aware Unsupervised Discovery of Skills Figure 1
arXiv preprint2020

Dynamics-Aware Unsupervised Discovery of Skills

Archit Sharma, Shixiang Gu, Sergey Levine, Vikash Kumar, Karol Hausman

Google, Google (United States)

四足机器人机器人学习

论文针对复杂机器人中学习全局动力学模型困难、泛化受限的问题,提出 DADS:用互信息目标无监督发现结果可预测且多样的低层技能,并同时学习技能级动力学,使测试时可在连续技能潜空间中用 MPC 组合技能。实验在 MuJoCo 四足、半猎豹、人形等任务上显示,零样本规划优于标准 MBRL、目标条件 RL 和既有技能发现方法,且能处理稀疏奖励。

Emergent Real-World Robotic Skills via Unsupervised Off-Policy Reinforcement Learning Figure 1
arXiv preprint2020

Emergent Real-World Robotic Skills via Unsupervised Off-Policy Reinforcement Learning

Archit Sharma, Michael Ahn, Sergey Levine, Vikash Kumar, Karol Hausman, Shixiang Gu

Robotics: Science and Systems Corvalis, Oregon, USA, Google Research, Google (United States), Corvallis Environmental Center

四足机器人机器人学习强化学习

面向真实机器人中奖励设计、重置与样本效率限制,本文将基于互信息的无监督技能发现 DADS 改造成异步离策略 off-DADS,并允许指定探索的任务相关维度、复用多机器人数据。在 D’Kitty 四足机器人上,无奖励和示教即可在约20小时内学出多样步态与朝向;仿真显示样本效率最高约提升4倍,学得技能还能经 MPC 组合用于目标导航且无需再训练。

First Steps: Latent-Space Control with Semantic Constraints for Quadruped Locomotion Figure 1
arXiv preprint2020

First Steps: Latent-Space Control with Semantic Constraints for Quadruped Locomotion

Oiwi Parker

Dynamic Robot Systems (DRS) Oxford Robotics Institute (ORI), University of Oxford, Applied AI Lab (A2I), Art Institute of Portland, Robotics Research (United States)

四足机器人机器人学习足式机器人运动控制

本文针对四足运动规划中手工简化动力学限制运动范围、复杂接触与稳定约束难以微分的问题,将机器人状态用 VAE 映射到结构化潜空间,并用稳定性、步态等语义分类器把约束转化为可梯度优化的目标。方法在仿真和 ANYmal 实机上生成平滑可执行步态,并报告约束评估较解析方法约快一个数量级。

Learning Agile Robotic Locomotion Skills by Imitating Animals Figure 1
arXiv preprint2020

Learning Agile Robotic Locomotion Skills by Imitating Animals

Xue Bin

Google Research, University of California, Berkeley

四足机器人机器人学习运动控制敏捷运动

针对四足机器人敏捷运动控制依赖手工设计、奖励调参且难以真实部署的问题,论文提出从真实动物动捕中学习的模仿学习流程:先将动物动作重定向到 Laikago 形态,再在仿真中用强化学习模仿,并结合域随机化与潜空间域适应用于 sim-to-real。实验使 18 自由度 Laikago 学会多种步态、跳跃和转向等动态技能,表明同一框架可生成较丰富的真实机器人运动控制器。

No Figure
Science Robotics2020

Learning quadrupedal locomotion over challenging terrain

Joonho Lee, Jemin Hwangbo, Lorenz Wellhausen, Vladlen Koltun, Marco Hutter

Robotic Systems Lab, ETH-Zürich, Zürich, Switzerland, ETH Zurich, Robotics & Artificial Intelligence Lab, KAIST, Deajeon, Korea, Robotics Research (United States), Centre for Artificial Intelligence and Robotics, Intelligent Systems Lab, Intel, Santa Clara, CA, USA

四足机器人机器人学习足式机器人运动控制地形感知

全文短总结尚未生成。

Learning to Walk in the Real World with Minimal Human Effort Figure 1
arXiv preprint2020

Learning to Walk in the Real World with Minimal Human Effort

Sehoon Ha, Peng Xu, Zhenyu Tan, Sergey Levine, Jie Tan

N N Georgia Institute of Technology N, Georgia Institute of Technology

四足机器人机器人学习

针对真实四足机器人用深度强化学习训练步态时人工复位多、易摔倒且难以规模化的问题,本文将多方向行走作为多任务联合学习以避免机器人离开训练区,并引入安全约束的SAC框架在奖励与摔倒风险间自适应权衡。在Minitaur上,系统能在平地、软床垫和带缝门垫上数小时内学到有效步态,平地实验几乎无需人工复位,并可一次训练前进、后退和左右转向策略。

Models, Pixels, and Rewards: Evaluating Design Trade-offs in Visual Model-Based Reinforcement Learning Figure 1
arXiv preprint2020

Models, Pixels, and Rewards: Evaluating Design Trade-offs in Visual Model-Based Reinforcement Learning

Mohammad Taghi

Google, Google (United States)

四足机器人机器人学习强化学习感知

这篇论文针对视觉模型式强化学习中世界模型设计缺乏可比分析的问题,统一比较是否预测像素、潜空间/观测空间动力学、奖励头输入等选择。核心发现是,预测未来图像比只预测奖励更能提升规划控制表现,且图像预测精度与下游成绩相关性强于奖励预测精度;相反,潜空间等常被强调的结构选择影响较小。实验还指出探索会改变模型优劣排序,性能拟合与在线探索需求可能存在冲突。

Mpc-based controller with terrain insight for dynamic legged locomotion Figure 1
arXiv preprint2020

Mpc-based controller with terrain insight for dynamic legged locomotion

Octavio Villarreal, Victor Barasuol, Patrick M. Wensing, Darwin G. Caldwell, Claudio Semini

Dynamic Legged Systems lab, Istituto Italiano di Tecnologia, Genoa, Italy, Istituto Italiano di Tecnologia,Dynamic Legged Systems lab,Genoa,Italy,16163, Italian Institute of Technology, Department of Aerospace and Mechanical Engineering, University of Notre, Dame, IN, USA, University of Notre,Department of Aerospace and Mechanical Engineering,Dame,IN,USA,46556, University of Notre Dame, Department of Advanced Robotics, Istituto Italiano di Tecnologia, Genoa, Italy, Istituto Italiano di Tecnologia,Department of Advanced Robotics,Genoa,Italy,16163

四足机器人机器人学习足式机器人运动控制模型预测控制

针对足式机器人在复杂地形中既要利用视觉地形信息、又受限于机载计算的矛盾,论文将CNN快速落足点评估生成的安全接触序列嵌入MPC躯干控制,用预测地面反力改善动态行走,并额外补偿摆动腿惯性对机身的力矩影响。在HyQReal仿真粗糙地形实验中,该方法在真实机载感知与计算约束下保持稳定,通过视觉提前应对障碍,落足点预测误差相较先前VFA降低约7%至36%。

No Figure
Science Robotics2020

Multi-expert learning of adaptive legged locomotion

Chuanyu Yang, Kai Yuan, Qiuguo Zhu, Wanming Yu, Zhibin Li

School of Informatics, University of Edinburgh, Edinburgh, UK, University of Edinburgh, Institute of Cyber-Systems and Control, Zhejiang University, Hangzhou, China, Zhejiang University

四足机器人机器人学习足式机器人运动控制

全文短总结尚未生成。

One Policy to Control Them All: Shared Modular Policies for Agent-Agnostic Control Figure 1
arXiv preprint2020

One Policy to Control Them All: Shared Modular Policies for Agent-Agnostic Control

作者信息待提取

Carnegie Mellon University

四足机器人机器人学习

针对强化学习控制器通常绑定单一机器人形态、难以在不同肢体数和状态/动作维度间复用的问题,论文提出共享模块化策略 SMP:在每个执行器上复用同一局部感知模块,并通过邻接肢体间消息传递实现全身协调。实验显示,一个策略可同时控制单足、双足、四足等平面形态,并零样本泛化到未见变体,性能接近为单个形态训练的基线。

No Figure
IEEE RA-L 20202020

Path Planning With Local Motion Estimations

Jerome Guzzi, R. Omar Chavez-Garcia, Mirko Nava, Luca Maria Gambardella, Alessandro Giusti

Dalle Molle Institute for Artificial Intelligence (IDSIA), USI-SUPSI, Lugano, Switzerland, University of Applied Sciences and Arts of Southern Switzerland, Dalle Molle Institute for Artificial Intelligence Research

四足机器人机器人学习导航规划

全文短总结尚未生成。

No Figure
Industrial Robot the international journal of robotics research and application2020

Plane-based stairway mapping for legged robot locomotion

Seungjun Woo, Francisco Yumbla, Chanyong Park, Hyouk Ryeol Choi, Hyungpil Moon

Sungkyunkwan University, Department of Mechanical Engineering, Sungkyunkwan University, Seoul, Republic of Korea

四足机器人机器人学习足式机器人运动控制

全文短总结尚未生成。

No Figure
Frontiers in Robotics and AI2020

Pronto: A Multi-Sensor State Estimator for Legged Robots in Real-World Scenarios

Marco Camurri, Milad Ramezani, Simona Nobili, Maurice Fallon

Dynamic Robot Systems, Department of Engineering Science, Oxford Robotics Institute, University of Oxford, Oxford, United Kingdom, Science Oxford, University of Oxford, University of Edinburgh

四足机器人机器人学习足式机器人导航

全文短总结尚未生成。

Rapidly Adaptable Legged Robots via Evolutionary Meta-Learning Figure 1
arXiv preprint2020

Rapidly Adaptable Legged Robots via Evolutionary Meta-Learning

Xingyou Song, Yuxiang Yang, Krzysztof Choromanski, Ken Caluwaerts, Wenbo Gao, Chelsea Finn, Jie Tan

Robotics at Google, Google (United States), Columbia University

四足机器人机器人学习足式机器人

本文针对足式机器人在电量下降、负载变化、打滑等真实动力学变化下难以快速适应的问题,提出将进化策略式元学习与非可微的 Batch Hill-Climbing 适应算子结合,以降低真实机器人高噪声对梯度估计的影响。方法在仿真中训练后部署到 Minitaur 四足机器人,在低电压加偏载和湿滑地面等场景中仅用约 50 次试验、150 秒真实数据即可显著改善行走表现,并优于基于策略梯度的 MAML 基线。

Rolling in the Deep - Hybrid Locomotion for Wheeled-Legged Robots using Online Trajectory Optimization Figure 1
IEEE RA-L 20202020

Rolling in the Deep - Hybrid Locomotion for Wheeled-Legged Robots using Online Trajectory Optimization

Marko Bjelonic, Prajish K. Sankar, C. Dario Bellicoso, Heike Vallery, Marco Hutter

Robotic Systems Lab, ETH Zürich, Zürich, Switzerland, ETH Zürich, ETH Zurich, Robotic Systems Lab, ETH-Zürich, Zürich, Switzerland, Delft University of Technology

四足机器人机器人学习足式机器人运动控制轮足运动

面向轮足机器人在复杂地形中兼顾高速长距离移动与越障能力的需求,论文提出将高维在线轨迹优化拆分为车轮轨迹与机身轨迹两部分,并结合ZMP平衡约束、滚动约束和分层全身力矩控制,以MPC方式实时生成行走-驱动混合运动。该方法在带非转向驱动轮的ANYmal上实现多种步态、毫秒级求解、盲越粗糙地形和台阶,并在DARPA地下挑战赛中完成快速建图、导航与搜索验证。

DeepGait: Planning and Control of Quadrupedal Gaits using Deep Reinforcement Learning Figure 1
IEEE RA-L 20202019

DeepGait: Planning and Control of Quadrupedal Gaits using Deep Reinforcement Learning

Vassilios Tsounis, Mitja Alge, Joonho Lee, Farbod Farshidian, Marco Hutter

Robotic Systems Lab, ETH Zürich, Zürich, Switzerland, ETH Zürich, ETH Zurich, Robotic Systems Lab, ETH-Zürich, Zürich, Switzerland

四足机器人机器人学习足式机器人强化学习运动控制

面向四足机器人在难以建模的非平坦地形中自主选 foothold 并保持动态平衡,DeepGait 将模型式轨迹优化与深度强化学习结合,用 CROC 动态可行性判定替代训练中的物理仿真,分别学习地形感知步态规划器和本体感知控制器。仿真实验显示其可通过随机楼梯、窄桥、间隙和踏脚石等场景,并较传统模型式方法具备更好的复杂地形适应性。

No Figure
DOI2019

Design a Fall Recovery Strategy for a Wheel-Legged Quadruped Robot Using Stability Feature Space

Juan Alejandro Castano, Chengxu Zhou, Nikos Tsagarakis

Systems Engineering and Automation, Carlos III University, Madrid, Spain, School of Mechanical Engineering, University of Leeds, Leeds, UK, University of Leeds, Humanoids & Human Centered Mechatronics Research Line, Istituto Italiano di Tecnologia, Genova, Italy, Italian Institute of Technology

四足机器人机器人学习足式机器人安全恢复轮足运动

全文短总结尚未生成。

No Figure
IEEE RA-L 20192019

Dynamic Locomotion on Slippery Ground

Fabian Jenelten, Jemin Hwangbo, Fabian Tresoldi, C. Dario Bellicoso, Marco Hutter

Robotic Systems Lab, ETH Zurich, Zurich, Switzerland, Robotic Systems Lab, ETH-Zürich, Zürich, Switzerland, ETH Zurich

四足机器人机器人学习运动控制敏捷运动地形感知

全文短总结尚未生成。

Fast and Continuous Foothold Adaptation for Dynamic Locomotion through CNNs Figure 1
IEEE RA-L 20192019

Fast and Continuous Foothold Adaptation for Dynamic Locomotion through CNNs

Octavio Antonio Villarreal Magana, Victor Barasuol, Marco Camurri, Luca Franceschi, Michele Focchi, Massimiliano Pontil, Darwin G. Caldwell, Claudio Semini

Dynamic Legged Systems Lab, Istituto Italiano di Tecnologia, Genoa, Italy, Italian Institute of Technology, Department of Advanced Robotics, Istituto Italiano di Tecnologia, Genoa, Italy

四足机器人机器人学习运动控制敏捷运动地形感知

针对四足机器人在粗糙未知地形上动态行走时,3D视觉处理难以满足实时落足调整的问题,本文用启发式规则自动生成安全落足标签,并训练CNN在摆腿过程中连续修正足端目标位置,作为反应式控制层的视觉接口。相比完整启发式搜索,推理最高快约200倍;在HyQ仿真与实机实验中支持静态和最高0.5 m/s动态步态,显示出更可靠的避障与落足适应能力。

Hierarchical Reinforcement Learning for Quadruped Locomotion Figure 1
arXiv preprint2019

Hierarchical Reinforcement Learning for Quadruped Locomotion

Deepali Jain, Atil Iscen, Ken Caluwaerts

四足机器人机器人学习足式机器人强化学习运动控制

针对四足机器人运动中高频稳定控制与低频任务决策难以手工分解的问题,论文提出端到端层级强化学习:高层在潜空间发出命令并决定持续时间,低层仅用机载传感器执行电机控制,从而解耦状态与时间尺度。路径跟随实验显示潜空间自动形成转向技能,低层可迁移到新轨迹以加速适应,并在真实四足机器人上完成验证。

Highly Dynamic Quadruped Locomotion via Whole-Body Impulse Control and Model Predictive Control Figure 1
arXiv preprint2019

Highly Dynamic Quadruped Locomotion via Whole-Body Impulse Control and Model Predictive Control

Di Carlo

四足机器人机器人学习足式机器人全身控制运动控制

针对四足高速运动中腾空相、短支撑和快速摆腿使传统轨迹跟踪式 WBC 难以稳定控制的问题,本文将凸 MPC 的长时域地面反力规划与高频全身冲量控制结合,重点跟踪反力而非质心轨迹,并放松浮动基约束以适应欠驱动态。该方法在 Mini-Cheetah 上实现 6 种步态、户外和跑步机测试,最高速度达 3.7 m/s,且展示了粗糙地形抗扰能力。

Policies Modulating Trajectory Generators Figure 1
arXiv preprint2019

Policies Modulating Trajectory Generators

Atil Iscen, Ken Caluwaerts

Google Brain, New York, United States, Google Brain, Mountain View, United States

四足机器人机器人学习

针对端到端学习四足步态数据需求高、复杂策略难训练的问题,论文提出 PMTG:让学习策略每步调制带状态的轨迹生成器参数,并叠加反馈修正,从而把先验步态与隐式记忆注入控制器。实验中,仅用 4 维 IMU 和简单线性策略,经 ES/RL 可学习可控速度步行,ES 少于 1000 次 rollout,并成功迁移到 Minitaur 实机。

Stabilizing Off-Policy Q-Learning via Bootstrapping Error Reduction Figure 1
arXiv preprint2019

Stabilizing Off-Policy Q-Learning via Bootstrapping Error Reduction

Aviral Kumar

UC Berkeley, Google Brain, UC Berkeley, Google Brain

四足机器人机器人学习

这篇论文针对离策略 Q-learning 在只能使用固定历史数据、无法再与机器人或仿真环境交互时容易发散的问题,指出关键原因是 Bellman 备份会在数据分布外动作上自举并累积误差。作者提出 BEAR,通过约束备份中的动作选择与数据支持集匹配来降低自举误差。MuJoCo 连续控制实验显示,它在随机、次优和专家数据上比常规离策略方法及 BCQ 更稳定,性能更一致。

Learning to Walk via Deep Reinforcement Learning Figure 1
arXiv preprint2018

Learning to Walk via Deep Reinforcement Learning

Tuomas Haarnoja, Sehoon Ha, Aurick Zhou, Jie Tan, George Tucker, Sergey Levine

Google Brain Berkeley Artificial Intelligence Research, University of California, Berkeley

四足机器人机器人学习强化学习

这篇论文针对真实四足机器人上深度强化学习样本效率低、超参数难调且易损伤硬件的问题,扩展最大熵 Soft Actor-Critic,通过目标熵约束自动调整温度参数,并配合异步采集/训练系统实现端到端学习。方法在 Minitaur 上无需模型或仿真,从零约 400 次 rollout、两小时学会稳定步态,且对未见地形和扰动有一定鲁棒性;仿真基准中也可用同一组超参数达到当时较强表现。

Policy Transfer with Strategy Optimization Figure 1
arXiv preprint2018

Policy Transfer with Strategy Optimization

作者信息待提取

School of Interactive Computing, Georgia Institute of Technology, GA

四足机器人机器人学习仿真到现实

本文针对仿真训练策略因现实差距难以直接迁移的问题,指出鲁棒策略易保守、自适应策略依赖系统辨识且在目标动力学偏离训练分布时会失效。其核心做法是在源环境中同时学习由动力学参数连续索引的一族策略,再在目标环境按任务回报用 CMA-ES 直接搜索最佳策略,而不显式辨识参数。实验覆盖 DART 到 MuJoCo、延迟、执行器误差和柔性末端等五类设置,显示 SO-CMA 比鲁棒/自适应基线能承受更大建模误差并以较少目标样本完成迁移。

Sim-to-Real: Learning Agile Locomotion For Quadruped Robots Figure 1
arXiv preprint2018

Sim-to-Real: Learning Agile Locomotion For Quadruped Robots

Jie Tan, Tingnan Zhang, Erwin Coumans, Atil Iscen

Google Brain, Google DeepMind

四足机器人机器人学习足式机器人运动控制仿真到现实

针对四足机器人敏捷步态依赖专家调参且仿真策略难以直接落地的问题,论文用 PPO 在仿真中学习控制器,并通过系统辨识、执行器与延迟建模、动力学随机化、扰动训练和紧凑观测来缩小现实差距,同时允许用开环参考约束步态风格。Minitaur 在无实机微调下实现 gallop 与 trot,速度接近手工步态且功耗分别降低约 35% 和 23%。

Meta Learning Shared Hierarchies Figure 1
arXiv preprint2017

Meta Learning Shared Hierarchies

Kevin Frans

Henry M. Gunn High School, UC Berkeley, Department of Electrical

四足机器人机器人学习

本文针对强化学习在相关新任务上从零学习样本效率低的问题,提出 MLSH:在任务分布上元学习一组共享、长时程执行的低层运动原语,由每个新任务单独学习的高层主策略切换,并通过反复采样任务、重置主策略来端到端训练。实验显示,该方法能在四足机器人迷宫中自动形成方向运动原语,迁移到稀疏奖励障碍任务,并让 3D 人形机器人用同一策略实现行走与爬行。