270

Robust RL Control for Bipedal Locomotion with Closed Kinematic Chains

Egor Maslennikov
Eduard Zaliaev
Nikita Dudorov
Oleg Shamanin
Karanov Dmitry
Gleb Afanasev
Alexey Burkov
Egor Lygin
Simeon Nedelchev
Evgeny Ponomarev
Main:5 Pages
5 Figures
Bibliography:2 Pages
5 Tables
Abstract

Developing robust locomotion controllers for bipedal robots with closed kinematic chains presents unique challenges, particularly since most reinforcement learning (RL) approaches simplify these parallel mechanisms into serial models during training. We demonstrate that this simplification significantly impairs sim-to-real transfer by failing to capture essential aspects such as joint coupling, friction dynamics, and motor-space control characteristics. In this work, we present an RL framework that explicitly incorporates closed-chain dynamics and validate it on our custom-built robot TopA. Our approach enhances policy robustness through symmetry-aware loss functions, adversarial training, and targeted network regularization. Experimental results demonstrate that our integrated approach achieves stable locomotion across diverse terrains, significantly outperforming methods based on simplified kinematic models.

View on arXiv
Comments on this paper