How Generalizable Is My Behavior Cloning Policy? A Statistical Approach
to Trustworthy Performance Evaluation

How Generalizable Is My Behavior Cloning Policy? A Statistical Approach to Trustworthy Performance Evaluation

8 May 2024

Joseph A. Vincent

Haruki Nishimura

Paarth Shah

Papers citing "How Generalizable Is My Behavior Cloning Policy? A Statistical Approach to Trustworthy Performance Evaluation"

11 / 11 papers shown

Title
Real-is-Sim: Bridging the Sim-to-Real Gap with a Dynamic Digital Twin for Real-World Robot Policy Evaluation Jad Abou-Chakra Lingfeng Sun Krishan Rana Brandon B. May Karl Schmeckpeper M. Minniti Laura Herlant OffRL 50 0 0 04 Apr 2025
Is Your Imitation Learning Policy Better than Mine? Policy Comparison with Near-Optimal Stopping David Snyder Asher Hancock Apurva Badithela Emma Dixon Patrick "Tree" Miller Rares Ambrus Anirudha Majumdar Masha Itkina Haruki Nishimura OffRL 80 1 0 14 Mar 2025
Efficient Evaluation of Multi-Task Robot Policies With Active Experiment Selection Abrar Anwar Rohan Gupta Zain Merchant Sayan Ghosh Willie Neiswanger Jesse Thomason OffRL 64 0 0 14 Feb 2025
Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progress Christopher Agia Rohan Sinha Jingyun Yang Zi-ang Cao Rika Antonova Marco Pavone Jeannette Bohg 26 6 0 06 Oct 2024
Robots that Suggest Safe Alternatives Hyun Joe Jeong Andrea V. Bajcsy Andrea Bajcsy OffRL 29 1 0 15 Sep 2024
Robot Learning as an Empirical Science: Best Practices for Policy Evaluation H. Kress-Gazit Kunimatsu Hashimoto Naveen Kuppuswamy Paarth Shah Phoebe Horgan Gordon Richardson Siyuan Feng Benjamin Burchfiel 18 5 0 14 Sep 2024
Contrast Sets for Evaluating Language-Guided Robot Policies Abrar Anwar Rohan Gupta Jesse Thomason 24 2 0 19 Jun 2024
Explore until Confident: Efficient Exploration for Embodied Question Answering Allen Z. Ren Jaden Clark Anushri Dixit Masha Itkina Anirudha Majumdar Dorsa Sadigh 40 28 0 23 Mar 2024
Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation Zipeng Fu Tony Zhao Chelsea Finn 100 281 0 04 Jan 2024
Guarantees on Robot System Performance Using Stochastic Simulation Rollouts Joseph A. Vincent Aaron O. Feldman Mac Schwager 32 6 0 19 Sep 2023
Sample-Efficient Safety Assurances using Conformal Prediction Rachel Luo Shengjia Zhao Jonathan Kuck B. Ivanovic Silvio Savarese Edward Schmerling Marco Pavone 45 56 0 28 Sep 2021