Affordances from Human Videos as a Versatile Representation for Robotics

17 April 2023

Papers citing "Affordances from Human Videos as a Versatile Representation for Robotics"

31 / 131 papers shown

Title
Dexterous Functional Grasping Ananye Agarwal Shagun Uppal Kenneth Shaw Deepak Pathak 23 34 0 05 Dec 2023
Towards Generalizable Zero-Shot Manipulation via Translating Human Interaction Plans Homanga Bharadhwaj Abhi Gupta Vikash Kumar Shubham Tulsiani LM&Ro 20 38 0 01 Dec 2023
Spacewalk-18: A Benchmark for Multimodal and Long-form Procedural Video Understanding in Novel Domains Rohan Myer Krishnan Zitian Tang Zhiqiu Yu Chen Sun 40 1 0 30 Nov 2023
One-Shot Open Affordance Learning with Foundation Models Gen Li Deqing Sun Laura Sevilla-Lara Varun Jampani VLM 61 21 0 29 Nov 2023
On Bringing Robots Home Nur Muhammad (Mahi) Shafiullah Anant Rai Haritheja Etukuru Yiqian Liu Ishan Misra Soumith Chintala Lerrel Pinto 22 74 0 27 Nov 2023
Open X-Embodiment: Robotic Learning Datasets and RT-X Models Open X-Embodiment Collaboration Abby OÑeill Abdul Rehman Abhinav Gupta Abhiram Maddukuri ... Zhuo Xu Zichen Jeff Cui Zichen Zhang Zipeng Fu Zipeng Lin LM&Ro 37 451 0 13 Oct 2023
Human-oriented Representation Learning for Robotic Manipulation Mingxiao Huo Mingyu Ding Chenfeng Xu Thomas Tian Xinghao Zhu Yao Mu Lingfeng Sun Masayoshi Tomizuka Wei Zhan SSL 28 12 0 04 Oct 2023
GRID: A Platform for General Robot Intelligence Development Sai H. Vemprala Shuhang Chen Abhinav Shukla Dinesh Narayanan Ashish Kapoor 17 10 0 02 Oct 2023
Online Estimation of Articulated Objects with Factor Graphs using Vision and Proprioceptive Sensing Russell Buchanan Adrian Rofer João Moura Abhinav Valada S. Vijayakumar 18 7 0 28 Sep 2023
Robotic Offline RL from Internet Videos via Value-Function Pre-Training Chethan Bhateja Derek Guo Dibya Ghosh Anika Singh Manan Tomar Q. Vuong Yevgen Chebotar Sergey Levine Aviral Kumar OffRL 26 20 0 22 Sep 2023
ForceSight: Text-Guided Mobile Manipulation with Visual-Force Goals Jeremy Collins C. Houff You Liang Tan Charles C. Kemp 8 4 0 21 Sep 2023
Efficient RL via Disentangled Environment and Agent Representations Kevin Gmelin Shikhar Bahl Russell Mendonca Deepak Pathak DRL 26 8 0 05 Sep 2023
RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunking Homanga Bharadhwaj Jay Vakil Mohit Sharma Abhi Gupta Shubham Tulsiani Vikash Kumar LM&Ro 15 115 0 05 Sep 2023
Structured World Models from Human Videos Russell Mendonca Shikhar Bahl Deepak Pathak LM&Ro 21 85 0 21 Aug 2023
VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models Wenlong Huang Chen Wang Ruohan Zhang Yunzhu Li Jiajun Wu Li Fei-Fei LM&Ro 28 474 0 12 Jul 2023
Learning Any-View 6DoF Robotic Grasping in Cluttered Scenes via Neural Surface Rendering Snehal Jauhri Ishikaa Lunawat Georgia Chalvatzaki 22 10 0 12 Jun 2023
Look Ma, No Hands! Agent-Environment Factorization of Egocentric Videos Matthew Chang Aditya Prakash Saurabh Gupta DiffM 27 17 0 25 May 2023
Pretrained Language Models as Visual Planners for Human Assistance Dhruvesh Patel H. Eghbalzadeh Nitin Kamra Michael L. Iuzzolino Unnat Jain Ruta Desai LM&Ro 11 24 0 17 Apr 2023
Real-World Robot Learning with Masked Visual Pre-training Ilija Radosavovic Tete Xiao Stephen James Pieter Abbeel Jitendra Malik Trevor Darrell SSL 146 238 0 06 Oct 2022
Learning State-Aware Visual Representations from Audible Interactions Himangi Mittal Pedro Morgado Unnat Jain Abhinav Gupta 64 22 0 27 Sep 2022
EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relations Ahmad Darkhalil Dandan Shan Bin Zhu Jian Ma Amlan Kar Richard E. L. Higgins Sanja Fidler David Fouhey Dima Damen VOS 39 98 0 26 Sep 2022
Learning Continuous Grasping Function with a Dexterous Hand from Human Demonstrations Jianglong Ye Jiashun Wang Binghao Huang Yuzhe Qin Xiaolong Wang 100 49 0 11 Jul 2022
Robotic Telekinesis: Learning a Robotic Hand Imitator by Watching Humans on Youtube Aravind Sivakumar Kenneth Shaw Deepak Pathak 112 99 0 21 Feb 2022
Ego4D: Around the World in 3,000 Hours of Egocentric Video Kristen Grauman Andrew Westbury Eugene Byrne Zachary Chavis Antonino Furnari ... Mike Zheng Shou Antonio Torralba Lorenzo Torresani Mingfei Yan Jitendra Malik EgoV 224 1,017 0 13 Oct 2021
Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Tasks Soroush Nasiriany Huihan Liu Yuke Zhu 80 107 0 07 Oct 2021
Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasets F. Ebert Yanlai Yang Karl Schmeckpeper Bernadette Bucher G. Georgakis Kostas Daniilidis Chelsea Finn Sergey Levine 155 212 0 27 Sep 2021
A Workflow for Offline Model-Free Robotic Reinforcement Learning Aviral Kumar Anika Singh Stephen Tian Chelsea Finn Sergey Levine OffRL 138 84 0 22 Sep 2021
DexMV: Imitation Learning for Dexterous Manipulation from Human Videos Yuzhe Qin Yueh-hua Wu Shaowei Liu Hanwen Jiang Ruihan Yang Yang Fu Xiaolong Wang 118 186 0 12 Aug 2021
What Matters in Learning from Offline Human Demonstrations for Robot Manipulation Ajay Mandlekar Danfei Xu J. Wong Soroush Nasiriany Chen Wang Rohun Kulkarni Li Fei-Fei Silvio Savarese Yuke Zhu Roberto Martín-Martín OffRL 147 461 0 06 Aug 2021
GridToPix: Training Embodied Agents with Minimal Supervision Unnat Jain Iou-Jen Liu Svetlana Lazebnik Aniruddha Kembhavi Luca Weihs A. Schwing 20 23 0 14 Apr 2021
Forecasting Action through Contact Representations from First Person Video Eadom Dessalene Chinmaya Devaraj Michael Maynord Cornelia Fermuller Yiannis Aloimonos EgoV 58 60 0 01 Feb 2021