Deep Affordance Foresight: Planning Through What Can Be Done in the Future

17 November 2020

Danfei Xu

Ajay Mandlekar

Roberto Martín-Martín

Yuke Zhu

Silvio Savarese

Li Fei-Fei

ArXiv PDF HTML

Papers citing "Deep Affordance Foresight: Planning Through What Can Be Done in the Future"

46 / 46 papers shown

Title
MOSAIC: A Skill-Centric Algorithmic Framework for Long-Horizon Manipulation Planning Itamar Mishani Yorai Shaoul Maxim Likhachev 40 0 0 23 Apr 2025
IAAO: Interactive Affordance Learning for Articulated Objects in 3D Environments Can Zhang G. Lee 27 0 0 09 Apr 2025
Automated Planning Domain Inference for Task and Motion Planning Jinbang Huang Allen Tao Rozilyn Marco Miroslav Bogdanovic Jonathan Kelly Florian Shkurti 29 1 0 21 Oct 2024
Generative Factor Chaining: Coordinated Manipulation with Diffusion-based Factor Graph Utkarsh Aashu Mishra Yongxin Chen Danfei Xu LRM 28 4 0 24 Sep 2024
Interpretable Responsibility Sharing as a Heuristic for Task and Motion Planning Arda Sarp Yenicesu Sepehr Nourmohammadi Berk Cicek Ozgur S. Oguz 67 0 0 09 Sep 2024
Points2Plans: From Point Clouds to Long-Horizon Plans with Composable Relational Dynamics Yixuan Huang Christopher Agia Jimmy Wu Tucker Hermans Jeannette Bohg 3DPC 49 1 0 27 Aug 2024
Affordance Labeling and Exploration: A Manifold-Based Approach Ismail Özçil A. Koku 23 0 0 22 Jul 2024
LIT: Large Language Model Driven Intention Tracking for Proactive Human-Robot Collaboration -- A Robot Sous-Chef Application Zhe Huang John Pohovey Ananya Yammanuru Katherine Driggs-Campbell LM&Ro 38 0 0 19 Jun 2024
Logic-Skill Programming: An Optimization-based Approach to Sequential Skill Planning Teng Xue Amirreza Razmjoo Suhan Shetty Sylvain Calinon 19 4 0 07 May 2024
Empowering Large Language Models on Robotic Manipulation with Affordance Prompting Guangran Cheng Chuheng Zhang Wenzhe Cai Li Zhao Changyin Sun Jiang Bian LM&Ro LLMAG 187 9 0 17 Apr 2024
A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approaches Zhigen Zhao Shuo Cheng Yan Ding Ziyi Zhou Shiqi Zhang Danfei Xu Ye Zhao 38 22 0 03 Apr 2024
NOD-TAMP: Generalizable Long-Horizon Planning with Neural Object Descriptors Shuo Cheng Caelan Reed Garrett Ajay Mandlekar Danfei Xu 35 2 0 02 Nov 2023
NOIR: Neural Signal Operated Intelligent Robots for Everyday Activities Ruohan Zhang Sharon Lee Minjune Hwang Ayano Hiranaka Chen Wang ... Gabrael Levine Ruohan Gao Anthony Norcia Fei-Fei Li Jiajun Wu LM&Ro 15 17 0 02 Nov 2023
Learning to Design and Use Tools for Robotic Manipulation Ziang Liu Stephen Tian Michelle Guo C. Karen Liu Jiajun Wu 29 4 0 01 Nov 2023
Generative Skill Chaining: Long-Horizon Skill Planning with Diffusion Models Utkarsh Aashu Mishra Shangjie Xue Yongxin Chen Danfei Xu LRM 31 65 0 13 Oct 2023
Primitive Skill-based Robot Learning from Human Evaluative Feedback Ayano Hiranaka Minjune Hwang Sharon Lee Chen Wang Li Fei-Fei Jiajun Wu Ruohan Zhang OffRL 13 11 0 28 Jul 2023
DiMSam: Diffusion Models as Samplers for Task and Motion Planning under Partial Observability Xiaolin Fang Caelan Reed Garrett Clemens Eppner Tomás Lozano-Pérez L. Kaelbling D. Fox DiffM 33 17 0 22 Jun 2023
Self-Supervised Learning of Action Affordances as Interaction Modes Liquang Wang Nikita Dvornik R. Dubeau Mayank Mittal Animesh Garg SSL 26 3 0 27 May 2023
DeRi-Bot: Learning to Collaboratively Manipulate Rigid Objects via Deformable Objects Zixing Wang A. H. Qureshi 19 2 0 22 May 2023
STRAP: Structured Object Affordance Segmentation with Point Supervision Lei Cui Xiaoxue Chen Hao Zhao Guyue Zhou Yixin Zhu 3DPC 28 6 0 17 Apr 2023
Text2Motion: From Natural Language Instructions to Feasible Plans Kevin Qinghong Lin Christopher Agia Toki Migimatsu Marco Pavone Jeannette Bohg LM&Ro 18 265 0 21 Mar 2023
Multi-step planning with learned effects of partial action executions Hakan Aktas Utku Bozdoğan Emre Ugur 6 2 0 16 Mar 2023
Recent Advances of Deep Robotic Affordance Learning: A Reinforcement Learning Perspective Xintong Yang Ze Ji Jing Wu Yunyu Lai 33 12 0 09 Mar 2023
Embodied Active Learning of Relational State Abstractions for Bilevel Planning Amber Li Tom Silver 23 9 0 08 Mar 2023
Using Memory-Based Learning to Solve Tasks with State-Action Constraints Mrinal Verghese C. Atkeson OffRL CLL 20 2 0 08 Mar 2023
Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied Agents Wenlong Huang Fei Xia Dhruv Shah Danny Driess Andy Zeng ... Pete Florence Igor Mordatch Sergey Levine Karol Hausman Brian Ichter LM&Ro 19 41 0 01 Mar 2023
Simulated Mental Imagery for Robotic Task Planning Shijia Li Tomas Kulvicius M. Tamosiunaite F. Worgotter LM&Ro 24 1 0 15 Nov 2022
Active Task Randomization: Learning Robust Skills via Unsupervised Generation of Diverse and Feasible Tasks Kuan Fang Toki Migimatsu Ajay Mandlekar Li Fei-Fei Jeannette Bohg 44 2 0 11 Nov 2022
LEAGUE: Guided Skill Learning and Abstraction for Long-Horizon Manipulation Shuo Cheng Danfei Xu 46 37 0 23 Oct 2022
STAP: Sequencing Task-Agnostic Policies Christopher Agia Toki Migimatsu Jiajun Wu Jeannette Bohg 35 19 0 21 Oct 2022
Learning Preconditions of Hybrid Force-Velocity Controllers for Contact-Rich Manipulation Jacky Liang Xianyi Cheng Oliver Kroemer 11 9 0 25 Jun 2022
Recognising Affordances in Predicted Futures to Plan with Consideration of Non-canonical Affordance Effects S. Arnold Mami Kuroishi Tadashi Adachi Kimitoshi Yamazaki 11 0 0 22 Jun 2022
Generalizable Task Planning through Representation Pretraining Chen Wang Danfei Xu Li Fei-Fei LM&Ro 55 28 0 16 May 2022
PartAfford: Part-level Affordance Discovery from 3D Objects Chao Xu Yixin Chen He-Nan Wang Song-Chun Zhu Yixin Zhu Siyuan Huang 21 25 0 28 Feb 2022
Learning to Act with Affordance-Aware Multimodal Neural SLAM Zhiwei Jia Kaixiang Lin Yizhou Zhao Qiaozi Gao Govind Thattai Gaurav Sukhatme LM&Ro 23 15 0 24 Jan 2022
The Paradox of Choice: Using Attention in Hierarchical Reinforcement Learning A. Nica Khimya Khetarpal Doina Precup 13 4 0 24 Jan 2022
Value Function Spaces: Skill-Centric State Abstractions for Long-Horizon Reasoning Dhruv Shah Peng-Tao Xu Yao Lu Ted Xiao Alexander Toshev Sergey Levine Brian Ichter OffRL 19 41 0 04 Nov 2021
Relationship Oriented Affordance Learning through Manipulation Graph Construction Chao Tang Jingwen Yu Weinan Chen Hong Zhang 16 3 0 27 Oct 2021
Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Tasks Soroush Nasiriany Huihan Liu Yuke Zhu 80 109 0 07 Oct 2021
Search-Based Task Planning with Learned Skill Effect Models for Lifelong Robotic Manipulation Jacky Liang Mohit Sharma A. LaGrassa Shivam Vats Saumya Saxena Oliver Kroemer 61 31 0 17 Sep 2021
Predicting Stable Configurations for Semantic Placement of Novel Objects Chris Paxton Christopher Xie Tucker Hermans D. Fox 28 47 0 26 Aug 2021
Temporally Abstract Partial Models Khimya Khetarpal Zafarali Ahmed Gheorghe Comanici Doina Precup 20 14 0 06 Aug 2021
VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated Objects Ruihai Wu Yan Zhao Kaichun Mo Zizheng Guo Yian Wang Tianhao Wu Qingnan Fan Xuelin Chen Leonidas J. Guibas Hao Dong 30 90 0 28 Jun 2021
NeRP: Neural Rearrangement Planning for Unknown Objects A. H. Qureshi Arsalan Mousavian Chris Paxton Michael C. Yip D. Fox 13 61 0 02 Jun 2021
What Can I Do Here? Learning New Skills by Imagining Visual Affordances Alexander Khazatsky Ashvin Nair Dan Jing Sergey Levine LM&Ro 4 33 0 01 Jun 2021
Learning Robotic Manipulation Tasks via Task Progress based Gaussian Reward and Loss Adjusted Exploration Sulabh Kumra Shirin Joshi F. Sahin 19 12 0 02 Mar 2021