Neural Task Graphs: Generalizing to Unseen Tasks from a Single Video Demonstration

10 July 2018

De-An Huang

Li Fei-Fei

Silvio Savarese

Juan Carlos Niebles

ArXiv PDF HTML

Papers citing "Neural Task Graphs: Generalizing to Unseen Tasks from a Single Video Demonstration"

38 / 38 papers shown

Title
Chain-of-Modality: Learning Manipulation Programs from Multimodal Human Videos with Vision-Language-Models Chen Wang Fei Xia Wenhao Yu Tingnan Zhang Ruohan Zhang Ce Liu Li Fei-Fei Jie Tan Jacky Liang 36 0 0 17 Apr 2025
Points2Plans: From Point Clouds to Long-Horizon Plans with Composable Relational Dynamics Yixuan Huang Christopher Agia Jimmy Wu Tucker Hermans Jeannette Bohg 3DPC 49 1 0 27 Aug 2024
TOD-Flow: Modeling the Structure of Task-Oriented Dialogues Sungryull Sohn Yiwei Lyu Anthony Z. Liu Lajanugen Logeswaran Dong-Ki Kim Dongsub Shim Honglak Lee 28 3 0 07 Dec 2023
Universal Visual Decomposer: Long-Horizon Manipulation Made Easy Zichen Zhang Yunshuang Li Osbert Bastani Abhishek Gupta Dinesh Jayaraman Yecheng Jason Ma Luca Weihs 37 17 0 12 Oct 2023
RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shot Haoshu Fang Hongjie Fang Zhenyu Tang Jirong Liu Chenxi Wang Junbo Wang Haoyi Zhu Cewu Lu 38 58 0 02 Jul 2023
Neural Constraint Satisfaction: Hierarchical Abstraction for Combinatorial Generalization in Object Rearrangement Michael Chang Alyssa Dayan Franziska Meier Thomas L. Griffiths Sergey Levine Amy Zhang OCL OffRL 27 9 0 20 Mar 2023
Action Dynamics Task Graphs for Learning Plannable Representations of Procedural Tasks Weichao Mao Ruta Desai Michael L. Iuzzolino Nitin Kamra 24 5 0 11 Jan 2023
Cross-Domain Transfer via Semantic Skill Imitation Karl Pertsch Ruta Desai Vikash Kumar Franziska Meier Joseph J. Lim Dhruv Batra Akshara Rai LM&Ro 13 18 0 14 Dec 2022
LEAGUE: Guided Skill Learning and Abstraction for Long-Horizon Manipulation Shuo Cheng Danfei Xu 54 37 0 23 Oct 2022
ToolTango: Common sense Generalization in Predicting Sequential Tool Interactions for Robot Plan Synthesis Shreshth Tuli Rajas Bansal Rohan Paul Mausam LM&Ro 15 4 0 18 Jun 2022
Fast Inference and Transfer of Compositional Task Structures for Few-shot Task Generalization Sungryull Sohn Hyunjae Woo Jongwook Choi lyubing qiang Izzeddin Gur Aleksandra Faust Honglak Lee BDL OffRL 29 3 0 25 May 2022
Policy Architectures for Compositional Generalization in Control Allan Zhou Vikash Kumar Chelsea Finn Aravind Rajeswaran 23 22 0 10 Mar 2022
BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning Eric Jang A. Irpan Mohi Khansari Daniel Kappler F. Ebert Corey Lynch Sergey Levine Chelsea Finn LM&Ro 72 518 0 04 Feb 2022
You Only Demonstrate Once: Category-Level Manipulation from Single Visual Demonstration Bowen Wen Wenzhao Lian Kostas Bekris S. Schaal 22 90 0 30 Jan 2022
Learning Task-Parameterized Skills from Few Demonstrations Jihong Zhu Michael Gienger Jens Kober 25 22 0 24 Jan 2022
Learning Two-Step Hybrid Policy for Graph-Based Interpretable Reinforcement Learning Tongzhou Mu Kaixiang Lin Fei Niu Govind Thattai OffRL 25 0 0 21 Jan 2022
Example-Driven Model-Based Reinforcement Learning for Solving Long-Horizon Visuomotor Tasks Bohan Wu Suraj Nair Li Fei-Fei Chelsea Finn OffRL LM&Ro 38 24 0 21 Sep 2021
Geometric Task Networks: Learning Efficient and Explainable Skill Coordination for Object Manipulation Meng Guo Mathias Bürger 27 9 0 18 Sep 2021
UMPNet: Universal Manipulation Policy Network for Articulated Objects Zhenjia Xu Zhanpeng He Shuran Song PINN 16 84 0 13 Sep 2021
Learning Forceful Manipulation Skills from Multi-modal Human Demonstrations An T. Le Meng Guo Niels van Duijkeren Leonel Rozo R. Krug A. Kupcsik Mathias Buerger 30 18 0 09 Sep 2021
Video2Skill: Adapting Events in Demonstration Videos to Skills in an Environment using Cyclic MDP Homomorphisms S. Sontakke Sumegh Roychowdhury Mausoom Sarkar Nikaash Puri Balaji Krishnamurthy Laurent Itti 34 1 0 08 Sep 2021
Learning to Synthesize Programs as Interpretable and Generalizable Policies Dweep Trivedi Jesse Zhang Shao-Hua Sun Joseph J. Lim NAI 24 72 0 31 Aug 2021
Predicting Stable Configurations for Semantic Placement of Novel Objects Chris Paxton Christopher Xie Tucker Hermans D. Fox 36 47 0 26 Aug 2021
Discovering Generalizable Skills via Automated Generation of Diverse Tasks Kuan Fang Yuke Zhu Silvio Savarese Li Fei-Fei 48 6 0 26 Jun 2021
Reactive Long Horizon Task Execution via Visual Skill and Precondition Models Shohin Mukherjee Chris Paxton Arsalan Mousavian Adam Fishman Maxim Likhachev D. Fox 32 13 0 17 Nov 2020
SHERLock: Self-Supervised Hierarchical Event Representation Learning Sumegh Roychowdhury S. Sontakke Nikaash Puri Mausoom Sarkar Milan Aggarwal Pinkesh Badjatiya Balaji Krishnamurthy Laurent Itti SSL DRL 33 1 0 06 Oct 2020
Evolving Graphical Planner: Contextual Global Planning for Vision-and-Language Navigation Zhiwei Deng Karthik Narasimhan Olga Russakovsky 21 86 0 11 Jul 2020
Learning Robot Skills with Temporal Variational Inference Tanmay Shankar Abhinav Gupta DRL BDL 38 74 0 29 Jun 2020
Transferable Task Execution from Pixels through Deep Planning Domain Learning Kei Kase Chris Paxton H. Mazhar T. Ogata D. Fox 147 45 0 08 Mar 2020
Scalable Multi-Task Imitation Learning with Autonomous Improvement Avi Singh Eric Jang A. Irpan Daniel Kappler Murtaza Dalal Sergey Levine Mohi Khansari Chelsea Finn 48 35 0 25 Feb 2020
Machine Learning in Python: Main developments and technology trends in data science, machine learning, and artificial intelligence S. Raschka Joshua Patterson Corey J. Nolet AI4CE 24 483 0 12 Feb 2020
A Mobile Manipulation System for One-Shot Teaching of Complex Tasks in Homes M. Bajracharya James Borders D. Helmick Thomas Kollar Michael Laskey ... A. Ochiai Josh Petersen K. Shankar Kevin Stone Yutaka Takaoka 25 30 0 30 Sep 2019
Continuous Relaxation of Symbolic Planner for One-Shot Imitation Learning De-An Huang Danfei Xu Yuke Zhu Animesh Garg Silvio Savarese Fei-Fei Li Juan Carlos Niebles CLL 17 18 0 16 Aug 2019
A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithms Oliver Kroemer S. Niekum George Konidaris 30 356 0 06 Jul 2019
Few-Shot Bayesian Imitation Learning with Logical Program Policies Tom Silver Kelsey R. Allen Alexander K. Lew L. Kaelbling J. Tenenbaum LM&Ro 21 50 0 12 Apr 2019
One-Shot Hierarchical Imitation Learning of Compound Visuomotor Tasks Tianhe Yu Pieter Abbeel Sergey Levine Chelsea Finn 13 68 0 25 Oct 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 344 11,684 0 09 Mar 2017
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 218 7,926 0 17 Aug 2015