Rapid trial-and-error learning with simulation supports flexible tool use and physical reasoning

22 July 2019

Papers citing "Rapid trial-and-error learning with simulation supports flexible tool use and physical reasoning"

47 / 47 papers shown

Title
Revisiting Rogers' Paradox in the Context of Human-AI Interaction K. M. Collins Umang Bhatt Ilia Sucholutsky 46 1 0 16 Jan 2025
Grounding Large Language Models In Embodied Environment With Imperfect World Models Haolan Liu Jishen Zhao LLMAG SyDa AI4CE 28 0 0 03 Oct 2024
Probing Mechanical Reasoning in Large Vision Language Models Haoran Sun Qingying Gao Haiyun Lyu Dezhi Luo Yijiang Li Hokin Deng LRM 39 2 0 01 Oct 2024
Building Machines that Learn and Think with People Katherine M. Collins Ilia Sucholutsky Umang Bhatt Kartik Chandra Lionel Wong ... Mark K. Ho Vikash K. Mansinghka Adrian Weller Joshua B. Tenenbaum Thomas L. Griffiths 40 29 0 22 Jul 2024
Compositional Image Decomposition with Diffusion Models Jocelin Su Nan Liu Yanbo Wang Joshua B. Tenenbaum Yilun Du CoGe 39 6 0 27 Jun 2024
Pandora: Towards General World Model with Natural Language Actions and Video States Jiannan Xiang Guangyi Liu Yi Gu Qiyue Gao Yuting Ning ... Shibo Hao Yemin Shi Zhengzhong Liu Eric P. Xing Zhiting Hu VGen 54 35 0 12 Jun 2024
Towards Lifelong Learning of Large Language Models: A Survey Junhao Zheng Shengjie Qiu Chengming Shi Qianli Ma KELM CLL 28 14 0 10 Jun 2024
PhyPlan: Generalizable and Rapid Physical Task Planning with Physics Informed Skill Networks for Robot Manipulators Mudit Chopra Abhinav Barnawal Harshil Vagadia Tamajit Banerjee Shreshth Tuli Souvik Chakraborty Rohan Paul LRM PINN 38 0 0 22 Apr 2024
m&m's: A Benchmark to Evaluate Tool-Use for multi-step multi-modal Tasks Zixian Ma Weikai Huang Jieyu Zhang Tanmay Gupta Ranjay Krishna 55 18 0 17 Mar 2024
PhyPlan: Compositional and Adaptive Physical Task Reasoning with Physics-Informed Skill Networks for Robot Manipulators Harshil Vagadia Mudit Chopra Abhinav Barnawal Tamajit Banerjee Shreshth Tuli Souvik Chakraborty Rohan Paul PINN LRM 29 2 0 24 Feb 2024
PoCo: Policy Composition from and for Heterogeneous Robot Learning Lirui Wang Jialiang Zhao Yilun Du Edward H. Adelson Russ Tedrake 73 28 0 04 Feb 2024
Benchmarks for Physical Reasoning AI Andrew Melnik Robin Schiewer Moritz Lange Andrei Muresanu Mozhgan Saeidi Animesh Garg Helge J. Ritter 24 8 0 17 Dec 2023
diff History for Neural Language Agents Ulyana Piterbarg Lerrel Pinto Rob Fergus 27 3 0 12 Dec 2023
Language Models, Agent Models, and World Models: The LAW for Machine Reasoning and Planning Zhiting Hu Tianmin Shu LLMAG LM&Ro LRM 102 34 0 08 Dec 2023
I-PHYRE: Interactive Physical Reasoning Shiqian Li Ke Wu Chi Zhang Yixin Zhu LRM 28 3 0 04 Dec 2023
Learning to Design and Use Tools for Robotic Manipulation Ziang Liu Stephen Tian Michelle Guo C. Karen Liu Jiajun Wu 29 4 0 01 Nov 2023
Physics-Based Task Generation through Causal Sequence of Physical Interactions C. Gamage Vimukthini Pinto Matthew Stephenson Jochen Renz 21 1 0 05 Aug 2023
Tool Learning with Foundation Models Yujia Qin Shengding Hu Yankai Lin Weize Chen Ning Ding ... Cheng Yang Tongshuang Wu Heng Ji Zhiyuan Liu Maosong Sun 42 199 0 17 Apr 2023
Learning Exploration Strategies to Solve Real-World Marble Runs Alisa Allaire C. Atkeson 24 0 0 08 Mar 2023
NovPhy: A Testbed for Physical Reasoning in Open-world Environments C. Gamage Vimukthini Pinto Cheng Xue Peng Zhang Ekaterina Nikonova Matthew Stephenson Jochen Renz LRM 19 2 0 03 Mar 2023
Learning rigid dynamics with face interaction graph networks Kelsey R. Allen Yulia Rubanova Tatiana López-Guevara William F. Whitney Alvaro Sanchez-Gonzalez Peter W. Battaglia Tobias Pfaff 3DH GNN AI4CE 34 34 0 07 Dec 2022
To think inside the box, or to think out of the box? Scientific discovery via the reciprocation of insights and concepts Yueqi Shi Manjie Xu Wenjuan Han Yixin Zhu LRM 28 1 0 01 Dec 2022
Discovering Generalizable Spatial Goal Representations via Graph-based Active Reward Learning Aviv Netanyahu Tianmin Shu J. Tenenbaum Pulkit Agrawal 24 5 0 24 Nov 2022
H-SAUR: Hypothesize, Simulate, Act, Update, and Repeat for Understanding Object Articulations from Interactions Keita Ota H. Tung Kevin A. Smith A. Cherian Tim K. Marks Alan Sullivan Asako Kanezaki J. Tenenbaum 20 3 0 22 Oct 2022
On the Learning Mechanisms in Physical Reasoning Shiqian Li Ke Wu Chi Zhang Yixin Zhu AI4CE 44 13 0 05 Oct 2022
Understanding Physical Effects for Effective Tool-use Zeyu Zhang Ziyuan Jiao Weiqi Wang Yixin Zhu Song-Chun Zhu Hangxin Liu 27 12 0 30 Jun 2022
Towards Understanding How Machines Can Learn Causal Overhypotheses Eliza Kosoy David M. Chan Adrian Liu Jasmine Collins Bryanna Kaufmann Sandy Han Huang Jessica B. Hamrick John F. Canny Nan Rosemary Ke Alison Gopnik CML AI4CE 26 18 0 16 Jun 2022
Modeling Human Behavior Part I -- Learning and Belief Approaches Andrew Fuchs A. Passarella M. Conti 27 7 0 13 May 2022
A Thermodynamics-informed Active Learning Approach to Perception and Reasoning about Fluids B. Moya Alberto Badías D. González Francisco Chinesta Elías Cueto AI4CE 10 12 0 11 Mar 2022
Learning Causal Overhypotheses through Exploration in Children and Computational Models Eliza Kosoy Adrian Liu Jasmine Collins David M. Chan Jessica B. Hamrick Nan Rosemary Ke Sandy H Huang Bryanna Kaufmann John F. Canny Alison Gopnik CML 22 9 0 21 Feb 2022
A Review of Emerging Research Directions in Abstract Visual Reasoning Mikolaj Malkiñski Jacek Mañdziuk 25 38 0 21 Feb 2022
Learning to reason about and to act on physical cascading events Y. Atzmon E. Meirom Shie Mannor Gal Chechik LRM 26 0 0 02 Feb 2022
Physical Design using Differentiable Learned Simulators Kelsey R. Allen Tatiana López-Guevara Kimberly L. Stachenfeld Alvaro Sanchez-Gonzalez Peter W. Battaglia Jessica B. Hamrick Tobias Pfaff AI4CE 19 42 0 01 Feb 2022
Unsupervised Learning of Compositional Energy Concepts Yilun Du Shuang Li Yash Sharma J. Tenenbaum Igor Mordatch CoGe OCL 19 76 0 04 Nov 2021
Capturing the objects of vision with neural networks B. Peters N. Kriegeskorte OCL 33 56 0 07 Sep 2021
Phy-Q as a measure for physical reasoning intelligence Cheng Xue Vimukthini Pinto C. Gamage Ekaterina Nikonova Peng Zhang Jochen Renz LRM 16 12 0 31 Aug 2021
Human-Level Reinforcement Learning through Theory-Based Modeling, Exploration, and Planning Pedro Tsividis J. Loula Jake Burga Nathan Foss Andres Campero Thomas Pouncy S. Gershman J. Tenenbaum LM&Ro 18 43 0 27 Jul 2021
Hi-Phy: A Benchmark for Hierarchical Physical Reasoning Cheng Xue Vimukthini Pinto C. Gamage Peng Zhang Jochen Renz 18 0 0 17 Jun 2021
The Difficulty of Novelty Detection in Open-World Physical Domains: An Application to Angry Birds Vimukthini Pinto Cheng Xue C. Gamage Matthew Stephenson Jochen Renz 17 2 0 16 Jun 2021
Physion: Evaluating Physical Prediction from Vision in Humans and Machines Daniel M. Bear E. Wang Damian Mrowca Felix Binder Hsiau-Yu Fish Tung ... Li Fei-Fei Nancy Kanwisher J. Tenenbaum Daniel L. K. Yamins Judith E. Fan OOD 58 86 0 15 Jun 2021
Visual scoping operations for physical assembly Felix Binder Marcelo Mattar David Kirsh Judith E. Fan 23 4 0 10 Jun 2021
Multi-Task Reinforcement Learning with Context-based Representations Shagun Sodhani Amy Zhang Joelle Pineau 27 180 0 11 Feb 2021
CRAFT: A Benchmark for Causal Reasoning About Forces and inTeractions Tayfun Ates Muhammed Samil Atesoglu Cagatay Yigit .Ilker Kesen Mert Kobaş Erkut Erdem Aykut Erdem T. Goksun Deniz Yuret 19 31 0 08 Dec 2020
Emergent Tool Use From Multi-Agent Autocurricula Bowen Baker I. Kanitscheider Todor Markov Yi Wu Glenn Powell Bob McGrew Igor Mordatch LRM 26 644 0 17 Sep 2019
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 314 11,681 0 09 Mar 2017
A Compositional Object-Based Approach to Learning Physical Dynamics Michael Chang T. Ullman Antonio Torralba J. Tenenbaum AI4CE OCL 241 438 0 01 Dec 2016
Interaction Networks for Learning about Objects, Relations and Physics Peter W. Battaglia Razvan Pascanu Matthew Lai Danilo Jimenez Rezende Koray Kavukcuoglu AI4CE OCL PINN GNN 278 1,400 0 01 Dec 2016