Title
Learning Conditional Invariances through Non-Commutativity Abhra Chaudhuri Serban Georgescu Anjan Dutta 38 0 0 18 Feb 2024
ContPhy: Continuum Physical Concept Learning and Reasoning from Videos Zhicheng Zheng Xin Yan Zhenfang Chen Jingzhou Wang Qin Zhi Eddie Lim Joshua B. Tenenbaum Chuang Gan LRM 27 6 0 09 Feb 2024
A call for embodied AI Giuseppe Paolo Jonas Gonzalez-Billandon Balázs Kégl LM&Ro 19 9 0 06 Feb 2024
VR-based generation of photorealistic synthetic data for training hand-object tracking models Chengyan Zhang Rahul Chaudhari 30 1 0 31 Jan 2024
On the Emergence of Symmetrical Reality Zhenlian Zhang Zeyu Zhang Ziyuan Jiao Yao Su Hangxin Liu Wei Wang Song-Chun Zhu 11 4 0 26 Jan 2024
Incorporating simulated spatial context information improves the effectiveness of contrastive learning models Lizhen Zhu James Z. Wang Wonseuk Lee Bradley P. Wyble 27 2 0 26 Jan 2024
HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments Qinhong Zhou Sunli Chen Yisong Wang Haozhe Xu Weihua Du Hongxin Zhang Yilun Du Josh Tenenbaum Chuang Gan AI4CE 20 12 0 23 Jan 2024
How does the primate brain combine generative and discriminative computations in vision? Benjamin Peters J. DiCarlo Todd Gureckis Ralf Haefner Leyla Isik ... Kimberly Stachenfeld Zenna Tavares Doris Y. Tsao Ilker Yildirim N. Kriegeskorte 16 2 0 11 Jan 2024
Holodeck: Language Guided Generation of 3D Embodied AI Environments Yue Yang Fan-Yun Sun Luca Weihs Eli VanderBilt Alvaro Herrasti ... Lingjie Liu Chris Callison-Burch Mark Yatskar Aniruddha Kembhavi Christopher Clark LM&Ro 29 77 0 14 Dec 2023
Counterfactual World Modeling for Physical Dynamics Understanding Rahul Venkatesh Honglin Chen Kevin T. Feigelis Daniel M. Bear Khaled Jedoui ... Wanhee Lee Sherry Liu Kevin A. Smith Judith E. Fan Daniel L. K. Yamins VGen 38 1 0 11 Dec 2023
Neither hype nor gloom do DNNs justice Gaurav Malhotra Christian Tsvetkov B. D. Evans 19 117 0 08 Dec 2023
MIMo: A Multi-Modal Infant Model for Studying Cognitive Development Dominik Mattern Pierre Schumacher F. M. López Marcel C. Raabe M. Ernst A. Aubret Jochen Triesch 15 4 0 07 Dec 2023
Caregiver Talk Shapes Toddler Vision: A Computational Study of Dyadic Play Timothy Schaumlöffel A. Aubret Gemma Roig Jochen Triesch 19 2 0 07 Dec 2023
Low-shot Object Learning with Mutual Exclusivity Bias Anh Thai Ahmad Humayun Stefan Stojanov Zixuan Huang Bikram Boote James M. Rehg 27 2 0 06 Dec 2023
Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real World Kiana Ehsani Tanmay Gupta Rose Hendrix Jordi Salvador Luca Weihs ... Alvaro Herrasti Ranjay Krishna Dustin Schwenk Eli VanderBilt Aniruddha Kembhavi 22 18 0 05 Dec 2023
Diversify, Don't Fine-Tune: Scaling Up Visual Recognition Training with Synthetic Images Zhuoran Yu Chenchen Zhu Sean Culatana Raghuraman Krishnamoorthi Fanyi Xiao Yong Jae Lee 109 13 0 04 Dec 2023
Differentiable Fluid Physics Parameter Identification Via Stirring Samuel Paradis Dongzhe Zheng Yutong Li Michael Whitmeyer Cewu Lu 11 0 0 09 Nov 2023
RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulation Yufei Wang Zhou Xian Feng Chen Tsun-Hsuan Wang Yian Wang Katerina Fragkiadaki Zackory M. Erickson David Held Chuang Gan LM&Ro 36 94 0 02 Nov 2023
Gen2Sim: Scaling up Robot Learning in Simulation with Generative Models Pushkal Katara Zhou Xian Katerina Fragkiadaki LM&Ro 41 35 0 27 Oct 2023
Large Language Models as Generalizable Policies for Embodied Tasks Andrew Szot Max Schwarzer Harsh Agrawal Bogdan Mazoure Walter A. Talbott Katherine Metcalf Natalie Mackraz Devon Hjelm Alexander Toshev LM&Ro 19 57 0 26 Oct 2023
Habitat 3.0: A Co-Habitat for Humans, Avatars and Robots Xavi Puig Eric Undersander Andrew Szot Mikael Dallaire Cote Tsung-Yen Yang ... Singh Chaplot Unnat Jain Dhruv Batra †. AksharaRai †. RoozbehMottaghi 16 114 0 19 Oct 2023
HandMeThat: Human-Robot Communication in Physical and Social Environments Yanming Wan Jiayuan Mao J. Tenenbaum 34 16 0 05 Oct 2023
LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Models Saaket Agashe Yue Fan Anthony Reyna Xin Eric Wang LLMAG LRM 94 10 0 05 Oct 2023
Skill Transformer: A Monolithic Policy for Mobile Manipulation Xiaoyu Huang Dhruv Batra Akshara Rai Andrew Szot LM&Ro 17 21 0 19 Aug 2023
$A^2$ Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Models Peihao Chen Xinyu Sun Hongyan Zhi Runhao Zeng Thomas H. Li Gaowen Liu Mingkui Tan Chuang Gan LLMAG LM&Ro 25 32 0 15 Aug 2023
PUG: Photorealistic and Semantically Controllable Synthetic Data for Representation Learning Florian Bordes Shashank Shekhar Mark Ibrahim Diane Bouchacourt Pascal Vincent Ari S. Morcos 23 25 0 08 Aug 2023
Improving Multimodal Datasets with Image Captioning Thao Nguyen S. Gadre Gabriel Ilharco Sewoong Oh Ludwig Schmidt VLM 19 70 0 19 Jul 2023
RL-ViGen: A Reinforcement Learning Benchmark for Visual Generalization Zhecheng Yuan Sizhe Yang Pu Hua C. Chang Kaizhe Hu Huazhe Xu OOD OffRL 22 16 0 15 Jul 2023
AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation System Yuzhe Qin Wei Yang Binghao Huang Karl Van Wyk Hao Su Xiaolong Wang Yu-Wei Chao D. Fox 28 91 0 10 Jul 2023
Building Cooperative Embodied Agents Modularly with Large Language Models Hongxin Zhang Weihua Du Jiaming Shan Qinhong Zhou Yilun Du J. Tenenbaum Tianmin Shu Chuang Gan LLMAG LM&Ro 45 155 0 05 Jul 2023
Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Properties H. Tung Mingyu Ding Zhenfang Chen Daniel M. Bear Chuang Gan J. Tenenbaum Daniel L. K. Yamins Judy Fan Kevin A. Smith 58 13 0 27 Jun 2023
Physics-Informed Machine Learning for Modeling and Control of Dynamical Systems Truong X. Nghiem Ján Drgoňa Colin N. Jones Zoltán Nagy Roland Schwan ... J. Paulson Andrea Carron M. Zeilinger Wenceslao Shaw-Cortez D. Vrabie PINN AI4CE 30 29 0 24 Jun 2023
HomeRobot: Open-Vocabulary Mobile Manipulation Sriram Yenamandra A. Ramachandran Karmesh Yadav Austin S. Wang Mukul Khanna ... Devendra Singh Chaplot Dhruv Batra Roozbeh Mottaghi Yonatan Bisk Chris Paxton LM&Ro 33 79 0 20 Jun 2023
CorNav: Autonomous Agent with Self-Corrected Planning for Zero-Shot Vision-and-Language Navigation Xiwen Liang Liang Ma Shanshan Guo Jianhua Han Hang Xu Shikui Ma Xiaodan Liang LM&Ro LLMAG 79 4 0 17 Jun 2023
RealImpact: A Dataset of Impact Sound Fields for Real Objects Samuel Clarke Ruohan Gao Mason Wang M. Rau Julia Xu Jui-Hsien Wang Doug L. James Jiajun Wu 25 9 0 16 Jun 2023
Galactic: Scaling End-to-End Reinforcement Learning for Rearrangement at 100k Steps-Per-Second Vincent-Pierre Berges Andrew Szot Devendra Singh Chaplot Aaron Gokaslan Roozbeh Mottaghi Dhruv Batra Eric Undersander LRM LM&Ro 19 5 0 13 Jun 2023
A Study of Global and Episodic Bonuses for Exploration in Contextual MDPs Mikael Henaff Minqi Jiang Roberta Raileanu 19 13 0 05 Jun 2023
Sonicverse: A Multisensory Simulation Platform for Embodied Household Agents that See and Hear Ruohan Gao Hao Li Gokul Dharan Zhuzhu Wang Chengshu Li Fei Xia Silvio Savarese Li Fei-Fei Jiajun Wu 26 11 0 01 Jun 2023
Adaptive Coordination in Social Embodied Rearrangement Andrew Szot Unnat Jain Dhruv Batra Z. Kira Ruta Desai Akshara Rai 33 12 0 31 May 2023
Modeling Dynamic Environments with Scene Graph Memory Andrey Kurenkov Michael Lingelbach Tanmay Agarwal Emily Jin Chengshu Li Ruohan Zhang Li Fei-Fei Jiajun Wu Silvio Savarese Roberto Martín-Martín 26 11 0 27 May 2023
How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontiers Junting Chen G. Li Suryansh Kumar Bernard Ghanem F. I. F. Richard Yu LM&Ro 14 50 0 26 May 2023
Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality Harman Singh Pengchuan Zhang Qifan Wang Mengjiao MJ Wang Wenhan Xiong Jingfei Du Yu Chen CoGe VLM 20 24 0 23 May 2023
Measuring and Modeling Physical Intrinsic Motivation Julio Martinez Felix Binder Haoliang Wang Nick Haber Judith E. Fan Daniel L. K. Yamins 11 2 0 22 May 2023
Neural Foundations of Mental Simulation: Future Prediction of Latent Representations on Dynamic Scenes Aran Nayebi R. Rajalingham M. Jazayeri G. R. Yang 28 17 0 19 May 2023
Multimodal Contextualized Plan Prediction for Embodied Task Completion Mert Inan Aishwarya Padmakumar Spandana Gella P. Lange Dilek Z. Hakkani-Tür LM&Ro 29 0 0 10 May 2023
Tracking through Containers and Occluders in the Wild Basile Van Hoorick P. Tokmakov Simon Stent Jie Li Carl Vondrick 29 13 0 04 May 2023
IndoorSim-to-OutdoorReal: Learning to Navigate Outdoors without any Outdoor Experience Joanne Truong April Zitkovich Sonia Chernova Dhruv Batra Tingnan Zhang Jie Tan Wenhao Yu LM&Ro 18 13 0 01 May 2023
Moving Forward by Moving Backward: Embedding Action Impact over Action Semantics Kuo-Hao Zeng Luca Weihs Roozbeh Mottaghi Ali Farhadi 22 3 0 24 Apr 2023
Synthetic Data from Diffusion Models Improves ImageNet Classification Shekoofeh Azizi Simon Kornblith Chitwan Saharia Mohammad Norouzi David J. Fleet VLM DiffM 15 288 0 17 Apr 2023
Tool Learning with Foundation Models Yujia Qin Shengding Hu Yankai Lin Weize Chen Ning Ding ... Cheng Yang Tongshuang Wu Heng Ji Zhiyuan Liu Maosong Sun 31 198 0 17 Apr 2023