Contrastive Learning of Structured World Models

27 November 2019

Papers citing "Contrastive Learning of Structured World Models"

50 / 60 papers shown

Title
Contrastive Federated Learning with Tabular Data Silos Achmad Ginanjar Xue Li Wen Hua Jiaming Pei FedML 71 2 0 17 Feb 2025
Slot-BERT: Self-supervised Object Discovery in Surgical Video Guiqiu Liao M. Jogan Marcel Hussing Kenta Nakahashi Kazuhiro Yasufuku Amin Madani Eric Eaton Daniel A. Hashimoto 112 0 0 21 Jan 2025
FACTS: A Factored State-Space Framework For World Modelling Li Nanbo Firas Laakom Yucheng Xu Wenyi Wang Jürgen Schmidhuber AI4TS 113 0 0 28 Oct 2024
Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigation Hyungjoo Chae Namyoung Kim Kai Tzu-iunn Ong Minju Gwak Gwanwoo Song Jihoon Kim S. Kim Dongha Lee Jinyoung Yeo LLMAG 33 14 0 17 Oct 2024
Generalization of Compositional Tasks with Logical Specification via Implicit Planning Duo Xu Faramarz Fekri OffRL 23 1 0 13 Oct 2024
Next state prediction gives rise to entangled, yet compositional representations of objects Tankred Saanum Luca M. Schulze Buschoff Peter Dayan Eric Schulz OCL CoGe OOD 25 1 0 07 Oct 2024
Exploring the Effectiveness of Object-Centric Representations in Visual Question Answering: Comparative Insights with Foundation Models Amir Mohammad Karimi Mamaghan Samuele Papa Karl Henrik Johansson Stefan Bauer Andrea Dittadi OCL 44 5 0 22 Jul 2024
NeoRL: Efficient Exploration for Nonepisodic RL Bhavya Sukhija Lenart Treven Florian Dorfler Stelian Coros Andreas Krause OffRL 28 0 0 03 Jun 2024
Learning Off-policy with Model-based Intrinsic Motivation For Active Online Exploration Yibo Wang Jiang Zhao OffRL OnRL 25 0 0 31 Mar 2024
Reasoning-Enhanced Object-Centric Learning for Videos Jian Li Pu Ren Yang Liu Hao-Lun Sun OCL LRM 40 2 0 22 Mar 2024
Neural Foundations of Mental Simulation: Future Prediction of Latent Representations on Dynamic Scenes Aran Nayebi R. Rajalingham M. Jazayeri G. R. Yang 28 17 0 19 May 2023
SlotDiffusion: Object-Centric Generative Modeling with Diffusion Models Ziyi Wu Jingyu Hu Wuyue Lu Igor Gilitschenski Animesh Garg DiffM OCL 28 44 0 18 May 2023
3D-IntPhys: Towards More Generalized 3D-grounded Visual Intuitive Physics under Challenging Scenes Haotian Xue Antonio Torralba J. Tenenbaum Daniel L. K. Yamins Yunzhu Li H. Tung PINN VGen AI4CE 48 8 0 22 Apr 2023
Reusable Slotwise Mechanisms Trang Nguyen Amin Mansouri Kanika Madan Khuong N. Nguyen Kartik Ahuja Dianbo Liu Yoshua Bengio OCL 22 4 0 21 Feb 2023
Self-supervised learning of Split Invariant Equivariant representations Q. Garrido Laurent Najman Yann LeCun SSL 19 32 0 14 Feb 2023
Equivariant Representation Learning in the Presence of Stabilizers Luis Armando ∗. GiovanniLucaMarchetti Danica Kragic D. Jarnikov Mike Holenderski 24 0 0 12 Jan 2023
Predictive World Models from Real-World Partial Observations Robin Karlsson Alexander Carballo Keisuke Fujii Kento Ohtani K. Takeda 17 5 0 12 Jan 2023
Contrastive Knowledge Graph Error Detection Qinggang Zhang Junnan Dong Keyu Duan Xiao Huang Yezi Liu Linchuan Xu 26 34 0 18 Nov 2022
Disentangled (Un)Controllable Features Jacob E. Kooi Mark Hoogendoorn Vincent François-Lavet DRL 19 0 0 31 Oct 2022
Sample Efficient Robot Learning with Structured World Models T. Akbulut Max Merlin Shane Parr Benedict Quartey Skye Thompson 13 0 0 21 Oct 2022
Robust and Controllable Object-Centric Learning through Energy-based Models Ruixiang Zhang Tong Che B. Ivanovic Renhao Wang Marco Pavone Yoshua Bengio Liam Paull OCL 26 8 0 11 Oct 2022
TarGF: Learning Target Gradient Field to Rearrange Objects without Explicit Goal Specification Min-Yu Wu Fangwei Zhong Yulong Xia Hao Dong OOD 30 17 0 02 Sep 2022
The Neural Process Family: Survey, Applications and Perspectives Saurav Jha Dong Gong Xuesong Wang Richard E. Turner L. Yao BDL 68 24 0 01 Sep 2022
Learning to Generalize with Object-centric Agents in the Open World Survival Game Crafter Aleksandar Stanić Yujin Tang David R Ha Jürgen Schmidhuber ELM 19 11 0 05 Aug 2022
To Answer or Not to Answer? Improving Machine Reading Comprehension Model with Span-based Contrastive Learning Yunjie Ji Liangyu Chen Chenxiao Dou Baochang Ma Xiangang Li 38 5 0 02 Aug 2022
Equivariant Representation Learning via Class-Pose Decomposition G. Marchetti Gustaf Tegnér Anastasiia Varava Danica Kragic DRL 22 14 0 07 Jul 2022
SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videos Gamaleldin F. Elsayed Aravindh Mahendran Sjoerd van Steenkiste Klaus Greff Michael C. Mozer Thomas Kipf VOS OCL 47 137 0 15 Jun 2022
Collaborative Knowledge Graph Fusion by Exploiting the Open Corpus Yue Wang Yao Wan Lu Bai Lixin Cui Zhuo Xu Ming Li Philip S. Yu Edwin R. Hancock 11 3 0 15 Jun 2022
Simple Unsupervised Object-Centric Learning for Complex and Naturalistic Videos Gautam Singh Yi-Fu Wu Sungjin Ahn OCL 37 114 0 27 May 2022
Binding Actions to Objects in World Models Ondrej Biza Robert W. Platt Jan Willem van de Meent Lawson L. S. Wong Thomas Kipf OCL 11 7 0 27 Apr 2022
Towards Self-Supervised Learning of Global and Object-Centric Representations Federico Baldassarre Hossein Azizpour SSL 3DPC OCL 30 13 0 11 Mar 2022
Policy Architectures for Compositional Generalization in Control Allan Zhou Vikash Kumar Chelsea Finn Aravind Rajeswaran 18 22 0 10 Mar 2022
KINet: Unsupervised Forward Models for Robotic Pushing Manipulation Alireza Rezazadeh Changhyun Choi SSL 3DPC 22 3 0 18 Feb 2022
Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive Matrices Mikolaj Malkiñski Jacek Mañdziuk 117 41 0 28 Jan 2022
Conditional Object-Centric Learning from Video Thomas Kipf Gamaleldin F. Elsayed Aravindh Mahendran Austin Stone S. Sabour G. Heigold Rico Jonschkowski Alexey Dosovitskiy Klaus Greff OCL 39 214 0 24 Nov 2021
Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language Mingyu Ding Zhenfang Chen Tao Du Ping Luo J. Tenenbaum Chuang Gan VGen PINN OCL 22 74 0 28 Oct 2021
Planning from Pixels in Environments with Combinatorially Hard Search Spaces Marco Bagatella Miroslav Olsák Michal Rolínek Georg Martius OffRL 11 6 0 12 Oct 2021
Neural Algorithmic Reasoners are Implicit Planners Andreea Deac Petar Velivcković Ognjen Milinković Pierre-Luc Bacon Jian Tang Mladen Nikolic OffRL 26 23 0 11 Oct 2021
Interactive Machine Comprehension with Dynamic Knowledge Graphs Xingdi Yuan 24 3 0 31 Aug 2021
Discrete-Valued Neural Communication Dianbo Liu DianboLiu Alex Lamb Kenji Kawaguchi Anirudh Goyal Chen Sun Michael C. Mozer Yoshua Bengio 13 50 0 06 Jul 2021
Low-Dimensional State and Action Representation Learning with MDP Homomorphism Metrics N. Botteghi M. Poel B. Sirmaçek C. Brune 16 3 0 04 Jul 2021
Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learning Nan Rosemary Ke Aniket Didolkar Sarthak Mittal Anirudh Goyal Guillaume Lajoie Stefan Bauer Danilo Jimenez Rezende Yoshua Bengio Michael C. Mozer C. Pal CML 19 54 0 02 Jul 2021
CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understanding Dong Wang Ning Ding Pijian Li Haitao Zheng AAML 24 115 0 01 Jul 2021
Learning Knowledge Graph-based World Models of Textual Environments Prithviraj Ammanabrolu Mark O. Riedl 3DV 24 30 0 17 Jun 2021
Physion: Evaluating Physical Prediction from Vision in Humans and Machines Daniel M. Bear E. Wang Damian Mrowca Felix Binder Hsiau-Yu Fish Tung ... Li Fei-Fei Nancy Kanwisher J. Tenenbaum Daniel L. K. Yamins Judith E. Fan OOD 45 86 0 15 Jun 2021
Which Mutual-Information Representation Learning Objectives are Sufficient for Control? Kate Rakelly Abhishek Gupta Carlos Florensa Sergey Levine SSL 13 38 0 14 Jun 2021
PlayVirtual: Augmenting Cycle-Consistent Virtual Trajectories for Reinforcement Learning Tao Yu Cuiling Lan Wenjun Zeng Mingxiao Feng Zhizheng Zhang Zhibo Chen OffRL 15 46 0 08 Jun 2021
Learning Latent Graph Dynamics for Visual Manipulation of Deformable Objects Xiao Ma David Hsu W. Lee AI4CE 30 28 0 25 Apr 2021
Unsupervised Object-Based Transition Models for 3D Partially Observable Environments Antonia Creswell Rishabh Kabra Christopher P. Burgess Murray Shanahan OCL 25 29 0 08 Mar 2021
DMotion: Robotic Visuomotor Control with Unsupervised Forward Model Learned from Videos Haoqi Yuan Ruihai Wu Andrew Zhao Hanwang Zhang Zihan Ding Hao Dong 19 3 0 07 Mar 2021