SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videos

15 June 2022

Gamaleldin F. Elsayed

Aravindh Mahendran

Sjoerd van Steenkiste

Papers citing "SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videos"

50 / 110 papers shown

Title
Perceptual Group Tokenizer: Building Perception with Iterative Grouping Zhiwei Deng Ting Chen Yang Li ViT VLM 10 2 0 30 Nov 2023
Betrayed by Attention: A Simple yet Effective Approach for Self-supervised Video Object Segmentation Shuangrui Ding Rui Qian Haohang Xu Dahua Lin Hongkai Xiong VOS 27 4 0 29 Nov 2023
Action-slot: Visual Action-centric Representations for Multi-label Atomic Activity Recognition in Traffic Scenes Chi-Hsi Kung Shu-Wei Lu Yi-Hsuan Tsai Yi-Ting Chen 23 6 0 29 Nov 2023
Object-Centric Learning with Slot Mixture Module Daniil E. Kirilenko Vitaliy Vorobyov A. Kovalev Aleksandr I. Panov OCL 21 3 0 08 Nov 2023
The Background Also Matters: Background-Aware Motion-Guided Objects Discovery Sandra Kara Hejer Ammar Florian Chabot Quoc-Cuong Pham 22 3 0 05 Nov 2023
Loci-Segmented: Improving Scene Segmentation Learning Manuel Traub Frederic Becker Adrian Sauter S. Otte Martin Volker Butz 10 2 0 16 Oct 2023
Learning Object Permanence from Videos via Latent Imaginations Manuel Traub Frederic Becker S. Otte Martin Volker Butz 20 1 0 16 Oct 2023
Leveraging Image Augmentation for Object Manipulation: Towards Interpretable Controllability in Object-Centric Learning Jinwoo Kim Janghyuk Choi Jaehyun Kang Changyeon Lee Ho-Jin Choi Seon Joo Kim OCL 21 0 0 13 Oct 2023
Self-supervised Object-Centric Learning for Videos Görkay Aydemir Weidi Xie Fatma Guney OCL VOS SSL 17 24 0 10 Oct 2023
Provable Compositional Generalization for Object-Centric Learning Thaddäus Wiedemer Jack Brady Alexander Panfilov Attila Juhos Matthias Bethge Wieland Brendel OCL 19 17 0 09 Oct 2023
Unsupervised Open-Vocabulary Object Localization in Videos Ke Fan Zechen Bai Tianjun Xiao Dominik Zietlow Max Horn ... Bernt Schiele Thomas Brox Zheng-Wei Zhang Yanwei Fu Tong He 32 3 0 18 Sep 2023
Object-Centric Multiple Object Tracking Zixu Zhao Jiaze Wang Max Horn Yizhuo Ding Tong He ... Bernt Schiele Yanwei Fu Francesco Locatello Zheng-Wei Zhang Tianjun Xiao VOT OCL 6 2 0 01 Sep 2023
Semantics Meets Temporal Correspondence: Self-supervised Object-centric Learning in Videos Rui Qian Shuangrui Ding Xian Liu Dahua Lin 15 14 0 19 Aug 2023
Helping Hands: An Object-Aware Ego-Centric Video Recognition Model Chuhan Zhang Ankush Gupta Andrew Zisserman VLM 10 19 0 15 Aug 2023
Grounded Object Centric Learning Avinash Kori Francesco Locatello Fabio De Sousa Ribeiro Francesca Toni Ben Glocker OCL 17 7 0 18 Jul 2023
Multi-Object Discovery by Low-Dimensional Object Motion Sadra Safadoust Fatma Guney OCL 13 9 0 16 Jul 2023
Linking vision and motion for self-supervised object-centric perception Kaylene C. Stocking Zak Murez Vijay Badrinarayanan Jamie Shotton Alex Kendall Claire Tomlin Christopher P. Burgess OCL 22 0 0 14 Jul 2023
How can objects help action recognition? Xingyi Zhou Anurag Arnab Chen Sun Cordelia Schmid 22 14 0 20 Jun 2023
OCAtari: Object-Centric Atari 2600 Reinforcement Learning Environments Quentin Delfosse Jannis Blüml Bjarne Gregori Sebastian Sztwiertnia Kristian Kersting 27 17 0 14 Jun 2023
Slot-VAE: Object-Centric Scene Generation with Slot Attention Yanbo Wang Letao Liu Justin Dauwels OCL BDL DRL 17 15 0 12 Jun 2023
DDLP: Unsupervised Object-Centric Video Prediction with Deep Dynamic Latent Particles Tal Daniel Aviv Tamar DiffM 12 3 0 09 Jun 2023
Object-Centric Learning for Real-World Videos by Predicting Temporal Feature Similarities Andrii Zadaianchuk Maximilian Seitzer Georg Martius OCL 10 15 0 07 Jun 2023
Exploring the Role of the Bottleneck in Slot-Based Models Through Covariance Regularization Andrew Stange Robert Lo Abishek Sridhar Kousik Rajesh 12 2 0 05 Jun 2023
Cycle Consistency Driven Object Discovery Aniket Didolkar Anirudh Goyal Yoshua Bengio OCL 13 8 0 03 Jun 2023
Rotating Features for Object Discovery Sindy Lowe Phillip Lippe Francesco Locatello Max Welling OCL 17 21 0 01 Jun 2023
Spotlight Attention: Robust Object-Centric Learning With a Spatial Locality Prior Ayush K Chakravarthy Trang Nguyen Anirudh Goyal Yoshua Bengio Michael C. Mozer OCL 16 4 0 31 May 2023
Sensitivity of Slot-Based Object-Centric Models to their Number of Slots Roland S. Zimmermann Sjoerd van Steenkiste Mehdi S. M. Sajjadi Thomas Kipf Klaus Greff OCL 21 5 0 30 May 2023
Im-Promptu: In-Context Composition from Image Prompts Bhishma Dedhia Michael Chang Jake C. Snell Thomas L. Griffiths N. Jha LRM MLLM 12 1 0 26 May 2023
Contrastive Training of Complex-Valued Autoencoders for Object Discovery Aleksandar Stanić Anand Gopalakrishnan Kazuki Irie Jürgen Schmidhuber OCL 20 14 0 24 May 2023
Provably Learning Object-Centric Representations Jack Brady Roland S. Zimmermann Yash Sharma Bernhard Schölkopf Julius von Kügelgen Wieland Brendel OCL 19 31 0 23 May 2023
SlotDiffusion: Object-Centric Generative Modeling with Diffusion Models Ziyi Wu Jingyu Hu Wuyue Lu Igor Gilitschenski Animesh Garg DiffM OCL 20 44 0 18 May 2023
DynaVol: Unsupervised Learning for Dynamic Scenes through Object-Centric Voxelization Yanpeng Zhao Siyu Gao Yunbo Wang Xiaokang Yang OCL 11 1 0 30 Apr 2023
Divided Attention: Unsupervised Multi-Object Discovery with Contextually Separated Slots Dong Lao Zhengyang Hu Francesco Locatello Yanchao Yang Stefano Soatto OCL 12 5 0 04 Apr 2023
Shepherding Slots to Objects: Towards Stable and Robust Object-Centric Learning Jinwoo Kim Janghyuk Choi Ho-Jin Choi Seon Joo Kim OCL VLM 8 10 0 31 Mar 2023
Object Discovery from Motion-Guided Tokens Zhipeng Bao P. Tokmakov Yu-xiong Wang Adrien Gaidon M. Hebert OCL 14 13 0 27 Mar 2023
Neural Constraint Satisfaction: Hierarchical Abstraction for Combinatorial Generalization in Object Rearrangement Michael Chang Alyssa Dayan Franziska Meier Thomas L. Griffiths Sergey Levine Amy Zhang OCL OffRL 8 9 0 20 Mar 2023
Semantic Attention Flow Fields for Monocular Dynamic Scene Decomposition Yiqing Liang Eliot Laidlaw Alexander Meyerowitz Srinath Sridhar James Tompkin VOS 17 12 0 02 Mar 2023
Reusable Slotwise Mechanisms Trang Nguyen Amin Mansouri Kanika Madan Khuong N. Nguyen Kartik Ahuja Dianbo Liu Yoshua Bengio OCL 12 4 0 21 Feb 2023
Object-centric Learning with Cyclic Walks between Parts and Whole Ziyu Wang Mike Zheng Shou Mengmi Zhang OCL 14 9 0 16 Feb 2023
Invariant Slot Attention: Object Discovery with Slot-Centric Reference Frames Ondrej Biza Sjoerd van Steenkiste Mehdi S. M. Sajjadi Gamaleldin F. Elsayed Aravindh Mahendran Thomas Kipf OCL 26 22 0 09 Feb 2023
An Investigation into Pre-Training Object-Centric Representations for Reinforcement Learning Jaesik Yoon Yi-Fu Wu Heechul Bae Sungjin Ahn OCL 11 39 0 09 Feb 2023
GPViT: A High Resolution Non-Hierarchical Vision Transformer with Group Propagation Chenhongyi Yang Jiarui Xu Shalini De Mello Elliot J. Crowley X. Wang ViT 21 21 0 13 Dec 2022
Disentangled Representation Learning Xin Eric Wang Hong Chen Siao Tang Zihao Wu Wenwu Zhu DRL 13 77 0 21 Nov 2022
Boosting Object Representation Learning via Motion and Object Continuity Quentin Delfosse Wolfgang Stammer Thomas Rothenbacher Dwarak Vittal Kristian Kersting OCL 16 20 0 16 Nov 2022
Neural Systematic Binder Gautam Singh Yeongbin Kim Sungjin Ahn OCL 11 29 0 02 Nov 2022
Perceptual Grouping in Contrastive Vision-Language Models Kanchana Ranasinghe Brandon McKinzie S. S. Ravi Yinfei Yang Alexander Toshev Jonathon Shlens VLM 8 50 0 18 Oct 2022
Improving Object-centric Learning with Query Optimization Baoxiong Jia Yu Liu Siyuan Huang OCL 10 49 0 17 Oct 2022
Differentiable Mathematical Programming for Object-Centric Representation Learning Adeel Pervez Phillip Lippe E. Gavves OCL 28 5 0 05 Oct 2022
Bridging the Gap to Real-World Object-Centric Learning Maximilian Seitzer Max Horn Andrii Zadaianchuk Dominik Zietlow Tianjun Xiao ... Tong He Zheng-Wei Zhang Bernhard Schölkopf Thomas Brox Francesco Locatello OCL 16 96 0 29 Sep 2022
Learning Multi-Object Symbols for Manipulation with Attentive Deep Effect Predictors Alper Ahmetoglu Erhan Öztop Emre Ugur 6 4 0 01 Aug 2022