v1v2 (latest)

Perceiver: General Perception with Iterative Attention

International Conference on Machine Learning (ICML), 2021

4 March 2021

ArXiv (abs)PDF HTML HuggingFace (2 upvotes)

Papers citing "Perceiver: General Perception with Iterative Attention"

36 / 786 papers shown

Title
Cross-lingual Transfer of Monolingual Models Evangelia Gogoulou Ariel Ekgren T. Isbister Magnus Sahlgren 213 20 0 15 Sep 2021
Patch-based Medical Image Segmentation using Matrix Product State Tensor Networks Raghavendra Selvan Erik Dam Soren Alexander Flensborg Jens Petersen MedIm 251 2 0 15 Sep 2021
The Sensory Neuron as a Transformer: Permutation-Invariant Neural Networks for Reinforcement LearningNeural Information Processing Systems (NeurIPS), 2021 Yujin Tang David R Ha 248 82 0 07 Sep 2021
$$\infty$-former: Infinite Memory Transformer$ $\infty$ -former: Infinite Memory TransformerAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Pedro Henrique Martins Zita Marinho André F. T. Martins 226 11 0 01 Sep 2021
Transformers predicting the future. Applying attention in next-frame and time series forecasting Radostin Cholakov T. Kolev AI4TS 116 20 0 18 Aug 2021
Perceiver IO: A General Architecture for Structured Inputs & OutputsInternational Conference on Learning Representations (ICLR), 2021 Andrew Jaegle Sebastian Borgeaud Jean-Baptiste Alayrac Carl Doersch Catalin Ionescu ... Olivier J. Hénaff M. Botvinick Andrew Zisserman Oriol Vinyals João Carreira MLLM VLM GNN 437 711 0 30 Jul 2021
Proposal-based Few-shot Sound Event Detection for Speech and Environmental Sounds with Perceivers Piper Wolters Logan Sizemore Chris Daw Brian Hutchinson Lauren A. Phillips 158 11 0 28 Jul 2021
A3GC-IP: Attention-Oriented Adjacency Adaptive Recurrent Graph Convolutions for Human Pose Estimation from Sparse Inertial MeasurementsComputers & graphics (Comput. Graph.), 2021 Patrik Puchert Timo Ropinski 3DH 264 4 0 23 Jul 2021
Sequence-to-Sequence Piano Transcription with TransformersInternational Society for Music Information Retrieval Conference (ISMIR), 2021 Curtis Hawthorne Ian Simon Rigel Swavely Ethan Manilow Jesse Engel 276 98 0 19 Jul 2021
Long Short-Term Transformer for Online Action DetectionNeural Information Processing Systems (NeurIPS), 2021 Mingze Xu Yuanjun Xiong Hao Chen Xinyu Li Wei Xia Zhuowen Tu Stefano Soatto ViT 226 169 0 07 Jul 2021
Long-Short Transformer: Efficient Transformers for Language and Vision Chen Zhu Ming-Yu Liu Chaowei Xiao Mohammad Shoeybi Tom Goldstein Anima Anandkumar Bryan Catanzaro ViT VLM 362 156 0 05 Jul 2021
Attention Bottlenecks for Multimodal FusionNeural Information Processing Systems (NeurIPS), 2021 Arsha Nagrani Shan Yang Anurag Arnab A. Jansen Cordelia Schmid Chen Sun 528 683 0 30 Jun 2021
Multi-Exit Vision Transformer for Dynamic InferenceBritish Machine Vision Conference (BMVC), 2021 Arian Bakhtiarnia Tao Gui Alexandros Iosifidis 235 27 0 29 Jun 2021
Transflower: probabilistic autoregressive dance generation with multimodal attentionACM Transactions on Graphics (TOG), 2021 Guillermo Valle Pérez G. Henter Jonas Beskow A. Holzapfel Pierre-Yves Oudeyer Simon Alexanderson 322 46 0 25 Jun 2021
Shape registration in the time of transformersNeural Information Processing Systems (NeurIPS), 2021 Giovanni Trappolini Luca Cosmo Luca Moschella R. Marin Simone Melzi Emanuele Rodolà ViT 3DPC MedIm 165 64 0 25 Jun 2021
TokenLearner: What Can 8 Learned Tokens Do for Images and Videos? Michael S. Ryoo A. Piergiovanni Anurag Arnab Mostafa Dehghani A. Angelova ViT 513 152 0 21 Jun 2021
XCiT: Cross-Covariance Image TransformersNeural Information Processing Systems (NeurIPS), 2021 Alaaeldin El-Nouby Hugo Touvron Mathilde Caron Piotr Bojanowski Matthijs Douze ... Ivan Laptev Natalia Neverova Gabriel Synnaeve Jakob Verbeek Edouard Grave ViT 327 602 0 17 Jun 2021
Improved Transformer for High-Resolution GANsNeural Information Processing Systems (NeurIPS), 2021 Long Zhao Zizhao Zhang Ting Chen Dimitris N. Metaxas Han Zhang ViT 313 109 0 14 Jun 2021
Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent NetworksNeural Information Processing Systems (NeurIPS), 2021 Avi Schwarzschild Eitan Borgnia Arjun Gupta Furong Huang U. Vishkin Micah Goldblum Tom Goldstein 183 89 0 08 Jun 2021
Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep LearningNeural Information Processing Systems (NeurIPS), 2021 Jannik Kossen Neil Band Clare Lyle Aidan Gomez Tom Rainforth Y. Gal OOD 3DPC 266 158 0 04 Jun 2021
Ember: No-Code Context Enrichment via Similarity-Based Keyless JoinsProceedings of the VLDB Endowment (PVLDB), 2021 S. Suri Ihab F. Ilyas Christopher Ré Theodoros Rekatsinas 92 27 0 02 Jun 2021
Towards mental time travel: a hierarchical memory for reinforcement learning agentsNeural Information Processing Systems (NeurIPS), 2021 Andrew Kyle Lampinen Stephanie C. Y. Chan Andrea Banino Felix Hill 261 58 0 28 May 2021
Towards General Purpose Vision SystemsComputer Vision and Pattern Recognition (CVPR), 2021 Tanmay Gupta Amita Kamath Aniruddha Kembhavi Derek Hoiem 230 55 0 01 Apr 2021
CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image ClassificationIEEE International Conference on Computer Vision (ICCV), 2021 Chun-Fu Chen Quanfu Fan Yikang Shen ViT 266 1,859 0 27 Mar 2021
User-Oriented Smart General AI System under Causal Inference Huimin Peng CML 104 0 0 25 Mar 2021
Projection: A Mechanism for Human-like Reasoning in Artificial Intelligence Frank Guerin 153 6 0 24 Mar 2021
You Only Group Once: Efficient Point-Cloud Processing with Token Representation and Relation Inference ModuleIEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2021 Chenfeng Xu Bohan Zhai Bichen Wu Tian Li Wei Zhan Peter Vajda Kurt Keutzer Masayoshi Tomizuka ViT 183 25 0 18 Mar 2021
Coordination Among Neural Modules Through a Shared Global WorkspaceInternational Conference on Learning Representations (ICLR), 2021 Anirudh Goyal Aniket Didolkar Alex Lamb Kartikeya Badola Nan Rosemary Ke Nasim Rahaman Jonathan Binas Charles Blundell Michael C. Mozer Yoshua Bengio 349 109 0 01 Mar 2021
The Uncanny Similarity of Recurrence and DepthInternational Conference on Learning Representations (ICLR), 2021 Avi Schwarzschild Arjun Gupta Amin Ghiasi Micah Goldblum Tom Goldstein 297 10 0 22 Feb 2021
Curriculum Learning: A SurveyInternational Journal of Computer Vision (IJCV), 2021 Petru Soviany Radu Tudor Ionescu Paolo Rota Andrii Zadaianchuk ODL 529 469 0 25 Jan 2021
Transformers in Vision: A SurveyACM Computing Surveys (CSUR), 2021 Salman Khan Muzammal Naseer Munawar Hayat Syed Waqas Zamir Fahad Shahbaz Khan M. Shah ViT 802 3,085 0 04 Jan 2021
A Survey on Visual TransformerIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 Kai Han Yunhe Wang Hanting Chen Xinghao Chen Jianyuan Guo ... Chunjing Xu Yixing Xu Zhaohui Yang Yiman Zhang Dacheng Tao ViT 941 2,988 0 23 Dec 2020
Neural Parameter Allocation Search Bryan A. Plummer Nikoli Dryden Julius Frost Torsten Hoefler Kate Saenko 405 18 0 18 Jun 2020
Neural Entity Linking: A Survey of Models Based on Deep Learning Ozge Sevgili Artem Shelmanov Mikhail V. Arkhipov Sergey Petrakov Christian Biemann VLM 3DV AI4TS 477 141 0 31 May 2020
Evaluating the Progress of Deep Learning for Visual Relational ConceptsJournal of Vision (J Vis), 2020 Sebastian Stabinger Peer David J. Piater A. Rodríguez-Sánchez 248 20 0 29 Jan 2020
On the Relationship between Self-Attention and Convolutional LayersInternational Conference on Learning Representations (ICLR), 2019 Jean-Baptiste Cordonnier Andreas Loukas Martin Jaggi 521 601 0 08 Nov 2019