Stronger ViTs With Octic Equivariance

21 May 2025

Papers citing "Stronger ViTs With Octic Equivariance"

38 / 38 papers shown

Title
DinoBloom: A Foundation Model for Generalizable Cell Embeddings in Hematology Valentin Koch S. J. Wagner Salome Kazeminia Ece Sancar Matthias Hehr Julia A. Schnabel Tingying Peng Carsten Marr AI4CE MedIm 55 6 0 07 Apr 2024
DUSt3R: Geometric 3D Vision Made Easy Shuzhe Wang Vincent Leroy Yohann Cabon Boris Chidlovskii Jérôme Revaud 3DGS 58 345 0 21 Dec 2023
A General Framework for Robust G-Invariance in G-Equivariant Networks Sophia Sanborn Nina Miolane AAML OOD 55 4 0 28 Oct 2023
Fast, Expressive SE $(n)$ Equivariant Networks through Weight-Sharing in Position-Orientation Space Erik J. Bekkers Sharvaree P. Vadgama Rob D. Hesselink P. A. V. D. Linden David W. Romero 36 27 0 04 Oct 2023
FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning Tri Dao LRM 64 1,221 0 17 Jul 2023
$E(2)$ -Equivariant Vision Transformer Renjun Xu Kaifan Yang Ke Liu Fengxiang He ViT MDE 45 10 0 11 Jun 2023
RoMa: Robust Dense Feature Matching Johan Edstedt Qiyu Sun Georg Bökman Maarten Wadenback Michael Felsberg 3DV 55 98 0 24 May 2023
Getting ViT in Shape: Scaling Laws for Compute-Optimal Model Design Ibrahim Alabdulmohsin Xiaohua Zhai Alexander Kolesnikov Lucas Beyer VLM 63 60 0 22 May 2023
DINOv2: Learning Robust Visual Features without Supervision Maxime Oquab Timothée Darcet Théo Moutakanni Huy Q. Vo Marc Szafraniec ... Hervé Jégou Julien Mairal Patrick Labatut Armand Joulin Piotr Bojanowski VLM CLIP SSL 242 3,205 0 14 Apr 2023
Segment Anything A. Kirillov Eric Mintun Nikhila Ravi Hanzi Mao Chloe Rolland ... Spencer Whitehead Alexander C. Berg Wan-Yen Lo Piotr Dollár Ross B. Girshick MLLM VLM 238 7,047 0 05 Apr 2023
SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer Xuanyao Chen Zhijian Liu Haotian Tang Li Yi Hang Zhao Song Han ViT 124 48 0 30 Mar 2023
Scaling Vision Transformers to 22 Billion Parameters Mostafa Dehghani Josip Djolonga Basil Mustafa Piotr Padlewski Jonathan Heek ... Mario Luvcić Xiaohua Zhai Daniel Keysers Jeremiah Harmsen N. Houlsby MLLM 121 585 0 10 Feb 2023
Equivariance with Learned Canonicalization Functions Sekouba Kaba Arnab Kumar Mondal Yan Zhang Yoshua Bengio Siamak Ravanbakhsh 65 67 0 11 Nov 2022
Group-invariant max filtering Jameson Cahill Joseph W. Iverson D. Mixon Dan Packer 44 23 0 27 May 2022
DeiT III: Revenge of the ViT Hugo Touvron Matthieu Cord Hervé Jégou ViT 101 402 0 14 Apr 2022
iBOT: Image BERT Pre-Training with Online Tokenizer Jinghao Zhou Chen Wei Huiyu Wang Wei Shen Cihang Xie Alan Yuille Tao Kong 59 722 0 15 Nov 2021
Scaling Vision Transformers Xiaohua Zhai Alexander Kolesnikov N. Houlsby Lucas Beyer ViT 107 1,074 0 08 Jun 2021
Geometric Deep Learning and Equivariant Neural Networks Jan E. Gerken J. Aronsson Oscar Carlsson Hampus Linander F. Ohlsson Christoffer Petersson Daniel Persson MLT 63 67 0 28 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 553 5,920 0 29 Apr 2021
Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges M. Bronstein Joan Bruna Taco S. Cohen Petar Velivcković GNN 269 1,137 0 27 Apr 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 288 21,051 0 25 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 666 28,659 0 26 Feb 2021
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 317 40,217 0 22 Oct 2020
End-to-End Object Detection with Transformers Nicolas Carion Francisco Massa Gabriel Synnaeve Nicolas Usunier Alexander Kirillov Sergey Zagoruyko ViT 3DV PINN 275 12,847 0 26 May 2020
Attentive Group Equivariant Convolutional Networks David W. Romero Erik J. Bekkers Jakub M. Tomczak Mark Hoogendoorn 63 91 0 07 Feb 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 440 4,662 0 23 Jan 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 221 42,038 0 03 Dec 2019
General $E(2)$ -Equivariant Steerable CNNs Maurice Weiler Gabriele Cesa 69 516 0 19 Nov 2019
Do ImageNet Classifiers Generalize to ImageNet? Benjamin Recht Rebecca Roelofs Ludwig Schmidt Vaishaal Shankar OOD SSeg VLM 75 1,693 0 13 Feb 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 882 93,936 0 11 Oct 2018
Roto-Translation Covariant Convolutional Networks for Medical Image Analysis Erik J. Bekkers Maxime W. Lafarge M. Veta K. Eppenhof J. Pluim R. Duits MedIm 40 173 0 10 Apr 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 430 129,831 0 12 Jun 2017
Steerable CNNs Taco S. Cohen Max Welling BDL 97 498 0 27 Dec 2016
Semantic Understanding of Scenes through the ADE20K Dataset Bolei Zhou Hang Zhao Xavier Puig Tete Xiao Sanja Fidler Adela Barriuso Antonio Torralba SSeg 322 1,850 0 18 Aug 2016
Gaussian Error Linear Units (GELUs) Dan Hendrycks Kevin Gimpel 148 4,934 0 27 Jun 2016
Group Equivariant Convolutional Networks Taco S. Cohen Max Welling BDL 112 1,917 0 24 Feb 2016
Exploiting Cyclic Symmetry in Convolutional Neural Networks Sander Dieleman J. Fauw Koray Kavukcuoglu 74 365 0 08 Feb 2016
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.0K 39,383 0 01 Sep 2014