Centered Self-Attention Layers

Centered Self-Attention Layers

2 June 2023

Lior Wolf

Papers citing "Centered Self-Attention Layers"

7 / 7 papers shown

Title
Setting the Record Straight on Transformer Oversmoothing G. Dovonon M. Bronstein Matt J. Kusner 20 5 0 09 Jan 2024
Graph Convolutions Enrich the Self-Attention in Transformers! Jeongwhan Choi Hyowon Wi Jayoung Kim Yehjin Shin Kookjin Lee Nathaniel Trask Noseong Park 25 3 0 07 Dec 2023
ResiDual: Transformer with Dual Residual Connections Shufang Xie Huishuai Zhang Junliang Guo Xu Tan Jiang Bian Hany Awadalla Arul Menezes Tao Qin Rui Yan 43 18 0 28 Apr 2023
Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrast Ye Du Zehua Fu Qingjie Liu Yunhong Wang 80 128 0 14 Oct 2021
Reducing Information Bottleneck for Weakly Supervised Semantic Segmentation Jungbeom Lee Jooyoung Choi J. Mok Sungroh Yoon SSeg 210 134 0 13 Oct 2021
ImageNet-21K Pretraining for the Masses T. Ridnik Emanuel Ben-Baruch Asaf Noy Lihi Zelnik-Manor SSeg VLM CLIP 154 676 0 22 Apr 2021
Multi-scale Attributed Node Embedding Benedek Rozemberczki Carl Allen Rik Sarkar GNN 145 828 0 28 Sep 2019