SAC: Accelerating and Structuring Self-Attention via Sparse Adaptive
Connection

SAC: Accelerating and Structuring Self-Attention via Sparse Adaptive Connection

22 March 2020

Jiwei Li

Papers citing "SAC: Accelerating and Structuring Self-Attention via Sparse Adaptive Connection"

9 / 9 papers shown

Title
Museformer: Transformer with Fine- and Coarse-Grained Attention for Music Generation Botao Yu Peiling Lu Rui Wang Wei Hu Xu Tan Wei Ye Shikun Zhang Tao Qin Tie-Yan Liu MGen 25 54 0 19 Oct 2022
CAB: Comprehensive Attention Benchmarking on Long Sequence Modeling Jinchao Zhang Shuyang Jiang Jiangtao Feng Lin Zheng Lingpeng Kong 3DV 41 9 0 14 Oct 2022
Attention Mechanism in Neural Networks: Where it Comes and Where it Goes Derya Soydaner 3DV 38 149 0 27 Apr 2022
GNN-LM: Language Modeling based on Global Contexts via GNN Yuxian Meng Shi Zong Xiaoya Li Xiaofei Sun Tianwei Zhang Fei Wu Jiwei Li LRM 16 37 0 17 Oct 2021
Layer-wise Model Pruning based on Mutual Information Chun Fan Jiwei Li Xiang Ao Fei Wu Yuxian Meng Xiaofei Sun 38 19 0 28 Aug 2021
A Survey of Transformers Tianyang Lin Yuxin Wang Xiangyang Liu Xipeng Qiu ViT 32 1,086 0 08 Jun 2021
Geom-GCN: Geometric Graph Convolutional Networks Hongbin Pei Bingzhen Wei Kevin Chen-Chuan Chang Yu Lei Bo Yang GNN 169 1,078 0 13 Feb 2020
Representation Learning on Graphs with Jumping Knowledge Networks Keyulu Xu Chengtao Li Yonglong Tian Tomohiro Sonobe Ken-ichi Kawarabayashi Stefanie Jegelka GNN 267 1,944 0 09 Jun 2018
Geometric deep learning on graphs and manifolds using mixture model CNNs Federico Monti Davide Boscaini Jonathan Masci Emanuele Rodolà Jan Svoboda M. Bronstein GNN 251 1,811 0 25 Nov 2016