Rewiring the Transformer with Depth-Wise LSTMs

13 July 2020

Papers citing "Rewiring the Transformer with Depth-Wise LSTMs"

4 / 4 papers shown

Title
Interpretability in Activation Space Analysis of Transformers: A Focused Survey Soniya Vijayakumar AI4CE 27 3 0 22 Jan 2023
Learning Light-Weight Translation Models from Deep Transformer Bei Li Ziyang Wang Hui Liu Quan Du Tong Xiao Chunliang Zhang Jingbo Zhu VLM 112 40 0 27 Dec 2020
Benefits of depth in neural networks Matus Telgarsky 123 602 0 14 Feb 2016
Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism Orhan Firat Kyunghyun Cho Yoshua Bengio LRM AIMat 209 623 0 06 Jan 2016