Reservoir Transformers

Reservoir Transformers

30 December 2020

Douwe Kiela

Papers citing "Reservoir Transformers"

10 / 10 papers shown

Title
Learning Music Audio Representations With Limited Data Christos Plachouras Emmanouil Benetos Johan Pauwels 18 0 0 09 May 2025
Partially Randomizing Transformer Weights for Dialogue Response Diversity Jing Yang Lee Kong Aik Lee Woon-Seng Gan 12 0 0 18 Nov 2023
How does the pre-training objective affect what large language models learn about linguistic properties? Ahmed Alajrami Nikolaos Aletras 17 20 0 20 Mar 2022
Efficient and Private Federated Learning with Partially Trainable Networks Hakim Sidahmed Zheng Xu Ankush Garg Yuan Cao Mingqing Chen FedML 47 13 0 06 Oct 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 249 2,009 0 28 Jul 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 226 4,424 0 23 Jan 2020
Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT Sheng Shen Zhen Dong Jiayu Ye Linjian Ma Z. Yao A. Gholami Michael W. Mahoney Kurt Keutzer MQ 225 571 0 12 Sep 2019
Classical Structured Prediction Losses for Sequence to Sequence Learning Sergey Edunov Myle Ott Michael Auli David Grangier MarcÁurelio Ranzato AIMat 48 185 0 14 Nov 2017
Neuromorphic Deep Learning Machines Emre Neftci C. Augustine Somnath Paul Georgios Detorakis BDL 124 257 0 16 Dec 2016
Convolutional Neural Networks for Sentence Classification Yoon Kim AILaw VLM 250 13,347 0 25 Aug 2014