ProFormer: Towards On-Device LSH Projection Based Transformers

v1v2 (latest)

ProFormer: Towards On-Device LSH Projection Based Transformers

13 April 2020

Chinnadhurai Sankar

Zornitsa Kozareva

ArXiv (abs)PDF HTML

Papers citing "ProFormer: Towards On-Device LSH Projection Based Transformers"

7 / 7 papers shown

Title
The Potential of Vision-Language Models for Content Moderation of Children's Videos Syed Hammad Ahmed Shengnan Hu G. Sukthankar VLM 117 3 0 06 Dec 2023
EELBERT: Tiny Models through Dynamic Embeddings Gabrielle Cohn Rishika Agarwal Deepanshu Gupta Siddharth Patwardhan 27 2 0 31 Oct 2023
Rediscovering Hashed Random Projections for Efficient Quantization of Contextualized Sentence Embeddings Ulf A. Hamster Ji-Ung Lee Alexander Geyken Iryna Gurevych 74 0 0 13 Mar 2023
HashFormers: Towards Vocabulary-independent Pre-trained Transformers Huiyin Xue Nikolaos Aletras 51 4 0 14 Oct 2022
Efficient Methods for Natural Language Processing: A Survey Marcos Vinícius Treviso Ji-Ung Lee Tianchu Ji Betty van Aken Qingqing Cao ... Emma Strubell Niranjan Balasubramanian Leon Derczynski Iryna Gurevych Roy Schwartz 156 114 0 31 Aug 2022
pNLP-Mixer: an Efficient all-MLP Architecture for Language Francesco Fusco Damian Pascual Peter W. J. Staar Diego Antognini 86 30 0 09 Feb 2022
Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Better Gaurav Menghani VLM MedIm 110 387 0 16 Jun 2021