The Framework Tax: Disparities Between Inference Efficiency in NLP
Research and Deployment

The Framework Tax: Disparities Between Inference Efficiency in NLP Research and Deployment

13 February 2023

Jared Fernandez

Papers citing "The Framework Tax: Disparities Between Inference Efficiency in NLP Research and Deployment"

9 / 9 papers shown

Title
Hardware Scaling Trends and Diminishing Returns in Large-Scale Distributed Training Jared Fernandez Luca Wehrstedt Leonid Shamis Mostafa Elhoushi Kalyan Saladi Yonatan Bisk Emma Strubell Jacob Kahn 106 3 0 20 Nov 2024
Pruning One More Token is Enough: Leveraging Latency-Workload Non-Linearities for Vision Transformers on the Edge Nick Eliopoulos Purvish Jajal James Davis Gaowen Liu George K. Thiravathukal Yung-Hsiang Lu 36 1 0 01 Jul 2024
LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insights Thibault Castells Hyoung-Kyu Song Bo-Kyeong Kim Shinkook Choi 34 18 0 18 Apr 2024
Learn to Code Sustainably: An Empirical Study on LLM-based Green Code Generation Tina Vartziotis Ippolyti Dellatolas George Dasoulas Maximilian Schmidt Florian Schneider Tim Hoffmann S. Kotsopoulos Michael Keckeisen 74 6 0 05 Mar 2024
Efficiency Pentathlon: A Standardized Arena for Efficiency Evaluation Hao Peng Qingqing Cao Jesse Dodge Matthew E. Peters Jared Fernandez ... Darrell Plessas Iz Beltagy Evan Pete Walsh Noah A. Smith Hannaneh Hajishirzi 24 7 0 19 Jul 2023
Spatial-Language Attention Policies for Efficient Robot Learning Priyam Parashar Vidhi Jain Xiaohan Zhang Jay Vakil Sam Powers Yonatan Bisk Chris Paxton LM&Ro 27 5 0 21 Apr 2023
Revisiting Neural Scaling Laws in Language and Vision Ibrahim M. Alabdulmohsin Behnam Neyshabur Xiaohua Zhai 148 101 0 13 Sep 2022
Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers Yi Tay Mostafa Dehghani J. Rao W. Fedus Samira Abnar Hyung Won Chung Sharan Narang Dani Yogatama Ashish Vaswani Donald Metzler 185 110 0 22 Sep 2021
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 226 4,424 0 23 Jan 2020