Adaptive Semantic Token Communication for Transformer-based Edge Inference

23 May 2025

Papers citing "Adaptive Semantic Token Communication for Transformer-based Edge Inference"

29 / 29 papers shown

Title
SING: Semantic Image Communications using Null-Space and INN-Guided Diffusion Models Jiakang Chen Selim F. Yilmaz Di You Pier Luigi Dragotti Deniz Gündüz DiffM 73 4 0 16 Mar 2025
Token Communications: A Unified Framework for Cross-modal Context-aware Semantic Communications Li Qiao Mahdi Boloursaz Mashhadi Zhen Gao Rahim Tafazolli Mehdi Bennis Dusit Niyato 96 8 0 17 Feb 2025
Joint Source-Channel Coding: Fundamentals and Recent Progress in Practical Designs Deniz Gündüz Michèle A. Wigger Tze-Yang Tung Ping Zhang Yong Xiao 62 16 0 26 Sep 2024
Adaptive Layer Selection for Efficient Vision Transformer Fine-Tuning Alessio Devoto Federico Alvetreti Jary Pomponi P. Lorenzo Pasquale Minervini Simone Scardapane 63 3 0 16 Aug 2024
Joint or Disjoint: Mixing Training Regimes for Early-Exit Models Bartłomiej Krzepkowski Monika Michaluk Franciszek Szarwacki Piotr Kubaty Jary Pomponi Tomasz Trzciñski Bartosz Wójcik Kamil Adamczewski 51 1 0 19 Jul 2024
Adaptive Semantic Token Selection for AI-native Goal-oriented Communications Alessio Devoto Simone Petruzzi Jary Pomponi P. Lorenzo Simone Scardapane 81 3 0 25 Apr 2024
Conditional computation in neural networks: principles and research trends Simone Scardapane Alessandro Baiocchi Alessio Devoto V. Marsocci Pasquale Minervini Jary Pomponi 56 2 0 12 Mar 2024
Adaptive Computation Modules: Granular Conditional Computation For Efficient Inference Bartosz Wójcik Alessio Devoto Karol Pustelnik Pasquale Minervini Simone Scardapane 72 6 0 15 Dec 2023
Adaptive Resource Allocation for Semantic Communication Networks Lingyi Wang Wei Wu Fuhui Zhou Zhaohui Yang Zhijing Qin 70 21 0 02 Dec 2023
Vision Transformers Need Registers Zilong Chen Maxime Oquab Julien Mairal Huaping Liu ViT 85 326 0 28 Sep 2023
Task-Oriented Communications for NextG: End-to-End Deep Learning and AI Security Aspects Y. Sagduyu S. Ulukus Aylin Yener AAML 43 27 0 19 Dec 2022
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale Tim Dettmers M. Lewis Younes Belkada Luke Zettlemoyer MQ 64 648 0 15 Aug 2022
AdaViT: Adaptive Vision Transformers for Efficient Image Recognition Lingchen Meng Hengduo Li Bor-Chun Chen Shiyi Lan Zuxuan Wu Yu-Gang Jiang Ser-Nam Lim ViT 47 227 0 30 Nov 2021
MoEfication: Transformer Feed-forward Layers are Mixtures of Experts Zhengyan Zhang Yankai Lin Zhiyuan Liu Peng Li Maosong Sun Jie Zhou MoE 61 121 0 05 Oct 2021
Semantic Communication with Adaptive Universal Transformer Qingyang Zhou Rongpeng Li Zhifeng Zhao Chenghui Peng Honggang Zhang 42 90 0 20 Aug 2021
Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges Yoshitomo Matsubara Marco Levorato Francesco Restuccia 50 202 0 08 Mar 2021
Dynamic Neural Networks: A Survey Yizeng Han Gao Huang Shiji Song Le Yang Honghui Wang Yulin Wang 3DH AI4TS AI4CE 57 638 0 09 Feb 2021
Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks Torsten Hoefler Dan Alistarh Tal Ben-Nun Nikoli Dryden Alexandra Peste MQ 248 703 0 31 Jan 2021
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity W. Fedus Barret Zoph Noam M. Shazeer MoE 57 2,136 0 11 Jan 2021
6G Networks: Beyond Shannon Towards Semantic and Goal-Oriented Communications Emilio Calvanese Strinati Sergio Barbarossa 44 388 0 04 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 400 40,217 0 22 Oct 2020
BERT Loses Patience: Fast and Robust Inference with Early Exit Wangchunshu Zhou Canwen Xu Tao Ge Julian McAuley Ke Xu Furu Wei 36 337 0 07 Jun 2020
Integer Quantization for Deep Learning Inference: Principles and Empirical Evaluation Hao Wu Patrick Judd Xiaojie Zhang Mikhail Isaev Paulius Micikevicius MQ 63 349 0 20 Apr 2020
Knowledge Distillation from Internal Representations Gustavo Aguilar Yuan Ling Yu Zhang Benjamin Yao Xing Fan Edward Guo 54 179 0 08 Oct 2019
RandAugment: Practical automated data augmentation with a reduced search space E. D. Cubuk Barret Zoph Jonathon Shlens Quoc V. Le MQ 188 3,458 0 30 Sep 2019
Searching for MobileNetV3 Andrew G. Howard Mark Sandler Grace Chu Liang-Chieh Chen Bo Chen ... Yukun Zhu Ruoming Pang Vijay Vasudevan Quoc V. Le Hartwig Adam 269 6,685 0 06 May 2019
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer Noam M. Shazeer Azalia Mirhoseini Krzysztof Maziarz Andy Davis Quoc V. Le Geoffrey E. Hinton J. Dean MoE 160 2,614 0 23 Jan 2017
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 238 19,523 0 09 Mar 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 844 149,474 0 22 Dec 2014