LLMZip: Lossless Text Compression using Large Language Models

LLMZip: Lossless Text Compression using Large Language Models

6 June 2023

Chandra Shekhara Kaushik Valmeekam

Krishna R. Narayanan

Papers citing "LLMZip: Lossless Text Compression using Large Language Models"

16 / 16 papers shown

Title
The KoLMogorov Test: Compression by Code Generation Ori Yoran Kunhao Zheng Fabian Gloeckle Jonas Gehring Gabriel Synnaeve Taco Cohen 62 1 0 18 Mar 2025
An Enhanced Text Compression Approach Using Transformer-based Language Models C. M. Rahman Mahbub E Sobhani Anika Tasnim Rodela Swakkhar Shatabda 69 0 0 15 Dec 2024
LMM-driven Semantic Image-Text Coding for Ultra Low-bitrate Learned Image Compression Shimon Murai Heming Sun J. Katto VLM 74 1 0 20 Nov 2024
In-context learning and Occam's razor Eric Elmoznino Tom Marty Tejas Kasetty Léo Gagnon Sarthak Mittal Mahan Fathi Dhanya Sridhar Guillaume Lajoie 32 1 0 17 Oct 2024
MLP-SLAM: Multilayer Perceptron-Based Simultaneous Localization and Mapping With a Dynamic and Static Object Discriminator Taozhe Li Wei Sun 24 1 0 14 Oct 2024
Transformers learn variable-order Markov chains in-context Ruida Zhou C. Tian Suhas Diggavi 26 0 0 07 Oct 2024
AlphaZip: Neural Network-Enhanced Lossless Text Compression Swathi Shree Narashiman Nitin Chandrachoodan VLM AI4CE 19 3 0 23 Sep 2024
SWIFT: Semantic Watermarking for Image Forgery Thwarting Gautier Evennou Vivien Chappelier Ewa Kijak Teddy Furon 38 1 0 26 Jul 2024
Coding for Intelligence from the Perspective of Category Wenhan Yang Zixuan Hu Lilang Lin Jiaying Liu Ling-Yu Duan AI4CE 33 1 0 01 Jul 2024
Training LLMs over Neurally Compressed Text Brian Lester Jaehoon Lee A. Alemi Jeffrey Pennington Adam Roberts Jascha Narain Sohl-Dickstein Noah Constant 32 6 0 04 Apr 2024
Towards Optimal Learning of Language Models Yuxian Gu Li Dong Y. Hao Qingxiu Dong Minlie Huang Furu Wei 36 7 0 27 Feb 2024
Evaluating Large Language Models for Generalization and Robustness via Data Compression Yucheng Li Yunhao Guo Frank Guerin Chenghua Lin ELM 20 5 0 01 Feb 2024
The Information of Large Language Model Geometry Zhiquan Tan Chenghai Li Weiran Huang 21 1 0 01 Feb 2024
Large Language Model Evaluation via Matrix Entropy Lai Wei Zhiquan Tan Chenghai Li Jindong Wang Weiran Huang 28 5 0 30 Jan 2024
SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models Zhixu Du Shiyu Li Yuhao Wu Xiangyu Jiang Jingwei Sun Qilin Zheng Yongkai Wu Ang Li Hai Helen Li Yiran Chen MoE 23 12 0 29 Oct 2023
Language Modeling Is Compression Grégoire Delétang Anian Ruoss Paul-Ambroise Duquenne Elliot Catt Tim Genewein ... Wenliang Kevin Li Matthew Aitchison Laurent Orseau Marcus Hutter J. Veness AI4CE 25 129 0 19 Sep 2023