v1v2v3 (latest)

CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillation

28 February 2025

ArXiv (abs)PDF HTML Github (25★)

Papers citing "CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillation"

50 / 89 papers shown

Title
Lightweight Latent Reasoning for Narrative Tasks Alexander Gurung Nikolay Malkin Mirella Lapata OffRL LRM 68 0 0 01 Dec 2025
SSA: Sparse Sparse Attention by Aligning Full and Sparse Attention Outputs in Feature Space Zhenyi Shen Junru Lu Lin Gui Jiazheng Li Yulan He D. Yin Xing Sun 224 0 0 25 Nov 2025
Incorporating Self-Rewriting into Large Language Model Reasoning Reinforcement Jiashu Yao Heyan Huang Shuang Zeng Chuwei Luo Wangjie You Jie Tang Qingsong Liu Yuhang Guo Yangyang Kang ReLM KELM 252 0 0 20 Nov 2025
C3PO: Optimized Large Language Model Cascades with Probabilistic Cost Constraints for Reasoning Antonios Valkanas Soumyasundar Pal Pavel Rumiantsev Yingxue Zhang Mark Coates 132 0 0 10 Nov 2025
Think Consistently, Reason Efficiently: Energy-Based Calibration for Implicit Chain-of-Thought Z. Chen Sen Cui Deheng Ye Yu Zhang Yatao Bian T. Zhu LRM 49 0 0 10 Nov 2025
CoCoVa: Chain of Continuous Vision-Language Thought for Latent Space Reasoning Jizheng Ma Xiaofei Zhou Yanlong Song Han Yan VLM LRM 153 1 0 04 Nov 2025
Beyond Single Embeddings: Capturing Diverse Targets with Multi-Query Retrieval Hung-Ting Chen Xiang Liu Shauli Ravfogel Eunsol Choi 88 0 0 04 Nov 2025
SemCoT: Accelerating Chain-of-Thought Reasoning through Semantically-Aligned Implicit Tokens Yinhan He Wendy Zheng Y. Zhu Zaiyi Zheng Lin Su Sriram Vasudevan Qi Guo Liangjie Hong Jundong Li LRM 112 1 0 28 Oct 2025
Latent Reasoning in LLMs as a Vocabulary-Space Superposition Jingcheng Deng Liang Pang Zihao Wei Shichen Xu Zenghao Duan Kun Xu Yang Song Huawei Shen Xueqi Cheng ReLM LRM 129 3 0 17 Oct 2025
Towards Inference-time Scaling for Continuous Space Reasoning Minghan Wang Thuy-Trang Vu Ehsan Shareghi Gholamreza Haffari LRM 90 1 0 14 Oct 2025
Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space C. L. Philip Chen Zhixin Ma Yongqi Li Yupeng Hu Yinwei Wei Wenjie Li Liqiang Nie LRM 112 2 0 14 Oct 2025
One Token Embedding Is Enough to Deadlock Your Large Reasoning Model Mohan Zhang Yihua Zhang Jinghan Jia Zhangyang Wang Sijia Liu Tianlong Chen SILM LRM 218 0 0 12 Oct 2025
Rényi Sharpness: A Novel Sharpness that Strongly Correlates with Generalization Qiaozhe Zhang Jun Sun Ruijie Zhang Yingzhuang Liu 160 0 0 09 Oct 2025
ToolExpander: Extending the Frontiers of Tool-Using Reinforcement Learning to Weak LLMs Fu Chen Peng Wang X. Li Wen Li Shichi Lei Dongdong Xiang 64 1 0 09 Oct 2025
SwiReasoning: Switch-Thinking in Latent and Explicit for Pareto-Superior Reasoning LLMs Dachuan Shi Abedelkadir Asi Keying Li Xiangchi Yuan Leyan Pan Wenke Lee Wen Xiao LRM 106 0 0 06 Oct 2025
LaDiR: Latent Diffusion Enhances LLMs for Text Reasoning Haoqiang Kang Y. Zhang Nikki Lijing Kuang Nicklas Majamaki Navdeep Jaitly Yi-An Ma Lianhui Qin LRM 536 1 0 06 Oct 2025
Coevolutionary Continuous Discrete Diffusion: Make Your Diffusion Language Model a Latent Reasoner Cai Zhou Chenxiao Yang Yi Hu Chenyu Wang Chubin Zhang Muhan Zhang Lester Mackey Tommi Jaakkola Stephen Bates Dinghuai Zhang 141 4 0 03 Oct 2025
KaVa: Latent Reasoning via Compressed KV-Cache Distillation Anna Kuzina Maciej Pioro Paul N. Whatmough B. Bejnordi ReLM LRM 144 1 0 02 Oct 2025
MemGen: Weaving Generative Latent Memory for Self-Evolving Agents Guibin Zhang Muxin Fu Shuicheng Yan LLMAG 370 2 0 29 Sep 2025
Latent Visual Reasoning Bangzheng Li Ximeng Sun Jiang-Long Liu Ze Wang Jialian Wu Xiaodong Yu Hao Chen Emad Barsoum Muhao Chen Zicheng Liu LRM VLM 192 5 0 29 Sep 2025
MARCOS: Deep Thinking by Markov Chain of Continuous Thoughts Jiayu Liu Zhenya Huang Anya Sims Tong Xu Yee Whye Teh Ning Miao OffRL BDL LRM 112 1 0 29 Sep 2025
MILR: Improving Multimodal Image Generation via Test-Time Latent Reasoning Yapeng Mi Hengli Li Yanpeng Zhao Chenxi Li Huimin Wu Xiaojian Ma Song-Chun Zhu Ying Nian Wu Qing Li LRM VLM 1.3K 2 0 26 Sep 2025
IA2: Alignment with ICL Activations Improves Supervised Fine-Tuning Aayush Mishra Daniel Khashabi Anqi Liu 152 1 0 26 Sep 2025
SIM-CoT: Supervised Implicit Chain-of-Thought Xilin Wei Xiaoran Liu Yuhang Zang Xiaoyi Dong Yuhang Cao Jiaqi Wang Xipeng Qiu Dahua Lin LRM 194 3 0 24 Sep 2025
Soft Tokens, Hard Truths Natasha Butt Ariel Kwiatkowski Ismail Labiad Julia Kempe Yann Ollivier OffRL CLL LRM 135 1 0 23 Sep 2025
CompLLM: Compression for Long Context Q&A Gabriele Berton Jayakrishnan Unnikrishnan Son Tran Mubarak Shah 68 1 0 23 Sep 2025
OnePiece: Bringing Context Engineering and Reasoning to Industrial Cascade Ranking System Sunhao Dai Jiakai Tang Jiahua Wu Kun Wang Yuxuan Zhu ... Anxiang Zeng Wenjie Wang Xu Chen Jun Xu See-Kiong Ng OffRL AI4TS LRM 124 4 0 22 Sep 2025
LTA-thinker: Latent Thought-Augmented Training Framework for Large Language Models on Complex Reasoning Jiaqi Wang Binquan Ji Haibo Luo Yiyang Qi Ruiting Li Huiyan Wang Yuantao Han Cangyi Yang jiaxu Zhang Feiliang Ren BDL LRM 191 1 0 16 Sep 2025
Implicit Reasoning in Large Language Models: A Comprehensive Survey Jindong Li Yali Fu Li Fan Jiahong Liu Yao Shu Chengwei Qin Menglin Yang Irwin King Rex Ying OffRL LRM AI4CE 176 10 0 02 Sep 2025
Stop Spinning Wheels: Mitigating LLM Overthinking via Mining Patterns for Early Reasoning Exit Zihao Wei Liang Pang Jiahao Liu Jingcheng Deng Shicheng Xu ... Jingang Wang Fei Sun Xunliang Cai Huawei Shen Xueqi Cheng LLMAG LRM 76 4 0 25 Aug 2025
Navigating Through Paper Flood: Advancing LLM-based Paper Evaluation through Domain-Aware Retrieval and Latent Reasoning Wuqiang Zheng Yiyan Xu Xinyu Lin Chongming Gao Wenjie Wang Fuli Feng LRM 141 0 0 07 Aug 2025
LLMs are Single-threaded Reasoners: Demystifying the Working Mechanism of Soft Thinking Chünhung Wu Jinliang Lu Zixuan Ren Gangqiang Hu Zhi Wu Dai Dai Hua Wu LRM 270 0 0 05 Aug 2025
Is Chain-of-Thought Reasoning of LLMs a Mirage? A Data Distribution Lens Chengshuai Zhao Zhen Tan Pingchuan Ma Dawei Li Bohan Jiang Yancheng Wang Yingzhen Yang Huan Liu LRM 281 28 0 02 Aug 2025
SynAdapt: Learning Adaptive Reasoning in Large Language Models via Synthetic Continuous Chain-of-Thought Jianwei Wang Ziming Wu Fuming Lai Shaobing Lian Ziqian Zeng LRM 114 2 0 01 Aug 2025
Learning Temporal Abstractions via Variational Homomorphisms in Option-Induced Abstract MDPs Chang Li Yaren Zhang Haoran Lv Qiong Cao Chao Xue Xiaodong He OffRL LRM 168 0 0 22 Jul 2025
Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation Sangmin Bae Yujin Kim Reza Bayat S. Kim Jiyoun Ha ... Adam Fisch Hrayr Harutyunyan Ziwei Ji Aaron Courville Se-Young Yun MoE 267 24 0 14 Jul 2025
Representation Consistency for Accurate and Coherent LLM Answer Aggregation Junqi Jiang Tom Bewley Salim I. Amoukou Francesco Leofante Antonio Rago Saumitra Mishra Francesca Toni 175 1 0 18 Jun 2025
Efficient Reasoning Through Suppression of Self-Affirmation Reflections in Large Reasoning Models Kaiyuan Liu Chen Shen Zhanwei Zhang Junjie Liu Xiaosong Yuan Jieping Ye ReLM LRM 227 9 0 14 Jun 2025
Augmenting Large Language Models with Static Code Analysis for Automated Code Quality Improvements Seyed Moein Abtahi Akramul Azim 272 4 0 12 Jun 2025
Revisiting Test-Time Scaling: A Survey and a Diversity-Aware Method for Efficient Reasoning Ho-Lam Chung Teng-Yun Hsiao Hsiao-Ying Huang Chunerh Cho Jian-Ren Lin Zhang Ziwei Yun-Nung Chen LRM 330 4 0 05 Jun 2025
Continuous Chain of Thought Enables Parallel Exploration and Reasoning Halil Alperen Gozeten M. E. Ildiz Xuechen Zhang Hrayr Harutyunyan A. S. Rawat Samet Oymak LRM 345 8 0 29 May 2025
Latent Reasoning via Sentence Embedding Prediction Hyeonbin Hwang Byeongguk Jeon Seungone Kim Jiyeon Kim Hoyeon Chang Sohee Yang Seungpil Won Dohaeng Lee Youbin Ahn Minjoon Seo AIFin LRM 282 0 0 28 May 2025
ARM: Adaptive Reasoning Model Siye Wu Jian Xie Yikai Zhang Aili Chen Kai Zhang Yu Su Yanghua Xiao LRM 242 12 0 26 May 2025
System-1.5 Reasoning: Traversal in Language and Latent Spaces with Dynamic Shortcuts Xiaoqiang Wang Suyuchen Wang Yun Zhu Bang Liu ReLM LRM 345 6 0 25 May 2025
Hybrid Latent Reasoning via Reinforcement Learning Zhenrui Yue Sara Szymkuć Huimin Zeng Honglei Zhuang Zhen Qin Chang Jo Kim Lanyu Shang Jiawei Han Dong Wang OffRL BDL LRM 301 4 0 24 May 2025
Anchored Diffusion Language Model Litu Rout Constantine Caramanis Sanjay Shakkottai 318 4 0 24 May 2025
Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chains Wenhui Tan Jiaze Li Jianzhong Ju Zhenbo Luo Jian Luan Ruihua Song ReLM OffRL LRM 515 17 0 22 May 2025
Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoning Jinghui Lu Haiyang Yu Siliang Xu Shiwei Ran Guozhi Tang ... Teng Fu Hao Feng Jingqun Tang Hongru Wang Can Huang LRM 357 13 0 21 May 2025
When Less Language is More: Language-Reasoning Disentanglement Makes LLMs Better Multilingual Reasoners Weixiang Zhao Jiahe Guo Yang Deng Tongtong Wu Wenxuan Zhang ... Yanyan Zhao Wanxiang Che Bing Qin Tat-Seng Chua Ting Liu LRM 418 1 0 21 May 2025
Seek in the Dark: Reasoning via Test-Time Instance-Level Policy Gradient in Latent Space Hengli Li Chenxi Li Tong Wu Xuekai Zhu Yuxuan Wang ... Eric Hanchen Jiang Song-Chun Zhu Zixia Jia Ying Nian Wu Zilong Zheng LRM 385 17 0 19 May 2025