The Relationship Between Reasoning and Performance in Large Language Models -- o3 (mini) Thinks Harder, Not Longer

24 February 2025

ArXiv (abs)PDF HTML HuggingFace (9 upvotes)

Papers citing "The Relationship Between Reasoning and Performance in Large Language Models -- o3 (mini) Thinks Harder, Not Longer"

23 / 23 papers shown

Title
Trace Length is a Simple Uncertainty Signal in Reasoning Models Siddartha Devic Charlotte Peale Arwen Bradley Sinead Williamson Preetum Nakkiran Aravind Gollakota LRM 120 0 0 12 Oct 2025
Overthinking Reduction with Decoupled Rewards and Curriculum Data Scheduling Shuyang Jiang Yusheng Liao Ya Zhang Yanfeng Wang Y. Wang OffRL LRM 76 0 0 30 Sep 2025
From Reasoning to Answer: Empirical, Attention-Based and Mechanistic Insights into Distilled DeepSeek R1 Models Jue Zhang Qingwei Lin Saravan Rajmohan Dongmei Zhang LRM 89 0 0 28 Sep 2025
Automated Item Neutralization for Non-Cognitive Scales: A Large Language Model Approach to Reducing Social-Desirability Bias Sirui Wu Daijin Yang 91 0 0 09 Sep 2025
Lexical Hints of Accuracy in LLM Reasoning Chains Arne Vanhoyweghen Brecht Verbeken Andres Algaba Vincent Ginis 109 1 0 19 Aug 2025
Using Large Language Models to Measure Symptom Severity in Patients At Risk for Schizophrenia Andrew X. Chen Guillermo Horga Sean Escola LM&MA 40 1 0 13 Aug 2025
Diversity-Enhanced Reasoning for Subjective Questions Yumeng Wang Zhiyuan Fan Jiayu Liu J. Huang Yi R. Fung LRM 410 5 0 27 Jul 2025
Fail Fast, or Ask: Mitigating the Deficiencies of Reasoning LLMs with Human-in-the-Loop Systems Engineering Michael J. Zellinger Matt Thomson LRM 69 0 0 18 Jul 2025
Exploring and Exploiting the Inherent Efficiency within Large Reasoning Models for Self-Guided Efficiency Enhancement Weixiang Zhao Jiahe Guo Yang Deng Xingyu Sui Yulin Hu Yanyan Zhao Wanxiang Che Bing Qin Tat-Seng Chua Ting Liu LRM 214 5 0 18 Jun 2025
The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem ComplexityRobotics (RAS), 2025 Parshin Shojaee Iman Mirzadeh Keivan Alizadeh Maxwell Horton Samy Bengio Mehrdad Farajtabar LRM 210 192 0 07 Jun 2025
AI Scientists Fail Without Strong Implementation Capability Minjun Zhu Qiujie Xie Yixuan Weng Jian Wu Zhen Lin Linyi Yang Yue Zhang ELM 269 6 0 02 Jun 2025
ER-REASON: A Benchmark Dataset for LLM-Based Clinical Reasoning in the Emergency Room Nikita Mehandru Niloufar Golchini David Bamman Travis Zack Melanie F. Molina Ahmed Alaa ELM 200 4 0 28 May 2025
What Makes a Good Reasoning Chain? Uncovering Structural Patterns in Long Chain-of-Thought Reasoning Gangwei Jiang Yahui Liu Zhaoyi Li Qi Wang Fuzheng Zhang Linqi Song Ying Wei Defu Lian LRM 175 6 0 28 May 2025
Rethinking the Unsolvable: When In-Context Search Meets Test-Time Scaling Fanzeng Xia Yidong Luo Tinko Sebastian Bartels Yaqi Xu Tongxin Li ReLM LRM 201 0 0 28 May 2025
CP-Router: An Uncertainty-Aware Router Between LLM and LRM Jiayuan Su Fulin Lin Zhaopeng Feng Han Zheng Teng Wang Zhenyu Xiao Xinlong Zhao Zuozhu Liu Lu Cheng Hongwei Wang 166 2 0 26 May 2025
Think or Not? Exploring Thinking Efficiency in Large Reasoning Models via an Information-Theoretic Lens Xixian Yong Xiao Zhou Yingying Zhang Jinlin Li Yefeng Zheng X. Wu LRM 187 8 0 23 May 2025
Mapping the Minds of LLMs: A Graph-Based Analysis of Reasoning LLM Zhen Xiong Yujun Cai Zhecheng Li Yiwei Wang LRM 144 6 0 20 May 2025
Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMs Jinyan Su Jennifer Healey Preslav Nakov Claire Cardie LRM 569 45 0 30 Apr 2025
Reasoning without Regret Tarun Chitra OffRL LRM 158 0 0 14 Apr 2025
Trade-offs in Large Reasoning Models: An Empirical Analysis of Deliberative and Adaptive Reasoning over Foundational Capabilities Weixiang Zhao Xingyu Sui Jiahe Guo Yulin Hu Yang Deng ... Wanxiang Che Tat-Seng Chua Ting Liu Ting Liu Bing Qin ELM LRM 421 18 0 23 Mar 2025
Preference Leakage: A Contamination Problem in LLM-as-a-judge Dawei Li Renliang Sun Yue Huang Ming Zhong Bohan Jiang Jiawei Han Wei Wei Wei Wang Huan Liu 506 64 0 03 Feb 2025
ReasoningWeekly: A General Knowledge and Verbal Reasoning Challenge for Large Language Models C. Anderson Joydeep Biswas Aleksander Boruch-Gruszecki Federico Cassano Molly Q. Feldman Joydeep Biswas Francesca Lucchetti Zixuan Wu ReLM ELM LRM 250 8 0 03 Feb 2025
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning DeepSeek-AI Daya Guo Dejian Yang Haowei Zhang Junxiao Song ... Shiyu Wang S. Yu Shunfeng Zhou Shuting Pan S.S. Li ReLM VLM OffRL AI4TS LRM 1.0K 5,096 0 22 Jan 2025