MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs

26 February 2024

ArXiv (abs)PDF HTML HuggingFace (2 upvotes)

Papers citing "MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs"

50 / 50 papers shown

Title
A Survey on LLM Mid-Training Chengying Tu Xuemiao Zhang Rongxiang Weng Rumei Li Chen Zhang Yang Bai Hongfei Yan Jingang Wang Xunliang Cai OffRL LRM 225 0 0 27 Oct 2025
AgenticMath: Enhancing LLM Reasoning via Agentic-based Math Data Generation Xianyang Liu Y. Liu Shuai Wang Hao Cheng Andrew Estornell Yuzhi Zhao Jiaheng Wei LRM 160 0 0 22 Oct 2025
Making Mathematical Reasoning Adaptive Z. Lai Xiang Geng Zhijun Wang Yang Bai Jiahuan Li Rongxiang Weng Jingang Wang Xuezhi Cao Xunliang Cai Xin Huang LRM 156 0 0 06 Oct 2025
Scaling Code-Assisted Chain-of-Thoughts and Instructions for Model Reasoning Honglin Lin Qizhi Pei Xin Gao Zhuoshi Pan Yu Li J. Li Conghui He Lijun Wu ALM LRM 160 1 0 05 Oct 2025
ScaleDiff: Scaling Difficult Problems for Advanced Mathematical Reasoning Qizhi Pei Zhuoshi Pan Honglin Lin Xin Gao Yu Li Zinan Tang Conghui He Rui Yan Lijun Wu AIMat OffRL LRM 211 2 0 25 Sep 2025
CogAtom: From Cognitive Atoms to Olympiad-level Mathematical Reasoning in Large Language Models Zhuofan Chen Jiyuan He Yichi Zhang Xing Hu Haoxing Wen Jun Bai Wenge Rong LRM 214 0 0 22 Sep 2025
When Inverse Data Outperforms: Exploring the Pitfalls of Mixed Data in Multi-Stage Fine-Tuning Mengyi Deng Xin Li T. Zhu Zhicheng YANG Zhijiang Guo Wei Wang 100 0 0 16 Sep 2025
Alignment with Fill-In-the-Middle for Enhancing Code Generation Houxing Ren Zimu Lu Weikang Shi Haotian Hou Yunqiao Yang Ke Wang A-Long Zhou Junting Pan Mingjie Zhan Jiaming Song 100 0 0 27 Aug 2025
FLAMES: Improving LLM Math Reasoning via a Fine-Grained Analysis of the Data Synthesis Pipeline Parker Seegmiller Kartik Mehta Soumya Saha Chenyang Tao Shereen Oraby Arpit Gupta Tagyoung Chung Mohit Bansal Nanyun Peng SyDa LRM 84 0 0 22 Aug 2025
PuzzleClone: An SMT-Powered Framework for Synthesizing Verifiable Data Kai Xiong Yanwei Huang Rongjunchen Zhang Kun Chen Haipang Wu 106 0 0 21 Aug 2025
Can Large Models Teach Student Models to Solve Mathematical Problems Like Human Beings? A Reasoning Distillation Method via Multi-LoRA InteractionInternational Joint Conference on Artificial Intelligence (IJCAI), 2025 Xinhe Li Jiajun Liu Peng Wang LRM 92 1 0 18 Aug 2025
MathSmith: Towards Extremely Hard Mathematical Reasoning by Forging Synthetic Problems with a Reinforced Policy Shaoxiong Zhan Yanlin Lai Ziyu Lu Dahua Lin Ziqing Yang Fei Tang LRM 107 9 0 07 Aug 2025
ACT: Bridging the Gap in Code Translation through Synthetic Data Generation & Adaptive Training Shreya Saxena Siva Prasad Zishan Ahmad Vishal Vaddina 50 0 0 22 Jul 2025
TreeRPO: Tree Relative Policy Optimization Zhicheng YANG Zhijiang Guo Yinya Huang Xiaodan Liang Yiwei Wang Jing Tang LRM 289 14 0 05 Jun 2025
MDPO: Multi-Granularity Direct Preference Optimization for Mathematical Reasoning Yunze Lin LRM 139 0 0 30 May 2025
Reasoning-OCR: Can Large Multimodal Models Solve Complex Logical Reasoning Problems from OCR Cues? Haibin He Maoyuan Ye Jing Zhang Xiantao Cai Juhua Liu Bo Du Dacheng Tao LRM 345 3 0 19 May 2025
MARGE: Improving Math Reasoning for LLMs with Guided Exploration Jingyue Gao Runji Lin Keming Lu Bowen Yu Junyang Lin Jianyu Chen LRM 255 1 0 18 May 2025
MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Ke Wang Junting Pan Linda Wei Aojun Zhou Weikang Shi ... Han Xiao Yiran Yang Houxing Ren Mingjie Zhan Jiaming Song 352 22 0 15 May 2025
RV-Syn: Rational and Verifiable Mathematical Reasoning Data Synthesis based on Structured Function Library Jiadong Wang Jinhao Jiang Qing Cui Jun Zhou Wayne Xin Zhao SyDa 213 1 0 29 Apr 2025
SWE-Synth: Synthesizing Verifiable Bug-Fix Data to Enable Large Language Models in Resolving Real-World Bugs Minh V.T. Pham Huy N. Phan Hoang N. Phan Cuong Le Chi Thien Hang Nguyen Nghi D. Q. Bui SyDa 359 7 0 20 Apr 2025
LLM for Complex Reasoning Task: An Exploratory Study in Fermi Problems Ziyue Liu Carlos Rabat Villarreal Mostafa Rahgouy Amit Das Zheng Zhang Chang Ren Dongji Feng ReLM LRM 284 0 0 03 Apr 2025
Cultural Learning-Based Culture Adaptation of Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Chen Cecilia Liu Anna Korhonen Iryna Gurevych 282 5 0 03 Apr 2025
ReFeed: Multi-dimensional Summarization Refinement with Reflective Reasoning on Feedback Taewon Yun Jihwan Oh Hyangsuk Min Yuho Lee Jihwan Bang Jason (Jinglun) Cai Hwanjun Song OffRL LRM 212 1 0 27 Mar 2025
LEMMA: Learning from Errors for MatheMatical Advancement in LLMsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Zhuoshi Pan Yu Li Honglin Lin Qizhi Pei Zinan Tang Wei Wu Chenlin Ming H. Vicky Zhao Bin Wang Lijun Wu LRM 378 13 0 21 Mar 2025
The KoLMogorov Test: Compression by Code GenerationInternational Conference on Learning Representations (ICLR), 2025 Ori Yoran Kunhao Zheng Fabian Gloeckle Jonas Gehring Gabriel Synnaeve Taco Cohen 211 3 0 18 Mar 2025
GiFT: Gibbs Fine-Tuning for Code GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Haochen Li Wanjin Feng Xin Zhou Zhiqi Shen SyDa 371 2 0 17 Feb 2025
MIH-TCCT: Mitigating Inconsistent Hallucinations in LLMs via Event-Driven Text-Code Cyclic Training Xinxin You Xien Liu Qixin Sun Huan Zhang Kaiyin Zhou Shaohui Liu Guoping Hu Shijin Wang Si Liu Ji Wu 361 0 0 13 Feb 2025
Enhancing Reasoning through Process Supervision with Monte Carlo Tree Search Shuangtao Li Shuaihao Dong Kexin Luan Xinhan Di Chaofan Ding LRM 219 7 0 02 Jan 2025
System-2 Mathematical Reasoning via Enriched Instruction Tuning Huanqia Cai Yijun Yang Zhifeng Li LRM 259 4 0 22 Dec 2024
Mars-PO: Multi-Agent Reasoning System Preference Optimization Xiaoxuan Lou Chaojie Wang Bo An LLMAG LRM 203 1 0 28 Nov 2024
Understanding Synthetic Context Extension via Retrieval Heads Xinyu Zhao Fangcong Yin Greg Durrett 555 4 0 29 Oct 2024
Markov Chain of Thought for Efficient Mathematical ReasoningNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Wen Yang Kai Fan Minpeng Liao LRM 155 11 0 23 Oct 2024
A Survey on Data Synthesis and Augmentation for Large Language Models Ke Wang Jiahui Zhu Minjie Ren Ziqiang Liu Shiwei Li ... Yiming Lei Xiaoyu Wu Qiqi Zhan Qingjie Liu Yunhong Wang SyDa 405 34 0 16 Oct 2024
SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-CorrectionInternational Conference on Learning Representations (ICLR), 2024 L. Yang Zhaochen Yu Tianze Zhang Minkai Xu Alfons Kemper Tengjiao Wang Shuicheng Yan ELM ReLM LRM 302 0 0 11 Oct 2024
MathCoder2: Better Math Reasoning from Continued Pretraining on Model-translated Mathematical CodeInternational Conference on Learning Representations (ICLR), 2024 Zimu Lu Aojun Zhou Ke Wang Houxing Ren Weikang Shi Junting Pan Mingjie Zhan Hongsheng Li LRM 180 26 0 10 Oct 2024
Subtle Errors in Reasoning: Preference Learning via Error-injected Self-editingAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Kaishuai Xu Tiezheng YU Wenjun Hou Yi Cheng Chak Tou Leong Liangyou Li Xin Jiang Lifeng Shang Qun Liu Wenjie Li LRM 1.0K 0 0 09 Oct 2024
LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical Reasoning Di Zhang Jianbo Wu Jingdi Lei Tong Che Jiatong Li ... Shufei Zhang Marco Pavone Yuqiang Li Wanli Ouyang Dongzhan Zhou LRM 199 89 0 03 Oct 2024
LogicPro: Improving Complex Logical Reasoning via Program-Guided LearningAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Jin Jiang Yuchen Yan Yang Liu Yonggang Jin Shuai Peng Hao Fei Xunliang Cai Yixin Cao Liangcai Gao LRM 421 10 0 19 Sep 2024
SIaM: Self-Improving Code-Assisted Mathematical Reasoning of Large Language Models Dian Yu Baolin Peng Ye Tian Linfeng Song Haitao Mi Dong Yu ALM LRM 180 4 0 28 Aug 2024
AI-Assisted Generation of Difficult Math Questions Vedant Shah Dingli Yu Kaifeng Lyu Simon Park Nan Rosemary Ke ... Yoshua Bengio Sanjeev Arora Anirudh Goyal Sanjeev Arora Anirudh Goyal 362 31 0 30 Jul 2024
DotaMath: Decomposition of Thought with Code Assistance and Self-correction for Mathematical Reasoning Chengpeng Li Guanting Dong Mingfeng Xue Ru Peng Xiang Wang Dayiheng Liu LRM ReLM 314 22 0 04 Jul 2024
Step-Controlled DPO: Leveraging Stepwise Error for Enhanced Mathematical Reasoning Zimu Lu Aojun Zhou Ke Wang Houxing Ren Weikang Shi Junting Pan Mingjie Zhan Hongsheng Li LRM 221 35 0 30 Jun 2024
Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs Xin Lai Zhuotao Tian Yukang Chen Senqiao Yang Xiangru Peng Jiaya Jia LRM 370 205 0 26 Jun 2024
Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning Zhihan Zhang Zhenwen Liang Wenhao Yu Dian Yu Mengzhao Jia Dong Yu Meng Jiang AIMat RALM LRM ReLM 188 21 0 17 Jun 2024
Step-level Value Preference Optimization for Mathematical Reasoning Guoxin Chen Minpeng Liao Chengxi Li Kai Fan LRM 203 64 0 16 Jun 2024
JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis ModelsNeural Information Processing Systems (NeurIPS), 2024 Kun Zhou Beichen Zhang Jiapeng Wang Zhipeng Chen Wayne Xin Zhao Jing Sha Zhichao Sheng Shijin Wang Ji-Rong Wen SyDa LRM 308 47 0 23 May 2024
AlphaMath Almost Zero: process Supervision without processNeural Information Processing Systems (NeurIPS), 2024 Guoxin Chen Minpeng Liao Chengxi Li Kai Fan AIMat LRM 256 169 0 06 May 2024
Describe-then-Reason: Improving Multimodal Mathematical Reasoning through Visual Comprehension Training Mengzhao Jia Zhihan Zhang Wenhao Yu Fangkai Jiao Meng Jiang VLM ReLM LRM 283 16 0 22 Apr 2024
Instruction Tuning for Large Language Models: A Survey Shengyu Zhang Linfeng Dong Xiaoya Li Sen Zhang Xiaofei Sun ... Jiwei Li Runyi Hu Tianwei Zhang Leilei Gan Guoyin Wang LM&MA 814 750 0 21 Aug 2023
WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-InstructInternational Conference on Learning Representations (ICLR), 2023 Haipeng Luo Qingfeng Sun Can Xu Lu Wang Jian-Guang Lou ... Xiubo Geng Qingwei Lin Shifeng Chen Yansong Tang Dongmei Zhang LRM OSLM 772 612 0 18 Aug 2023