Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning

5 February 2025

Papers citing "Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning"

50 / 168 papers shown

Title
Math-PUMA: Progressive Upward Multimodal Alignment to Enhance Mathematical ReasoningAAAI Conference on Artificial Intelligence (AAAI), 2024 Wenwen Zhuang Xin Huang Xiantao Zhang Jin Zeng LRM 315 55 0 16 Aug 2024
DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Search Huajian Xin Zhaochun Ren Junxiao Song Zhihong Shao Wanjia Zhao ... Dejian Yang Zhibin Gou Z. F. Wu Fuli Luo Chong Ruan AIMat LRM 267 127 0 15 Aug 2024
A Large Encoder-Decoder Family of Foundation Models For Chemical Language Eduardo Soares Victor Shirasuna E. V. Brazil Renato F. G. Cerqueira Dmitry Zubarev Kristin Schmidt AI4CE 236 13 0 24 Jul 2024
A Benchmark Dataset for Multimodal Prediction of Enzymatic Function Coupling DNA Sequences and Natural Language Yuchen Zhang Ratish Kumar Chandrakant Jha Soumya Bharadwaj Vatsal Sanjaykumar Thakkar Adrienne Hoarfrost Jin Sun 130 2 0 21 Jul 2024
XAI meets LLMs: A Survey of the Relation between Explainable AI and Large Language Models Xiaoshi Zhong Lorenzo Malandri Fabio Mercorio Navid Nobani Andrea Seveso 305 37 0 21 Jul 2024
Qwen2 Technical Report An Yang Baosong Yang Binyuan Hui Jian Xu Bowen Yu ... Yuqiong Liu Zeyu Cui Zhenru Zhang Zhifang Guo Zhi-Wei Fan OSLM VLM MU 620 1,650 0 15 Jul 2024
Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation Biqing Qi Kaiyan Zhang Kai Tian Haoxiang Li Zhang-Ren Chen Sihang Zeng Ermo Hua Hu Jinfang Bowen Zhou LM&MA 360 31 0 12 Jul 2024
We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning? Runqi Qiao Qiuna Tan Guanting Dong Minhui Wu Chong Sun ... Yida Xu Muxi Diao Zhimin Bao Chen Li Honggang Zhang VLM LRM 264 156 0 01 Jul 2024
OlympicArena Medal Ranks: Who Is the Most Intelligent AI So Far? Zhen Huang Zengzhi Wang Shijie Xia Pengfei Liu ELM 212 12 0 24 Jun 2024
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery Yu Zhang Xiusi Chen Sara Szymkuć Sheng Wang Shuiwang Ji Wei Wang Jiawei Han 356 86 0 16 Jun 2024
MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos Xuehai He Weixi Feng Kaizhi Zheng Yujie Lu Wanrong Zhu ... Zhengyuan Yang Kevin Lin William Yang Wang Lijuan Wang Xin Eric Wang VGen LRM 542 34 0 12 Jun 2024
Evaluating Mathematical Reasoning of Large Language Models: A Focus on Error Identification and Correction Xiaoyuan Li Wenjie Wang Moxin Li Junrong Guo Yang Zhang Fuli Feng ELM LRM 221 41 0 02 Jun 2024
Xwin-LM: Strong and Scalable Alignment Practice for LLMs Bolin Ni Jingcheng Hu Yixuan Wei Houwen Peng Zheng Zhang Gaofeng Meng Han Hu LM&MA ALM 123 3 0 30 May 2024
A Survey of Multimodal Large Language Model from A Data-centric Perspective Tianyi Bai Hao Liang Binwang Wan Yanran Xu Xi Li ... Ping Huang Jiulong Shan Conghui He Binhang Yuan Wentao Zhang 339 64 0 26 May 2024
M4U: Evaluating Multilingual Understanding and Reasoning for Large Multimodal Models Hongyu Wang Jiayu Xu Senwei Xie Ruiping Wang Jialin Li Zhaojie Xie Bin Zhang Chuyan Xiong Xilin Chen ELM VLM LRM 363 9 0 24 May 2024
JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis ModelsNeural Information Processing Systems (NeurIPS), 2024 Kun Zhou Beichen Zhang Jiapeng Wang Zhipeng Chen Wayne Xin Zhao Jing Sha Zhichao Sheng Shijin Wang Ji-Rong Wen SyDa LRM 296 47 0 23 May 2024
DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data Huajian Xin Daya Guo Zhihong Shao Zhaochun Ren Qihao Zhu Bo Liu Chong Ruan Wenda Li Xiaodan Liang SyDa 258 145 0 23 May 2024
Desirable Characteristics for AI Teaching Assistants in Programming EducationAnnual Conference on Innovation and Technology in Computer Science Education (ITiCSE), 2024 Paul Denny Stephen MacNeil Jaromír Šavelka Leo Porter Andrew Luxton-Reilly 232 57 0 23 May 2024
Benchmarking Retrieval-Augmented Large Language Models in Biomedical NLP: Application, Robustness, and Self-Awareness Mingchen Li Zaifu Zhan Han Yang Yongkang Xiao Jiatan Huang Rui Zhang 299 7 0 13 May 2024
Mitigating Hallucinations in Large Language Models via Self-Refinement-Enhanced Knowledge Retrieval Mengjia Niu Hao Li Jie Shi Hamed Haddadi Fan Mo HILM 143 23 0 10 May 2024
A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language ModelsKnowledge Discovery and Data Mining (KDD), 2024 Wenqi Fan Yujuan Ding Liang-bo Ning Shijie Wang Hengyun Li D. Yin Tat-Seng Chua Qing Li RALM 3DV 546 575 0 10 May 2024
MAmmoTH2: Scaling Instructions from the WebNeural Information Processing Systems (NeurIPS), 2024 Xiang Yue Tuney Zheng Ge Zhang Lei Ma ALM LRM 358 148 0 06 May 2024
Large Language Models are Inconsistent and Biased Evaluators Rickard Stureborg Dimitris Alikaniotis Yoshi Suhara ALM 355 97 0 02 May 2024
BiomedRAG: A Retrieval Augmented Large Language Model for Biomedicine Mingchen Li H. Kilicoglu Hualei Xu Rui Zhang LM&MA RALM 374 49 0 01 May 2024
Hallucination of Multimodal Large Language Models: A Survey Zechen Bai Pichao Wang Tianjun Xiao Tong He Zongbo Han Zheng Zhang Mike Zheng Shou VLM LRM 576 301 0 29 Apr 2024
Multimodal Fusion on Low-quality Data: A Comprehensive Survey Qingyang Zhang Yake Wei Zongbo Han Huazhu Fu Xi Peng ... Qinghua Hu Cai Xu Jie Wen Di Hu Changqing Zhang 300 59 0 27 Apr 2024
How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suites Zhe Chen Weiyun Wang Hao Tian Shenglong Ye Zhangwei Gao ... Tong Lu Dahua Lin Yu Qiao Jifeng Dai Wenhai Wang MLLM VLM 466 963 0 25 Apr 2024
Continual Learning of Large Language Models: A Comprehensive Survey Haizhou Shi Zihao Xu Hengyi Wang Weiyi Qin Wenyuan Wang Yibin Wang Zifeng Wang Sayna Ebrahimi Hao Wang CLL KELM LRM 361 146 0 25 Apr 2024
Integrating Chemistry Knowledge in Large Language Models via Prompt Engineering Hongxuan Liu Haoyu Yin Zhiyao Luo Xiaonan Wang 143 32 0 22 Apr 2024
UrbanCross: Enhancing Satellite Image-Text Retrieval with Cross-Domain Adaptation Siru Zhong Xixuan Hao Yibo Yan Ying Zhang Yangqiu Song Yuxuan Liang 115 16 0 22 Apr 2024
Detecting and Mitigating Hallucination in Large Vision Language Models via Fine-Grained AI Feedback Wenyi Xiao Ziwei Huang Yaoyao Yu Wanggui He Haoyuan Li Zhelun Yu Hao Jiang Leilei Gan Linchao Zhu MLLM 250 55 0 22 Apr 2024
Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biology Oren Z. Kraus Kian Kenyon-Dean Saber Saberian Maryam Fallah Peter McLean ... Chi Vicky Cheng Kristen Morse Maureen Makes Ben Mabey Berton Earnshaw 181 49 0 16 Apr 2024
MM-MATH: Advancing Multimodal Math Evaluation with Process Evaluation and Fine-grained Classification Kai Sun Yushi Bai Ji Qi Lei Hou Juanzi Li LRM 256 37 0 07 Apr 2024
ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique PipelineConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Yifan Xu Xiao Liu Xinghan Liu Zhenyu Hou Yueyan Li ... Aohan Zeng Zhengxiao Du Wenyi Zhao Jie Tang Yuxiao Dong LRM 199 51 0 03 Apr 2024
MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems? Renrui Zhang Dongzhi Jiang Yichi Zhang Haokun Lin Ziyu Guo ... Aojun Zhou Pan Lu Kai-Wei Chang Shiyang Feng Jiaming Song 216 452 0 21 Mar 2024
EXAMS-V: A Multi-Discipline Multilingual Multimodal Exam Benchmark for Evaluating Vision Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Rocktim Jyoti Das Simeon Emilov Hristov Jinyan Su Dimitar Iliyanov Dimitrov Ivan Koychev Preslav Nakov CoGe ELM 226 41 0 15 Mar 2024
Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Survey Qizhi Pei Lijun Wu Ran Bi Jinhua Zhu Yue Wang Guoqing Liu Tao Qin Lijun Wu Rui Yan AI4CE 313 22 0 03 Mar 2024
Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Models Lei Li Yuqi Wang Runxin Xu Peiyi Wang Xiachong Feng Lingpeng Kong Qi Liu 315 95 0 01 Mar 2024
Deep Learning for Cross-Domain Data Fusion in Urban Computing: Taxonomy, Advances, and Outlook Xingchen Zou Yibo Yan Xixuan Hao Yuehong Hu Haomin Wen ... Junbo Zhang Yong Li Tianrui Li Yu Zheng Yuxuan Liang HAI AI4TS 259 81 0 29 Feb 2024
OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems Chaoqun He Renjie Luo Yuzhuo Bai Shengding Hu Zhen Leng Thai ... Yuxiang Zhang Jie Liu Lei Qi Zhiyuan Liu Maosong Sun ELM AIMat 367 642 0 21 Feb 2024
ChemLLM: A Chemical Large Language Model Di Zhang Wei Liu Qian Tan Jingdan Chen Hang Yan ... Dongzhan Zhou Shufei Zhang Mao Su Han-Sen Zhong Yuqiang Li AI4MH 186 81 0 10 Feb 2024
Reasoning Grasping via Multimodal Large Language ModelConference on Robot Learning (CoRL), 2024 Shiyu Jin Jinxuan Xu Yutian Lei Liangjun Zhang LRM 222 36 0 09 Feb 2024
InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoning Huaiyuan Ying Shuo Zhang Linyang Li Zhejian Zhou Yunfan Shao ... Hang Yan Xipeng Qiu Jiayu Wang Kai-xiang Chen Dahua Lin ReLM LRM 195 111 0 09 Feb 2024
SceMQA: A Scientific College Entrance Level Multimodal Question Answering Benchmark Zhenwen Liang Kehan Guo Gang Liu Taicheng Guo Yujun Zhou Tianyu Yang Jiajun Jiao Renjie Pi Jipeng Zhang Xiangliang Zhang ELM 222 34 0 06 Feb 2024
Beyond Lines and Circles: Unveiling the Geometric Reasoning Gap in Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Spyridon Mouselinos Henryk Michalewski Mateusz Malinowski LRM 173 11 0 06 Feb 2024
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models Zhihong Shao Peiyi Wang Qihao Zhu Runxin Xu Jun-Mei Song ... Haowei Zhang Mingchuan Zhang Yiming Li Yu-Huan Wu Daya Guo ReLM LRM 1.2K 3,647 0 05 Feb 2024
A Survey on Robotics with Foundation Models: toward Embodied AI Zhiyuan Xu Kun Wu Junjie Wen Jinming Li Ning Liu Zhengping Che Jian Tang AI4CE LRM LM&Ro 254 61 0 04 Feb 2024
Bringing Generative AI to Adaptive Learning in Education Hang Li Tianlong Xu Chaoli Zhang Eason Chen Jing Liang Xing Fan Haoyang Li Shucheng Zhou Qingsong Wen 271 38 0 02 Feb 2024
A Survey on Large Language Model Hallucination via a Creativity Perspective Xuhui Jiang Yuxing Tian Fengrui Hua Chengjin Xu Yuanzhuo Wang Jian Guo LRM 196 52 0 02 Feb 2024
A Survey on Hallucination in Large Vision-Language Models Hanchao Liu Wenyuan Xue Yifei Chen Dapeng Chen Xiutian Zhao Ke Wang Liping Hou Rong-Zhi Li Wei Peng LRM MLLM 293 238 0 01 Feb 2024