Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning

Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning

5 February 2025

Daniel Schwalbe-Koda

ArXiv (abs)PDF HTML

Papers citing "Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning"

18 / 168 papers shown

Title
Unifying Large Language Models and Knowledge Graphs: A RoadmapIEEE Transactions on Knowledge and Data Engineering (TKDE), 2023 Shirui Pan Linhao Luo Yufei Wang Chen Chen Jiapu Wang Xindong Wu KELM 451 1,092 0 14 Jun 2023
Multimodal Explainable Artificial Intelligence: A Comprehensive Review of Methodological Advances and Future Research DirectionsIEEE Access (IEEE Access), 2023 N. Rodis Christos Sardianos Panagiotis I. Radoglou-Grammatikis Panagiotis G. Sarigiannidis Iraklis Varlamis Georgios Th. Papadopoulos 249 36 0 09 Jun 2023
M3Exam: A Multilingual, Multimodal, Multilevel Benchmark for Examining Large Language ModelsNeural Information Processing Systems (NeurIPS), 2023 Wenxuan Zhang Sharifah Mahani Aljunied Chang Gao Yew Ken Chia Lidong Bing ELM 250 120 0 08 Jun 2023
Fine-Grained Human Feedback Gives Better Rewards for Language Model TrainingNeural Information Processing Systems (NeurIPS), 2023 Zeqiu Wu Yushi Hu Weijia Shi Nouha Dziri Alane Suhr Prithviraj Ammanabrolu Noah A. Smith Mari Ostendorf Hannaneh Hajishirzi ALM 397 406 0 02 Jun 2023
What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasksNeural Information Processing Systems (NeurIPS), 2023 Taicheng Guo Kehan Guo B. Nan Zhengwen Liang Zhichun Guo Nitesh Chawla Olaf Wiest Xiangliang Zhang ELM 442 206 0 27 May 2023
Scaling Data-Constrained Language ModelsNeural Information Processing Systems (NeurIPS), 2023 Niklas Muennighoff Alexander M. Rush Boaz Barak Teven Le Scao Aleksandra Piktus Nouamane Tazi S. Pyysalo Thomas Wolf Colin Raffel ALM 537 314 0 25 May 2023
Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Daman Arora H. Singh Mausam ELM LRM 364 72 0 24 May 2023
Reasoning with Language Model is Planning with World ModelConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Shibo Hao Yi Gu Haodi Ma Joshua Jiahua Hong Zhen Wang D. Wang Zhiting Hu ReLM LRM LLMAG 347 801 0 24 May 2023
TheoremQA: A Theorem-driven Question Answering datasetConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Wenhu Chen Ming Yin Max Ku Pan Lu Yixin Wan Xueguang Ma Jianyu Xu Xinyi Wang Tony Xia AIMat 272 181 0 21 May 2023
T-SciQ: Teaching Multimodal Chain-of-Thought Reasoning via Mixed Large Language Model Signals for Science Question AnsweringAAAI Conference on Artificial Intelligence (AAAI), 2023 Lei Wang Yilang Hu Jiabang He Xingdong Xu Ning Liu Hui-juan Liu Hengtao Shen LRM MLLM 226 77 0 05 May 2023
DataComp: In search of the next generation of multimodal datasetsNeural Information Processing Systems (NeurIPS), 2023 S. Gadre Gabriel Ilharco Alex Fang J. Hayase Georgios Smyrnis ... A. Dimakis J. Jitsev Y. Carmon Vaishaal Shankar Ludwig Schmidt VLM 529 566 0 27 Apr 2023
Chameleon: Plug-and-Play Compositional Reasoning with Large Language ModelsNeural Information Processing Systems (NeurIPS), 2023 Pan Lu Baolin Peng Hao Cheng Michel Galley Kai-Wei Chang Ying Nian Wu Song-Chun Zhu Jianfeng Gao KELM MLLM LRM 269 405 0 19 Apr 2023
AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models Wanjun Zhong Ruixiang Cui Yiduo Guo Yaobo Liang Shuai Lu Yanlin Wang Amin Saied Weizhu Chen Nan Duan ALM ELM 338 702 0 13 Apr 2023
ChemCrow: Augmenting large-language models with chemistry tools Andres M Bran Sam Cox Oliver Schilter Carlo Baldassari Andrew D. White P. Schwaller LLMAG 572 627 0 11 Apr 2023
Scientists' Perspectives on the Potential for Generative AI in their Fields Meredith Ringel Morris AI4CE 141 47 0 04 Apr 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 3.5K 20,141 0 15 Mar 2023
Large Language Models Can Be Easily Distracted by Irrelevant ContextInternational Conference on Machine Learning (ICML), 2023 Freda Shi Xinyun Chen Kanishka Misra Nathan Scales David Dohan Ed H. Chi Nathanael Scharli Denny Zhou ReLM RALM LRM 548 782 0 31 Jan 2023
ClimaX: A foundation model for weather and climateInternational Conference on Machine Learning (ICML), 2023 Tung Nguyen Johannes Brandstetter Ashish Kapoor Jayesh K. Gupta Aditya Grover AI4Cl AI4CE 525 355 0 24 Jan 2023