Evaluating the Deductive Competence of Large Language Models

Evaluating the Deductive Competence of Large Language Models

11 September 2023

Papers citing "Evaluating the Deductive Competence of Large Language Models"

11 / 11 papers shown

Title
DeduCE: Deductive Consistency as a Framework to Evaluate LLM Reasoning Atharva Pandey Kshitij Dubey Rahul Sharma Amit Sharma ReLM ELM LRM 52 0 0 09 Apr 2025
How Transformers Solve Propositional Logic Problems: A Mechanistic Analysis Guan Zhe Hong Nishanth Dikkala Enming Luo Cyrus Rashtchian Xin Wang Rina Panigrahy OffRL LRM NAI 29 0 0 06 Nov 2024
Reasoning Elicitation in Language Models via Counterfactual Feedback Alihan Hüyük Xinnuo Xu Jacqueline Maasch Aditya V. Nori Javier González ReLM LRM 80 1 0 02 Oct 2024
Automotive innovation landscaping using LLM Raju Gorain Omkar Salunke 22 0 0 22 Sep 2024
Does Reasoning Emerge? Examining the Probabilities of Causation in Large Language Models Javier González Aditya V. Nori LRM 42 2 0 15 Aug 2024
LLM-based Extraction of Contradictions from Patents Stefan Trapp Joachim Warschat 19 4 0 21 Mar 2024
The Debate Over Understanding in AI's Large Language Models Melanie Mitchell D. Krakauer ELM 70 197 0 14 Oct 2022
Analogy Generation by Prompting Large Language Models: A Case Study of InstructGPT B. Bhavya Jinjun Xiong Chengxiang Zhai LRM 43 42 0 09 Oct 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 303 11,881 0 04 Mar 2022
Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Survey Prajjwal Bhargava Vincent Ng ReLM LRM 32 61 0 28 Jan 2022
Making Pre-trained Language Models Better Few-shot Learners Tianyu Gao Adam Fisch Danqi Chen 241 1,913 0 31 Dec 2020