I2D2: Inductive Knowledge Distillation with NeuroLogic and Self-Imitation

19 December 2022

Keisuke Sakaguchi

Yejin Choi

Papers citing "I2D2: Inductive Knowledge Distillation with NeuroLogic and Self-Imitation"

25 / 25 papers shown

Title
Soda-Eval: Open-Domain Dialogue Evaluation in the age of LLMs John Mendonça Isabel Trancoso A. Lavie ALM 29 1 0 20 Aug 2024
Stress-Testing Long-Context Language Models with Lifelong ICL and Task Haystack Xiaoyue Xu Qinyuan Ye Xiang Ren 38 6 0 23 Jul 2024
ECoh: Turn-level Coherence Evaluation for Multilingual Dialogues John Mendonça Isabel Trancoso A. Lavie 29 3 0 16 Jul 2024
A Survey on Symbolic Knowledge Distillation of Large Language Models Kamal Acharya Alvaro Velasquez H. Song SyDa 29 4 0 12 Jul 2024
Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometrics Seungbeen Lee Seungwon Lim Seungju Han Giyeong Oh Hyungjoo Chae ... Beong-woo Kwak Yeonsoo Lee Dongha Lee Jinyoung Yeo Youngjae Yu 33 8 0 20 Jun 2024
Are LLMs classical or nonmonotonic reasoners? Lessons from generics Alina Leidinger R. Rooij Ekaterina Shutova LRM 26 3 0 05 Jun 2024
Grounding Data Science Code Generation with Input-Output Specifications Yeming Wen Pengcheng Yin Kensen Shi Henryk Michalewski Swarat Chaudhuri A. Polozov SyDa 22 10 0 12 Feb 2024
CANDLE: Iterative Conceptualization and Instantiation Distillation from Large Language Models for Commonsense Reasoning Weiqi Wang Tianqing Fang Chunyang Li Haochen Shi Wenxuan Ding ... Jiaxin Bai Xin Liu Cheng Jiayang Chunkit Chan Yangqiu Song LRM 20 27 0 14 Jan 2024
Towards Consistent Language Models Using Declarative Constraints Jasmin Mousavi Arash Termehchy HILM ALM 17 2 0 24 Dec 2023
NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation Peter West Ronan Le Bras Taylor Sorensen Bill Yuchen Lin Liwei Jiang ... Khyathi Raghavi Chandu Jack Hessel Ashutosh Baheti Chandra Bhagavatula Yejin Choi VLM 21 10 0 10 Dec 2023
Localized Symbolic Knowledge Distillation for Visual Commonsense Models J. Park Jack Hessel Khyathi Raghavi Chandu Paul Pu Liang Ximing Lu ... Youngjae Yu Qiuyuan Huang Jianfeng Gao Ali Farhadi Yejin Choi VLM 16 11 0 08 Dec 2023
NeuroPrompts: An Adaptive Framework to Optimize Prompts for Text-to-Image Generation Shachar Rosenman Vasudev Lal Phillip Howard DiffM 24 4 0 20 Nov 2023
Fine-Tuning Language Models Using Formal Methods Feedback Yunhao Yang N. Bhatt Tyler Ingebrand William Ward Steven Carr Zhangyang Wang Ufuk Topcu 19 8 0 27 Oct 2023
Generative AI vs. AGI: The Cognitive Strengths and Weaknesses of Modern LLMs Ben Goertzel 22 12 0 19 Sep 2023
Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties Taylor Sorensen Liwei Jiang Jena D. Hwang Sydney Levine Valentina Pyatkin ... Kavel Rao Chandra Bhagavatula Maarten Sap J. Tasioulas Yejin Choi SLR 11 50 0 02 Sep 2023
Translate Meanings, Not Just Words: IdiomKB's Role in Optimizing Idiomatic Translation with Language Models Shuang Li Jiangjie Chen Siyu Yuan Xinyi Wu Hao Yang Shimin Tao Yanghua Xiao 38 15 0 26 Aug 2023
Symbolic Chain-of-Thought Distillation: Small Models Can Also "Think" Step-by-Step Liunian Harold Li Jack Hessel Youngjae Yu Xiang Ren Kai-Wei Chang Yejin Choi LRM AI4CE ReLM 22 127 0 24 Jun 2023
PlaSma: Making Small Language Models Better Procedural Knowledge Models for (Counterfactual) Planning Faeze Brahman Chandra Bhagavatula Valentina Pyatkin Jena D. Hwang Xiang Lorraine Li H. J. Arai Soumya Sanyal Keisuke Sakaguchi Xiang Ren Yejin Choi LRM 21 0 0 31 May 2023
Learning from Mistakes via Cooperative Study Assistant for Large Language Models Danqing Wang Lei Li 23 6 0 23 May 2023
NeuroComparatives: Neuro-Symbolic Distillation of Comparative Knowledge Phillip Howard Junlin Wang Vasudev Lal Gadi Singer Yejin Choi Swabha Swayamdipta 32 9 0 08 May 2023
Vera: A General-Purpose Plausibility Estimation Model for Commonsense Statements Jiacheng Liu Wenya Wang Dianzhuo Wang Noah A. Smith Yejin Choi Hannaneh Hajishirzi VLM 39 48 0 05 May 2023
Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization Mutian He Tianqing Fang Weiqi Wang Yangqiu Song 33 29 0 03 Jun 2022
Penguins Don't Fly: Reasoning about Generics through Instantiations and Exceptions Emily Allaway Jena D. Hwang Chandra Bhagavatula Kathleen McKeown Doug Downey Yejin Choi LRM 42 20 0 23 May 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 303 11,881 0 04 Mar 2022
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 226 4,424 0 23 Jan 2020