Papers citing "Evaluating Large Language Models Trained on Code"

50 / 908 papers shown

Title
Evaluating the Ripple Effects of Knowledge Editing in Language Models Roi Cohen Eden Biran Ori Yoran Amir Globerson Mor Geva KELM 42 155 0 24 Jul 2023
Llama 2: Open Foundation and Fine-Tuned Chat Models Hugo Touvron Louis Martin Kevin R. Stone Peter Albert Amjad Almahairi ... Sharan Narang Aurelien Rodriguez Robert Stojnic Sergey Edunov Thomas Scialom AI4MH ALM 93 11,004 0 18 Jul 2023
COLLIE: Systematic Construction of Constrained Text Generation Tasks Shunyu Yao Howard Chen Austin W. Hanjie Runzhe Yang Karthik Narasimhan 44 32 0 17 Jul 2023
Extending the Frontier of ChatGPT: Code Generation and Debugging Fardin Ahsan Sakib Saadat Hasan Khan A. Karim ALM LLMAG ELM 21 41 0 17 Jul 2023
A Lightweight Framework for High-Quality Code Generation Mohammed Latif Siddiq B.K. Casey Joanna C. S. Santos 41 17 0 17 Jul 2023
Mini-Giants: "Small" Language Models and Open Source Win-Win Zhengping Zhou Lezhi Li Xinxi Chen Andy Li SyDa ALM MoE 26 6 0 17 Jul 2023
Deduplicating and Ranking Solution Programs for Suggesting Reference Solutions Atsushi Shirafuji Yutaka Watanobe 24 1 0 16 Jul 2023
Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Text Zhun Yang Adam Ishay Joohyung Lee LRM ELM 33 51 0 15 Jul 2023
Image Transformation Sequence Retrieval with General Reinforcement Learning Enrique Mas-Candela Antonio Ríos-Vila Jorge Calvo-Zaragoza 22 0 0 13 Jul 2023
Explaining Competitive-Level Programming Solutions using LLMs Jierui Li Szymon Tworkowski Yingying Wu Raymond J. Mooney LRM 31 16 0 11 Jul 2023
Large Language Models as General Pattern Machines Suvir Mirchandani F. Xia Peter R. Florence Brian Ichter Danny Driess Montse Gonzalez Arenas Kanishka Rao Dorsa Sadigh Andy Zeng LLMAG 51 184 0 10 Jul 2023
COMEX: A Tool for Generating Customized Source Code Representations Debeshee Das N. Mathews Alex Mathai Srikanth G. Tamilselvam Kranthi Sedamaki S. Chimalakonda Atul Kumar VLM 18 5 0 10 Jul 2023
ChatGPT in the Age of Generative AI and Large Language Models: A Concise Survey S. Mohamadi G. Mujtaba Ngan Le Gianfranco Doretto Don Adjeroh LM&MA AI4MH 23 21 0 09 Jul 2023
Copilot for Xcode: Exploring AI-Assisted Programming by Prompting Cloud-based Large Language Models C. Tan Shangxin Guo M. Wong Ching Nam Hang 24 10 0 08 Jul 2023
Large Language Models as Batteries-Included Zero-Shot ESCO Skills Matchers Benjamin Clavié Guillaume Soulié 26 11 0 07 Jul 2023
Exploring Continual Learning for Code Generation Models Prateek Yadav Q. Sun Hantian Ding Xiaopeng Li Dejiao Zhang ... Parminder Bhatia Ramesh Nallapati M. K. Ramanathan Mohit Bansal Bing Xiang CLL 37 30 0 05 Jul 2023
Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review M. Wong Shangxin Guo Ching Nam Hang Siu-Wai Ho C. Tan 42 78 0 04 Jul 2023
Personality Traits in Large Language Models Gregory Serapio-García Mustafa Safdari Clément Crepy Luning Sun Stephen Fitz P. Romero Marwa Abdulhai Aleksandra Faust Maja J. Matarić LM&MA LLMAG 58 119 0 01 Jul 2023
Is Pre-training Truly Better Than Meta-Learning? Brando Miranda P. Yu Saumya Goyal Yu-xiong Wang Oluwasanmi Koyejo 44 5 0 24 Jun 2023
Is Self-Repair a Silver Bullet for Code Generation? Theo X. Olausson J. Inala Chenglong Wang Jianfeng Gao Armando Solar-Lezama LRM 26 108 0 16 Jun 2023
Investigating Prompting Techniques for Zero- and Few-Shot Visual Question Answering Rabiul Awal Le Zhang Aishwarya Agrawal LRM 38 12 0 16 Jun 2023
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena Lianmin Zheng Wei-Lin Chiang Ying Sheng Siyuan Zhuang Zhanghao Wu ... Dacheng Li Eric P. Xing Haotong Zhang Joseph E. Gonzalez Ion Stoica ALM OSLM ELM 19 3,802 0 09 Jun 2023
Solving Novel Program Synthesis Problems with Genetic Programming using Parametric Polymorphism Edward R. Pantridge Thomas Helmuth 9 6 0 08 Jun 2023
World Models for Math Story Problems Andreas Opedal Niklas Stoehr Abulhair Saparov Mrinmaya Sachan ReLM 36 12 0 07 Jun 2023
SelfEvolve: A Code Evolution Framework via Large Language Models Shuyang Jiang Yuhao Wang Yu Wang 16 32 0 05 Jun 2023
Explanation Graph Generation via Generative Pre-training over Synthetic Graphs H. Cui Sha Li Yu Zhang Qi Shi 11 1 0 01 Jun 2023
The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Code Xiao Liu Da Yin Chen Zhang Yansong Feng Dongyan Zhao ELM ReLM ReCod LRM 32 20 0 30 May 2023
How Effective Are Neural Networks for Fixing Security Vulnerabilities Yi Wu Nan Jiang H. Pham Thibaud Lutellier Jordan Davis Lin Tan Petr Babkin Sameena Shah AAML 19 78 0 29 May 2023
Integrating Action Knowledge and LLMs for Task Planning and Situation Handling in Open Worlds Yan Ding Xiaohan Zhang S. Amiri Nieqing Cao Hao Yang Andy Kaminski Chad Esselink Shiqi Zhang LM&Ro 32 49 0 27 May 2023
FERMAT: An Alternative to Accuracy for Numerical Reasoning Jasivan Sivakumar N. Moosavi ReLM LRM 37 3 0 27 May 2023
Playing repeated games with Large Language Models Elif Akata Lion Schulz Julian Coda-Forno Seong Joon Oh Matthias Bethge Eric Schulz 413 122 0 26 May 2023
On the Tool Manipulation Capability of Open-source Large Language Models Qiantong Xu Fenglu Hong B. Li Changran Hu Zheng Chen Jian Zhang LLMAG 24 68 0 25 May 2023
Coarse-Tuning Models of Code with Reinforcement Learning Feedback Abhinav C. P. Jain Chima Adiole Swarat Chaudhuri Thomas W. Reps Chris Jermaine Rice University ALM 19 2 0 25 May 2023
The False Promise of Imitating Proprietary LLMs Arnav Gudibande Eric Wallace Charles Burton Snell Xinyang Geng Hao Liu Pieter Abbeel Sergey Levine Dawn Song ALM 44 196 0 25 May 2023
Large Language Models are Few-Shot Health Learners Xin Liu Daniel J. McDuff G. Kovács I. Galatzer-Levy Jacob Sunshine Jiening Zhan M. Poh Shun Liao P. Achille Shwetak N. Patel LM&MA AI4MH 34 99 0 24 May 2023
Uncovering and Quantifying Social Biases in Code Generation Y. Liu Xiaokang Chen Yan Gao Zhe Su Fengji Zhang Daoguang Zan Jian-Guang Lou Pin-Yu Chen Tsung-Yi Ho 36 19 0 24 May 2023
Tricking LLMs into Disobedience: Formalizing, Analyzing, and Detecting Jailbreaks Abhinav Rao S. Vashistha Atharva Naik Somak Aditya Monojit Choudhury 30 17 0 24 May 2023
A New Era in Software Security: Towards Self-Healing Software via Large Language Models and Formal Verification Norbert Tihanyi Ridhi Jain Yiannis Charalambous M. Ferrag Youcheng Sun Lucas C. Cordeiro 23 48 0 24 May 2023
ALGO: Synthesizing Algorithmic Programs with LLM-Generated Oracle Verifiers Kexun Zhang Danqing Wang Jingtao Xia William Yang Wang Lei Li 30 40 0 24 May 2023
IdealGPT: Iteratively Decomposing Vision and Language Reasoning via Large Language Models Haoxuan You Rui Sun Zhecan Wang Long Chen Gengyu Wang Hammad A. Ayyubi Kai-Wei Chang Shih-Fu Chang VLM MLLM LRM 46 43 0 24 May 2023
Better Zero-Shot Reasoning with Self-Adaptive Prompting Xingchen Wan Ruoxi Sun H. Dai Sercan Ö. Arik Tomas Pfister ReLM OffRL LRM 18 48 0 23 May 2023
OlaGPT: Empowering LLMs With Human-like Problem-Solving Abilities Yuanzhen Xie Tao Xie Mingxiong Lin Wen-Ke Wei Chenglin Li Beibei Kong Lei Chen Chengxiang Zhuo Bo Hu Zang Li RALM LLMAG LRM 24 6 0 23 May 2023
Knowledge of Knowledge: Exploring Known-Unknowns Uncertainty with Large Language Models Alfonso Amayuelas Kyle Wong Liangming Pan Wenhu Chen W. Wang 37 26 0 23 May 2023
Neural Machine Translation for Code Generation K. Dharma Clayton T. Morrison 32 4 0 22 May 2023
Fact-Checking Complex Claims with Program-Guided Reasoning Liangming Pan Xiaobao Wu Xinyuan Lu A. Luu William Yang Wang Min-Yen Kan Preslav Nakov LRM 32 116 0 22 May 2023
BertRLFuzzer: A BERT and Reinforcement Learning Based Fuzzer Piyush Jha Joseph Scott Jaya Sriram Ganeshna M. Singh Vijay Ganesh 16 5 0 21 May 2023
TheoremQA: A Theorem-driven Question Answering dataset Wenhu Chen Ming Yin Max W.F. Ku Pan Lu Yixin Wan Xueguang Ma Jianyu Xu Xinyi Wang Tony Xia AIMat 38 117 0 21 May 2023
SLaDe: A Portable Small Language Model Decompiler for Optimized Assembly Jordi Armengol-Estapé Jackson Woodruff Chris Cummins Michael F. P. O'Boyle 45 15 0 21 May 2023
Description-Based Text Similarity Shauli Ravfogel Valentina Pyatkin Amir D. N. Cohen Avshalom Manevich Yoav Goldberg 25 5 0 21 May 2023
AI-assisted Code Authoring at Scale: Fine-tuning, deploying, and mixed methods evaluation V. Murali C. Maddila Imad Ahmad Michael Bolin Daniel Cheng Negar Ghorbani Renuka Fernandez Nachiappan Nagappan Peter C. Rigby 16 14 0 20 May 2023