Large Language Models as General Pattern Machines

10 July 2023

Montse Gonzalez Arenas

Dorsa Sadigh

Papers citing "Large Language Models as General Pattern Machines"

50 / 154 papers shown

Title
Affordance-Guided Reinforcement Learning via Visual Prompting Olivia Y. Lee Annie Xie Kuan Fang Karl Pertsch Chelsea Finn OffRL LM&Ro 62 7 0 14 Jul 2024
Commonsense Reasoning for Legged Robot Adaptation with Vision-Language Models Annie S. Chen Alec M. Lessing Andy Tang Govind Chada Laura Smith Sergey Levine Chelsea Finn LM&Ro LRM 26 8 0 02 Jul 2024
SADL: An Effective In-Context Learning Method for Compositional Visual QA Long Hoang Dang T. Le Vuong Le Tu Minh Phuong Truyen Tran ReLM CoGe 33 2 0 02 Jul 2024
Learning Modality Knowledge Alignment for Cross-Modality Transfer Wenxuan Ma Shuang Li Lincan Cai Jingxuan Kang 19 1 0 27 Jun 2024
LICO: Large Language Models for In-Context Molecular Optimization Tung Nguyen Aditya Grover 23 6 0 27 Jun 2024
Open-vocabulary Pick and Place via Patch-level Semantic Maps Mingxi Jia Haojie Huang Zhewen Zhang Chenghao Wang Linfeng Zhao Dian Wang J. Liu Robin Walters Robert Platt Stefanie Tellex LM&Ro 29 5 0 21 Jun 2024
Effective Generative AI: The Human-Algorithm Centaur S. Saghafian Lihi Idan 32 3 0 16 Jun 2024
Off-Policy Evaluation from Logged Human Feedback Aniruddha Bhargava Lalit P. Jain B. Kveton Ge Liu Subhojyoti Mukherjee OffRL 26 2 0 14 Jun 2024
XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learning Alexander Nikulin Ilya Zisman Alexey Zemtsov Viacheslav Sinii 89 4 0 13 Jun 2024
LLM-Craft: Robotic Crafting of Elasto-Plastic Objects with Large Language Models Alison Bartsch A. Farimani 70 6 0 12 Jun 2024
LLM-Enhanced Bayesian Optimization for Efficient Analog Layout Constraint Generation Guojin Chen Keren Zhu Seunggeun Kim Hanqing Zhu Yao Lai Bei Yu David Z. Pan 16 6 0 07 Jun 2024
Pretraining Decision Transformers with Reward Prediction for In-Context Multi-task Structured Bandit Learning Subhojyoti Mukherjee Josiah P. Hanna Qiaomin Xie Robert Nowak 50 2 0 07 Jun 2024
Open-Endedness is Essential for Artificial Superhuman Intelligence Edward Hughes Michael Dennis Jack Parker-Holder Feryal M. P. Behbahani Aditi Mavalankar Yuge Shi Tom Schaul Tim Rocktaschel LRM 32 18 0 06 Jun 2024
Controlling Large Language Model Agents with Entropic Activation Steering Nate Rahn P. DÓro Marc G. Bellemare LLMSV 16 6 0 01 Jun 2024
Metaheuristics and Large Language Models Join Forces: Toward an Integrated Optimization Approach Camilo Chacón Sartori Christian Blum Filippo Bistaffa Guillem Rodríguez Corominas AIFin 37 3 0 28 May 2024
What is it for a Machine Learning Model to Have a Capability? Jacqueline Harding Nathaniel Sharadin ELM 18 3 0 14 May 2024
Toward Automated Programming for Robotic Assembly Using ChatGPT Annabella Macaluso Nicholas Cote Sachin Chitta 17 3 0 13 May 2024
The Platonic Representation Hypothesis Minyoung Huh Brian Cheung Tongzhou Wang Phillip Isola 72 107 0 13 May 2024
Philosophy of Cognitive Science in the Age of Deep Learning Raphaël Millière AI4CE NAI 28 3 0 07 May 2024
A Philosophical Introduction to Language Models - Part II: The Way Forward Raphael Milliere Cameron Buckner LRM 37 11 0 06 May 2024
Large Language Models estimate fine-grained human color-concept associations Kushin Mukherjee Timothy T. Rogers Karen B. Schloss VLM 27 2 0 04 May 2024
In-Context Symbolic Regression: Leveraging Large Language Models for Function Discovery Matteo Merler Katsiaryna Haitsiukevich Nicola Dainese Pekka Marttinen 26 6 0 29 Apr 2024
Large Language Models as In-context AI Generators for Quality-Diversity Bryan Lim Manon Flageat Antoine Cully 19 4 0 24 Apr 2024
SemEval-2024 Task 9: BRAINTEASER: A Novel Task Defying Common Sense Yifan Jiang Filip Ilievski Kaixin Ma LRM 25 30 0 22 Apr 2024
Experimental Design for Active Transductive Inference in Large Language Models Subhojyoti Mukherjee Anusha Lalitha Aniket Deshmukh Ge Liu Yifei Ma B. Kveton LRM 30 1 0 12 Apr 2024
From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examples Robert Vacareanu Vlad-Andrei Negru Vasile Suciu Mihai Surdeanu 21 4 0 11 Apr 2024
GenCHiP: Generating Robot Policy Code for High-Precision and Contact-Rich Manipulation Tasks Kaylee Burns Ajinkya Jain Keegan Go Fei Xia Michael Stark S. Schaal Karol Hausman 24 4 0 09 Apr 2024
PREGO: online mistake detection in PRocedural EGOcentric videos Alessandro Flaborea Guido Maria DÁmely di Melendugno Leonardo Plini Luca Scofano Edoardo De Matteis Antonino Furnari G. Farinella Fabio Galasso EgoV 43 11 0 02 Apr 2024
ZeroCAP: Zero-Shot Multi-Robot Context Aware Pattern Formation via Large Language Models Vishnunandan L. N. Venkatesh Byung-Cheol Min LM&Ro 56 1 0 02 Apr 2024
Zero-shot Safety Prediction for Autonomous Robots with Foundation World Models Zhenjiang Mao Siqi Dai Yuang Geng Ivan Ruchkin 22 3 0 30 Mar 2024
LLMSense: Harnessing LLMs for High-level Reasoning Over Spatiotemporal Sensor Traces Xiaomin Ouyang Mani B. Srivastava LRM 19 17 0 28 Mar 2024
Improving Text-to-Image Consistency via Automatic Prompt Optimization Oscar Manas Pietro Astolfi Melissa Hall Candace Ross Jack Urbanek Adina Williams Aishwarya Agrawal Adriana Romero Soriano M. Drozdzal 26 26 0 26 Mar 2024
ReAct Meets ActRe: When Language Agents Enjoy Training Data Autonomy Zonghan Yang Peng Li Ming Yan Ji Zhang Fei Huang Yang Janet Liu LLMAG LRM 31 7 0 21 Mar 2024
Reasoning Abilities of Large Language Models: In-Depth Analysis on the Abstraction and Reasoning Corpus Seungpil Lee Woochang Sim Donghyeon Shin Sanha Hwang Wongyu Seo Jiwon Park Seokki Lee Sejin Kim Sundong Kim LRM 29 19 0 18 Mar 2024
LLM3:Large Language Model-based Task and Motion Planning with Motion Failure Reasoning Shu Wang Muzhi Han Ziyuan Jiao Zeyu Zhang Yingnian Wu Song-Chun Zhu Hangxin Liu LRM 27 32 0 18 Mar 2024
RLingua: Improving Reinforcement Learning Sample Efficiency in Robotic Manipulations With Large Language Models Liangliang Chen Yutian Lei Shiyu Jin Ying Zhang Liangjun Zhang LM&Ro 30 8 0 11 Mar 2024
ItD: Large Language Models Can Teach Themselves Induction through Deduction Wangtao Sun Haotian Xu Xuanqing Yu Pei Chen Shizhu He Jun Zhao Kang Liu LRM 17 5 0 09 Mar 2024
A Survey on Human-AI Teaming with Large Pre-Trained Models Vanshika Vats Marzia Binta Nizam Minghao Liu Ziyuan Wang Richard Ho ... Celeste Shen Rachel Shen Nafisa Hussain Kesav Ravichandran James Davis LM&MA 28 8 0 07 Mar 2024
ReMatch: Retrieval Enhanced Schema Matching with LLMs Eitam Sheetrit Menachem Brief Moshik Mishaeli Oren Elisha 16 2 0 03 Mar 2024
Towards Modeling Learner Performance with Large Language Models Seyed Parsa Neshaei Richard Lee Davis Adam Hazimeh Bojan Lazarevski Pierre Dillenbourg Tanja Kaser AI4Ed 28 5 0 29 Feb 2024
Linear Transformers are Versatile In-Context Learners Max Vladymyrov J. Oswald Mark Sandler Rong Ge 16 13 0 21 Feb 2024
Learning to Learn Faster from Human Feedback with Language Model Predictive Control Jacky Liang Fei Xia Wenhao Yu Andy Zeng Montse Gonzalez Arenas ... N. Heess Kanishka Rao Nik Stewart Jie Tan Carolina Parada LM&Ro 39 28 0 18 Feb 2024
PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs Soroush Nasiriany Fei Xia Wenhao Yu Ted Xiao Jacky Liang ... Karol Hausman N. Heess Chelsea Finn Sergey Levine Brian Ichter LM&Ro LRM 15 88 0 12 Feb 2024
Towards Unified Alignment Between Agents, Humans, and Environment Zonghan Yang An Liu Zijun Liu Kai Liu Fangzhou Xiong ... Zhenhe Zhang Fuwen Luo Zhicheng Guo Peng Li Yang Liu 16 4 0 12 Feb 2024
Real-World Robot Applications of Foundation Models: A Review Kento Kawaharazuka T. Matsushima Andrew Gambardella Jiaxian Guo Chris Paxton Andy Zeng OffRL VLM LM&Ro 35 11 0 08 Feb 2024
CodeIt: Self-Improving Language Models with Prioritized Hindsight Replay Natasha Butt Blazej Manczak Auke Wiggers Corrado Rainone David W. Zhang Michaël Defferrard Taco S. Cohen ReLM LRM 46 17 0 07 Feb 2024
Fine-Tuned Language Models Generate Stable Inorganic Materials as Text Nate Gruver Anuroop Sriram Andrea Madotto A. Wilson C. L. Zitnick Zachary W. Ulissi 9 53 0 06 Feb 2024
Large Language Models to Enhance Bayesian Optimization Tennison Liu Nicolás Astorga Nabeel Seedat M. Schaar 53 44 0 06 Feb 2024
RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agents Tomoyuki Kagaya Thong Jing Yuan Yuxuan Lou J. Karlekar Sugiri Pranata Akira Kinose Koki Oguri Felix Wick Yang You LLMAG 49 32 0 06 Feb 2024
Position: What Can Large Language Models Tell Us about Time Series Analysis Ming Jin Yifan Zhang Wei Chen Kexin Zhang Yuxuan Liang Bin Yang Jindong Wang Shirui Pan Qingsong Wen AI4TS 26 16 0 05 Feb 2024