Learning to Execute Actions or Ask Clarification Questions

18 April 2022

Papers citing "Learning to Execute Actions or Ask Clarification Questions"

29 / 29 papers shown

Title
RACQUET: Unveiling the Dangers of Overlooked Referential Ambiguity in Visual LLMs A. Testoni Barbara Plank Raquel Fernández 62 0 0 18 Dec 2024
A Survey of Conversational Search Fengran Mo Kelong Mao Ziliang Zhao Hongjin Qian Haonan Chen Yiruo Cheng X. Li Y. X. Zhu Zhicheng Dou Jian-Yun Nie KELM 32 3 0 21 Oct 2024
Repairs in a Block World: A New Benchmark for Handling User Corrections with Multi-Modal Language Models Javier Chiyah-Garcia Alessandro Suglia Arash Eshghi KELM 24 1 0 21 Sep 2024
ArchCode: Incorporating Software Requirements in Code Generation with Large Language Models Hojae Han Jaejin Kim Jaeseok Yoo Youngwon Lee Seung-won Hwang 19 0 0 02 Aug 2024
NeBuLa: A discourse aware Minecraft Builder Akshay Chaturvedi Kate Thompson Nicholas Asher 18 2 0 26 Jun 2024
Retrieval-Augmented Code Generation for Situated Action Generation: A Case Study on Minecraft Chalamalasetti Kranti Sherzod Hakimov David Schlangen 19 1 0 25 Jun 2024
Instruction Tuning With Loss Over Instructions Zhengyan Shi Adam X. Yang Bin Wu Laurence Aitchison Emine Yilmaz Aldo Lipani ALM 19 19 0 23 May 2024
It Couldn't Help But Overhear: On the Limits of Modelling Meta-Communicative Grounding Acts with Supervised Learning Brielen Madureira David Schlangen 30 0 0 02 May 2024
Tell Me More! Towards Implicit User Intention Understanding of Language Model Driven Agents Cheng Qian Bingxiang He Zhuang Zhong Jia Deng Yujia Qin ... Zhong Zhang Jie Zhou Yankai Lin Zhiyuan Liu Maosong Sun 20 27 0 14 Feb 2024
Large Language Models as Minecraft Agents Chris Madge Massimo Poesio LLMAG 19 6 0 13 Feb 2024
Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questions A. Testoni Raquel Fernández 14 10 0 09 Feb 2024
Improving Agent Interactions in Virtual Environments with Language Models Jack Zhang LLMAG 11 0 0 08 Feb 2024
Taking Action Towards Graceful Interaction: The Effects of Performing Actions on Modelling Policies for Instruction Clarification Requests Brielen Madureira David Schlangen 24 2 0 30 Jan 2024
Lexical Entrainment for Conversational Systems Zhengxiang Shi Procheta Sen Aldo Lipani 23 1 0 14 Oct 2023
DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning Zhengxiang Shi Aldo Lipani VLM 13 30 0 11 Sep 2023
'What are you referring to?' Evaluating the Ability of Multi-Modal Dialogue Models to Process Clarificational Exchanges Javier Chiyah-Garcia Alessandro Suglia Arash Eshghi Helen F. Hastie 14 6 0 28 Jul 2023
Towards a Neural Era in Dialogue Management for Collaboration: A Literature Survey Amogh Mannekote LLMAG 6 3 0 18 Jul 2023
Solving Dialogue Grounding Embodied Task in a Simulated Environment using Further Masked Language Modeling Weijie Zhang 12 0 0 21 Jun 2023
Rethink the Effectiveness of Text Data Augmentation: An Empirical Analysis Zhengxiang Shi Aldo Lipani 19 2 0 13 Jun 2023
"Are you telling me to put glasses on the dog?'' Content-Grounded Annotation of Instruction Clarification Requests in the CoDraw Dataset Brielen Madureira David Schlangen 6 3 0 04 Jun 2023
Self Contrastive Learning for Session-based Recommendation Zhengxiang Shi Xi Wang Aldo Lipani 14 5 0 02 Jun 2023
R2H: Building Multimodal Navigation Helpers that Respond to Help Requests Yue Fan Jing Gu Kaizhi Zheng Xin Eric Wang 24 4 0 23 May 2023
Rethinking Semi-supervised Learning with Language Models Zhengxiang Shi Francesco Tonolini Nikolaos Aletras Emine Yilmaz G. Kazai Yunlong Jiao 15 17 0 22 May 2023
When and What to Ask Through World States and Text Instructions: IGLU NLP Challenge Solution Zhengxiang Shi Jerome Ramos To Eun Kim Xi Wang Hossein A. Rahmani Aldo Lipani 14 10 0 09 May 2023
Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner Zhengxiang Shi Aldo Lipani VLM CLL 27 21 0 02 May 2023
Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedback Nikhil Mehta Milagro Teruel Patricio Figueroa Sanz Xinwei Deng Ahmed Hassan Awadallah Julia Kiseleva LLMAG 27 20 0 21 Apr 2023
Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw Dataset Brielen Madureira David Schlangen 25 10 0 28 Feb 2023
Attention-based Ingredient Phrase Parser Zhengxiang Shi Pin Ni Meihui Wang To Eun Kim Aldo Lipani 4 1 0 05 Oct 2022
Help, Anna! Visual Navigation with Natural Multimodal Assistance via Retrospective Curiosity-Encouraging Imitation Learning Khanh Nguyen Hal Daumé LM&Ro EgoV 178 148 0 04 Sep 2019