Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning

20 March 2017

Papers citing "Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning"

50 / 228 papers shown

Title
Towards Deep Conversational Recommendations Raymond Li Samira Ebrahimi Kahou Hannes Schulz Vincent Michalski Laurent Charlin C. Pal 18 366 0 18 Dec 2018
From FiLM to Video: Multi-turn Question Answering with Multi-modal Context T. Nguyen Shikhar Sharma Hannes Schulz Layla El Asri 12 33 0 17 Dec 2018
Visual Dialogue without Vision or Dialogue Daniela Massiceti P. Dokania N. Siddharth Philip H. S. Torr 14 32 0 16 Dec 2018
What's to know? Uncertainty as a Guide to Asking Goal-oriented Questions Ehsan Abbasnejad Qi Wu Javen Qinfeng Shi A. Hengel 11 20 0 16 Dec 2018
Gold Seeker: Information Gain from Policy Distributions for Goal-oriented Vision-and-Langauge Reasoning Ehsan Abbasnejad Iman Abbasnejad Qi Wu Javen Qinfeng Shi A. Hengel OffRL 22 5 0 16 Dec 2018
Counterfactual Critic Multi-Agent Training for Scene Graph Generation Long Chen Hanwang Zhang Jun Xiao Xiangnan He Shiliang Pu Shih-Fu Chang 14 159 0 06 Dec 2018
Semantic bottleneck for computer vision tasks Apostolos Modas Seyed-Mohsen Moosavi-Dezfooli P. Frossard 6 15 0 06 Nov 2018
Out of the Box: Reasoning with Graph Convolution Nets for Factual Visual Question Answering Medhini Narasimhan Svetlana Lazebnik A. Schwing NAI GNN ReLM 10 11 0 01 Nov 2018
TarMAC: Targeted Multi-Agent Communication Abhishek Das Théophile Gervet Joshua Romoff Dhruv Batra Devi Parikh Michael G. Rabbat Joelle Pineau 19 378 0 26 Oct 2018
Deep Reinforcement Learning Yuxi Li VLM OffRL 23 144 0 15 Oct 2018
Efficient Dialog Policy Learning via Positive Memory Retention Rui Zhao Volker Tresp 12 10 0 02 Oct 2018
Refining Manually-Designed Symbol Grounding and High-Level Planning by Policy Gradients Takuya Hiraoka Takashi Onishi Takahisa Imagawa Yoshimasa Tsuruoka 6 2 0 29 Sep 2018
Beyond task success: A closer look at jointly learning to see, ask, and GuessWhat Ravi Shekhar Aashish Venkatesh Tim Baumgärtner Elia Bruni Barbara Plank Raffaella Bernardi Raquel Fernández 8 51 0 10 Sep 2018
Visual Coreference Resolution in Visual Dialog using Neural Module Networks Satwik Kottur José M. F. Moura Devi Parikh Dhruv Batra Marcus Rohrbach 16 164 0 06 Sep 2018
Live Video Comment Generation Based on Surrounding Frames and Live Comments Damai Dai VGen 6 0 0 13 Aug 2018
Community Regularization of Visually-Grounded Dialog Akshat Agarwal Swaminathan Gurumurthy Vasu Sharma M. Lewis Katia P. Sycara 18 10 0 10 Aug 2018
Backplay: "Man muss immer umkehren" Cinjon Resnick R. Raileanu Sanyam Kapoor Alex Peysakhovich Kyunghyun Cho Joan Bruna OffRL 20 45 0 18 Jul 2018
The Bottleneck Simulator: A Model-based Deep Reinforcement Learning Approach Iulian Serban Chinnadhurai Sankar Michael Pieper Joelle Pineau Yoshua Bengio OffRL 12 29 0 12 Jul 2018
Talk the Walk: Navigating New York City through Grounded Dialogue H. D. Vries Kurt Shuster Dhruv Batra Devi Parikh Jason Weston Douwe Kiela 13 124 0 09 Jul 2018
Memory Augmented Policy Optimization for Program Synthesis and Semantic Parsing Chen Liang Mohammad Norouzi Jonathan Berant Quoc V. Le Ni Lao 6 134 0 06 Jul 2018
Learning Goal-Oriented Visual Dialog via Tempered Policy Gradient Rui Zhao Volker Tresp LLMAG 12 14 0 02 Jul 2018
Learning Existing Social Conventions via Observationally Augmented Self-Play Adam Lerer A. Peysakhovich OffRL 9 2 0 26 Jun 2018
End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features Chiori Hori Huda AlAmri Jue Wang G. Wichern Takaaki Hori ... Raphael Gontijo-Lopes Abhishek Das Irfan Essa Dhruv Batra Devi Parikh VGen 16 125 0 21 Jun 2018
iParaphrasing: Extracting Visually Grounded Paraphrases via an Image Chenhui Chu Mayu Otani Yuta Nakashima 12 8 0 12 Jun 2018
Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7 Huda AlAmri Vincent Cartillier Raphael Gontijo-Lopes Abhishek Das Jue Wang ... Dhruv Batra Devi Parikh A. Cherian Tim K. Marks Chiori Hori 9 32 0 01 Jun 2018
Variational Inference for Data-Efficient Model Learning in POMDPs Sebastian Tschiatschek Kai Arulkumaran Jan Stühmer Katja Hofmann 9 15 0 23 May 2018
Ask No More: Deciding when to guess in referential visual dialogue Ravi Shekhar Tim Baumgärtner Aashish Venkatesh Elia Bruni Raffaella Bernardi Raquel Fernández 15 21 0 17 May 2018
Multimodal Hierarchical Reinforcement Learning Policy for Task-Oriented Visual Dialog Jiaping Zhang Tiancheng Zhao Zhou Yu 4 39 0 08 May 2018
Dialog-based Interactive Image Retrieval Xiaoxiao Guo Hui Wu Yu Cheng Steven J. Rennie Gerald Tesauro Rogerio Feris 48 204 0 01 May 2018
Modeling Psychotherapy Dialogues with Kernelized Hashcode Representations: A Nonparametric Information-Theoretic Approach S. Garg Irina Rish Guillermo Cecchi Palash Goyal Sarik Ghazarian Shuyang Gao Greg Ver Steeg Aram Galstyan 19 0 0 26 Apr 2018
Interactive Language Acquisition with One-shot Visual Concept Learning through a Conversational Game Haichao Zhang Haonan Yu W. Xu LLMAG 33 8 0 26 Apr 2018
Vehicle Communication Strategies for Simulated Highway Driving Cinjon Resnick I. Kulikov Kyunghyun Cho Jason Weston 12 7 0 19 Apr 2018
Outline Objects using Deep Reinforcement Learning Zhenxin Wang S. Sarcar Jingxin Liu Yilin Zheng Xiangshi Ren SSeg 6 7 0 10 Apr 2018
Two can play this Game: Visual Dialog with Discriminative Question Generation and Answering Unnat Jain Svetlana Lazebnik A. Schwing MLLM 19 81 0 29 Mar 2018
Deep Communicating Agents for Abstractive Summarization Asli Celikyilmaz Antoine Bosselut Xiaodong He Yejin Choi AI4CE 8 305 0 27 Mar 2018
Discriminability objective for training descriptive captions Ruotian Luo Brian L. Price Scott D. Cohen Gregory Shakhnarovich 8 202 0 12 Mar 2018
Modeling Others using Oneself in Multi-Agent Reinforcement Learning Roberta Raileanu Emily L. Denton Arthur Szlam Rob Fergus 12 200 0 26 Feb 2018
Answerer in Questioner's Mind: Information Theoretic Approach to Goal-Oriented Visual Dialog Sang-Woo Lee Y. Heo Byoung-Tak Zhang 20 30 0 12 Feb 2018
FlipDial: A Generative Model for Two-Way Visual Dialogue Daniela Massiceti N. Siddharth P. Dokania Philip H. S. Torr MLLM 19 41 0 11 Feb 2018
Building Generalizable Agents with a Realistic and Rich 3D Environment Yi Wu Yuxin Wu Georgia Gkioxari Yuandong Tian 3DV 31 338 0 07 Jan 2018
Federated Control with Hierarchical Multi-Agent Deep Reinforcement Learning Saurabh Kumar Pararth Shah Dilek Z. Hakkani-Tür Larry Heck AI4CE 6 34 0 22 Dec 2017
Hierarchical Text Generation and Planning for Strategic Dialogue Denis Yarats M. Lewis 8 53 0 15 Dec 2017
CoDraw: Collaborative Drawing as a Testbed for Grounded Goal-driven Communication Jin-Hwa Kim Nikita Kitaev Xinlei Chen Marcus Rohrbach Byoung-Tak Zhang Yuandong Tian Dhruv Batra Devi Parikh DiffM VGen 27 25 0 15 Dec 2017
Grounding Referring Expressions in Images by Variational Context Hanwang Zhang Yulei Niu Shih-Fu Chang BDL ObjD 13 219 0 05 Dec 2017
Examining Cooperation in Visual Dialog Models Mircea Mironenco D. Kianfar Ke M. Tran Evangelos Kanoulas E. Gavves 12 4 0 04 Dec 2017
Asking the Difficult Questions: Goal-Oriented Visual Question Generation via Intermediate Rewards Junjie Zhang Qi Wu Chunhua Shen Jian Andrew Zhang Jianfeng Lu A. Hengel LRM 24 29 0 21 Nov 2017
Are You Talking to Me? Reasoned Visual Dialog Generation through Adversarial Learning Qi Wu Peng Wang Chunhua Shen Ian Reid A. Hengel GAN 22 129 0 21 Nov 2017
Parallel Attention: A Unified Framework for Visual Object Discovery through Dialogs and Queries Bohan Zhuang Qi Wu Chunhua Shen Ian Reid A. Hengel ObjD 11 134 0 17 Nov 2017
Active Learning for Visual Question Answering: An Empirical Study Xiaoyu Lin Devi Parikh 31 31 0 06 Nov 2017
Interpretable and Pedagogical Examples S. Milli Pieter Abbeel Igor Mordatch 16 14 0 02 Nov 2017