Sample-Efficient Reinforcement Learning via Counterfactual-Based Data Augmentation

16 December 2020

Chaochao Lu

Erdun Gao

Ke Wang

José Miguel Hernández-Lobato

Papers citing "Sample-Efficient Reinforcement Learning via Counterfactual-Based Data Augmentation"

37 / 37 papers shown

Title
Generative Framework for Personalized Persuasion: Inferring Causal, Counterfactual, and Latent Knowledge Donghuo Zeng Roberto Legaspi Yuewen Sun Xinshuai Dong Kazushi Ikeda Peter Spirtes Kun Zhang CML 31 0 0 08 Apr 2025
Towards Better Sample Efficiency in Multi-Agent Reinforcement Learning via Exploration Amir Baghi Jens Sjölund Joakim Bergdahl Linus Gisslén Alessandro Sestini 58 0 0 17 Mar 2025
Learning Counterfactual Outcomes Under Rank Preservation Peng Wu Haoxuan Li Chunyuan Zheng Yan Zeng Jiawei Chen Yang Liu Ruocheng Guo Kaipeng Zhang 70 0 0 10 Feb 2025
Skills Regularized Task Decomposition for Multi-task Offline Reinforcement Learning Minjong Yoo Sangwoo Cho Honguk Woo OffRL 39 10 0 28 Aug 2024
OASIS: Conditional Distribution Shaping for Offline Safe Reinforcement Learning Yi-Fan Yao Zhepeng Cen Wenhao Ding Hao-ming Lin Shiqi Liu Tingnan Zhang Wenhao Yu Ding Zhao OffRL OnRL 51 1 0 19 Jul 2024
Fine-Grained Causal Dynamics Learning with Quantization for Improving Robustness in Reinforcement Learning Inwoo Hwang Yunhyeok Kwak Suhyung Choi Byoung-Tak Zhang Sanghack Lee 40 1 0 05 Jun 2024
Causal Action Influence Aware Counterfactual Data Augmentation Núria Armengol Urpí Marco Bagatella Marin Vlastelica Georg Martius CML 33 5 0 29 May 2024
Counterfactual Reasoning Using Predicted Latent Personality Dimensions for Optimizing Persuasion Outcome Donghuo Zeng Roberto Legaspi Yuewen Sun Xinshuai Dong Kazushi Ikeda Peter Spirtes Kun Zhang 22 2 0 21 Apr 2024
Why Online Reinforcement Learning is Causal Oliver Schulte Pascal Poupart CML OffRL 37 1 0 07 Mar 2024
Counterfactual Influence in Markov Decision Processes M. Kazemi Jessica Lally Ekaterina Tishchenko Hana Chockler Nicola Paoletti 23 1 0 13 Feb 2024
Causal Bayesian Optimization via Exogenous Distribution Learning Shaogang Ren Xiaoning Qian 16 1 0 03 Feb 2024
Natural Counterfactuals With Necessary Backtracking Guang-Yuan Hao Jiji Zhang Erdun Gao Hao Wang Kun Zhang 31 0 0 02 Feb 2024
Closing the Gap between TD Learning and Supervised Learning -- A Generalisation Point of View Raj Ghugare Matthieu Geist Glen Berseth Benjamin Eysenbach OffRL 35 14 0 20 Jan 2024
Guided Data Augmentation for Offline Reinforcement Learning and Imitation Learning Nicholas Corrado Yu-Tao Qu John U. Balis Adam Labiosa Josiah P. Hanna OffRL 38 2 0 27 Oct 2023
Agent-Specific Effects: A Causal Effect Propagation Analysis in Multi-Agent MDPs Stelios Triantafyllou A. Sukovic Debmalya Mandal Goran Radanović 24 0 0 17 Oct 2023
Offline Imitation Learning with Variational Counterfactual Reasoning Bowei He Zexu Sun Jinxin Liu Shuai Zhang Xu Chen Chen Ma OffRL 31 9 0 07 Oct 2023
Seeing is not Believing: Robust Reinforcement Learning against Spurious Correlation Wenhao Ding Laixi Shi Yuejie Chi Ding Zhao OOD 27 18 0 15 Jul 2023
Causal Reinforcement Learning: A Survey Zhi-Hong Deng Jing Jiang Guodong Long Chen Zhang CML LRM 50 13 0 04 Jul 2023
Reinforcement Learning with Temporal-Logic-Based Causal Diagrams Yashi Paliwal Rajarshi Roy Jean-Raphael Gaglione Nasim Baharisangari Daniel Neider Xiaoming Duan Ufuk Topcu Zhe Xu 19 3 0 23 Jun 2023
VIBR: Learning View-Invariant Value Functions for Robust Visual Control Tom Dupuis Jaonary Rabarisoa Q. C. Pham David Filliat 36 0 0 14 Jun 2023
Finding Counterfactually Optimal Action Sequences in Continuous State Spaces Stratis Tsirtsis Manuel Gomez Rodriguez CML OffRL 30 9 0 06 Jun 2023
Partial Counterfactual Identification of Continuous Outcomes with a Curvature Sensitivity Model Valentyn Melnychuk Dennis Frauen Stefan Feuerriegel 19 11 0 02 Jun 2023
Simple Noisy Environment Augmentation for Reinforcement Learning Raad Khraishi Ramin Okhrati OffRL 15 1 0 04 May 2023
Q-Cogni: An Integrated Causal Reinforcement Learning Framework C. Cunha Wei Liu T. French Ajmal Mian 26 1 0 26 Feb 2023
A Survey on Causal Reinforcement Learning Yan Zeng Ruichu Cai Gang Hua Libo Huang Zhifeng Hao CML 26 27 0 10 Feb 2023
Counterfactual Identifiability of Bijective Causal Models Arash Nasr-Esfahany MohammadIman Alizadeh Devavrat Shah CML BDL 35 26 0 04 Feb 2023
Counterfactual (Non-)identifiability of Learned Structural Causal Models Arash Nasr-Esfahany Emre Kıcıman 26 11 0 22 Jan 2023
MoCoDA: Model-based Counterfactual Data Augmentation Silviu Pitis Elliot Creager Ajay Mandlekar Animesh Garg OffRL 48 33 0 20 Oct 2022
Causal Dynamics Learning for Task-Independent State Abstraction Zizhao Wang Xuesu Xiao Zifan Xu Yuke Zhu Peter Stone CML 32 52 0 27 Jun 2022
Bootstrapped Transformer for Offline Reinforcement Learning Kerong Wang Hanye Zhao Xufang Luo Kan Ren Weinan Zhang Dongsheng Li OffRL 16 37 0 17 Jun 2022
A Relational Intervention Approach for Unsupervised Dynamics Generalization in Model-Based Reinforcement Learning J. Guo Biwei Huang Dacheng Tao 8 20 0 09 Jun 2022
Diffusion Causal Models for Counterfactual Estimation Pedro Sanchez Sotirios A. Tsaftaris DiffM BDL 35 69 0 21 Feb 2022
Learning Generalized Gumbel-max Causal Mechanisms Guy Lorberbom Daniel D. Johnson Chris J. Maddison Daniel Tarlow Tamir Hazan CML 11 20 0 11 Nov 2021
Accelerating the Learning of TAMER with Counterfactual Explanations Jakob Karalus F. Lindner OffRL 29 4 0 03 Aug 2021
Independent mechanism analysis, a new concept? Luigi Gresele Julius von Kügelgen Vincent Stimper Bernhard Schölkopf M. Besserve CML 16 100 0 09 Jun 2021
Causal Learning for Socially Responsible AI Lu Cheng Ahmadreza Mosallanezhad Paras Sheth Huan Liu 71 13 0 25 Apr 2021
Towards Causal Representation Learning Bernhard Schölkopf Francesco Locatello Stefan Bauer Nan Rosemary Ke Nal Kalchbrenner Anirudh Goyal Yoshua Bengio OOD CML AI4CE 43 318 0 22 Feb 2021