Bridging Model-Based Optimization and Generative Modeling via
Conservative Fine-Tuning of Diffusion Models

Bridging Model-Based Optimization and Generative Modeling via Conservative Fine-Tuning of Diffusion Models

30 May 2024

Masatoshi Uehara

Ehsan Hajiramezanali

Gabriele Scalia

Gökçen Eraslan

Tommaso Biancalani

Papers citing "Bridging Model-Based Optimization and Generative Modeling via Conservative Fine-Tuning of Diffusion Models"

10 / 10 papers shown

Title
Fine-Tuning Discrete Diffusion Models via Reward Optimization with Applications to DNA and Protein Design Chenyu Wang Masatoshi Uehara Yichun He Amy Wang Tommaso Biancalani Avantika Lal Tommi Jaakkola Sergey Levine Hanchen Wang Aviv Regev 41 8 0 17 Oct 2024
Cliqueformer: Model-Based Optimization with Structured Transformers J. Kuba Pieter Abbeel Sergey Levine OffRL AI4CE 36 2 0 17 Oct 2024
Maximum Entropy Inverse Reinforcement Learning of Diffusion Models with Energy-Based Models Sangwoong Yoon Himchan Hwang Dohyun Kwon Yung-Kyun Noh Frank C. Park 14 2 0 30 Jun 2024
Adding Conditional Control to Diffusion Models with Reinforcement Learning Yulai Zhao Masatoshi Uehara Gabriele Scalia Tommaso Biancalani Sergey Levine Ehsan Hajiramezanali Ehsan Hajiramezanali AI4CE 46 3 0 17 Jun 2024
Dirichlet Flow Matching with Applications to DNA Sequence Design Hannes Stärk Bowen Jing Chenyu Wang Gabriele Corso Bonnie Berger Regina Barzilay Tommi Jaakkola BDL 36 45 0 08 Feb 2024
Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Design Andrew Campbell Jason Yim Regina Barzilay Tom Rainforth Tommi Jaakkola AI4CE 60 96 0 07 Feb 2024
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
Pessimistic Model-based Offline Reinforcement Learning under Partial Coverage Masatoshi Uehara Wen Sun OffRL 89 144 0 13 Jul 2021
Continuous Doubly Constrained Batch Reinforcement Learning Rasool Fakoor Jonas W. Mueller Kavosh Asadi Pratik Chaudhari Alex Smola OffRL 191 23 0 18 Feb 2021
Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems Sergey Levine Aviral Kumar George Tucker Justin Fu OffRL GP 321 1,662 0 04 May 2020