HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Models

13 July 2023

Nataniel Ruiz

Yuanzhen Li

Varun Jampani

Wei Wei

Tingbo Hou

Yael Pritch

Neal Wadhwa

Michael Rubinstein

Kfir Aberman

DiffM

ArXiv PDF HTML

Papers citing "HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Models"

43 / 143 papers shown

Title
DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalization Jisu Nam Heesu Kim Dongjae Lee Siyoon Jin Seungryong Kim Seunggyu Chang DiffM 16 40 0 15 Feb 2024
Hypernetwork-Driven Model Fusion for Federated Domain Generalization Marc Bartholet Taehyeon Kim Ami Beuret SeYoung Yun J. M. Buhmann FedML 26 1 0 10 Feb 2024
$λ$ -ECLIPSE: Multi-Concept Personalized Text-to-Image Diffusion Models by Leveraging CLIP Latent Space Maitreya Patel Sangmin Jung Chitta Baral Yezhou Yang VLM 16 28 0 07 Feb 2024
StableIdentity: Inserting Anybody into Anywhere at First Sight Qinghe Wang Xu Jia Xiaomin Li Taiqing Li Liqian Ma Yunzhi Zhuge Huchuan Lu 29 20 0 29 Jan 2024
BootPIG: Bootstrapping Zero-shot Personalized Image Generation Capabilities in Pretrained Diffusion Models Senthil Purushwalkam Akash Gokul Shafiq R. Joty Nikhil Naik DiffM 24 16 0 25 Jan 2024
Controllable Image Synthesis of Industrial Data Using Stable Diffusion Gabriele Valvano Antonino Agostino Giovanni De Magistris Antonino Graziano Giacomo Veneri 24 5 0 06 Jan 2024
ColorizeDiffusion: Adjustable Sketch Colorization with Reference Image and Text Dingkun Yan Liang Yuan Erwin Wu Yuma Nishioka I. Fujishiro Suguru Saito DiffM 8 5 0 02 Jan 2024
DiffMorph: Text-less Image Morphing with Diffusion Models Shounak Chatterjee DiffM 13 0 0 01 Jan 2024
Personalized Restoration via Dual-Pivot Tuning Pradyumna Chari Sizhuo Ma Daniil Ostashev A. Kadambi Gurunandan Krishnan Jian Wang Kfir Aberman DiffM 10 3 0 28 Dec 2023
Cross Initialization for Personalized Text-to-Image Generation Lianyu Pang Jian Yin Haoran Xie Qiping Wang Qing Li Xudong Mao DiffM 16 7 0 26 Dec 2023
PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalization Xu Peng Junwei Zhu Boyuan Jiang Ying Tai Donghao Luo Jiangning Zhang Wei Lin Taisong Jin Chengjie Wang Rongrong Ji DiffM 27 54 0 11 Dec 2023
RS-Corrector: Correcting the Racial Stereotypes in Latent Diffusion Models Yue Jiang Yueming Lyu Tianxiang Ma Bo Peng Jing Dong 40 3 0 08 Dec 2023
PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding Zhen Li Mingdeng Cao Xintao Wang Zhongang Qi Ming-Ming Cheng Ying Shan DiffM 34 187 0 07 Dec 2023
DreamVideo: Composing Your Dream Videos with Customized Subject and Motion Yujie Wei Shiwei Zhang Zhiwu Qing Hangjie Yuan Zhiheng Liu Yu Liu Yingya Zhang Jingren Zhou Hongming Shan DiffM VGen 11 89 0 07 Dec 2023
Alchemist: Parametric Control of Material Properties with Diffusion Models Prafull Sharma Varun Jampani Yuanzhen Li Xuhui Jia Dmitry Lagun Frédo Durand William T. Freeman Mark J. Matthews DiffM 31 21 0 05 Dec 2023
Customization Assistant for Text-to-image Generation Yufan Zhou Ruiyi Zhang Jiuxiang Gu Tongfei Sun DiffM 17 11 0 05 Dec 2023
FaceStudio: Put Your Face Everywhere in Seconds Yuxuan Yan C. Zhang Rui Wang Yichao Zhou Gege Zhang Pei Cheng Gang Yu Bin-Bin Fu DiffM 21 38 0 05 Dec 2023
Orthogonal Adaptation for Modular Customization of Diffusion Models Ryan Po Guandao Yang Kfir Aberman Gordon Wetzstein DiffM 18 26 0 05 Dec 2023
Generative Powers of Ten Xiaojuan Wang Janne Kontkanen Brian L. Curless Steven M. Seitz Ira Kemelmacher-Shlizerman B. Mildenhall Pratul P. Srinivasan Dor Verbin Aleksander Holynski 19 8 0 04 Dec 2023
Style Aligned Image Generation via Shared Attention Amir Hertz Andrey Voynov Shlomi Fruchter Daniel Cohen-Or DiffM 13 122 0 04 Dec 2023
VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence Yuchao Gu Yipin Zhou Bichen Wu Licheng Yu Jia-Wei Liu Rui Zhao Jay Zhangjie Wu David Junhao Zhang Mike Zheng Shou Kevin Tang DiffM VGen 60 36 0 04 Dec 2023
VideoBooth: Diffusion-based Video Generation with Image Prompts Yuming Jiang Tianxing Wu Shuai Yang Chenyang Si Dahua Lin Yu Qiao Chen Change Loy Ziwei Liu DiffM VGen 32 65 0 01 Dec 2023
VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models Hyeonho Jeong Geon Yeong Park Jong Chul Ye VGen DiffM 103 53 0 01 Dec 2023
Non-Visible Light Data Synthesis and Application: A Case Study for Synthetic Aperture Radar Imagery Zichen Tian Zhaozheng Chen Qianru Sun 17 1 0 29 Nov 2023
DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedback Jiao Sun Deqing Fu Yushi Hu Su Wang Royi Rassin ... Dana Alon Charles Herrmann Sjoerd van Steenkiste Ranjay Krishna Cyrus Rashtchian EGVM 20 39 0 29 Nov 2023
SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Models Yuwei Guo Ceyuan Yang Anyi Rao Maneesh Agrawala Dahua Lin Bo Dai DiffM VGen 15 113 0 28 Nov 2023
HawkI: Homography & Mutual Information Guidance for 3D-free Single Image to Aerial View D. Kothandaraman Tianyi Zhou Ming C. Lin Dinesh Manocha DiffM 21 2 0 27 Nov 2023
InstaStyle: Inversion Noise of a Stylized Image is Secretly a Style Adviser Xing Cui Zekun Li Peipei Li Huaibo Huang Xuannan Liu Zhaofeng He DiffM 21 7 0 25 Nov 2023
Text-to-Sticker: Style Tailoring Latent Diffusion Models for Human Expression Animesh Sinha Bo Sun Anmol Kalia Arantxa Casanova Elliot Blanchard ... Ankit Ramchandani Maziar Sanjabi Sonal Gupta Amy Bearman Dhruv Mahajan DiffM 23 4 0 17 Nov 2023
A Data Perspective on Enhanced Identity Preservation for Diffusion Personalization Xingzhe He Zhiwen Cao Nicholas I. Kolkin Lantao Yu Kun Wan Helge Rhodin Ratheesh Kalarot 16 12 0 07 Nov 2023
SingleInsert: Inserting New Concepts from a Single Image into Text-to-Image Models for Flexible Editing Zijie Wu Chaohui Yu Zhen Zhu Fan Wang Xiang Bai 17 12 0 12 Oct 2023
State of the Art on Diffusion Models for Visual Computing Ryan Po Wang Yifan Vladislav Golyanik Kfir Aberman Jonathan T. Barron ... Matthias Nießner Bjorn Ommer Christian Theobalt Peter Wonka Gordon Wetzstein 22 101 0 11 Oct 2023
RealFill: Reference-Driven Generation for Authentic Image Completion Luming Tang Nataniel Ruiz Qinghao Chu Yuanzhen Li Aleksander Holynski ... Bharath Hariharan Yael Pritch Neal Wadhwa Kfir Aberman Michael Rubinstein DiffM 11 43 0 28 Sep 2023
PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Models Li Chen Mengyi Zhao Yiheng Liu Mingxu Ding Yangyang Song ... Xu Wang Hao Yang Jing Liu Kang Du Min Zheng DiffM 17 52 0 11 Sep 2023
My Art My Choice: Adversarial Protection Against Unruly AI Anthony Rhodes Ram Bhagat U. Ciftci Ilke Demir DiffM 22 4 0 06 Sep 2023
HyperLoRA for PDEs Ritam Majumdar Vishal Sudam Jadhav A. Deodhar Shirish S. Karande L. Vig Venkataramana Runkana PINN AI4CE 8 1 0 18 Aug 2023
TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Composition Shilin Lu Yanzhu Liu A. Kong 37 51 0 24 Jul 2023
Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuning Jiancang Ma Junhao Liang Chen Chen H. Lu 18 138 0 21 Jul 2023
My3DGen: A Scalable Personalized 3D Generative Model Luchao Qi Jiaye Wu Annie N. Wang Sheng-Yu Wang Roni Sengupta 3DH 27 3 0 11 Jul 2023
InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuning Jing Shi Wei Xiong Zhe-nan Lin H. J. Jung DiffM 119 272 0 06 Apr 2023
Localizing Object-level Shape Variations with Text-to-Image Diffusion Models Or Patashnik Daniel Garibi Idan Azuri Hadar Averbuch-Elor Daniel Cohen-Or DiffM 21 105 0 20 Mar 2023
Muse: Text-To-Image Generation via Masked Generative Transformers Huiwen Chang Han Zhang Jarred Barber AJ Maschinot José Lezama ... Kevin Patrick Murphy William T. Freeman Michael Rubinstein Yuanzhen Li Dilip Krishnan DiffM 197 515 0 02 Jan 2023
Instance-Conditioned GAN Arantxa Casanova Marlene Careil Jakob Verbeek M. Drozdzal Adriana Romero Soriano GAN 193 132 0 10 Sep 2021