HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Models

13 July 2023

Nataniel Ruiz

Yuanzhen Li

Varun Jampani

Wei Wei

Tingbo Hou

Yael Pritch

Neal Wadhwa

Michael Rubinstein

Kfir Aberman

DiffM

ArXiv PDF HTML

Papers citing "HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Models"

50 / 143 papers shown

Title
CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilities Tao Wu Yong Zhang Xintao Wang Xianpan Zhou Guangcong Zheng Zhongang Qi Ying Shan Xi Li VGen DiffM 24 26 0 23 Aug 2024
MagicFace: Training-free Universal-Style Human Image Customized Synthesis Yibin Wang Weizhong Zhang Cheng Jin DiffM 32 3 0 14 Aug 2024
DiffLoRA: Generating Personalized Low-Rank Adaptation Weights with Diffusion Yujia Wu Yiming Shi Jiwei Wei Chengwei Sun Yuyang Zhou Yang Yang Heng Tao Shen 28 3 0 13 Aug 2024
UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalization Junjie He Yifeng Geng Liefeng Bo DiffM 44 20 0 12 Aug 2024
DDAP: Dual-Domain Anti-Personalization against Text-to-Image Diffusion Models Jing Yang Runping Xi Yingxin Lai Xun Lin Zitong Yu DiffM 24 1 0 29 Jul 2024
PreciseControl: Enhancing Text-To-Image Diffusion Models with Fine-Grained Attribute Control Rishubh Parihar VS Sachidanand Sabariswaran Mani Tejan Karmali R. V. Babu DiffM 34 13 0 24 Jul 2024
Stable-Hair: Real-World Hair Transfer via Diffusion Model Yuxuan Zhang Qing Zhang Yiren Song Jiaming Liu DiffM 46 6 0 19 Jul 2024
ModalChorus: Visual Probing and Alignment of Multi-modal Embeddings via Modal Fusion Map Yilin Ye Shishi Xiao Xingchen Zeng Wei Zeng 36 2 0 17 Jul 2024
Still-Moving: Customized Video Generation without Customized Video Data Hila Chefer Shiran Zada Roni Paiss Ariel Ephrat Omer Tov Michael Rubinstein Lior Wolf Tali Dekel T. Michaeli Inbar Mosseri DiffM VGen 19 20 0 11 Jul 2024
Powerful and Flexible: Personalized Text-to-Image Generation via Reinforcement Learning Fanyue Wei Wei Zeng Zhenyang Li Dawei Yin Lixin Duan Wen Li EGVM 21 2 0 09 Jul 2024
Magic Insert: Style-Aware Drag-and-Drop Nataniel Ruiz Yuanzhen Li Neal Wadhwa Yael Pritch Michael Rubinstein David E. Jacobs Shlomi Fruchter DiffM 25 7 0 02 Jul 2024
MotionBooth: Motion-Aware Customized Text-to-Video Generation Jianzong Wu Xiangtai Li Yanhong Zeng J. J. Zhang Qianyu Zhou Yining Li Yunhai Tong Kai Chen DiffM VGen 70 40 0 25 Jun 2024
Interpreting the Weight Space of Customized Diffusion Models Amil Dravid Yossi Gandelsman Kuan-Chieh Jackson Wang Rameen Abdal Gordon Wetzstein Alexei A. Efros Kfir Aberman 34 9 0 13 Jun 2024
FontStudio: Shape-Adaptive Diffusion Model for Coherent and Consistent Font Effect Generation Xinzhi Mu Li Chen Bohan Chen Shuyang Gu Jianmin Bao Dong Chen Ji Li Yuhui Yuan DiffM 27 3 0 12 Jun 2024
AttnDreamBooth: Towards Text-Aligned Personalized Text-to-Image Generation Lianyu Pang Jian Yin Baoquan Zhao Feize Wu Fu Lee Wang Qing Li Xudong Mao DiffM 37 1 0 07 Jun 2024
AttenCraft: Attention-guided Disentanglement of Multiple Concepts for Text-to-Image Customization Junjie Shentu Matthew Watson Noura Al Moubayed DiffM 40 0 0 28 May 2024
RefDrop: Controllable Consistency in Image or Video Generation via Reference Feature Guidance JiaoJiao Fan Haotian Xue Qinsheng Zhang Yongxin Chen 30 1 0 27 May 2024
RB-Modulation: Training-Free Personalization of Diffusion Models using Stochastic Optimal Control Litu Rout Yujia Chen Nataniel Ruiz Abhishek Kumar C. Caramanis Sanjay Shakkottai Wen-Sheng Chu DiffM 32 23 0 27 May 2024
Anonymization Prompt Learning for Facial Privacy-Preserving Text-to-Image Generation Liang Shi Jie M. Zhang Shiguang Shan PICV DiffM 40 1 0 27 May 2024
ID-to-3D: Expressive ID-guided 3D Heads via Score Distillation Sampling F. Babiloni Alexandros Lattas Jiankang Deng S. Zafeiriou DiffM 31 4 0 26 May 2024
User-Friendly Customized Generation with Multi-Modal Prompts Linhao Zhong Yan Hong Wentao Chen Binglin Zhou Yiyi Zhang Jianfu Zhang Liqing Zhang DiffM 35 0 0 26 May 2024
RectifID: Personalizing Rectified Flow with Anchored Classifier Guidance Zhicheng Sun Zhenhao Yang Yang Jin Haozhe Chi Kun Xu ... Hao Jiang Di Zhang Yang Song Kun Gai Yadong Mu 24 3 0 23 May 2024
FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Composition Ganggui Ding Canyu Zhao Wen Wang Zhen Yang Zide Liu Hao Chen Chunhua Shen DiffM 28 20 0 22 May 2024
Personalized Residuals for Concept-Driven Text-to-Image Generation Cusuh Ham Matthew Fisher James Hays Nicholas I. Kolkin Yuchen Liu Richard Y. Zhang Tobias Hinz DiffM 29 7 0 21 May 2024
MasterWeaver: Taming Editability and Face Identity for Personalized Text-to-Image Generation Yuxiang Wei Zhilong Ji Jinfeng Bai Hongzhi Zhang Lei Zhang W. Zuo DiffM 36 0 0 09 May 2024
A Survey on Personalized Content Synthesis with Diffusion Models Xu-Lu Zhang Xiao Wei Wengyu Zhang Jinlin Wu Zhaoxiang Zhang Zhen Lei Qing Li Zhen Lei Qing Li EGVM 131 19 0 09 May 2024
Customizing Text-to-Image Models with a Single Image Pair Maxwell Jones Sheng-Yu Wang Nupur Kumari David Bau Jun-Yan Zhu DiffM 25 18 0 02 May 2024
Learning to Compose: Improving Object Centric Learning by Injecting Compositionality Whie Jung Jaehoon Yoo Sungjin Ahn Seunghoon Hong OCL CoGe 24 4 0 01 May 2024
CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models Qinghe Wang Baolu Li Xiaomin Li Bing Cao Liqian Ma Huchuan Lu Xu Jia DiffM 37 6 0 24 Apr 2024
Customizing Text-to-Image Diffusion with Camera Viewpoint Control Nupur Kumari Grace Su Richard Zhang Taesung Park Eli Shechtman Jun-Yan Zhu DiffM 28 2 0 18 Apr 2024
GoodDrag: Towards Good Practices for Drag Editing with Diffusion Models Zewei Zhang Huan Liu Jun Chen Xiangyu Xu DiffM 16 8 0 10 Apr 2024
GeoSynth: Contextually-Aware High-Resolution Satellite Image Synthesis S. Sastry Subash Khanal A. Dhakal Nathan Jacobs 41 6 0 09 Apr 2024
StyleForge: Enhancing Text-to-Image Synthesis for Any Artistic Styles with Dual Binding Junseo Park Beom-Seok Ko Hyeryung Jang DiffM 91 1 0 08 Apr 2024
LCM-Lookahead for Encoder-based Text-to-Image Personalization Rinon Gal Or Lichter Elad Richardson Or Patashnik Amit H. Bermano Gal Chechik Daniel Cohen-Or DiffM 31 29 0 04 Apr 2024
DreamSalon: A Staged Diffusion Framework for Preserving Identity-Context in Editable Face Generation Haonan Lin Mengmeng Wang Yan Chen Wenbin An Yuzhe Yao Guang Dai Qianying Wang Yong-Jin Liu Jingdong Wang DiffM 35 4 0 28 Mar 2024
MM-Diff: High-Fidelity Image Personalization via Multi-Modal Condition Integration Zhichao Wei Qingkun Su Long Qin Weizhi Wang DiffM 31 6 0 22 Mar 2024
LoRA-Composer: Leveraging Low-Rank Adaptation for Multi-Concept Customization in Training-Free Diffusion Models Yang Yang Wen Wang Liang Peng Chaotian Song Yao Chen ... Xiaolong Yang Qinglin Lu Deng Cai Boxi Wu Wei Liu MoMe 60 24 0 18 Mar 2024
OSTAF: A One-Shot Tuning Method for Improved Attribute-Focused T2I Personalization Ye Wang Zili Yi Rui Ma DiffM 20 0 0 17 Mar 2024
OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Models Zhe Kong Yong Zhang Tianyu Yang Tao Wang Kaihao Zhang Bizhu Wu Guanying Chen Wei Liu Wenhan Luo DiffM 40 26 0 16 Mar 2024
IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representation Yizhi Song Zhifei Zhang Zhe Lin Scott D. Cohen Brian L. Price Jianming Zhang Soo Ye Kim He Zhang Wei Xiong Daniel G. Aliaga DiffM 66 35 0 15 Mar 2024
Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generation Fangfu Liu Hanyang Wang Weiliang Chen Haowen Sun Yueqi Duan DiffM 42 11 0 14 Mar 2024
PFStorer: Personalized Face Restoration and Super-Resolution Tuomas Varanka Tapani Toivonen Soumya Tripathy Guoying Zhao Erman Acar DiffM 27 2 0 13 Mar 2024
Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Model Yuxuan Zhang Lifu Wei Qing Zhang Yiren Song DiffM 31 12 0 12 Mar 2024
FaceChain-SuDe: Building Derived Class to Inherit Category Attributes for One-shot Subject-Driven Generation Pengchong Qiao Lei Shang Chang-Shu Liu Baigui Sun Xiang Ji Jie Chen CVBM 33 3 0 11 Mar 2024
Controllable Generation with Text-to-Image Diffusion Models: A Survey Pu Cao Feng Zhou Qing-Huang Song Lu Yang 67 35 0 07 Mar 2024
FaceChain-ImagineID: Freely Crafting High-Fidelity Diverse Talking Faces from Disentangled Audio Chao Xu Yang Liu Jiazheng Xing Weida Wang Mingze Sun ... Tianxin Huang Siyuan Li Zhi-Qi Cheng Ying Tai Baigui Sun CVBM 38 11 0 04 Mar 2024
Diffusion Model-Based Image Editing: A Survey Yi Huang Jiancheng Huang Yifan Liu Mingfu Yan Jiaxi Lv Jianzhuang Liu Wei Xiong He Zhang Liangliang Cao Liangliang Cao EGVM 66 84 0 27 Feb 2024
Investigating the Effectiveness of HyperTuning via Gisting Jason Phang 30 0 0 26 Feb 2024
Recovering the Pre-Fine-Tuning Weights of Generative Models Eliahu Horwitz Jonathan Kahana Yedid Hoshen 42 9 0 15 Feb 2024
Textual Localization: Decomposing Multi-concept Images for Subject-Driven Text-to-Image Generation Junjie Shentu Matthew Watson Noura Al Moubayed 15 0 0 15 Feb 2024