Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondence

23 May 2023

Aleksander Holynski

Papers citing "Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondence"

47 / 97 papers shown

Title
SpotlessSplats: Ignoring Distractors in 3D Gaussian Splatting S. Sabour Lily Goli George Kopanas Mark J. Matthews Dmitry Lagun Leonidas J. Guibas Alec Jacobson David J. Fleet Andrea Tagliasacchi 29 18 0 28 Jun 2024
Immiscible Diffusion: Accelerating Diffusion Training with Noise Assignment Yiheng Li Heyang Jiang Akio Kodaira M. Tomizuka Kurt Keutzer Chenfeng Xu DiffM 29 7 0 18 Jun 2024
Eye-for-an-eye: Appearance Transfer with Semantic Correspondence in Diffusion Models Sooyeon Go Kyungmook Choi Minjung Shin Youngjung Uh DiffM 29 2 0 11 Jun 2024
Diffusion Features to Bridge Domain Gap for Semantic Segmentation Yuxiang Ji Boyong He Chenyuan Qu Zhuoyue Tan Chuan Qin Liaoni Wu 37 2 0 02 Jun 2024
MotionDreamer: Zero-Shot 3D Mesh Animation from Video Diffusion Models Lukas Uzolas E. Eisemann Petr Kellnhofer 35 1 0 30 May 2024
RefDrop: Controllable Consistency in Image or Video Generation via Reference Feature Guidance JiaoJiao Fan Haotian Xue Qinsheng Zhang Yongxin Chen 30 1 0 27 May 2024
Zero-Shot Video Semantic Segmentation based on Pre-Trained Diffusion Models Qian Wang Abdelrahman Eldesokey Mohit Mendiratta Fangneng Zhan Adam Kortylewski Christian Theobalt Peter Wonka DiffM 39 4 0 27 May 2024
Disentangling Foreground and Background Motion for Enhanced Realism in Human Video Generation Jinlin Liu Kai Yu Mengyang Feng Xiefan Guo Miaomiao Cui DiffM 37 3 0 26 May 2024
Looking Backward: Streaming Video-to-Video Translation with Feature Banks Feng Liang Akio Kodaira Chenfeng Xu M. Tomizuka Kurt Keutzer Diana Marculescu DiffM VGen 61 7 0 24 May 2024
Diffusion for World Modeling: Visual Details Matter in Atari Eloi Alonso Adam Jelley Vincent Micheli Anssi Kanervisto Amos Storkey Tim Pearce Franccois Fleuret 33 37 0 20 May 2024
Probing the 3D Awareness of Visual Foundation Models Mohamed El Banani Amit Raj Kevis-Kokitsi Maninis Abhishek Kar Yuanzhen Li Michael Rubinstein Deqing Sun Leonidas J. Guibas Justin Johnson Varun Jampani 28 79 0 12 Apr 2024
3D Congealing: 3D-Aware Image Alignment in the Wild Yunzhi Zhang Zizhang Li Amit Raj Andreas Engelhardt Yuanzhen Li Tingbo Hou Jiajun Wu Varun Jampani 3DV 21 0 0 02 Apr 2024
Object Pose Estimation via the Aggregation of Diffusion Features Tianfu Wang Guosheng Hu Hongguang Wang DiffM 25 8 0 27 Mar 2024
Pose-Guided Self-Training with Two-Stage Clustering for Unsupervised Landmark Discovery Siddharth Tourani Ahmed Alwheibi Arif Mahmood Muhammad Haris Khan DiffM 30 1 0 24 Mar 2024
Click to Grasp: Zero-Shot Precise Manipulation via Visual Diffusion Descriptors Nikolaos Tsagkas Jack Rome S. Ramamoorthy Oisin Mac Aodha Chris Xiaoxuan Lu 19 6 0 21 Mar 2024
Open-Vocabulary Attention Maps with Token Optimization for Semantic Segmentation in Diffusion Models Pablo Marcos-Manchón Roberto Alcover-Couso Juan C. Sanmiguel Jose M. Martínez VLM 37 18 0 21 Mar 2024
Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillation Axel Sauer Frederic Boesel Tim Dockhorn A. Blattmann Patrick Esser Robin Rombach DiffM 16 104 0 18 Mar 2024
Text-to-Image Diffusion Models are Great Sketch-Photo Matchmakers Subhadeep Koley A. Bhunia Aneeshan Sain Pinaki Nath Chowdhury Tao Xiang Yi-Zhe Song DiffM 41 7 0 12 Mar 2024
Disentangled 3D Scene Generation with Layout Learning Dave Epstein Ben Poole B. Mildenhall Alexei A. Efros Aleksander Holynski CoGe OCL 3DV 34 20 0 26 Feb 2024
NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs Michael Fischer Zhengqin Li Thu Nguyen-Phuoc Aljaz Bozic Zhao Dong Carl S. Marshall Tobias Ritschel 32 10 0 13 Feb 2024
Gore Diffusion LoRA Model Ayush Thakur A. K. Dubey 19 0 0 09 Feb 2024
Training-Free Consistent Text-to-Image Generation Yoad Tewel Omri Kaduri Rinon Gal Yoni Kasten Lior Wolf Gal Chechik Y. Atzmon DiffM 20 50 0 05 Feb 2024
EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Models Koichi Namekata Amirmojtaba Sabour Sanja Fidler Seung Wook Kim 42 17 0 22 Jan 2024
Robo-ABC: Affordance Generalization Beyond Categories via Semantic Correspondence for Robot Manipulation Yuanchen Ju Kaizhe Hu Guowei Zhang Gu Zhang Mingrun Jiang Huazhe Xu 20 38 0 15 Jan 2024
Representative Feature Extraction During Diffusion Process for Sketch Extraction with One Example Kwan Yun Youngseo Kim Kwanggyoon Seo Chang Wook Seo Junyong Noh DiffM 22 2 0 09 Jan 2024
Gen2Det: Generate to Detect Saksham Suri Fanyi Xiao Animesh Sinha Sean Culatana Raghuraman Krishnamoorthi Chenchen Zhu Abhinav Shrivastava VLM DiffM 18 9 0 07 Dec 2023
Readout Guidance: Learning Control from Diffusion Features Grace Luo Trevor Darrell Oliver Wang Dan B. Goldman Aleksander Holynski 13 21 0 04 Dec 2023
Brain Decodes Deep Nets Huzheng Yang James C. Gee Jianbo Shi 22 6 0 03 Dec 2023
DiffCAD: Weakly-Supervised Probabilistic CAD Model Retrieval and Alignment from an RGB Image Daoyi Gao Dávid Rozenberszki Stefan Leutenegger Angela Dai DiffM 10 11 0 30 Nov 2023
Unsupervised Keypoints from Pretrained Diffusion Models Eric Hedlin Gopal Sharma Shweta Mahajan Xingzhe He Hossam N. Isack Abhishek Kar Helge Rhodin Andrea Tagliasacchi Kwang Moo Yi 8 7 0 29 Nov 2023
Telling Left from Right: Identifying Geometry-Aware Semantic Correspondence Junyi Zhang Charles Herrmann Junhwa Hur Eric Chen Varun Jampani Deqing Sun Ming-Hsuan Yang 19 37 0 28 Nov 2023
Diffusion 3D Features (Diff3F): Decorating Untextured Shapes with Distilled Semantic Features Niladri Shekhar Dutt Sanjeev Muralikrishnan Niloy J. Mitra 10 20 0 28 Nov 2023
CLiC: Concept Learning in Context Mehdi Safaee Aryan Mikaeili Or Patashnik Daniel Cohen-Or Ali Mahdavi-Amiri 10 11 0 28 Nov 2023
Cross-Image Attention for Zero-Shot Appearance Transfer Yuval Alaluf Daniel Garibi Or Patashnik Hadar Averbuch-Elor Daniel Cohen-Or DiffM 22 66 0 06 Nov 2023
SD4Match: Learning to Prompt Stable Diffusion Model for Semantic Matching Xinghui Li Jingyi Lu Kai Han V. Prisacariu DiffM 17 19 0 26 Oct 2023
State of the Art on Diffusion Models for Visual Computing Ryan Po Wang Yifan Vladislav Golyanik Kfir Aberman Jonathan T. Barron ... Matthias Nießner Bjorn Ommer Christian Theobalt Peter Wonka Gordon Wetzstein 22 101 0 11 Oct 2023
A General Protocol to Probe Large Vision Models for 3D Physical Understanding Guanqi Zhan Chuanxia Zheng Weidi Xie Andrew Zisserman DiffM 17 14 0 10 Oct 2023
FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimators Haiping Wang Yuan-Bin Liu Bing Wang Yujing Sun Zhenchao Dong Wenping Wang Bisheng Yang DiffM 23 10 0 05 Oct 2023
Text-image Alignment for Diffusion-based Perception Neehar Kondapaneni Markus Marks Manuel Knott Rogério Guimarães Pietro Perona VLM DiffM 14 32 0 29 Sep 2023
RealFill: Reference-Driven Generation for Authentic Image Completion Luming Tang Nataniel Ruiz Qinghao Chu Yuanzhen Li Aleksander Holynski ... Bharath Hariharan Yael Pritch Neal Wadhwa Kfir Aberman Michael Rubinstein DiffM 11 27 0 28 Sep 2023
Diffusion Model as Representation Learner Xingyi Yang Xinchao Wang DiffM 25 52 0 21 Aug 2023
TokenFlow: Consistent Diffusion Features for Consistent Video Editing Michal Geyer Omer Bar-Tal Shai Bagon Tali Dekel VGen DiffM 15 249 0 19 Jul 2023
On the Design Fundamentals of Diffusion Models: A Survey Ziyi Chang G. Koulieris Hubert P. H. Shum DiffM 27 50 0 07 Jun 2023
Unsupervised Semantic Correspondence Using Stable Diffusion Eric Hedlin Gopal Sharma Shweta Mahajan Hossam N. Isack Abhishek Kar Andrea Tagliasacchi K. M. Yi DiffM 19 86 0 24 May 2023
A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondence Junyi Zhang Charles Herrmann Junhwa Hur Luisa Polania Cabrera Varun Jampani Deqing Sun Ming Yang DiffM 11 84 0 24 May 2023
Label-Efficient Semantic Segmentation with Diffusion Models Dmitry Baranchuk Ivan Rubachev A. Voynov Valentin Khrulkov Artem Babenko DiffM VLM 187 508 0 06 Dec 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 283 5,723 0 29 Apr 2021