The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation

2 June 2023

Charles Herrmann

David J. Fleet

Papers citing "The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation"

50 / 67 papers shown

Title
Pixel Motion as Universal Representation for Robot Control Kanchana Ranasinghe Xiang Li Cristina Mata J. Park Michael S. Ryoo VGen 11 0 0 12 May 2025
Fast Flow-based Visuomotor Policies via Conditional Optimal Transport Couplings Andreas Sochopoulos Nikolay Malkin Nikolaos Tsagkas João Moura Michael Gienger S. Vijayakumar 34 1 0 02 May 2025
Direct Motion Models for Assessing Generated Videos Kelsey R. Allen Carl Doersch Guangyao Zhou Mohammed Suhail Danny Driess ... Thomas Kipf Mehdi S. M. Sajjadi Kevin P. Murphy João Carreira Sjoerd van Steenkiste EGVM DiffM VGen 74 0 0 30 Apr 2025
The Fourth Monocular Depth Estimation Challenge Anton Obukhov Matteo Poggi Fabio Tosi Ripudaman Singh Arora Jaime Spencer ... Tuan-Anh Yang Minh-Quang Nguyen T. Tran Albert Luginov Muhammad Shahzad MDE 37 0 0 24 Apr 2025
VistaDepth: Frequency Modulation With Bias Reweighting For Enhanced Long-Range Depth Estimation Mingxia Zhan Li Zhang Xiaomeng Chu Beibei Wang MDE 57 0 0 21 Apr 2025
MicroFlow: Domain-Specific Optical Flow for Ground Deformation Estimation in Seismic Events Juliette Bertrand Sophie Giffard-Roisin James Hollingsworth Julien Mairal 19 0 0 18 Apr 2025
Mono3R: Exploiting Monocular Cues for Geometric 3D Reconstruction Wenyu Li Sidun Liu Peng Qiao Yong Dou 25 0 0 18 Apr 2025
SCFlow2: Plug-and-Play Object Pose Refiner with Shape-Constraint Scene Flow Qingyuan Wang Rui Song Jiaojiao Li Kerui Cheng David Ferstl Yinlin Hu 3DPC 43 0 0 12 Apr 2025
Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstruction Zeren Jiang Chuanxia Zheng Iro Laina Diane Larlus Andrea Vedaldi VGen 41 0 0 10 Apr 2025
Studying Image Diffusion Features for Zero-Shot Video Object Segmentation Thanos Delatolas Vicky S. Kalogeiton Dim P. Papadopoulos DiffM VOS 43 1 0 07 Apr 2025
Hierarchical Flow Diffusion for Efficient Frame Interpolation Yang Hai Guo Wang Tan Su Wenjie Jiang Yinlin Hu DiffM 53 0 0 01 Apr 2025
Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimation Jiyuan Wang Chunyu Lin Cheng Guan Lang Nie Jing He Haodong Li K. Liao Yao Zhao DiffM MDE 61 0 0 20 Mar 2025
DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Framework Henrique Morimitsu Xiaobin Zhu Roberto M. Cesar Jr. Xiangyang Ji Xu-Cheng Yin MDE 53 0 0 19 Mar 2025
BAT: Learning Event-based Optical Flow with Bidirectional Adaptive Temporal Correlation Gangwei Xu Haotong Lin Z. Zhang H. Luo Haiyang Sun Xin-She Yang 54 0 0 05 Mar 2025
L4P: Low-Level 4D Vision Perception Unified Abhishek Badki Hang Su Bowen Wen Orazio Gallo VLM 75 1 0 18 Feb 2025
Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusion Massimiliano Viola Kevin Qu Nando Metzger B. Ke Alexander Becker Konrad Schindler Anton Obukhov VLM MDE 91 3 0 18 Dec 2024
TAPTRv3: Spatial and Temporal Context Foster Robust Tracking of Any Point in Long Video Jinyuan Qu Hongyang Li Shilong Liu Tianhe Ren Zhaoyang Zeng Lei Zhang 3DPC 66 1 0 27 Nov 2024
RoMo: Robust Motion Segmentation Improves Structure from Motion Lily Goli S. Sabour Mark J. Matthews Marcus A. Brubaker Dmitry Lagun Alec Jacobson David J. Fleet Saurabh Saxena Andrea Tagliasacchi VOS 97 3 0 27 Nov 2024
One Diffusion to Generate Them All Duong H. Le Tuan Pham Sangho Lee Christopher Clark Aniruddha Kembhavi Stephan Mandt Ranjay Krishna Jiasen Lu VLM 59 5 0 25 Nov 2024
PriorDiffusion: Leverage Language Prior in Diffusion Models for Monocular Depth Estimation Ziyao Zeng Jingcheng Ni Daniel Wang Patrick Rim Younjoon Chung Fengyu Yang Byung-Woo Hong A. Wong DiffM MDE 91 2 0 24 Nov 2024
Benchmarking the Robustness of Optical Flow Estimation to Corruptions Zhonghua Yi Hao-miao Shi Qi Jiang Yao Gao Ze Wang Y. Zhang Kailun Yang Kaiwei Wang AAML 70 0 0 22 Nov 2024
Diff-2-in-1: Bridging Generation and Dense Perception with Diffusion Models Shuhong Zheng Zhipeng Bao Ruoyu Zhao Martial Hebert Yu-xiong Wang DiffM 35 0 0 07 Nov 2024
Multi-task Geometric Estimation of Depth and Surface Normal from Monocular 360° Images Kun Huang Fang-Lue Zhang Fangfang Zhang Yu-Kun Lai Paul L. Rosin N. Dodgson 25 0 0 04 Nov 2024
A Simple Approach to Unifying Diffusion-based Conditional Generation Xirui Li Charles Herrmann Kelvin C.K. Chan Yinxiao Li Deqing Sun Chao Ma Ming Yang DiffM VLM 35 1 0 15 Oct 2024
E-Motion: Future Motion Simulation via Event Sequence Diffusion Song Wu Zhiyu Zhu Junhui Hou Guangming Shi Jinjian Wu DiffM VGen 35 0 0 11 Oct 2024
Diffusion Models in 3D Vision: A Survey Zhen Wang Dongyuan Li Renhe Jiang Tianyu He Jiang Bian Renhe Jiang MedIm 49 4 0 07 Oct 2024
MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motion Junyi Zhang Charles Herrmann Junhwa Hur Varun Jampani Trevor Darrell Forrester Cole Deqing Sun Ming Yang VGen 79 69 0 04 Oct 2024
D3RoMa: Disparity Diffusion-based Depth Sensing for Material-Agnostic Robotic Manipulation Songlin Wei Haoran Geng Jiayi Chen Congyue Deng Wenbo Cui Chengyang Zhao Xiaomeng Fang Leonidas J. Guibas He Wang MDE 52 7 0 22 Sep 2024
Fine-Tuning Image-Conditional Diffusion Models is Easier than You Think Gonzalo Martin Garcia Karim Abou Zeid Christian Schmidt Daan de Geus Alexander Hermans Bastian Leibe 37 23 0 17 Sep 2024
GRIN: Zero-Shot Metric Depth with Pixel-Level Diffusion Vitor Campagnolo Guizilini P. Tokmakov Achal Dave Rares Ambrus DiffM 23 2 0 15 Sep 2024
PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimage Denis Zavadski Damjan Kalšan Carsten Rother DiffM MDE 18 5 0 13 Sep 2024
RCDM: Enabling Robustness for Conditional Diffusion Model Weifeng Xu Xiang Zhu Xiaoyong Li AAML 19 0 0 05 Aug 2024
Improving 2D Feature Representations by 3D-Aware Fine-Tuning Yuanwen Yue Anurag Das Francis Engelmann Siyu Tang J. E. Lenssen 38 23 0 29 Jul 2024
BetterDepth: Plug-and-Play Diffusion Refiner for Zero-Shot Monocular Depth Estimation Xiang Zhang B. Ke Hayko Riemenschneider Nando Metzger Anton Obukhov Markus H. Gross Konrad Schindler Christopher Schroers DiffM MDE 41 7 0 25 Jul 2024
Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions Fabio Tosi Pierluigi Zama Ramirez Matteo Poggi DiffM MQ MDE 28 7 0 23 Jul 2024
Single Image Rolling Shutter Removal with Diffusion Models Zhanglei Yang Haipeng Li Mingbo Hong Chen-Lin Zhang Shuaicheng Liu Shuaicheng Liu DiffM 18 3 0 03 Jul 2024
Disentangled Motion Modeling for Video Frame Interpolation Jaihyun Lew Jooyoung Choi Chaehun Shin Dahuin Jung Sungroh Yoon VGen DiffM 31 0 0 25 Jun 2024
GeoBench: Benchmarking and Analyzing Monocular Geometry Estimation Models Yongtao Ge Guangkai Xu Zhiyue Zhao Libo Sun Zheng Huang Yanlong Sun Hao Chen Chunhua Shen MDE 34 3 0 18 Jun 2024
RecMoDiffuse: Recurrent Flow Diffusion for Human Motion Generation Mirgahney Mohamed Harry Jake Cunningham M. Deisenroth Lourdes Agapito DiffM 28 0 0 11 Jun 2024
Learning Temporally Consistent Video Depth from Video Diffusion Priors Jiahao Shao Yuanbo Yang Hongyu Zhou Youmin Zhang Yujun Shen Matteo Poggi Yiyi Liao VGen DiffM MDE 31 37 0 03 Jun 2024
SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flow Yihan Wang Lahav Lipson Jia Deng 32 36 0 23 May 2024
Structure-based drug design by denoising voxel grids Pedro H. O. Pinheiro Arian R. Jamasb Omar Mahmood Vishnu Sresht Saeed Saremi DiffM 34 7 0 07 May 2024
Invisible Stitch: Generating Smooth 3D Scenes with Depth Inpainting Paul Engstler Andrea Vedaldi Iro Laina Christian Rupprecht MDE 29 9 0 30 Apr 2024
The Third Monocular Depth Estimation Challenge Jaime Spencer Fabio Tosi Matteo Poggi Ripudaman Singh Arora Chris Russell ... Albert Luginov Muhammad Shahzad Seyed Hosseini Aleksander Trajcevski James H. Elder MDE 33 7 0 25 Apr 2024
InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior Zhiheng Liu Ouyang Hao Qiuyu Wang Ka Leong Cheng Jie Xiao Kai Zhu Nan Xue Yu Liu Yujun Shen Yang Cao DiffM 3DGS 41 19 0 17 Apr 2024
GazeHTA: End-to-end Gaze Target Detection with Head-Target Association Zhi-Yi Lin Jouh Yeong Chew J. C. V. Gemert Xucong Zhang 34 1 0 16 Apr 2024
Rethinking Iterative Stereo Matching from Diffusion Bridge Model Perspective Yuguang Shi DiffM 25 0 0 13 Apr 2024
MemFlow: Optical Flow Estimation and Prediction with Memory Qiaole Dong Yanwei Fu 23 19 0 07 Apr 2024
WorDepth: Variational Language Prior for Monocular Depth Estimation Ziyao Zeng Daniel Wang Fengyu Yang Hyoungseob Park Yangchao Wu Stefano Soatto Byung-Woo Hong Dong Lao Alex Wong MDE 36 26 0 04 Apr 2024
Independently Keypoint Learning for Small Object Semantic Correspondence Hailong Jin Huiying Li 24 0 0 03 Apr 2024