$RGB$\leftrightarrow$X: Image decomposition and synthesis using material- and lighting-aware diffusion models$

RGB $\leftrightarrow$ X: Image decomposition and synthesis using material- and lighting-aware diffusion models

1 May 2024

Zheng Zeng

Valentin Deschaintre

Iliyan Georgiev

Yannick Hold-Geoffroy

Fujun Luan

Miloš Hašan

Papers citing "RGB$\leftrightarrow$X: Image decomposition and synthesis using material- and lighting-aware diffusion models"

50 / 64 papers shown

Title
LaFiTe: A Generative Latent Field for 3D Native Texturing Chia-Hao Chen Zi-Xin Zou Yan-Pei Cao Ze Yuan Guan Luo Xiaojuan Qi Ding Liang Song-Hai Zhang Yuan-Chen Guo 28 0 0 04 Dec 2025
UniLight: A Unified Representation for Lighting Zitian Zhang Iliyan Georgiev Michael Fischer Yannick Hold-Geoffroy Jean-François Lalonde Valentin Deschaintre 32 0 0 03 Dec 2025
LumiX: Structured and Coherent Text-to-Intrinsic Generation Xu Han Biao Zhang Xiangjun Tang Xianzhi Li Peter Wonka VGen 164 0 0 02 Dec 2025
CtrlVDiff: Controllable Video Generation via Unified Multimodal Video Diffusion Dianbing Xi Jiepeng Wang Yuanzhi Liang Xi Qiu Jialun Liu ... Yuchi Huo Rui Wang H. Huang Chi Zhang Xuelong Li DiffM VGen 194 0 0 26 Nov 2025
MatMart: Material Reconstruction of 3D Objects via Diffusion X. Wu Pengfei Zhu Jiangjing Lyu Xinguo Liu Jie Guo Yanwen Guo Weiwei Xu Chengfei Lyu DiffM 172 0 0 24 Nov 2025
NeAR: Coupled Neural Asset-Renderer Stack Hong Li Chongjie Ye Houyuan Chen Weiqing Xiao Ziyang Yan ... Yikai Wang Baochang Zhang Xiaoguang Han Jiaolong Yang Hao Zhao 140 0 0 23 Nov 2025
MatPedia: A Universal Generative Foundation for High-Fidelity Material Synthesis D. X. Luo Shuhui Yang M. Yang Jiawei Lu Yixuan Tang Xintong Han Zhuo Chen Beibei Wang Chunchao Guo 144 0 0 21 Nov 2025
OLATverse: A Large-scale Real-world Object Dataset with Precise Lighting Control Xilong Zhou Jianchun Chen Pramod Rao Timo Teufel Linjie Lyu Tigran Minasian Oleksandr Sotnychenko Xiao-Xiao Long Marc Habermann Christian Theobalt 206 1 0 04 Nov 2025
Detail Enhanced Gaussian Splatting for Large-Scale Volumetric CaptureACM Transactions on Graphics (TOG), 2025 Julien Philip Li Ma Pascal Clausen Wenqi Xian Ahmet Levent Taşel ... Xueming Yu David M George Ning Yu Oliver Pilarski P. Debevec 3DGS 3DH 329 0 0 31 Oct 2025
OmniX: From Unified Panoramic Generation and Perception to Graphics-Ready 3D Scenes Yukun Huang Jiwen Yu Yanning Zhou Jianan Wang Xintao Wang Pengfei Wan Xihui Liu VGen 157 0 0 30 Oct 2025
Yesnt: Are Diffusion Relighting Models Ready for Capture Stage Compositing? A Hybrid Alternative to Bridge the Gap Elisabeth Jüttner Leona Krath Stefan Korfhage Hannah Dröge M. Hullin Markus Plack VGen 136 0 0 27 Oct 2025
OBCache: Optimal Brain KV Cache Pruning for Efficient Long-Context LLM Inference Yuzhe Gu Xiyu Liang Jiaojiao Zhao Enmao Diao 122 2 0 09 Oct 2025
One Stone with Two Birds: A Null-Text-Null Frequency-Aware Diffusion Models for Text-Guided Image Inpainting Haipeng Liu Yang Wang M. Y. Wang DiffM 497 4 0 09 Oct 2025
ComGS: Efficient 3D Object-Scene Composition via Surface Octahedral Probes Jian Gao Mengqi Yuan Yifei Zeng Chang Zeng Z. Li ... Weichao Qiu Xiao-Xiao Long Hao Zhu Xun Cao Yao Yao 3DGS 128 0 0 09 Oct 2025
Teamwork: Collaborative Diffusion with Low-rank Coordination and Adaptation Sam Sartor Pieter Peers DiffM 148 1 0 07 Oct 2025
Aerial Path Planning for Urban Geometry and Texture Co-Capture Weidan Xiong Bochuan Zeng Ziyu Hu Jianwei Guo Ke Xie Hui Huang 65 0 0 26 Sep 2025
Physics-Based Decomposition of Reflectance and Shading using a Single Visible-Thermal Image Pair Zeqing Leo Yuan Mani Ramanagopal Aswin Sankaranarayanan Srinivasa G. Narasimhan 84 0 0 12 Sep 2025
Chord: Chain of Rendering Decomposition for PBR Material Estimation from Generated Texture Images Zhi Ying Boxiang Rong Jingyu Wang Maoyuan Xu DiffM 148 2 0 12 Sep 2025
Texture-aware Intrinsic Image Decomposition with Model- and Learning-based Priors Xiaodong Wang Zijun He Xin Yuan 68 0 0 11 Sep 2025
LuxDiT: Lighting Estimation with Video Diffusion Transformer Ruofan Liang Kai He Zan Gojcic Igor Gilitschenski Sanja Fidler Nandita Vijaykumar Zian Wang ViT VGen 115 3 0 03 Sep 2025
PractiLight: Practical Light Control Using Foundational Diffusion Models Yotam Erel Rishabh Dabral Vladislav Golyanik Amit H. Bermano Christian Theobalt 133 1 0 01 Sep 2025
IntrinsicReal: Adapting IntrinsicAnything from Synthetic to Real Objects Xiaokang Wei Zizheng Yan Zhangyang Xiong Yiming Hao Yipeng Qin Xiaoguang Han 124 0 0 31 Aug 2025
StableIntrinsic: Detail-preserving One-step Diffusion Model for Multi-view Material Estimation X. Wu Pengfei Zhu Jiangjing Lyu Xinguo Liu Jie Guo Yanwen Guo Weiwei Xu Chengfei Lyu DiffM 134 1 0 27 Aug 2025
Ouroboros: Single-step Diffusion Models for Cycle-consistent Forward and Inverse Rendering Shanlin Sun Yifan Wang Hanwen Zhang Yifeng Xiong Qin Ren Ruogu Fang Xiaohui Xie Chenyu You 170 3 0 20 Aug 2025
WeatherDiffusion: Controllable Weather Editing in Intrinsic Space Yixin Zhu Zuoliang Zhu Jian Yang Jian Yang J. Xie Beibei Wang 164 0 0 09 Aug 2025
HiMat: DiT-based Ultra-High Resolution SVBRDF Generation Zixiong Wang Jian Yang Yiwei Hu Milos Hasan Beibei Wang 215 0 0 09 Aug 2025
Physically Controllable Relighting of Photographs Chris Careaga Yağız Aksoy 3DH 121 0 0 07 Aug 2025
InvRGB+L: Inverse Rendering of Complex Scenes with Unified Color and LiDAR Reflectance Modeling Xiaoxue Chen Bhargav Chandaka Chih-Hao Lin Ya Zhang David A. Forsyth Hang Zhao Shenlong Wang 3DV 156 0 0 23 Jul 2025
Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Details Zeqiang Lai Yunfei Zhao Haolin Liu Zibo Zhao Qingxiang Lin ... Yuhong Liu Jie Jiang Linus J. Huang Chunchao Guo 202 31 0 19 Jun 2025
NTIRE 2025 Image Shadow Removal Challenge Report Florin-Alexandru Vasluianu Tim Seizinger Z. Zhou C. L. Philip Chen Zongwei Wu ... Suiyi Zhao Bo Wang Yan Luo M. Y. Wang Yilin Zhang 210 22 0 18 Jun 2025
UniRelight: Learning Joint Decomposition and Synthesis for Video Relighting Kai He Ruofan Liang Jacob Munkberg J. Hasselgren Nandita Vijaykumar Alexander Keller Sanja Fidler Igor Gilitschenski Zan Gojcic Zian Wang 212 9 0 18 Jun 2025
StableMTL: Repurposing Latent Diffusion Models for Multi-Task Learning from Partially Annotated Synthetic Datasets Anh-Quan Cao Ivan Lopes Raoul de Charette 211 1 0 09 Jun 2025
Generative Perception of Shape and Material from Differential Motion Xinran Nicole Han Ko Nishino T. Zickler DiffM VGen 365 0 0 03 Jun 2025
Jodi: Unification of Visual Generation and Understanding via Joint Modeling Yifeng Xu Zhenliang He Meina Kan Shiguang Shan Xilin Chen VLM 332 1 0 25 May 2025
LightLab: Controlling Light Sources in Images with Diffusion Models Nadav Magar Amir Hertz Eric Tabellion Yael Pritch Alex Rav-Acha Ariel Shamir Yedid Hoshen 248 9 0 14 May 2025
Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image AnalysisIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2025 Bingxin Ke Kevin Qu Tianfu Wang Nando Metzger Shengyu Huang Bo Li Anton Obukhov Konrad Schindler DiffM VLM 366 31 0 14 May 2025
IntrinsicEdit: Precise generative image manipulation in intrinsic spaceACM Transactions on Graphics (TOG), 2025 Linjie Lyu Valentin Deschaintre Yannick Hold-Geoffroy Jian Yang Jae Shin Yoon Thomas Leimkuhler Christian Theobalt Iliyan Georgiev DiffM 274 4 0 13 May 2025
MeshGen: Generating PBR Textured Mesh with Render-Enhanced Auto-Encoder and Generative Data AugmentationComputer Vision and Pattern Recognition (CVPR), 2025 Zilong Chen Yikai Wang Wenqiang Sun Feng Wang Yiwen Chen Huaping Liu 291 4 0 07 May 2025
ePBR: Extended PBR Materials in Image Synthesis Yu Guo Zhiqiang Lao Xiyun Song Yubin Zhou Zongfang Lin Heather Yu 217 1 0 23 Apr 2025
PRISM: A Unified Framework for Photorealistic Reconstruction and Intrinsic Scene Modeling Alara Dirik Tuanfeng Y. Wang Duygu Ceylan Stefanos Zafeiriou Anna Frühstück DiffM 242 5 0 19 Apr 2025
GaSLight: Gaussian Splats for Spatially-Varying Lighting in HDR Christophe Bolduc Frédéric Fortier-Chouinard Zhixin Shu Jean-François Lalonde 3DGS 503 5 0 15 Apr 2025
MESA: Text-Driven Terrain Generation Using Latent Diffusion and Global Copernicus Data Paul Borne--Pons Mikolaj Czerkawski Rosalie Martin Romain Rouffet DiffM 282 3 0 09 Apr 2025
3D Gaussian Inverse Rendering with Approximated Global Illumination Zirui Wu Jianteng Chen Laijian Li Shaoteng Wu Z. Zhu Kang Xu Martin R. Oswald Jie Song 3DGS 3DV 877 2 0 02 Apr 2025
IntrinsiX: High-Quality PBR Generation using Image Priors Peter Kocsis Lukas Höllein Matthias Nießner 262 9 0 01 Apr 2025
Intrinsic Image Decomposition for Robust Self-supervised Monocular Depth Estimation on Reflective SurfacesAAAI Conference on Artificial Intelligence (AAAI), 2025 Wonhyeok Choi K. Hwang Minwoo Choi Kiljoon Han Wonjoon Choi Mingyu Shin S. Im MDE 232 0 0 28 Mar 2025
MuMA: 3D PBR Texturing via Multi-Channel Multi-View Generation and Agentic Post-Processing Lingting Zhu Jingrui Ye Runze Zhang Zeyu Hu Yingda Yin ... Jinnan Chen Shengju Qian Xin Wang Qingmin Liao L. Yu 285 6 0 24 Mar 2025
PoseTraj: Pose-Aware Trajectory Control in Video DiffusionComputer Vision and Pattern Recognition (CVPR), 2025 Longbin Ji Lei Zhong Pengfei Wei Changjian Li DiffM VGen 259 3 0 20 Mar 2025
Diffusion-based G-buffer generation and rendering Bowen Xue G. C. Guarnera Shuang Zhao Zahra Montazeri DiffM 233 3 0 18 Mar 2025
PBR3DGen: A VLM-guided Mesh Generation with High-quality PBR Texture Xiaokang Wei Bowen Zhang Xiaoyu Yang Yuxuan Wang Chunchao Guo Xi Zhao Yan Luximon 287 1 0 14 Mar 2025
Channel-wise Noise Scheduled Diffusion for Inverse Rendering in Indoor ScenesComputer Vision and Pattern Recognition (CVPR), 2025 JunYong Choi M. Sagong SeokYeong Lee Seung-Won Jung Ig-Jae Kim Junghyun Cho DiffM 223 0 0 13 Mar 2025