DIB-R++: Learning to Predict Lighting and Material with a Hybrid Differentiable Renderer

30 October 2021

Sanja Fidler

Papers citing "DIB-R++: Learning to Predict Lighting and Material with a Hybrid Differentiable Renderer"

45 / 45 papers shown

Title
Model-based Metric 3D Shape and Motion Reconstruction of Wild Bottlenose Dolphins in Drone-Shot Videos Daniele Baieri Riccardo Cicciarella Michael Krützen Emanuele Rodolà Silvia Zuffi 43 0 0 22 Apr 2025
Digital Twin Catalog: A Large-Scale Photorealistic 3D Object Digital Twin Dataset Z. Dong Ka Chen Zhaoyang Lv Hong-Xing Yu Yunzhi Zhang ... Xiaqing Pan Mingfei Yan Jiajun Wu Carl Ren Richard A. Newcombe 42 1 0 11 Apr 2025
GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Rendering Kai Ye Chong Gao Guanbin Li Wenzheng Chen Baoquan Chen 3DGS 26 0 0 31 Oct 2024
Neural Material Adaptor for Visual Grounding of Intrinsic Dynamics Junyi Cao Shanyan Guan Yanhao Ge Wei Li Xiaokang Yang Chao Ma AI4CE 31 5 0 10 Oct 2024
UniVoxel: Fast Inverse Rendering by Unified Voxelization of Scene Representation Shuang Wu Songlin Tang Guangming Lu Jianzhuang Liu Wenjie Pei 37 0 0 28 Jul 2024
Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Models Ziyi Wu Yulia Rubanova Rishabh Kabra Drew A. Hudson Igor Gilitschenski Yusuf Aytar Sjoerd van Steenkiste Kelsey R. Allen Thomas Kipf VGen DiffM 44 10 0 13 Jun 2024
Rasterized Edge Gradients: Handling Discontinuities Differentiably Stanislav Pidhorskyi Tomas Simon Gabriel Schwartz He Wen Yaser Sheikh Jason M. Saragih 3DH 30 4 0 03 May 2024
Learning Topology Uniformed Face Mesh by Volume Rendering for Multi-view Reconstruction Yating Wang Ran Yi Ke Fan Jinkun Hao Jiangbo Lu Lizhuang Ma CVBM 3DH 34 0 0 08 Apr 2024
SIR: Multi-view Inverse Rendering with Decomposable Shadow Under Indoor Intense Lighting Xiaokang Wei Zhuoman Liu Ping Li Yan Luximon 31 0 0 09 Feb 2024
SPAD : Spatially Aware Multiview Diffusers Yash Kant Ziyi Wu Michael Vasilkovsky Guocheng Qian Jian Ren R. A. Guler Bernard Ghanem Sergey Tulyakov Igor Gilitschenski Aliaksandr Siarohin DiffM 24 34 0 07 Feb 2024
Structure from Duplicates: Neural Inverse Graphics from a Pile of Objects Tianhang Cheng Wei-Chiu Ma Kaiyu Guan Antonio Torralba Shenlong Wang 3DV 38 1 0 10 Jan 2024
Diffusion Reflectance Map: Single-Image Stochastic Inverse Rendering of Illumination and Reflectance Yuto Enyo Ko Nishino 3DV 26 2 0 07 Dec 2023
Differentiable Point-based Inverse Rendering Hoon-Gyu Chung Seokjun Choi Seung-Hwan Baek 24 2 0 05 Dec 2023
Reconstructing Objects in-the-wild for Realistic Sensor Simulation Ze Yang S. Manivasagam Yun Chen Jingkang Wang Rui Hu R. Urtasun 26 20 0 09 Nov 2023
CADSim: Robust and Scalable in-the-wild 3D Reconstruction for Controllable Sensor Simulation Jingkang Wang S. Manivasagam Yun Chen Ze Yang Ioan Andrei Bârsan A. Yang Wei-Chiu Ma R. Urtasun 3DV 35 24 0 02 Nov 2023
Stanford-ORB: A Real-World 3D Object Inverse Rendering Benchmark Zhengfei Kuang Yunzhi Zhang Hong-Xing Yu Samir Agarwala Shangzhe Wu Jiajun Wu 18 23 0 24 Oct 2023
Relighting Neural Radiance Fields with Shadow and Highlight Hints Chong Zeng Guojun Chen Yue Dong Pieter Peers Hongzhi Wu Xin Tong 3DH 30 37 0 25 Aug 2023
Differentiable Shadow Mapping for Efficient Inverse Graphics Markus Worchel M. Alexa 13 3 0 21 Aug 2023
NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Images Yuan-Bin Liu Peng Wang Cheng Lin Xiaoxiao Long Jie-Chao Wang Lingjie Liu Taku Komura Wenping Wang 29 115 0 27 May 2023
Inverse Rendering of Translucent Objects using Physical and Neural Renderers Chenhao Li Trung Thanh Ngo Hajime Nagahara 14 8 0 15 May 2023
Tracking by 3D Model Estimation of Unknown Objects in Videos D. Rozumnyi Jirí Matas Marc Pollefeys V. Ferrari Martin R. Oswald 3DPC 17 4 0 13 Apr 2023
Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenes Zian Wang Tianchang Shen Jun Gao S. Huang Jacob Munkberg J. Hasselgren Zan Gojcic Wenzheng Chen Sanja Fidler AI4CE 99 86 0 06 Apr 2023
Partial-View Object View Synthesis via Filtered Inversion Fan-Yun Sun Jonathan Tremblay Valts Blukis Kevin Qinghong Lin Danfei Xu ... Ruohan Zhang Yunzhu Li Jiajun Wu Marco Pavone Nick Haber 20 0 0 03 Apr 2023
VDN-NeRF: Resolving Shape-Radiance Ambiguity via View-Dependence Normalization Bingfan Zhu Yanchao Yang Xulong Wang Youyi Zheng Leonidas J. Guibas 25 16 0 31 Mar 2023
Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation Rui Chen Y. Chen Ningxin Jiao K. Jia DiffM 39 559 0 24 Mar 2023
Efficient Meshy Neural Fields for Animatable Human Avatars Xiaoke Huang Yiji Cheng Yansong Tang Xiu Li Jie Zhou Jiwen Lu 3DH 16 1 0 23 Mar 2023
A Review of Deep Learning-Powered Mesh Reconstruction Methods Zhiqin Chen 3DV 35 2 0 06 Mar 2023
Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinement Jiaxiang Tang Hang Zhou Xiaokang Chen Tianshu Hu Errui Ding Jingdong Wang Gang Zeng 32 115 0 03 Mar 2023
Relightable Neural Human Assets from Multi-view Gradient Illuminations Taotao Zhou Kai He Di Wu Teng Xu Qixuan Zhang Kuixiang Shao Wenzheng Chen Lan Xu Jingyi Yi 3DH 25 14 0 15 Dec 2022
Learning to Rasterize Differentiably Chenghao Wu Hamila Mailee Zahra Montazeri Tobias Ritschel 11 0 0 23 Nov 2022
Shape, Pose, and Appearance from a Single Image via Bootstrapped Radiance Field Inversion Dario Pavllo D. Tan Marie-Julie Rakotosaona F. Tombari 3DH 21 29 0 21 Nov 2022
TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decomposition Y. Chen Rui Chen Jiabao Lei Yabin Zhang K. Jia CLIP 19 81 0 20 Oct 2022
LION: Latent Point Diffusion Models for 3D Shape Generation Xiaohui Zeng Arash Vahdat Francis Williams Zan Gojcic Or Litany Sanja Fidler Karsten Kreis DiffM 44 485 0 12 Oct 2022
GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Images Jun Gao Tianchang Shen Zian Wang Wenzheng Chen K. Yin Daiqing Li Or Litany Zan Gojcic Sanja Fidler 36 438 0 22 Sep 2022
Neural Light Field Estimation for Street Scenes with Differentiable Virtual Object Insertion Zian Wang Wenzheng Chen David Acuna Jan Kautz Sanja Fidler 3DPC 26 37 0 19 Aug 2022
DM-NeRF: 3D Scene Geometry Decomposition and Manipulation from 2D Images Bing Wang Lujia Chen Bo-Hsiang Yang 19 65 0 15 Aug 2022
SNeS: Learning Probably Symmetric Neural Surfaces from Incomplete Data Eldar Insafutdinov Dylan Campbell João F. Henriques Andrea Vedaldi 3DV 14 11 0 13 Jun 2022
Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoising J. Hasselgren Nikolai Hofmann Jacob Munkberg 3DV 24 160 0 07 Jun 2022
NeILF: Neural Incident Light Field for Physically-based Material Estimation Yao Yao Jingyang Zhang Jingbo Liu Yihang Qu Tian Fang David McKinnon Yanghai Tsin Long Quan 34 87 0 14 Mar 2022
De-rendering 3D Objects in the Wild Felix Wimbauer Shangzhe Wu Christian Rupprecht 11 29 0 06 Jan 2022
Extracting Triangular 3D Models, Materials, and Lighting From Images Jacob Munkberg J. Hasselgren Tianchang Shen Jun Gao Wenzheng Chen Alex Evans Thomas Müller Sanja Fidler 37 370 0 24 Nov 2021
Learning Indoor Inverse Rendering with 3D Spatially-Varying Lighting Zian Wang Jonah Philion Sanja Fidler Jan Kautz 3DV 99 81 0 13 Sep 2021
Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering Yuxuan Zhang Wenzheng Chen Huan Ling Jun Gao Yinan Zhang Antonio Torralba Sanja Fidler DRL 98 138 0 18 Oct 2020
A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras S. Laine Timo Aila 276 10,348 0 12 Dec 2018
Image-to-Image Translation with Conditional Adversarial Networks Phillip Isola Jun-Yan Zhu Tinghui Zhou Alexei A. Efros SSeg 212 19,447 0 21 Nov 2016