271

Implicit Image-to-Image Schrodinger Bridge for Image Restoration

Pattern Recognition (Pattern Recogn.), 2024
Abstract

Diffusion-based models are widely recognized for their effectiveness in image restoration tasks; however, their iterative denoising process, which begins from Gaussian noise, often results in slow inference speeds. The Image-to-Image Schr\"odinger Bridge (I2^2SB) presents a promising alternative by starting the generative process from corrupted images and leveraging training techniques from score-based diffusion models. In this paper, we introduce the Implicit Image-to-Image Schr\"odinger Bridge (I3^3SB) to further accelerate the generative process of I2^2SB. I3^3SB reconfigures the generative process into a non-Markovian framework by incorporating the initial corrupted image into each step, while ensuring that the marginal distribution aligns with that of I2^2SB. This allows for the direct use of the pretrained network from I2^2SB. Extensive experiments on natural images, human face images, and medical images validate the acceleration benefits of I3^3SB. Compared to I2^2SB, I3^3SB achieves the same perceptual quality with fewer generative steps, while maintaining equal or improved fidelity to the ground truth.

View on arXiv
Comments on this paper