PACO: Global Signal Restoration via PAtch COnsensus

Many signal processing algorithms break the target signal into overlapping segments (also called windows, or patches), process them separately, and then stitch them back into place to produce a unified output. At the overlaps, the final value of those samples that are estimated more than once needs to be decided in some way. Averaging, the simplest approach, tends to produce blurred results. Significant work has been devoted to this issue in recent years: several works explore the idea of a weighted average of the overlapped patches and/or pixels; a more recent approach is to promote agreement (consensus) between the patches at their intersections. This work investigates the case where consensus is imposed as a hard constraint on the restoration problem. This leads to a general framework applicable to all sorts of signals, problems, decomposition strategies, and featuring a number of theoretical and practical advantages over other similar methods. The framework itself consists of a general optimization problem and a simple and efficient \admm-based algorithm for solving it. We also show that the consensus step of the algorithm, which is the main bottleneck of similar methods, can be solved efficiently and easily for any arbitrary patch decomposition scheme. As an example of the potential of our framework, we propose a method for filling missing samples (inpainting) which can be applied to signals of any dimension, and show its effectiveness on audio, image and video signals.