It has recently been proved that the popular nonlocal means (NLM) denoising
algorithm does not optimally denoise images with sharp edges. Its weakness lies
in the isotropic nature of the neighborhoods it uses to set its smoothing
weights. In response, in this paper we introduce several theoretical and
practical anisotropic nonlocal means (ANLM) algorithms and prove that they are
near minimax optimal for edge-dominated images from the Horizon class. On
real-world test images, an ANLM algorithm that adapts to the underlying image
gradients outperforms NLM by a significant margin.
We conduct an asymptotic risk analysis of the nonlocal means image denoising
algorithm for the Horizon class of images that are piecewise constant with a
sharp edge discontinuity. We prove that the mean square risk of an optimally
tuned nonlocal means algorithm decays according to $n^{-1}\log^{1/2+\epsilon}
n$, for an $n$-pixel image with $\epsilon>0$. This decay rate is an improvement
over some of the predecessors of this algorithm, including the linear
convolution filter, median filter, and the SUSAN filter, each of which provides
a rate of only $n^{-2/3}$.
We consider the compressed sensing problem, where the object $x_0 \in \bR^N$
is to be recovered from incomplete measurements $y = Ax_0 + z$; here the
sensing matrix $A$ is an $n \times N$ random matrix with iid Gaussian entries
and $n < N$. A popular method of sparsity-promoting reconstruction is
$\ell^1$-penalized least-squares reconstruction (aka LASSO, Basis Pursuit).
Consider the noisy underdetermined system of linear equations: y=Ax0 + z0,
with n x N measurement matrix A, n < N, and Gaussian white noise z0 ~
N(0,\sigma^2 I). Both y and A are known, both x0 and z0 are unknown, and we
seek an approximation to x0. When x0 has few nonzeros, useful approximations
are obtained by l1-penalized l2 minimization, in which the reconstruction \hxl
solves min || y - Ax||^2/2 + \lambda ||x||_1.
In a recent paper, the authors proposed a new class of low-complexity
iterative thresholding algorithms for reconstructing sparse signals from a
small set of linear measurements \cite{DMM}. The new algorithms are broadly
referred to as AMP, for approximate message passing. This is the first of two
conference papers describing the derivation of these algorithms, connection
with the related literature, extensions of the original framework, and new
empirical evidence.
In a recent paper, the authors proposed a new class of low-complexity
iterative thresholding algorithms for reconstructing sparse signals from a
small set of linear measurements \cite{DMM}. The new algorithms are broadly
referred to as AMP, for approximate message passing. This is the second of two
conference papers describing the derivation of these algorithms, connection
with related literature, extensions of original framework, and new empirical
evidence.
We conducted an extensive computational experiment, lasting multiple
CPU-years, to optimally select parameters for two important classes of
algorithms for finding sparse solutions of underdetermined systems of linear
equations. We make the optimally tuned implementations available at {\tt
sparselab.stanford.edu}; they run `out of the box' with no user tuning: it is
not necessary to select thresholds or know the likely degree of sparsity.