David L. Donoho

  1. Information-Theoretically Optimal Compressed Sensing via Spatial Coupling and Approximate Message Passing.

    Authors: David L. Donoho, Andrea Montanari, Adel Javanmard
    Subjects: Information Theory
    Abstract

    We study the compressed sensing reconstruction problem for a broad class of
    random, band-diagonal sensing matrices. This construction is inspired by the
    idea of spatial coupling in coding theory. As demonstrated heuristically and
    numerically by Krzakala et al. \cite{KrzakalaEtAl}, message passing algorithms
    can effectively solve the reconstruction problem for spatially coupled
    measurements with undersampling rates close to the fraction of non-zero
    coordinates.

  2. The Noise-Sensitivity Phase Transition in Compressed Sensing.

    Authors: Arian Maleki, David L. Donoho, Andrea Montanari
    Subjects: Statistics
    Abstract

    Consider the noisy underdetermined system of linear equations: y=Ax0 + z0,
    with n x N measurement matrix A, n < N, and Gaussian white noise z0 ~
    N(0,\sigma^2 I). Both y and A are known, both x0 and z0 are unknown, and we
    seek an approximation to x0. When x0 has few nonzeros, useful approximations
    are obtained by l1-penalized l2 minimization, in which the reconstruction \hxl
    solves min || y - Ax||^2/2 + \lambda ||x||_1.

  3. Message Passing Algorithms for Compressed Sensing: I. Motivation and Construction.

    Authors: Arian Maleki, David L. Donoho, Andrea Montanari
    Subjects: Information Theory
    Abstract

    In a recent paper, the authors proposed a new class of low-complexity
    iterative thresholding algorithms for reconstructing sparse signals from a
    small set of linear measurements \cite{DMM}. The new algorithms are broadly
    referred to as AMP, for approximate message passing. This is the first of two
    conference papers describing the derivation of these algorithms, connection
    with the related literature, extensions of the original framework, and new
    empirical evidence.

  4. Message Passing Algorithms for Compressed Sensing: II. Analysis and Validation.

    Authors: Arian Maleki, David L. Donoho, Andrea Montanari
    Subjects: Information Theory
    Abstract

    In a recent paper, the authors proposed a new class of low-complexity
    iterative thresholding algorithms for reconstructing sparse signals from a
    small set of linear measurements \cite{DMM}. The new algorithms are broadly
    referred to as AMP, for approximate message passing. This is the second of two
    conference papers describing the derivation of these algorithms, connection
    with related literature, extensions of original framework, and new empirical
    evidence.

  5. Optimally Tuned Iterative Reconstruction Algorithms for Compressed Sensing.

    Authors: Arian Maleki, David L. Donoho
    Subjects: Numerical Analysis
    Abstract

    We conducted an extensive computational experiment, lasting multiple
    CPU-years, to optimally select parameters for two important classes of
    algorithms for finding sparse solutions of underdetermined systems of linear
    equations. We make the optimally tuned implementations available at {\tt
    sparselab.stanford.edu}; they run `out of the box' with no user tuning: it is
    not necessary to select thresholds or know the likely degree of sparsity.

Syndicate content