Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
article

Improving A OMP

Published: 01 January 2016 Publication History
  • Get Citation Alerts
  • Abstract

    Best-first search has been recently utilized for compressed sensing (CS) by the A orthogonal matching pursuit ( A OMP ) algorithm. In this work, we concentrate on theoretical and empirical analyses of A OMP . We present a restricted isometry property (RIP) based general condition for exact recovery of sparse signals via A OMP . In addition, we develop online guarantees which promise improved recovery performance with the residue-based termination instead of the sparsity-based one. We demonstrate the recovery capabilities of A OMP with extensive recovery simulations using the adaptive-multiplicative (AMul) cost model, which effectively compensates for the path length differences in the search tree. The presented results, involving phase transitions for different nonzero element distributions as well as recovery rates and average error, reveal not only the superior recovery accuracy of A OMP, but also the improvements with the residue-based termination and the AMul cost model. Comparison of the run times indicates the speed up by the AMul cost model. We also demonstrate a hybrid of OMP and A OMP to accelerate the search further. Finally, we run A OMP on sparse images to illustrate its recovery performance for more realistic coefficient distributions. HighlightsWe analyze the empirical and theoretical performance of A OMP in sparse recovery.RIP-based theoretical analysis provides recovery guarantees for A OMP .The introduced novel dynamic cost model improves recovery performance significantly.Results of computationally expensive experiments are presented by phase transitions. A OMP outperforms conventional methods in a wide range of sparse recovery scenarios.

    References

    [1]
    N.B. Karahanoglu, H. Erdogan, A* orthogonal matching pursuit, Digit. Signal Process., 22 (2012) 555-568.
    [2]
    Y.C. Pati, R. Rezaiifar, P.S. Krishnaprasad, Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition, in: Proceedings of the 27th Asilomar Conference on Signals, Systems and Computers, Los Alamitos, CA, vol. 1, 1993, pp. 40-44.
    [3]
    P.E. Hart, N.J. Nilsson, B. Raphael, A formal basis for the heuristic determination of minimum cost paths, IEEE Trans. Syst. Sci. Cybern., 4 (1968) 100-107.
    [4]
    F. Jelinek, Statistical Methods For Speech Recognition, MIT Press, Cambridge, MA, USA, 1997.
    [5]
    N.B. Karahanoglu, H. Erdogan, A comparison of termination criteria for A * OMP, in: European Signal Processing Conference, Bucharest, Romania, August 2012.
    [6]
    S. Chen, D. Donoho, M. Saunders, Atomic decomposition by basis pursuit, SIAM J. Sci. Comput., 20 (1998) 33-61.
    [7]
    E. Candès, T. Tao, Decoding by linear programming, IEEE Trans. Inf. Theory, 51 (2005) 4203-4215.
    [8]
    D. Donoho, Compressed sensing, IEEE Trans. Inf. Theory, 52 (2006) 1289-1306.
    [9]
    J.A. Tropp, Algorithms for simultaneous sparse approximation. Part ii, Signal Process., 86 (2006) 589-602.
    [10]
    W. Dai, O. Milenkovic, Subspace pursuit for compressive sensing signal reconstruction, IEEE Trans. Inf. Theory, 55 (2009) 2230-2249.
    [11]
    T. Blumensath, M.E. Davies, Iterative hard thresholding for compressed sensing, Appl. Comput. Harmonic Anal., 27 (2009) 265-274.
    [12]
    N.B. Karahanoglu, H. Erdogan, Compressed sensing signal recovery via forward-backward pursuit, Digit. Signal Process., 23 (2013) 1539-1548.
    [13]
    D. Sundman, S. Chatterjee, M. Skoglund, Distributed greedy pursuit algorithms, Signal Process., 105 (2014) 298-315.
    [14]
    J.A. Tropp, A.C. Gilbert, M.J. Strauss, Algorithms for simultaneous sparse approximation. Part i, Signal Process., 86 (2006) 572-588.
    [15]
    S. Ji, Y. Xue, L. Carin, Bayesian compressive sensing, IEEE Trans. Signal Process., 56 (2008) 2346-2356.
    [16]
    S.D. Babacan, R. Molina, A.K. Katsaggelos, Bayesian compressive sensing using Laplace priors, IEEE Trans. Image Process., 19 (2010) 53-63.
    [17]
    H. Mohimani, M. Babaie-Zadeh, C. Jutten, A fast approach for overcomplete sparse decomposition based on smoothed l0 norm, IEEE Trans. Signal Process., 57 (2009) 289-301.
    [18]
    M.R. Mohammadi, E. Fatemizadeh, M.H. Mahoor, Non-negative sparse decomposition based on constrained smoothed ¿ 0 norm, Signal Process., 100 (2014) 42-50.
    [19]
    L.B. Montefusco, D. Lazzaro, S. Papi, A fast algorithm for nonconvex approaches to sparse recovery problems, Signal Process., 93 (2013) 2636-2647.
    [20]
    T. Ince, A. Nacaroglu, N.l. Watsuji, Nonconvex compressed sensing with partially known signal support, Signal Process., 93 (2013) 338-344.
    [21]
    Y. Wang, W. Yin, Sparse signal reconstruction via iterative support detection, SIAM J. Imaging Sci., 3 (2010) 462-491.
    [22]
    E. Candés, M. Wakin, S. Boyd, Enhancing sparsity by reweighted ¿ 1 minimization, J. Fourier Anal. Appl., 14 (2008) 877-905.
    [23]
    J. Fang, Y. Shen, H. Li, Z. Ren, Sparse signal recovery from one-bit quantized data, Signal Process., 102 (2014) 201-206.
    [24]
    J.A. Tropp, A.C. Gilbert, Signal recovery from random measurements via orthogonal matching pursuit, IEEE Trans. Inf. Theory, 53 (2007) 4655-4666.
    [25]
    M.A. Davenport, M.B. Wakin, Analysis of orthogonal matching pursuit using the restricted isometry property, IEEE Trans. Inf. Theory, 56 (2010) 4395-4401.
    [26]
    J. Wang, B. Shim, On the recovery limit of sparse signals using orthogonal matching pursuit, IEEE Trans. Signal Process., 60 (2012) 4973-4976.
    [27]
    S.F. Cotter, B.D. Rao, Application of tree-based searches to matching pursuit, in: 2001 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2001, pp. 3933-3936.
    [28]
    S. Kwon, J. Wang, B. Shim, Multipath matching pursuit, IEEE Trans. Inf. Theory, 60 (2014) 2986-3001.
    [29]
    N.B. Karahanoglu, H. Erdogan, Online Recovery Guarantees for Orthogonal Matching Pursuit, Preprint {http://arxiv.org/abs/1210.5991}, 2013.
    [30]
    M. Rudelson, R. Vershynin, Sparse reconstruction by convex relaxation: Fourier and Gaussian measurements, in: 40th Annual Conference on Information Sciences and Systems, 2006, pp. 207-212.
    [31]
    E. Candès, T. Tao, Near-optimal signal recovery from random projections, IEEE Trans. Inf. Theory, 52 (2006) 5406-5425.
    [32]
    W. Xu, Y. Tian, J. Lin, Performance analysis of partial segmented compressed sampling, Signal Process., 93 (2013) 2653-2663.
    [33]
    Y. Wang, J. Wang, Z. Xu, Restricted p-isometry properties of nonconvex block-sparse compressed sensing, Signal Process., 104 (2014) 188-196.
    [34]
    R. Sedgewick, K. Wayne, Algorithms, Addison-Wesley Professional, Westford, Massachusetts, USA, 2011.
    [35]
    A. Maleki, D.L. Donoho, Optimally tuned iterative reconstruction algorithms for compressed sensing, IEEE J. Sel. Top. Signal Process., 4 (2010) 330-341.
    [36]
    N.B. Karahanoglu, Search-Based Methods for the Sparse Signal Recovery Problem in Compressed Sensing (Ph.D. thesis), Sabanci University, Istanbul, Turkey, January 2013.

    Cited By

    View all
    • (2018)Polynomial dictionary learning algorithms in sparse representationsSignal Processing10.1016/j.sigpro.2017.08.011142:C(492-503)Online publication date: 1-Jan-2018
    • (2017)Nonlinear regression A*OMP for compressive sensing signal reconstructionDigital Signal Processing10.5555/3138885.313904469:C(11-21)Online publication date: 1-Oct-2017

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Signal Processing
    Signal Processing  Volume 118, Issue C
    January 2016
    294 pages

    Publisher

    Elsevier North-Holland, Inc.

    United States

    Publication History

    Published: 01 January 2016

    Author Tags

    1. A ⋆ orthogonal matching pursuit
    2. Adaptive-multiplicative cost model
    3. Compressed sensing
    4. Restricted isometry property

    Qualifiers

    • Article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0

    Other Metrics

    Citations

    Cited By

    View all
    • (2018)Polynomial dictionary learning algorithms in sparse representationsSignal Processing10.1016/j.sigpro.2017.08.011142:C(492-503)Online publication date: 1-Jan-2018
    • (2017)Nonlinear regression A*OMP for compressive sensing signal reconstructionDigital Signal Processing10.5555/3138885.313904469:C(11-21)Online publication date: 1-Oct-2017

    View Options

    View options

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media