Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Correcting Data Corruption Errors for Multivariate Function Approximation

Published: 01 January 2016 Publication History

Abstract

We discuss the problem of constructing an accurate function approximation when data are corrupted by unexpected errors. The unexpected corruption errors are different from the standard observational noise in the sense that they can have much larger magnitude and in most cases are sparse. By focusing on overdetermined case, we prove that the sparse corruption errors can be effectively eliminated by using $\ell_1$-minimization, also known as the least absolute deviations method. In particular, we establish probabilistic error bounds of the $\ell_1$-minimization solution with the corrupted data. Both the lower bound and the upper bound are related only to the errors of the $\ell_1$- and $\ell_2$-minimization solutions with respect to the uncorrupted data and the sparsity of the corruption errors. This ensures that the $\ell_1$-minimization solution with the corrupted data are close to the regression results with uncorrupted data, thus effectively eliminating the corruption errors. Several numerical examples are presented to verify the theoretical finding.

References

[1]
N. Abdelmalek, On the discrete linear $l_1$ approximation and $l_1$ solutions of overdetermined linear equations, J. Approx. Theory, 11 (1974), pp. 38--53.
[2]
I. Barrodale and F. Roberts, An improved algorithm for discrete $l_1$ linear approximation, SIAM J. Numer. Anal., 10 (1973), pp. 839--848.
[3]
G. Bassett and R. Koenker, Asymptotic theory of least absolute error regression, J. Amer. Statist. Assoc., 73 (1978), pp. 618--622.
[4]
P. Bloomfield and W. Steiger, Least absolute deviations curve-titting, SIAM J. Sci. Comput., 1 (1980), pp. 290--301.
[5]
P. Bloomfield and W. Steiger, Least Absolute Deviations: Theory, Applications and Algorithms, Birkhauser, Basel, 1983.
[6]
J. Cadzow, Minimum $\ell_1$, $\ell_2$, and $\ell_\infty$ norm approximate solutions to an overdetermined system of linear equations, Digital Signal Proc., 12 (2002), pp. 524--560.
[7]
E. Candès, The restricted isometry property and its implications for compressed sensing, C. R. Math., 346 (2008), pp. 589--592.
[8]
E. Candès and J. Romberg, l1-Magic: Recovery of Sparse Signals via Convex Programming, www. acm. caltech. edu/l1magic/downloads/l1magic.pdf (2005).
[9]
E. Candès, M. Rudelson, T. Tao, and R. Vershynin, Error correction via linear programming, in Proceedings of the 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05), Pittsburh, PA, 2005, pp. 668--681.
[10]
E. Candès and T. Tao, Decoding by linear programming, IEEE Trans. Inform. Theory, 51 (2005), pp. 4203--4215.
[11]
A. Charnes, W. Cooper, and R. Ferguson, Optimal estimation of executive compensation by linear programming, Management Sci., 1 (1955), pp. 138--151.
[12]
A. Cohen, M. A. Davenport, and D. Leviatan, On the stability and accuracy of least squares approximations, Found. Comput. Math., 13 (2013), pp. 819--834.
[13]
D. Cox, Principles of Statistical Inference, Cambridge University Press, Cambridge, UK, 2006.
[14]
D. Freedman, Statistical Models: Theory and Practice, Cambridge University Press, Cambridge, UK, 2005.
[15]
A. Gelman, Analysis of variance? why it is more important than ever, Ann. Statist., 33 (2005), p. 153.
[16]
A. Genz, Testing multidimensional integration routines, in Tools, Methods, and Languages for Scientific and Engineering Computation, B. Ford, J. Rault, and F. Thomasset, eds., North-Holland, Amsterdam, 1984, pp. 81--94.
[17]
S. Narula and J. Wellington, The minimum sum of absolute errors regression: A state of the art survey, Int. Statist. Rev., 50 (1982), pp. 317--326.
[18]
M. Osborne and G. Watson, On an algorithm for discrete nonlinear $l_1$ approximation, Computer J., 14 (1971), pp. 184--188.
[19]
D. Pollard, Asymptotics for least absolute deviation regression estimators, Econometric Theory, 7 (1991), pp. 186--199.
[20]
S. Portnoy and R. Koenker, The Gaussian hare and the Laplacian tortoise: Computability of squared-error vs. absolute-error estimators, with discussion, Statist. Sci., 12 (1997), pp. 279--300.
[21]
J. Powell, Least absolute deviations estimation for the censored regression model, J. Econometrics, 25 (1984), pp. 303--325.
[22]
H. Scheffe, The Analysis of Variance, Wiley, New York, 1959.
[23]
K. Spyropoulos, E. Kiountouzis, and A. Young, Discrete approximation in the $l_1$ norm, Computer J., 16 (1972), pp. 180--186.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image SIAM Journal on Scientific Computing
SIAM Journal on Scientific Computing  Volume 38, Issue 4
DOI:10.1137/sjoce3.38.4
Issue’s Table of Contents

Publisher

Society for Industrial and Applied Mathematics

United States

Publication History

Published: 01 January 2016

Author Tags

  1. error correction
  2. linear regression
  3. $\ell_1$-minimization
  4. least absolute deviations
  5. least squares

Author Tags

  1. 65D05
  2. 42C05
  3. 41A10

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media