Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Remark on Algorithm 1012: Computing Projections with Large Datasets

Published: 28 June 2024 Publication History

Abstract

In ACM TOMS Algorithm 1012, the DELAUNAYSPARSE software is given for performing Delaunay interpolation in medium to high dimensions. When extrapolating outside the convex hull of the training set, DELAUNAYSPARSE calls the nonnegative least squares solver DWNNLS to compute projections onto the convex hull. However, DWNNLS and many other available sum-of-squares optimization solvers were not intended for usage with many variable problems, which result from the large training sets that are typical in machine learning applications. Thus, a new PROJECT subroutine is given, based on the highly customizable quadratic program solver BQPD. This solution is shown to be as robust as DELAUNAYSPARSE for projection onto both synthetic and real-world datasets, where other available solvers frequently fail. Although it is intended as an update for DELAUNAYSPARSE, due to the difficulty and prevalence of the problem, this solution is likely to be of external interest as well.

References

[1]
Tyler H. Chang, Layne T. Watson, Thomas C. H. Lux, Ali R. Butt, Kirk W. Cameron, and Yili Hong. 2020. Algorithm 1012: DELAUNAYSPARSE: Interpolation via a sparse subset of the Delaunay triangulation in medium to high dimensions. ACM Transactions on Mathematical Software (TOMS) 46, 4, Article 38 (2020), 20 pages. DOI:
[2]
Tyler H. Chang, Layne T. Watson, Thomas C. H. Lux, Bo Li, Li Xu, Ali R. Butt, Kirk W. Cameron, and Yili Hong. 2018. A polynomial time algorithm for multivariate interpolation in arbitrary dimension via the Delaunay triangulation. In Proceedings of the ACM Southeast Conference (ACMSE ’18). ACM, Article 12, 8 pages. DOI:
[3]
Steven Diamond and Stephen Boyd. 2016. CVXPY: A Python-embedded modeling language for convex optimization. Journal of Machine Learning Research 17, 83 (2016), 1–5. Retrieved from http://jmlr.org/papers/v17/15-408.html
[4]
Alexander Domahidi, Eric Chu, and Stephen Boyd. 2013. ECOS: An SOCP solver for embedded systems. In Proceedings of the European Control Conference (ECC ’13). IEEE, 3071–3076. DOI:
[5]
Herbert Edelsbrunner and Ernst P. Mücke. 1990. Simulation of simplicity: A technique to cope with degenerate cases in geometric algorithms. ACM Transactions on Graphics (TOG) 9, 1 (1990), 66–104. DOI:
[6]
Roger Fletcher. 1993. Resolving degeneracy in quadratic programming. Annals of Operations Research 46 (1993), 307–334. DOI:
[7]
Roger Fletcher. 2000. Stable reduced Hessian updates for indefinite quadratic programming. Mathematical Programming 87 (2000), 251–264.
[8]
Richard J. Hanson and Karen H. Haskell. 1982. Algorithm 587: Two algorithms for the linearly constrained least squares problem. ACM Transactions on Mathematical Software (TOMS) 8, 3 (1982), 323–333. DOI:
[9]
Thomas C. H. Lux, Layne T. Watson, Tyler H. Chang, Jon Bernard, Bo Li, Li Xu, Godmar Back, Ali R. Butt, Kirk W. Cameron, and Yili Hong. 2021. Interpolation of sparse high-dimensional data. Numerical Algorithms 88, 1 (2021), 281–313. DOI:
[10]
Brendan O’Donoghue, Eric Chu, Neal Parikh, and Stephen Boyd. 2016. Conic optimization via operator splitting and homogeneous self-dual embedding. Journal of Optimization Theory and Applications 169, 3 (June 2016), 1042–1068. DOI:
[11]
Bartolomeo Stellato, Goran Banjac, Paul Goulart, Alberto Bemporad, and Stephen Boyd. 2020. OSQP: An operator splitting solver for quadratic programs. Mathematical Programming Computation 12, 4 (2020), 637–672. DOI:
[12]
Mahbod Tavallaee, Ebrahim Bagheri, Wei Lu, and Ali A. Ghorbani. 2009. A detailed analysis of the KDD CUP 99 data set. In Proceedings of the IEEE Symposium on Computational Intelligence for Security and Defense Applications. IEEE, Ottawa, ON, Canada, 1–6. DOI:

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Mathematical Software
ACM Transactions on Mathematical Software  Volume 50, Issue 2
June 2024
178 pages
EISSN:1557-7295
DOI:10.1145/3613551
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2024
Online AM: 22 April 2024
Accepted: 12 March 2024
Revised: 23 October 2023
Received: 23 October 2023
Published in TOMS Volume 50, Issue 2

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Delaunay interpolation
  2. projection
  3. quadratic programming
  4. data skew

Qualifiers

  • Research-article

Funding Sources

  • U.S. Department of Energy, Office of Science, Advanced Scientific Computing Research

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 102
    Total Downloads
  • Downloads (Last 12 months)102
  • Downloads (Last 6 weeks)7
Reflects downloads up to 01 Jan 2025

Other Metrics

Citations

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media