Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
article

A linear-space algorithm for distance preserving graph embedding

Published: 01 May 2009 Publication History

Abstract

The distance preserving graph embedding problem is to embed the vertices of a given weighted graph onto points in d-dimensional Euclidean space for a constant d such that for each edge the distance between their corresponding endpoints is as close to the weight of the edge as possible. If the given graph is complete, that is, if the weights are given as a full matrix, then multi-dimensional scaling [Trevor Cox, Michael Cox, Multidimensional Scaling, second ed., Chapman & Hall CRC, 2001] can minimize the sum of squared embedding errors in quadratic time. A serious disadvantage of this approach is its quadratic space requirement. In this paper we develop a linear-space algorithm for this problem for the case when the weight of any edge can be computed in constant time. A key idea is to partition a set of n objects into O(n) disjoint subsets (clusters) of size O(n) such that the minimum inter cluster distance is maximized among all possible such partitions. Experimental results are included comparing the performance of the newly developed approach to the performance of the well-established least-squares multi-dimensional scaling approach [Trevor Cox, Michael Cox, Multidimensional Scaling, second ed., Chapman & Hall CRC, 2001] using three different applications. Although least-squares multi-dimensional scaling gave slightly more accurate results than our newly developed approach, least-squares multi-dimensional scaling ran out of memory for data sets larger than 15@?000 vertices.

References

[1]
Tetsuo Asano, Binay Bhattacharya, Mark Keil, Frances Yao, Clustering algorithms based on minimum and maximum spanning trees, in: SCG '88: Proceedings of the Fourth Annual Symposium on Computational Geometry, 1988, pp. 252--257
[2]
Zouhour Ben Azouz, Prosenjit Bose, Chang Shu, Stefanie Wuhrer, Approximations of geodesic distances for incomplete triangular manifolds, in: Proceedings of the 19th Canadian Conference on Computational Geometry, 2007, pp. 177--180
[3]
Holger Bast, Dimension reduction: A powerful principle for automatically finding concepts in unstructured data, in: Proc. International Workshop on Self-Properties in Complex Information Systems (SELF-STAR 2004), 2004, pp. 113--116
[4]
Borg, Ingwer and Groenen, Patrick, Modern Multidimensional Scaling Theory and Applications. 1997. Springer.
[5]
Alexander M. Bronstein, Michael M. Bronstein, Ron Kimmel, Expression-invariant 3d face recognition, in: Proceedings of the Audio- and Video-based Biometric Person Authentication, Lecture Notes in Computer Science, vol. 2688, 2003, pp. 62--69
[6]
Bronstein, Alexander M., Bronstein, Michael M. and Kimmel, Ron, Three-dimensional face recognition. International Journal of Computer Vision. v64 i1. 5-30.
[7]
Alexander M. Bronstein, Michael M. Bronstein, Ron Kimmel, Robust expression-invariant face recognition from partially missing data, in: Proceedings of the European Conference on Computer Vision, 2006, pp. 396--408
[8]
Bronstein, Alexander M., Bronstein, Michael M., Kimmel, Ron and Yavneh, Irad, Multigrid multidimensional scaling. Numerical Linear Algebra with Applications. v13 i2--3. 149-171.
[9]
Buja, Andreas, Swayne, Deborah, Littman, Michael, Dean, Nate, Hofmann, Heike and Chen, Lisha, Interactive data visualization with multidimensional scaling. Journal of Computational and Graphical Statistics. v17 i2. 444-472.
[10]
Mihai Badoiu, Erik D. Demaine, Mohammad Taghi Hajiaghayi, Piotr Indyk, Low-dimensional embedding with extra information, in: SCG '04: Proceedings of the Twentieth Annual Symposium on Computational Geometry, 2004, pp. 320--329
[11]
Mihai Badoiu, Kedar Dhamdhere, Anupam Gupta, Yuri Rabinovich, Harald Räcke, R. Ravi, Anastasios Sidiropoulos, Approximation algorithms for low-distortion embeddings into low-dimensional spaces, in: SODA '05: Proceedings of the Sixteenth Annual ACM--SIAM Symposium on Discrete Algorithms, 2005, pp. 119--128
[12]
Cox, Trevor and Cox, Michael, Multidimensional Scaling. 2001. second ed. Chapman & Hall CRC.
[13]
Duda, Richard, Hart, Peter and Stork, David, Pattern Classification. 2001. second ed. John Wiley & Sons, Inc.
[14]
Elad, Asi and Kimmel, Ron, On bending invariant signatures for surfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence. v25 i10. 1285-1295.
[15]
Gonzalez, Teofilo, Clustering to minimize the maximum inter cluster distance. Theoretical Computer Science. v38. 293-306.
[16]
Gower, John C., Adding a point to vector diagrams in multivariate analysis. Biometrika. v55 i3. 582-585.
[17]
Groenen, Patrick and Franses, Philip H., Visualizing time-varying correlations across stock markets. Journal of Empirical Finance. v7. 155-172.
[18]
Hochbaum, Dorit S. and Shmoys, David B., A unified approach to approximation algorithms for bottleneck problems. Journal of the ACM. v33 i3. 533-550.
[19]
Kimmel, Ron and Sethian, James, Computing geodesic paths on manifolds. National Academy of Sciences. v95. 8431-8435.
[20]
Kleinberg, Jon and Tardos, Eva, Algorithm Design. 2005. Addison-Wesley.
[21]
Kruskal, Joseph and Wish, Myron, Multidimensional Scaling. 1978. Sage.
[22]
Liu, Dong C. and Nocedal, Jorge, On the limited memory method for large scale optimization. Mathematical Programming. v45. 503-528.
[23]
Roweis, Sam and Saul, Lawrence, Nonlinear dimensionality reduction by locally linear embedding. Science. v190 i5500. 2323-2326.
[24]
Tenenbaum, Joshua B., de Silva, Vin and Langford, John C., A global geometric framework for nonlinear dimensionality reduction. Science. v190 i5500. 2319-2323.

Cited By

View all
  • (2018)Non-Iterative MDS Method for Collaborative Network Localization With Sparse Range and Pointing MeasurementsIEEE Transactions on Signal Processing10.1109/TSP.2018.287962367:3(568-578)Online publication date: 17-Dec-2018
  • (2014)Leveraging graph dimensions in online graph searchProceedings of the VLDB Endowment10.14778/2735461.27354698:1(85-96)Online publication date: 1-Sep-2014
  • (2012)Sensor network localization by eigenvector synchronization over the euclidean groupACM Transactions on Sensor Networks10.1145/2240092.22400938:3(1-42)Online publication date: 2-Aug-2012

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Computational Geometry: Theory and Applications
Computational Geometry: Theory and Applications  Volume 42, Issue 4
May, 2009
94 pages

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 May 2009

Author Tags

  1. Clustering
  2. Graph embedding
  3. Multi-dimensional scaling

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2018)Non-Iterative MDS Method for Collaborative Network Localization With Sparse Range and Pointing MeasurementsIEEE Transactions on Signal Processing10.1109/TSP.2018.287962367:3(568-578)Online publication date: 17-Dec-2018
  • (2014)Leveraging graph dimensions in online graph searchProceedings of the VLDB Endowment10.14778/2735461.27354698:1(85-96)Online publication date: 1-Sep-2014
  • (2012)Sensor network localization by eigenvector synchronization over the euclidean groupACM Transactions on Sensor Networks10.1145/2240092.22400938:3(1-42)Online publication date: 2-Aug-2012

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media