Article

Out-of-core tensor approximation of multi-dimensional matrices of visual data

Authors:

Hongcheng Wang,

Narendra AhujaAuthors Info & Claims

SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

Pages 527 - 535

https://doi.org/10.1145/1186822.1073224

Published: 01 July 2005 Publication History

Abstract

Tensor approximation is necessary to obtain compact multilinear models for multi-dimensional visual datasets. Traditionally, each multi-dimensional data item is represented as a vector. Such a scheme flattens the data and partially destroys the internal structures established throughout the multiple dimensions. In this paper, we retain the original dimensionality of the data items to more effectively exploit existing spatial redundancy and allow more efficient computation. Since the size of visual datasets can easily exceed the memory capacity of a single machine, we also present an out-of-core algorithm for higher-order tensor approximation. The basic idea is to partition a tensor into smaller blocks and perform tensor-related operations blockwise. We have successfully applied our techniques to three graphics-related data-driven models, including 6D bidirectional texture functions, 7D dynamic BTFs and 4D volume simulation sequences. Experimental results indicate that our techniques can not only process out-of-core data, but also achieve higher compression ratios and quality than previous methods.

Supplementary Material

JPG File (pps016.jpg)

Download
13.93 KB

MP4 File (pps016.mp4)

Download
38.16 MB

References

[1]

Brand, M. 2002. Incremental singular value decomposition of uncertain data with missing values. In Proc. European Conference on Computer Vision (Vol. 1), 707--720.

Digital Library

[2]

Chen, W.-C., Bouguet, J.-Y., Chu, M., and Grzeszczuk, R. 2002. Light field mapping: Efficient representation and hardware rendering of surface light fields. ACM Transactions on Graphics 21, 3, 447--456.

Digital Library

[3]

Dana, K. J., van Ginneken, B., Nayar, S. K., and Koenderink, J. J. 1999. Reflectance and texture of real world surfaces. ACM Transactions on Graphics 18, 1, 1--34.

Digital Library

[4]

Enright, D., Marschner, S., and Fedkiw, R. 2002. Animation and rendering of complex water surfaces. ACM Transactions on Graphics 21, 3, 736--744.

Digital Library

[5]

Furukawa, R., Kawasaki, H., Ikeuchi, K., and Sakauchi, M. 2002. Appearance based object modeling using texture database: Acquisition, compression, and rendering. In 13th Eurographics Workshop on Rendering, 257--265.

Digital Library

[6]

Gu, X., Gortler, S., and Hoppe, H. 2002. Geometry images. ACM Transactions on Graphics 21, 3, 355--361.

Digital Library

[7]

Han, J., and Perlin, K. 2003. Measuring bidirectional texture reflectance with a kaleidoscope. ACM Transactions on Graphics 22, 3, 741--748.

Digital Library

[8]

James, D., and Fatahalian, K. 2003. Precomputing interactive dynamic deformable scenes. ACM TOG 22, 3, 879--887.

Digital Library

[9]

Koudelka, M., Magda, S., Belhumeur, P., and Kriegman, D. 2003. Acquisition, compression, and synthesis of bidirectional texture functions. In 3rd Intl. Workshop on Texture Analysis and Synthesis, 59--64.

[10]

Kroonenberg, P., and de Leeuw, J. 1980. Principal component analysis of three-mode data by means of alternating least squares algorithms. Psychometrika 45, 324--1342.

[11]

Lathauwer, L. D., De Moor, B., and Vandewalle, J. 2000. A multilinear singular value decomposition. SIAM J. Matrix Analysis and Applications 21, 4, 1253--1278.

Digital Library

[12]

Lathauwer, L. D., de Moor, B., and Vandewalle, J. 2000. On the best rank-1 and rank-(R1, R2, .., Rn) approximation of higher-order tensors. SIAM J. Matrix Analysis and Applications 21, 4, 1324--1342.

Digital Library

[13]

Leung, T., and Malik, J. 1999. Recognizing surfaces using three dimensional textons. In Intl. Conf. Computer Vision.

Digital Library

[14]

Levoy, M., and Hanrahan, P. 1996. Light field rendering. In Computer Graphics Proceedings, Annual Conference Series, 31--42.

Digital Library

[15]

Liu, X., Yu, Y., and Shum, H.-Y. 2001. Synthesizing bidirectional texture functions for real-world surfaces. In Proceedings of SIGGRAPH, 97--106.

Digital Library

[16]

Liu, X., Hu, Y., Zhang, J., Tong, X., Guo, B., and Shum, H.-Y. 2004. Synthesis and rendering of bidirectional texture functions on arbitrary surfaces. IEEE Trans. Visualization and Computer Graphics 10, 3, 278--289.

Digital Library

[17]

Matusik, W., Pfister, H., Brand, M., and McMillan, L. 2003. A data-driven reflectance model. ACM Transactions on Graphics 22, 3, 759--769.

Digital Library

[18]

Nguyen, K., and Saupe, D. 2001. Rapid high quality compression of volume data for visualization. Compuer Graphics Forum 20, 3, 49--56.

[19]

Nishino, K., Sato, Y., and Ikeuchi, K. 1999. Eigen-texture method: appearance compression based on 3d model. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'99), 618--624.

[20]

Rabani, E., and Toledo, S. 2001. Out-of-core svd and qr decompositions. In Proceedings of the 10th SIAM Conference on Parallel Processing for Scientific Computing.

[21]

Rodler, F. 1999. Wavelet based 3d compression with fast random access for very large volume data. In Proceedings of the 7th Pacific Conference on Computer Graphics and Applications, 108--117.

Digital Library

[22]

Sattler, M., Sarlette, R., and Klein, R. 2003. Efficient and realistic visualization of cloth. In Proc. Eurographics Symposium on Rendering, 167--177.

Digital Library

[23]

Shashua, A., and Levin, A. 2001. Linear image regression and classification using the tensor-rank principle. In IEEE Conf. Computer Vision and Pattern Recognition.

[24]

Shi, L., and Yu, Y. 2005. Controllable smoke animation with guiding objects. ACM Transactions on Graphics 24, 1, 140--164.

Digital Library

[25]

Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. In SIGGRAPH 2002 Proceedings, 665--672.

Digital Library

[26]

Tucker, L. 1966. Some mathematical notes on three-mode factor analysis. Psychometrika 31, 279--311.

[27]

Vasilescu, M. A. O., and Terzopoulos, D. 2002. Multilinear analysis of image ensembles: Tensorfaces. In European Conference on Computer Vision, 447--460.

Digital Library

[28]

Vasilescu, M., and Terzopoulos, D. 2004. Tensortextures: Multilinear image-based rendering. ACM Transactions on Graphics 23, 3, 334--340.

Digital Library

[29]

Wang, H., and Ahuja, N. 2003. Facial expression decomposition. In Int. Conf. on Computer Vision, 958--965.

Digital Library

[30]

Weyrich, T., Pfister, H., and Gross, M. 2005. Rendering deformable surface reflectance fields. IEEE Trans. Visualization and Computer Graphics 11, 1, 48--58.

Digital Library

[31]

Yang, J., Zhang, D., Frangi, A., and Yang, J. 2004. Two-dimensional pca: A new approach to appearance-based face representation and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 26, 1 (January).

Digital Library

[32]

Ye, J. 2004. Generalized low rank approximations of matrices. In International Conference on Machine Learning, ICML'04.

Digital Library

[33]

Yeo, B.-L., and Liu, B. 1995. Volume rendering of dct-based compressed 3d scalar data. IEEE Trans. Visualization and Computer Graphics 1, 1, 29--43.

Digital Library

[34]

Yu, Y., and Chang, J. 2005. Shadow graphs and 3d texture reconstruction. International Journal of Computer Vision 62, 1/2, 35--60.

Digital Library

Cited By

Tsai YAbu Bakar M(2024)HMK-CTA: A Hierarchical Multidimensional Representation for Visual DatasetsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670954(1-10)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670954
Deng HLiu YWang BYang JMa LHolzschuch NYan L(2022)Constant-Cost Spatio-Angular Prefiltering of Glinty Appearance Using Tensor DecompositionACM Transactions on Graphics10.1145/350791541:2(1-17)Online publication date: 22-Jan-2022
https://dl.acm.org/doi/10.1145/3507915
Kim MCandan KLi JWang XGarofalakis MSoboroff ISuel TWang M(2014)Efficient Static and Dynamic In-Database Tensor Decompositions on Chunk-Based Array StoresProceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management10.1145/2661829.2661864(969-978)Online publication date: 3-Nov-2014
https://dl.acm.org/doi/10.1145/2661829.2661864
Show More Cited By

Index Terms

Out-of-core tensor approximation of multi-dimensional matrices of visual data
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
      1. Texturing
    2. Rendering

Recommendations

Out-of-core tensor approximation of multi-dimensional matrices of visual data

Tensor approximation is necessary to obtain compact multilinear models for multi-dimensional visual datasets. Traditionally, each multi-dimensional data item is represented as a vector. Such a scheme flattens the data and partially destroys the internal ...
Hierarchical Tensor Approximation of Multi-Dimensional Visual Data

Visual data comprise of multi-scale and inhomogeneous signals. In this paper, we exploit these characteristics and develop a compact data representation technique based on a hierarchical tensor-based transformation. In this technique, an original multi-...
Synthesizing bidirectional texture functions for real-world surfaces
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques

In this paper, we present a novel approach to synthetically generating bidirectional texture functions (BTFs) of real-world surfaces. Unlike a conventional two-dimensional texture, a BTF is a six-dimensional function that describes the appearance of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

July 2005

826 pages

ISBN:9781450378253

DOI:10.1145/1186822

Editor:
Markus Gross
Eidgenössische Technische Hochschule Zürich

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH05

Sponsor:

SIGGRAPH

SIGGRAPH05: Special Interest Group on Computer Graphics and Interactive Techniques Conference

July 31 - August 4, 2005

California, Los Angeles

Acceptance Rates

SIGGRAPH '05 Paper Acceptance Rate 98 of 461 submissions, 21%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
1,217
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Tsai YAbu Bakar M(2024)HMK-CTA: A Hierarchical Multidimensional Representation for Visual DatasetsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670954(1-10)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670954
Deng HLiu YWang BYang JMa LHolzschuch NYan L(2022)Constant-Cost Spatio-Angular Prefiltering of Glinty Appearance Using Tensor DecompositionACM Transactions on Graphics10.1145/350791541:2(1-17)Online publication date: 22-Jan-2022
https://dl.acm.org/doi/10.1145/3507915
Kim MCandan KLi JWang XGarofalakis MSoboroff ISuel TWang M(2014)Efficient Static and Dynamic In-Database Tensor Decompositions on Chunk-Based Array StoresProceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management10.1145/2661829.2661864(969-978)Online publication date: 3-Nov-2014
https://dl.acm.org/doi/10.1145/2661829.2661864
Yu SBi JYe J(2011)Matrix-variate and higher-order probabilistic projectionsData Mining and Knowledge Discovery10.1007/s10618-010-0183-922:3(372-392)Online publication date: 1-May-2011
https://dl.acm.org/doi/10.1007/s10618-010-0183-9
Liu RLin ZSu ZTang K(2010)Feature extraction by learning Lorentzian metric tensor and its extensionsPattern Recognition10.1016/j.patcog.2010.05.00943:10(3298-3306)Online publication date: 1-Oct-2010
https://dl.acm.org/doi/10.1016/j.patcog.2010.05.009
Wang FWang XZhang DZhang CLi T(2009)marginFacePattern Recognition10.1016/j.patcog.2009.04.01542:11(2863-2875)Online publication date: 1-Nov-2009
https://dl.acm.org/doi/10.1016/j.patcog.2009.04.015
Perera MShiratori TKudoh SNakazawa AIkeuchi K(2008)Task Recognition and Person Identification in Cyclic Dance Sequences with Multi Factor Tensor AnalysisIEICE - Transactions on Information and Systems10.1093/ietisy/e91-d.5.1531E91-D:5(1531-1542)Online publication date: 1-May-2008
https://dl.acm.org/doi/10.1093/ietisy/e91-d.5.1531
Sun XZhou KChen YLin SShi JGuo B(2007)Interactive relighting with dynamic BRDFsACM Transactions on Graphics10.1145/1276377.127641126:3(27-es)Online publication date: 29-Jul-2007
https://dl.acm.org/doi/10.1145/1276377.1276411
Sun XZhou KChen YLin SShi JGuo BLevoy M(2007)Interactive relighting with dynamic BRDFsACM SIGGRAPH 2007 papers10.1145/1275808.1276411(27-es)Online publication date: 5-Aug-2007
https://dl.acm.org/doi/10.1145/1275808.1276411
Perera MShiratori TKudoh SNakazawa AIkeuchi K(2007)Multilinear analysis for task recognition and person identification2007 IEEE/RSJ International Conference on Intelligent Robots and Systems10.1109/IROS.2007.4399293(1409-1415)Online publication date: Oct-2007
https://doi.org/10.1109/IROS.2007.4399293
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents