Abstract
In this paper, we propose a robust unsupervised algorithm for automatic alignment of two manifolds in different datasets with possibly different dimensionalities. The significant contribution is that the proposed alignment algorithm is performed automatically without any assumptions on the correspondences between the two manifolds. For such purpose, we first automatically extract local feature histograms at each point of the manifolds and establish an initial similarity between the two datasets by matching their histogram-based features. Based on such similarity, an embedding space is estimated where the distance between the two manifolds is minimized while maximally retaining the original structure of the manifolds. The elegance of this idea is that such complicated problem is formulated as a generalized eigenvalue problem, which can be easily solved. The alignment process is achieved by iteratively increasing the sparsity of correspondence matrix until the two manifolds are correctly aligned and consequently one can reveal their joint structure. We demonstrate the effectiveness of our algorithm on different datasets by aligning protein structures, 3D face models and facial images of different subjects under pose and lighting variations. Finally, we also compare with a state-of-the-art algorithm and the results show the superiority of the proposed manifold alignment in terms of vision effect and numerical accuracy.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)
Wang, C., Mahadevan, S.: Manifold alignment using Procrustes analysis. In: ICML, pp. 1120–1127 (2008)
Pei, Y., Huang, F., Shi, F., Zha, H.: Unsupervised image matching based on manifold alignment. TPAMI 34(8), 1658–1664 (2012)
Cui, Z., Shan, S., Zhang, H., Lao, S., Chen, X.: Image sets alignment for video-based face recognition. In: CVPR, pp. 2626–2633 (2012)
Yan, W., Tian, Z., Duan, X., Pan, L.: Feature matching based on unsupervised manifold alignment. Mach. Vis. Appl. 24(5), 983–994 (2013)
Tenenbaum, J.B., De Silva, V., Langford, J.C.: A global geometric framework for nonlinear dimensionality reduction. Science 290(5500), 2319–2323 (2000)
Roweis, S.T., Saul, L.K.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500), 2323–2326 (2000)
Zhang, Z., Zha, H.: Principal manifolds and nonlinear dimensionality reduction via tangent space alignment. SIAM J. Sci. Comput. 26(1), 313–338 (2004)
Wang, C., Mahadevan, S.: A general framework for manifold alignment. In: AAAI Fall Symposium on Manifold Learning and Its Applications (2009)
Ham, J., Lee, D., Saul, L.: Semisupervised alignment of manifolds. In: Ghahramani, Z., Cowell, R. (eds.) Proceedings of the Annual Conference on Uncertainty in Artificial Intelligence, vol. 10, pp. 120–127 (2005)
Wang, C., Mahadevan, S.: Manifold alignment without correspondence. In: IJCAI, pp. 1273–1278 (2009)
He, X., Niyogi, P.: Locality Preserving Projections. NIPS (2003)
Belkin, M., Niyogi, P.: Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput. 15(6), 1373–1396 (2003)
Besl, P.J., McKay, N.D.: A method for registration of 3-d shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)
Chen, Y., Medioni, G.: Object modelling by registration of multiple range images. Image Vision Comput. 10(3), 145–155 (1992)
Fan, K., Mian, A., Liu, W., Li, L.: Unsupervised iterative manifold alignment via local feature histograms. WACV 2014, 572–579 (2014)
Huang, D., Yi, Z., Pu, X.: Manifold-based learning and synthesis. TSMCB 39(3), 592–606 (2009)
Rangarajan, A., Chui, H., Bookstein, F.L.: The softassign Procrustes matching algorithm. In: 15th International Conference on Information Processing in Medical Imaging, IPMI 1997. Lecture Notes in Computer Science, vol. 1230, pp. 29–42 (1997)
Rose, K.: Deterministic annealing for clustering, compression, classification, regression, and related optimization problems. Proc. IEEE 86(11), 2210–2239 (1998)
Berman, H.M., Westbrook, J., Feng, Z., Gilliland, G., Bhat, T., Weissig, H., Shindyalov, I.N., Bourne, P.E.: The protein data bank. Nucleic Acids Res. 28(1), 235–242 (2000)
Yin, L., Chen, X., Sun, Y., Worm, T., Reale, M.: A high-resolution 3D dynamic facial expression database. FG 08, 1–6 (2008)
Little, D., Krishna, S., Black, J., Panchanathan, S.: A methodology for evaluating robustness of face recognition algorithms with respect to variations in pose angle and illumination angle. In: ICASSP (2005)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. CVPR 1, 886–893 (2005)
Kim, T.-K., Kittler, J., Cipolla, R.: Discriminative learning and recognition of image set classes using canonical correlations. IEEE Trans. Pattern Anal. Mach. Intell. 29(6), 1005–1018 (2007)
Huang, D., Storer, M., De la Torre, F., Bischof, H.: Supervised local subspace learning for continuous head pose estimation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2921–2928 (2011)
Gross, R., Matthews, I., Cohn, J., Kanade, T., Baker, S.: Multi-pie. Image Vision Comput. 28(5), 807–813 (2010)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Fan, K., Mian, A., Liu, W. et al. Unsupervised manifold alignment using soft-assign technique. Machine Vision and Applications 27, 929–942 (2016). https://doi.org/10.1007/s00138-016-0772-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-016-0772-8