article

Similarity metric learning for face verification using sigmoid decision function

Authors:

Shou-Hong Ding,

Cheng-Jie Wang,

Fei-Yue HuangAuthors Info & Claims

The Visual Computer: International Journal of Computer Graphics, Volume 32, Issue 4

Pages 479 - 490

https://doi.org/10.1007/s00371-015-1079-x

Published: 01 April 2016 Publication History

Abstract

In this paper, we consider the face verification problem, which is to determine whether two face images belong to the same subject or not. Although many research efforts have been focused on this problem, it still remains a challenging problem due to large intra-personal variations in imaging conditions, such as illumination, pose, expression, and occlusion. Our proposed method is based on the idea that we would like the similarity between positive pairs larger than negative pairs, and obtain a similarity estimation of two images. We construct our decision function by incorporating bilinear similarity and Mahalanobis distance to the sigmoid function. The constructed decision function makes our method discriminative for inter-personal differences and invariant to intra-personal variations such as pose/lighting/expression. What is more, our formulated objective function is convex, which guarantees global minimum. Our method belongs to nonlinear metric which is more robust to handle heterogeneous data than linear metric. We evaluate our proposed verification method on the challenging labeled faces in the wild (LFW) database. Experimental results demonstrate that the proposed method outperforms state-of-the-art methods such as Joint Bayesian under the unrestricted setting of LFW.

References

[1]

Kumar Retna, S.M., Muneeswaran, K.: Optimal feature extraction using greedy approach for random image components and subspace approach in face recognition. J. Comput. Sci. Technol. 28(2), 322---328 (2013)

[2]

Li, Y., Meng, L., Feng, J., Wu, J.: Downsampling sparse representation and discriminant information aided occluded face recognition. Sci. China Inf. Sci. 57(3), 1---9 (2014)

[3]

Wang, Z., Miao, Z., Wu, Q.M.J., Yanli, W., Zhen, T.: Low-resolution face recognition: a review. Vis. Comput. 30(4), 359---386 (2014)

Digital Library

[4]

Singh, C., Walia, E., Mittal, N.: Robust two-stage face recognition approach using global and local features. Vis. Comput. 28(11), 1085---1098 (2012)

[5]

Vieira, T.F., Bottino, A., Laurentini, A., De Simone, M.: Detecting siblings in image pairs. Vis. Comput. 30(12), 1333---1345 (2014)

Digital Library

[6]

Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91---110 (2004)

Digital Library

[7]

Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037---2041 (2006)

Digital Library

[8]

Liu, C., Wechsler, H.: Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition. IEEE Trans. Image Proc. 11(4), 467---476 (2002)

[9]

Cao, Z., Yin, Q., Tang, X., Sun, J.: Face recognition with learning-based descriptor. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2707---2714 (2010)

[10]

Huang, R., Ye, M., Xu, P., Li, T., Dou, Y.: Learning to pool high-level features for face representation. Vis. Comput. 30(1), 1---13 (2014)

Digital Library

[11]

Chen, D., Cao, X., Wen, F., Sun, J.: Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3025---3032 (2013)

Digital Library

[12]

Goldberger, J., Roweis, S., Hinton, G.: Neighbourhood components analysis. In: Advances in Neural Information Processing Systems (NIPS). pp. 513---520. MIT Press, Cambridge, MA (2005)

[13]

Guillaumin, M., Verbeek, J., Schmid, C.: Is that you? Metric learning approaches for face identification. In: IEEE 12th International Conference on Computer Vision, pp. 498---505 (2009)

[14]

Kostinger, M., Hirzer, M., Wohlhart, P., Roth, P.M., Bischof, H.: Large scale metric learning from equivalence constraints. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2288---2295 (2012)

[15]

Cao, Q., Ying, Y., Li, P.: Similarity metric learning for face recognition. In: IEEE International Conference on Computer Vision (ICCV), pp. 2408---2415 (2013)

Digital Library

[16]

Chen, D., Cao, X., Wang, L., Wen, F., Sun, J.: Bayesian face revisited: a joint formulation. In: Computer Vision-ECCV, pp. 566---579. Springer, Berlin (2012)

Digital Library

[17]

Weinberger, K.Q., Blitzer, J., Saul, L.K.: Distance metric learning for large margin nearest neighbor classification. In: Advances in Neural Information Processing Systems, pp. 1473---1480 (2005)

Digital Library

[18]

Hoi, S.C., Liu, W., Lyu, M.R., Ma, W.-Y.: Learning distance metrics with contextual constraints for image retrieval. In: Conference on Computer Vision and Pattern Recognition (CVPR), IEEE Computer Society Conference on, pp. 2072---2078 (2006)

Digital Library

[19]

Torresani, L., Lee, K.-C.: Large margin component analysis. In: Advances in Neural Information Processing Systems (NIPS), pp. 1385---1392. MIT Press, Cambridge, MA (2006)

[20]

Shalev-Shwartz, S., Singer, Y., Ng A.Y.: Online and batch learning of pseudo-metrics. In: Proceedings of the Twenty-first International Conference on Machine Learning, p. 94 (2004)

Digital Library

[21]

Noh, Y.K., Zhang, B.T., Lee, D.D.: Generative local metric learning for nearest neighbor classification. In: Advances in Neural Information Processing Systems (NIPS), pp. 1822---1830. MIT Press, Cambridge, MA (2010)

[22]

Weinberger, K.Q., Saul, L.K.: Fast solvers and efficient implementations for distance metric learning. In: Proceedings of the 25th International Conference on Machine Learning, pp. 1160---1167 (2008)

Digital Library

[23]

Bellet, A., Habrard, A., Sebban, M.: A survey on metric learning for feature vectors and structured data. CoRR, abs/1306.6709 (2013)

[24]

Qi, G.-J., Tang, J., Zha, Z.-J., Chua, T.-S., Zhang, H.-J.: An efficient sparse metric learning in high-dimensional space via l1-penalized log-determinant regularization. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 841---848 (2009)

Digital Library

[25]

Chechik, G., Sharma, V., Shalit, U., Bengio, S.: Large scale online learning of image similarity through ranking. J. Mach. Learn. Res. 11, 1109---1135 (2010)

Digital Library

[26]

Hosmer, D.W., Lemeshow, S.: Introduction to the logistic regression model. In: Applied Logistic Regression, 2nd edn., pp. 1---30 (2000)

[27]

Davis, J.V., Brian, K., Prateek, J., Suvrit, S., Inderjit, S.D.: Information-theoretic metric learning. In: Proceedings of the Twenty-Fourth International Conference Machine Learning, pp. 209---216 (2007)

[28]

Jain, P., Kulis, B., Inderjit, S.D., Kristen, G.: Online metric learning and fast similarity search. Adv. Neural Inf. Proc. Syst. 21, 761---768 (2008)

[29]

Shalev-Shwartz, S., Singer, Y., Srebro, N., Cotter, A.: Pegasos: primal estimated sub-gradient solver for svm. Math. Program. 127(1), 3---30 (2011)

Digital Library

[30]

Cao, X., Wei, Y., Wen, F., Sun, J.: Face alignment by explicit shape regression. Int. J. Comput. Vis. 107(2), 177---190 (2014)

Digital Library

[31]

Hariharan, B., Malik, J., Ramanan, D.: Discriminative decorrelation for clustering and classification. In: Computer Vision-ECCV, pp. 459---472. Springer Berlin, Heidelberg (2012)

Digital Library

[32]

Moghaddam, B., Jebara, T., Pentland, A.: Bayesian face recognition. Pattern Recogn. 33(11), 1771---1782 (2000)

[33]

Wang, X., Tang, X.: A unified framework for subspace face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 26(9), 1222---1228 (2004)

Digital Library

[34]

Taigman, Y., Wolf, L., Hassner, T. Multiple one-shots for utilizing class label information. In: BMVC, pp. 1---12 (2009)

[35]

Cox, D., Pinto, N.: Beyond simple features: a large-scale feature search approach to unconstrained face recognition. In: IEEE International Conference on Automatic Face and Gesture Recognition and Workshops (FG 2011), pp. 8---15 (2011)

[36]

Nguyen, H. V., Bai, L.: Cosine similarity metric learning for face verification. In: Computer Vision--ACCV 2010, pp. 709---720. Springer Berlin, Heidelberg (2011)

[37]

Ying, Y., Li, P.: Distance metric learning with eigenvalue optimization. J. Mach. Learn. Res. 13(1), 1---26 (2012)

Digital Library

[38]

LFW website. http://vis-www.cs.umass.edu/lfw/results.html (2015)

[39]

Li, P., Fu, Y., Mohammed, U., Elder, J.H., Prince, S.J.D.: Probabilistic models for inference about identity. IEEE Trans. Pattern Anal. Mach. Intell. 34(1), 144---157 (2012)

Digital Library

[40]

Simonyan, K., Parkhi, O.M., Vedaldi, A., Zisserman, A.: Fisher vector faces in the wild. In: British Machine Vision Conference (BMVC) (2013)

[41]

Barkan, O., Weill, J., Wolf, L., Aronowitz, H.: Fast high dimensional vector multiplication face recognition. In: IEEE International Conference on Computer Vision (ICCV), pp. 1960---1967 (2013)

Digital Library

[42]

Sun, Y., Wang, X., Tang, X.: Hybrid deep learning for face verification. In: IEEE International Conference on Computer Vision (ICCV), pp. 1489---1496 (2013)

Digital Library

Cited By

Xie JGe YZhang JHuang SChen FWang H(2022)Low-resolution assisted three-stream network for person re-identificationThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-021-02127-038:7(2515-2525)Online publication date: 1-Jul-2022
https://dl.acm.org/doi/10.1007/s00371-021-02127-0
Fan XJiang WLuo HMao W(2022)Modality-transfer generative adversarial network and dual-level unified latent representation for visible thermal Person re-identificationThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-020-02015-z38:1(279-294)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1007/s00371-020-02015-z
Zhang DWu ZWang XLv CLiu N(2021)3D skull and face similarity measurements based on a harmonic wave kernel signatureThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-020-01946-x37:4(749-764)Online publication date: 1-Apr-2021
https://dl.acm.org/doi/10.1007/s00371-020-01946-x
Show More Cited By

Recommendations

Multiview discriminative marginal metric learning for makeup face verification
Abstract
Makeup face verification in the wild is an important research problem for its popularization in real-world. However, little effort has been made to tackle it in computer vision. In this research, we first build a new database, i.e., ...
Fine-grained face verification

As performance on some aspects of the Labeled Faces in the Wild (LFW) benchmark approaches 100% accuracy, there is an intense debate on whether unconstrained face verification problem has already been solved. In this paper, we study a new face ...
Face Verification Using Template Matching
Part 2

Human faces are similar in structure with minor differences from person to person. These minor differences may average out while trying to synthesize the face image of a given person, or while building a model of face image in automatic face ...

Comments

Information & Contributors

Information

Published In

cover image The Visual Computer: International Journal of Computer Graphics

The Visual Computer: International Journal of Computer Graphics Volume 32, Issue 4

April 2016

129 pages

ISSN:0178-2789

Issue’s Table of Contents

Copyright © Copyright © 2016 Springer-Verlag Berlin Heidelberg.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 April 2016

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xie JGe YZhang JHuang SChen FWang H(2022)Low-resolution assisted three-stream network for person re-identificationThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-021-02127-038:7(2515-2525)Online publication date: 1-Jul-2022
https://dl.acm.org/doi/10.1007/s00371-021-02127-0
Fan XJiang WLuo HMao W(2022)Modality-transfer generative adversarial network and dual-level unified latent representation for visible thermal Person re-identificationThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-020-02015-z38:1(279-294)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1007/s00371-020-02015-z
Zhang DWu ZWang XLv CLiu N(2021)3D skull and face similarity measurements based on a harmonic wave kernel signatureThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-020-01946-x37:4(749-764)Online publication date: 1-Apr-2021
https://dl.acm.org/doi/10.1007/s00371-020-01946-x
Yu JKim DYoon YJeon M(2019)Action matching network: open-set action recognition using spatio-temporal representation matchingThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-019-01751-136:7(1457-1471)Online publication date: 18-Sep-2019
https://dl.acm.org/doi/10.1007/s00371-019-01751-1
Choi J(2018)Spatial pyramid face feature representation and weighted dissimilarity matching for improved face recognitionThe Visual Computer: International Journal of Computer Graphics10.5555/3288062.328807334:11(1535-1549)Online publication date: 1-Nov-2018
https://dl.acm.org/doi/10.5555/3288062.3288073
Chen DXu CYang JQian JZheng YShen L(2018)Joint Bayesian guided metric learning for end-to-end face verificationNeurocomputing10.5555/3198485.3198785275:C(560-567)Online publication date: 31-Jan-2018
https://dl.acm.org/doi/10.5555/3198485.3198785
Agarwal SSantra BMukherjee D(2018)AnubhavThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-016-1323-z34:2(177-191)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1007/s00371-016-1323-z

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents