article

Personalized clothing recommendation combining user social circle and fashion style consistency

Authors:

Qiang PengAuthors Info & Claims

Multimedia Tools and Applications, Volume 77, Issue 14

Pages 17731 - 17754

https://doi.org/10.1007/s11042-017-5245-1

Published: 01 July 2018 Publication History

Abstract

With the rapid expansion of social networks and fashion websites, clothing recommendation has attracted more attention of researchers, since various web data bring opportunities for recommender systems to solve the problems of cold start and sparsity. For clothing recommender system, user social circle and fashion style consistency of clothing items are two important factors, which have critical impacts on user decision making. In this paper, two practical problems are considered: how to visually analyze fashion style consistency between clothing items and how to implement personalized clothing recommendation by combining user social circle and fashion style consistency. To address the first problem, a Siamese Convolutional Neural Network (SCNN) with a novel sampling strategy is employed to measure the fashion style consistency of clothing items. It can learn a feature transformation from clothing images to a latent feature space, where the representations of clothing items with similar styles locate closer than those with different styles. For the second problem, three social factors (i.e., personal interest, interpersonal interest similarity and interpersonal influence) and fashion style consistency are fused into a unified personalized recommendation model based on probabilistic matrix factorization (PMF). To comprehensively evaluate our model, extensive experiments have been conducted on two real world datasets collected from a popular social fashion website, which demonstrate the effectiveness of the proposed method for personalized clothing recommendation.

References

[1]

Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans Knowl Data Eng 17(6):734---749

Digital Library

[2]

Bossard L, Dantone M, Leistner C, Wengert C, Quack T, Gool L V (2013) Apparel classification with style. In: Asian conference on computer vision, pp 321---335

Digital Library

[3]

Chen H, Gallagher A, Girod B (2012) Describing clothing by semantic attributes. In: European conference on computer vision, pp 609---623

Digital Library

[4]

Cui P, Wang F, Liu S, Ou M, Yang S, Sun L (2011) Who should share what?: item-level social influence prediction for users and posts ranking. In: International ACM SIGIR conference on research and development in information retrieval, pp 185---194

Digital Library

[5]

Cui P, Wang F, Yang S, Sun L (2011) Item-level social influence prediction with probabilistic hybrid factor matrix factorization. In: AAAI conference on artificial intelligence

Digital Library

[6]

Fu J, Wang J, Li Z, Xu M, Lu H (2012) Efficient clothing retrieval with semantic-preserving visual phrases. In: Asian conference on computer vision, pp 420---431

Digital Library

[7]

Gao H, Tang J, Hu X, Liu H (2015) Content-aware point of interest recommendation on location-based social networks. In: AAAI conference on artificial intelligence, pp 1721---1727

Digital Library

[8]

He R, McAuley J (2016) Ups and downs: modeling the visual evolution of fashion trends with one-class collaborative filtering. In: International conference on world wide web, pp 507---517

Digital Library

[9]

Hu Y, Yi X, Davis L S (2015) Collaborative fashion recommendation: a functional tensor factorization approach. In: ACM international conference on multimedia, pp 129---138

Digital Library

[10]

Huang J, Feris R S, Chen Q, Yan S (2015) Cross-domain image retrieval with a dual attribute-aware ranking network. In: International conference on computer vision, pp 1062---1070

Digital Library

[11]

Jagadeesh V, Piramuthu R, Bhardwaj A, Di W, Sundaresan N (2014) Large scale visual recommendations from street fashion images. In: ACM conference on knowledge discovery and data mining, pp 1925---1934

Digital Library

[12]

Jamali M, Ester M (2009) TrustWalker: a random walk model for combining trust-based and item-based recommendation. In: ACM conference on knowledge discovery and data mining, pp 397---406

Digital Library

[13]

Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: convolutional architecture for fast feature embedding. arXiv:http://arXiv.org/abs/1408.5093

[14]

Jiang M, Cui P, Liu R, Yang Q, Wang F, Zhu W, Yang S (2012) Social contextual recommendation. In: International conference on information and knowledge management, pp 45---54

Digital Library

[15]

Jiang S, Qian X, Shen J, Fu Y, Mei T (2015) Author topic model-based collaborative filtering for personalized POI recommendations. IEEE Trans Multimed 17(6):907---918

[16]

Kalantidis Y, Kennedy L, Li L (2013) Getting the look: clothing recognition and segmentation for automatic product suggestions in everyday photos. In: International conference on multimedia retrieval, pp 105---112

Digital Library

[17]

Kiapour M H, Yamaguchi K, Berg A C, Berg T L (2014) Hipster wars: discovering elements of fashion styles. In: European conference on computer vision, pp 472---488

[18]

Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: ACM conference on knowledge discovery and data mining, pp 426---434

Digital Library

[19]

Liang X, Lin L, Yang W, Luo P, Huang J, Yan S (2016) Clothes co-parsing via joint image segmentation and labeling with application to clothing retrieval. IEEE Trans Multimed 18(6):1175---1186

Digital Library

[20]

Liu S, Feng J, Song Z, Zhang T, Lu H, Xu C, Yan S (2012) Hi, magic closet, tell me what to wear! In: ACM international conference on multimedia MM, pp 619---628

Digital Library

[21]

Liu S, Song Z, Liu G, Xu C, Lu H, Yan S (2012) Street-to-shop: cross-scenario clothing retrieval via parts alignment and auxiliary set. In: Computer vision and pattern recognition, pp 3330---3337

Digital Library

[22]

Liu S, Feng J, Domokos C, Xu H, Huang J, Hu Z, Yan S (2014) Fashion parsing with weak color-category labels. IEEE Trans Multimed 16(1):253---265

[23]

Liu Z, Luo P, Qiu S, Wang X, Tang X (2016) Deepfashion: powering robust clothes recognition and retrieval with rich annotations. In: Computer vision and pattern recognition, pp 1096---1104

[24]

Ma H, King I, Lyu M R (2009) Learning to recommend with social trust ensemble. In: International ACM SIGIR conference on research and development in information retrieval, pp 203---210

Digital Library

[25]

McAuley J J, Targett C, Shi Q, van den Hengel A (2015) Image-based recommendations on styles and substitutes. In: International ACM SIGIR conference on research and development in information retrieval, pp 43---52

Digital Library

[26]

Nogueira K, Veloso A A, dos Santos J A (2016) Pointwise and pairwise clothing annotation: combining features from social media. Multimed Tools Appl 75 (7):4083---4113

Digital Library

[27]

Qian X, Liu X, Zheng C, Du Y, Hou X (2013) Tagging photos using users' vocabularies. Neurocomputing 111:144---153

Digital Library

[28]

Qian X, Feng H, Zhao G, Mei T (2014) Personalized recommendation combining user interest and social circle. IEEE Trans Knowl Data Eng 26(7):1763---1777

[29]

Resnick P, Iacovou N, Suchak M, Bergstrom P, Riedl J (1994) Grouplens: an open architecture for collaborative filtering of netnews. In: ACM conference on computer supported cooperative work and social computing, pp 175---186

Digital Library

[30]

Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M S, Berg A C, Li F (2014) Imagenet large scale visual recognition challenge. CoRR arXiv:1409.0575

[31]

Salakhutdinov R, Mnih A (2007) Probabilistic matrix factorization. In: Neural information processing systems, pp 1257---1264

Digital Library

[32]

Sarwar B M, Karypis G, Konstan J A, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: International conference on World Wide Web, pp 285---295

Digital Library

[33]

Simo-Serra E, Fidler S, Moreno-Noguer F, Urtasun R (2015) Neuroaesthetics in fashion: modeling the perception of fashionability. In: Computer vision and pattern recognition

[34]

Sun G, Wu X, Peng Q (2016) Part-based clothing image annotation by visual neighbor retrieval. Neurocomputing 213:115---124

Digital Library

[35]

Veit A, Kovacs B, Bell S, McAuley J, Bala K, Belongie S J (2015) Learning visual clothing style with heterogeneous dyadic co-occurrences. In: International conference on computer vision, pp 4642---4650

Digital Library

[36]

Wang X, Zhang T (2011) Clothes search in consumer photos via color matching and attribute learning. In: ACM international conference on multimedia, pp 1353---1356

Digital Library

[37]

Wang Z, Sun L, Zhu W, Yang S, Li H, Wu D (2013) Joint social and content recommendation for user-generated videos in online social network. IEEE Trans Multimed 15(3):698---709

Digital Library

[38]

Yamaguchi K, Kiapour M H, Ortiz L E, Berg T L (2012) Parsing clothing in fashion photographs. In: Computer vision and pattern recognition, pp 3570---3577

Digital Library

[39]

Yamaguchi K, Kiapour M H, Berg T L (2013) Paper doll parsing: retrieving similar styles to parse clothing items. In: International conference on computer vision, pp 3519---3526

Digital Library

[40]

Yamaguchi K, Berg T L, Ortiz L E (2014) Chic or social: visual popularity analysis in online fashion networks. In: ACM international conference on multimedia, pp 773---776

Digital Library

[41]

Yang X, Steck H, Liu Y (2012) Circle-based recommendation in online social networks. In: ACM conference on knowledge discovery and data mining, pp 1267---1275

Digital Library

[42]

Zhao B, Wu X, Peng Q, Yan S (2016) Clothing cosegmentation for shopping images with cluttered background. IEEE Trans Multimed 18(6):1111---1123

Cited By

Aayesha AAfzaal MNeidhardt JBoratto LGena CMarras MGermanakos PPopescus E(2024)User Experience of Recommender System: A User Study of Social-aware Fashion Recommendations SystemAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664896(356-361)Online publication date: 27-Jun-2024
https://dl.acm.org/doi/10.1145/3631700.3664896
Tan JYang XYang ZChen RLu YLin L(2024)Extensible Max-Min Collaborative Retention for Online Mini-Batch Learning Hash RetrievalIEEE Transactions on Multimedia10.1109/TMM.2024.335564626(6743-6758)Online publication date: 2-Feb-2024
https://dl.acm.org/doi/10.1109/TMM.2024.3355646
You WJi JSun LYang CYu MChen SYao J(2024)Automatic Generation of Interactive Nonlinear Video for Online Apparel Shopping NavigationIEEE Transactions on Multimedia10.1109/TMM.2023.326661526(474-486)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2023.3266615
Show More Cited By

Index Terms

Personalized clothing recommendation combining user social circle and fashion style consistency
1. Computing methodologies
  1. Machine learning
    1. Machine learning approaches
      1. Neural networks
2. Information systems
  1. Information systems applications

Index terms have been assigned to the content through auto-classification.

Recommendations

Collaborative Fashion Recommendation: A Functional Tensor Factorization Approach
MM '15: Proceedings of the 23rd ACM international conference on Multimedia

With the rapid expansion of online shopping for fashion products, effective fashion recommendation has become an increasingly important problem. In this work, we study the problem of personalized outfit recommendation, i.e. automatically suggesting ...
Personalized Recommendation Algorithm Using User Demography Information
WKDD '09: Proceedings of the 2009 Second International Workshop on Knowledge Discovery and Data Mining

Personalized recommendation systems are web-based systems that aim at predicting a user’s interest on available products and services by relying on previously rated items and dealing with the problem of information and product overload. User demography ...
A personalized recommendation system combining case-based reasoning and user-based collaborative filtering
CCDC'09: Proceedings of the 21st annual international conference on Chinese control and decision conference

Personalized recommendation systems are becoming increasingly popular with the evolution of the Internet, and collaborative filtering is one of the most important technologies in recommender systems. Such technology recommends items to a customer ...

Comments

Information & Contributors

Information

Published In

cover image Multimedia Tools and Applications

Multimedia Tools and Applications Volume 77, Issue 14

Jul 2018

1326 pages

ISSN:1380-7501

Issue’s Table of Contents

Copyright © Copyright © 2018 Springer Science+Business Media, LLC, part of Springer Nature.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 July 2018

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 11 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Aayesha AAfzaal MNeidhardt JBoratto LGena CMarras MGermanakos PPopescus E(2024)User Experience of Recommender System: A User Study of Social-aware Fashion Recommendations SystemAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664896(356-361)Online publication date: 27-Jun-2024
https://dl.acm.org/doi/10.1145/3631700.3664896
Tan JYang XYang ZChen RLu YLin L(2024)Extensible Max-Min Collaborative Retention for Online Mini-Batch Learning Hash RetrievalIEEE Transactions on Multimedia10.1109/TMM.2024.335564626(6743-6758)Online publication date: 2-Feb-2024
https://dl.acm.org/doi/10.1109/TMM.2024.3355646
You WJi JSun LYang CYu MChen SYao J(2024)Automatic Generation of Interactive Nonlinear Video for Online Apparel Shopping NavigationIEEE Transactions on Multimedia10.1109/TMM.2023.326661526(474-486)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2023.3266615
Wang YLiu LFu XLiu L(2024)MCCP: multi-modal fashion compatibility and conditional preference model for personalized clothing recommendationMultimedia Tools and Applications10.1007/s11042-023-15659-583:4(9621-9645)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1007/s11042-023-15659-5
Fan Y(2023)Clothing Style Recognition and Design by Using Feature Representation and Collaboration LearningInternational Journal of e-Collaboration10.4018/IJeC.31687019:5(1-14)Online publication date: 27-Jan-2023
https://dl.acm.org/doi/10.4018/IJeC.316870
Deldjoo YNazary FRamisa AMcAuley JPellegrini GBellogin ANoia T(2023)A Review of Modern Fashion Recommender SystemsACM Computing Surveys10.1145/362473356:4(1-37)Online publication date: 21-Oct-2023
https://dl.acm.org/doi/10.1145/3624733
Liu HHe JCheng ZXiang WYang QChai WWang GBao XLuo BGeng YXie XEl Saddik AMei TCucchiara RBertini MTobon Vallejo DAtrey PHossain M(2023)PoSynDA: Multi-Hypothesis Pose Synthesis Domain Adaptation for Robust 3D Human Pose EstimationProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3612368(5542-5551)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3581783.3612368
Bao XCheng ZHe JXiang WLi CSun JLiu HLiu WLuo BGeng YXie XEl Saddik AMei TCucchiara RBertini MTobon Vallejo DAtrey PHossain M(2023)KeyPosS: Plug-and-Play Facial Landmark Detection through GPS-Inspired True-Range MultilaterationProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3612366(5746-5755)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3581783.3612366
Akram SMalik PSingh RGehlot AJuyal AGhafoor KShrestha S(2022)Implementation of Digitalized Technologies for Fashion Industry 4.0Scientific Programming10.1155/2022/75232462022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/7523246
Yu Y(2022)Beyond Natural Language Processing: Building Knowledge Graphs to Assist Scientists Understand COVID-19 ConceptsProceedings of the 2022 5th International Conference on Machine Learning and Natural Language Processing10.1145/3578741.3578791(245-251)Online publication date: 23-Dec-2022
https://dl.acm.org/doi/10.1145/3578741.3578791
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents