Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1007/978-3-030-47426-3_1guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

Fashion Recommendation with Multi-relational Representation Learning

Published: 11 May 2020 Publication History
  • Get Citation Alerts
  • Abstract

    Driven by increasing demands of assisting users to dress and match clothing properly, fashion recommendation has attracted wide attention. Its core idea is to model the compatibility among fashion items by jointly projecting embedding into a unified space. However, modeling the item compatibility in such a category-agnostic manner could barely preserve intra-class variance, thus resulting in sub-optimal performance. In this paper, we propose a novel category-aware metric learning framework, which not only learns the cross-category compatibility notions but also preserves the intra-category diversity among items. Specifically, we define a category complementary relation representing a pair of category labels, e.g., tops-bottoms. Given a pair of item embeddings, we first project them to their corresponding relation space, then model the mutual relation of a pair of categories as a relation transition vector to capture compatibility amongst fashion items. We further derive a negative sampling strategy with non-trivial instances to enable the generation of expressive and discriminative item representations. Comprehensive experimental results conducted on two public datasets demonstrate the superiority and feasibility of our proposed approach.

    References

    [1]
    Ak, K.E., Kassim, A.A., Lim, J.H., Tham, J.Y.: Learning attribute representations with localization for flexible fashion search. In: CVPR (2018)
    [2]
    Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: NIPS, pp. 2787–2795 (2013)
    [3]
    Chen H, Gallagher A, and Girod B Fitzgibbon A, Lazebnik S, Perona P, Sato Y, and Schmid C Describing clothing by semantic attributes Computer Vision – ECCV 2012 2012 Heidelberg Springer 609-623
    [4]
    Chen, L., He, Y.: Dress fashionably: learn fashion collocation with deep mixed-category metric learning. In: AAAI, pp. 2103–2110 (2018)
    [5]
    Han, X., Wu, Z., Jiang, Y., Davis, L.S.: Learning fashion compatibility with bidirectional LSTMS. In: ACM MM, pp. 1078–1086 (2017)
    [6]
    He, R., Packer, C., McAuley, J.J.: Learning compatibility across categories for heterogeneous item recommendation. In: ICDM, pp. 937–942 (2016)
    [7]
    Ji, G., Liu, K., He, S., Zhao, J.: Knowledge graph completion with adaptive sparse transfer matrix. In: AAAI (2016)
    [8]
    Kiapour, M.H., Han, X., Lazebnik, S., Berg, A.C., Berg, T.L.: Where to buy it: matching street clothing photos in online shops. In: ICCV (2015)
    [9]
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS, pp. 1097–1105 (2012)
    [10]
    Li Y, Luo Y, and Huang Z Borovica-Gajic R, Qi J, and Wang W Graph-based relation-aware representation learning for clothing matching Databases Theory and Applications 2020 Cham Springer 189-197
    [11]
    Liu, Z., Luo, P., Qiu, S., Wang, X., Tang, X.: DeepFashion: powering robust clothes recognition and retrieval with rich annotations. In: CVPR. IEEE (2016)
    [12]
    Luo, Y., Wang, Z., Huang, Z., Yang, Y., Zhao, C.: Coarse-to-fine annotation enrichment for semantic segmentation learning. In: CIKM (2018)
    [13]
    McAuley, J.J., Targett, C., Shi, Q., van den Hengel, A.: Image-based recommendations on styles and substitutes. In: SIGIR, pp. 43–52 (2015)
    [14]
    Nickel, M., Tresp, V., Kriegel, H.: A three-way model for collective learning on multi-relational data. In: ICML, pp. 809–816 (2011)
    [15]
    Rendle, S., Freudenthaler, C., Gantner, Z., Schmidt-Thieme, L.: BPR: bayesian personalized ranking from implicit feedback. In: IJAI, pp. 452–461 (2009)
    [16]
    Song, X., Feng, F., Liu, J., Li, Z., Nie, L., Ma, J.: Neurostylist: neural compatibility modeling for clothing matching. In: ACM MM, pp. 753–761 (2017)
    [17]
    Vasileva MI, Plummer BA, Dusad K, Rajpal S, Kumar R, and Forsyth D Ferrari V, Hebert M, Sminchisescu C, and Weiss Y Learning type-aware embeddings for fashion compatibility Computer Vision – ECCV 2018 2018 Cham Springer 405-421
    [18]
    Veit, A., Belongie, S.J., Karaletsos, T.: Conditional similarity networks. In: CVPR, pp. 1781–1789 (2017)
    [19]
    Veit, A., Kovacs, B., Bell, S., McAuley, J.J., Bala, K., Belongie, S.J.: Learning visual clothing style with heterogeneous dyadic co-occurrences. In: ICCV, pp. 4642–4650 (2015)
    [20]
    Wang, Z., Zhang, J., Feng, J., Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: AAAI (2014)
    [21]
    Yang, X., et al.: Interpretable fashion matching with rich attributes. In: SIGIR (2019)
    [22]
    Yang, X., Ma, Y., Liao, L., Wang, M., Chua, T.: TransNFCM: translation-based neural fashion compatibility modeling. In: AAAI, pp. 403–410 (2019)

    Cited By

    View all
    • (2023)Recommendation of Mix-and-Match Clothing by Modeling Indirect Personal CompatibilityProceedings of the 2023 ACM International Conference on Multimedia Retrieval10.1145/3591106.3592224(560-564)Online publication date: 12-Jun-2023

    Index Terms

    1. Fashion Recommendation with Multi-relational Representation Learning
            Index terms have been assigned to the content through auto-classification.

            Recommendations

            Comments

            Information & Contributors

            Information

            Published In

            cover image Guide Proceedings
            Advances in Knowledge Discovery and Data Mining: 24th Pacific-Asia Conference, PAKDD 2020, Singapore, May 11–14, 2020, Proceedings, Part I
            May 2020
            905 pages
            ISBN:978-3-030-47425-6
            DOI:10.1007/978-3-030-47426-3
            • Editors:
            • Hady W. Lauw,
            • Raymond Chi-Wing Wong,
            • Alexandros Ntoulas,
            • Ee-Peng Lim,
            • See-Kiong Ng,
            • Sinno Jialin Pan

            Publisher

            Springer-Verlag

            Berlin, Heidelberg

            Publication History

            Published: 11 May 2020

            Author Tags

            1. Fashion compatibility
            2. Fashion recommendation
            3. Representation learning

            Qualifiers

            • Article

            Contributors

            Other Metrics

            Bibliometrics & Citations

            Bibliometrics

            Article Metrics

            • Downloads (Last 12 months)0
            • Downloads (Last 6 weeks)0

            Other Metrics

            Citations

            Cited By

            View all
            • (2023)Recommendation of Mix-and-Match Clothing by Modeling Indirect Personal CompatibilityProceedings of the 2023 ACM International Conference on Multimedia Retrieval10.1145/3591106.3592224(560-564)Online publication date: 12-Jun-2023

            View Options

            View options

            Get Access

            Login options

            Media

            Figures

            Other

            Tables

            Share

            Share

            Share this Publication link

            Share on social media