research-article

An Instance Segmentation Model to Categorize Clothes from Wild Fashion Images

Authors:

Rohan Indrajeet Jadhav,

Rejwanul Haque,

Mohammed HasanuzzamanAuthors Info & Claims

ICDLT '22: Proceedings of the 2022 6th International Conference on Deep Learning Technologies

Pages 75 - 83

https://doi.org/10.1145/3556677.3556690

Published: 08 October 2022 Publication History

Abstract

Categorizing of clothes from wild fashion images involves identifying the type of clothes a person wears from non-studio images such as a shirt, trousers, and so on. Identifying the fashion clothes from wild images that are often grainy, unfocused, with people in different poses is a challenge. This research proposes a comparison between object detection and instance segmentation based models to categorise clothes from wild fashion images. The Object detection model is implemented using Faster Region-Based Convolutional Neural Network (RCNN). Mask RCNN is used to implement an instance segmentation model. We have trained the models on standard benchmark dataset namely deepfashion2. Results demonstrate that Instance Segmentation models such as Mask RCNN outperforms Object Detection models by 20%. Mask RCNN achieved 21.05% average precision, 73% recall across the different IoU (Intersection over Union). These results show promise for using Instance Segmentation models for faster image retrieval based e-commerce applications.

References

[1]

Patricia S. Abril and Robert Plant. 2007. The patent holder’s dilemma: Buy, sell, or troll?Commun. ACM 50, 1 (Jan. 2007), 36–44. https://doi.org/10.1145/1188913.1188915

Digital Library

[2]

Rajaram Anantharaman, Matthew Velazquez, and Yugyung Lee. 2018. Utilizing Mask R-CNN for Detection and Segmentation of Oral Diseases. In 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). 2197–2204. https://doi.org/10.1109/BIBM.2018.8621112

[3]

Yu-Wei Chao, Sudheendra Vijayanarasimhan, Bryan Seybold, David A. Ross, Jia Deng, and Rahul Sukthankar. 2018. Rethinking the Faster R-CNN Architecture for Temporal Action Localization. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 1130–1139. https://doi.org/10.1109/CVPR.2018.00124

[4]

Triphena Delight D and Karunakaran V. 2021. Deep Learning based Object Detection using Mask RCNN. In 2021 6th International Conference on Communication and Electronics Systems (ICCES). 1684–1690. https://doi.org/10.1109/ICCES51350.2021.9489152

[5]

Jian Ding, Nan Xue, Gui-Song Xia, Xiang Bai, Wen Yang, Michael Yang, Serge Belongie, Jiebo Luo, Mihai Datcu, Marcello Pelillo, and et al.2021. Object Detection in Aerial Images: A Large-Scale Benchmark and Challenges. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021), 1–1. https://doi.org/10.1109/tpami.2021.3117983

[6]

Zhihua Feng, Xin Luo, Tao Yang, and Kenji Kita. 2018. An object Detection System Based on YOLOv2 in Fashion Apparel. In 2018 IEEE 4th International Conference on Computer and Communications (ICCC). 1532–1536. https://doi.org/10.1109/CompComm.2018.8780944

[7]

Yuying Ge, Ruimao Zhang, Lingyun Wu, Xiaogang Wang, Xiaoou Tang, and Ping Luo. 2019. DeepFashion2: A Versatile Benchmark for Detection, Pose Estimation, Segmentation and Re-Identification of Clothing Images. arxiv:1901.07973 [cs.CV]

[8]

Costantino Grana, Daniele Borghesani, and Rita Cucchiara. 2012. Class-Based Color Bag of Words for Fashion Retrieval. In 2012 IEEE International Conference on Multimedia and Expo. 444–449. https://doi.org/10.1109/ICME.2012.13

Digital Library

[9]

Fabian Caba Heilbron, Bojan Pepik, Zohar Barzelay, and Michael Donoser. 2019. Clothing Recognition in the Wild using the Amazon Catalog. In 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW). 3145–3148. https://doi.org/10.1109/ICCVW.2019.00385

[10]

Menglin Jia, Yichen Zhou, Mengyun Shi, and Bharath Hariharan. 2018. A Deep-Learning-Based Fashion Attributes Detection Model. arxiv:1810.10148 [cs.CV]

[11]

Mohammed Kayed, Ahmed Anter, and Hadeer Mohamed. 2020. Classification of Garments from Fashion MNIST Dataset Using CNN LeNet-5 Architecture. In 2020 International Conference on Innovative Trends in Communication and Computer Engineering (ITCE). 238–243. https://doi.org/10.1109/ITCE48509.2020.9047776

[12]

Hyo Jin Kim, Doo Hee Lee, Asim Niaz, Chan Yong Kim, Asif Aziz Memon, and Kwang Nam Choi. 2021. Multiple-Clothing Detection and Fashion Landmark Estimation Using a Single-Stage Detector. IEEE Access 9(2021), 11694–11704. https://doi.org/10.1109/ACCESS.2021.3051424

[13]

Ziwei Liu, Ping Luo, Shi Qiu, Xiaogang Wang, and Xiaoou Tang. 2016. DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 1096–1104. https://doi.org/10.1109/CVPR.2016.124

[14]

Shaheena Noor, Maria Waqas, Muhammad Imran Saleem, and Humera Noor Minhas. 2021. Automatic Object Tracking and Segmentation Using Unsupervised SiamMask. IEEE Access 9(2021), 106550–106559. https://doi.org/10.1109/ACCESS.2021.3101054

[15]

Vladyslav Pliuhin, Volodymyr Korobka, Andrey Karyuk, Mycola Pan, and Maria Sukhonos. 2019. Using Azure Machine Learning Studio with Python Scripts for Induction Motors Optimization Web-Deploy Project. In 2019 IEEE International Scientific-Practical Conference Problems of Infocommunications, Science and Technology (PIC S T). 631–634. https://doi.org/10.1109/PICST47496.2019.9061447

[16]

Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2017. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 39, 6(2017), 1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031

Digital Library

[17]

Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2017. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 39, 6(2017), 1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031

Digital Library

[18]

Neha Sharma, Vibhor Jain, and Anju Mishra. 2018. An Analysis Of Convolutional Neural Networks For Image Classification. Procedia Computer Science 132 (2018), 377–384. https://doi.org/10.1016/j.procs.2018.05.198 International Conference on Computational Intelligence and Data Science.

Digital Library

[19]

Jun Xiang, Tiantian Dong, Ruru Pan, and Weidong Gao. 2020. Clothing Attribute Recognition Based on RCNN Framework Using L-Softmax Loss. IEEE Access 8(2020), 48299–48313. https://doi.org/10.1109/ACCESS.2020.2979164

[20]

Xiaoye Zhang, Chengfang Song, Yingyi Yang, Zheng Zhang, Xining Zhang, Peng Wang, and Qin Zou. 2020. Deep learning based human body segmentation for clothing fashion classification. In 2020 Chinese Automation Congress (CAC). 7544–7549. https://doi.org/10.1109/CAC51589.2020.9327016

[21]

Dingfu Zhou, Jin Fang, Xibin Song, Chenye Guan, Junbo Yin, Yuchao Dai, and Ruigang Yang. 2019. IoU Loss for 2D/3D Object Detection. In 2019 International Conference on 3D Vision (3DV). 85–94. https://doi.org/10.1109/3DV.2019.00019

Cited By

Stynes PMuntean CSheridan FThornbury EPathak P(2024)Research Supervision Framework: A Student's Experience2024 IEEE World Engineering Education Conference (EDUNINE)10.1109/EDUNINE60625.2024.10500658(1-5)Online publication date: 10-Mar-2024
https://doi.org/10.1109/EDUNINE60625.2024.10500658
Marigowda CMoldovan ASiddig AMuntean CPathak PStynes P(2023)A Novel Hybrid Machine Learning Framework to Recommend E-Commerce ProductsProceedings of the 2023 5th International Conference on Information Technology and Computer Communications10.1145/3606843.3606853(59-67)Online publication date: 15-Jun-2023
https://dl.acm.org/doi/10.1145/3606843.3606853

Index Terms

An Instance Segmentation Model to Categorize Clothes from Wild Fashion Images
1. Computing methodologies
  1. Machine learning
    1. Machine learning approaches
      1. Neural networks
2. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing systems and tools
      1. Social networking sites

Recommendations

A semantic segmentation algorithm for fashion images based on modified mask RCNN
Abstract
The semantic segmentation of human body images has huge application potential in many fields, such as autonomous driving, artificial intelligence (AI) face changing, and virtual try-on. Nowadays, many researchers use additional human body posture ...
A novel finetuned YOLOv6 transfer learning model for real-time object detection
Abstract
Object detection and object recognition are the most important applications of computer vision. To pursue the task of object detection efficiently, a model with higher detection accuracy is required. Increasing the detection accuracy of the model ...
3D Nucleus Instance Segmentation for Whole-Brain Microscopy Images
Information Processing in Medical Imaging
Abstract
Tissue clearing and light-sheet microscopy technologies offer new opportunities to quantify the three-dimensional (3D) neural structure at a cellular or even sub-cellular resolution. Although many efforts have been made to recognize nuclei in 3D ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICDLT '22: Proceedings of the 2022 6th International Conference on Deep Learning Technologies

July 2022

155 pages

ISBN:9781450396936

DOI:10.1145/3556677

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 October 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICDLT 2022

ICDLT 2022: 2022 6th International Conference on Deep Learning Technologies

July 26 - 28, 2022

Xi'an, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
107
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)1

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Stynes PMuntean CSheridan FThornbury EPathak P(2024)Research Supervision Framework: A Student's Experience2024 IEEE World Engineering Education Conference (EDUNINE)10.1109/EDUNINE60625.2024.10500658(1-5)Online publication date: 10-Mar-2024
https://doi.org/10.1109/EDUNINE60625.2024.10500658
Marigowda CMoldovan ASiddig AMuntean CPathak PStynes P(2023)A Novel Hybrid Machine Learning Framework to Recommend E-Commerce ProductsProceedings of the 2023 5th International Conference on Information Technology and Computer Communications10.1145/3606843.3606853(59-67)Online publication date: 15-Jun-2023
https://dl.acm.org/doi/10.1145/3606843.3606853

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents