Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3477314.3506994acmconferencesArticle/Chapter ViewAbstractPublication PagessacConference Proceedingsconference-collections
research-article

Enhanced strawberry image classification using multi-task deep neural learning

Published: 06 May 2022 Publication History

Abstract

Strawberry is a popular fruit with a unique flavor between sweetness and sourness. Harvesting the fruit at the correct ripeness stage, along with the estimation of its acidity and Brix values, is an essential factor in the smart farming of the fruit. While the previous works focus on the two tasks (of ripening stage classification and Brix and acidity estimation) separately, we first show that the effective estimation of acidity and Brix is possible and that the estimation of these measures can improve the ripening stage identification of strawberries as well. We assemble the estimation of the acidity and Brix measures in our proposed Cascaded Convolutional Multi-Task Deep Neural Learning (CC-MTDNL) structure accompanying the image classification task simultaneously. Our best empirical network structure achieved a 96% classification accuracy while also effectively estimating Brix and acidity values. In particular, the proposed CC-MTDNL model shows higher effectiveness when compared with other neural network models in our experiments. These findings will benefit both consumers' and farmers' perspectives for taste and more effective harvesting and grading of strawberries.

References

[1]
Wanhyun Cho, Myunghwan Na, Sangkoon Kim, and Wonbae Jeon. 2019. Automatic prediction of brix and acidity in stages of ripeness of strawberries using image processing techniques. In 2019 34th International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC). IEEE, 1--4.
[2]
Sandya De Alwis, Yishuo Zhang, Myung Na, and Gang Li. 2019. Duo Attention with Deep Learning on Tomato Yield Prediction and Factor Interpretation. In Pacific Rim International Conference on Artificial Intelligence. Springer, 704--715.
[3]
Zongmei Gao, Yuanyuan Shao, Guantao Xuan, Yongxian Wang, Yi Liu, and Xiang Han. 2020. Real-time hyperspectral imaging for the in-field estimation of strawberry ripeness with deep learning. Artificial Intelligence in Agriculture 4 (2020), 31--38.
[4]
Manuel B Garcia, Shaneth Ambat, and Rossana T Adao. 2019. Tomayto, Tomahto: A Machine Learning Approach for Tomato Ripening Stage Identification Using Pixel-Based Color Image Classification. In 2019 IEEE 11th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management (HNICEM). IEEE, 1--6.
[5]
Yuanyue Ge, Ya Xiong, Gabriel Lins Tenorio, and Pal Johan From. 2019. Fruit Localization and Environment Perception for Strawberry Harvesting Robots. IEEE Access 7 (2019), 147642--147652.
[6]
Diederik P. Kingma and Jimmy Ba. 2017. Adam: A Method for Stochastic Optimization. arXiv:1412.6980 [cs.LG]
[7]
Shihan Mao, Yuhua Li, You Ma, Baohua Zhang, Jun Zhou, and Kai Wang. 2020. Automatic cucumber recognition algorithm for harvesting robots in the natural environment using deep learning and multi-feature fusion. Computers and Electronics in Agriculture 170, January (2020), 105254.
[8]
Fatma MA Mazen and Ahmed A Nashat. 2019. Ripeness classification of bananas using an artificial neural network. Arabian Journal for Science and Engineering 44, 8 (2019), 6901--6910.
[9]
Ishan Misra, Abhinav Shrivastava, Abhinav Gupta, and M. Hebert. 2016. Cross-Stitch Networks for Multi-task Learning. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016), 3994--4003.
[10]
Teresa M Montero, Esperanza M Mollá, Rosa M Esteban, and Francisco J López-Andréu. 1996. Quality attributes of strawberry during ripening. Scientia Horticulturae 65, 4 (1996), 239--250.
[11]
Xuan Nie, Luyao Wang, Haoxuan Ding, and Min Xu. 2019. Strawberry Verticillium Wilt Detection Network Based on Multi-Task Learning and Attention. IEEE Access 7 (2019), 170003--170011.
[12]
Lin Mar Oo and Nay Zar Aung. 2018. A simple and efficient method for automatic strawberry shape and size estimation and classification. Biosystems Engineering 170 (2018), 96--107.
[13]
Meng Ren, Huy Quan Vu, Gang Li, and Rob Law. 2021. Large-scale comparative analyses of hotel photo content posted by managers and customers to review platforms based on deep learning: implications for hospitality marketers. Journal of Hospitality Marketing & Management 30, 1 (2021), 96--119.
[14]
Sebastian Ruder, Joachim Bingel, Isabelle Augenstein, and Anders Søgaard. 2017. Sluice networks: Learning what to share between loosely related tasks. ArXiv abs/1705.08142 (2017).
[15]
Hasan Seyyedhasani, Chen Peng, Wei jiunn Jang, and Stavros G. Vougioukas. 2020. Collaboration of human pickers and crop-transporting robots during harvesting - Part I: Model and simulator development. Computers and Electronics in Agriculture 172, November 2019 (2020), 105324.
[16]
Yuanyuan Shao, Yongxian Wang, Guantao Xuan, Zongmei Gao, Zhichao Hu, Chong Gao, and Kaili Wang. 2020. Assessment of Strawberry Ripeness Using Hyperspectral Imaging. Analytical Letters 54, 10 (2020), 1547--1560.
[17]
Zhang Yishuo, Li Gang, Birgit Muskat, Quan Huy Vu, Rob Law, et al. 2021. Predictivity of tourism demand data. (2021).
[18]
Chu Zhang, Chentong Guo, Fei Liu, Wenwen Kong, Yong He, and Binggan Lou. 2016. Hyperspectral imaging analysis for ripeness evaluation of strawberry with support vector machine. Journal of Food Engineering 179 (2016), 11--18.
[19]
Yishuo Zhang, Gang Li, Birgit Muskat, and Rob Law. 2021. Tourism demand forecasting: A decomposed deep learning approach. Journal of Travel Research 60, 5 (2021), 981--997.

Cited By

View all
  • (2024)Migrant Farmworkers' Experiences of Agricultural Technologies: Implications for Worker Sociality and Desired ChangeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642263(1-23)Online publication date: 11-May-2024
  • (2024)Technology progress in mechanical harvest of fresh market strawberriesComputers and Electronics in Agriculture10.1016/j.compag.2024.109468226:COnline publication date: 1-Nov-2024
  • (2023)HCI Research on Agriculture: Competing Sociotechnical Imaginaries, Definitions, and OpportunitiesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581081(1-24)Online publication date: 19-Apr-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SAC '22: Proceedings of the 37th ACM/SIGAPP Symposium on Applied Computing
April 2022
2099 pages
ISBN:9781450387132
DOI:10.1145/3477314
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 May 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. brix and acidity estimation
  2. convolutional neural network
  3. multi-task deep learning
  4. smart farming
  5. strawberry classification

Qualifiers

  • Research-article

Funding Sources

  • Australian Government Research Training Program Scholarship

Conference

SAC '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Upcoming Conference

SAC '25
The 40th ACM/SIGAPP Symposium on Applied Computing
March 31 - April 4, 2025
Catania , Italy

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)19
  • Downloads (Last 6 weeks)1
Reflects downloads up to 14 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Migrant Farmworkers' Experiences of Agricultural Technologies: Implications for Worker Sociality and Desired ChangeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642263(1-23)Online publication date: 11-May-2024
  • (2024)Technology progress in mechanical harvest of fresh market strawberriesComputers and Electronics in Agriculture10.1016/j.compag.2024.109468226:COnline publication date: 1-Nov-2024
  • (2023)HCI Research on Agriculture: Competing Sociotechnical Imaginaries, Definitions, and OpportunitiesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581081(1-24)Online publication date: 19-Apr-2023
  • (2023)Research on Strawberry Quality Grading Based on Object Detection and Stacking Fusion ModelIEEE Access10.1109/ACCESS.2023.333957211(137475-137484)Online publication date: 2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media