Apple quality identification and classification by image processing based on convolutional neural networks

Yanfei Li; Xianying Feng; Yandong Liu; Xingchang Han

doi:10.1038/s41598-021-96103-2

Apple quality identification and classification by image processing based on convolutional neural networks

Sci Rep. 2021 Aug 17;11(1):16618. doi: 10.1038/s41598-021-96103-2.

Authors

Yanfei Li^{1

2}, Xianying Feng^{3

4}, Yandong Liu^{1

2}, Xingchang Han^{1

2

5}

Affiliations

¹ School of Mechanical Engineering, Shandong University, Jinan, 250061, Shandong, China.
² Key Laboratory of High Efficiency and Clean Mechanical Manufacture of Ministry of Education, Shandong University, Jinan, 250061, Shandong, China.
³ School of Mechanical Engineering, Shandong University, Jinan, 250061, Shandong, China. fxying@sdu.edu.cn.
⁴ Key Laboratory of High Efficiency and Clean Mechanical Manufacture of Ministry of Education, Shandong University, Jinan, 250061, Shandong, China. fxying@sdu.edu.cn.
⁵ Shandong Academy of Agricultural Machinery Sciences, Jinan, 250100, Shandong, China.

Abstract

This work researched apple quality identification and classification from real images containing complicated disturbance information (background was similar to the surface of the apples). This paper proposed a novel model based on convolutional neural networks (CNN) which aimed at accurate and fast grading of apple quality. Specific, complex, and useful image characteristics for detection and classification were captured by the proposed model. Compared with existing methods, the proposed model could better learn high-order features of two adjacent layers that were not in the same channel but were very related. The proposed model was trained and validated, with best training and validation accuracy of 99% and 98.98% at 2590th and 3000th step, respectively. The overall accuracy of the proposed model tested using an independent 300 apple dataset was 95.33%. The results showed that the training accuracy, overall test accuracy and training time of the proposed model were better than Google Inception v3 model and traditional imaging process method based on histogram of oriented gradient (HOG), gray level co-occurrence matrix (GLCM) features merging and support vector machine (SVM) classifier. The proposed model has great potential in Apple's quality detection and classification.