research-article

A hierarchical approach based CBIR scheme using shape, texture, and color for accelerating retrieval process

Authors:

Arup Kumar Pal,

Naushad Varish,

Irfan Nurhidayat,

Sayed M. Eldin,

Soubhagya Kumar SahooAuthors Info & Claims

Volume 35, Issue 7

https://doi.org/10.1016/j.jksuci.2023.101609

Published: 01 July 2023 Publication History

Abstract

In the traditional content-based image retrieval (CBIR) framework, images are retrieved based on the combined primitive features. However, such a kind of fusion is always not effective as one feature may overshadow other image feature. To overcome this issue, in this particular paper, we have suggested a hierarchical framework where features like color, texture, and shape are considered in a single hierarchy only. The main concern of the hierarchical system is the proper selection of the order of retrieving visual features. So, semantic-based image retrieval has been carried out. Here, at the first level, the salience map-based region of interest has been identified, and then edge histogram descriptor-based shape features are incorporated. In the second hierarchy, we have proposed a novel directional texture feature extraction based on the Tamura features’ directionality. Further, color is considered another primitive feature of an image, but human visual perception is not sensitive to each color. The image can be visualized by the salient colors, and in this work, we have developed a color image quantization-based approach. Now, to validate the system, extensive experimental results and its comparison with its contemporaries through Corel-1 K, GHIM-10 K, Olivia-2688, and Produce-1400 databases have been carried out.

References

[1]

K.T. Ahmed, S. Ummesafi, A. Iqbal, Content based image retrieval using image features information fusion, Informat. Fus. 51 (2019) 76–99.

[2]

R. Ashraf, K. Bashir, A. Irtaza, M.T. Mahmood, Content based image retrieval using embedded neural networks with bandletized regions, Entropy 17 (6) (2015) 3552–3580.

[3]

J. Canny, A computational approach to edge detection, in: Readings in Computer Vision, Elsevier, 1987, pp. 184–203.

[4]

S.R. Dubey, S.K. Singh, R.K. Singh, Multichannel decoded local binary patterns for content-based image retrieval, IEEE Trans. Image Process. 25 (9) (2016) 4018–4032.

[5]

J. Flusser, T. Suk, Rotation moment invariants for recognition of symmetric objects, IEEE Trans. Image Process. 15 (12) (2006) 3784–3790.

[6]

Gu, Y., Panda, B., Haque, A, K., 2001. Design and analysis of data structures for querying image databases. In: Proceedings of the 2001 ACM Symposium on Applied Computing, ACM, pp. 236–241.

[7]

P. Heckbert, Color Image Quantization for Frame Buffer Display, vol. 16, ACM, 1982.

[8]

P. Howarth, S.M. Rüger, Evaluation of texture features for content-based image retrieval, CIVR, vol. 3115, Springer, 2004, pp. 326–334.

[9]

A. Khokher, R. Talwar, A fast and effective image retrieval scheme using color-, texture-, and shape-based histograms, Multimedia Tools Appl. 76 (20) (2017) 21787–21809.

[10]

R. Krishnamoorthy, S.S. Devi, Image retrieval using edge based shape similarity with multiresolution enhanced orthogonal polynomials model, Digital Signal Process. 23 (2) (2013) 555–568.

[11]

S. Kumar, A.K. Pal, A cbir scheme using active contour and edge histogram descriptor in ycbcr color space, IJCTA 9 (41) (2016) 889–898.

[12]

S. Kumar, J. Pradhan, A.K. Pal, A cbir scheme using glcm features in dct domain, in: 2017 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC), IEEE, 2017, pp. 1–7.

[13]

S. Kumar, J. Pradhan, A.K. Pal, A cbir technique based on the combination of shape and color features, in: Advanced Computational and Communication Paradigms, Springer, 2018, pp. 737–744.

[14]

S. Kumar, A.K. Pal, S.H. Islam, M. Hammoudeh, Secure and efficient image retrieval through invariant features selection in insecure cloud environments, Neural Comput. Appl. (2021) 1–26.

[15]

S. Kumar, J. Pradhan, A.K. Pal, Adaptive tetrolet based color, texture and shape feature extraction for content based image retrieval application, Multimedia Tools Appl. 80 (19) (2021) 29017–29049.

[16]

S. Kumar, J. Pradhan, A.K. Pal, S.H. Islam, M.K. Khan, Radiological image retrieval technique using multi-resolution texture and shape features, Multimedia Tools Appl. (2021) 1–28.

[17]

S. Kumar, M. Singhal, R. Revthi, A local feature extraction mechanism for effective content based image retrieval, in: 2022 2nd International Conference on Emerging Frontiers in Electrical and Electronic Technologies (ICEFEET), IEEE, 2022, pp. 1–6.

[18]

M.K. Kundu, M. Chowdhury, S.R. Bulò, A graph-based relevance feedback mechanism in content-based image retrieval, Knowl.-Based Syst. 73 (2015) 254–264.

Digital Library

[19]

J. Li, J.Z. Wang, Real-time computerized annotation of pictures, IEEE Trans. Pattern Anal. Machine Intell. 30 (6) (2008) 985–1002.

[20]

G.-H. Liu, J.-Y. Yang, Content-based image retrieval using color difference histogram, Pattern Recogn. 46 (1) (2013) 188–198.

[21]

Y. Liu, D. Zhang, G. Lu, W.-Y. Ma, A survey of content-based image retrieval with high-level semantics, Pattern Recogn. 40 (1) (2007) 262–282.

Digital Library

[22]

G.-H. Liu, L. Zhang, Y.-K. Hou, Z.-Y. Li, J.-Y. Yang, Image retrieval based on multi-texton histogram, Pattern Recogn. 43 (7) (2010) 2380–2389.

Digital Library

[23]

G.-H. Liu, Z.-Y. Li, L. Zhang, Y. Xu, Image retrieval based on micro-structure descriptor, Pattern Recogn. 44 (9) (2011) 2123–2133.

[24]

G.-H. Liu, J.-Y. Yang, Z. Li, Content-based image retrieval using computational visual attention model, Pattern Recogn. 48 (8) (2015) 2554–2566.

[25]

F. Mahmoudi, J. Shanbehzadeh, A.-M. Eftekhari-Moghadam, H. Soltanian-Zadeh, Image retrieval based on shape similarity by edge orientation autocorrelogram, Pattern Recogn. 36 (8) (2003) 1725–1736.

[26]

R. Maini, H. Aggarwal, Study and comparison of various image edge detection techniques, Int. J. Image Process. (IJIP) 3 (1) (2009) 1–11.

[27]

A. Oliva, A. Torralba, Modeling the shape of the scene: A holistic representation of the spatial envelope, Int. J. Comput. Vision 42 (3) (2001) 145–175.

Digital Library

[28]

N. Otsu, A threshold selection method from gray-level histograms, IEEE Trans. Syst. Man Cybernet. 9 (1) (1979) 62–66.

[29]

S. Pandey, P. Khanna, H. Yokota, A semantics and image retrieval system for hierarchical image databases, Informat. Process. Manage. 52 (4) (2016) 571–591.

[30]

J. Pradhan, A.K. Pal, H. Banka, A prominent object region detection based approach for cbir application, in: Parallel, Distributed and Grid Computing (PDGC), 2016 Fourth International Conference on, IEEE, 2016, pp. 447–452.

[31]

Produce-1400 Database. http://www.ic.unicamp.br/rocha/pub/downloads/tropical-fruits-DB-1024x768.tar.gz/. Accessed: 2018-04-07.

[32]

Rosenfeld, A., 1975. Visual texture analysis: An overview. Technical report, MARYLAND UNIV COLLEGE PARK COMPUTER SCIENCE CENTER.

[33]

F.A.A. Salih, A.A. Abdulla, Two-layer content-based image retrieval technique for improving effectiveness, Multimedia Tools Appl. (2023) 1–22.

[34]

N. Shrivastava, V. Tyagi, An efficient technique for retrieval of color images in large databases, Comput. Electr. Eng. 46 (2015) 314–327.

[35]

P. Srivastava, N.T. Binh, A. Khare, Content-based image retrieval using moments of local ternary pattern, Mobile Networks Appl. 19 (5) (2014) 618–625.

[36]

H. Tamura, S. Mori, T. Yamawaki, Textural features corresponding to visual perception, IEEE Trans. Syst. Man Cybernet. 8 (6) (1978) 460–473.

[37]

Y. Tankala, J.K. Paul, V. Manikandan, A content-based image retrieval scheme with object detection and quantised colour histogram, Int. J. Comput. Sci. Eng. 25 (4) (2022) 367–374.

[38]

H.R. Tizhoosh, Fast fuzzy edge detection, in: Fuzzy Information Processing Society, 2002. Proceedings. NAFIPS. 2002 Annual Meeting of the North American, IEEE, 2002, pp. 239–242.

[39]

R.d.S. Torres, A.X. Falcão, Contour salience descriptors for effective image retrieval and analysis, Image Vis. Comput. 25 (1) (2007) 3–13.

[40]

N. Varish, A modified similarity measurement for image retrieval scheme using fusion of color, texture and shape moments, Multimedia Tools Appl. 81 (15) (2022) 20373–20405.

[41]

N. Varish, S. Kumar, A.K. Pal, A novel similarity measure for content based image retrieval in discrete cosine transform domain, Fundamenta Informat. 156 (2) (2017) 209–235.

[42]

N. Varish, J. Pradhan, A.K. Pal, Image retrieval based on non-uniform bins of color histogram and dual tree complex wavelet transform, Multimedia Tools Appl. 76 (14) (2017) 15885–15921.

[43]

J. Vogel, B. Schiele, Performance evaluation and optimization for content-based image retrieval, Pattern Recogn. 39 (5) (2006) 897–909.

[44]

X.-Y. Wang, Y.-J. Yu, H.-Y. Yang, An effective image retrieval scheme using color, texture and shape features, Comput. Stand. Interf. 33 (1) (2011) 59–68.

[45]

C.S. Won, D.K. Park, S.-J. Park, Efficient use of mpeg-7 edge histogram descriptor, ETRI J. 24 (1) (2002) 23–30.

[46]

S. Zeng, R. Huang, H. Wang, Z. Kang, Image retrieval using spatiograms of colors quantized by gaussian mixture models, Neurocomputing 171 (2016) 673–684.

Cited By

Giveki DEsfandyari S(2025)Semantic image representation for image recognition and retrieval using multilayer variational auto-encoder, InceptionNet and low-level image featuresThe Journal of Supercomputing10.1007/s11227-024-06792-581:1Online publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1007/s11227-024-06792-5

Recommendations

Integration of a three-colour channel with the four diagonals of the GLCM approach for similar image retrieval

Feature extractions are perceptive problems due to differences of opinion in image assets and contents. An image has strong texture and colour channels, i.e., a gray-level cooccurrence matrix (GLCM) and a Red, Green and Blue (RGB) channel. We proposed an ...
Color Directional Local Quinary Patterns for Content Based Indexing and Retrieval

This paper presents a novel evaluationary approach to extract color-texture features for image retrieval application namely Color Directional Local Quinary Pattern (CDLQP). The proposed descriptor extracts the individual R, G and B channel wise ...
Addressing CBIR efficiency, effectiveness, and retrieval subjectivity simultaneously
MIR '03: Proceedings of the 5th ACM SIGMM international workshop on Multimedia information retrieval

This work is about Content Based Image Retrieval (CBIR), focusing on developing a Fast And Semantics-Tailored (FAST) image retrieval methodology. Specifically, the contributions of FAST methodology to the CBIR literature include: (1) development of a ...

Comments

Information & Contributors

Information

Published In

cover image Journal of King Saud University - Computer and Information Sciences

Journal of King Saud University - Computer and Information Sciences Volume 35, Issue 7

Jul 2023

571 pages

ISSN:1319-1578

Issue’s Table of Contents

The Authors.

Publisher

Elsevier Science Inc.

United States

Publication History

Published: 01 July 2023

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Giveki DEsfandyari S(2025)Semantic image representation for image recognition and retrieval using multilayer variational auto-encoder, InceptionNet and low-level image featuresThe Journal of Supercomputing10.1007/s11227-024-06792-581:1Online publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1007/s11227-024-06792-5

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents