research-article

Multi-level colored directional motif histograms for content-based image retrieval

Authors:

Jitesh Pradhan,

Arup Kumar Pal,

Haider BankaAuthors Info & Claims

The Visual Computer, Volume 36, Issue 9

Pages 1847 - 1868

https://doi.org/10.1007/s00371-019-01773-9

Published: 01 September 2020 Publication History

Abstract

Color features and local geometrical structures are the two basic image features which are sufficient to convey the image semantics. Both of these features show diverse nature on the different regions of a natural image. Traditional local motif patterns are standard tools to emphasize these local visual image features. These motif-based schemes consider either structural orientations or limited directional patterns which are not sufficient to realize the detailed local geometrical properties of an image. To address these issues, we have proposed a new multi-level colored directional motif histogram (MLCDMH) for devising a content-based image retrieval scheme. The proposed scheme extracts local structural features at three different levels. Initially, MLCDMH scheme extracts directional structural patterns from a

3 \times 3

pixel grids of an image. This reflects the

9^{9}

different structural arrangements using 28 directional patterns. Next, we have used a weighted neighboring similarity (WNS) scheme to exploit the uniqueness of each motif pixel in its local surrounding. The WNS scheme will compute the importance of each directional motif pattern in its

3 \times 3

local neighborhood. In the last level, we have fused all directional motif images into a single directional difference matrix which reflects the local structural and directional motif features in detail and also reduces the computation overhead. The MLCDMH considers all possible permutations and rotations of the motif patterns to generate rotational invariant structural features. The image retrieval performance of this proposed scheme has been evaluated using different Corel/natural, object, texture and heterogeneous image datasets. The results of the retrieval experiments have shown satisfactory improvement over other motif- and non-motif-based CBIR approaches.

References

[1]

Swain, M.J.: Interactive indexing into image databases. In: Proceedings of SPIE 1908, Storage and Retrieval for Image and Video Databases (1993). 10.1117/12.143659

[2]

Worring M, Smeulders AW, Gupta A, Santini S, and Jain R Content-based image retrieval at the end of the early years IEEE Trans. Pattern Anal. Mach. Intell. 2000 22 1349-1380

[3]

Gudivada VN and Raghavan VV Content based image retrieval systems Computer 1995 28 9 18-22

[4]

Lin C-H, Chen C-C, Lee H-L, and Liao J-R Fast k-means algorithm based on a level histogram for image retrieval Expert Syst. Appl. 2014 41 7 3276-3283

[5]

Anuar FM, Setchi R, and Lai Y Trademark image retrieval using an integrated shape descriptor Expert Syst. Appl. 2013 40 1 105-121

[6]

Penatti OAB, Valle E, and Torres RS Comparative study of global color and texture descriptors for web image retrieval J. Vis. Commun. Image Represent. 2012 23 2 359-380

[7]

Vipparthi SK and Nagar SK Expert image retrieval system using directional local motif XoR patterns Expert Syst. Appl. 2014 41 17 8016-8026

[8]

Varish N, Pradhan J, and Pal AK Image retrieval based on non-uniform bins of color histogram and dual tree complex wavelet transform Multimed. Tools Appl. 2017 76 14 15885-15921

[9]

Chun YD, Kim NC, and Jang IH Content-based image retrieval using multiresolution color and texture features IEEE Trans. Multimed. 2008 10 6 1073-1084

[10]

Lu Z-M and Burkhardt H Colour image retrieval based on DCT-domain vector quantisation index histograms Electron. Lett. 2005 41 1 956-957

[11]

Lu T-C and Chang C-C Color image retrieval technique based on color features and image bitmap Inf. Process. Manag. 2007 43 2 461-472

[12]

Yue J, Li Z, Liu L, and Fu Z Content-based image retrieval using color and texture fused features Math. Comput. Model. 2011 54 3 1121-1127

[13]

Kokare M, Biswas PK, and Chatterji BN Texture image retrieval using rotated wavelet filters Pattern Recognit. Lett. 2007 28 10 1240-1249

[14]

Selesnick IW, Baraniuk RG, and Kingsbury NC The dual-tree complex wavelet transform IEEE Signal Process. Mag. 2005 22 6 123-151

[15]

Krommweh J Tetrolet transform: a new adaptive haar wavelet algorithm for sparse image representation J. Vis. Commun. Image Represent. 2010 21 4 364-374

[16]

Han J and Ma K-K Rotation-invariant and scale-invariant gabor features for texture image retrieval Image Vis. Comput. 2007 25 9 1474-1481

[17]

He Z, You X, and Yuan YTexture image retrieval based on non-tensor product wavelet filter banksSignal Process.20098981501-15101178.94040

[18]

Wang X-Y, Zhang B-B, and Yang H-Y Content-based image retrieval by integrating color and texture features Multimed. Tools Appl. 2014 68 3 545-569

[19]

Li C, Huang Y, and Zhu L Color texture image retrieval based on Gaussian copula models of Gabor wavelets Pattern Recognit. 2017 64 118-129

[20]

Sadeghi B, Jamshidi K, Vafaei A, and Monadjemi SA A local image descriptor based on radial and angular gradient intensity histogram for blurred image matching Vis. Comput. 2019 35 10 1373-1391

[21]

Jai AK and Vailay A Shape-based retrieval: a case study with trademark image databases Pattern Recognit. 1998 31 9 1369-1390

[22]

Pradhan, J., Pal, A.K., Banka, H.: A prominent object region detection based approach for CBIR application. In: 2016 Fourth International Conference on Parallel, Distributed and Grid Computing (PDGC), pp. 447–452. IEEE (2016)

[23]

Won CS, Park DK, and Park S-JEfficient use of MPEG-7 edge histogram descriptorETRI J.200224123-301430168

[24]

Pradhan J, Pal AK, and Banka H Principal texture direction based block level image reordering and use of color edge features for application of object based image retrieval Multimed. Tools Appl. 2019 78 2 1685-1717

[25]

Chen L, Wang R, Yang J, Xue L, and Hu M Multi-label image classification with recurrently learning semantic dependencies Vis. Comput. 2019 35 10 1361-1371

[26]

Liu Y, Zhang D, Lu G, and Ma W-YA survey of content-based image retrieval with high-level semanticsPattern Recognit.2007401262-2821103.68503

[27]

An, F., Liu, Z.: Facial expression recognition algorithm based on parameter adaptive initialization of CNN and LSTM. Vis. Comput. 1–16 (2019). 10.1007/s00371-019-01635-4

[28]

Mohammed MM, Badr A, and Abdelhalim MB Image classification and retrieval using optimized pulse-coupled neural network Expert Syst. Appl. 2015 42 11 4927-4936

[29]

Thuy QDT, Huu QN, Van CP, and Quoc TN An efficient semantic-related image retrieval method Expert Syst. Appl. 2017 72 30-41

[30]

Khatami A, Babaie M, Tizhoosh HR, Khosravi A, Nguyen T, and Nahavandi S A sequential search-space shrinking using cnn transfer learning and a radon projection pool for medical image retrieval Expert Syst. Appl. 2018 100 224-233

[31]

Cheng S, Lai H, Wang L, and Qin J A novel deep hashing method for fast image retrieval Vis. Comput. 2019 35 9 1255-1266

[32]

Ojala T, Pietikäinen M, and Harwood D A comparative study of texture measures with classification based on featured distributions Pattern Recognit. 1996 29 1 51-59

[33]

Takala V, Ahonen T, and Pietikäinen M Block-Based Methods for Image Retrieval Using Local Binary Patterns 2005 Berlin Springer 882-891

[34]

Heikkilä M, Pietikäinen M, and Schmid CDescription of interest regions with local binary patternsPattern Recognit.2009423425-4361181.68237

[35]

Subrahmanyam M, Maheshwari RP, and Balasubramanian R Expert system design using wavelet and color vocabulary trees for image retrieval Expert Syst. Appl. 2012 39 5 5104-5114

[36]

Vipparthi SK and Nagar SK Multi-joint histogram based modelling for image indexing and retrieval Comput. Electr. Eng. 2014 40 8 163-173

[37]

Bhunia, A.K., Bhattacharyya, A., Banerjee, P., Roy, P.P., Murala, S.: A novel feature descriptor for image retrieval by combining modified color histogram and diagonally symmetric co-occurrence texture pattern. arXiv preprint arXiv:1801.00879 (2018)

[38]

Feng Q, Hao Q, Chen Y, Yi Y, Wei Y, and Dai J Hybrid histogram descriptor: a fusion feature representation for image retrieval Sensors 2018 18 6 1943

[39]

Obulesu A, Vijay Kumar V, and Sumalatha L Content based image retrieval using multi motif co-occurrence matrix Int. J. Image Graph. Signal Process. 2018 10 4 59

[40]

Jhanwar N, Chaudhuri S, Seetharaman G, and Zavidovique B Content based image retrieval using motif cooccurrence matrix Image Vis. Comput. 2004 22 14 1211-1220

[41]

Li J and Wang JZ Real-time computerized annotation of pictures IEEE Trans. Pattern Anal. Mach. Intell. 2008 30 6 985-1002

[42]

Liu G-H, Yang J-Y, and Li ZY Content-based image retrieval using computational visual attention model Pattern Recognit. 2015 48 8 2554-2566

[43]

tropical-fruits-db-1024x768.tar.gz. http://www.ic.unicamp.br/~rocha/pub/downloads/tropical-fruits-DB-1024x768.tar.gz/. Accessed 18 Aug 2017

[44]

site www, vision & image, lagis-vi.univ-lille1.fr (2017). http://lagis-vi.univlille1.fr/datasets/outex.html. Accessed 18 Aug 2017

[45]

Everingham M, Van LG, Williams CKI, Winn J, and Zisserman A The pascal visual object classes (VOC) challenge Int. J. Comput. Vis. 2010 88 2 303-338

[46]

Yao C-H and Chen S-Y Retrieval of translated, rotated and scaled color textures Pattern Recognit. 2003 36 4 913-929

[47]

Liu G-H, Zhang L, Hou Y-K, Li Z-Y, and Yang J-YImage retrieval based on multi-texton histogramPattern Recognit.20104372380-23891209.68206

[48]

Liu G-H, Li Z-Y, Zhang L, and Xu Y Image retrieval based on micro-structure descriptor Pattern Recognit. 2011 44 9 2123-2133

[49]

Liu G-H and Yang J-Y Content-based image retrieval using color difference histogram Pattern Recognit. 2013 46 1 188-198

[50]

Zeng S, Huang R, Wang H, and Kang Z Image retrieval using spatiograms of colors quantized by gaussian mixture models Neurocomputing 2016 171 Supplement C 673-684

[51]

Galshetwar GM, Waghmare LM, Gonde AB, and Murala S Local energy oriented pattern for image indexing and retrieval J. Vis. Commun. Image Represent. 2019 64 102615

[52]

Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR arXiv:1409.1556 (2014)

Cited By

Salih FAbdulla A(2023)Two-layer content-based image retrieval technique for improving effectivenessMultimedia Tools and Applications10.1007/s11042-023-14678-682:20(31423-31444)Online publication date: 4-Mar-2023
https://dl.acm.org/doi/10.1007/s11042-023-14678-6
Saranya MGeetha P(2022)A deep learning-based feature extraction of cloth data using modified grab cut segmentationThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-022-02584-139:9(4195-4211)Online publication date: 15-Jul-2022
https://dl.acm.org/doi/10.1007/s00371-022-02584-1

Index Terms

Multi-level colored directional motif histograms for content-based image retrieval
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
  2. Computer graphics
    1. Image manipulation
2. Information systems
  1. Information retrieval
    1. Retrieval models and ranking
  2. Information systems applications
    1. Multimedia information systems
      1. Multimedia databases

Index terms have been assigned to the content through auto-classification.

Recommendations

Expert image retrieval system using directional local motif XoR patterns

This paper presents a new image feature descriptor, namely directional local motif XoR patterns (DLMXoRPs) for image retrieval application. The proposed motif representation is entirely different from existing motif. The DLMXoRP presents a novel ...
Principal texture direction based block level image reordering and use of color edge features for application of object based image retrieval

In this paper, the authors have presented a novel content-based image retrieval (CBIR) scheme based on the combination of color, shape, and texture visual image features. Initially, the combined features of color and shape are derived from the object ...
Content-Based Image Retrieval for Blood Cells
AMS '09: Proceedings of the 2009 Third Asia International Conference on Modelling & Simulation

The rapid development of technologies and steadily growing amounts of digital information highlight the need of developing an accessing system. Content-based image indexing and retrieval has been an important research area in computer science for the ...

Comments

Information & Contributors

Information

Published In

cover image The Visual Computer: International Journal of Computer Graphics

The Visual Computer: International Journal of Computer Graphics Volume 36, Issue 9

Sep 2020

199 pages

ISSN:0178-2789

Issue’s Table of Contents

© Springer-Verlag GmbH Germany, part of Springer Nature 2019.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 September 2020

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Salih FAbdulla A(2023)Two-layer content-based image retrieval technique for improving effectivenessMultimedia Tools and Applications10.1007/s11042-023-14678-682:20(31423-31444)Online publication date: 4-Mar-2023
https://dl.acm.org/doi/10.1007/s11042-023-14678-6
Saranya MGeetha P(2022)A deep learning-based feature extraction of cloth data using modified grab cut segmentationThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-022-02584-139:9(4195-4211)Online publication date: 15-Jul-2022
https://dl.acm.org/doi/10.1007/s00371-022-02584-1

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents