LQEBP
LQEBP
LQEBP
ABSTRACT
A new image retrieval technique has been proposed in this paper namely local quantized edge binary
patterns using HSV color space. To make use of color, intensity and brightness of image HSV color space
is used. Local quantized patterns are used to define the local information in all possible directions
i.e 0 , 45 , 90 and135 . Local edge binary patterns extract the maximum edge information from the
quantized patterns in all directions in an image. Performance is compared with local binary pattern(LBP),
Centre symmetric local binary pattern(CS_LBP) with color feature, local edge patterns for segmentation
(LEPSEG) with color feature and wavelet transform with color feature and another existing method by
conducting three experiments on standard databases Corel-10k, MIT-Vistex and Color Brodatz texture.
After results investigation, a significant improvement in terms of their evaluation measures as compared
with existing methods on respective databases.
Keywords: Content Based Image Retrieval, Local Binary Patterns, HSV Color Space, Local Quantized
Pattern, Edge Binary Patterns, Histograms, Feature Vector.
1. INTRODUCTION
Now a days it is observed that, the multimedia pixel intensity values. Ahmaddinet.al[6] used the
libraries expanded radically in the internet due to Wavelet transmission (WT) for texture
high quality cameras, scanners etc. Handling of classification. Moghahaddam et.al [7] introduces a
these massive digital libraries are extremely new algorithm called Wavelet correlogram (WC).
annoying rather impractical task. On the other hand, Kokare et.al [8,9] proposed rotated and complex
there exist two major difficulties, especially when rotated wavelet filters to be used for CBIR.
the size of image collections is vast. To defeat these Subramanyamet.al[10] proposed correlogram
difficulties, content based image retrieval (CBIR) algorithm for image retrieval using wavelet and
was proposed. In CBIR, the feature extraction is a rotated wavelet. The idea of color histogram was
important step and the success of a CBIR system proposed by Swain et.al[11] for image matching
depends typically on the method of feature and distance measure by histograms.
extraction from raw images. Hence, there is a great Strickeret.al[12] introduced two new methods for
need of some expert technique viz content based color indexing, in that first gives the complete color
image retrieval (CBIR). distribution and second holds only major features.
Compositions of color and texture features are used
1.1 Background: The CBIR utilizes the low level as a dominant descriptor for image retrieval.
features of an image such as color, shape, texture, Wavelet and Gabor wavelet transform [13]
spatial layouts and faces etc, in order to represent combined with color histogram for color and
and index the image. However, complete and texture based image retrieval. Further, Lin.et.al [14]
extensive literature survey in [1-4]. Among all these introduced color co-occurrence matrix (CCM),
local features texture classification is an active color histogram for K-mean and (CHKM) and
research topic in the fields of medical, object based difference between pixels of scan patterns
image coding, image retrieval and many more. (DBPSP). Instead of RGB, HSV color space is
Various algorithms have been proposed for texture used for color representation and this method is
analysis.Chellepaet.al[5] used the Gaussian Markov applied for image retrieval [15]. S.Jeonget.al[16]
Random fields (GMRF) to model texture pattern used Gaussian mixer vector quantization for better
based on statistical relationship between adjacent quantization of color histogram for image retrieval.
291
Journal of Theoretical and Applied Information Technology
31st January 2018. Vol.96. No 2
© 2005 – ongoing JATIT & LLS
In addition to the previous ones, the statistical local In section1 literature survey, which includes
image feature extraction proved to be very efficient motivation and main contribution of proposed
in recent years. Ojala et.al [17,18] introduced local work, section2 involves the introduction of color
binary pattern(LBP) to extract the local information space and various texture descriptors LBP and
of each pixel using eight neighbouring pixels. LBP LMEBP. In section3 proposed method, similarity
was modified for rotational invariant texture measurements and framework of proposed method.
classification [19]. LBP used for many signal and Section 4 gives experimental results and
image processing applications eg, Face discussions on two different databases. As a final
recognition[20], texture classification[21,22], object point, the conclusion is achieved in section5.
tracking[23]etc. Heikkilaet.al[24], proposed the
modified LBP as center symmetric local binary 2.LOCAL PATTERNS
pattern (CS_LBP) which computes the difference in
only four directions. Some other extensions in LBP 2.1 Color Space: In nature, there are 3 types of
were introduced for better feature extraction like images, Binary images, Grayscale images and
completed LBP[25], Dominant LBP [26], local Color images. Binary images contain only two
edge patterns for segmentation and rotation intensity levels for black and white pixels.
invariant image retrieval (LEPSEG& LEPINV) Grayscale images have a range of intensities in one
[27]. Tan.et.al[28] proposed another approach for specific band. The last color images have multiple
local feature extraction for face recognition was bands and each band includes a range of intensity.
local ternary pattern (LTP). That computes the In general color images use RGB color bands called
center pixel and its eight neighbouring pixels with a red, green and blue. Hence it is called RGB color
threshold interval, and assigns a ternary pattern. space. These three bands contain information about
Zhang et.al[29] proposed a higher order local red, green and blue of an image. The other color
binary pattern called local derivative pattern (LDP) space called HSV stands hue, saturation, and value.
for face recognition. Hussainet.al[30,31] proposed
the local quantized patterns for visual recognition. Hue is directly related to color and hue is defined as
It inherits the flexibility and robustness compare to an angle. Saturation represents the lightness and
the traditional local pattern features. It can handle brightness of color segment, and value shows the
significantly larger patterns than previous local intensity of color component. Hue gives an angle
patterns. Subramanyamet.al[32] introduced a new information from 00 to 3600, and each degree
approach based on edge distribution called local occupies different colours. The brightness of an
maximum edge binary pattern (LMEBP). In [33-36] image represented by saturation ranges from 0 to 1,
local tetra patterns (LTrP), directional binary as theintensity of color increases it goes from low
wavelet patterns (DBWP), local mesh patterns and to high. Value also ranges from 0 to 1. Many
local ternary co-occurrence patterns discussed for researches proved that individual RGB components
CBIR and biomedical image are not usually recommended and HSV color model
retrieval.Muralaet.al[37] proposed a new texture is more appropriate than RGB model. In the
feature descriptor called local extrema patterns, proposed method RGB image converted into HSV
where it collects the texture information in all color space.
possible directions of a pixel. Vermaet.al[38]
2.2. Local Binary Pattern (LBP)
proposed color texture feature descriptor called
local extrema co-occurrence pattern. The concept of LBP introduced by Ojala.et.al[17]
for feature classification from neighbourhood
The concepts of LQP and LMEBP have motivated
pixels. It succeeded in many research areas like
us to propose the local quantized edge binary
face recognition, image retrieval etc, due to its
patterns(LQEBP) for image retrieval application.
performance and speed. For a center pixel in 3x3
The main contributions of this algorithm are
pattern, LBP value is calculated by comparing its
summarized as follows. a)The LQEBP features are
gray scale value with its neighbours as
extracted for database images as well as for query
image in contrast of LBP. b) The combination of ∑ )
,
LQEBP and color features is proposed. c) The
performance of the method is experienced for
(1)
image retrieval on various color texture databases.
1 0
The organization of the paper is as follows. (2)
0 0
292
Journal of Theoretical and Applied Information Technology
31st January 2018. Vol.96. No 2
© 2005 – ongoing JATIT & LLS
Where P stands for no.of neighbours and R stands deeper quantization with domain-adaptive vector
radius of neighbourhood. quantization.
2.3. Local Quantized Pattern (LQP) It collects all possible geometric features
0 , 45 , 90 135 i.e horizontal(H),
LQP proposed by Hussainet.al[30] for visual vertical(V), diagonal(D) and anti-diagonal(A) strips
recognition. It is a generalized form of local of pixels. Figure2 illustrates geometric structure for
patterns that uses large local neighbourhoods and the LQP operator.
2.4. Local Maximum Edge Binary Patterns possible directions using quantized patterns. The
(LMEBP) first maximum edge is obtained by the magnitude
of local difference between the center pixel and its
Subrahmanyamet.al[32] proposed this method for a sixteen neighbors in 0 , 45 , 90 135
given image.The first maximum edge is obtained by for radius equal to 1 and 2 as shown in Figure 4.
the magnitude of local difference between the
center pixel and it’s all neighbors. After calculation
of differences all the values are arranged in
descending order using only magnitudes as shown ∀ 1,2, … … . 8; 1
in Figure 3. Similarly, the remaining seven patterns (3)
are calculated to attain first maximum edge. The
total eight maximum edges are evaluated using nine
binary values.
∀ 16; 2
(4)
3. PROPOSED FEATURE DESCRIPTOR sort the values in descending order
3.1. Local Quantized Edge Binary Pattern | 1 |, | 2 |, …
(LQEBP)
| 8 |, | 1 , 3 ,| 5 , …
The concepts of LBP,LQP and LMEBP motivate us
to propose local quantized edge binary patterns for
15 )) (5)
image retrieval system. The LQEBP extracts the
extreme edge information from an image in all
293
Journal of Theoretical and Applied Information Technology
31st January 2018. Vol.96. No 2
© 2005 – ongoing JATIT & LLS
5 ,…… 8 (8)
294
Journal of Theoretical and Applied Information Technology
31st January 2018. Vol.96. No 2
© 2005 – ongoing JATIT & LLS
295
Journal of Theoretical and Applied Information Technology
31st January 2018. Vol.96. No 2
© 2005 – ongoing JATIT & LLS
3.3 Similarity measure and Query matching: 3.4 Proposed system framework for image
Feature extraction has to be calculated for all retrieval.
images including the query image, and a feature
vector database has been constructed for the full Figure 5 illustrates the proposed image retrieval
database images. After completing the feature system framework is specified below:
extraction process, similarity has to be performed
for query image. In this paper three types of 1. Load the image and convert it into HSV
similarity distance measures are used as discussed color space.
below: 2. Construct the hue, saturation histograms
separately.
3. Collect the HVDA5 structure for a given
1 : , ∑ | | (10)
center pixel in the value space.
4. Compute the local differences in 0°, 45°,
: , 90°, and 135° directions.
∑ | |(11) 5. Calculate the 16-bit LQEBP pattern for
center pixel and its eight neighbours.
6. Construct the histogram for all LQEBP
: , ∑ | patterns.
| 7. Construct the feature vector by
concatenate all the histograms, i.e Hue,
Saturation and Value.
(12) 8. Compare the query image with images in
the database using Eq. (10).
Where q is the query image, b is the database image 9. Retrieve the images based on the best
matches.
296
Journal of Theoretical and Applied Information Technology
31st January 2018. Vol.96. No 2
© 2005 – ongoing JATIT & LLS
100
80
% Precision
60
40
20
0
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100
No.of Image Catgory
(a)
297
Journal of Theoretical and Applied Information Technology
31st January 2018. Vol.96. No 2
© 2005 – ongoing JATIT & LLS
60
40
20
0
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100
No.of Image Category
(b)
40
30
20
10
10 20 30 40 50 60 70 80 90 100
No.of images Retrieved
( c)
30
25
20
ARR
15
10
5
0
10 20 30 40 50 60 70 80 90 100
No.of images Retrieved
(d)
298
Journal of Theoretical and Applied Information Technology
31st January 2018. Vol.96. No 2
© 2005 – ongoing JATIT & LLS
0.3
0.25
F-Measure 0.2
0.15
0.1
0.05
0
10 20 30 40 50 60 70 80 90 100
No.of Top matches
(e)
Figure6: Corel-10k Database:(A) Precision And Image Category Number (B)Recall And Image Category (C) ARP And
Images Retrieved (D) ARR And Images Retrieved (E)F-Measure Vs Top Matched Images.
4.2 Database 2: MIT- Vistex database is used to 640x640 size. Each image is divided into 25 sub
evaluate our proposed method. Figure (7) shows an images of size 128x128 like MIT-Vistex database.
example where apiece image from each category of So, the total number of images in the database is
MIT-Vistex database [40].It comprises of 40 2800. It is comparatively bigger than MIT-Vistex
different colour texture images and each in size of database. Sample images from the database is
512x512. For image retrieval, these images are shown in Fig.(9).The results are show in Fig (10).
divided into 16 blocks where each block size is In Fig.10(a), the graph of precision with number of
128x128, therefore 640 (40x16) image database has images retrieved for a group of 25, and in Fig.10(b)
been created. From Fig.8(a)&8(b) the retrieval graph of recall with number of images retrieved
performance of the proposed method compared from the whole database is shown. The results
with the state- of- art approaches in terms of ARP, determined in graphs openly indicate that the
ARR and F-measure in Fig.8(c). Table 3 shows the proposed method is better than the existing local
results of proposed method and previous methods patterns.
on all colour and texture databases. It demonstrated
that the proposed method showed a significant
retrieval.
299
Journal of Theoretical and Applied Information Technology
31st January 2018. Vol.96. No 2
© 2005 – ongoing JATIT & LLS
ARP
70 40
60 20
50 0
10 20 30 40 50 60 70 80 90 100 10 20 30 40 50 60 70 80 90 100
No.of Images Retrieved No.of Images Retrieved
(a) (b)
0.2
0.15
F-Measure
0.1
0.05
0
10 20 30 40 50 60 70 80 90 100
No.of Top Matches
(c)
Figure 8: MIT-Vistex Database: (A) ARP And Images Retrieved (B) ARR And Images Retrieved (C)F-Measure Vs
Top Matched Images.
Table 3: Results Of Previous Methods And The Proposed Method For The Following Databases.
Corel-10K MIT-Vistex Color-Brodatz
ARP ARR ARP ARR ARP ARR
Wavelet+ 41.5 17.4 87 94 56 70.2
Colorhist
CS_LBP+ 45 19 91 95 58 72
Colorhist
LEPINV+ 45.5 19.4 91 94 59 74
Colorhist
LEPSEG+ 49 21.4 90 95 65 80
Colorhist
LECoP+
52 23.4 99 98 72 83.5
Color
PM 67 27 100 99 76 86
300
Journal of Theoretical and Applied Information Technology
31st January 2018. Vol.96. No 2
© 2005 – ongoing JATIT & LLS
80
Avg.Precision
70
60
50
40
30
20
25 30 35 40 45 50 55 60 65 70
No.of images Retrieved
(a)
Wavelet+Colorhist CS_LBP+ Colorhist LEPINV+ Colorhist
LEPSEG+ Colorhist LECoP+Color PM
90
Avg.Recall
80
70
60
50
25 30 35 40 45 50 55 60 65 70
No.of Images Retrieved
(b)
Figure 10: Avg. Precision And Avg. Recall Curves For Color Brodatz Texture Database.
301
Journal of Theoretical and Applied Information Technology
31st January 2018. Vol.96. No 2
© 2005 – ongoing JATIT & LLS
302
Journal of Theoretical and Applied Information Technology
31st January 2018. Vol.96. No 2
© 2005 – ongoing JATIT & LLS
303