Wavelet Transform Techniques For Image Resolution Enhancement
Wavelet Transform Techniques For Image Resolution Enhancement
Wavelet Transform Techniques For Image Resolution Enhancement
Index Terms Image Interpolation, Peak signal-to-noise Fig 1. Block diagram of DWT Filter Banks of level 1
ratio (PSNR), Wavelet Zero Padding (WZP), Cycle Spanning [8]
(CS), Dual-Tree Complex Wavelet Transform (DT-CWT),
Discrete Wavelet Transform (DWT), Stationary Wavelet
Transform (SWT).
II. REGULARITY-PRESERVING IMAGE
INTERPOLATION
I. INTRODUCTION Traditional interpolation methods work in the time domain.
As stated in [2], the regularity-preserving interpolation
Resolution has been frequently referred as an important technique synthesizes a new wavelet subband based on the
property of an image. Images are being processed in order to known wavelet transform coefficients decay. The lowpass
obtain super enhanced resolution. One of the commonly output of a wavelet analysis stage can be considered as the
used techniques for image resolution enhancement is image to be interpolated. The original image can given as
Interpolation. Interpolation has been widely used in many input to a single wavelet synthesis stage along with the
image processing applications. Interpolation in image corresponding high frequency subbands to produce an
processing is a method to increase the number of pixels in a image interpolated by a factor of two in both directions. The
digital image. Traditionally there are three techniques for creation of unknown high-frequency subbands is necessary
image interpolation namely Linear, Nearest Neighbor and in the regularity-preserving interpolation strategy. Two-step
Bicubic. Nearest Neighbor result in significant Jaggy process is carried out to obtain the unknown high-frequency
edge distortion [1]. The Bilinear Interpolation result in subbands separably. In First step, in each row edges with
smoother edges but somewhat blurred appearance overall significant correlation across scales are identified.
[1]. Bicubic Interpolation looks best with smooth edges and Then near these edges the rate of decay of the wavelet
much less blurring than the bilinear result [1]. coefficients is extrapolated to approximate the high-
By applying the 1-D discrete wavelet transform (DWT) frequency subband required to resynthesize a row of twice
along the rows of the image rst, and then along the columns the original size. In second step, the same procedure as in
to produce 2-D decomposition of image[8]. DWT produce first step is then applied to each column of the row-
four subbands low-low(LL), low- high(LH), interpolated image. Block diagram of interpolation system
high-low(HL)and high-high(HH).By using these four for 1-D row and column signals is shown in Fig. 2.
subands we can regenerate original image[8]. Theoretically,
a lter bank shown in Fig. 1 should work on the image in
order to generate different subband frequency images.
68 www.erpublication.org
Wavelet Transform Techniques for Image Resolution Enhancement
Fig 2. Block diagram of interpolation system for 1-D row and column resolution images are generated by spatial shifting, wavelet
signals[2]. transforming, and discarding the high frequency subbands.
A hybrid approach produced by combining bilinear iii)The final high resolution image is reconstructed by re-
interpolation and covariance-based adaptive interpolation is aligning and averaging these intermediated high resolution
used in [3] to reduce the overall computational complexity. images. Fig. 3 shows the block diagram of the WZP- and
Traditional linear interpolation schemes (e.g., bilinear and
CS-based image super resolution[4].
bicubic) based on space-invariant models are not able to
capture the fast evolving statistics around edges and
consequently produce interpolated images with blurred edges
and annoying artifacts. Linear interpolation is good due to its
computational simplicity but not good due to its the
performance issue. Geometric regularity is very much
important for the visual quality of a natural image such as the
sharpness of edges and the freedom from artifacts. Without
the loss of generality, Xin Li & Michael T. Orchard
assume that the low-resolution image X i , j of size H W
directly comes from of size of 2H 2W, i.e. Y2i ,2 j X
i, j .
Fig3. Block Diagram of the WZP-and-CS-based image Resolution
They use the following basic problem to introduce their new
Enhancement [4].
interpolation technique: How do they interpolate the
interlacing lattice Y2i 1,2 j 1 from the lattice
Y2i ,2 j X i , j .They constrain their selves to the fourth- V. DT-CWT BASED IMAGE RESOLUTION
order linear interpolation. ENHANCEMENT
In this technique, as stated in [5],[8] dual-tree CWT
(DT-CWT) is used to decompose an input image into
different subband images. DT- CWT is used to decompose
The above equation is core part of this algorithm
an input low-resolution image into different subbands.
invented in [3]. In order to manage the computational
Then, the high-frequency subband images and the input
complexity, they used the following hybrid approach:
image are interpolated, followed by combining all these
covariance-based adaptive interpolation is only applied to
images to generate a new high-resolution image by using
edge pixels (pixels near an edge); for nonedge pixels
inverse DT-CWT. The resolution enhancement is achieved
(pixels in smooth regions), they still use simple bilinear
by using directional selectivity provided by the CWT,
interpolation. Such a hybrid approach is based on the
where the high-frequency subbands in six different
observation that only edge pixels benefit from the
directions contribute to the sharpness of the high-frequency
covariance-based adaptation and edge pixels often consist of
details, such as edges. Fig. 4 shows details of this
a small fraction of the whole image. A pixel is
technique, where the enlargement factor through the
considered as an edge pixel if an activity measure (e.g., the
resolution enhancement is .
local variance estimated from the nearest four neighbors) is
above a preselected threshold value . Since the computation
of the activity measure is typically negligible when
compared to that of covariance estimation, dramatic
reduction of complexity can be achieved for images
containing a small fraction of edge pixels. Xin Li &
Michael T. Orchard in [3] have found that the percentage of
edge pixels ranges from 5% to 15% for the test images used
in their experiments, which implies a speed-up factor of 7
20 [3].
IV. WZP-CS BASED IMAGE RESOLUTION Fig4. Block Diagram of DT-CWT Based Image Resolution
Enhancement [5]
ENHANCEMENT
As stated in[4],[8] this algorithm consists of two main steps The dual-tree complex wavelet transform (CWT) is
as follows: Step 1) an initial approximation to the unknown a relatively recent enhancement to the discrete wavelet
high resolution image is generated using wavelet domain zero transform (DWT), with important additional properties: It is
padding (WZP).Step 2) The cycle-spinning methodology is nearly shift invariant and directionally selective in two and
adopted to operate the following tasks: higher dimensions. It achieves this with a redundancy factor
i) Using high resolution image in part (1) a number of low of only 2d for d-dimensional
69 www.erpublication.org
International Journal of Engineering and Technical Research (IJETR)
ISSN: 2321-0869, Volume-1, Issue-8, October 2013
signals, which is substantially lower than the undecimated directional resolution when compared with that of the
DWT. The multidimensional (M-D) dual-tree CWT is decimated DWT. Such features make it suitable for image
nonseparable but is based on a computationally efficient, resolution enhancement. In this letter, a complex
separable filter bank (FB).A method for image resolution wavelet-domain image resolution enhancement algorithm
enhancement from a single LR image using the dual-tree based on the estimation of wavelet coefficients at HR scales is
complex wavelet. The rough estimate of the HR image is proposed. The initial estimate of the HR image is constructed
decomposed to estimate the complex-valued high-pass by applying a cycle-spinning methodology in the DT-CWT
wavelet coefficients for the input LR image. The estimated domain. It is then decomposed using the one-level DT-CWT
complex wavelet coefficients are used, together with the input to create a set of high-pass coefficients at the same spatial
LR image, to reconstruct the resultant HR image by resolution of the LR image. The high-pass coefficients,
employing IDT-CWT.Image resolution enhancement is a together with the LR image, are used to reconstruct the HR
usable preprocess for many satellite image processing image using inverse DT-CWT (IDT-CWT).
applications. The DT-CWT is a combination of two real-valued
Image resolution enhancement is a usable preprocess decimated DWTs. The ordinary decimated DWT is shift
for many satellite image processing applications, such as variant due to the decimation operation exploited in the
vehicle recognition, bridge recognition, and building transform. As a result, a small shift in the input signal can
recognition to name a few. Image resolution enhancement result in a very different set of wavelet coefficients. For that,
techniques can be categorized into two major classes Kingsbury introduced a new kind of wavelet transform, called
according to the domain that they are applied in: 1) image the DT-CWT which exhibits shift-invariant property and
domain and 2) transform domain. The techniques in the image improves directional resolution when compared with that of
domain use the statistical and geometric data directly the decimated DWT.
extracted from the input image itself while transform-domain The DT-CWT also yields perfect reconstruction by using two
techniques use transformations such as decimated discrete parallel decimated trees with real-valued coefficients
wavelet transform (DWT) to achieve the image resolution generated at each tree. The 1-D DT-CWT decomposes the
enhancement. The decimated DWT has been widely used for input signal f(x) by expressing it in terms of a complex shifted
performing image resolution enhancement. A common and dilated mother wavelet (x) and a scaling function (x),
assumption of DWT-based image resolution enhancement is i.e.,
that the low-resolution (LR) image is the low-pass-filtered
subband of the wavelet-transformed high-resolution (HR)
image. This type of approach requires the estimation of
wavelet coefficients in sub bands containing high-pass spatial where Z is the set of natural numbers, j and l refer to the index
frequency information in order to estimate the HR image from of shifts and dilations, respectively, sj0,l is the scaling
the LR image. coefficient, and cj,l is the complex wavelet coefficient with
In order to estimate the high-pass spatial frequency j0,l(x) = rj 0,l(x) + 1i j0,l(x) and j,l(x) = r j,l(x)
information, many different approaches have been + 1i j,l(x), where the superscripts r and i denote the real
introduced.The high-pass coefficients with significant and imaginary parts, respectively. In the 1-D DT-CWT case,
magnitudes are estimated as the evolution of the wavelet the set {rj 0,l,i j0,l,rj 0,l,i j0,l
coefficients among the scales. The performance is mainly } forms a tight wavelet frame with double redundancy. The
affected from the fact that the signs of the estimated real and imaginary parts of the 1-D DT-CWT are computed
coefficients are copied directly from parent coefficients using separate filter banks with filters h0 and h1 for the real
without any attempt being made to estimate the actual signs. part and g0 and g1 for the imaginary part. Similar to the 1-D
This is contradictory to the fact that there is very little DT-CWT, the 2-D DT-CWT decomposes a 2-D image f(x, y)
correlation between the signs of the parent coefficients and through a series of dilations and translations of a complex
their descendants. As a result, the signs of the coefficients scaling function and six complex wavelet functions j,l,
estimated using extreme evolution techniques cannot be relied
upon. A hidden Markov tree (HMT)-based method models METHOD
the unknown wavelet coefficients as belonging to mixed Let us consider the unknown 2H 2W HR image
Gaussian distributions which are symmetrical about the zero XH and the known H W LR image XL. The aim of the
mean. HMT models are used to determine the most probable enhancement is to generate an estimated HR image XH of the
state for the coefficients to be estimated. The performance unknown HR image XH using the known LR image XL. Let
also suffers mainly from the sign changes between the scales. us further assume that the one-level DT-CWT decomposition
The decimated DWT is not shift invariant, and as a result, of a 2H 2W image X results in a matrix of DT-CWT(X) =
suppression of wavelet coefficients introduces artifacts into [LPX HPX], and the IDT-CWT of [LPX HPX] reconstructs
the image which manifest as ringing in the neighborhood of the signal X perfectly, i.e., IDT-CWT([LPX HPX]) = X. LPX
discontinuities. In order to combat this drawback in is a matrix of size H W which is the complex-valued
DWTbased image resolution enhancement, a cycle-spinning low-pass subband resulting
methodology was adopted. The perceptual and objective from the one-level DT-CWT decomposition of image X, and
quality of the resolution-enhanced images by their method HPX is a matrix of size H W 6 which is the collection of all
compares favorably with that in recent methods in the field. A six complex-valued high-pass subbands resulting from the
dual-tree complex wavelet transform (DT-CWT) is one-level DT-CWT decomposition of image X.
introduced to alleviate the drawbacks caused by the For a given LR image XL, the proposed resolution
decimated DWT . It is shift invariant and has improved enhancement method is made up of the following four main
70 www.erpublication.org
Wavelet Transform Techniques for Image Resolution Enhancement
steps: 1) Generate the initial estimate (Y) of the HR image; 2) method is the same for all subband and the input images.
decompose Y using one-level DT-CWT to create a low and The interpolation technique and the wavelet function are
high-pass matrix structure [LPY HPY]; 3) formulate a matrix two important factors in determining the quality of the
structure [XL HPY] using [LPY HPY] and the input LR super-resolved images. To measure quality of image PSNR
image XL; and 4) generate the HR image by employing the value is used.
IDT-CWT on [XL HPY]. The first step employs the
cycle-spinning algorithm in the DT-CWT domain to create an
initial estimate of the unknown HR image.
The second step is the estimation of the high-pass
coefficients for the input LR signal XL. The initial estimate Y
is decomposed using the one-level DT-CWT to create one
complex valued low-pass sub band and six complex-valued
high-passsubbands with the same spatial resolution as that of
XL, i.e.,
DT-CWT(Y) = [LPY HPY].
In the final step, the input LR image, together with
the complex-valued high-pass sub bands HPY extracted from
the one-level DT-CWT decomposition of Y, is used to create
the HR image by employing IDT-CWT, i.e.,
71 www.erpublication.org
International Journal of Engineering and Technical Research (IJETR)
ISSN: 2321-0869, Volume-1, Issue-8, October 2013
APPLICATIONS
MSE=Iavg(i,j)-I(I,j)/(M*N) The image resolution enhancement techniques
72 www.erpublication.org
Wavelet Transform Techniques for Image Resolution Enhancement
REFERENCES
[1] Digital Image Processing Using MATLAB (Second Edition) by
Rafel C. Gonzalez and Richard E. woods and Steven L. Eddins.
[2] W. Knox. Carey, Daniel. B. Chuang, and S. S. Hemami, Regularity
Preserving image interpolation, IEEE Trans. Image Process., vol. 8, no. 9,
pp. 12951297, Sep. 1999.
[3] Xin. Li and Michael. T. Orchard, New edge-directed interpolation,
IEEE Trans. Image Process., vol. 10, no. 10, pp. 15211527, Oct. 2001.
[4] Alptekin. Temizel and Theo. Vlachos, Wavelet domain image
resolution enhancement using cycle-spinning, Electron. Lett., vol. 41, no.
3, pp. 119121, Feb. 3, 2005.
[5] Hasan. Demirel and Gholamreza. Anbarjafari, Satellite image resolution
enhancement using complex wavelet transform, IEEE Geosci. Remote
Sens. Lett., vol. 7, no. 1, pp. 123126, Jan. 2010.
[6] Gholamreza. Anbarjafari and Hasan. Demirel, Image super
resolution based on interpolation of wavelet domain high frequency
subbands and the spatial domain input image, ETRI J., vol. 32, no. 3, pp.
390394, Jun. 2010.
[7] Hasan. Demirel and Gholamreza. Anbarjafari, IMAGE Resolution
Enhancement by Using Discrete and Stationary Wavelet Decomposition,
IEEE IMAGE PROCESSING, VOL. 20, NO. 5, MAY 2011..
[8] Hasan. Demirel and Gholamreza. Anbarjafari, Discrete Wavelet
Transform-Based Satellite Image Resolution Enhancement, IEEE
Geosciences and Remote Sensing Letter, VOL. 49, NO. 6, JUNE
2011.Brown, L. D., Hua, H., and Gao, C. 2003. A widget
[9] Dual Tree Complex wavelet Transforms- Ivan W. Selesnick, Richard
G. Baraniuk, and Nick G. Kingsbury
[10] Image Resolution Enhancement using Dual Tree Complex Wavelet
Transforms- Turgay Celik and Tardi Tjahjadi
73 www.erpublication.org