research-article

Demosaicking by alternating projections: theory and fast one-step implementation

Authors:

Martin VetterliAuthors Info & Claims

IEEE Transactions on Image Processing, Volume 19, Issue 8

Pages 2085 - 2098

https://doi.org/10.1109/TIP.2010.2045710

Published: 01 August 2010 Publication History

Abstract

Color image demosaicking is a key process in the digital imaging pipeline. In this paper, we study a well-known and influential demosaicking algorithm based upon alternating projections (AP), proposed by Gunturk, Altunbasak and Mersereau in 2002. Since its publication, the AP algorithm has been widely cited and compared against in a series of more recent papers in the demosaicking literature. Despite good performances, a limitation of the AP algorithm is its high computational complexity. We provide three main contributions in this paper. First, we present a rigorous analysis of the convergence property of the AP demosaicking algorithm, showing that it is a contraction mapping, with a unique fixed point. Second, we show that this fixed point is in fact the solution to a constrained quadratic minimization problem, thus, establishing the optimality of the AP algorithm. Finally, using the tool of polyphase representation, we show how to obtain the results of the AP algorithm in a single step, implemented as linear filtering in the polyphase domain. Replacing the original iterative procedure by the proposed one-step solution leads to substantial computational savings, by about an order of magnitude in our experiments.

References

[1]

R. Ramanath, W. E. Snyder, G. L. Bilbro, and W. A. Sander, III, "Demosaicking methods for Bayer color arrays," J. Electron. Imag., vol. 11, no. 3, pp. 306-315, Jul. 2002.

[2]

B. K. Gunturk, J. Glotzbach, Y. Altunbasak, R. W. Schafer, and R. M. Mersereau, "Demosaicking: Color filter array interpolation," IEEE Signal Process. Mag., vol. 22, no. 1, pp. 44-54, Jan. 2005.

[3]

X. Li, B. Gunturk, and L. Zhang, W. A. Pearlman, J. W. Woods. and L. Lu, Eds., "Image demosaicing: A systematic survey," in Proc. SPIE Conf. on Vis. Commun. and Image Proc., San Jose, CA, Jan. 2008, vol. 6822.

[4]

D. Alleysson and B. C. de Lavarène, W. A. Pearlman, J. W. Woods, and L. Lu, Eds., "Frequency selection demosaicking: A review and a look ahead," in Proc. SPIE Conf. on Vis. Commun. and Image Proc., San Jose, CA, Jan. 2008, vol. 6822.

[5]

B. K. Gunturk, Y. Altunbasak, and R. M. Mersereau, "Color plane interpolation using alternating projections," IEEE Trans. Image Process., vol. 11, no. 9, pp. 997-1013, Sep. 2002.

Digital Library

[6]

R. Lukac, K. Martin, and K. N. Plataniotis, "Demosaicked image post-processing using local color ratios," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 6, pp. 914-920, Jun. 2004.

Digital Library

[7]

X. Wu and N. Zhang, "Primary-consistent soft-decision color demosaicking for digital cameras," IEEE Trans. Image Process., vol. 13, no. 9, pp. 1263-1274, Sep. 2004.

Digital Library

[8]

K. Hirakawa and T. W. Parks, "Adaptive homogeneity-directed demosaicing algorithm," IEEE Trans. Image Process., vol. 14, no. 3, pp. 360-369, Mar. 2005.

Digital Library

[9]

X. Li, "Demosaicing by successive approximation," IEEE Trans. Image Process., vol. 14, no. 3, pp. 370-379, Mar. 2005.

Digital Library

[10]

D. Alleysson, S. Siisstrunk, and J. Héraut, "Linear demosaicing inspired by the human visual system," IEEE Trans. Image Process., vol. 14, no. 4, pp. 439-449, Apr. 2005.

Digital Library

[11]

L. Zhang and X. Wu, "Color demosaicking via directional minimum mean squaJe-error estimation," IEEE Trans. Image Process., vol. 14, no. 12, pp. 2167-2178, Dec. 2005.

Digital Library

[12]

D. Paliy, V. Katkovnik, R. Bileu, S. Alenius, and K. Egiazarian, "Spatially adaptlve color filter array interpolation for noiseless and noisy data," Int. J. Imag. Syst. and Technol., vol. 17, no. 3, pp. 105-122, Oct. 2007.

Digital Library

[13]

N.-X. Lian, L. Chang, Y.-P. Tan, and V. Zagorodnov, "Adaptive filtering for color filter array demosaicking," IEEE Trans. Image Process., vol. 16, no. 10, pp. 2515-2525, Oct. 2007.

Digital Library

[14]

D. G. Luenberger, Optimization by Vector Space Methods. Hoboken, NJ: Wiley, 1969

[15]

D. Menon and G. Calvagno, "Regularization approaches to demosaicking," IEEE Trans. Image Process., vol. 18, no. 10, pp. 2209-2220, Oct. 2009.

Digital Library

[16]

L. Condat, "A generic variational approach for demosaicking from an arbitrary color filter array," in Proc. IEEE Int. Conf. on Image Proc., Cairo, Egypt, Nov. 2009.

Digital Library

[17]

P. P. Vaidyanathan. Multirate Systems and Filter Banks. Upper Saddle River, NJ: Prentice-Hall, 1993.

[18]

M. Vetterli and J. Kovacevic. Wavelets and Subband Coding. Upper Saddle River, NJ: Prentice Hall. 1995.

[19]

B. E. Bayer, "Color Imaging Array," U.S. 3 971 065, Jul. 1976.

[20]

J. F. Hamilton and J. E. Adams, "Adaptive Color Plane Interpolation in Single Sensor Color Electronic Camera," U.S. 5 629 734, May 1997.

[21]

J. E. Adams, "Design of practical color filter array interpolation algorithms for digital cameras, part 2," in Proc. IEEE Int. Conf. on Image Proc., Chicago, IL, Oct. 1998.

[22]

W. Cheney and A. A. Goldstein, "Proximity maps for convex sets," Proc. Amer. Math. Soc., vol. 10, no. 3, pp. 448-450, Jun. 1959.

[23]

A. W. Naylor and G. R. Sell, Linear Operator Theory in Engineering and Science. New York: Springer-Verlag, 1982.

[24]

D. H. Brandwood, "A complex gradient operator and its applications in adaptive array theory," lEE Proc. F, Commun., Radar, Signal Process., vol. 130, no. 1, pp. 11-16, Feb. 1983.

[25]

W.-S. Lu and A. Antoniou, Two-Dimensional Digital Filters. Boca Raton, FL: CRC, 1992.

[26]

H. J. Trussel and R. E. Hartwig, "Mathematics for demosaicking," IEEE Trans. Image Process., vol. 11, no. 4, pp. 485-492, Apr. 2002.

[27]

B. C. de Lavarène, D. Alleysson, and J. Héraut, "Practical implementation of LMMSE demosaicing using luminance and chrominance spaces;' Comput. Vis. Image Understand., vol. 107, no. 1-2, pp. 3-13, 2007.

Digital Library

[28]

R. A. Hom and C. R. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge University Press, 1985.

Cited By

Safna Asiq MEmmanuel W(2022)Efficient colour filter array demosaicking with prior error reductionJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2019.06.01334:4(1191-1199)Online publication date: 1-Apr-2022
https://dl.acm.org/doi/10.1016/j.jksuci.2019.06.013
Schwartz EGiryes RBronstein A(2019)DeepISP: Toward Learning an End-to-End Image Processing PipelineIEEE Transactions on Image Processing10.1109/TIP.2018.287285828:2(912-923)Online publication date: 1-Feb-2019
https://dl.acm.org/doi/10.1109/TIP.2018.2872858
Manikandan VMasilamani VBatra DBrown MNatarajan V(2016)A context dependent fragile watermarking scheme for tamper detection from demosaicked color imagesProceedings of the Tenth Indian Conference on Computer Vision, Graphics and Image Processing10.1145/3009977.3009987(1-8)Online publication date: 18-Dec-2016
https://dl.acm.org/doi/10.1145/3009977.3009987
Show More Cited By

Recommendations

Effective color-difference-based interpolation algorithm for CFA image demosaicking
MMM'11: Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part I

This paper proposes an effective color-difference-based (ECDB) interpolation algorithm for CFA Image demosaicking. A CFA image consists of a set of spectrally selective filters which are arranged in an interleaved pattern such that only one of color ...
Novel color demosaicking for noisy color filter array data

Single sensor digital color still/video cameras use color demosaicking to reproduce full color images from color filter array (CFA) data. The quality of interpolated image will be degraded due to the sensor noise introduced during the image capture ...
Joint demosaicking and denoising with space-varying filters
ICIP'09: Proceedings of the 16th IEEE international conference on Image processing

In a digital camera usually images are captured using a Color Filter Array (CFA), requiring a demosaicking process to reconstruct the full resolution color image. Often also a denoising step is necessary to remove the noise introduced by the sensor. In ...

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Image Processing

IEEE Transactions on Image Processing Volume 19, Issue 8

August 2010

279 pages

ISSN:1057-7149

Issue’s Table of Contents

Copyright © 2010.

Publisher

IEEE Press

Publication History

Published: 01 August 2010

Revised: 06 February 2010

Received: 26 June 2009

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Safna Asiq MEmmanuel W(2022)Efficient colour filter array demosaicking with prior error reductionJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2019.06.01334:4(1191-1199)Online publication date: 1-Apr-2022
https://dl.acm.org/doi/10.1016/j.jksuci.2019.06.013
Schwartz EGiryes RBronstein A(2019)DeepISP: Toward Learning an End-to-End Image Processing PipelineIEEE Transactions on Image Processing10.1109/TIP.2018.287285828:2(912-923)Online publication date: 1-Feb-2019
https://dl.acm.org/doi/10.1109/TIP.2018.2872858
Manikandan VMasilamani VBatra DBrown MNatarajan V(2016)A context dependent fragile watermarking scheme for tamper detection from demosaicked color imagesProceedings of the Tenth Indian Conference on Computer Vision, Graphics and Image Processing10.1145/3009977.3009987(1-8)Online publication date: 18-Dec-2016
https://dl.acm.org/doi/10.1145/3009977.3009987
Gharbi MChaurasia GParis SDurand F(2016)Deep joint demosaicking and denoisingACM Transactions on Graphics10.1145/2980179.298239935:6(1-12)Online publication date: 5-Dec-2016
https://dl.acm.org/doi/10.1145/2980179.2982399
Hu YLo CChen W(2016)Probability-based reversible image authentication scheme for image demosaickingFuture Generation Computer Systems10.1016/j.future.2016.04.00162:C(92-103)Online publication date: 1-Sep-2016
https://dl.acm.org/doi/10.1016/j.future.2016.04.001
Chenyan Bai Jia Li Zhouchen Lin Jian Yu Yen-Wei Chen (2015)Penrose DemosaickingIEEE Transactions on Image Processing10.1109/TIP.2015.240956924:5(1672-1684)Online publication date: 23-Mar-2015
https://dl.acm.org/doi/10.1109/TIP.2015.2409569
Luo XZhang JDai Q(2015)Hybrid fusion and interpolation algorithm with near-infrared imageFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-014-4230-39:3(375-382)Online publication date: 1-Jun-2015
https://dl.acm.org/doi/10.1007/s11704-014-4230-3
Censor YChen WCombettes PDavidi RHerman G(2012)On the effectiveness of projection methods for convex feasibility problems with linear inequality constraintsComputational Optimization and Applications10.1007/s10589-011-9401-751:3(1065-1088)Online publication date: 1-Apr-2012
https://dl.acm.org/doi/10.1007/s10589-011-9401-7

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents