Abstract
The demosaicing process converts single-CCD color representations of one color channel per pixel into full per-pixel RGB. We introduce a Bayesian technique for demosaicing Bayer color filter array patterns that is based on a statistically-obtained two color per-pixel image prior. By modeling all local color behavior as a linear combination of two fully specified RGB triples, we avoid color fringing artifacts while preserving sharp edges. Our grid-less, floating-point pixel location architecture can process both single images and multiple images from video within the same framework, with multiple images providing denser color samples and therefore better color reproduction with reduced aliasing. An initial clustering is performed to determine the underlying local two color model surrounding each pixel. Using a product of Gaussians statistical model, the underlying linear blending ratio of the two representative colors at each pixel is estimated, while simultaneously providing noise reduction. Finally, we show that by sampling the image model at a finer resolution than the source images during reconstruction, our continuous demosaicing technique can super-resolve in a single step.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Bayer, B.: Color imaging array. U.S. Patent No. 3,971,065 (1976)
Cok, D.: Signal processing method and apparatus for producing interpolated chrominance values in a sampled color image signal. U.S. Patent No. 5,373,322 (1987)
Freeman, W.: Median filter for reconstructing missing color samples. U.S. Patent No 4,724,395 (1988)
Ramanath, R., Snyder, W., Bilbro, G., Sander, W.: Demosaicking methods for bayer color arrays. J. of Electronic Imaging 11(3), 306–315 (2002)
Gupta, M., Chen, T.: Vector color filter array demosaicing. In: Procs. of SPIE, Sensors and Camera Systems for Scientific, Industrial, and Digital Photography Apps. II., vol. 4306, pp. 374–382 (2001)
Laroche, C., Prescott, M.: Apparatus and method for adaptively interpolating a full color image utilizing chrominance gradients. U.S. Patent No. 5,629,734 (1994)
Hamilton, J., Adams, J.: Adaptive color plane interpolation in single sensor color electronic camera. U.S. Patent No. 5,629,734 (1997)
Chang, E., Cheung, S., Pan, D.: Color filter array recovery using a threshold-based variable number of gradients. In: Procs. of SPIE/IS and T EI., vol. 3650 (1999)
Kimmel, R.: Demosaicing, image reconstruction from color CCD samples. IEEE Trans. on Image Processing 8, 1221–1228 (1999)
Malvar, H., He, L., Cutler, R.: High-quality linear interpolation for demosaicing of bayer-patterned color images. In: Procs. of ICASSP (2004)
Eastman Kodak Company: PhotoCD PCD0992, http://r0k.us/graphics/kodak/
Nayar, S.K., Narasimhan, S.G.: Assorted pixels: Multi-sampled imaging with structural models. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 636–652. Springer, Heidelberg (2002)
Hel-Or, Y.: The canonical correlations of color images and their use for demosaicing. Technical Report HPL-2003-164R1, Hewlett Packard Labs. Israel (2004)
Brainard, D.: Bayesian method for reconstructing color images from trichromatic samples. In: Soc. for Imaging Science Technology Conf., pp. 375–380 (1995)
Chuang, Y., Curless, B., Salesin, D., Szeliski, R.: A bayesian approach to digital matting. In: CVPR, vol. 2, pp. 264–271 (2001)
Zomet, A., Peleg, S.: Multi-sensor super-resolution. In: Procs. IEEE Workshop on Apps. of Computer Vision, pp. 27–31 (2002)
Freeman, W., Jones, T., Pasztor, E.: Example-based super-resolution. IEEE Computer Graphics and Applications 22(2), 56–65 (2002)
Fung, J., Mann, S.: Projective demosaicing using multiple overlapping images. In: Procs. of the Int’l Symp. on Intelligent Multimedia, Video, and Speech Processing, pp. 190–193 (2004)
Gotoh, T., Okutomi, M.: Direct super-resolution and registration using raw CFA images. In: CVPR, vol. 2, pp. 600–607 (2004)
Zhang, X., Wandell, B.: A spatial extension of CIELAB for digital color image reproduction. In: Procs. of Soc. For Information Display, pp. 731–734 (1996)
Zhang, X., Wandell, B.: Color image fidelity metrics evaluated using image distortion maps. Signal Processing 70(3), 201–214 (1998)
Fairchild, M., Johnson, G.: The iCAM framework for image appearance, image differences, and image quality. J. of Electronic Imaging 13, 126–138 (2004)
Pattanaik, S., Ferwerda, J., Fairchild, M., Greenberg, D.: A multiscale model of adaptation and spatial vision for realistic image display. In: ACM SIGGRAPH, pp. 287–298 (1998)
Daly, S.: The Visible Differences Predictor: An Algorithm for the Assessment of Image Fidelity. In: Digital Images and Computer Vision, pp. 179–206. MIT Press, Cambridge (1993)
Ramasubramanian, M., Pattanaik, S., Greenberg, D.: A perceptually based physical error metric for realistic image synthesis. In: ACM SIGGRAPH, pp. 73–82 (1999)
Walter, B., Pattanaik, S., Greenberg, D.: Using perceptual texture masking for efficient image synthesis. In: Procs. of Eurographics, pp. 393–400 (2002)
Lee, A., Mumford, D., Huang, J.: Occlusion models for natural images: A statistical study of a scale-invariant dead leaves model. IJCV 41, 35–59 (2001)
Lin, Z., Shum, H.: Fundamental limits of reconstruction-based superresolution algorithms under local translation. IEEE Trans. PAMI 26(1), 83–97 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bennett, E.P., Uyttendaele, M., Zitnick, C.L., Szeliski, R., Kang, S.B. (2006). Video and Image Bayesian Demosaicing with a Two Color Image Prior. In: Leonardis, A., Bischof, H., Pinz, A. (eds) Computer Vision – ECCV 2006. ECCV 2006. Lecture Notes in Computer Science, vol 3951. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11744023_40
Download citation
DOI: https://doi.org/10.1007/11744023_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33832-1
Online ISBN: 978-3-540-33833-8
eBook Packages: Computer ScienceComputer Science (R0)