Abstract
Image inpainting, which removes undesired objects in a static image and fills in the missing regions with plausible textures, has been developed in the research fields of image processing. On the other hand, Diminished Reality (DR), which visually removes real objects from video images by filling in the missing regions with background textures in real time, is one of the growing topics in Virtual/Mixed Reality, and considered as the opposite of Augmented Reality. In this paper, we introduce the state-of-the-art of image inpainting methods and how to apply the image inpainting to diminished reality.
Chapter PDF
Similar content being viewed by others
References
Siltanen, S.: Texture generation over the marker area. In: Proc. Int. Symp. on Mixed and Augmented Reality, pp. 253–254 (2006)
Korkalo, O., Aittala, M., Siltanen, S.: Light-weight marker hiding for augmented reality. In: Proc. Int. Symp. on Mixed and Augmented Reality, pp. 247–248 (2010)
Kawai, N., Yamasaki, M., Sato, T., Yokoya, N.: Diminished reality for AR marker hiding based on image inpainting with reflection of luminance changes. ITE Trans. on Media Technology and Applications 1(4), 343–353 (2013)
Kawai, N., Sato, T., Yokoya, N.: Diminished reality considering background structures. In: Proc. Int. Symp. on Mixed and Augmented Reality, pp. 259–260 (2013)
Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: Proc. SIGGRAPH, pp. 417–424 (2000)
Efros, A.A., Leung, T.K.: Texture synthesis by non-parametric sampling. In: Proc. Int. Conf. on Computer Vision, pp. 1033–1038 (1999)
Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. on Image Processing 13(9), 1200–1212 (2004)
Wexler, Y., Shechtman, E., Irani, M.: Space-time completion of video. IEEE Trans. on Pattern Analysis and Machine Intelligence 29(3), 463–476 (2007)
Kawai, N., Sato, T., Yokoya, N.: Image inpainting considering brightness change and spatial locality of textures and its evaluation. In: Proc. Pacific-Rim Symposium on Image and Video Technology, pp. 271–282 (2009)
Kawai, N., Yokoya, N.: Image inpainting considering symmetric patterns. In: Proc. Int. Conf. on Pattern Recognition, pp. 2744–2747 (2012)
Darabi, S., Shechtman, E., Barnes, C., Goldman, D.B., Sen, P.: Image melding: Combining inconsistent images using patch-based synthesis. ACM Trans. on Graphics 31(4), 82:1–82:10 (2012)
Pavić, D., Schönefeld, V., Kobbelt, L.: Interactive image completion with perspective correction. The Visual Computer 22(9), 671–681 (2006)
Huang, J.B., Kopf, J., Ahuja, N., Kang, S.B.: Transformation guided image completion. In: Proc. Int. Conf. on Computational Photography, pp. 1–9 (2013)
Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: PatchMatch: A randomized correspondence algorithm for structural image editing. ACM Trans. on Graphics 28(3), 1–11 (2009)
Barnes, C., Shechtman, E., Goldman, D.B., Finkelstein, A.: The Generalized PatchMatch Correspondence Algorithm. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part III. LNCS, vol. 6313, pp. 29–43. Springer, Heidelberg (2010)
Herling, J., Broll, W.: Advanced self-contained object removal for realizing real-time diminished reality in unconstrained environments. In: Proc. Int. Symp. on Mixed and Augmented Reality, pp. 207–212 (2010)
Herling, J., Broll, W.: Pixmix: A real-time approach to high-quality diminished reality. In: Proc. Int. Symp. on Mixed and Augmented Reality, pp. 141–150 (2012)
Simakov, D., Caspi, Y., Shechtman, E., Irani, M.: Summarizing visual data using bidirectional similarity. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Kato, H., Billinghurst, M.: Marker tracking and hmd calibration for a video-based augmented reality conferencing system. In: Proc. Int. Workshop on Augmented Reality, pp. 85–94 (1999)
Klein, G., Murray, D.: Parallel tracking and mapping for small AR workspaces. In: Proc. Int. Symp. on Mixed and Augmented Reality, pp. 225–234 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Kawai, N., Sato, T., Yokoya, N. (2014). From Image Inpainting to Diminished Reality. In: Shumaker, R., Lackey, S. (eds) Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments. VAMR 2014. Lecture Notes in Computer Science, vol 8525. Springer, Cham. https://doi.org/10.1007/978-3-319-07458-0_34
Download citation
DOI: https://doi.org/10.1007/978-3-319-07458-0_34
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07457-3
Online ISBN: 978-3-319-07458-0
eBook Packages: Computer ScienceComputer Science (R0)