Article

Generating Sub-Resolution Detail in Images and Volumes Using Constrained Texture Synthesis

Authors:

Klaus MuellerAuthors Info & Claims

VIS '04: Proceedings of the conference on Visualization '04

Pages 75 - 82

https://doi.org/10.1109/VISUAL.2004.35

Published: 10 October 2004 Publication History

Abstract

A common deficiency of discretized datasets is that detail beyond the resolution of the dataset has been irrecoverably lost. This lack of detail becomes immediately apparent once one attempts to zoom into the dataset and only recovers blur. Here, we describe a method that generates the missing detail from any available and plausible high-resolution data, using texture synthesis. Since the detail generation process is guided by the underlying image or volume data and is designed to fill in plausible detail in accordance with the coarse structure and properties of the zoomed-in neighborhood, we refer to our method as constrained texture synthesis. Regular zooms become "semantic zooms", where each level of detail stems from a data source attuned to that resolution. We demonstrate our approach by a medical application - the visualization of a human liver - but its principles readily apply to any scenario, as long as data at all resolutions are available. We will first present a 2D viewing application, called the "virtual microscope", and then extend our technique to 3D volumetric viewing.

References

[1]

{1} Ashikhmin, M. 2001. Synthesizing natural textures. ACM Symposium on Interactive 3D Graphics, 217-226.

Digital Library

[2]

{2} Ashikhmin, M. 2003. Fast texture transfer. IEEE Computer Graphics and Applications 23, 4, 38-43.

Digital Library

[3]

{3} Dischler, J. M., Maritaud, K., Ievy, B., and Ghazanfarpour, D. 2002. Texture particles. Computer Graphics Forum 21, 3, 401-410.

[4]

{4} Drori, I., Cohen-or, D., and Yeshurun, H. 2003. Fragment-based image completion. Proc. of SIGGRAPH 2003, 303-312.

Digital Library

[5]

{5} Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. Proc. of SIGGRAPH 2001, 341-346.

Digital Library

[6]

{6} Efros, A. A., and Leung, T. K. 1999. Texture synthesis by non-parametric sampling. Int. Conference on Computer Vision, 2, 1033-1038.

Digital Library

[7]

{7} Furnas, G. W., and Bederson, B. B. 1995. Space-scale diagrams: understanding multiscale interfaces. Proc. of CHI'95 Human Factors in Computing Systems, 234-241.

Digital Library

[8]

{8} Freeman, W. T., Jones, T. R., and Pasztor, E. 2002. Example-based super-resolution. IEEE Computer Graphics and Applications, 56-65.

Digital Library

[9]

{9} Gonzalez, R. C., and Woods, R. E. 1992. Digital Image Processing. Addison-Wesley Pub Co., Boston, MA.

Digital Library

[10]

{10} Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B. H., and Salesin, D. 2001. Image analogies. Proc. of SIGGRAPH 2001, 327-340.

Digital Library

[11]

{11} Jia, J., and Tang, C.-K. 2004. Inference of segmented color and texture description by tensor voting. IEEE Trans. on Pattern Analysis and Machine Intelligence, 26, 6, 771-786.

Digital Library

[12]

{12} Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. Proc. of SIGGRAPH 2003, 277-286.

Digital Library

[13]

{13} Liang, L., Liu, C., Xu, Y. Q., Guo, B., and Shum, H. Y. 2001. Real-time texture synthesis by patch-based sampling. ACM Trans. on Graphics 20, 3, 127-150.

Digital Library

[14]

{14} Perlin, K., and Fox, D. 1993. Pad: an alternative approach to the computer interface. Proc. of SIGGRAPH 1993, 57-64.

Digital Library

[15]

{15} Nealen, A., and Alexa, M. 2003. Hybrid texture synthesis. Proc. Eurographics workshop on Rendering 2003, 97-105.

Digital Library

[16]

{16} Neyret, F., and Cani, M. P. 1999. Pattern-based texturing revisited. Proc. of SIGGRAPH 1999, 235-242.

Digital Library

[17]

{17} Schödl, A., Szeliski, R., Salesin, D. H., and Essa, I. 2000. Video textures. Proc. of SIGGRAPH 2000, 489-498.

Digital Library

[18]

{18} Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H. Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. ACM Trans. on Graphics (SIGGRAPH 02), 21, 3, 665-672.

Digital Library

[19]

{19} Turk G. 2001. Texture synthesis on surfaces. Proc. of SIGGRAPH 2001, 347-354.

Digital Library

[20]

{20} Wolberg, G. 1990. Digital Image Warping. IEEE Computer Society Press, Los Alamitos, CA.

Digital Library

[21]

{21} Wei, L. Y., and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. Proc. of SIGGRAPH 2000, 479-488.

Digital Library

[22]

{22} Wei, L. Y. 2001. Texture synthesis by fixed neighborhood searching. Ph.D. Thesis. Stanford University.

Digital Library

[23]

{23} Xu, Y. Q., Guo, B., and Shum, H. Y. 2000. Chaos mosaic: fast and memory efficient texture synthesis. Technical Report MSR-TR-2000- 32, Microsoft Research.

[24]

{24} Yamauchi, H., Haber, J., and Seidel, H.-P. 2003. Image restoration using mutli-resolution image synthesis and image inpainting. Proc. Computer Graphics International 2003, 120-125.

[25]

{25} Yuri, B., and Kolmogorov, V. 2001. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. In Third International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition, 359-374.

Digital Library

[26]

{26} Yuri, B., Veksler, O., and Zabih, R. 1999. Fast approximate energy minimization via graph cuts. International Conference on Computer Vision, 1, 377-384.

[27]

{27} Zelinka, S., and Garland, M. 2002. Towards real-time texture synthesis with the jump map. Proc. 2002 Eurographics Workshop on Rendering Techniques, 99-104.

Digital Library

Cited By

Heinzl CStappen S(2017)STARComputer Graphics Forum10.1111/cgf.1321436:3(647-666)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1111/cgf.13214
Ens BGrossman TAnderson FMatejka JFitzmaurice GLatulipe CHartmann BGrossman T(2015)Candid InteractionProceedings of the 28th Annual ACM Symposium on User Interface Software & Technology10.1145/2807442.2807449(467-476)Online publication date: 5-Nov-2015
https://dl.acm.org/doi/10.1145/2807442.2807449
Eisemann MEisemann ESeidel HMagnor MMould DNoël S(2010)Photo zoomProceedings of Graphics Interface 201010.5555/1839214.1839228(71-78)Online publication date: 31-May-2010
https://dl.acm.org/doi/10.5555/1839214.1839228
Show More Cited By

Generating Sub-Resolution Detail in Images and Volumes Using Constrained Texture Synthesis
1. Computing methodologies
  1. Artificial intelligence
  2. Computer graphics

Recommendations

Texture enhancement for improving single-image super-resolution performance

Although various single-image super-resolution algorithms have been developed to increase image resolution, they still do not provide adequate performance in the texture region due to the lack of fine textures in the processed image. In this paper, we ...
Constrained Texture Synthesis via Energy Minimization

This paper describes CMS (constrained minimization synthesis), a fast, robust texture synthesis algorithm that creates output textures while satisfying constraints. We show that constrained texture synthesis can be posed in a principled way as an energy ...
Antialiased super-resolution with parallel high-frequency synthesis

Image super-resolution (SR) increases the resolution of the target image, and has become a fundamental image-editing operation for real-world applications. Traditional methods often cause jaggies and blurring artifacts because natural images generally ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VIS '04: Proceedings of the conference on Visualization '04

October 2004

667 pages

ISBN:0780387880

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

IEEE Computer Society

United States

Publication History

Published: 10 October 2004

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
8
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Heinzl CStappen S(2017)STARComputer Graphics Forum10.1111/cgf.1321436:3(647-666)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1111/cgf.13214
Ens BGrossman TAnderson FMatejka JFitzmaurice GLatulipe CHartmann BGrossman T(2015)Candid InteractionProceedings of the 28th Annual ACM Symposium on User Interface Software & Technology10.1145/2807442.2807449(467-476)Online publication date: 5-Nov-2015
https://dl.acm.org/doi/10.1145/2807442.2807449
Eisemann MEisemann ESeidel HMagnor MMould DNoël S(2010)Photo zoomProceedings of Graphics Interface 201010.5555/1839214.1839228(71-78)Online publication date: 31-May-2010
https://dl.acm.org/doi/10.5555/1839214.1839228
Patel DSture ØHauser HGiertsen CEduard Gröller M(2009)Knowledge Assisted VisualizationComputers and Graphics10.1016/j.cag.2009.06.00533:5(585-596)Online publication date: 1-Oct-2009
https://dl.acm.org/doi/10.1016/j.cag.2009.06.005
Tran MDatta A(2007)Variable neighbourhood texture synthesis with patch initialisationProceedings of the 2007 international conference on Computational science and Its applications - Volume Part II10.5555/1802954.1803019(627-638)Online publication date: 26-Aug-2007
https://dl.acm.org/doi/10.5555/1802954.1803019
Ramanarayanan GBala K(2007)Constrained Texture Synthesis via Energy MinimizationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2007.413:1(167-178)Online publication date: 1-Jan-2007
https://dl.acm.org/doi/10.1109/TVCG.2007.4
Shen PWillis PWyvill GArnold DBillinghurst M(2005)Texture for volume character animationProceedings of the 3rd international conference on Computer graphics and interactive techniques in Australasia and South East Asia10.1145/1101389.1101438(255-264)Online publication date: 29-Nov-2005
https://dl.acm.org/doi/10.1145/1101389.1101438

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents