short-paper

Example-based synthesis of three-dimensional clouds from photographs

Authors:

Yoshinori Dobashi,

Makoto OkabeAuthors Info & Claims

CGI '17: Proceedings of the Computer Graphics International Conference

Article No.: 28, Pages 1 - 6

https://doi.org/10.1145/3095140.3095168

Published: 27 June 2017 Publication History

Abstract

In this paper, we propose a modeling method of clouds from a single photograph. To synthesize realistic images of outdoor scenes, modeling of 3D clouds is necessary. However, synthesizing realistic clouds is still a difficult task. To address this problem, we propose an example-based volume texture synthesis to model nonhomogeneous density volumes. Our method prepares an example cloud volume data using a physically-based fluid simulator. Then the output cloud volume is automatically synthesized from the example cloud volume data so that its rendered image becomes similar to the clouds in the input photograph. In contrast to the previous texture synthesis methods, our method synthesizes density volumes taking into account scattering and transmittance of light. We show several cloud volumes whose rendered images are similar to the input photograph.

References

[1]

Y. Dobashi, W. Iwasaki, A. Ono, T. Yamamoto, Y. Yue, and T. Nishita. 2012. An Inverse Problem Approach for Automatically Adjusting the Parameters for Rendering Clouds Using Photographs. ACM Transactions on Graphics 31, 6 (2012), Article 145.

Digital Library

[2]

Y. Dobashi, K. Kusumoto, T. Nishita, and T. Yamamoto. 2008. Feedback Control of Cumuliform Cloud Formation based on Computational Fluid Dynamics. ACM Transactions on Graphics 27, 3 (2008), Article 94.

Digital Library

[3]

Y. Dobashi, T. Nishita, H. Yamashita, and T. Okita. 1998. Using Metaballs to Modeling and Animate Clouds from Satellite Images. The Visual Computer 15, 9 (1998), 471--482.

Digital Library

[4]

Y. Dobashi, Y. Shinzo, and T. Yamamoto. 2010. Modeling of Clouds from a Single Photograph. Computer Graphics Forum 29, 7 (2010), 2083--2090.

[5]

D. S. Ebert. 1997. Volumetric Modeling with Implicit Functions: A Cloud is Born. In Visual Proceedings of SIGGRAPH 1997. 147.

Digital Library

[6]

D. S. Ebert, F. K. Musgrave, D. Peachey, K. Perlin, and S. Worley. 2002. Texturing & modeling: a procedural approach. Morgan Kaufman.

Digital Library

[7]

G. Y. Gardner. 1985. Visual simulation of clouds. Computer Graphics (Proceedings of SIGGRAPH 1985) 19, 3 (1985), 297--304.

Digital Library

[8]

D. J. Heeger and J. R. Bergen. 1995. Pyramid-based Texture Analysis and Synthesis. In Proc. ACM SIGGRAPH 1995. 229--238.

Digital Library

[9]

J. T. Kajiya and B. P Von Herzen. 1984. Ray tracing volume densities. Computer Graphics (Proceedings of SIGGRAPH 1984) 18, 3 (1984), 165--174.

Digital Library

[10]

J. Kopf, C.-W. Fu, D. Cohen-or, O. Deussen, D. Lischinski, and T.-T. Wong. 2007. Solid Texture Synthesis from 2D Exemplars. ACM Transactions on Graphics 26, 3 (2007), Article 2.

Digital Library

[11]

V. Kwatra, I. Essa, and N. Kwatra A. Bobick. 2005. Texture Optimization for Example-based Texture Synthesis. ACM. Transactions on Graphics 24, 3 (2005), 795--802.

Digital Library

[12]

A. Levis, Y. Y. Schechner, A. Aides, and A. B. Davis. 2015. Airbone Three-Dimensional Cloud Tomography. In Proceedings of IEEE International Conference Computer Vision.

Digital Library

[13]

R. Miyazaki, S. Yoshida, T. Nishita, and Y. Dobashi. 2001. A Method for Modeling Clouds Based on Atmospheric Fluid Dynamics. In Proceedings of the 9th Pacific Conference on Computer Graphics and Applications. 363--372.

Digital Library

[14]

M. Muja and D. G. Lowe. 2014. Scalable Nearest Neighbor Algorithms for High Dimensional Data. IEEE Transactions on Pattern Analysis and Machine Intelligence 36 (2014), 2227--2240.

[15]

T. Nishita, E. Nakamae, and Y. Dobashi. 1996. Display of Clouds Taking into Account Multiple Anisotropic Scattering and Sky Light. In Proceedings of ACM SIGGRAPH 1996, Annual Conference Series. 379--386.

Digital Library

[16]

M. Okabe, Y. Dobashi, K. Anjyo, and R. Onai. 2015. Fluid Volume Modeling from Sparse Multi-view Images by Appearance Transfer. ACM Transactions on Graphics 34, 4 (2015), 93:1--93:10.

Digital Library

[17]

G. Sakas. 1993. Modeling and animating turbulent gaseous phenomena using spectral synthesis. The Visual Computer 9, 4 (1993), 200--212.

Digital Library

[18]

J. Schpok, J. Simons, D. S. Ebert, and C. Hansen. 2003. A real-time cloud modeling, rendering, and animation system. In Proceedings of Symposium on Computer Animation 2005. 160--166.

Digital Library

[19]

Y. Shu, Y. Qian, H. Sun, and Y. Chen. 2014. Efficient Texture Synthesis of Aggregate Solid Material. The Visual Computer 30, 6--8 (2014), 877--887.

Digital Library

[20]

R. Voss. 1983. Fourier Synthesis of Gaussian Fractals: 1/f noises, landscapes, and flakes. In SIGGRAPH'83: Tutorial on State of the Art Image Synthesis, Vol. 10.

[21]

C. Yuan, X. Liang, S. Hao, Y. Qi, and Q. Zhao. 2014. Modelling Cumulus Cloud Shape from a Single Image. Computer Graphics Forum 33, 6 (2014), 288--297.

Digital Library

[22]

S. Zhao, W. Jakob, S. Marschner, and K. Bala. 2012. Structure-aware Synthesis for Predictive Woven Fabric Appearance. ACM Transactions on Graphics 31, 4 (2012), 75:1--75:10.

Digital Library

[23]

C. Zhu, R. H. Byrd, and J. Nocedal. 1997. L-BFGS-B: Algorithm 778: L-BFGS-B, FORTRAN routines for large scale bound constrained optimization. ACM Trans. Math. Software 23, 4 (1997), 550--560.

Digital Library

Cited By

Fukaya KDaylamani-Zad DAgius H(2025)Intelligent Generation of Graphical Game Assets: A Conceptual Framework and Systematic Review of the State of the ArtACM Computing Surveys10.1145/370849957:5(1-38)Online publication date: 9-Jan-2025
https://dl.acm.org/doi/10.1145/3708499
Zhao XGuo JWang LLi FLi JZheng JYang BElkind E(2023)STS-GANProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/196(1768-1776)Online publication date: 19-Aug-2023
https://dl.acm.org/doi/10.24963/ijcai.2023/196
Zamri MSunar M(2022)Atmospheric cloud modeling methods in computer graphics: A review, trends, taxonomy, and future directionsJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2020.11.03034:6(3468-3488)Online publication date: Jun-2022
https://doi.org/10.1016/j.jksuci.2020.11.030

Index Terms

Example-based synthesis of three-dimensional clouds from photographs
1. Computing methodologies
  1. Computer graphics
    1. Shape modeling
      1. Volumetric models

Recommendations

Synthesis and Rendering of Bidirectional Texture Functions on Arbitrary Surfaces

Abstract--The bidirectional texture function (BTF) is a 6D function that describes the appearance of a real-world surface as a function of lighting and viewing directions. The BTF can model the fine-scale shadows, occlusions, and specularities caused by ...
Synthesis of bidirectional texture functions on arbitrary surfaces
SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques

The bidirectional texture function (BTF) is a 6D function that can describe textures arising from both spatially-variant surface reflectance and surface mesostructures. In this paper, we present an algorithm for synthesizing the BTF on an arbitrary ...
Image-based rendering for scenes with reflections

We present a system for image-based modeling and rendering of real-world scenes containing reflective and glossy surfaces. Previous approaches to image-based rendering assume that the scene can be approximated by 3D proxies that enable view ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

CGI '17: Proceedings of the Computer Graphics International Conference

June 2017

260 pages

ISBN:9781450352284

DOI:10.1145/3095140

Program Chairs:
Xiaoyang Mao
University of Yamanashi, Japan
,
Daniel Thalmann
NTU, Singapore & EPFL IC-DO, Switzerland
,
Marina Gavrilova
University of Calgary, Canada

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 June 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

CGI '17

CGI '17: Computer Graphics International 2017

June 27 - 30, 2017

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 35 of 159 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
139
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Fukaya KDaylamani-Zad DAgius H(2025)Intelligent Generation of Graphical Game Assets: A Conceptual Framework and Systematic Review of the State of the ArtACM Computing Surveys10.1145/370849957:5(1-38)Online publication date: 9-Jan-2025
https://dl.acm.org/doi/10.1145/3708499
Zhao XGuo JWang LLi FLi JZheng JYang BElkind E(2023)STS-GANProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/196(1768-1776)Online publication date: 19-Aug-2023
https://dl.acm.org/doi/10.24963/ijcai.2023/196
Zamri MSunar M(2022)Atmospheric cloud modeling methods in computer graphics: A review, trends, taxonomy, and future directionsJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2020.11.03034:6(3468-3488)Online publication date: Jun-2022
https://doi.org/10.1016/j.jksuci.2020.11.030

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten