research-article

Public Access

Crumpling sound synthesis

Authors:

Eitan Grinspun,

Miguel A. Otaduy,

Changxi ZhengAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 35, Issue 6

Article No.: 181, Pages 1 - 11

https://doi.org/10.1145/2980179.2982400

Published: 05 December 2016 Publication History

Abstract

Crumpling a thin sheet produces a characteristic sound, comprised of distinct clicking sounds corresponding to buckling events. We propose a physically based algorithm that automatically synthesizes crumpling sounds for a given thin shell animation. The resulting sound is a superposition of individually synthesized clicking sounds corresponding to visually significant and insignificant buckling events. We identify visually significant buckling events on the dynamically evolving thin surface mesh, and instantiate visually insignificant buckling events via a stochastic model that seeks to mimic the power-law distribution of buckling energies observed in many materials.

In either case, the synthesis of a buckling sound employs linear modal analysis of the deformed thin shell. Because different buckling events in general occur at different deformed configurations, the question arises whether the calculation of linear modes can be reused. We amortize the cost of the linear modal analysis by dynamically partitioning the mesh into nearly rigid pieces: the modal analysis of a rigidly moving piece is retained over time, and the modal analysis of the assembly is obtained via Component Mode Synthesis (CMS). We illustrate our approach through a series of examples and a perceptual user study, demonstrating the utility of the sound synthesis method in producing realistic sounds at practical computation times.

Supplementary Material

ZIP File (a181-cirio.zip)

Supplemental file.

Download
97.45 MB

References

[1]

Abobaker, M., Bouaziz, O., Lebyodkin, M., Lebedkina, T., and Shashkov, I. V. 2015. Avalanche dynamics in crumpled aluminum thin foils. Scripta Materialia 99 (Apr.), 17--20.

[2]

An, S. S., Marschner, S., and James, D. L. 2012. Motion-driven Concatenative Synthesis of Cloth Sounds. ACM Trans. Graph. 31, 4.

Digital Library

[3]

Balankin, A. S., Cruz, M. A. M., Caracheo, L. A. A., Huerta, O. S., Rivas, C. D., Martínez, C. L., Ochoa, D. S., Ruiz, L. M., Gutiérrez, S. M., Ortiz, J. P., and Ortiz, M. P. 2015. Mechanical properties and relaxation behavior of crumpled aluminum foils. Journal of Materials Science 50, 13.

[4]

Baraff, D., and Witkin, A. 1998. Large steps in cloth simulation. In Proc. SIGGRAPH '98.

Digital Library

[5]

Bathe, K.-J., and Dong, J. 2014. Component mode synthesis with subspace iterations for controlled accuracy of frequency and mode shape solutions. Computers & Structures 139 (July).

[6]

Bridson, R., Marino, S., and Fedkiw, R. 2003. Simulation of clothing with folds and wrinkles. In Proc. SCA '03.

Digital Library

[7]

Cerda, E., Chaieb, S., Melo, F., and Mahadevan, L. 1999. Conical dislocations in crumpling. Nature 401, 6748 (Sept.), 46--49.

[8]

Chadwick, J. N., An, S. S., and James, D. L. 2009. Harmonic shells: a practical nonlinear sound model for near-rigid thin shells. ACM Trans. Graph. 28, 5.

Digital Library

[9]

Choi, K.-J., and Ko, H.-S. 2002. Stable but Responsive Cloth. In Proc. SIGGRAPH '02.

Digital Library

[10]

Cook, P. R. 2002. Real Sound Synthesis for Interactive Applications, 1st edition ed. A K Peters/CRC Press.

Digital Library

[11]

Craig, R. R., and Bampton, M. C. C. 1968. Coupling of substructures for dynamic analyses. AIAA Journal 6, 7, 1313--1319.

[12]

Craig, R. R., and Kurdila, A. J. 2006. Fundamentals of Structural Dynamics, 2 edition ed. Wiley, Hoboken, N.J, July.

[13]

Craig, J. R. 2000. Coupling of substructures for dynamic analyses: An overview. In 41st Structures, Structural Dynamics, and Materials Conference and Exhibit.

[14]

De Klerk, D., Rixen, D. J., and Voormeeren, S. N. 2008. General framework for dynamic substructuring. AIAA Journal 46, 5, 1169--1181.

[15]

DiDonna, B. A. 2002. Scaling of the buckling transition of ridges in thin sheets. Physical Review E 66, 1 (July), 016601.

[16]

Doel, K. v. d., Kry, P. G., and Pai, D. K. 2001. FoleyAutomatic: physically-based sound effects for interactive simulation and animation. In Proc. SIGGRAPH '01.

Digital Library

[17]

Feller, W. 2008. An introduction to probability theory and its applications, vol. 2. John Wiley & Sons.

[18]

Fontana, F., and Bresin, R. 2003. Physics-based sound synthesis and control: Crushing, walking and running by crumpling sounds. In Proc. of the XIV Colloquium on Musical Informatics.

[19]

Gingold, Y., Secord, A., Han, J. Y., Grinspun, E., and Zorin, D. 2004. A Discrete Model for Inelastic Deformation of Thin Shells. Technical Report.

[20]

Golub, G. H., and Van Loan, C. F. 2012. Matrix computations, vol. 3. JHU Press.

[21]

Grinspun, E., Hirani, A. N., Desbrun, M., and Schröder, P. 2003. Discrete shells. In Proc. SCA '03.

Digital Library

[22]

Holm-Jorgensen, K., and Nielsen, S. R. K. 2009. A component mode synthesis algorithm for multibody dynamics of wind turbines. Journal of Sound and Vibration 326, 753--767.

[23]

Houle, P. A., and Sethna, J. P. 1996. Acoustic Emission from crumpling paper. Physical Review E 54, 1 (July), 278--283.

[24]

Hurty, W. C. 1965. Dynamic Analysis of Structural Systems Using Component Modes. AIAA Journal 3, 4, 678--685.

[25]

James, D. L., and Twigg, C. D. 2005. Skinning mesh animations. ACM Trans. Graph. 24, 3.

Digital Library

[26]

James, D. L., Barbic, J., and Pai, D. K. 2006. Precomputed acoustic transfer: output-sensitive, accurate sound generation for geometrically complex vibration sources. ACM Trans. Graph. 25, 3.

Digital Library

[27]

Kim, T., Thürey, N., James, D. L., and Gross, M. H. 2008. Wavelet turbulence for fluid simulation. ACM Trans. Graph. 27, 3.

Digital Library

[28]

Kramer, E. M., and Lobkovsky, A. E. 1996. Universal Power Law in the Noise from a Crumpled Elastic Sheet. Physical Review E 53, 2 (Feb.), 1465--1469.

[29]

MacNeal, R. H. 1971. A hybrid method of component mode synthesis. Computers & Structures 1, 4 (Dec.), 581--601.

[30]

Moakher, M. 2002. Means and Averaging in the Group of Rotations. SIAM Journal on Matrix Analysis and Applications 24.

Digital Library

[31]

Narain, R., Samii, A., and O'Brien, J. F. 2012. Adaptive anisotropic remeshing for cloth simulation. ACM Trans. Graph. 31, 6.

Digital Library

[32]

Narain, R., Pfaff, T., and O'Brien, J. F. 2013. Folding and Crumpling Adaptive Sheets. ACM Trans. Graph. 32, 4.

Digital Library

[33]

O'Brien, J. F., Shen, C., and Gatchalian, C. M. Synthesizing sounds from rigid-body simulations. In Proc. SCA '02.

Digital Library

[34]

O'Brien, J. F., Cook, P. R., and Essl, G. 2001. Synthesizing sounds from physically based motion. In Proc. SIGGRAPH '01.

Digital Library

[35]

Pandey, A., Moulton, D. E., Vella, D., and Holmes, D. P. 2014. Dynamics of snapping beams and jumping poppers. EPL (Europhysics Letters) 105, 2, 24001.

[36]

Parlett, B. N. 1980. The symmetric eigenvalue problem, vol. 7. SIAM.

[37]

Petri, A., Paparo, G., Vespignani, A., Alippi, A., and Costantini, M. 1994. Experimental evidence for critical dynamics in microfracturing processes. Physical Review Letters 73, 25.

[38]

Ramm, E., and Wall, W. 2003. Shell Structures - a Sensitive Interrelation Between Physics and Numerics. Bericht. SFB 404.

[39]

Rubin, S. 1975. Improved Component-Mode Representation for Structural Dynamic Analysis. AIAA Journal 13, 8, 995--1006.

[40]

Rubinstein, R. Y., and Kroese, D. P. 2011. Simulation and the Monte Carlo method, vol. 707. John Wiley & Sons.

Digital Library

[41]

Schreck, C., Rohmer, D., James, D., Hahmann, S., and Cani, M.-P. 2016. Real-time sound synthesis for paper material based on geometric analysis. In Proc. SCA '16.

Digital Library

[42]

Sethna, J. P., Dahmen, K. A., and Myers, C. R. 2001. Crackling noise. Nature 410, 6825 (Mar.), 242--250.

[43]

Shabana, A. A. 2012. Theory of vibration: Volume II: discrete and continuous systems. Springer Science & Business Media.

[44]

Shen, L., and Liu, Y. J. 2006. An adaptive fast multipole boundary element method for three-dimensional acoustic wave problems based on the Burton-Miller formulation. Computational Mechanics 40, 3 (Oct.), 461--472.

[45]

Stammberger, M., and Voss, H. 2008. Automated Multi-Level Substructuring for a Fluid-Solid Vibration Problem. In Numerical Mathematics and Advanced Applications. 563--570.

[46]

Sun, B. H., Yeh, K. Y., and Rimrott, F. P. J. 1995. On the buckling of structures. Technische Mechanik 15, 2, 129--140.

[47]

Terzopoulos, D., Platt, J., Barr, A., and Fleischer, K. 1987. Elastically deformable models. In Proc. SIGGRAPH '87.

Digital Library

[48]

Vliegenthart, G. A., and Gompper, G. 2006. Forced crumpling of self-avoiding elastic sheets. Nature Materials 5, 3, 216--221.

[49]

Winnemöller, H., Olsen, S. C., and Gooch, B. 2006. Real-time video abstraction. ACM Trans. Graph. 25, 3.

Digital Library

[50]

Wood, A. 2002. Witten's lectures on crumpling. Physica A: Statistical Mechanics and its Applications 313, 1.

[51]

Yang, Y., Xu, W., Guo, X., Zhou, K., and Guo, B. 2013. Boundary-Aware Multidomain Subspace Deformation. IEEE TVCG 19, 10.

[52]

Zheng, C., and James, D. L. 2010. Rigid-body fracture sound with precomputed soundbanks. ACM Trans. Graph. 29, 4.

Digital Library

[53]

Zheng, C., and James, D. L. 2011. Toward high-quality modal contact sound. ACM Trans. Graph. 30, 4.

Digital Library

[54]

Zhou, C., Jin, X., and Wang, C. C. L. 2008. Shear buckling and dynamic bending in cloth simulation. Computer Animation and Virtual Worlds 19, 3-4 (Jan.), 493--503.

Digital Library

Cited By

Krekhov AEmmerich KDemay LKrüger J(2024)Clothing Sounds in Games: Generation Procedure and Impact on Player ExperienceProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685378(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685378
Cao CAn ZRen ZManocha DZhou K(2023)A Psychoacoustic Quality Criterion for Path-Traced Sound PropagationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.321351429:12(5422-5433)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1109/TVCG.2022.3213514
Liu SManocha D(2022)Sound Synthesis, Propagation, and RenderingSynthesis Lectures on Visual Computing10.2200/S01162ED1V01Y202201VCP03311:2(1-110)Online publication date: 24-Mar-2022
https://doi.org/10.2200/S01162ED1V01Y202201VCP033
Show More Cited By

Index Terms

Crumpling sound synthesis
1. Applied computing
  1. Arts and humanities
    1. Sound and music computing
2. Computing methodologies
  1. Computer graphics
    1. Animation
      1. Physical simulation

Recommendations

Multi-scale simulation of nonlinear thin-shell sound with wave turbulence

Thin shells --- solids that are thin in one dimension compared to the other two --- often emit rich nonlinear sounds when struck. Strong excitations can even cause chaotic thin-shell vibrations, producing sounds whose energy spectrum diffuses from low ...
Harmonic shells: a practical nonlinear sound model for near-rigid thin shells
SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers

We propose a procedural method for synthesizing realistic sounds due to nonlinear thin-shell vibrations. We use linear modal analysis to generate a small-deformation displacement basis, then couple the modes together using nonlinear thin-shell forces. ...
An efficient C0 finite element modeling of an inverse hyperbolic shear deformation theory for the flexural and stability analysis of laminated composite and sandwich plates

A computationally efficient C^0 finite element model is developed for laminated composite and sandwich plates by implementing the inverse hyperbolic shear deformation theory recently developed by the authors. This model is used to determine responses of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 35, Issue 6

November 2016

1045 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2980179

Issue’s Table of Contents

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 December 2016

Published in TOG Volume 35, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
707
Total Downloads

Downloads (Last 12 months)126
Downloads (Last 6 weeks)38

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Krekhov AEmmerich KDemay LKrüger J(2024)Clothing Sounds in Games: Generation Procedure and Impact on Player ExperienceProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685378(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685378
Cao CAn ZRen ZManocha DZhou K(2023)A Psychoacoustic Quality Criterion for Path-Traced Sound PropagationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.321351429:12(5422-5433)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1109/TVCG.2022.3213514
Liu SManocha D(2022)Sound Synthesis, Propagation, and RenderingSynthesis Lectures on Visual Computing10.2200/S01162ED1V01Y202201VCP03311:2(1-110)Online publication date: 24-Mar-2022
https://doi.org/10.2200/S01162ED1V01Y202201VCP033
Liu SLi SCheng H(2022)Towards an End-to-End Visual-to-Raw-Audio Generation With GANIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2021.307989732:3(1299-1312)Online publication date: Mar-2022
https://doi.org/10.1109/TCSVT.2021.3079897
Nagao KKumon KHattori K(2021)Impact Sound Generation for Audiovisual Interaction with Real-World Movable Objects in Building-Scale Virtual RealityApplied Sciences10.3390/app1116754611:16(7546)Online publication date: 17-Aug-2021
https://doi.org/10.3390/app11167546
Su FJoslin C(2021)Subjective and Objective Evaluation of Procedurally-Generated Audio for Soft-Body InteractionsProceedings of the 16th International Audio Mostly Conference10.1145/3478384.3478404(1-8)Online publication date: 1-Sep-2021
https://dl.acm.org/doi/10.1145/3478384.3478404
Su FJoslin C(2019)Procedural Sound Generation for Soft Bodies in Video GamesProceedings of the 12th ACM SIGGRAPH Conference on Motion, Interaction and Games10.1145/3359566.3360068(1-12)Online publication date: 28-Oct-2019
https://dl.acm.org/doi/10.1145/3359566.3360068
Su FJoslin C(2019)Toward Generating Realistic Sounds for Soft BodiesProceedings of the 14th International Audio Mostly Conference: A Journey in Sound10.1145/3356590.3356620(199-206)Online publication date: 18-Sep-2019
https://dl.acm.org/doi/10.1145/3356590.3356620
Rocchesso DMonache SBarrass S(2019)Interaction by EarInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2019.05.012Online publication date: May-2019
https://doi.org/10.1016/j.ijhcs.2019.05.012
Su FJoslin CCunningham SPicking R(2018)Procedurally-Generated Audio for Soft-Body AnimationsProceedings of the Audio Mostly 2018 on Sound in Immersion and Emotion10.1145/3243274.3243285(1-8)Online publication date: 12-Sep-2018
https://dl.acm.org/doi/10.1145/3243274.3243285
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents