Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3441000.3441028acmotherconferencesArticle/Chapter ViewAbstractPublication PagesozchiConference Proceedingsconference-collections
Work in Progress

Creating 3D worlds through storytelling and narration

Published: 15 February 2021 Publication History
  • Get Citation Alerts
  • Abstract

    While contemporary game engine tools have allowed a lower barrier of entry into creating 3D environments, many rely on engineering, architectural or cartographic approaches. While useful, this usually facilitates very particular methods of 3D space creation. In this paper, we present our tool for creating 3D spaces through the use of narration and storytelling as an interface. Our platform utilizes voice recognition to allow users to narrate a story or event and have elements of the story appear in 3D space as virtual objects in real-time. Through further voice commands or the use of drag-and-drop controls, users can then reconfigure these objects to better suit their story or create new variations of the story. Our platform is designed for immersive systems such as VR HMDs, 3D-enabled cylindrical screens, stereo walls, and non-immersive ones such as desktops and tablets allowing for accessibility and collaboration. A novel contribution of this paper is this method of building worlds through narration. To provide some insight into its capabilities and the reasoning behind design decisions, an account of constructing the story Lessons in Vinyl within the tool during early development is presented.

    Supplementary Material

    p677-edmond-supplement (p677-edmond-supplement.pdf)
    Lessons in Vinyl

    References

    [1]
    Conan Bourke and Tomasz Bednarz. 2019. Multi-Modal High-End Visualization System. In Proceedings of the 17 th International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI‘19). Association for Computing Machinery, Brisbane, QLD, 1-2. https://doi.org/10.1145/3359997.3365731.
    [2]
    Jaimee Brennan 2016. Entertainment Center by Hope Bremiller. Retrieved August 21, 2020 from https://www.turbosquid.com/3d-models/free-obj-mode-victorian-entertainment-center/1078494.
    [3]
    Nguyen Thong Dang, Monica Tavanti, Ivan Rankin and Matthew Cooper, 2009. A comparison of different input devices for a 3D environment. Int. J. Ind. Ergonom. 39, 3 (May 2009), 554-563. https://doi.org/10.1016/j.ergon.2008.10.016.
    [4]
    Franca Garzotto and Matteo Forfori. 2006. FaTe2: storytelling edutainment experiences in 2D and 3D collaborative spaces. In Proceedings of the 2006 conference on Interaction design and children (IDC '06). Association for Computing Machinery, New York, NY, USA, 113–116. https://doi.org/10.1145/1139073.1139102.
    [5]
    Hadwa 2010. Coffee Maker. Retrieved August 21, 2020, from https://www.turbosquid.com/3d-models/coffee-making-machine-3ds-free/541555.
    [6]
    Hend_Z 2015. Vase 01. Retrieved August 21, 2020, from https://www.turbosquid.com/3d-models/free-max-model-vase/963988.
    [7]
    Daniel Hepperle, Yannick Weiß, Andreas Siessa and Matthias Wölfel, 2018. 2D, 3D or speech? A case study on which user interface is preferable for what kind of object interaction in immersive virtual reality. Comput. Graph. 82 (August 2019), 321-331. https://doi.org/10.1016/j.cag.2019.06.003.
    [8]
    HighPolyCNC 2016. Ring Little Dragon. Retrieved August 21, 2020, from https://www.turbosquid.com/3d-models/3d-rings-printing/1044679.
    [9]
    McCloud, Scott. 1993. Understanding Comics. William Morrow. New York, USA.
    [10]
    MrCAD 2000. Model2. Retrieved August 21, 2020, from https://www.turbosquid.com/3d-models/3d-dresser-model/127879.
    [11]
    pholubz4 2002. Jar.3ds. Retrieved August 21, 2020 from https://www.turbosquid.com/3d-models/jar-3ds-free/180667.
    [12]
    TalismanST 2019. 3D diamond ring model. Retrieved August 21, 2020, from https://www.turbosquid.com/3d-models/3d-jewellery-diamond-ring-modell-model-1466699.
    [13]
    Matthias Thöny, Raimund Schnürer, René Sieber, Lorenz Hurni and Renato Pajarola. ISPRS Int. J. Geo-Inf. 7, 3 (March 2018), 1-4. https://doi.org/10.3390/ijgi7030123.
    [14]
    Myrthe L. Tielman, Mark A. Neerincx, Rafael Bidarra, Ben Kybartas and Willem-Paul Brinkman. 2017. A Therapy System for Post-Traumatic Stress Disorder Using a Virtual Agent and Virtual Storytelling to Reconstruct Traumatic Memories. J. Med. Syst. 41 (April 2017), 1-10. https://doi.org/10.1007/s10916-017-0771-y.
    [15]
    Tomoplace 2020. 3D Refrigerator. Retrieved August 21, 2020, from https://www.turbosquid.com/3d-models/3d-refrigerator-1506717.
    [16]
    Turbosquid 2020. Turbosquid. Retrieved August 21, 2020, from https://www.turbosquid.com/.
    [17]
    Unity Technologies 2020. ProBuilder. Retrieved August 21, 2020, from https://unity3d.com/unity/features/worldbuilding/probuilder.
    [18]
    Unity Technologies 2020 Unity3D. Retrieved August 21, 2020, from https://unity.com/.
    [19]
    Theodor G Wyeld, Brett Leavy, Joti Carroll, Craig Gibbons, Brendan Ledwich and James Hills. 2007. The Ethics of Indigenous Storytelling: using the TorqueGame Engine to Support Australian Aboriginal Cultural Heritage. In Proceedings of the 2007 DiGRA International Conference: Situated Play (DIGRA’07). Digital Games Research Association, Tokyo, Japan, 261-268. http://www.digra.org/wp-content/uploads/digital-library/07312.11188.pdf.

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    OzCHI '20: Proceedings of the 32nd Australian Conference on Human-Computer Interaction
    December 2020
    764 pages
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 February 2021

    Check for updates

    Author Tags

    1. collaborative storytelling
    2. digital and interaction design
    3. immersive environments
    4. immersive prototyping
    5. narration

    Qualifiers

    • Work in progress
    • Research
    • Refereed limited

    Conference

    OzCHI '20

    Acceptance Rates

    Overall Acceptance Rate 362 of 729 submissions, 50%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 105
      Total Downloads
    • Downloads (Last 12 months)14
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 06 Aug 2024

    Other Metrics

    Citations

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media