research-article

Connecting the Dots: Enhancing the Usability of Indexed Multimedia Data for AR Cultural Heritage Applications through Storytelling

Authors:

Woontack WooAuthors Info & Claims

CBMI '17: Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing

Article No.: 11, Pages 1 - 6

https://doi.org/10.1145/3095713.3095725

Published: 19 June 2017 Publication History

Abstract

This paper proposes a method to effectively utilize multimedia databases created and indexed by a metadata schema designed specifically for AR applications used at cultural heritage sites. We attempt to do so by incorporating storytelling principles that employ video data for the purpose of providing useful and meaningful guidance at Changdeokgung Palace, a UNESCO World Heritage Site that consists of multiple PoIs. We designed a themed narrative that embeds video data related to the PoIs, creating a guide route that connects each PoI in a fixed order. An extensive between-group user evaluation comparing a search-based AR experience and the proposed narrative-based one was conducted to test and prove the validity and effectiveness of our approach. Our results show that storytelling is indeed a significantly powerful tool to enhance the level of immersion users experience through video data in an AR environment at cultural heritage sites.

References

[1]

Eunseok Kim, Jungwha Kim, and Woontack Woo. Metadata schema for context-aware augmented reality applications in cultural heritage domain. In 2015 Digital Heritage, volume 2, pages 283--290. IEEE, 2015.

[2]

Hyerim Park and Woontack Woo. Metadata design for location-based film experience in augmented places. In Mixed and Augmented Reality-Media, Art, Social Science, Humanities and Design (ISMAR-MASH'D), 2015 IEEE International Symposium on, pages 40--45. IEEE, 2015.

[3]

Hyerim Park and Woontack Woo. Metadata design for ar spacetelling experience using movie clips.

[4]

W. Woo E. Kim. Metadata schema for visualization and sharing of the augmented reality contents. 2015.

[5]

T. BÃijrge W. Lee, W. Bailer. Ontology for media resources 1.0. 2012. https://www.w3.org/TR/2012/REC-mediaont-10-20120209/.

[6]

B. Jeon D. Hyun. Metadata element and format for broadcast content distribution. 2014. http://mpeg.chiariglione.org/standards/mpeg-a/augmented-reality-application-format.

[7]

Hien To, Hyerim Park, Seon Ho Kim, and Cyrus Shahabi. Incorporating geotagged mobile videos into context-aware augmented reality applications. In Multimedia Big Data (BigMM), 2016 IEEE Second International Conference on, pages 295--302. IEEE, 2016.

[8]

Rachel Heery and Manjula Patel. Application profiles: mixing and matching metadata schemas. Ariadne, (25), 2000.

[9]

Erik Duval, Wayne Hodgins, Stuart Sutton, and Stuart L Weibel. Metadata principles and practicalities. D-lib Magazine, 8(4):16, 2002.

[10]

Jane Hunter and Liz Armstrong. A comparison of schemas for video metadata representation. Computer Networks, 31(11):1431--1451, 1999.

Digital Library

[11]

Woontack Woo Eunseok Kim. Augmented reality framework for archeological site tours. Journal of the HCI Society of Korea, 10:35--43, 2015.

[12]

J Shin, J Kim, and W Woo. Narrative design for rediscovering daereungwon: A location-based augmented reality game. In Consumer Electronics (ICCE), 2017 IEEE International Conference on, pages 384--387. IEEE, 2017.

[13]

Gabriel Cristian Sabou, Irina Maiorescu, et al. Learning about heritage through augmented reality games. In Conference proceedings of&Gt; eLearning and Software for Education &Lt;(eLSE), number 02, pages 87--92. Universitatea Nationala de Aparare Carol I, 2013.

[14]

Francisco Guimarães, Mauro Figueiredo, and José Rodrigues. Augmented reality and storytelling in heritage application in public gardens: Caloust gulbenkian foundation garden. In Digital Heritage, 2015, volume 1, pages 317--320. IEEE, 2015.

[15]

Mads Haahr. Literary Play: Locative Game Mechanics and Narrative Techniques for Cultural Heritage, pages 114--119. Springer International Publishing, Cham, 2015.

[16]

P Bulencea and R Egger. Gamification in tourism. Books on Demand, Norderstedt, 2015.

[17]

Yiannis Georgiou and Eleni A Kyza. The development and validation of the ari questionnaire: An instrument for measuring immersion in location-based augmented reality settings. International Journal of Human-Computer Studies, 98:24--37, 2017.

Digital Library

Cited By

Nikolarakis AKoutsabasis P(2024)Mobile AR Interaction Design Patterns for Storytelling in Cultural Heritage: A Systematic ReviewMultimodal Technologies and Interaction10.3390/mti80600528:6(52)Online publication date: 17-Jun-2024
https://doi.org/10.3390/mti8060052
Ghosh SChatterjee S(2024)A review based knowledge organization supported research framework for digital storytelling from travel recordsGlobal Knowledge, Memory and Communication10.1108/GKMC-09-2023-0339Online publication date: 18-Mar-2024
https://doi.org/10.1108/GKMC-09-2023-0339
Yoo EKwon OYu J(2023)Evaluation of an Augmented Reality for Historical Context Experiences of 3D Restored Court PaintingsIEEE Access10.1109/ACCESS.2023.326852811(39197-39212)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3268528
Show More Cited By

Index Terms

Connecting the Dots: Enhancing the Usability of Indexed Multimedia Data for AR Cultural Heritage Applications through Storytelling
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing design and evaluation methods

Recommendations

How Space is Told: Linking Trajectory, Narrative, and Intent in Augmented Reality Storytelling for Cultural Heritage Sites
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

We report on a qualitative study in which 22 participants created Augmented Reality (AR) stories for outdoor cultural heritage sites. As storytelling is a crucial strategy for AR content aimed at providing meaningful experiences, the emphasis has been ...
From mud to the museum

An archaeological site is a palimpsest in which the evidence of the depositional episodes is destroyed through the excavation processes; all that remains are the artefacts and their documentary evidence manifested in registers, datasets, dig diaries and ...
Visiting a virtual graveyard: designing virtual reality cultural heritage experiences
MUM '19: Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia

Virtual reality offers a potential solution to enable visiting inaccessible cultural heritage sites. We present the design, prototyping and evaluation (n = 6) of a virtual visit to a historic graveyard. The Salla World War II graveyard is located in an ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

CBMI '17: Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing

June 2017

237 pages

ISBN:9781450353335

DOI:10.1145/3095713

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 June 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CBMI '17

CBMI '17: International Workshop on Content-Based Multimedia Indexing

June 19 - 21, 2017

Florence, Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
344
Total Downloads

Downloads (Last 12 months)34
Downloads (Last 6 weeks)5

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nikolarakis AKoutsabasis P(2024)Mobile AR Interaction Design Patterns for Storytelling in Cultural Heritage: A Systematic ReviewMultimodal Technologies and Interaction10.3390/mti80600528:6(52)Online publication date: 17-Jun-2024
https://doi.org/10.3390/mti8060052
Ghosh SChatterjee S(2024)A review based knowledge organization supported research framework for digital storytelling from travel recordsGlobal Knowledge, Memory and Communication10.1108/GKMC-09-2023-0339Online publication date: 18-Mar-2024
https://doi.org/10.1108/GKMC-09-2023-0339
Yoo EKwon OYu J(2023)Evaluation of an Augmented Reality for Historical Context Experiences of 3D Restored Court PaintingsIEEE Access10.1109/ACCESS.2023.326852811(39197-39212)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3268528
Tian JCao YFeng LFu DYuan LQu HWang YFan M(2023)PoeticAR: Reviving Traditional Poetry of the Heritage Site of Jichang Garden via Augmented RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2023.217680640:6(1438-1454)Online publication date: 13-Feb-2023
https://doi.org/10.1080/10447318.2023.2176806
Park HShakeri MJeon IKim JSadeghi-Niaraki AWoo W(2022)Spatial transition management for improving outdoor cinematic augmented reality experience of the TV showVirtual Reality10.1007/s10055-021-00617-z26:3(1059-1077)Online publication date: 6-Jan-2022
https://doi.org/10.1007/s10055-021-00617-z
Nikolakopoulou VKoutsabasis P(2020)Methods and Practices for Assessing the User Experience of Interactive Systems for Cultural HeritageApplying Innovative Technologies in Heritage Science10.4018/978-1-7998-2871-6.ch009(171-208)Online publication date: 2020
https://doi.org/10.4018/978-1-7998-2871-6.ch009
Kontiza KAntoniou ADaif AReboreda-Morillo SBassani MGonzález-Soutelo SLykourentzou IJones CPadfield JLópez-Nores M(2020)On How Technology-Powered Storytelling Can Contribute to Cultural Heritage Sustainability across Multiple Venues—Evidence from the CrossCult H2020 ProjectSustainability10.3390/su1204166612:4(1666)Online publication date: 23-Feb-2020
https://doi.org/10.3390/su12041666
López-Nores MBravo-Quezada OBassani MAntoniou ALykourentzou IJones CKontiza KGonzález-Soutelo SReboreda-Morillo SNaudet YVlachidis ABikakis APazos-Arias J(2019)Technology-Powered Strategies to Rethink the Pedagogy of History and Cultural Heritage through Symmetries and NarrativesSymmetry10.3390/sym1103036711:3(367)Online publication date: 12-Mar-2019
https://doi.org/10.3390/sym11030367
Zhang QZhu XYu HJiang Y(2019)Enhancing Rock Painting Tour Experience with Outdoor Augmented Reality2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct.2019.00-67(118-121)Online publication date: Oct-2019
https://doi.org/10.1109/ISMAR-Adjunct.2019.00-67
Shin JWoo W(2018)Design Guidelines for a Location-based Digital Heritage Storytelling Tool to Support Author Intent2018 3rd Digital Heritage International Congress (DigitalHERITAGE) held jointly with 2018 24th International Conference on Virtual Systems & Multimedia (VSMM 2018)10.1109/DigitalHeritage.2018.8810102(1-8)Online publication date: Oct-2018
https://doi.org/10.1109/DigitalHeritage.2018.8810102
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents