research-article

Interacting with the past: Creating a time perception journey experience using kinect-based breath detection and deterioration and recovery simulation technologies

Authors:

Wen-Ching Liao,

Yi-Ping HungAuthors Info & Claims

Journal on Computing and Cultural Heritage (JOCCH), Volume 7, Issue 1

Article No.: 1, Pages 1 - 15

https://doi.org/10.1145/2535937

Published: 01 February 2014 Publication History

Abstract

We propose an application that allows a museum audience to interact with the past and to appreciate the value of antique objects through multimedia installations. Discussions in this article are based on our experiences in developing the Mao-Kung Cauldron time perception journey multimedia application. This installation was inspired by the Mao-Kung Cauldron, an ancient bronze cauldron in the collection of the National Palace Museum known for its historical significance. The question, however, lies in how to create an experience in which the audiences can interact with the past. To address this issue, the research team used the Kinect-based breath detection and deterioration/recovery simulation technologies to develop the application. This installation is the first application linked to Kinect-based breath detection and deterioration/recovery simulation technologies. The main contribution of this work is the analysis of design concepts, design decisions, and evaluations in a museum setting. We conduct a control group study to compare the outcomes between the experimental group (Mao-Kung Cauldron time perception journey multimedia application) and control group (asynchronous web-based kiosk). Both the quantitative (questionnaire survey) and qualitative methods (observation) are used to analyze the collected data. This work proposes a feasibility design to let museum audiences experience the features of cultural object by the virtual time perception journey application.

References

[1]

ABCmoney. 2007. Virtual heritage allows time travel. Retrieved from http://www.abcmoney.co.uk/news/27200777903.htm.

[2]

N. Burba, M. Bolas, D. M. Krum, and E. A. Suma. 2012. Unobtrusive measurement of subtle nonverbal behaviors with the Microsoft Kinect. Proceedings of the 2012 IEEE Virtual Reality Workshops.

Digital Library

[3]

S. Bussolon. 2013. Kinect: Natural or involuntary interface&quest; Retrieved from http://www.foodandtec.com/in&lowbar;formare/files/kinect.pdf.

[4]

C. W. Cheng. 2001. The Daoist and the primitive mind. Chinese Studies. 19, 2, 113--140.

[5]

CNN. 2007. Lost worlds become virtual heritage. Retrieved from http://edition.cnn.com/2007/TECH/science/05/08/Virtual&lowbar; Heritage/.

[6]

Collection of National Palace Museum. 2013. Homepage. Retrieved from http://www.npm.gov.tw/en/collection/selections&lowbar;02.htm&quest; docno=194&catno=19&pageno=2.

[7]

J. Dorsey and P. Hanrahan. 1996. Modeling and rendering of metallic patinas. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'96).

Digital Library

[8]

J. Dorsey, A. Edelman, H. W. Jensen, J. Legakis, and H. K. Pedersen. 1999. Modeling and rendering of weathered stone. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'99).

Digital Library

[9]

T. Dutta. 2012. Evaluation of the Kinect sensor for 3-D kinematic measurement in the workplace. Applied Ergonomics 43, 4, 645--649.

[10]

E. Ch'ng. 2009. Experiential archaeology: Is virtual time travel possible&quest; Journal of Cultural Heritage 10, 4, 458--470.

[11]

A. Gardner, C. Tchou, T. Hawkins, and P. Debevec. 2003. Linear light source reflectometry. ACM Transaction on Graphics. 22, 3, 749--758.

Digital Library

[12]

A. S. Georghiades, J. Lu, G. Xu, J. Dorsey, and H. Rushmeier. 2005. Observing and transferring material histories. Tech. Rep. 1329, Yale University.

[13]

R. J. Gerrig. 1993. Experiencing Narrative Worlds. Yale University Press, New Haven, CT.

[14]

J. Gu, C. I. Tu, R. Ramamoorthi, P. Belhumeur, W. Matusik, and S. Nayar. 2006. Time-varying surface appearance: Acquisition, modeling and rendering. ACM Transaction on Graphics 25, 3.

Digital Library

[15]

D. Hoyer, K. Schmidt, R. Bauer, U. Zwiener, M. Kohler, B. Luthke, and M. Eiselt. 1997. Nonlinear analysis of heart rate and respiratory dynamics. IEEE Engineering in Medicine and Biology Magazine 16, 1, 31--39.

[16]

C. K. Hsieh, X. Tong, Y. P. Hung, C. P. Chen, J. C. Ko, M. C. Yu, H. H. Lin, S. W. Wu, C. Y. Y., L. C. Lin, M. S. Lee, C. S. Chen, J. P. Wang, Q. P. Lin, and I. L. Liu. 2010a. Transformational breathing between present and past: Virtual exhibition model of the Mao-Kung Ting. In Proceedings of the 16th International Conference on Advances in Multimedia Modeling (MMM'10).

Digital Library

[17]

C. K. Hsieh, X. Tong, Y. P. Hung, C. P. Chen, L. C. Lin, I. L. Liu, M. C. Yu, C. S. Chen, and J. P. Wang. 2010b. Turning rust into gold: An ancient artifact as an interactive artwork. In Proceedings of the 2010 IEEE International Conference on Multimedia and Expo (ICME'10).

[18]

H. J. Hsu. 2011. The potential of Kinect as interactive educational technology. In Proceedings of the 2nd International Conference on Education and Management Technology.

[19]

I. Y. Immoreev. 2006. Practical application of ultra-wideband radars. In Proceedings of the 3rd International Conference on Ultra-wideband and Ultrashort Impulse Signals.

[20]

D. Jung, M. H. Jensen, S. Liang, and J. Mayall. 2012. .cyclic.: An interactive performance combining dance, graphics, music and Kinect-technology. In Proceedings of the 13th International Conference of the NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction.

Digital Library

[21]

Kinect. 2013. Homepage. Retrieved from http://www.xbox.com/en-gb/kinect.

[22]

S. Kenderdine, J. Shaw, and A. Kocsis. 2009. Dramaturgies of PLACE: evaluation, embodiment and performance in PLACE-Hampi. In Proceedings of the International Conference on Advances in Computer Entertainment Technology 2009.

Digital Library

[23]

Z. Lei and D. Xu. 2009. Immersive display and interactive techniques for the modeling and rendering of virtual heritage environments. In Proceedings of the International Conference on Information Management and Engineering 2009 (ICIME'09).

Digital Library

[24]

A. Mehler and A. Lucking. 2012. WikiNect: Towards a gestural writing system for kinetic museum wikis. In Proceedings of the 2012 ACM Workshop on User Experience in E-learning and Augmented Technologies in Education.

Digital Library

[25]

P. l. Nunez and R. Srinvsan. 1981. Electric Fields of the Brain: The Neurophysics of EEG. Oxford University Press.

[26]

H. Richards-Rissetto, J. Robertsson, J. Von Schwerin, G. Agugiaro, F. Remondino, G. Girardi, and M. Forte. 2012. Hands-Off: Using Kinect to virtually query the ancient Maya city of Copan, Honduras. In Proceedings of the 2012 Conference on Computer Applications and Quantitative Methods in Archaeology (CAA'12).

[27]

Ava Fatah gen Schieck and Ana Maria Moutinho. 2012. ArCHI: Engaging with museum objects spatially through whole body movement. In Proceedings of the 16th International Academic MindTrek Conference (MindTrek'12).

Digital Library

[28]

F. Sen, L. Diaz, and T. Horttana. 2012. A novel gesture-based interface for a VR simulation: Re-discovering Vrouw Maria. In Proceedings of the 18th International Conference on Virtual Systems and Multimedia (VSMM'12).

[29]

S. Smith, S. Cutchin, A. Rockwood, A. Saad, N. G. Smith, and T. E. Levy. 2012. Demo paper: Virtual and immersive experience presentation of cultural heritage Sites. In Proceedings of the 18th International Conference on Virtual Systems and Multimedia (VSMM'12).

[30]

H. M. Ting. 2005. The Chuang Tzu regard “Chi” as the vital thoughts. Journal of Cheng Shiu University 18, 31--46.

[31]

S. Valtolina, S. Franzoni, P. Mazzoleni, and E. Bertino. 2005. Dissemination of cultural heritage content through virtual reality and multimedia techniques: A case study. In Proceedings of the 11th International Multi-Media Modelling Conference (MMM 2005).

Digital Library

[32]

J. P. Wang, X. Tong, S. Lin, C. Wang, M. G. Pan, H. J. Bao, B. N. Guo, and H. Y. Shun. 2006. Appearance manifolds for modeling time-variant appearance of materials. ACM Transaction on Graphics 25, 3.

Digital Library

[33]

G. J. Ward. 1992. Measuring and modeling anisotropic reflection. In Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'92).

Digital Library

[34]

M. C. Yu, Y. P. Hung, K. J. Chang, J. S. Chen, S. C. Hsu, J. C. Ko, and C. Y. Lin. 2008. Multimedia feedback for improving breathing habit. In Proceedings of the 1st IEEE International Conference on Ubi-media Computing (U-Media'08).

[35]

M. C. Yu, J. L. Liou, S. W. Kuo, M. S. Lee, and Y. P. Hung. 2012. Noncontact respiratory measurement of volume change using depth camera. In Proceedings of the 2012 IEEE Annual International Conference of the Engineering in Medicine and Biology Society (EMBS'12 ).

Cited By

Portnova GMaslennikova A(2023)The Photic Stimulation Has an Impact on the Reproduction of 10 s Intervals Only in Healthy Controls but Not in Patients with Schizophrenia: The EEG StudyBrain Sciences10.3390/brainsci1301011213:1(112)Online publication date: 7-Jan-2023
https://doi.org/10.3390/brainsci13010112
Bonis MNguyen HBourdot P(2022)A Literature Review of User Studies in Extended Reality Applications for Archaeology2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00023(92-101)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00023
Monaco DPellegrino MScarano VVicidomini L(2022)Linked open data in authoring virtual exhibitionsJournal of Cultural Heritage10.1016/j.culher.2021.11.00253(127-142)Online publication date: Jan-2022
https://doi.org/10.1016/j.culher.2021.11.002
Show More Cited By

Index Terms

Interacting with the past: Creating a time perception journey experience using kinect-based breath detection and deterioration and recovery simulation technologies
1. Applied computing
  1. Arts and humanities
  2. Document management and text processing
    1. Document capture
      1. Graphics recognition and interpretation
2. Computing methodologies
  1. Computer graphics

Recommendations

Design and territory: laser cutting/engraving applied in the manufacture of products for the promotion of the "Pedra Grande" archeological site, RS, Brazil
DPPI '11: Proceedings of the 2011 Conference on Designing Pleasurable Products and Interfaces

The pursuit for knowing the peculiarities of each country or region takes millions of people to embark on journeys to various destinations. The curiosity about other cultures makes the tourism activity a means of learning the history of a place, ...
Visiting a virtual graveyard: designing virtual reality cultural heritage experiences
MUM '19: Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia

Virtual reality offers a potential solution to enable visiting inaccessible cultural heritage sites. We present the design, prototyping and evaluation (n = 6) of a virtual visit to a historic graveyard. The Salla World War II graveyard is located in an ...
An Interactive Digital Experience to Enhance the Cultural Heritage of the Town of Gallipoli: The Gallipoli MAB Project
Extended Reality
Abstract
The convergence of technology and cultural heritage has inaugurated a new era of exploration and engagement within museums and historical sites worldwide. Extended Reality (XR) is at the forefront of this transformation, revolutionizing ...

Comments

Information & Contributors

Information

Published In

cover image Journal on Computing and Cultural Heritage

Journal on Computing and Cultural Heritage Volume 7, Issue 1

February 2014

99 pages

ISSN:1556-4673

EISSN:1556-4711

DOI:10.1145/2582016

Issue’s Table of Contents

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 February 2014

Accepted: 01 October 2013

Revised: 01 July 2013

Received: 01 January 2013

Published in JOCCH Volume 7, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
612
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Portnova GMaslennikova A(2023)The Photic Stimulation Has an Impact on the Reproduction of 10 s Intervals Only in Healthy Controls but Not in Patients with Schizophrenia: The EEG StudyBrain Sciences10.3390/brainsci1301011213:1(112)Online publication date: 7-Jan-2023
https://doi.org/10.3390/brainsci13010112
Bonis MNguyen HBourdot P(2022)A Literature Review of User Studies in Extended Reality Applications for Archaeology2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00023(92-101)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00023
Monaco DPellegrino MScarano VVicidomini L(2022)Linked open data in authoring virtual exhibitionsJournal of Cultural Heritage10.1016/j.culher.2021.11.00253(127-142)Online publication date: Jan-2022
https://doi.org/10.1016/j.culher.2021.11.002
Campos WPina ARubio G(2021)Náhuat Language Kinect Application for Museum2021 International Symposium on Computers in Education (SIIE)10.1109/SIIE53363.2021.9583657(1-5)Online publication date: 23-Sep-2021
https://doi.org/10.1109/SIIE53363.2021.9583657
Koutsabasis P(2020)Empirical Evaluations of Interactive Systems in Cultural HeritageCognitive Analytics10.4018/978-1-7998-2460-2.ch067(1331-1355)Online publication date: 2020
https://doi.org/10.4018/978-1-7998-2460-2.ch067
Bekele MPierdicca RFrontoni EMalinverni EGain J(2018)A Survey of Augmented, Virtual, and Mixed Reality for Cultural HeritageJournal on Computing and Cultural Heritage 10.1145/314553411:2(1-36)Online publication date: 22-Mar-2018
https://dl.acm.org/doi/10.1145/3145534
Raptis GFidas CAvouris N(2018)Effects of mixed-reality on players’ behaviour and immersion in a cultural tourism game: A cognitive processing perspectiveInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2018.02.003114(69-79)Online publication date: Jun-2018
https://doi.org/10.1016/j.ijhcs.2018.02.003
Dondi PLombardi LRocca IMalagodi MLicchelli M(2018)Multimodal workflow for the creation of interactive presentations of 360 spin images of historical violinsMultimedia Tools and Applications10.1007/s11042-018-6046-x77:21(28309-28332)Online publication date: 1-Nov-2018
https://dl.acm.org/doi/10.1007/s11042-018-6046-x
Koutsabasis P(2017)Empirical Evaluations of Interactive Systems in Cultural HeritageInternational Journal of Computational Methods in Heritage Science10.4018/IJCMHS.20170101071:1(100-122)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.4018/IJCMHS.2017010107
Mills SGreen DLongnecker NBrundell JRodger CBrook P(2016)Embodied Earth: Experiencing natural phenomena2016 International Conference on Image and Vision Computing New Zealand (IVCNZ)10.1109/IVCNZ.2016.7804425(1-6)Online publication date: Nov-2016
https://doi.org/10.1109/IVCNZ.2016.7804425

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents