research-article

Thresholds: Embedding Virtual Reality in the Museum

Authors:

Sarah Martindale,

Dimitrios Darzentas,

Mat CollishawAuthors Info & Claims

Journal on Computing and Cultural Heritage (JOCCH), Volume 13, Issue 2

Article No.: 12, Pages 1 - 35

https://doi.org/10.1145/3369394

Published: 30 May 2020 Publication History

Abstract

We examine the experience of Thresholds, a virtual reality (VR) recreation of the world's first photographic exhibition, which has toured to multiple museums. Following the method of performance-led research in the wild, we provide an account of the artist's design rationale and the experiences of visitors as the work toured. We reveal how the overlaying and juxtaposing of virtual and physical spaces established a VR architecture that underpinned the extended user experience. Overlaying was used to layer a virtual model onto a corresponding physical set to deliver physical sensations of touch and movement alongside visual and audio stimuli. Juxtaposition was used to embed the VR installation within the surrounding gallery space at each host museum, dealing with the challenges of entering, exiting, spectating, and invigilating the experience. We propose that museum designers can use these techniques to deliver VR installations that are compelling but also scalable and tourable.

References

[1]

Laurent Aguerreche, Thierry Duval, and Anatole Lécuyer. 2010. Reconfigurable tangible devices for 3D virtual object manipulation by single or multiple users. In Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology (VRST’10). 227--230.

Digital Library

[2]

Eli Anapur. 2017. Mat Collishaw's thresholds explore photography through VR at Somerset House. WideWalls. Retrieved from http://www.widewalls.ch/mat-collishaw-thresholds-somerset-house/.

[3]

Brian Appleyard. 2017. Virtually brilliant: Once a gritty YBA, Mat Collishaw is now one of our best grown-up artists. And his new VR show is genius. The Sunday Times (London), 10--11. Retrieved on May 4th 2020 from https://www.thetimes.co.uk/article/mat-collishaw-thresholds-somerset-house-bryan-appleyard-rmh09rh2f.

[4]

Mafkereseb Bekele, Roberto Pierdicca, Emanuele Frontoni, Eva Malinverni, and James Gain. 2018. A survey of augmented, virtual, and mixed reality for cultural heritage. J. Comput. Cult. Herit. 11, 1--36.

Digital Library

[5]

Steve Benford, Chris Greenhalgh, Andy Crabtree, Martin Flintham, Brendan Walker, Joe Marshall, Boriana Koleva, Stefan Rennick Egglestone, Gabriella Giannachi, Matt Adams, Nick Tandavanitj, and Ju Row Farr. 2013. Performance-led research in the wild. ACM Trans. Comput.-Hum. Interact. 20, 3 14, 1--14:22.

Digital Library

[6]

Barry Brown, Ian MacColl, Matthew Chalmers, Areti Galani, Cliff Randell, and Anthony Steed. 2003. Lessons from the lighthouse: Collaboration in a shared mixed reality system. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’03). 577--584.

Digital Library

[7]

Lung-Pan Cheng, Li Chang, Sebastian Marwecki, and Patrick Baudisch. 2018. Iturk: Turning passive haptics into active haptics by making users reconfigure props in virtual reality. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI’18). 89, 1--89:10.

[8]

Hannah Ellis-Petersen. 2017. Mat Collishaw restages 1839 photography show in virtual reality; artist says VR will change our outlook as he prepares Somerset House display based on Henry Fox Talbot's seminal exhibition. The Guardian (London), TECHNOLOGY; Version:1. Retrieved on May 4th 2020 from https://www.theguardian.com/technology/2017/apr/14/somerset-house-mat-collishaw-restages-1839-photography-show-in-virtual-reality.

[9]

S. J. Eve. 2014. Dead men's eyes: Embodied GIS, mixed reality and landscape archaeology. UCL (University College London). British Archaeological Reports Oxford Ltd.

[10]

Gerhard Fischer and Bernhard Greiner. 2007. The Play within the Play: The Performance of Meta-theatre and Self-Reflection. Rodopi.

[11]

Daniel Fitzgerald and Hiroshi Ishii. 2018. Mediate: A spatial tangible interface for mixed reality. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHIEA’18). LBW625:1--LBW625:6.

Digital Library

[12]

Bernard Frischer, Dean Abernathy, Gabriele Guidi, Joel Myers, Cassie Thibodeau, Antonio Salvemini, Pascal Müller, Peter Hofstee, and Barry Minor. 2008. Rome reborn. In Proceedings of the ACM SIGGRAPH New Tech Demos (SIGGRAPH’08). 34, 1--34:1.

Digital Library

[13]

A. Gaucci, S. Garagnani, and A. M. Manferdini. 2015. Reconstructing the lost reality archaeological analysis and transmedial technologies for a perspective of virtual reality in the Etruscan city of Kainua. In Proceedings of the Digital Heritage Conference. 227--234.

[14]

William Gaver. 2012. What should we expect from research through design? In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12). 937--946.

Digital Library

[15]

C. F. Giloth and J. Tanant. 2015. User experiences in three approaches to a visit to a 3D Labyrinthe of Versailles. In Proceedings of the Digital Heritage Conference. 403--404.

[16]

Google. 2017. Tango. Retrieved from: https://get.google.com/tango/

[17]

Lilian de Greef, Meredith Morris, and Kori Inkpen. 2016. TeleTourist: Immersive telepresence tourism for mobility-restricted participants. In Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion (CSCW’16 Companion). 273--276.

Digital Library

[18]

H. G. Hoffman. 1998. Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments. In Proceedings of the IEEE Virtual Reality International Symposium (Cat. No.98CB36180). 59--63.

Digital Library

[19]

Brent Edward Insko. 2001. Passive Haptics Significantly Enhances Virtual Environments. PhD dissertation. The University of North Carolina at Chapel Hill.

[20]

Phisan Kaewprapha, Nattakan Puttarak, and Thaewa Tansarn. 2016. Multi-hop network localization in unit disk graph model under noisy measurement using tree-search algorithm with graph-properties-assist traversing selection. Eng. App. Sci. Res. 43: 114--117.

[21]

Jarrod Knibbe, Jonas Schjerlund, Mathias Petraeus, and Kasper Hornbæk. 2018. The dream is collapsing: The experience of exiting VR. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI’18). 483, 1--483:13.

Digital Library

[22]

Boriana Koleva, Steve Benford, and Chris Greenhalgh. 1999. The properties of mixed reality boundaries. In Proceedings of the European Conference on Computer Supported Cooperative Work (ECSCW’99). Springer, Dordrecht, 119--137.

Digital Library

[23]

Boriana Koleva, Holger Schnädelbach, Steve Benford, and Chris Greenhalgh. 2000. Developing mixed reality boundaries. In Proceedings of the Conference on Designing Augmented Reality Environments (DARE’00). 155--156.

Digital Library

[24]

G. Lepouras, A. Katifori, C. Vassilakis, and D. Charitos. 2004. Real exhibitions in a virtual museum. Virt. Real. 7, 2 120--128.

Digital Library

[25]

Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1995. Augmented reality: A class of displays on the reality-virtuality continuum. In Proceedings of the Telemanipulator and Telepresence Technologies Conference. 282--293.

[26]

T. Miyashita, P. Meier, T. Tachikawa, S. Orlic, T. Eble, V. Scholz, A. Gapel, O. Gerl, S. Arnaudov, and S. Lieberknecht. 2008. An augmented reality museum guide. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality. 103--106.

[27]

Stuart Reeves, Mike Fraser, Holger Schnadelbach, Claire O'Malley, and Steve Benford. 2005. Engaging augmented reality in public places. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 11.

[28]

Maria V. Sanchez-Vives and Mel Slater. 2005. From presence to consciousness through virtual reality. Nat. Rev. Neurosci. 6, 332.

[29]

Larry J. Schaaf. Perception of Realities, No. 1. Retrieved from http://foxtalbot.bodleian.ox.ac.uk/2017/05/19/perception-of-realities-no-1/.

[30]

Holger Schnädelbach, Boriana Koleva, Martin Flintham, Mike Fraser, Shahram Izadi, Paul Chandler, Malcolm Foster, Steve Benford, Chris Greenhalgh, and Tom Rodden. 2002. The augurscope: A mixed reality interface for outdoors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’02). 9--16.

Digital Library

[31]

Beat Signer and Timothy J. Curtin. 2017. Tangible holograms: Towards mobile physical augmentation of virtual objects. Retrieved from http://arxiv.org/abs/1703.08288.

[32]

Adalberto L. Simeone, Eduardo Velloso, and Hans Gellersen. 2015. Substitutional reality: Using the physical environment to design virtual reality experiences. In Proceedings of the 33rd ACM Conference on Human Factors in Computing Systems (CHI’15). 3307--3316.

Digital Library

[33]

Sky. 2018. Nominations announced for the South Bank Sky Arts awards. Sky Corporate. Retrieved from https://www.skygroup.sky/corporate/media-centre/articles/en-gb/nominations-announced-for-the-south-bank-sky-arts-awards-2018.

[34]

Mel Slater and Martin Usoh. 1993. Representations systems, perceptual position, and presence in immersive virtual environments. Pres.: Teleop. Virt. Environ. 2, 3 221--233.

Digital Library

[35]

Mel Slater, Martin Usoh, and Anthony Steed. 1994. Depth of presence in virtual environments. Pres.: Teleop. Virt. Environ. 3, 2 130--144.

Digital Library

[36]

Hyungki Son, Hyunjae Gil, Sangkyu Byeon, Sang-Youn Kim, and Jin Ryong Kim. 2018. RealWalk: Feeling ground surfaces while walking in virtual reality. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA’18). D400:1--D400:4.

Digital Library

[37]

Julian Stallabrass. 1999. High Art Lite: British Art in the 1990s. Verso.

[38]

A. Steed, J. MacColl, C. Randell, B. Brown, M. Chalmers, and C. Greenhalgh. 2004. Models of space in a mixed-reality system. In Proceedings of the 8th International Conference on Information Visualisation. 768--777.

[39]

Richard Stoakley, Matthew J. Conway, and Randy Pausch. 1995. Virtual reality on a WIM: Interactive worlds in miniature. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’95). 265--272.

Digital Library

[40]

Stella Sylaiou, Katerina Mania, Athanasis Karoulis, and Martin White. 2010. Exploring the relationship between presence and enjoyment in a virtual museum. Int. J. Hum.-Comput. Stud. 68, 5 243--253.

Digital Library

[41]

Laurie Taylor. It's a Kind of Magic. Retrieved from https://frieze.com/article/its-kind-magic.

[42]

M. White, N. Mourkoussis, J. Darcy, P. Petridis, F. Liarokapis, P. Lister, K. Walczak, R. Wojciechowski, W. Cellary, J. Chmielewski, M. Stawniak, W. Wiza, M. Patel, J. Stevenson, J. Manley, F. Giorgini, P. Sayd, and F. Gaspard. 2004. ARCO—An architecture for digitization, management, and presentation of virtual exhibitions. In Proceedings of the Computer Graphics International Conference. 622--625.

[43]

William Henry Fox Talbot. 1839. Talbot correspondence project: TALBOT William Henry Fox to HERSCHEL John Frederick William. Retrieved from http://foxtalbot.dmu.ac.uk/letters/transcriptDocnum.php?docnum=3908.

[44]

Gaby Wood. 2017. Somewhere between art and illusion; Virtual reality meets Victorian fakery in Mat Collishaw's eerie new works, finds Gaby Wood. The Daily Telegraph (London), REVIEW; NEWS; 6--7. Retrieved on May 4th 2020 from https://www.telegraph.co.uk/art/artists/really-quite-uncharted-territory-inside-mat-collishaws-creepy/.

[45]

Eric Woods, Mark Billinghurst, Julian Looser, Graham Aldridge, Deidre Brown, Barbara Garrie, and Claudia Nelles. 2004. Augmenting the science centre and museum experience. In Proceedings of the 2nd International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia (GRAPHITE’04). 230--236.

Digital Library

[46]

A. Zenner and A. Krüger. 2017. Shifty: A weight-shifting dynamic passive haptic proxy to enhance object perception in virtual reality. IEEE Trans. Vis. Comput. Graph. 23, 4 1285--1294.

Digital Library

[47]

Yiwei Zhao, Lawrence H. Kim, Ye Wang, Mathieu Le Goc, and Sean Follmer. 2017. Robotic assembly of haptic proxy objects for tangible interaction and virtual reality. In Proceedings of the ACM International Conference on Interactive Surfaces and Spaces (ISS’17). 82--91.

Digital Library

[48]

John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research through design as a method for interaction design research in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’07). 493--502.

Digital Library

[49]

National Gallery. Take a virtual tour of the national gallery. Retrieved from https://www.nationalgallery.org.uk/visiting/virtual-tours.

[50]

Louvre Museum. Retrieved from http://www.youvisit.com/tour/louvremuseum.

[51]

Factory-42. Hold the World. Retrieved from https://www.factory42.uk/holdtheworld.

[52]

Nefertari: Journey to Eternity on Steam. Retrieved from: https://store.steampowered.com/app/861400/Nefertari_Journey_to_Eternity/.

[53]

Skin and Bones. Mobile augmented reality app for the National Museum of Natural History's Hall of Bones. Retrieved from https://naturalhistory.si.edu/exhibits/bone-hall/index.cfm.

Cited By

Chernbumroong SAriya PYolthasart SWongwan NIntawong KPuritat K(2024)Comparing the Impact of Non-Gamified and Gamified Virtual Reality in Digital Twin Virtual Museum Environments: A Case Study of Wieng Yong House Museum, ThailandHeritage10.3390/heritage70400897:4(1870-1892)Online publication date: 24-Mar-2024
https://doi.org/10.3390/heritage7040089
Elkhuizen WLove JParisi SKarana E(2024)On the Role of Materials Experience for Novel Interactions with Digital Representations of Historical Pop-up and Movable BooksProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642142(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642142
Paulauskas LPaulauskas ABlažauskas TDamaševičius RMaskeliūnas R(2023)Reconstruction of Industrial and Historical Heritage for Cultural Enrichment Using Virtual and Augmented RealityTechnologies10.3390/technologies1102003611:2(36)Online publication date: 25-Feb-2023
https://doi.org/10.3390/technologies11020036
Show More Cited By

Index Terms

Thresholds: Embedding Virtual Reality in the Museum
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

Being-in-the-Gallery
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

Being-in-the-Gallery is an immersive experience which explores the embodied nature of virtual reality and the implications this has on contemporary sculptural practice and our encounters with both. This interactive artwork is experienced through the HTC ...
Implementation and Experimentation of a Mixed Reality Collaborative Design Space
Computer Supported Cooperative Work in Design IV

During the last decade, the Mixed Reality (MR) concept and supporting technologies emerges to present the real and virtual contents together onto a single display. This paper mainly focuses on three parts: the first part of this paper presents the ...
VR Grabbers: Ungrounded Haptic Retargeting for Precision Grabbing Tools
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

Haptic feedback in VR is important for realistic simulation in virtual reality. However, recreating the haptic experience for hand tools in VR traditionally requires hardware with precise actuators, adding complexity to the system. We propose Ungrounded ...

Comments

Information & Contributors

Information

Published In

cover image Journal on Computing and Cultural Heritage

Journal on Computing and Cultural Heritage Volume 13, Issue 2

June 2020

172 pages

ISSN:1556-4673

EISSN:1556-4711

DOI:10.1145/3403613

Editor:
Franco Niccolucci
VAST-LAB at PIN, University of Florence, Italy

Issue’s Table of Contents

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 May 2020

Accepted: 01 October 2019

Revised: 01 September 2019

Received: 01 February 2019

Published in JOCCH Volume 13, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
1,704
Total Downloads

Downloads (Last 12 months)351
Downloads (Last 6 weeks)21

Reflects downloads up to 26 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chernbumroong SAriya PYolthasart SWongwan NIntawong KPuritat K(2024)Comparing the Impact of Non-Gamified and Gamified Virtual Reality in Digital Twin Virtual Museum Environments: A Case Study of Wieng Yong House Museum, ThailandHeritage10.3390/heritage70400897:4(1870-1892)Online publication date: 24-Mar-2024
https://doi.org/10.3390/heritage7040089
Elkhuizen WLove JParisi SKarana E(2024)On the Role of Materials Experience for Novel Interactions with Digital Representations of Historical Pop-up and Movable BooksProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642142(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642142
Paulauskas LPaulauskas ABlažauskas TDamaševičius RMaskeliūnas R(2023)Reconstruction of Industrial and Historical Heritage for Cultural Enrichment Using Virtual and Augmented RealityTechnologies10.3390/technologies1102003611:2(36)Online publication date: 25-Feb-2023
https://doi.org/10.3390/technologies11020036
Steed AArcher DIzzouzi LNuman NShapiro KSwapp DLammiman DLindeman R(2023)Immersive competence and immersive literacy: Exploring how users learn about immersive experiencesFrontiers in Virtual Reality10.3389/frvir.2023.11292424Online publication date: 23-Mar-2023
https://doi.org/10.3389/frvir.2023.1129242
Paszkiewicz ASalach MWydrzyński DWoźniak JBudzik GBolanowski MGanzha MPaprzycki MCierpicki N(2023)Use of virtual reality to facilitate engineer training in the aerospace industryMachine Graphics and Vision10.22630/MGV.2023.32.2.232:2(19-44)Online publication date: 6-Nov-2023
https://doi.org/10.22630/MGV.2023.32.2.2
Harley D(2023)Virtual narratives, physical bodies: Designing diegetic sensory experiences for virtual realityConvergence: The International Journal of Research into New Media Technologies10.1177/13548565231178915(135485652311789)Online publication date: 31-May-2023
https://doi.org/10.1177/13548565231178915
Cameron HSpors V(2023)The Museum is Dreaming: Re-Imagining the Museum through Feminist Values and Data Practices in Design FictionProceedings of the 26th International Academic Mindtrek Conference10.1145/3616961.3616984(182-194)Online publication date: 3-Oct-2023
https://dl.acm.org/doi/10.1145/3616961.3616984
Li YCh’ng ECobb S(2023)Factors Influencing Engagement in Hybrid Virtual and Augmented RealityACM Transactions on Computer-Human Interaction10.1145/358995230:4(1-27)Online publication date: 30-Mar-2023
https://dl.acm.org/doi/10.1145/3589952
Sivertsen CSmith Mvan der Zwan S(2023)Art Critique by Other MeansProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596069(343-352)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596069
Wolf SWeber MHurtienne J(2023)Virtual Tourism, Real Experience: A Motive-Oriented Approach to Virtual TourismExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585594(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585594
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents