research-article

BrainX³: embodied exploration of neural data

Authors:

Paul F. M. J. VerschureAuthors Info & Claims

VRIC '14: Proceedings of the 2014 Virtual Reality International Conference

Article No.: 37, Pages 1 - 4

https://doi.org/10.1145/2617841.2620726

Published: 09 April 2014 Publication History

Get Access

Abstract

We present BrainX³ as a novel immersive and interactive technology for exploration of large biological data, which in this paper is customized towards brain networks. Unlike traditional machine-inference systems, BrainX³ posits a two-way coupling of human intuition to powerful machine computation to tackle the big data challenge.

Furthermore, through unobtrusive wearable sensors, BrainX³ can infer user's states in terms of arousal and cognitive workload, thus changing the visualization and the sonification parameters to boost the exploration process.

References

[1]

J. Beatty and B. Lucero-Wagoner. Pupillary System. In J. T. Cacioppo, L. Tassinary, and G. Berntson, editors, Handbook of Psychophysiology, chapter 6, pages 142--162. Cambridge University Press, New York, NY, USA, 2nd edition, 2000.

Google Scholar

[2]

U. Bernardet, A. Väljamäe, M. Inderbitzin, S. Wierenga, A. Mura, and P. F. M. J. Verschure. Quantifying human subjective experience and social interaction using the eXperience Induction Machine. Brain research bulletin, 85:305--312, Nov. 2010.

Google Scholar

[3]

A. Betella, R. Carvalho, J. Sanchez-palencia, U. Bernardet, and P. F. M. J. Verschure. Embodied Interaction with Complex Neuronal Data in Mixed-Reality. In Virtual Reality International Conference (VRIC 2012), 2012.

Digital Library

Google Scholar

[4]

A. Betella, E. Martínez, R. Zucca, X. D. Arsiwalla, P. Omedas, S. Wierenga, A. Mura, J. Wagner, F. Lingenfelser, E. André, D. Mazzei, A. Tognetti, A. Lanatà, D. De Rossi, and P. F. M. J. Verschure. Advanced interfaces to stem the data deluge in mixed reality: placing human (un)consciousness in the loop. In ACM SIGGRAPH 2013 Posters, SIGGRAPH '13, pages 68:1---_68:1, New York, NY, USA, 2013. ACM.

Digital Library

Google Scholar

[5]

A. Betella, D. Pacheco, R. Zucca, X. D. Arsiwalla, P. Omedas, A. Lanatà, D. Mazzei, A. Tognetti, A. Greco, N. Carbonaro, J. Wagner, F. Lingenfelser, E. André, D. De Rossi, and P. F. M. J. Verschure. Interpreting Psychophysiological States Using Unobtrusive Wearable Sensors in Virtual Reality. In ACHI2014: The Seventh International Conference on Advances in Computer-Human Interactions, pages 331--336, Barcelona, Spain, 2014.

Google Scholar

[6]

R. Cetnarski, A. Betella, H. Prins, S. Koudier, and P. F. M. J. Verschure. Subliminal Response Priming in mixed reality: The ecological validity of a classic paradigm of perception. Presence: Teleoperators and Virtual Environments, In Press.

Digital Library

Google Scholar

[7]

P. Hagmann, L. Cammoun, X. Gigandet, R. Meuli, C. J. Honey, V. J. Wedeen, and O. Sporns. Mapping the Structural Core of Human Cerebral Cortex. PLoS Biology, 6(7):15, 2008.

Google Scholar

[8]

D. A. Keim. Information visualization and visual data mining. Visualization and Computer Graphics, IEEE Transactions on, 8(1):1--8, 2002.

Digital Library

Google Scholar

[9]

S. Lee, J. Seo, G. J. Kim, and C. mo Park. Evaluation of pointing techniques for ray casting selection in virtual environments. In Third International Conference on Virtual Reality and Its Application in Industry, pages 38--44, 2003.

Crossref

Google Scholar

[10]

P. Papachristodoulou, A. Betella, and P. F. M. J. Verschure. Sonification of Large Datasets in a 3D Immersive Environment: A Neuroscience Case Study. In ACHI2014: The Seventh International Conference on Advances in Computer-Human Interactions, pages 35--40, Barcelona, Spain, 2014.

Google Scholar

[11]

P. Stein, M. Bosner, R. Kleiger, and B. Conger. Heart rate variability: a measure of cardiac autonomic tone. American Heart Journal, 127(5):1376--1381, 1994.

Crossref

Google Scholar

[12]

P. F. M. J. Verschure. Distributed Adaptive Control: A theory of the Mind, Brain, Body Nexus. Biologically Inspired Cognitive Architectures, 1:55--72, July 2012.

Crossref

Google Scholar

[13]

J. Wagner, F. Lingenfelser, T. Baur, I. Damian, F. Kistler, and E. André. The Social Signal Interpretation (SSI) Framework Multimodal Signal Processing and Recognition in Real-Time. In Proceedings of the 21st ACM International Conference on Multimedia, pages 21--25, 2013.

Digital Library

Google Scholar

[14]

K. Wolf. What I grasp is what I control: interacting through grasp releases. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction, TEI '12, pages 389--390, New York, NY, USA, 2012. ACM.

Digital Library

Google Scholar

Cited By

View all

Sharma VVilarrubias RVerschure P(2023)BrainX3: A Neuroinformatic Tool for Interactive Exploration of Multimodal Brain DatasetsBiomimetic and Biohybrid Systems10.1007/978-3-031-39504-8_11(157-177)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-39504-8_11
López-Carral HBlancas-Muñoz MMura AOmedas PEspaña-Cumellas ÀMartínez-Bueno EMilliken NMoore PHaque LGilroy SVerschure P(2021)A Virtual Reality System for the Simulation of NeurodiversityProceedings of Sixth International Congress on Information and Communication Technology10.1007/978-981-16-2380-6_46(523-531)Online publication date: 17-Sep-2021
https://doi.org/10.1007/978-981-16-2380-6_46
Keiriz JZhan LAjilore OLeow AForbes A(2018)NeuroCave: A web-based immersive visualization platform for exploring connectome datasetsNetwork Neuroscience10.1162/netn_a_000442:3(344-361)Online publication date: Sep-2018
https://doi.org/10.1162/netn_a_00044
Show More Cited By

Index Terms

BrainX³: embodied exploration of neural data

Recommendations

Embodied interaction with complex neuronal data in mixed-reality
VRIC '12: Proceedings of the 2012 Virtual Reality International Conference

The study of natural and artificial phenomena generates massive amounts of data in many areas of research. This data is frequently left unused due to the lack of tools to effectively extract, analyze and understand it. Visual representation techniques ...
Journalism in virtual reality: opportunities and future research challenges
AcademicMindtrek '16: Proceedings of the 20th International Academic Mindtrek Conference

This paper presents a state-of-the-art overview of journalism and its opportunities and challenges in virtual reality (VR). First, we examine what kind of real-life journalistic experiments have been made in this field thus far, and then we analyze the ...
I'm Sensing in the Rain: Spatial Incongruity in Visual-Tactile Mid-Air Stimulation Can Elicit Ownership in VR Users
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Major virtual reality (VR) companies are trying to enhance the sense of immersion in virtual environments by implementing haptic feedback in their systems (e.g., Oculus Touch). It is known that tactile stimulation adds realism to a virtual environment. ...

Comments

Information & Contributors

Information

Published In

VRIC '14: Proceedings of the 2014 Virtual Reality International Conference

April 2014

193 pages

ISBN:9781450326261

DOI:10.1145/2617841

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

VRIC '14

Sponsor:

Laval Virtual

VRIC '14: Virtual Reality International Conference - Laval Virtual 2014

April 9 - 11, 2014

Laval, France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
236
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)1

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Sharma VVilarrubias RVerschure P(2023)BrainX3: A Neuroinformatic Tool for Interactive Exploration of Multimodal Brain DatasetsBiomimetic and Biohybrid Systems10.1007/978-3-031-39504-8_11(157-177)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-39504-8_11
López-Carral HBlancas-Muñoz MMura AOmedas PEspaña-Cumellas ÀMartínez-Bueno EMilliken NMoore PHaque LGilroy SVerschure P(2021)A Virtual Reality System for the Simulation of NeurodiversityProceedings of Sixth International Congress on Information and Communication Technology10.1007/978-981-16-2380-6_46(523-531)Online publication date: 17-Sep-2021
https://doi.org/10.1007/978-981-16-2380-6_46
Keiriz JZhan LAjilore OLeow AForbes A(2018)NeuroCave: A web-based immersive visualization platform for exploring connectome datasetsNetwork Neuroscience10.1162/netn_a_000442:3(344-361)Online publication date: Sep-2018
https://doi.org/10.1162/netn_a_00044
Arsiwalla XPacheco DPrincipe ARocamora RVerschure P(2018)A Temporal Estimate of Integrated Information for Intracranial Functional ConnectivityArtificial Neural Networks and Machine Learning – ICANN 201810.1007/978-3-030-01421-6_39(403-412)Online publication date: 26-Sep-2018
https://doi.org/10.1007/978-3-030-01421-6_39
Arsiwalla XVerschure P(2017)Why the Brain Might Operate Near the Edge of CriticalityArtificial Neural Networks and Machine Learning – ICANN 201710.1007/978-3-319-68600-4_38(326-333)Online publication date: 24-Oct-2017
https://doi.org/10.1007/978-3-319-68600-4_38
Arsiwalla XVerschure P(2016)The global dynamical complexity of the human brain networkApplied Network Science10.1007/s41109-016-0018-81:1Online publication date: 30-Dec-2016
https://doi.org/10.1007/s41109-016-0018-8
Arsiwalla XVerschure P(2016)High Integrated Information in Complex Networks Near CriticalityArtificial Neural Networks and Machine Learning – ICANN 201610.1007/978-3-319-44778-0_22(184-191)Online publication date: 13-Aug-2016
https://doi.org/10.1007/978-3-319-44778-0_22
Arsiwalla XVerschure P(2016)Computing Information Integration in Brain NetworksProceedings of the 12th International Conference and School on Advances in Network Science - Volume 956410.1007/978-3-319-28361-6_11(136-146)Online publication date: 11-Jan-2016
https://dl.acm.org/doi/10.1007/978-3-319-28361-6_11
Papachristodoulou PBetella AManzolli J(2015)Augmenting the navigation of complex data sets using sonificationProceedings of the 2015 IEEE 2nd VR Workshop on Sonic Interactions for Virtual Environments (SIVE)10.1109/SIVE.2015.7361284(1-6)Online publication date: 24-Mar-2015
https://dl.acm.org/doi/10.1109/SIVE.2015.7361284
Arsiwalla XDalmazzo DZucca RBetella ABrandi SMartinez EOmedas PVerschure P(2015)Connectomics to Semantomics: Addressing the Brain's Big Data Challenge1Procedia Computer Science10.1016/j.procs.2015.07.27853(48-55)Online publication date: 2015
https://doi.org/10.1016/j.procs.2015.07.278
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Cited By

Index Terms

Recommendations

Embodied interaction with complex neuronal data in mixed-reality

Journalism in virtual reality: opportunities and future research challenges

I'm Sensing in the Rain: Spatial Incongruity in Visual-Tactile Mid-Air Stimulation Can Elicit Ownership in VR Users

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Embodied interaction with complex neuronal data in mixed-reality

Journalism in virtual reality: opportunities and future research challenges

I'm Sensing in the Rain: Spatial Incongruity in Visual-Tactile Mid-Air Stimulation Can Elicit Ownership in VR Users

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations