Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Breaking the Curse of Visual Analytics: Accommodating Virtual Reality in the Visualization Pipeline

  • Conference paper
  • First Online:
Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2019)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1182))

  • 899 Accesses

Abstract

Previous research has exposed the discrepancy between the subject of analysis (real world) and the actual data on which the analysis is performed (data world) as a critical weak spot in visual analysis pipelines. In this paper, we demonstrate how Virtual Reality (VR) can help to verify the correspondence of both worlds in the context of Information Visualization (InfoVis) and Visual Analytics (VA). Immersion allows the analyst to dive into the data world and collate it to familiar real-world scenarios. If the data world lacks crucial dimensions, then these are also missing in created virtual environments, which may draw the analyst’s attention to inconsistencies between the database and the subject of analysis. When situating VR in a generic visualization pipeline, we can confirm its basic equality compared to other mediums as well as possible benefits. To overcome the guarded stance of VR in InfoVis and VA, we present a structured analysis of arguments, exhibiting the circumstances that make VR a viable medium for visualizations. As a further contribution, we discuss how VR can aid in minimizing the gap between the data world and the real world and present a use case that demonstrates two solution approaches. Finally, we report on initial expert feedback attesting the applicability of our approach in a real-world scenario for crime scene investigation.

This work has received funding from the European Unions Horizon 2020 research and innovation programme under grant agreement No 740754 and from the project FLORIDA (project number 13N14253) by the German Federal Ministry of Education and Research (BMBF, Germany) and the Austrian Security Research Programme KIRAS owned by the Austrian Federal Ministry for Transport, Innovation and Technology (BMVIT).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Arms, L., Cook, D., Cruz-Neira, C.: The benefits of statistical visualization in an immersive environment. In: 1999 Proceedings of the IEEE Virtual Reality, pp. 88–95. IEEE (2003). https://doi.org/10.1109/vr.1999.756938

  2. Bach, B., Sicat, R., Beyer, J., Cordeil, M., Pfister, H.: The hologram in my hand: how effective is interactive exploration of 3D visualizations in immersive tangible augmented reality? IEEE Trans. Visual Comput. Graphics 24(1), 457–467 (2018). https://doi.org/10.1109/TVCG.2017.2745941

    Article  Google Scholar 

  3. Benford, S., et al.: Coping with uncertainty in a location-based game. IEEE Pervasive Comput. 2(3), 34–41 (2003)

    Article  Google Scholar 

  4. Benford, S., Bowers, J., Fahlén, L.E., Greenhalgh, C., Snowdon, D.: User embodiment in collaborative virtual environments. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1995, Denver, Colorado, USA, 7–11 May 1995. pp. 242–249 (1995). https://doi.org/10.1145/223904.223935

  5. Bidarra, R., Gambon, D., Kooij, R., Nagel, D., Schutjes, M., Tziouvara, I.: Gaming at the dentist’s – serious game design for pain and discomfort distraction. In: Schouten, B., Fedtke, S., Bekker, T., Schijven, M., Gekker, A. (eds.) Games for Health, pp. 207–215. Springer, Wiesbaden (2013). https://doi.org/10.1007/978-3-658-02897-8_16

    Chapter  Google Scholar 

  6. Bliss, J.P., Tidwell, P.D.: The effectiveness of virtual reality for administering spatial navigation training to police officers. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 39, no. 14, p. 936 (2012). https://doi.org/10.1177/154193129503901412

    Article  Google Scholar 

  7. BMBF: FLORIDA - Flexibles, teilautomatisiertes Analysesystem zur Auswertung von Videomassendaten. http://www.florida-project.de/. Accessed 14 July 2019

  8. Buchmuller, J., Cakmak, E., Keim, D.A., Jackle, D., Brandes, U.: MotionRugs: visualizing collective trends in space and time. IEEE Trans. Visual Comput. Graphics 25(1), 76–86 (2018). https://doi.org/10.1109/tvcg.2018.2865049

    Article  Google Scholar 

  9. Cánovas, R., León, I., Roldán, M.D., Astur, R., Cimadevilla, J.M.: Virtual reality tasks disclose spatial memory alterations in fibromyalgia. Rheumatology (Oxford, England) 48(10), 1273–1278 (2009). https://doi.org/10.1093/rheumatology/kep218

    Article  Google Scholar 

  10. Card, S.K., Mackinlay, J.D., Shneiderman, B.: Readings in Information Visualization: Using Vision to Think (Interactive Technologies). Morgan Kaufmann Publishers Inc., San Francisco (1999). https://doi.org/10.1234/12345678

    Book  Google Scholar 

  11. Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: a survey. AMC Comput. Surv. (CSUR) 41(3), 15 (2009). https://doi.org/10.1145/1541880.1541882

    Article  Google Scholar 

  12. Chen, M., Gaither, K., John, N.W., McCann, B.: Cost-benefit analysis of visualization in virtual environments. IEEE Trans. Visual Comput. Graphics 25(1), 32–42 (2018). http://arxiv.org/abs/1802.09012

  13. Chen, M., Golan, A.: What may visualization processes optimize? IEEE Trans. Visual Comput. Graphics 22(12), 2619–2632 (2016). https://doi.org/10.1109/TVCG.2015.2513410

    Article  Google Scholar 

  14. Chi, E.H.: A taxonomy of visualization techniques using the data state reference model. In: IEEE Symposium on Information Visualization 2000 (INFOVIS 2000), Salt Lake City, Utah, USA, 9–10 October 2000, pp. 69–75 (2000). https://doi.org/10.1109/INFVIS.2000.885092

  15. Cockburn, A., McKenzie, B.: Evaluating the effectiveness of spatial memory in 2D and 3D physical and virtual environments. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Changing our World, Changing Ourselves - CHI 2002, p. 203 (2002). https://doi.org/10.1145/503376.503413

  16. Cruz-Neira, C., Sandin, D.J., DeFanti, T.A.: Surround-screen projection-based virtual reality: the design and implementation of the CAVE. In: The Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 1993), pp. 135–142. ACM (1993). https://doi.org/10.1145/166117.166134

  17. Cummings, J.J., Bailenson, J.N., Fidler, M.J.: How immersive is enough? A foundation for a meta-analysis of the effect of immersive technology on measured presence. In: Proceedings of the International Society for Presence Research Conference, vol. 19, no. 2, pp. 272–309 (2012). https://doi.org/10.1080/15213269.2015.1015740

    Article  Google Scholar 

  18. Bowman, D.A., McMahan, R.P.: Virtual reality: how much immersion is enough? Computer 40(7), 36–43 (2007). https://doi.org/10.1109/MC.2007.257

    Article  Google Scholar 

  19. De Smith, M.J., Goodchild, M.F., Longley, P.: Geospatial Analysis: A Comprehensive Guide to Principles, Techniques, and Software Tools. Troubador Publishing Ltd., Leicester City (2007). https://doi.org/10.1111/j.1467-9671.2008.01122.x

    Book  Google Scholar 

  20. Dictionary: Reality: Dictionary. http://www.dictionary.com/browse/reality. Accessed 14 July 2019

  21. Dictionary: Virtual: Dictionary. http://www.dictionary.com/browse/virtual. Accessed 14 July 2019

  22. Dasgupta, D., Forrest, S.: Novelty detection in time series data using ideas from immunology. In: Proceedings of the International Conference on Intelligent Systems, pp. 82–87 (1996). http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.50.9949d

  23. Djorgovski, S.G., Donalek, C., Lombeyda, S., Davidoff, S., Amori, M.: Immersive and collaborative data visualization and analytics using virtual reality. In: American Geophysical Union, Fall Meeting 2018, pp. 609–614 (2018). https://doi.org/10.1109/BigData.2014.7004282

  24. Dos Santos, S., Brodlie, K.: Gaining understanding of multivariate and multidimensional data through visualization. Comput. Graph. (Pergamon) 28(3), 311–325 (2004). https://doi.org/10.1016/j.cag.2004.03.013

    Article  Google Scholar 

  25. Dünser, A., Steinbügl, K., Kaufmann, H., Glück, J.: Virtual and augmented reality as spatial ability training tools. In: Proceedings of the ACM SIGCHI New Zealand Chapter’s International Conference on Computer-Human Interaction Design Centered HCI - CHINZ 2006, pp. 125–132. ACM (2006). https://doi.org/10.1145/1152760.1152776

  26. Ellis, S.R.: What are virtual twins? IEEE Comput. Graphics Appl. 14(1), 17–22 (1994). https://www.wisegeek.com/what-are-virtual-twins.htm#didyouknowout

    Article  Google Scholar 

  27. Erra, U., Malandrino, D., Pepe, L.: Virtual reality interfaces for interacting with three-dimensional graphs. Int. J. Hum. Comput. Interact. 35(1), 75–88 (2019). https://doi.org/10.1080/10447318.2018.1429061

    Article  Google Scholar 

  28. EU: VICTORIA - Video Analysis for Investigation of Criminal and Terrorist Activities. https://www.victoria-project.eu/. Accessed 14 July 2019

  29. Filho, J.A.W., Dal, C., Freitas, S., Rey, M.F., Freitas, C.M.D.S.: Immersive visualization of abstract information: an evaluation on dimensionally-reduced data scatterplots automatic construction of large readability corpora view project blind guardian view project immersive visualization of abstract information: an evaluation In: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 483–490 (2018). https://doi.org/10.1109/VR.2018.8447558

  30. Fluke, C.J., Barnes, D.G.: The ultimate display. Multimedia: from Wagner to virtual reality, pp. 506–508 (2016). https://arxiv.org/abs/1601.03459

  31. Gershon, N.D.: Visualization of an imperfect world. IEEE Comput. Graphics Appl. 18(4), 43–45 (1998). https://doi.org/10.1109/38.689662

    Article  Google Scholar 

  32. Google: Google VR Cardboard. https://www.google.com/get/cardboard. Accessed 14 July 2019

  33. Gruchalla, K.: Immersive well-path editing: investigating the added value of immersion. In: IEEE Virtual Reality Conference 2004, pp. 157–164 (2004). https://doi.org/10.1109/VR.2004.42

  34. Gutiérrez, F., et al.: The impact of the degree of immersion upon learning performance in virtual reality simulations for medical education. J. Invest. Med. 55, S91 (2007). https://doi.org/10.1097/00042871-200701010-00099

    Article  Google Scholar 

  35. Haber, R.B., Mcnabb, D.A.: Visualization ldioms: a conceptual model for scientific visualization systems. Vis. Sci. Comput. 74, 93 (1990)

    Google Scholar 

  36. Hodge, V., Austin, J.: A survey of outlier detection methodologies. Artif. Intell. Rev. 22(2), 85–126 (2004). https://doi.org/10.1007/s10462-004-4304-y

    Article  MATH  Google Scholar 

  37. He, L., Guayaquil-Sosa, A., Mcgraw, T.: Medical image atlas interaction in virtual reality. In: Proceedings of Immersive Analytics Workshop at VIS (2017)

    Google Scholar 

  38. HTC: Vive Controller. https://vive.com/eu/accessory/controller/. Accessed 14 July 2019

  39. Huang, B., Jiang, B., Li, H.: An integration of GIS, virtual reality and the Internet for visualization, analysis and exploration of spatial data. Int. J. Geogr. Inf. Sci. 15(5), 439–456 (2001). https://doi.org/10.1080/13658810110046574

    Article  Google Scholar 

  40. Ijsselsteijn, W., Riva, G.: Being there: the experience of presence in mediated environments, p. 14. In: Emerging Communication: Studies on New Technologies and Practices in Communication. IOS Press, Netherlands (2003). citeulike-article-id: 4444927

    Google Scholar 

  41. Kim, W.S.: Computer vision assisted virtual reality calibration. IEEE Trans. Robot. Autom. 15(3), 450–464 (1999)

    Article  Google Scholar 

  42. Kraus, M., Weiler, N., Breitkreutz, T., Keim, D., Stein, M.: Breaking the curse of visual data exploration: improving analyses by building bridges between data world and real world. In: Proceedings of the International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3, IVAPP, pp. 19–27. INSTICC, SciTePress (2019). https://doi.org/10.5220/0007257400190027

  43. Krokos, E., Plaisant, C., Varshney, A.: Virtual memory palaces: immersion aids recall. Virtual Reality 23(1) (2019). https://doi.org/10.1007/s10055-018-0346-3

    Article  Google Scholar 

  44. Laha, B., Sensharma, K., Schiffbauer, J.D., Bowman, D.A.: Effects of immersion on visual analysis of volume data. IEEE Trans. Visual Comput. Graphics 18(4), 597–606 (2012). https://doi.org/10.1109/TVCG.2012.42

    Article  Google Scholar 

  45. Latta, J.N., Oberg, D.J.: A conceptual virtual reality model. IEEE Comput. Graphics Appl. 14(1), 23–29 (1994). https://doi.org/10.1109/38.250915

    Article  Google Scholar 

  46. Logitech: Logitech Bridge. https://github.com/Logitech/logi_bridge_sdk. Accessed 14 July 2019

  47. MacEachren, A.M., et al.: Visualizing geospatial information uncertainty: what we know and what we need to know. Cartogr. Geogr. Inf. Sci. 32(3), 139–160 (2005). https://doi.org/10.1559/1523040054738936

    Article  Google Scholar 

  48. Madole, D., Begault, D.: 3-D Sound for Virtual Reality and Multimedia, vol. 19. Academic Press Professional Inc., San Diego (1995). https://doi.org/10.2307/3680997

    Book  Google Scholar 

  49. McGloin, R., Farrar, K., Krcmar, M.: Video games, immersion, and cognitive aggression: does the controller matter? Media Psychol. 16(1), 65–87 (2013). https://doi.org/10.1080/15213269.2012.752428

    Article  Google Scholar 

  50. Merino, L., et al.: On the impact of the medium in the effectiveness of 3D software visualizations. In: Proceedings of the 2017 IEEE Working Conference on Software Visualization, October, vol. 2017, pp. 11–21. IEEE (2017). https://doi.org/10.1109/VISSOFT.2017.17

  51. Niehorster, D.C., Li, L., Lappe, M.: The accuracy and precision of position and orientation tracking in the HTC vive virtual reality system for scientific research. i-Perception 8(3), 2041669517708205 (2017)

    Google Scholar 

  52. Pollok, T.: A new multi-camera dataset with surveillance, mobile and stereo cameras for tracking, situation analysis and crime scene investigation applications. In: Proceedings of the International Conference on Video and Image Processing, pp. 171–175 (2018). https://doi.org/10.1145/3301506.3301542

  53. Porter, J., Anand, T., Johnson, B., Khan, R.M., Sobel, N.: Brain mechanisms for extracting spatial information from smell. Neuron 47(4), 581–592 (2005). https://doi.org/10.1016/j.neuron.2005.06.028

    Article  Google Scholar 

  54. Prabhat, Forsberg, A.S., Katzourin, M., Wharton, K., Slater, M.: A comparative study of desktop, fishtank, and cave systems for the exploration of volume rendered confocal data sets. IEEE Trans. Visual Comput. Graphics 14(3), 551–563 (2008). https://doi.org/10.1109/TVCG.2007.70433

    Article  Google Scholar 

  55. Probst, D., Reymond, J.L.: Exploring DrugBank in virtual reality chemical space. J. Chem. Inf. Model. 58(9), 1731–1735 (2018). https://doi.org/10.1021/acs.jcim.8b00402

    Article  Google Scholar 

  56. Ragan, E.D., Sowndararajan, A., Kopper, R., Bowman, D.A.: The effects of higher levels of immersion on procedure memorization performance and implications for educational virtual environments. Presence Teleoperators Virtual Environ. 19(6), 527–543 (2010). https://doi.org/10.1162/pres_a_00016

    Article  Google Scholar 

  57. Rehm, F., Klawonn, F., Kruse, R.: A novel approach to noise clustering for outlier detection. Soft. Comput. 11(5), 489–494 (2007). https://doi.org/10.1007/s00500-006-0112-4

    Article  Google Scholar 

  58. Simeone, A.L., Velloso, E., Gellersen, H.: Substitutional reality: using the physical environment to design virtual reality experiences. In: Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI, pp. 3307–3316. ACM (2015). https://doi.org/10.1145/2702123.2702389

  59. Skeels, M., Lee, B., Smith, G., Robertson, G.G.: Revealing uncertainty for information visualization. Inf. Vis. 9(1), 70–81 (2010). https://doi.org/10.1057/ivs.2009.1

    Article  Google Scholar 

  60. Slater, M., Wilbur, S.: A framework for immersive virtual environments (FIVE): speculations on the role of presence in virtual environments. Presence Teleoperators Virtual Environ. 6(6), 603–616 (1997). https://doi.org/10.1162/pres.1997.6.6.603

    Article  Google Scholar 

  61. Stein, M., et al.: Director’s cut: analysis and annotation of soccer matches. IEEE Comput. Graphics Appl. 36(5), 50–60 (2016). https://doi.org/10.1109/MCG.2016.102

    Article  Google Scholar 

  62. Steuer, J.: Defining virtual reality: dimensions determining telepresence. J. Commun. 42(4), 73–93 (1992). https://doi.org/10.1111/j.1460-2466.1992.tb00812.x

    Article  Google Scholar 

  63. Strandburg-Peshkin, A., Farine, D.R., Crofoot, M.C., Couzin, I.D.: Habitat and social factors shape individual decisions and emergent group structure during baboon collective movement. Elife 6, e19505 (2017). https://doi.org/10.7554/eLife.19505

    Article  Google Scholar 

  64. Suzuki, K., Wakisaka, S., Fujii, N.: Substitutional reality system: a novel. Sci. Rep. 2, 1–9 (2012). https://doi.org/10.1038/srep00459

    Article  Google Scholar 

  65. UNDP: United Nations Statistical Commission and Economic Commission for Europe glossary of terms on statistical data editing. https://webgate.ec.europa.eu/fpfis/mwikis/essvalidserv/images/3/37/UN_editing_glossary.pdf (2018). Accessed 14 July 2019

  66. Van der Meijden, O.A.J., Schijven, M.P.: The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review. Surg. Endosc. 23(6), 1180–1190 (2009). https://doi.org/10.1007/s00464-008-0298-x

    Article  Google Scholar 

  67. Verbree, E., Maren, G.V., Germs, R., Jansen, F., Kraak, M.J.: Interaction in virtual world views-linking 3D GIS with VR. Int. J. Geogr. Inf. Sci. 13(4), 385–396 (1999). https://doi.org/10.1080/136588199241265

    Article  Google Scholar 

  68. Wagner Filho, J.A., Freitas, C.M., Nedel, L.: VirtualDesk: a comfortable and efficient immersive information visualization approach. Comput. Graphics Forum 37(3), 415–426 (2018). https://doi.org/10.1111/cgf.13430

    Article  Google Scholar 

  69. Walshe, D.G., Lewis, E.J., Kim, S.I., O’Sullivan, K., Wiederhold, B.K.: Exploring the use of computer games and virtual reality in exposure therapy for fear of driving following a motor vehicle accident. CyberPsychol. Behav. 6(3), 329–334 (2003). https://doi.org/10.1089/109493103322011641

    Article  Google Scholar 

  70. van Wijk, J.J.: The value of visualization. In: IEEE Visualization Conference, pp. 79–86 (2005). https://doi.org/10.1109/VISUAL.2005.1532781

  71. Wills, S., Roecker, S.: Statistics for Soil Survey. http://ncss-tech.github.io/stats_for_soil_survey/chapters/9_uncertainty/Uncert_val.html#1_introduction (2017). Accessed 14 July 2019

  72. Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments: a presence questionnaire. Presence Teleoperators Virtual Environ. 7(3), 225–240 (1998). https://doi.org/10.1162/105474698565686

    Article  Google Scholar 

  73. Zhang, S., et al.: An immersive virtual environment for DT-mri volume visualization applications: a case study. In: Proceedings of the Conference on Visualization, 2001, pp. 437–440. IEEE Computer Society (2001). https://doi.org/10.1109/VISUAL.2001.964545

Download references

Author information

Authors and Affiliations

  1. University of Konstanz, Konstanz, Germany

    Matthias Kraus, Matthias Miller, Juri Buchmüller, Manuel Stein, Niklas Weiler, Daniel A. Keim & Mennatallah El-Assady

Authors
  1. Matthias Kraus
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matthias Miller
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Juri Buchmüller
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Manuel Stein
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Niklas Weiler
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Daniel A. Keim
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Mennatallah El-Assady
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Matthias Kraus .

Editor information

Editors and Affiliations

  1. University of Lisbon, Lisbon, Portugal

    Ana Paula Cláudio

  2. University of Rennes 1, Rennes, France

    Kadi Bouatouch

  3. University of Genoa, Genoa, Italy

    Manuela Chessa

  4. Mines ParisTech, Paris, France

    Alexis Paljic

  5. Linnaeus University, Växjö, Sweden

    Andreas Kerren

  6. French Civil Aviation University (ENAC), Toulouse, France

    Christophe Hurter

  7. University Jean Monnet, Saint-Etienne, France

    Alain Tremeau

  8. University of Catania, Catania, Italy

    Giovanni Maria Farinella

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kraus, M. et al. (2020). Breaking the Curse of Visual Analytics: Accommodating Virtual Reality in the Visualization Pipeline. In: Cláudio, A., et al. Computer Vision, Imaging and Computer Graphics Theory and Applications. VISIGRAPP 2019. Communications in Computer and Information Science, vol 1182. Springer, Cham. https://doi.org/10.1007/978-3-030-41590-7_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-41590-7_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-41589-1

  • Online ISBN: 978-3-030-41590-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation