Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Advertisement

Development of a model for explaining the learning outcomes when using 3D virtual environments in informal learning settings

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

The study presents the development and testing of a model for explaining the learning outcomes when individuals use 3D virtual environments (VEs) in informal learning settings. For that matter, a VE was developed, presenting the work of a sculptress, namely Nausica Pastra. The following subjective factors were considered so as to build a research model: perceived usefulness, perceived ease of use, motivation, presence, perceived application’s realism, as well as the enjoyment when using VEs. Self-reported data together with the results of tests embedded in the VE were gathered from 612 individuals. Structural Equation Modelling was employed for model testing and parameter estimation. The analyses of the results revealed a good model fit and 53% of the variance in the learning outcomes was explained. Out of the twenty research hypotheses, fifteen were supported. It was found that the most significant factors affecting the learning outcomes were motivation, perceived ease of use, perceived usefulness, and enjoyment. The implications of the findings for experts involved in the development of virtual museums are also discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  • Alexander, E. P., Alexander, M., & Decker, J. (2017). Museums in motion: An introduction to the history and functions of museums. Rowman & Littlefield.

  • Allison, C., Campbell, A., Davies, C. J., Dow, L., Kennedy, S., & McCaffery, J., (2012). Growing the use of virtual worlds in education: An OpenSim perspective. Proceedings of the 2nd European Immersive Education Summit, 1-13. Paris, France.

  • Ampartzaki, M., Kypriotaki, M., Voreadou, C., Dardioti, A., & Stathi, I. (2013). Communities of practice and participatory action research: The formation of a synergy for the development of museum programmes for early childhood. Educational Action Research, 21(1), 4–27. https://doi.org/10.1080/09650792.2013.761920.

    Article  Google Scholar 

  • Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588–606. https://doi.org/10.1037/0033-2909.88.3.588.

    Article  Google Scholar 

  • Bulu, S. T. (2012). Place presence, social presence, co-presence, and satisfaction in virtual worlds. Computers & Education, 58(1), 154–161. https://doi.org/10.1016/j.compedu.2011.08.024.

    Article  Google Scholar 

  • Burnham, K. P., & Anderson, D. R. (1998). Model selection and inference: A practical information-theoretic approach. New York: Springer-Verlag. https://doi.org/10.1007/978-1-4757-2917-7.

    Book  MATH  Google Scholar 

  • Chin, W. W. (1988). Issues and opinion on structural equation modeling. MIS Quarterly, 22, vii–xvi.

    Google Scholar 

  • Chin, W. W., Marcolin, B. L., & Newsted, P. R. (2003). A partial least squares latent variable modeling approach for measuring interaction effects: Results from a Monte Carlo simulation study and an electronic-mail emotion/adoption study. Information Systems Research, 14(2), 189–217. https://doi.org/10.1287/isre.14.2.189.16018.

    Article  Google Scholar 

  • Comrey, A. L., & Lee, H. B. (2013). A first course in factor analysis. Psychology Press.

  • Coombs, P. H., Prosser, C., & Ahmed, M. (1973). New paths to learning for rural children and youth. New York: International Council for Educational Development.

    Google Scholar 

  • Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7), 1–9.

    Google Scholar 

  • Dalgarno, B., & Lee, M. J. W. (2010). What are the learning affordances of 3-D virtual environments? British Journal of Educational Technology, 41(1), 10–32. https://doi.org/10.1111/j.1467-8535.2009.01038.x.

    Article  Google Scholar 

  • Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989). User acceptance of computer technology: A comparison of two theoretical models. Management Science, 35(8), 982–1003. https://doi.org/10.1287/mnsc.35.8.982.

    Article  Google Scholar 

  • DeVellis, R. F. (2003). Scale development: Theory and applications (2nd ed.). Newbury Park, CA: SAGE Publications.

    Google Scholar 

  • Dilli, R., & Dümenci, S. (2015). Effect of museum education on teaching extinct animals lived in anatolia to pre-school children. Eğitim ve Bilim, 40(181), 217–230. https://doi.org/10.15390/EB.2015.4653.

    Google Scholar 

  • Duncan, I., Miller, A., & Jiang, S. (2012). A taxonomy of virtual worlds usage in education. British Journal of Educational Technology, 43(6), 949–964. https://doi.org/10.1111/j.1467-8535.2011.01263.x.

    Article  Google Scholar 

  • Everitt, B. S. (1975). Multivariate analysis: The need for data, and other problems. The British Journal of Psychiatry, 126(3), 237–240. https://doi.org/10.1192/bjp.126.3.237.

    Article  Google Scholar 

  • Faiola, A., Newlon, C., Pfaff, M., & Smyslova, O. (2013). Correlating the effects of flow and telepresence in virtual worlds: Enhancing our understanding of user behavior in game-based learning. Computers in Human Behavior, 29(3), 1113–1121. https://doi.org/10.1016/j.chb.2012.10.003.

    Article  Google Scholar 

  • Fokides, E. (2017). A model for explaining primary school students' learning outcomes when they use multi-user virtual environments. Journal of Computers in Education, 4(3), 225–250. https://doi.org/10.1007/s40692-017-0080-y.

    Article  Google Scholar 

  • Fonseca, D., Valls, F., Redondo, E., & Villagrasa, S. (2016). Informal interactions in 3D education: Citizenship participation and assessment of virtual urban proposals. Computers in Human Behavior, 55, 504–518. https://doi.org/10.1016/j.chb.2015.05.032.

    Article  Google Scholar 

  • Fornell, C., Tellis, G. J., & Zinkhan, G. M. (1982). Validity assessment: A structural equations approach using partial least squares. In B. J. Walker et al. (Eds.), An assessment of marketing thought & practice (pp. 405–409). Chicago: American Marketing Association.

    Google Scholar 

  • Gaskin, J. (2013). SEM series part 5a: Confirmatory factor analysis. Retrieved from https://www.youtube.com/watch?v=MCYmyzRZnIY

  • Gerber, B. L., Marek, E. A., & Cavallo, A. M. L. (2001). Development of an informal learning opportunities assay. International Journal of Science Education, 23(6), 569–583. https://doi.org/10.1080/09500690116959.

    Article  Google Scholar 

  • Hackett, A. (2014). Zigging and zooming all over the place: Young children’s meaning making and movement in the museum. Journal of Early Childhood Literacy, 14(1), 5–27. https://doi.org/10.1177/1468798412453730.

    Article  Google Scholar 

  • Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2006). Multivariate data analysis (Vol. 6). Upper Saddle River, NJ: Pearson Prentice Hall.

    Google Scholar 

  • Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis: International version (7th ed.). New Jersey: Pearson.

    Google Scholar 

  • Harrington, M. C. (2012). The virtual trillium trail and the empirical effects of freedom and fidelity on discovery-based learning. Virtual Reality, 16(2), 105–120. https://doi.org/10.1007/s10055-011-0189-7.

    Article  MathSciNet  Google Scholar 

  • Harrop, D., & Turpin, B. (2013). A study exploring learners' informal learning space behaviors, attitudes, and preferences. New Review of Academic Librarianship, 19(1), 58–77. https://doi.org/10.1080/13614533.2013.740961.

    Article  Google Scholar 

  • Hassell, M. D., Goyal, S., Limayem, M., & Boughzala, I. (2012). Effects of presence, copresence, and flow on learning outcomes in 3D learning spaces. Administrative Issues Journal: Education, Practice, and Research, 2(1), 62–73. https://doi.org/10.5929/2011.2.1.4.

    Google Scholar 

  • Hayes, A. F. (2013). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. Guilford Press.

  • Hooper-Greenhill, E. (2013). Museums and their visitors. Routledge.

  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/10705519909540118.

    Article  Google Scholar 

  • Jia, D., Bhatti, A., & Nahavandi, S. (2014). The impact of self-efficacy and perceived system efficacy on effectiveness of virtual training systems. Behaviour & Information Technology, 33(1), 16–35. https://doi.org/10.1080/0144929X.2012.681067.

    Article  Google Scholar 

  • Jones, G., & Alba, A. D. (2016). Reviewing the effectiveness and learning outcomes of a 3D virtual museum: A pilot study. In F. M. Mendes Neto, & R. de Souza (Eds.), Handbook of Research on 3-D Virtual Environments and Hypermedia for Ubiquitous Learning (pp. 168-191). IGI global. https://doi.org/10.4018/978-1-5225-0125-1.ch007 .

  • Kaiser, H. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20, 141–151. https://doi.org/10.1177/001316446002000116.

    Article  Google Scholar 

  • Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York: Guilford Press.

    MATH  Google Scholar 

  • Kozlov, M. D., & Johansen, M. K. (2010). Real behavior in virtual environments: Psychology experiments in a simple virtual-reality paradigm using video games. Cyberpsychology, Behavior, and Social Networking, 13(6), 711–714. https://doi.org/10.1089/cyber.2009.0310.

    Article  Google Scholar 

  • Lee, E. A. L., Wong, K. W., & Fung, C. C. (2010). How does desktop virtual reality enhance learning outcomes? A structural equation modeling approach. Computers & Education, 55(4), 1424–1442. https://doi.org/10.1016/j.compedu.2010.06.006.

    Article  Google Scholar 

  • Li, L., & Zhou, J. (2016, December). Virtual reality technology based developmental designs of multiplayer-interaction-supporting exhibits of science museums: taking the exhibit of virtual experience on an aircraft carrier in China science and technology museum as an example. Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry-Volume 1, 409–412. ACM. https://doi.org/10.1145/3013971.3014018 .

  • Linnenbrink, E. A., & Pintrich, P. R. (2002). Motivation as an enabler for academic success. School Psychology Review, 31(3), 313–327.

    Google Scholar 

  • Marsick, V. J., & Watkins, K. (1990). Informal and incidental learning in the workplace. New York: Routledge.

    Google Scholar 

  • Martens, R., Bastiaens, T., & Kirschner, P. A. (2007). New learning design in distance education: The impact on student perception and motivation. Distance Education, 28(1), 81–93. https://doi.org/10.1080/01587910701305327.

    Article  Google Scholar 

  • McDonald, R. P., & Ho, M. R. (2002). Principles and practice in reporting structural equation analyses. Psychological Methods, 7(1), 64–82. https://doi.org/10.1037/1082-989X.7.1.64.

    Article  Google Scholar 

  • McLellan, H. (2004). Virtual realites. In D. H. Jonassen (Ed.), Handbook of research on educational communications and technology. Erlbaum Associates: Mahwah, NJ.

    Google Scholar 

  • Merchant, Z., Goetz, E. T., Keeney-Kennicutt, W., Kwok, O. M., Cifuentes, L., & Davis, T. J. (2012). The learner characteristics, features of desktop 3D virtual reality environments, and college chemistry instruction: A structural equation modeling analysis. Computers & Education, 59(2), 551–568. https://doi.org/10.1016/j.compedu.2012.02.004.

    Article  Google Scholar 

  • Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students' learning outcomes in K-12 and higher education: A meta-analysis. Computers & Education, 70, 29–40. https://doi.org/10.1016/j.compedu.2013.07.033.

    Article  Google Scholar 

  • Miglietta, A. M., Belmonte, G., & Boero, F. (2008). A summative evaluation of science learning: A case study of the marine biology museum "Pietro Parenzan" (south East Italy). Visitor Studies, 11(2), 213–219. https://doi.org/10.1080/10645570802355984.

    Article  Google Scholar 

  • Naya, V. B., & Ibáñez, L. A. H. (2015). Evaluating user experience in joint activities between schools and museums in virtual worlds. Universal Access in the Information Society, 14(3), 389–398. https://doi.org/10.1007/s10209-014-0367-y.

    Article  Google Scholar 

  • North, M. M., & North, S. M. (2016). A comparative study of sense of presence of traditional virtual reality and immersive environments. Australasian Journal of Information Systems, 20. https://doi.org/10.3127/ajis.v20i0.1168.

  • Novak, T. P., Hoffman, D. L., & Yung, Y. F. (2000). Measuring the customer experience in online environments: Α structural modeling approach. Marketing Science, 19(1), 22–42. https://doi.org/10.1287/mksc.19.1.22.15184.

    Article  Google Scholar 

  • deNoyelles, A., Hornik, S., & Johnson, R. D. (2014). Exploring the dimensions of self-efficacy in virtual world learning: Environment, task, and content. Journal of Online Learning and Teaching, 10(2), 255.

    Google Scholar 

  • Nunez, D. (2004, November). How is presence in non-immersive, non-realistic virtual environments possible? Proceedings of the 3rd International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa, 83–86. ACM. https://doi.org/10.1145/1029949.1029964 .

  • O’Brien, R. M. (2007). A caution regarding rules of thumb for variance inflation factors. Quality & Quantity, 41(5), 673–690. https://doi.org/10.1007/s11135-006-9018-6.

    Article  Google Scholar 

  • Paliokas, I., & Sylaiou, S. (2016, September). The use of serious games in museum visits and exhibitions: A systematic mapping study. Proceedings of Games and Virtual Worlds for Serious Applications (VS-Games), 2016 8th International Conference, 1-8. IEEE. https://doi.org/10.1109/VS-GAMES.2016.7590371 .

  • Pescarin, S., Pagano, A., Wallergard, M., Hupperetz, W., & Ray, C. (2012). Evaluating virtual museums: Archeovirtual case study. Archaeology in the Digital Era, 74(12).

  • Podsakoff, P. M., & Organ, D. W. (1986). Self-reports in organizational research: Problems and prospects. Journal of Management, 12(4), 531–544. https://doi.org/10.1177/014920638601200408.

    Article  Google Scholar 

  • Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903. https://doi.org/10.1037/0021-9010.88.5.879.

    Article  Google Scholar 

  • Pujol, L. & Lorente, A., (2013). The virtual museum: A quest for the standard definition. Archaeology in the digital era. Proceedings of the 40th Annual Conference of Computer Applications and Quantitative Methods in Archaeology (CAA), 40–48.

  • Rapanotti, L., Minocha, S., Barroca, L., Boulos, M. N., & Morse, D. R. (2012). 3D virtual worlds in higher education. Informed Design of Educational Technologies in Higher Education: Enhanced Learning and Teaching, 212–240. https://doi.org/10.4018/978-1-61350-080-4.ch012.

  • Sanchez-Vives, M. V., & Slater, M. (2005). From presence to consciousness through virtual reality. Nature Reviews Neuroscience, 6(4), 332–339. https://doi.org/10.1038/nrn1651.

    Article  Google Scholar 

  • Schumacker, R. E., & Lomax, R. G. (2010). A beginner' guide to structural equation modeling (3rd ed.). New York: Routledge.

    MATH  Google Scholar 

  • Screven, C. (1993). Museums and informal education. CMS Bulletin, 1(1), 36–66.

    Google Scholar 

  • Selwyn, N. (1997). Students' attitudes toward computers: Validation of a computer attitude scale for 16-19 education. Computers & Education, 28, 35–41. https://doi.org/10.1016/S0360-1315(96)00035-8.

    Article  Google Scholar 

  • Seok, K. H., & Kim, Y. S. (2014). Implementation of interactive web 3D based virtual educational system using O3D-WebGL. International Journal of Multimedia and Ubiquitous Engineering, 9(4), 273–284. https://doi.org/10.14257/ijmue.2014.9.4.29.

    Article  Google Scholar 

  • Sharda, R., Romano Jr, N. C., Lucca, J. A., Weiser, M., Scheets, G., Chung, J. M., … Sleezer, C. M., (2004). Foundation for the study of computer-supported collaborative learning requiring immersive presence. Journal of Management Information Systems, 20(4), 31–63. https://doi.org/10.1080/07421222.2004.11045780 .

  • Skamantzari, M., & Georgopoulos, A. (2016). 3D Visualization for virtual museum development. The International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 41, 961–968. https://doi.org/10.5194/isprsarchives-XLI-B5-961-2016.

    Article  Google Scholar 

  • Soper, D. S. (2016). Post-hoc statistical power calculator for multiple regression [Software]. Retrieved from http://www.danielsoper.com/statcalc

  • Sylaiou, S., Mania, K., Karoulis, A., & White, M. (2010). Exploring the relationship between presence and enjoyment in a virtual museum. International Journal of Human-Computer Studies, 68(5), 243–253. https://doi.org/10.1016/j.ijhcs.2009.11.002.

    Article  Google Scholar 

  • Synodi, E. (2014). Verbal communication in museum programs for young children: Perspectives from Greece and the UK. Childhood Education, 90(2), 116–126. https://doi.org/10.1080/00094056.2014.894814.

    Article  Google Scholar 

  • Tamborini, R., Bowman, N. D., Eden, A., Grizzard, M., & Organ, A. (2010). Defining media enjoyment as the satisfaction of intrinsic needs. Journal of Communication, 60(4), 758e777. https://doi.org/10.1111/j.1460-2466.2010.01513.x.

    Article  Google Scholar 

  • Teo, T., & Noyes, J. (2011). An assessment of the influence of attitude and perceived enjoyment on the intention to use technology among pre-service teachers: A structural equation modelling approach. Computers & Education, 57(2), 1645–1653. https://doi.org/10.1016/j.compedu.2011.03.002.

    Article  Google Scholar 

  • Trilling, B., & Fadel, C. (2009). 21st century skills: Learning for life in our times. Wiley.

  • Tüzün, H., & Özdinç, F. (2016). The effects of 3D multi-user virtual environments on freshmen university students' conceptual and spatial learning and presence in departmental orientation. Computers & Education, 94, 228–240. https://doi.org/10.1016/j.compedu.2015.12.005.

    Article  Google Scholar 

  • Voss, G. B., Nunes, F. B., Muhlbeier, A. R. K., & Medina, R. D. (2013). Context-aware virtual laboratory for teaching computer networks: A proposal in the 3D OpenSim environment. Proceedings of the 15th Symposium on Virtual and Augmented Reality (SVR 2013) (pp. 252–255). Brazil: Cuiaba, Mato Grosso. https://doi.org/10.1109/SVR.2013.46.

    Google Scholar 

  • Witmer, B. G., & Singer, M. J. (1998). Measuring presence in virtual environments: Α presence questionnaire. Presence, 7(3), 225–240. https://doi.org/10.1162/105474698565686.

    Article  Google Scholar 

  • Wrzesien, M., & Raya, M. A. (2010). Learning in serious virtual worlds: Evaluation of learning effectiveness and appeal to students in the E-junior project. Computers & Education, 55(1), 178–187. https://doi.org/10.1016/j.compedu.2010.01.003.

    Article  Google Scholar 

  • Yaman, M., Nerdel, C., & Bayrhuber, H. (2008). The effects of instructional support and learner interests when learning using computer simulations. Computers & Education, 51, 1784–1794. https://doi.org/10.1016/j.compedu.2008.05.009.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Emmanuel Fokides.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Appendix

Appendix

Table 9 The final questionnaire

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fokides, E., Atsikpasi, P. Development of a model for explaining the learning outcomes when using 3D virtual environments in informal learning settings. Educ Inf Technol 23, 2265–2287 (2018). https://doi.org/10.1007/s10639-018-9719-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-018-9719-1

Keywords