research-article

Integrating quantitative and qualitative data in assessment of wiki collaborative assignments

Authors:

Manuel Palomo Duarte,

Antonio Balderas,

Juan Manuel Dodero,

Antonio J. Reinoso,

Juan Antonio Caballero,

Pablo DelatorreAuthors Info & Claims

TEEM'18: Proceedings of the Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality

Pages 328 - 332

https://doi.org/10.1145/3284179.3284232

Published: 24 October 2018 Publication History

Abstract

Wikis are well known systems to support collaborative assignments. They provide a digital platform for asynchronous collaboration between students under the monitoring of a supervisor. Additionally, as all the students' interactions are recorded in the wiki database, teachers can retrieve interesting data for skill assessment. On the one hand, there are different approaches for skill assessment based on quantitative data obtained from the wiki. Their main advantage is that they are based on objective data that can be automatically retrieved. Unfortunately, they are rather coarse-grained and different interesting aspects regarding the contributions to the wiki can be dismissed. On the other hand, qualitative approaches offer a more detailed assessment process, but their automation is limited. This can lead to scalability problems in large groups of students. Based on our previous experience using both methods, we propose a mixed approach integrating quantitative and qualitative data for assessment of wiki collaborative assignments. It is supported by the software system Clever Figures 4 MediaWiki, which has been specifically developed for this purpose. Its application shows promising results, generating ranking and charts than combine both sources of information.

References

[1]

A. Kemppainen, S. Amato-Henderson and G. Hein. 2010., "Work in progress --- Refining a technical communication rubric for first-year engineering instructors," 2010 IEEE Frontiers in Education Conference (FIE), Washington, DC, 2010, pp. T2G-1-T2G-3.

[2]

J. Ortega-Valiente, A. J. Reinoso, and R. Muñoz-Mansilla. 2013. Analysis of the implementation of wiki-based platforms in university education. International Journal of Computer Information Systems and Industrial Management Applications 5 (2013), 41--49.

[3]

M. Pérez-Mateo. 2014. La construcción colaborativa de proyectos como metodología para adquirir competencias digitales. Comunicar 21, 42 (January 2014), 15--24.

[4]

M. D. V. Urías, S. A. Ortega, and M. G. Navarro. 2016. Desarrollo de competencias digitales en docencia online: la asignatura Cimientos del curso de adaptación a grado en ingeniería de edificación. Revista de Educación a Distancia 49, 8 (April 2016), 1--29.

[5]

D. F. M. Rios and P. P. Robles. 2016. Desarrollo de competencias académicas utilizando la Wiki en la enseñanza de nivel superior: caso de dos universidades colombianas y sus bibliotecas. VIRTUalis 6, 12 (2016), 40--59.

[6]

S. Hadjerrouit. 2014. Wiki as a collaborative writing tool in teacher education: Evaluation and suggestions for effective use. Computers in Human Behavior 32 (March 2014), 301--312.

[7]

L. V. Martínez and M. E. del Moral Pérez. 2011. Webquest y wikis: búsqueda de información en red y desarrollo de competencias en colaboración. Teoría de la Educación: Educación y Cultura en la Sociedad de la Información 12, 1 (2011), 190--208.

[8]

A. R. González. 2013. Percepción de los estudiantes sobre el uso de wiki. Análisis de una experiencia de aprendizaje colaborativo en la Universitat de Girona. Teoría de la Educación: Educación y Cultura en la Sociedad de la Información 14, 1 (2013), 76--100.

[9]

M. Palomo-Duarte, J. M. Dodero, I. Medina-Bulo, E. J. Rodríguez-Posada, and I. Ruiz-Rube. 2014. Assessment of collaborative learning experiences by graphical analysis of wiki contributions. Interactive Learning Environments 22, 4 (2014), 444--466.

[10]

J. A. Caballero-Hernández, M. Palomo-Duarte, J. M. Dodero, G. Rodríguez, and M. S. Ibarra. 2014. Integrating external evidences of skill assessment in Virtual Learning Environments. In Proceedings of the Fifth International Conference on eLearning (eLearning-2014). Belgrade, Serbia, 65--70.

[11]

M. Palomo-Duarte, J. M. Dodero, A. García-Dominguez, P. Neira-Ayuso, N. Sales-Montes, I. Medina-Bulo, F. Palomo-Lozano, C. Castro-Cabrera, E. J. Rodríguez-Posada, and A. Balderas. 2014. Scalability of assessments of wiki-based learning experiences in higher education. Computers in Human Behavior 31 (February 2014), 638--650.

Digital Library

[12]

A. Balderas, L. Gutiérrez-Madroñal, M. Palomo-Duarte, and J. M. Dodero. 2016. Evaluación de competencias genéricas en proyectos colaborativos en wikis. In 24° Congreso Universitario de Innovación Educativa en las Enseñanzas Técnicas (24° CUIEET), 1--11.

[13]

I. Traverso, A. Balderas, J. M. Dodero, I. Ruiz-Rube, and M. Palomo-Duarte. 2016. Open Data Framework for Sustainable Assessment of Project-Based Learning Experiences. Program electronic library and information systems 50, 4, 380--398. 2016.

[14]

L. Gutiérrez-Madroñal, A. Ruiz-Castellanos, and M. Palomo-Duarte. 2016. Mejora del aprendizaje de verbos en latín con contenidos multimedia libres: una experiencia wiki. Jornadas de Innovación Docente Universitaria de la Universidad de Cádiz 2016, 1, Cádiz, Spain, 306--308.

[15]

A. Balderas, M. Palomo-Duarte, J. M. Dodero, and I. Ruiz-Rube. 2012. Qualitative assessment of wiki-based learning processes. In Proceedings of Ninth multidisciplinary symposium on the design and evaluation of digital content for education (SPDECE-2012), 161--172.

[16]

A. Almagro. 2015. Aplicación web para el análisis cuantitativo-cualitativo de actividad en wikis. Repositorios de Objetos de Docencia e Investigación de la Universidad de Cádiz (RODIN). Retrieved from: http://hdl.handle.net/10498/17927

[17]

Á. M. Guerrero-Higueras, M. Á. Conde, and V. Matellán. 2017. Uso de sistemas de control de versiones para aplicar estrategias de evaluación por pares en contextos tecnológicos. In IV Congreso Internacional sobre Aprendizaje, Innovación y Competitividad (CINAIC 2017). 4-6 October, Zaragoza, Spain, 583--588.

Cited By

Farshad SZorin EAmangeldiuly NFortin C(2024)Engagement assessment in project-based education: a machine learning approach in team chat analysisEducation and Information Technologies10.1007/s10639-023-12381-529:10(13105-13131)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1007/s10639-023-12381-5
Vásquez-Bermúdez MSanz CZangara MHidalgo J(2020)Mirroring Tools and Interaction Indicators in Collaborative Work: A Systematic ReviewTechnologies and Innovation10.1007/978-3-030-62015-8_14(179-192)Online publication date: 28-Oct-2020
https://doi.org/10.1007/978-3-030-62015-8_14

Index Terms

Integrating quantitative and qualitative data in assessment of wiki collaborative assignments
1. Applied computing
  1. Education

Recommendations

A Framework for the Assessment of Wiki-Based Collaborative Learning Activities

This paper discusses the pedagogical and technological aspects of assessing wiki-based collaborative learning activities. The first part of the paper presents a general framework of collaborative learning assessment. The framework is based on four ...
Assessment of wiki-supported collaborative learning in higher education
ITHET'10: Proceedings of the 9th international conference on Information technology based higher education and training

Collaborative learning activities, based on constructivism, were applied within the introductory course on the Internet for the first year students of Computer science at the Faculty of Education. In the paper we present a form of wiki-supported ...
Scaffolding wiki-supported collaborative learning for small-group projects and whole-class collaborative knowledge building

While educators value wikis' potential, wikis may fail to support collaborative constructive learning without careful scaffolding. This article proposes literature-based instructional methods, revised based on two expert instructors' input, presents the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

TEEM'18: Proceedings of the Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality

October 2018

1072 pages

ISBN:9781450365185

DOI:10.1145/3284179

Editor:
Francisco José García-Peñalvo
University of Salamanca

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

University of Salamanca: University of Salamanca

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Convocatoria de Ayudas para la Difusión de Resultados de Innovación Docente (UCA)

Conference

TEEM'18

TEEM'18: Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality

October 24 - 26, 2018

Salamanca, Spain

Acceptance Rates

TEEM'18 Paper Acceptance Rate 151 of 243 submissions, 62%;

Overall Acceptance Rate 496 of 705 submissions, 70%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
74
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Farshad SZorin EAmangeldiuly NFortin C(2024)Engagement assessment in project-based education: a machine learning approach in team chat analysisEducation and Information Technologies10.1007/s10639-023-12381-529:10(13105-13131)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1007/s10639-023-12381-5
Vásquez-Bermúdez MSanz CZangara MHidalgo J(2020)Mirroring Tools and Interaction Indicators in Collaborative Work: A Systematic ReviewTechnologies and Innovation10.1007/978-3-030-62015-8_14(179-192)Online publication date: 28-Oct-2020
https://doi.org/10.1007/978-3-030-62015-8_14

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents