research-article

A new AENOR project for measuring the quality of digital educational materials

Author:

Ana M. Fernández-PampillónAuthors Info & Claims

TEEM '13: Proceedings of the First International Conference on Technological Ecosystem for Enhancing Multiculturality

Pages 133 - 139

https://doi.org/10.1145/2536536.2536557

Published: 14 November 2013 Publication History

Abstract

This article presents the design of a new Spanish standard for measuring the quality of Digital Educational Materials as well as the results of previous work. This standard is being developed within the Spanish National Agency for Standardization (AENOR) and involves actors from the academic, administrative and business sectors. Basically, this entails defining a set of measurable criteria and sub-criteria which specify the minimum conditions and requirements needed from any digital resource used effectively in learning, teaching and training. The purpose of the standard is threefold: (1) to serve as a tool for measuring the adaptability of digital educational materials to user needs, and thereby select the most appropriate, (2) to evaluate and certify the quality of the educational production of an author, a school, an administration or a production company, and finally, (3) to guide authors in creating and improving their digital educational content. Thus, the standard will address a fundamental e-learning weakness in Spain, the shortage of quality digital educational materials.

References

[1]

ANECA, 2012 a. 2007. Programa de evaluación de profesorado para la contratación. Principios y orientaciones para la aplicación de los criterios de evaluación. Technical Report. Agencia nacional de Evaluación de la Calidad y Acreditación (May 2007). URL= http://www.aneca.es/content/download/11202/122982/file/pep_criterios_070515.pdf

[2]

ANECA, 2012 b. 2008. Programa ACADEMIA. Principios y orientaciones para la aplicación de los criterios de evaluación. Technical Report. Agencia nacional de Evaluación de la Calidad y Acreditación (Jan. 2008). URL= http://www.aneca.es/content/download/10527/118089/version/1/file/academia_14_ppiosyorientaciones.pdf

[3]

Arús, J., Fernández-Pampillón, A. M., Lahoz, J. M., Domínguez, E., De Armas, I. 2011. Learning Object Management for IT-Illiterate Instructors. In Proceedings of 3rd International Conference on Education and New Learning Technologies (EDULEARN11). (Barcelona, Spain, July 4--6, 2011).

[4]

Becta. 2007. Quality Principles for digital learning resources. Summary Information. Technical Report. UK Government Agency for effective and innovative use of technology throughout learning. URL: http://es.scribd.com/doc/2032665/becta-quality-principles

[5]

DESIRE Project Team. 2000. Section 2.1 Quality selection: ensuring the quality of your collection. DESIRE Information gateways handbook. URL: http://cuc.carnet.hr/cuc2000/handbook/2-1.html

[6]

Dominguez, E.; Fernández-Pampillón, A.; de Armas, I. 2013. Rúbrica para evaluar la calidad de los Materiales Educativos Digitales v1.0. Technical Report. Universidad Complutense de Madrid. URL: http://mediaserver.filol.ucm.es/materiales/bo/download/35/Rúbrica_calidad_MED_2013.pdf

[7]

EFQUEL. 2011. UNIQUe Criteria. European Foundation for Quality in eLearning. Bruxelles. URL: http://unique.efquel.org/unique-criteria.

[8]

Fernández-Pampillón, A., Domínguez, E., De Armas, I. 2012. Herramienta de evaluación de la Calidad de Objetos de Aprendizaje Universitarios (COdA): Guía para la producción y evaluación de materiales didácticos digitales. Technical Report. Universidad Complutense de Madrid. (July 2012) URL: http://eprints.ucm.es/12533/

[9]

Fernández-Pampillón, A.; Domínguez, E.; De Armas, I. 2013. Diez criterios para mejorar la calidad de los materiales didácticos digitales. In Actas VII Jornada CV-UCM. Validar, valorar y difundir Campus Virtual. Editorial Complutense. (March 2013). Pp 25--34. URL: https://cv2.sim.ucm.es/moodle/file.php/19226/actas_vii_jornadas_campus_virtual_ucm.pdf

[10]

Fernández-Pampillón, A., Domínguez, E., Lahoz, J. M., Romero, D., De Armas, I., Palmaz, S., Arús, J. 2011. A Strategy for the Inductive Generation of Learning Objects in low-Tech Contexts. In Proceedings of the 10th European Conference on E-Learning (ECEL 2011) (Brighton. UK. November 10--11, 2011). URL: http://academic-conferences.org/ecel/ecel2011/ecel11-proceedings.htm

[11]

Kay, R. H., Knaack, L. 2008. A multi-component model for assessing learning objects: The learning object evaluation metric (LOEM). Australasian Journal of Educational Technology, 24(5), 574--591. URL: http://www.ascilite.org.au/ajet/ajet24/kay.html

[12]

Kurilovas, E., Dagiene, V. 2011. Evaluation of Quality of Learning Software: Basics, Concepts, Methods. Saarbrücken Lambert Academic Publishing.

[13]

Leacock, T., J. Nesbit. 2007. A framework for evaluating the quality of multimedia learning Resources. Educational technology y society, vol. 10, num 2, pp. 44--59. URL: http://ifets.info/journals/10_2/ets_10_2.pdf#page=49

[14]

MELT project. 2007. Audit Report on MELT Content-version 2. Part I. Deliverable D5.2. pp. 6--9. (March 2007). URL: http://info.melt-project.eu/shared/data/melt/MELT_D5P2_Part1_final.pdf

[15]

Morales, E., Alonso, D., García F. J. 2008. Herramienta para la evaluación de objetos didácticos de aprendizaje reutilizables. In: X Simposio Internacional de Informática Educativa SIIE 2008. (Salamanca, Spain, October 1--3, 2008). Ediciones Universidad de Salamanca (España). Pp. 181--186. URI: http://hdl.handle.net/10366/55576

[16]

Moskal, B. M. 2000. Scoring rubrics: what, when and how? Practical Assessment, Research & Evaluation, 7(3). URL: http://PAREonline.net/getvn.asp?v=7&n=3

[17]

Nesbit, J. C., Belfer, K., Leacock, T. 2003. Learning object review instrument (LORI). Version 1.5. URL: http://www.transplantedgoose.net/gradstudies/educ892/LORI1.5.pdf

[18]

Paulsson, F., Naeve, A. 2006. Establishing technical quality criteria for Learning Objects. In eChallenges 2006 Conference. (Barcelona, Spain, October 25--27, 2006). URL: http://www.frepa.org/wp/wp-content/files/Paulsson-Establ-Tech-Qual_finalv1.pdf

[19]

Q4R. Quality Assurance Workflow Model. 2007. Quality for Reuse project. URL: http://www.q4r.org/Q4RBestPractices/Q4RWorkflowModels/Q4RQualityAssuranceWorkflowModel/tabid/1260/language/en-US/Default.aspx

[20]

REBIUN. 2007. Informe sobre la Situación de los Repositorios de Materiales Didácticos y Objetos de Aprendizaje en las Universidades españolas. Final Report. II Plan estratégico 2007--2011. Pp 5. Red de Bibliotecas Universitarias. URL: http://www.mcu.es/bibliotecas/docs/Cooperacion/ccb/Planestrategico07_11.pdf

[21]

UNED. Protocolo Evaluación Materiales Impresos". Instituto Universitario de Educación a Distancia. Universidad Nacional de Educación a Distancia. URL: http://www.uned.es/iued/subsitio/html/documentos/Protocolo_MADI.pdf

[22]

UNIQUe. 2012. The quality label for the use of ICT in higher education (Universities and Institutes). URL: http://www.qualityfoundation.org/unique-certification/

[23]

Vargo, J., Nesbit, J. C., Belfer, K. and Archambault, A. 2003. Learning Object Evaluation: Computer-Mediated Collaboration and Inter-Raterreliability. International Journal of Computers and Applications, Vol. 25, No. 3.

[24]

Williams, D. D. Evaluation of Learning Objects and Instruction Using Learning Objects The Instructional Use of Learning Objects: Online Version, ed. D. A. Wiley, (2000) URL: http://reusability.org/read/chapters/williams.doc

Cited By

Hajdin GPlantak Vukovac DOreški D(2023)What Do Students Think About Learning Supported by e-Schools Digital Educational Resources?Learning and Collaboration Technologies10.1007/978-3-031-34411-4_19(274-291)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-34411-4_19
Hai-Jew S(2018)Coding Digital Learning Objects for Adoption for Online Teaching and LearningTechniques for Coding Imagery and Multimedia10.4018/978-1-5225-2679-7.ch007(414-476)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-2679-7.ch007
Morais CMiranda LAlves P(2014)Digital educational resources supporting higher education students' learning2014 9th Iberian Conference on Information Systems and Technologies (CISTI)10.1109/CISTI.2014.6877045(1-6)Online publication date: Jun-2014
https://doi.org/10.1109/CISTI.2014.6877045

Index Terms

A new AENOR project for measuring the quality of digital educational materials
1. Applied computing
  1. Education
2. Social and professional topics
  1. Professional topics
    1. Computing education

Recommendations

Automatically characterizing resource quality for educational digital libraries
JCDL '09: Proceedings of the 9th ACM/IEEE-CS joint conference on Digital libraries

With the rise of community-generated web content, the need for automatic characterization of resource quality has grown, particularly in the realm of educational digital libraries. We demonstrate how identifying concrete factors of quality for web-based ...
Educational modelling language and learning design: new opportunities for instructional reusability and personalised learning

Learning technologies offer new opportunities to meet the rapidly growing demand for new, constructivist ways of learning (such as competency-based, collaborative or adaptive learning). They have the potential to act as catalysts for more effective ...
PLORS: a personalized learning object recommender system

Learning management systems (LMS) are typically used by large educational institutions and focus on supporting instructors in managing and administrating online courses. However, such LMS typically use a "one size fits all" approach without considering ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

TEEM '13: Proceedings of the First International Conference on Technological Ecosystem for Enhancing Multiculturality

November 2013

582 pages

ISBN:9781450323451

DOI:10.1145/2536536

Editor:
Francisco José García-Peñalvo
University of Salamanca, Salamanca, Spain

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

University of Salamanca: University of Salamanca

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Spanish Ministery of Science and Innovation

Conference

TEEM '13

Sponsor:

University of Salamanca

TEEM '13: Technological Ecosystems for Enhancing Multiculturality Conference

November 14 - 15, 2013

Salamanca, Spain

Acceptance Rates

TEEM '13 Paper Acceptance Rate 94 of 118 submissions, 80%;

Overall Acceptance Rate 496 of 705 submissions, 70%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
122
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hajdin GPlantak Vukovac DOreški D(2023)What Do Students Think About Learning Supported by e-Schools Digital Educational Resources?Learning and Collaboration Technologies10.1007/978-3-031-34411-4_19(274-291)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-34411-4_19
Hai-Jew S(2018)Coding Digital Learning Objects for Adoption for Online Teaching and LearningTechniques for Coding Imagery and Multimedia10.4018/978-1-5225-2679-7.ch007(414-476)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-2679-7.ch007
Morais CMiranda LAlves P(2014)Digital educational resources supporting higher education students' learning2014 9th Iberian Conference on Information Systems and Technologies (CISTI)10.1109/CISTI.2014.6877045(1-6)Online publication date: Jun-2014
https://doi.org/10.1109/CISTI.2014.6877045

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents