Abstract
E-learning systems permeate the modern informative approaches of education. As their number is growing up, a new demand arises. That demand is about evaluating those systems in order not to separate the “good” ones from the “bad” ones but to comprehend the factors that lead to an effective and useful e-learning system. This paper proposes a multi-criteria model that uses linear programming to measure a satisfaction index and to compute criteria weights. To evaluate the e-learning system, we use a set of fifteen sub-criteria that corresponds to three main criteria. In addition, there is a crest-question that counts the overall satisfaction. In this study, we focused on the multi-criteria methodology, but we also included our thoughts and ambitions on an expanding implementation through an e-learning system.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aldridge, S. and Rowley, J. (1998). Measuring customer satisfaction in higher education, Quality Assurance in Education 6 (4), pp. 197–204.
Baroudi, J.J. and Orlikowski, W.J.(1988). A short-form measure of user information satisfaction: a psychometric evaluation and notes on use, Journal of Management Information Systems 4 (4), pp. 44–59.
Blin, MJ. and Tsoukiàs, A. (2001). Contribution of Multi-criteria Methodology to Software Quality Evaluations.Software Quality Journal, vol.9, pp. 113 — 132.
Cashin, W.E. and Downey, R.G.(1992). Using global student rating items for summative evaluation. Journal of Educational Psychology 84 (4), pp. 563–572.
Cohen, P.A.(1981). Student ratings of instruction and student achievement. Review of Educational Research 51 (3), pp. 281–309.
Deng, J. L. (1989). Introduction to Grey System Theory. The Journal of Grey System, vol.1, pp. 1–24 1989.
Doll, WJ. and Torkzadeh, G. (1991). The measurement of end-user computing satisfaction: theoretical and methodological issues. MIS Quarterly 15 (1), pp. 5- 10.
Doll, W.J., Xia, W. and Torkzadeh, G.(1994). A confirmatory factor analysis of the end-user computing satisfaction instrument. MIS Quarterly 18 (4), pp. 453- 461.
Feldman, K.A. (1989). The association between student ratings of specific instructional dimensions and student achievement: refining and extending the synthesis of data from multisection validity studies. Research in Higher Education 30 (6), pp. 583–645.
Grigoroudis, E. and Siskos, Y. (2002). Preference disaggregation for measuring and analyzing customer satisfaction: The MUSA method, European Journal of Operational Research, 143 (1), pp. 148–170
Guolla, M.(1999). Assessing the teaching quality to student satisfaction relationship: applied customer satisfaction research in the classroom. Journal of Marketing Theory and Practice 7 (3), pp. 87–97.
International Organization for Standardization, (1991) ISO 9126: Information Technology — Software product evaluation — Quality characteristics and guidelines for their use
Jacquet-Lagreze, E. and Siskos, J. (1982). Assessing a set of additive utility functions for multicriteria decision-making: The UTA method. European Journal of Operational Research 10 (2), pp. 151–164.
Keeney, R. L., & Raiffa, H. (1976). Decisions with multiple objectives: preferences and value tradeoffs. New York: John Wiley and Sons.
Keeney, R. L., (1992). Value — focused thinking: A path to creative decision making, Harvard University Press, London.
Long, P.D., Tricker, T., Rangecroft, M. and Gilroy, P. (1999). Measuring the satisfaction gap: education in the market-place. Total Quality Management 10 (4- 5), pp. S772-S778.
Long, P.D., Tricker, T., Rangecroft, M. and Gilroy, P. (2000). Satisfaction with distance education: evaluation of a service template. Total Quality Management 11 (4-6), pp. S530-S536.
Marsh, H.W. (1987).Students' evaluations of university teaching: research findings, methodological issues, and directions for future research, International Journal of Educational Psychology 11 (3), pp. 253–388.
Marsh, H.W. (1991). Multidimensional students' evaluations of teaching effectiveness: a test of alternative higher-order structures, Journal of Educational Psychology 83 (2), pp. 285–296.
Oliver, R.L.(1981). Measurement and evaluation of satisfaction processes in retailing setting, Journal of Retailing 57 (3), pp. 25–48.
Palvia, P.C.(1996). A model and instrument for measuring small business user satisfaction with information technology, Information and Management 31 (3), pp. 151–163.
Piccoli, G., Ahmad, R. and Ives, B. (2001). Web-based virtual learning environments: a research framework and a preliminary assessment of effectiveness in basic IT skills training. MIS Quarterly 25 (4), pp. 401–426.
Saaty, T. L. (1980). The analytic hierarchy process. NK: McGraw-Hill.
Siskos, Y. (1985). Analyses de regression et programmation linéaire. Revue de Statistique Appliquée, vol.XXXII, pp. 41–55.
Siskos, Y., Yannacopoulos, D. (1985). UTASTAR: An ordinal regression method for building additive value functions. Investigacao Operacional 1 (5), pp. 39–53.
The Institute of Electrical and Electronics Engineers, (1992), Standard for a Software Quality Metrics Methodology, December 1992
Wang, Yi-Shun (2003). Assessment of learner satisfaction with asynchronous electronic learning systems. Information & Management, vol.41 pp. 75–86.
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
About this article
Cite this article
Matsatsinis, N.F., Grigoroudis, E. & Delias, P. User satisfaction and e-learning systems: Towards a multi-criteria evaluation methodology. Oper Res Int J 3, 249–259 (2003). https://doi.org/10.1007/BF02936404
Issue Date:
DOI: https://doi.org/10.1007/BF02936404