Abstract
E-Learning has been massively used in higher education, one of which is in Universitas Indonesia. The e-learning system in Universitas Indonesia is called Student Centered E-Learning Environment Universitas Indonesia (SCELE UI). This research determines the effect of usability on the intention to use SCELE UI in a sustainable way. The Expectation Confirmation Model (ECM) is used as a basis of the research model. Perceived Usability, Learnability, Presentation, Navigation and Error variables are added to the model. The Partial Least Square is used to analyze and test the model. Of the 12 proposed hypotheses, 10 hypotheses were accepted and 2 hypotheses were rejected. This research gives theoretical and practical contributions. On the theoretical side, this research successfully proposes and examines the integration of usability and ECM in the context of sustain e-learning usage intention. This research reveals the indirect effect of Perceived Usability on continued usage intention of the e-learning system. On the practical side, this research also provides insights for developers and universities that can help them to effectively foster the improvement of their system that can ensure sustained usage by their students.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Availability of data and materials
The authors can not share the data as this may breach participant confidentiality.
References
Abran, A., Khelifi, A., Suryn, W., & Seffah, A. (2003). Usability meanings and interpretations in ISO standards. Software Quality Journal, 11, 325–338.
Ahmadi, N., Romoser, M. R., Guarnieri, L. M., Kry, T. G., & Porter-Fyke, E. I. (2019). Application of eye tracking technology in naturalistic usability assessment of an academic library website. In T. Z. Ahram and C. Falcão (Eds.): AHFE 2018, AISC 794 (pp. 729–740). Switzerland: Springer Nature.
Akrimi, Y., & Khemakhem, P. R. (2014). An analysis of perceived usability, perceived interactivity and website personality and their effects on consumer satisfaction. International Journal of Management Excellence, 2(3), 227–236.
Akugizibwe, E., & Ahn, J. Y. (2020). Perspectives for effective integration of e-learning tools in university mathematics instruction for developing countries. Education and Information Technologies, 25, 889–903.
Al-Fraihat, D., Joy, M., Masa’deh, R., & Sinclair, J. (2020). Evaluating e-learning systems success: An empirical study. Computers in Human Behavior, 102, 67–86.
Alotaibi, K. J. (2017). Gathering of usability requirements by Saudi e-learning software developers. Proceedings of the 8th International Conference on Information Technology (ICIT) (pp. 255–261). https://doi.org/10.1109/ICITECH.2017.8080009
Alshammari, M., Anane, R., & Hendley, R. J., et al. (2015). Design and usability evaluation of adaptive e-learning systems based on learner knowledge and learning style. In J. Abascal (Ed.), INTERACT 2015, Part II, LNCS 9297 (pp. 584–591). Switzerland.
Alshehri, A., Rutter, M., & Smith, S. (2019). Assessing the relative importance of an e-learning system’s usability design characteristics based on students’ preferences. European Journal of Educational Research, 8(3), 839–855. https://doi.org/10.12973/eu-jer.8.3.839
Alves, R., & Nunes, N. J. (2016). Ceiling and threshold of PaaS tools: The role of learnability in tool adoption. In C. Bogdan et al. (Eds.): HCSE 2016/HESSD 2016, LNCS 9856 (pp. 335–347). Switzerland: Springer.
Ambalov, I. A. (2018). A meta-analysis of IT continuance: An evaluation of the expectation-confirmation model. Telematics and Informatics, 35, 1561–1571.
Ammar, L. S., Trabelsi, A., & Mahfoudhi, A. (2016). A model-driven approach for usability engineering of interactive systems. Software Quality Journal, 24, 301–335. https://doi.org/10.1007/s11219-014-9266-y1892
Ardito, C., Costabile, M. F., De Marsico, M., Lanzilotti, R., Levialdi, S., Roselli, T., & Rossano, V. (2006). An approach to usability evaluation of e-learning applications. Universal Access in the Information Society, 4, 270–283.
Arning, K., Himmel, S., & Ziefle, M. (2016). You can(’t) teach an old dog new tricks: Analyzing the learnability of manufacturing software systems in older users. In J. Zhou and G. Salvendy (Eds.): ITAP 2016, PartII, LNCS 9755 (pp. 277–288). Switzerland: Springer.
Belanche, D., Casalo´, L., & Guinalı, M. (2012). Website usability, consumer satisfaction and the intention to use a website: The moderating effect of perceived risk. Journal of Retailing and Consumer Services, 19, 124–132.
Bhattacherjee, A. (2001). Understanding information systems continuance: An expectation-confirmation model. Management Information Systems Quarterly, 25(3), 351–370.
Bolen, M.C. (2020). Exploring the determinants of users’ continuance intention in smartwatches. Technology in Society, 60.https://doi.org/10.1016/j.techsoc.2019.101209
Bourges-Waldegg, P., & Scrivener, A. (1998). Meaning: The central issue in cross-cultural HCI design. Interacting with Computers, 9(3), 287–309.
Cabero-Almenara, J., Marín-Díaz, V., & Sampedro-Requena, B. E. (2016). Meta-analysis of research in e-learning published in Spanish journals. International Journal of Educational Technology in Higher Education, 13(25). https://doi.org/10.1186/s41239-016-0023-0
Casalo, L., Flavian, C., & Guinalíu, M. (2008). The role of perceived usability, reputation, satisfaction and consumer familiarity on the website loyalty formationprocess. Computers in Human Behavior, 24, 325–345.
Castañeda, L., & Selwyn, N. (2018). More than tools? Making sense of the ongoing digitizations of higher education. International Journal of Educational Technology in Higher Education, 15(22). https://doi.org/10.1186/s41239-018-0109-y
Chen, C. P., Lai, H. M., & Ho, C. Y. (2015). Why do teachers continue to use teaching blogs? The roles of perceived voluntariness and habit. Computers & Education, 82, 236–249. https://doi.org/10.1016/j.compedu.2014.11.017
Chen, S. C., Yen, D. C., & Peng, S. C. (2018a). Assessing the impact of determinants in e-magazines acceptance: An empirical study. Computer Standards & Interfaces, 57, 49–58.
Chen, Y., Yang, L., Zhang, M., & Yang, J. (2018b). Central or peripheral? Cognition elaboration cues’ effect on users’ continuance intention of mobile health applications in the developing markets. International Journal of Medical Informatics, 116, 33–45.
Cheng, M., & Yuen, A. H. K. (2019). Cultural divides in acceptance and continuance of learning management system use: A longitudinal study of teenagers. Educational Technology Research and Development, 67, 1613–1637. https://doi.org/10.1007/s11423-019-09680-5
Cheng, Y. M. (2021). Can tasks and learning be balanced? A dual-pathway model of cloud-based e-learning continuance intention and performance outcomes. Kybernetes. https://doi.org/10.1108/K-07-2020-0440
Chin, W. W. (1998). The partial least squares approach for structural equation modeling. In G. A. Macoulides (Ed.), Modern methods for business research. Mahwah (pp. 295–336). NJ: Lawrence Erlbaum Associates
Choi, B. C. F., & Lee, N. T. (2015). A study on mobile fitness application usage. In F. F. H. Nah & C. H. Tan (Eds.), HCIB 2015, LNCS 9191 (pp. 446–457). Switzerland.
Chow, W.C., & Shi, S. (2014). Investigating students’ satisfaction and continuance intention toward e-learning: An extension of the expectation–confirmation model. In Procedia - Social and Behavioral Sciences, 141, (pp. 1145 – 1149). https://doi.org/10.1016/j.sbspro.2014.05.193
Daghan, G., & Akkoyunlu, B. (2016). Modeling the continuance usage intention of online learning environments. Computers in Human Behavior, 60, 198–211. https://doi.org/10.1016/j.chb.2016.02.066
Darmawan, A. K., Siahaan, D. O., Susanto, T. D., Hoiriyah, Umam, B. A., & Bakir, B. (2020). Understanding Indonesian citizen's continuance itention to use mobile-based smart city: A perspective of modified expectation confirmation model (M-ECM). In Proceedings of the 7th International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE). https://doi.org/10.1109/ICITACEE50144.2020.9239157
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319. https://doi.org/10.2307/249008
DeLone, W. H., & McLean, E. R. (2003). The DeLone and McLean model of information systems success : A ten-year update. Journal of Management Information Systems, 19(4), 9–30.
Demangeot, C., & Broderick, A. J. (2006). Exploring the experiential intensity of online shopping environments. Qualitative Market Research: An International Journal, 9(4), 325–351.
Digión, L. B., & Sosa, M., et al. (2012). Communicability and usability for the interface in e-learning. In F. V. Cipolla-Ficarra (Ed.), ADNTIIC 2011, LNCS 7547 (pp. 165–172). Berlin.
Eltahir, M. E., Al-Qatawneh, S., Al-Ramahi, N., & Alsalhi, N. (2019). The perspective of students and faculty members on the efficiency and usability of e-learning courses at Ajman university: A case study. Journal of Technology and Science Education, 9(3), 388–403. https://doi.org/10.3926/jotse.590
Eze, S. C., Chinedu-Eze, V. C., & Bello, A. O. (2018). The utilisation of e-learning facilities in the educational delivery system of Nigeria: a study of M-University. International Journal of Educational Technology in Higher Education, 15(34). https://doi.org/10.1186/s41239-018-0116-z
Fang, X., & Holsapple, C. W. (2011). A model-driven approach for usability engineering of interactive systems. Information Systems Frontiers, 13, 453–469. https://doi.org/10.1007/s10796-010-9227-3
Fernandez, A., Abrahão, S., & Insfran, E. (2011). A web usability evaluation process for model-driven web development. In H. Mouratidis and C. Rolland (Eds.): CAiSE 2011, LNCS 6741 (pp. 108–122). Berlin: Springer-Verlag.
Findlater, L., & Mcgrenere, J. (2008). Impact of screen size on performance, awareness, and user satisfaction with adaptive graphical user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1247–1256). https://doi.org/10.1145/1357054.1357249
Findlater, L., Moffatt, K., Mcgrenere, J., & Dawson, J. (2009). Ephemeral adaptation: The use of gradual onset to improve menu selection performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1655–1664). https://doi.org/10.1145/1518701.1518956
Flavián, C., Longás, L., & Lozano, J. (2013). E-learning and market orientation in higher education. Education and Information Technologies, 18, 69–83.
Fu, X., Zhang, J., & Chan, F. T. S. (2018). Determinants of loyalty to public transit: A model integrating satisfaction-loyalty theory and expectation-confirmation theory. Transportation Research Part a: Policy and Practice, 113, 476–490.
Gajos, K., Wobbrock, J., & Weld, D. (2008). Improving the performance of motor-impaired users with automatically - generated, ability-based interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1257–1266). https://doi.org/10.1145/1357054.1357250
Gamberini, L., & Valentini, E. (2003). Web usability today: Theories, approach and methods. In G. Riva & C. Galimberti (Eds.), Towards CyberPsychology: Mind, Cognitions and Society in the Internet Age (pp. 109–126). Amsterdam.
Geng, R., & Tian, J. (2015). Improving web navigation usability by comparing actual and anticipated usage. IEEE Transactions on Human-Machine Systems, 45(1), 84–94. https://doi.org/10.1109/THMS.2014.2363125
Ghavifekr, S., & Mahmood, H. (2017). Factors affecting use of e-learning platform (SPeCTRUM) among University students in Malaysia. Education and Information Technologies, 22, 75–100.
Greenberg, S., & Witten, I. (1985). Adaptive personalized interfaces - A question of viability. Behaviour and Information Technology, 4, 31–45.
Harefa, E. B. (2020). Usability measurement of google classroom applications as e-learning for students of department of building engineering education IKIP gunung sitoli. Indonesian Science Education Research, 2(1), 11–14.
Heimgartner, R. (2005). Towards cross-cultural adaptive human-machine-interaction in automotive navigation systems. In Proceedings of the Seventh International Workshop on Internationalisation of Products and Systems (pp. 97–111).
Heimgartner, R., Tiede, L. W., Leimbach, J., Zehner, S., & Windl, H. (2007). Towards cultural adaptability to broaden universal access in future interfaces of driver information systems. In Stephanidis C. (Ed.), Universal Access in Human-Computer Interaction. Ambient Interaction (pp. 383–392). Springer, Berlin, Heidelberg.
Henseler, J., Ringle, C. M., & Sarstedt, M. (2012). Using partial least squares path modeling in advertising research: Basic concepts and recent issues. Handbook of Research on International Advertising. https://doi.org/10.4337/9781781001042.00023
Höck, M., & Ringle, C. M. (2006). Strategic networks in the software industry: An empirical analysis of the value continuum. In IFSAM VIIIth World Congress.
Holden, H. (2009). Assessing teachers’ acceptance and usage behavior of current job-related technologies. Unpublished Dissertation, University of Maryland Baltimore, County, Baltimore, MD. UMI # 3389007
Holzinger, A. (2005). Usability engineering methods for software developers. Communications of the ACM, 48(1), 71–74.
Hook, K. (1997). Evaluating the utility and usability of an adaptive hypermedia system. In Proceedings of the 2nd international conference on Intelligent user interfaces (pp. 179–186). https://doi.org/10.1145/238218.238320
Hussain, W., Hussain, O. K., Hussain, F. K., & Khan, M. Q. (2017). Usability evaluation of english, local and plain languages to enhance on-screen text readability: A use case of Pakistan. Global Journal of Flexible Systems Management, 18(1), 33–49. https://doi.org/10.1007/s40171-016-0146-0
Ibrahim, Y., & Hidayat-ur-Rehman, I. (2021). COVID-19 crisis and the continuous use of virtual classes. International Journal of Advanced and Applied Sciences, 8(4), 117–129. https://doi.org/10.21833/ijaas.2021.04.014
Islam, A. K. M. N. (2011). Antecedents of post-adoption expectations. T. Skersys et al. (Eds.): I3E 2011, IFIP AICT 353 (pp. 269–281). IFIP International Federation for Information Processing.
ISO 9241–11. (2018). Ergonomics of human-system interaction — Part 11: usability: Definitions and concepts. https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-2:v1:en. Accessed 3 Mar 2021
Kabir, M. A., Hossin, M. A., Mahmud, S. M. H., Noori, S. R. H., & Bhuiyan, T. (2018). Usability evaluation of mobile applications: An empirical analysis of supply chain management systems. Proceedings of the 4th International Conference on Computer and Communications (pp. 2525–2531). https://doi.org/10.1109/CompComm.2018.8780831
Kersten, G., Kersten, M., & Rakowski, W. (2002). Software and culture: Beyond the internationalization of the interface. Journal of Global Information Management, 10(4). https://doi.org/10.4018/jgim.2002100105
Kiili, K. (2002). Evaluating WAP usability: “What Usability?” Proceedings of the IEEE International Workshop on Wireless and Mobile Technologies in Education. https://doi.org/10.1109/WMTE.2002.1039245
Kim, B. (2010). An empirical investigation of mobile data service continuance: Incorporating the theory of planned behavior into the expectation–confirmation model. Expert Systems with Applications, 37, 7033–7039.
Kim, M. H., Ko, S. M., Mun, J. S., Ji, Y. G., & Jung, M. R. (2007). A usability study on personalized EPG (pEPG) UI of digital TV. In J. Jacko (Ed.): Human-Computer Interaction, Part III, HCII 2007, LNCS 4552 (pp. 892–901). Berlin: Springer-Verlag.
Kipkurui, N. G. P., & Ikoha, A. (2014). Evaluating usability of e-learning systems in universities. International Journal of Advanced Computer Science and Applications, 5(8).https://doi.org/10.14569/ijacsa.2014.050815
Kumar, A., Tadayoni, R., & Sorensen, L. T. (2015). Metric based efficiency analysis of educational erp system usability-using fuzzy model. In Proceedings of the Third International Conference on Image Information Processing (pp. 382–386). https://doi.org/10.1109/ICIIP.2015.7414801
Kumar, J. A., & Bervell, B. (2019). Google Classroom for mobile learning in higher education: Modelling the initial perceptions of students. Education and Information Technologies, 24(1), 1793–1817.
Kumar, J. A., Bervell, B., & Osman, S. (2020). Google classroom: Insights from Malaysian higher education students’ and instructors’ experiences. Education and Information Technologies, 25, 4175–4195.
Lacka, E., & Chong, A. (2016). Usability perspective on social media sites’ adoption in the B2B context. Industrial Marketing Management, 54, 80–91.
Lee, M. C. (2010). Explaining and predicting users’ continuance intention toward e-learning: An extension of the expectation–confirmation model. Computers & Education, 54, 506–516. https://doi.org/10.1016/j.compedu.2009.09.002
Leung, L., & Chen, C. (2019). E-health/m-health adoption and lifestyle improvements: Exploring the roles of technology readiness, the expectation-confirmation model, and health-related information activities. Telecommunications Policy, 43, 563–575. https://doi.org/10.1016/j.telpol.2019.01.005
Lin, C. C. (2013). Exploring the relationship between technology acceptance model and usability test. Information Technology and Management, 14, 243–245. https://doi.org/10.1007/s10799-013-0162-0
Lin, T. C., Huang, S. L., & Hsu, C. J. (2015). A dual-factor model of loyalty to IT product – The case of smartphones. International Journal of Information Management, 35, 215–228.
Mabanza, N. (2018). Evaluating the usability of flat panel displays: A case study of the faculty of engineering and information technology. In Proceedings of the International Conference on Advances in Big Data, Computing and Data Communication Systems (icABCD). https://doi.org/10.1109/ICABCD.2018.8465477
Milicevic, V., Denic, N., Milicevic, Z., Arsic, L., Spasic-Stojkovic, M., Petkovic, D., Stojanovic, J., Krkic, M., Milovancevic, N. S., & Jovanovic, A. (2021). E-learning perspectives in higher education institutions. Technological Forecasting & Social Change. https://doi.org/10.1016/j.techfore.2021.120618
Moraga, M. A., Calero, C., Piattini, M., & Diaz, O. (2007). Improving a portlet usability model. Software Quality Journal, 15, 155–177. https://doi.org/10.1007/s11219-006-9008-x
Nascimento, B., Oliveira, T., & Tam, C. (2018). Wearable technology: What explains continuance intention in smartwatches? Journal of Retailing and Consumer Services, 43, 157–169. https://doi.org/10.1016/j.jretconser.2018.03.017
Ngampornchai, A., & Adams, J. (2016). Students’ acceptance and readiness for e-learning in Northeastern Thailand. International Journal of Educational Technology in Higher Education, 13(34). https://doi.org/10.1186/s41239-016-0034-x
Nielsen, J. (1993). Usability engineering. Boston, EEUU: AP Professional
Nouman, N., & Umer, A. (2019). Web navigation and usability analysis of educational websites in Pakistan. In Proceedings of the Seventh International Conference on Digital Information Processing and Communications (ICDIPC) (pp. 57–62). https://doi.org/10.1109/ICDIPC.2019.8723704
Obienu, A. C., & Amadin, F. I. (2020). User acceptance of learning innovation: A structural equation modelling based on the GUAM framework. Education and Information Technologies. https://doi.org/10.1007/s10639-020-10341-x
Oghuma, A. P., Libaque-Saenz, C. F., Wong, S. F., & Chang, Y. (2016). An expectation-confirmation model of continuance intention to use mobile instant messaging. Telematics and Informatics, 33, 34–47.
Oghuma, A. P., Chang, Y., Libaque-Saenz, C. F., Park, M. C., & Rho, J. J. (2015). Benefit-confirmation model for post-adoption behavior of mobile instant messaging applications: A comparative analysis of KakaoTalk and Joyn in Korea. Telecommunications Policy, 39, 658–677.
Olsina, L., Santos, L., & Lew, P. (2014). Evaluating mobileapp usability: A holistic quality approach. In S. Casteleyn, G. Rossi, and M. Winckler (Eds.): ICWE 2014, LNCS 8541 (pp. 111–129). Switzerland: Springer.
Oulasvirta, A., Engelbrecht, K., Jameson, A., & Möller, S. (2019). The usability of spoken dialogue system design. Designing Human Interface in Speech Technology. https://doi.org/10.1007/0-387-24156-6_7
Pangestu, H., & Karsen, M. (2016). Evaluation of usability in online learning. In International Conference on Information Management and Technology (ICIMTech) (pp. 267–271). https://doi.org/10.1109/ICIMTech.2016.7930342
Pirhonen, A. (2005). Supporting a user facing a novel application: Learnability in OOBE. Personal and Ubiquitous Computing, 9, 218–226. https://doi.org/10.1007/s00779-004-0323-6
Rafla, T., Robillard, P. N., & Desmarais, M. (2007). A method to elicit architecturally sensitive usability requirements: Its integration into a software development process. Software Quality Journal, 15, 117–133. https://doi.org/10.1007/s11219-006-9009-9
Raita, E., & Oulasvirta, A. (2014). Mixed feelings? The relationship between perceived usability and user experience in the wild. In The 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (pp. 26–30)
Ramadiani, A. R., Selamat, M. H., Abdullah, R., Pa, N. C., & Azainil. (2016). User difficulties in e-learning system. In 2nd International Conference on Science in Information Technology (ICSITech). https://doi.org/10.1109/icsitech.2016.7852626
Rauf, A., Batool, S., Rehman, S. U., & Shahid, A. A. (2010). Survey based usability evaluation of Ms Word. In Proceedings of the International Conference on User Science Engineering (i-USEr) (pp. 195–198). https://doi.org/10.1109/IUSER.2010.5716750
Reinecke, K., & Bernstein, A. (2007). Culturally adaptive software: Moving beyond internationalization. In Aykin N. (Ed.) Usability and Internationalization. Global and Local User Interfaces (pp. 201–210). Springer, Berlin, Heidelberg
Reinecke, K., & Bernstein, A. (2011). Improving performance, perceived usability, and aesthetics with culturally adaptive user interfaces. ACM Transactions on Computer-Human Interaction, 18(2), 1–29. https://doi.org/10.1145/1970378.1970382
Reinecke, K., Schenkel, S., & Bernstein, A. (2010). Modeling a user’s culture. In E. G. Blanchard & D. Allard (Eds.), Handbook of Research on Culturally - Aware Information Technology: Perspectives and Models (pp. 242–264). USA.
Revythi, A., & Tselios, N. (2019). Extension of technology acceptance model by using system usability scale to assess behavioral intention to use e-learning. Education and Information Technologies, 24, 2341–2355.
Ringle, C. M., Wende, S., & Jan-Michael, B. (2015). SmartPLS 3. http://www.smartpls.com. Accessed 14 March 2021
Rosenbaum, S. (1989). Usability evaluations versus usability testing: When and why? IEEE Transactions on Professional Communication, 32(4), 210–216. https://doi.org/10.1109/47.44533
Safsouf, Y., Mansouri, K., & Poirier, F. (2020). Smart learning environment, measure online student satisfaction: a case study in the context of higher education in Morocco. In Proceedings of 4th International Conference on Electrical and Information Technologies. https://doi.org/10.1109/ICEIT48248.2020.9113189
Salloum, S. A., Al-Emran, M., Shaalan, K., & Tarhini, A. (2019). Factors affecting the E-learning acceptance: A case study from UAE. Education and Information Technologies, 24, 509–530.
Saputra, R., Isnaini, N., Adhy, S., Bahtiar, N., Abidin, Z., & Suharto, E. (2020). Factors influencing student’s adoption of e-learning in Indonesian secondary schools. In Proceedings of 4th International Conference on Informatics and Computational Sciences (ICICoS). https://doi.org/10.1109/ICICoS51170.2020.9299109
Sauro, J. (2013). How to measure learnability. MeasuringU mixed-methods research and software firm. https://measuringu.com/measure-learnability/. Accessed 12 March 2021
Scholtz, B. M., Mahmud, I., & Ramayah, T. (2016). Does usability matter? an analysis of the impact of usability on technology acceptance in ERP settings. Interdisciplinary Journal of Information, Knowledge, and Management, 11, 309–330. https://doi.org/10.28945/3591
Scholtz, B., Calitz, A., & Cilliers, C. (2013). Usability evaluation of a medium-sized ERP system in higher education. Electronic Journal of Information Systems Evaluation, 16(2), 148–161.
Seaborn, K., Satoh, Y., & Fels, D. I. (2016). usability and safety of a hud during powered chair navigation: A pilot study. In M. Antona and C. Stephanidis (Eds.): UAHCI 2016, Part III, LNCS 9739 (pp. 628–638). Switzerland: Springer.
Sears, A., & Shneiderman, B. (1994). Split menus: Effectively using selection frequency to organize menus. ACM Transactions on Computer-Human Interaction, 1(1). https://doi.org/10.1145/174630.174632
Seffah, A., Donyaee, M., Kline, R. B., & Padda, H. K. (2006). Usability measurement and metrics: A consolidated model. Software Quality Journal, 14, 159–178. https://doi.org/10.1007/s11219-006-7600-8
Sholiq, Auda, R.A., Subriadi, A.P., Tjahyanto, A., & Wulandari, A.D. (2021). Measuring software quality with usability, efficiency, and portability characteristics. IOP Conference Series: Earth and Environmental Science, 704. https://doi.org/10.1088/1755-1315/704/1/012039
Singh, A., & Wesson, J. L. (2009). Evaluation criteria for assessing the usability of ERP systems. In Proceedings of the 2009 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists (pp. 87–95). New York : ACM.
Stone, R. W., & Baker-Eveleth, L. (2013). Students’ expectation, confirmation, and continuance intention to use electronic textbooks. Computers in Human Behavior, 29, 984–990. https://doi.org/10.1016/j.chb.2012.12.007
Suzianti, A., & Paramadini, S.A. (2021). Continuance intention of e-learning: The Condition and Its Connection with Open Innovation. Journal of Open Innovation: Technology, Market, and Complexity, 7 (97). https://doi.org/10.3390/joitmc7010097
Tam, C., Santos, D., & Oliveira, T. (2020). Exploring the influential factors of continuance intention to use mobile Apps: Extending the expectation confirmation model. Information Systems Frontiers, 22, 243–217. https://doi.org/10.1007/s10796-018-9864-5
Tesavrita, C., Suryadi, K., & Wiratmadja, I. I. (2016). Web Usability and Self-Efficacy in Promoting Individual Knowledge Sharing. Proceedings of the IEEE International Conference on Industrial Engineering and Engineering Management (IEEM) (pp. 16–20). https://doi.org/10.1109/IEEM.2016.7797827
Venkatesh, V., & Goyal, S. (2010). Expectation disconfirmation and technology adoption: Polynomial modeling and response surface analysis. MIS Quarterly, 34(2), 281–303.
Venkatesh, V., Thong, J. Y. L., Chan, F. K. Y., Hu, P. J. H., & Brown, S. A. (2011). Extending the twostage information systems continuance model: Incorporating UTAUT predictors and the role of context. Information Systems Journal, 21(6), 527–555. https://doi.org/10.1111/j.1365-2575.2011.00373
Wang, L. Y. K., Lew, S. K., Lau, S. H., & Leow, M. C. (2019). Usability factors predicting continuance of intention to use cloud e-learning application. Heliyon, 5. https://doi.org/10.1016/j.heliyon.2019.e01788
Watanabe, W. M., de Mattos Fortes, R. P., & Pimentel, M. D. G. C. (2011). The link-offset-scale mechanism for improving the usability of touch screen displays on the web. In P. Campos et al. (Eds.): INTERACT 2011, Part III, LNCS 6948 (pp. 356–372). Berlin: Springer-Verlag.
Weichbroth, P. (2020). Usability of mobile applications: A systematic literature study. IEEE Access, 8, 55563–55577. https://doi.org/10.1109/ACCESS.2020.2981892
Xu, F., & Du, J. T. (2018). Factors influencing users’ satisfaction and loyalty to digital libraries in Chinese universities. Computers in Human Behavior, 83, 64–72.
Yeung, P., & Jordan, E. (2006). Understanding the continued usage of business e-learning courses in HK corporations. In D. Kumar & J. Tumer, (Eds.): Education for the 21st Century-Impact of ICT and Digital Resources (pp. 245–254). Boston: Springer.
Yu, Y., & Liu, Z. (2008). Research on system usability of digital libraries in China. Proceedings of the IEEE International Symposium on Electronic Design, Test & Applications. https://doi.org/10.1109/DELTA.2008.22
Yuan, H., Lao, C. C., Hu, S. L., Zhang, Q. L., & Liang B. K. (2019). Design and usability of the touch-based interface of CNC presses. In Proceedings of the International Conference on Information Technology and Computer Application (ITCA) (pp. 39–52). https://doi.org/10.1109/ITCA49981.2019.00016
Yusuf, S. U., Taslim, J., Adnan, W. A. W., & Baharudin, S. K. (2014). Usability evaluation of human resource management information system (HRMIS). In Proceedings of the 3rd International Conference on User Science and Engineering (i-USEr) (pp. 204–209). https://doi.org/10.1109/IUSER.2014.7002703
Zali, Z., & Fadzlah, A. F. A. (2016). An initial theoretical usability evaluation model for assessing defence mobile e-based application system. In Proceedings of the International Conference on Information and Communication Technology (ICICTM) (pp. 198–202). https://doi.org/10.1109/ICICTM.2016.7890800
Zardari, B. A., Hussain, Z., Arain, A. A., Rizvi, W. H., & Vighio, M. S. (2020). QUEST e-learning portal: Applying heuristic evaluation, usability testing and eye tracking. Universal Access in the Information Society. https://doi.org/10.1007/s10209-020-00774-z
Author information
Authors and Affiliations
Contributions
AR made substantial contributions to the whole part of the Manuscript and the data analysis, also involved in revising the manuscript to meet the journal standard. ANH involved in the analysis of data. GAS involved in writing the whole part of the Manuscript and analysis of data. IW and NNA were involved in the acquisition of data and interpretation of data. JAJ involved in the literature study.
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ramadhan, A., Hidayanto, A.N., Salsabila, G.A. et al. The effect of usability on the intention to use the e-learning system in a sustainable way: A case study at Universitas Indonesia. Educ Inf Technol 27, 1489–1522 (2022). https://doi.org/10.1007/s10639-021-10613-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-021-10613-0