Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

A fuzzy-based framework for evaluation of website design quality index

Published: 01 March 2021 Publication History

Abstract

An unrecognized significance of the web acts as a driving force for the massive and rapid growth of websites in each domain of social life. For making a successful website, it is necessary for developers to embrace appropriate web testing and evaluation methodology. Some valuable works in the past have striven to appraise the web applications quantitatively. Various parameters have been considered which are again sub-parameterized to measurable indicators. But their weighing criterion has not been appropriately taken into account according to the domain of the website. Also, the relative degrees of interactions among parameters have not been taken into consideration. The work presented in this paper aims at describing a framework, Quality Index Evaluation Method to gauge the design quality of a website in the form of index value. An automated tool has been designed and coded to measure the metrics quantitatively. A weighing technique based on Fuzzy-DEMATEL (Decision Making Trial and Evaluation Laboratory Method) has been applied on these metrics. Fuzzy trapezoidal numbers have been used for assessment of parameters and the final design quality index value. To verify the use of framework in different website domains, it has been exercised on eight academic (four institutional and four digital libraries), five informative and four commercial websites. The results have been validated through the most widely used method in literature, i.e., user judgment. Opinions of users for each website have been quantified and aggregated with fuzzy aggregation technique. Experimental results show that the proposed framework provides accurate and consistent results in very less time.

References

[1]
Asano Y, Koide S, Iwayama M, et al. Constructing a site for publishing open data of the ministry of economy, trade, and industry New Gener. Comput. 2016 34 4 341-366
[2]
Bai B, Law R, and Wen I The impact of website quality on customer satisfaction and purchase intentions: evidence from Chinese online visitors Int. J. Hosp. Manag. 2008 27 3 391-402
[3]
Calero C, Ruiz J, and Piattini M Classifying web metrics using the web quality model Online Inf. Rev. 2005 29 3 227-248
[4]
Gregg DG and Walczak S The relationship between website quality, trust and price premiums at online auctions Electron. Commer. Res. 2010 10 1 1-25
[5]
Jones C and Kim S Influences of retail brand trust, off-line patronage, clothing involvement and website quality on online apparel shopping intention Int. J. Consum. Stud. 2010 34 6 627-637
[6]
Kaya T and Kahraman C A fuzzy approach to e-banking website quality assessment based on an integrated AHP-ELECTRE method Technol. Econ. Dev. Econ. 2011 17 2 313-334
[7]
Aladwani AM and Palvia PC Developing and validating an instrument for measuring user-perceived web quality Inf. Manag. 2002 39 6 467-476
[8]
Cocquebert E, Trentesaux D, and Tahon C WISDOM: a website design method based on reusing design and software solutions Inf. Softw. Technol. 2010 52 12 1272-1285
[9]
Éthier J, Hadaya P, Talbot J, and Cadieux J Interface design and emotions experienced on B2C Web sites: empirical testing of a research model Comput. Hum. Behav. 2008 24 6 2771-2791
[10]
Huang TCK and Huang CH An integrated decision model for evaluating educational web sites from the fuzzy subjective and objective perspectives Comput. Educ. 2010 55 2 616-629
[11]
Lee S and Koubek RJ The effects of usability and web design attributes on user preference for e-commerce web sites Comput. Ind. 2010 61 4 329-341
[12]
Şengel E and Öncü S Conducting preliminary steps to usability testing: investigating the website of Uludağ University Proc. Soc. Behav. Sci. 2010 2 2 890
[13]
Akbulut ÖE and Akbulut K Web site designers’ opinions about the visual elements Proc. Soc. Behav. Sci. 2010 2 2 1549-1553
[14]
Moshagen M and Thielsch MT Facets of visual aesthetics Int. J. Hum Comput Stud. 2010 68 10 689-709
[15]
Zeng L, Salvendy G, and Zhang M Factor structure of web site creativity Comput. Hum. Behav. 2009 25 2 568-577
[16]
Caballero-Luque A, Aragonés-Beltrán P, García-Melón M, and Dema-Pérez C Analysis of the alignment of company goals to web content using ANP Int. J. Inform. Technol. Decis. Mak. 2010 9 03 419-436
[17]
Cormany D and Baloglu S Medical travel facilitator websites: an exploratory study of web page contents and services offered to the prospective medical tourist Tour. Manag. 2011 32 4 709-716
[18]
Xiaosong, L., Ye, L., Zizhou, F., Will, L.: A quantitative approach in heuristic evaluation of e-commerce websites. Int. J. Artif. Intell. Appl. (IJAIA) 9(1), (2018). https://arxiv.org/abs/1801.04829
[19]
Gupta S and Dubey SK Singh R, Choudhury S, and Gehlot A Adaptability evaluation of E-commerce websites in Indian perspective Intelligent Communication, Control and Devices. Advances in Intelligent Systems and Computing 2018 Singapore Springer 847-854
[20]
Cebi S A quality evaluation model for the design quality of online shopping websites Electron. Commer. Res. Appl. 2013 12 2 124-135
[21]
Mavromoustakos S and Andreou AS WAQE: a web application quality evaluation model Int. J. Web Eng. Technol. 2006 3 1 96-120
[22]
Mich L, Franch M, and Gaio L Evaluating and designing web site quality IEEE Multimed. 2003 10 1 34-43
[23]
Mich, L.: Evaluating website quality by addressing quality gaps: a modular process. In: (2014) IEEE International Conference on Software Science, Technology and Engineering (SWSTE), Jun 11, pp. 42–49, IEEE (2014).
[24]
Olsina L and Rossi G Measuring web application quality with WebQEM IEEE Multimed. 2002 9 4 20-29
[25]
Torrente MCS, Prieto ABM, GutiéRrez DA, and De Sagastegui MEA Sirius: a heuristic-based framework for measuring web usability adapted to the type of website J. Syst. Softw. 2013 86 3 649-663
[26]
Berners-Lee, T.: Web Index. http://theWebindex.org (2014). Accessed 11 July 2016
[27]
Malhotra, R., Sharma, A.: A neuro-fuzzy classifier for website quality prediction. In: 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp. 1274–1279 IEEE (2013).
[28]
Alsmadi, I., Al-Taani, A.T., Zaid, N.A.: Web structural metrics evaluation. In: Developments in E-systems Engineering (DESE), pp. 225–230 IEEE (2010).
[29]
Banos V and Manolopoulos Y A quantitative approach to evaluate website archivability using the CLEAR + method Int. J. Digit. Libr. 2016 17 2 119-141
[30]
Wu HH, Chen HK, and Shieh JI Evaluating performance criteria of employment service outreach program personnel by DEMATEL method Expert Syst. Appl. 2010 37 7 5219-5223
[31]
Wu WW and Lee YT Developing global managers’ competencies using the fuzzy DEMATEL method Expert Syst. Appl. 2007 32 2 499-507
[32]
Yang JL and Tzeng GH An integrated MCDM technique combined with DEMATEL for a novel cluster-weighted with ANP method Expert Syst. Appl. 2011 38 3 1417-1424
[33]
Wu HH and Tsai YN A DEMATEL method to evaluate the causal relations among the criteria in auto spare parts industry Appl. Math. Comput. 2011 218 5 2334-2342
[34]
Suo WL, Feng B, and Fan ZP Extension of the DEMATEL method in an uncertain linguistic environment Soft. Comput. 2012 16 3 471-483
[35]
Chang B, Chang CW, and Wu CH Fuzzy DEMATEL method for developing supplier selection criteria Expert Syst. Appl. 2011 38 3 1850-1858
[36]
DeMarco T Management can Make Quality (IM) Possible 1999 Boston Cutter IT Summit
[37]
Lilburne, B., Prajwol, D., Khan, K.M., Khosrowpour, M.: Measuring quality metrics for web applications. In: Proceedings of the 15th Information Resources Management Association International Conference, Held in New Orleans, USA, 23–26 May (2004)
[38]
ISO/IEC 9126:1991: Software product evaluation—quality characteristics and guidelines for their use. Geneva (1991)
[39]
ISO 13407:1999: Human-centred design processes for interactive systems. Geneva (1999)
[40]
ISO 9241-11:1998: Ergonomic requirements for office work with visual display terminals (VDTs)—Part 11: guidance on usability. Geneva (1998)
[41]
ISO/IEC 25010:2011: Systems and software engineering—software product quality requirements and evaluation (SQuaRE)—software product quality and system quality in use models. Geneva (2011)
[42]
ISO 9001:2015: Quality management system standard. Geneva (2015)
[43]
Effendi, F.S., Alfina, I.: Quality evaluation of airline’s e-commerce website, a case study of AirAsia and Lion Air websites. In: 2014 International Conference on Advanced Computer Science and Information Systems (ICACSIS), pp. 125–128, IEEE (2014).
[44]
Joo S, Lin S, and Lu K A usability evaluation model for academic library websites: efficiency, effectiveness and learnability J. Libr. Inform. Stud. 2011 9 2 11-26
[45]
Santos, A.M.: Theoretical-Methodological proposal to evaluate the quality of educational websites to support education. In: Proceedings of the 3rd International Conference on Technological Ecosystems for Enhancing Multiculturality, pp. 397–401 ACM (2015).
[46]
Baloglu S and Pekcan YA The website design and internet site marketing practices of upscale and luxury hotels in Turkey Tour. Manag. 2006 27 1 171-176
[47]
Pranić L, Garbin Praničević D, and Arnerić J Hotel website performance: evidence from a transition country Tour. Hosp. Manag. 2014 20 1 45-60
[48]
Elkhani N, Soltani S, and Bakri A An effective model for evaluating website quality considering customer satisfaction and loyalty: evidence of airline websites IJCSI Int. J. Comput. Sci. Issues 2013 10 2 109
[49]
Law R, Qi S, and Buhalis D Progress in tourism management: a review of website evaluation in tourism research Tour. Manag. 2010 31 3 297-313
[50]
Afonso, A.P., Lima, J.R., Cota, M.P.: A heuristic evaluation of usability of Web interfaces. In: 2012 7th Iberian Conference on Information Systems and Technologies (CISTI), 1–6 IEEE (2012)
[51]
Schäfer K and Kummer TF Determining the performance of website-based relationship marketing Expert Syst. Appl. 2013 40 18 7571-7578
[52]
Kaur A and Dani D The web navigability structure of e-banking in India Int. J. Inform. Technol. Comput. Sci. (IJITCS) 2013 5 5 29
[53]
Chinthakayala KC, Zhao C, Kong J, and Zhang K A comparative study of three social networking websites World Wide Web 2014 17 6 1233-1259
[54]
Chu SC and Kim Y Determinants of consumer engagement in electronic word-of-mouth (eWOM) in social networking sites Int. J. Advert. 2011 30 1 47-75
[55]
Kincl T and Štrach P Measuring website quality: asymmetric effect of user satisfaction Behav. Inform. Technol. 2012 31 7 647-657
[56]
Suwawi, D.D.J., Darwiyanto, E., Rochmani, M.: Evaluation of academic website using ISO/IEC 9126. In: 2015 3rd International Conference on Information and Communication Technology (ICoICT), pp. 222–227 IEEE (2015).
[57]
Lorca P, de Andrés J, and Martínez AB Does web accessibility differ among banks? World Wide Web 2016 19 3 351-373
[58]
Xie I, Joo S, and Matusiak KK Multifaceted evaluation criteria of digital libraries in academic settings: similarities and differences from different stakeholders J. Acad. Libr. 2018 44 6 854-863
[59]
Asmaran M Quantitative and qualitative evaluation of three search engines (Google, Yahoo, and Bing) Am. Sci. Res. J. Eng. Technol. Sci. (ASRJETS) 2016 26 2 97-106
[60]
Ismail A and Kuppusamy KS Accessibility of Indian universities’ homepages: an exploratory study J. King Saud Univ. Comput. Inform. Sci. 2018 30 268-278
[61]
Lin CL and Wu WW A fuzzy extension of the DEMATEL method for group decision making Eur. J. Oper. Res. 2004 156 445-455
[62]
Lin CJ and Wu WW A causal analytical method for group decision-making under fuzzy environment Expert Syst. Appl. 2008 34 1 205-213
[63]
Wei G, Zhao X, and Wang H An approach to multiple attribute group decision making with interval intuitionistic trapezoidal fuzzy information Technol. Econ. Dev. Econ. 2012 18 2 317-330
[64]
Zadeh LA The concept of a linguistic variable and its application to approximate reasoning. (Part II) Inform. Sci. 1975 8 301-357
[65]
Felix A and Devadoss AV A fuzzy DEMATEL—trapezoidal structure for modeling cause and effect relationships of youth violence Int. J. Data Min. Tech. Appl. 2013 2 292-303
[66]
Pearson JM and Pearson AM An exploratory study into determining the relative importance of key criteria in web usability: a multi-criteria approach J. Comput. Inform. Syst. 2008 48 4 115-127
[67]
Rocha A Framework for a global quality evaluation of a website Online Inf. Rev. 2012 36 3 374-382
[68]
Tsabadze T A method for aggregation of trapezoidal fuzzy estimates under group decision-making Fuzzy Sets Syst. 2015 266 114-130
[69]
Ismailova R and Inal Y Accessibility evaluation of top university websites: a comparative study of Kyrgyzstan, Azerbaijan, Kazakhstan and Turkey Univ. Access Inf. Soc. 2018 17 2 437-445
[70]
Chowdhury G Sustainability of digital libraries: a conceptual model and a research framework Int. J. Digit. Libr. 2014 14 3–4 181-195

Cited By

View all
  • (2024)Accessibility engineering in web evaluation process: a systematic literature reviewUniversal Access in the Information Society10.1007/s10209-023-00967-223:2(653-686)Online publication date: 1-Jun-2024
  • (2023)Importance of the perceived quality of touchpoints for customer journey analysis – evidence from the B2B sectorElectronic Commerce Research10.1007/s10660-022-09654-523:3(1515-1538)Online publication date: 1-Sep-2023

Index Terms

  1. A fuzzy-based framework for evaluation of website design quality index
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image International Journal on Digital Libraries
          International Journal on Digital Libraries  Volume 22, Issue 1
          Mar 2021
          142 pages
          ISSN:1432-5012
          EISSN:1432-1300
          Issue’s Table of Contents

          Publisher

          Springer-Verlag

          Berlin, Heidelberg

          Publication History

          Published: 01 March 2021
          Accepted: 13 July 2020
          Revision received: 23 April 2020
          Received: 10 September 2018

          Author Tags

          1. Website design quality evaluation
          2. Fuzzy-DEMATEL
          3. Fuzzy trapezoidal
          4. Website design quality index
          5. HTML parser

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 01 Jan 2025

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)Accessibility engineering in web evaluation process: a systematic literature reviewUniversal Access in the Information Society10.1007/s10209-023-00967-223:2(653-686)Online publication date: 1-Jun-2024
          • (2023)Importance of the perceived quality of touchpoints for customer journey analysis – evidence from the B2B sectorElectronic Commerce Research10.1007/s10660-022-09654-523:3(1515-1538)Online publication date: 1-Sep-2023

          View Options

          View options

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media