Article

Assessing quality in use in a consistent way

Authors:

Guillermo J. Covella,

Luis A. OlsinaAuthors Info & Claims

ICWE '06: Proceedings of the 6th international conference on Web engineering

Pages 1 - 8

https://doi.org/10.1145/1145581.1145583

Published: 11 July 2006 Publication History

Abstract

In the present paper we discuss a systematic approach in order to specify, measure, and evaluate quality in use, i.e., the perceived quality of software or web applications by actual users in real con-texts of use. The methodological proposal is grounded on our measurement and evaluation framework which in turn is based on the metrics and indicators ontology. In order to illustrate the pro-posal a case study for assessing the quality in use of an e-Learning application was conducted. The final results are analyzed in the light of both the consistency of the methodological support and the challenges of assessing quality in use with actual users.

References

[1]

Avgeriou, P.; Papasalouros, A.; Retalis S., Skordlakis; Towards a Pattern Language for Learning Management Sys-tems, 2003, ISSN 1436--4522.

[2]

Bevan, N.; Usability is Quality in Use, 6th International Conference on Human Computer Interaction, Yokohama, Anzai & Ogawa Eds., Elsevier, 1995.

[3]

Brooke, J.; "SUS -- A 'quick and dirty' usability scale", Digital Equipment, Reading, UK. (document accessed by 2005/12/29). www.usability.serco.com/trump/documents/Suschapt.doc.

[4]

Covella, G.; Olsina L.; Specifying Quality Attributes for Sites with E-Learning Functionality. ICWE'02, Santa Fe, Argentina, pp. 154--167, 2002, ISSN 1666-6526.

[5]

ISO 9241--11 Ergonomic requirements for office work with visual display terminals (VDT) - Part 11 Guidance on Us-ability, 1998.

[6]

ISO/IEC 14598-1. Information Technology-Software Product Evaluation-Part 1: General overview, 1999.

[7]

ISO/IEC 9126-1. Software Engineering Software Product Quality-Part 1: Quality Model, Int'l Org. for Standardization, Geneva, 2001.

[8]

ISO/IEC DTR 9126-4. Software Engineering Product Quality - Part 4: Quality in Use Metrics, 2002.

[9]

Milutinovic, V.; Skundric N.; Will Distance Learning Create a Global University? IEEE Computer, 36(3), 2003.

Digital Library

[10]

Nielsen, J.; The Alertbox column, from 1995 to 2005, http://www.useit.com/alertbox/ accessed by 2005/12/29

[11]

Olsina, L.; Rossi, G.; Measuring Web Application Quality with WebQEM. IEEE Multimedia, 9(4), pp. 20--29, 2002.

Digital Library

[12]

Olsina, L.; Martín M.; Ontology for Software Metrics and Indicators, Journal of Web Engineering, Rinton Press, US, Vol 2 N° 4, pp. 262--281, 2004, ISSN 1540-9589.

Digital Library

[13]

Olsina, L.; Covella, G.; Rossi, G.; Web Quality Chapter of the Book named Web Engineering: Theory and Practice of Metrics and Measurement for Web Development, Emilia Mendes and Nile Mosley Eds., Spinger Verlag, 2005, ISBN 3-540-28196-7.

[14]

Olsina, L.; Papa, F.; Molina H.; Organization-oriented Measurement and Evaluation Framework for Software and Web Engineering Projects, in LNCS Vol. 3579, ICWE 2005, Sydney, Australia, pp. 42--52, 2005, ISBN 3-540-27996-2.

Digital Library

[15]

Olsina, L; Papa, F.; Molina, H; Ontological Support for a Measurement and Evaluation Framework, To appear in the Journal of Intelligent Systems (Spring 2006).

Digital Library

Cited By

Erazo-Garzon LIllescas-Peña LCedillo P(2021)A Quality in Use Model for Ambient Assisted Living (AAL) SystemsApplied Technologies10.1007/978-3-030-71503-8_50(643-660)Online publication date: 1-Apr-2021
https://doi.org/10.1007/978-3-030-71503-8_50
Olsina LLew PDieser ARivera B(2018)Using web quality models and a strategy for purpose-oriented evaluationsJournal of Web Engineering10.5555/2230856.223085810:4(316-352)Online publication date: 21-Dec-2018
https://dl.acm.org/doi/10.5555/2230856.2230858
Petasakis ITheodosiou TKazanidis IValsamidis S(2018)Multicriteria analysis of e-learning coursesInternational Journal of Data Analysis Techniques and Strategies10.1504/IJDATS.2015.0687517:2(203-215)Online publication date: 14-Dec-2018
https://dl.acm.org/doi/10.1504/IJDATS.2015.068751
Show More Cited By

Index Terms

Assessing quality in use in a consistent way
1. Software and its engineering
  1. Software creation and management
    1. Software development techniques
      1. Reusability
        Software product lines

Recommendations

Evaluating Quality in Use of Corporate Web Sites: An Empirical Investigation

In our prior work, we presented a novel approach to the evaluation of quality in use of corporate web sites based on an original quality model (QM-U) and a related methodology (EQ-EVAL). This article focuses on two research questions. The first one aims ...
Improving quality in use of web applications in a systematic way
ICWE'11: Proceedings of the 11th international conference on Current Trends in Web Engineering

A first step to evaluate quality is to define nonfunctional requirements usually through quality models. The ISO 25010 standard describes one such model for general usage in specifying and evaluating software quality requirements, but its concepts need ...
Assessing the Quality of Auction Web Sites
HICSS '01: Proceedings of the 34th Annual Hawaii International Conference on System Sciences ( HICSS-34)-Volume 7 - Volume 7

WebQual is an instrument for assessing the quality of Internet sites from the perspective of the customer. Earlier versions of WebQual focused on information and interaction quality. This paper reports on a new version of WebQual that incorporates three ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICWE '06: Proceedings of the 6th international conference on Web engineering

July 2006

384 pages

ISBN:1595933522

DOI:10.1145/1145581

General Chairs:
Dave Wolber
University of San Francisco, USA
,
Neil Calder
SLAC, USA
,
Program Chairs:
Chris Brooks
University of San Francisco, USA
,
Athula Ginige
University of Western Sydney, Australia

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

ACM: Association for Computing Machinery

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 July 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
1,084
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Erazo-Garzon LIllescas-Peña LCedillo P(2021)A Quality in Use Model for Ambient Assisted Living (AAL) SystemsApplied Technologies10.1007/978-3-030-71503-8_50(643-660)Online publication date: 1-Apr-2021
https://doi.org/10.1007/978-3-030-71503-8_50
Olsina LLew PDieser ARivera B(2018)Using web quality models and a strategy for purpose-oriented evaluationsJournal of Web Engineering10.5555/2230856.223085810:4(316-352)Online publication date: 21-Dec-2018
https://dl.acm.org/doi/10.5555/2230856.2230858
Petasakis ITheodosiou TKazanidis IValsamidis S(2018)Multicriteria analysis of e-learning coursesInternational Journal of Data Analysis Techniques and Strategies10.1504/IJDATS.2015.0687517:2(203-215)Online publication date: 14-Dec-2018
https://dl.acm.org/doi/10.1504/IJDATS.2015.068751
Musumba GWario R(2018)Towards Group Fuzzy Analytical Hierarchy ProcessInformation and Communication Technology for Development for Africa10.1007/978-3-319-95153-9_27(283-307)Online publication date: 5-Jul-2018
https://doi.org/10.1007/978-3-319-95153-9_27
Nyongesa HMusumba GChileshe N(2017)Partner selection and performance evaluation framework for a construction-related virtual enterprise: a multi-agent systems approachArchitectural Engineering and Design Management10.1080/17452007.2017.132439813:5(344-364)Online publication date: 13-May-2017
https://doi.org/10.1080/17452007.2017.1324398
Becker PLew POlsina L(2012)Specifying process views for a measurement, evaluation, and improvement strategyAdvances in Software Engineering10.1155/2012/9497462012(2-2)Online publication date: 1-Jan-2012
https://dl.acm.org/doi/10.1155/2012/949746
Lew POlsina LBecker PZhang L(2012)An integrated strategy to systematically understand and manage quality in use for web applicationsRequirements Engineering10.1007/s00766-011-0128-x17:4(299-330)Online publication date: 1-Nov-2012
https://dl.acm.org/doi/10.1007/s00766-011-0128-x
Lew POlsina L(2011)Instantiating web quality models in a purposeful wayProceedings of the 11th international conference on Web engineering10.5555/2027776.2027793(214-227)Online publication date: 20-Jun-2011
https://dl.acm.org/doi/10.5555/2027776.2027793
Becker PLew POlsina LRaffo DPfahl DZhang L(2011)Strategy to improve quality for software applicationsProceedings of the 2011 International Conference on Software and Systems Process10.1145/1987875.1987897(129-138)Online publication date: 21-May-2011
https://dl.acm.org/doi/10.1145/1987875.1987897
Lew POlsina L(2011)Instantiating Web Quality Models in a Purposeful WayWeb Engineering10.1007/978-3-642-22233-7_15(214-227)Online publication date: 2011
https://doi.org/10.1007/978-3-642-22233-7_15
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents