article

Using web quality models and a strategy for purpose-oriented evaluations

Authors:

Alexander Dieser,

Belen RiveraAuthors Info & Claims

Journal of Web Engineering, Volume 10, Issue 4

Pages 316 - 352

Published: 01 December 2011 Publication History

Abstract

Web applications and their quality evaluation has been the subject of abundant research. However, instantiated models have been used mostly for the purpose of understanding, rather than improving. In this paper, we propose utilizing a quality modeling framework together with a non-intrusive evaluation strategy to instantiate quality models with the specific purpose of not only to model and understand a Web application in-use, but also to improve it. Starting with a quality modeling framework, our approach instantiates models for both quality in use and external quality, resulting in a requirements tree for both followed by evaluation and then combined with a mechanism to develop relationships between them. Interpreting these relationships viz. 'depends on', and 'influences', in alignment with the ISO 25010 quality life cycle model, is the basis for continuous improvement. This is illustrated with a case study showing the underlying strategy from model instantiation to application improvement.

References

[1]

Basili V., Lindvall M., Regardie M., Seaman C., Heidrich J., Munch J., Rombach D., Trendowicz A.: Linking software development and business strategy through measurement. IEEE Computer, 43(4), pp. 57-65, 2010.

Digital Library

[2]

Becker P., Molina H., Olsina L.: Measurement and Evaluation as quality driver. In: Journal ISI (Ingénierie des Systèmes d'Information), Special Issue "Quality of Information Systems", Lavoisier, Paris, France, 15(6), pp. 33-62, 2010.

[3]

Bevan N.: Extending quality in use to provide a framework for usability measurement. In: LNCS 5619, Springer, HCI Int'l 2009, San Diego, USA, pp. 13-22, 2009.

[4]

Bevan N., Bohomolni I.: Incorporating user quality requirements in the software development process. In: Proceedings of 4th International Software Quality Week Europe, Brussels, pp. 1192- 1204, 2000.

[5]

Brambilla M., Comai S., Fraternali P., Matera M.: Designing Web Applications with WebML and WebRatio. In: Web Engineering. Modelling and Implementing Web Applications. Springer HCIS, Ch. 9, pp. 221-261, 2008.

[6]

Burton M., Walther J.: The value of Web log data in use-based design and testing. Journal of Computer-Mediated Communication, 6(3), 2001.

[7]

Cappiello C., Daniel F., Koschmider A., Matera M., Picozzi M.: A Quality Model for Mashups. In: LNCS 6757, Springer, Web Engineering, 11th Int'l Conference on Web Engineering (ICWE2011), Auer S., Díaz O., Papadopoulos G. (Eds.), Paphos, Cyprus, pp. 137-151, 2011.

[8]

Covella G., Olsina L.: Assessing Quality in Use in a Consistent Way. In ACM proceedings, Int'l Congress on Web Engineering, (ICWE'06), SF, USA, pp. 1-8, 2006.

Digital Library

[9]

Fernandez A., Insfran E., Abrahão S.: Integrating a Usability Model into a Model-Driven Web Development Process. In: LNCS 5802, Springer, 10th International Conference on Web Information Systems Engineering (WISE 2009), pp. 497-510, 2009.

Digital Library

[10]

Hassenzahl M.: User experience: towards an experiential perspective on product quality, IHM; V.339, Proc. 20th Int'l Conference of the Assoc. Francophone d'Interaction Homme-Machine, pp 11-15, 2008.

[11]

ISO/IEC 25010: Systems and software engineering. Systems and software Quality Requirements and Evaluation (SQuaRE). System and software quality models, 2011.

[12]

ISO/IEC CD 25010.3, Systems and software engineering. Systems and software Quality Requirements and Evaluation (SQuaRE). System and software quality models, 2009

[13]

ISO/IEC 25012: Software engineering -- Software product Quality Requirements and Evaluation (SQuaRE) -- Data quality model, 2008

[14]

ISO/IEC 9126-1. International Standard, Software Engineering - Product Quality - Part 1: Quality Model, 2001.

[15]

ISO 13407: User centered design process for interactive systems, 1998.

[16]

Lew P., Olsina L.: Instantiating Web Quality Models in a Purposeful Way, In: LNCS 6757, Springer, Web Engineering, 11th Int'l Conference on Web Engineering (ICWE2011), Auer S., Díaz O., Papadopoulos G. (Eds.), Paphos, Cyprus, pp. 214-229, 2011.

[17]

Lew P., Olsina L., Becker P., Zhang, L.: An Integrated Strategy to Understand and Manage Quality in Use for Web Applications. Requirements Engineering Journal, Springer, 16 (3), pp. 1- 32, DOI 10.1007/s00766-011-0128-x, 2011.

[18]

Lew P., Olsina L., Zhang L.: Quality, Quality in Use, Actual Usability and User Experience as Key Drivers for Web Application Evaluation, In: LNCS 6189, Springer, 10th Int'l Congress on Web Engineering (ICWE2010), Vienne, Austria, pp. 218-232, 2010.

[19]

METI, Ministry of Economy - Trade and Industry - Japan, Software Metrics Advanced Project, Investigative Report on Measure for System/Software Product Quality Requirement Definition and Evaluation, March 2011.

[20]

Molina, H., Olsina, L.: Assessing Web Applications Consistently: A Context Information Approach. IEEE CS, 8th Int'l Congress on Web Engineering, NY, US, pp. 224-230, 2008.

[21]

Moraga M. A, Bertoa M. F., Morcillo M.C., Calero C., Vallecillo A.: Evaluating Quality-in-Use Using Bayesian Networks. In Proc. of QAOOSE 2008, Paphos, Cyprus, 2008.

[22]

Murugesan S.: Web Application Development: Challenges and the Role of Web Engineering. Chap. 2 in Springer HCIS, Web Engineering: Modeling and Implementing Web Applications. Rossi G, Pastor O, Schwabe D, Olsina L (Eds.), pp. 7-32, 2008.

[23]

Nielsen, J: Involving Stakeholders in User Testing, Jakob Nielsen's Alertbox, May 24, 2010, Available at http://www.useit.com/alertbox/utest-observers.html, accessed in Jan, 2011

[24]

Olsina L., Sassano R., Mich L. Towards the Quality of Web 2.0 Applications, In proc. of 8th Int'l Workshop on Web-oriented Software Technology (IWWOST 2009) held at Int'l Congress on Web Engineering (ICWE09), San Sebastian, Spain, V. 493, pp. 3-15, CEUR (ceur-ws.org), ISSN 1613-0073, 2009.

[25]

Olsina L., Papa F., Molina H.: How to Measure and Evaluate Web Applications in a Consistent Way. In: Modelling and Implementing Web Applications. Springer HCIS, Ch. 13, pp. 385-420, 2008.

[26]

Olsina L., Rossi G., Garrido A., Distante D., Canfora G.: Web Applications Refactoring and Evaluation: A Quality-Oriented Improvement Approach, Journal of Web Engineering, Rinton Press, US, 7 (4), pp. 258-280, 2008.

[27]

Olsina, L.; Lafuente, G. Pastor, O., Towards a Reusable Repository of Web Metrics, Journal of Web Engineering, Rinton Press, US, 1 (1), pp. 61-73, ISSN 1540-9589, 2002.

[28]

Olsina L., Rossi G.: Measuring Web Application Quality with WebQEM, IEEE Multimedia, 9 (4), pp. 20-29, 2002.

Digital Library

[29]

Papa M. F. Becker P., Olsina L.: Assessing Integrated Measurement and Evaluation Strategies: A Case Study, To appear in: IEEE Xplore proceeding: 7th Central Eastern European Software Engineering Conference (CEE-SECR 2011), Moscow, Russia, 2011.

[30]

Prates, R., de Souza, C.; Barbosa, S.: A method for communicability evaluation of user interfaces. Interactions, ACM, 7(1), pp. 31-3, 2000.

[31]

SPEM. Software Process Engineering Metamodel Specification. Doc./02-11-14., Ver.1.0, 2002.

Cited By

Fogli DGuida G(2018)Evaluating Quality in Use of Corporate Web SitesACM Transactions on the Web10.1145/318464612:3(1-35)Online publication date: 17-Jul-2018
https://dl.acm.org/doi/10.1145/3184646
Olsina L(2012)Engineering the evaluation approach to fit different web project and organization needsProceedings of the 12th international conference on Web Engineering10.1007/978-3-642-31753-8_54(502-503)Online publication date: 23-Jul-2012
https://dl.acm.org/doi/10.1007/978-3-642-31753-8_54

Recommendations

Instantiating web quality models in a purposeful way
ICWE'11: Proceedings of the 11th international conference on Web engineering

Web applications and their quality evaluation has been the subject of abundant research. However, models have been used mostly for the purpose of understanding, rather than improving. In this work, we propose utilizing a quality modeling framework to ...
Improving quality in use of web applications in a systematic way
ICWE'11: Proceedings of the 11th international conference on Current Trends in Web Engineering

A first step to evaluate quality is to define nonfunctional requirements usually through quality models. The ISO 25010 standard describes one such model for general usage in specifying and evaluating software quality requirements, but its concepts need ...
An integrated strategy to systematically understand and manage quality in use for web applications

The main goal in evaluating software quality is to ultimately improve its quality. In this work, we discuss SIQinU (Strategy for Improving Quality in Use), a six-phased evaluation-driven strategy for understanding and improving software quality ...

Comments

Information & Contributors

Information

Published In

cover image Journal of Web Engineering

Journal of Web Engineering Volume 10, Issue 4

December 2011

102 pages

ISSN:1540-9589

Issue’s Table of Contents

Publisher

Rinton Press, Incorporated

Paramus, NJ

Publication History

Revised: 21 December 2011

Published: 01 December 2011

Received: 03 November 2011

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
80
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Fogli DGuida G(2018)Evaluating Quality in Use of Corporate Web SitesACM Transactions on the Web10.1145/318464612:3(1-35)Online publication date: 17-Jul-2018
https://dl.acm.org/doi/10.1145/3184646
Olsina L(2012)Engineering the evaluation approach to fit different web project and organization needsProceedings of the 12th international conference on Web Engineering10.1007/978-3-642-31753-8_54(502-503)Online publication date: 23-Jul-2012
https://dl.acm.org/doi/10.1007/978-3-642-31753-8_54

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents