Abstract
Analyzing evaluation results of usability and user experience studies has its limitations when it comes to personalized user interfaces, highly complex and connected systems, or internationally used services involving millions of users. To support the analysis of the evaluation results of usability and user experience, a task-based evaluation approach is proposed. This approach uses multiple visualization views to support the analysis of evaluation results. The visualization offers different temporal views ranging from individual to more cumulative data views in order to combine results from evaluations and task models. The applicability of this approach is presented on a simple but demonstrative case study from television and entertainment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bernhaupt, R., Palanque, P.: POISE - a framework for systemic change analysis (2020, in preparation)
Bernhaupt, R., Navarre, D., Palanque, P., Winckler, M.: Model-based evaluation: a new way to support usability evaluation of multimodal interactive applications. In: Law, E.L.C., Hvannberg, E.T., Cockton, G. (eds.) Maturing Usability: Quality in Software, Interaction and Value. HCIS, pp. 96–119. Springer, London (2008). https://doi.org/10.1007/978-1-84628-941-5_5
Bernhaupt, R., Palanque, P., Drouet, D., Martinie, C.: Enriching task models with usability and user experience evaluation data. In: Bogdan, C., Kuusinen, K., Lárusdóttir, M.K., Palanque, P., Winckler, M. (eds.) HCSE 2018. LNCS, vol. 11262, pp. 146–163. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-05909-5_9
Bernhaupt, R., Palanque, P., Manciet, F., Martinie, C.: User-test results injection into task-based design process for the assessment and improvement of both usability and user experience. In: Bogdan, C., et al. (eds.) HESSD/HCSE -2016. LNCS, vol. 9856, pp. 56–72. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-44902-9_5
Brooke, J., et al.: SUS-a quick and dirty usability scale. In: Jordan, P.W., Thomas, B., McClelland, I.L., Weerdmeester, B. (eds.) Usability Evaluation in Industry, pp. 189–194. Taylor & Francis, Abingdon (1996)
Diaper, D.: Task analysis for knowledge descriptions (TAKD): the method and an example. In: Task Analysis for Human-Computer Interaction, pp. 108–159. Lawrence Erlbaum Associates (1990)
Eiselmayer, A., Wacharamanotham, C., Beaudouin-Lafon, M., Mackay, W.E.: Touchstone2: an interactive environment for exploring trade-offs in HCI experiment design. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York (2019)
Fahssi, R., Martinie, C., Palanque, P.: Enhanced task modelling for systematic identification and explicit representation of human errors. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015. LNCS, vol. 9299, pp. 192–212. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22723-8_16
Goldberg, J.H., Wichansky, A.M.: Eye tracking in usability evaluation: a practitioner’s guide. In: The Mind’s Eye, pp. 493–516. Elsevier (2003)
Greenberg, S.: Working through task-centered system design. In: Diaper, D., Stanton, N. (eds.) The Handbook of Task Analysis for Human-Computer Interaction, pp. 49–66. Lawrence Erlbaum Associates, Hillsdale (2004)
Hassenzahl, M., Burmester, M., Koller, F.: AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In: Szwillus, G., Ziegler, J. (eds) Mensch & Computer 2003. Berichte des German Chapter of the ACM, vol. 57, pp. 187–196. Springer, Heidelberg (2003). https://doi.org/10.1007/978-3-322-80058-9_19
Johnson, P.: Interactions, collaborations and breakdowns. In: Proceedings of the 3rd Annual Conference on Task Models and Diagrams, pp. 1–3. ACM, New York (2004)
Johnson, P., Johnson, H., Hamilton, F.: Getting the knowledge into HCI: theoretical and practical aspects of task knowledge structures. In: Cognitive Task Analysis. Lawrence Erlbaum Associates (2000)
Lallemand, C., Gronier, G.: Méthodes de design UX: 30 méthodes fondamentales pour concevoir et évaluer les systèmes interactifs. Editions Eyrolles (2015)
Lazar, J., Feng, J.H., Hochheiser, H.: Research Methods in Human-Computer Interaction. Morgan Kaufmann, Burlington (2017)
Marti, P., Iacono, I.: Anticipated, momentary, episodic, remembered: the many facets of user experience. In: 2016 Federated Conference on Computer Science and Information Systems (FedCSIS), pp. 1647–1655 (2016)
Martinie, C., Palanque, P., Bouzekri, E., Cockburn, A., Canny, A., Barboni, E.: Analysing and demonstrating tool-supported customizable task notations, vol. 3. Association for Computing Machinery, New York, June 2019. https://doi.org/10.1145/3331154
Martinie, C., Palanque, P., Ragosta, M., Barboni, E.: Extending procedural task models by systematic explicit integration of objects, knowledge and information. In: Proceedings of the of the 31st European Conference on Cognitive Ergonomics, ECCE 2013. ACM, New York (2013)
Martinie, C., Palanque, P., Navarre, D., Winckler, M., Poupart, E.: Model-based training: an approach supporting operability of critical interactive systems. In: Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS 2011, pp. 53–62. ACM, New York (2011)
Meng, X., Foong, P.S., Perrault, S., Zhao, S.: NexP: a beginner friendly toolkit for designing and conducting controlled experiments. In: Bernhaupt, R., Dalvi, G., Joshi, A., K. Balkrishan, D., O’Neill, J., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10515, pp. 132–141. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67687-6_10
Navarre, D., Palanque, P., Paternò, F., Santoro, C., Bastide, R.: A tool suite for integrating task and system models through scenarios. In: Johnson, C. (ed.) DSV-IS 2001. LNCS, vol. 2220, pp. 88–113. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-45522-1_6
Paterno, F.: Task models in interactive software systems. In: Handbook of Software Engineering and Knowledge Engineering. World Scientific (2000)
Paternó, F., Mancini, C., Meniconi, S.: ConcurTaskTrees: a diagrammatic notation for specifying task models. In: Proceedings of IFIP INTERACT 1997, pp. 362–369. Lawrence Erlbaum Associates (1997)
Pinelle, D., Gutwin, C., Greenberg, S.: Task analysis for groupware usability evaluation: modelling shared-workspace tasks with the mechanics of collaboration. In: ACM Transactions on Computer-Human Interaction, vol. 10, no. 4. pp. 281–311. ACM, New York (2003)
Pirker, M.M., Bernhaupt, R.: Measuring user experience in the living room: results from an ethnographically oriented field study indicating major evaluation factors. In: Proceedings of the 9th European Conference on Interactive TV and Video, pp. 79–82. ACM, New York (2011)
Ragosta, M., Martinie, C., Palanque, P., Navarre, D., Sujan, M.A.: Concept maps for integrating modelling techniques for the analysis and re-design of partly-autonomous interactive systems. In: Proceedings of the 5th International Conference on Application and Theory of Automation in Command and Control Systems, ATACCS 2015, pp. 41–52. ACM, New York (2015)
Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., Riedl, J.: GroupLens: an open architecture for collaborative filtering of netnews. In: Smith, J.B., Smith, F.D., Malone, T.W. (eds.) Proceedings of the Conference on Computer Supported Cooperative Work, pp. 175–186. ACM (1994)
Rosson, M.B., Carroll, J.M.: Usability Engineering: Scenario-Based Development of Human-computer Interaction. Elsevier, Amsterdam (2001)
Roto, V., Law, E., Vermeeren, A., Hoonhout, J.: User experience white paper: bringing clarity to the concept of user experience. In: Dagstuhl Seminar on Demarcating User Experience, pp. 1–12 (2011)
Shneiderman, B.: The eyes have it: a task by data type taxonomy for information visualizations. In: Proceedings of the 1996 IEEE Symposium on Visual Languages, pp. 336–343 (1996)
Van der Veer, G., Lenting, B., Bergevoet, A.: GTA: groupware task analysis - modelling complexity. In: Acta Psychologica, New York, NY, vol. 91, no. 3, pp. 297–322 (1996)
Wallner, G., Kriglstein, S.: Visualization-based analysis of gameplay data - a review of literature. Entertain. Comput. 4(3), 143–155 (2013)
Winckler, M., Palanque, P., Freitas, C.: Tasks and scenario-based evaluation of information visualization techniques. In: Proceedings of the 3rd Annual Conference on Task Models and Diagrams, TAMODIA 2004, pp. 165–172. ACM, New York (2004)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 IFIP International Federation for Information Processing
About this paper
Cite this paper
Bernhaupt, R., Martinie, C., Palanque, P., Wallner, G. (2020). A Generic Visualization Approach Supporting Task-Based Evaluation of Usability and User Experience. In: Bernhaupt, R., Ardito, C., Sauer, S. (eds) Human-Centered Software Engineering. HCSE 2020. Lecture Notes in Computer Science(), vol 12481. Springer, Cham. https://doi.org/10.1007/978-3-030-64266-2_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-64266-2_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-64265-5
Online ISBN: 978-3-030-64266-2
eBook Packages: Computer ScienceComputer Science (R0)
