extended-abstract

On the retrospective assessment of users' experiences over time: memory or actuality?

Authors:

Evangelos Karapanos,

Jean-Bernard Martens,

Marc HassenzahlAuthors Info & Claims

CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

Pages 4075 - 4080

https://doi.org/10.1145/1753846.1754105

Published: 10 April 2010 Publication History

Abstract

An alternative paradigm to longitudinal studies of user experience is proposed. We illustrate this paradigm through a number of recent tool-based methods. We conclude by raising a number of challenges that we need to address in order to establish this paradigm as a fruitful alternative to longitudinal studies.

References

[1]

Anderson, S.J. and Conway, M.A., Investigating the structure of autobiographical memories. Learning. Memory, 1993. 19(5): p. 1178--1196.

[2]

Betsch, T., Plessner, H., Schwieren, C., and Gutig, R., I like it but I don't know why: A value-account approach to implicit attitude formation. Personality and Social Psychology Bulletin, 2001. 27(2): p. 242.

[3]

Courage, C., Jain, J., and Rosenbaum, S., Best practices in longitudinal research, in Proceedings of the 27th international conference extended abstracts on Human factors in computing systems. 2009, ACM: Boston, MA, USA.

Digital Library

[4]

Fenko, A., Schifferstein, H.N.J., and Hekkert, P., Shifts in sensory dominance between various stages of user-product interactions. Applied Ergonomics, 2010. 41(1): p. 34--40.

[5]

Gerken, J., Bak, P., and Reiterer, H. Longitudinal evaluation methods in human-computer studies and visual analytics. in Visualization 2007: IEEE Workshop on Metrics for the Evaluation of Visual Analytics. 2007.

[6]

Hassenzahl, M., The interplay of beauty, goodness, and usability in interactive products. Human-Computer Interaction, 2004. 19(4): p. 319--349.

Digital Library

[7]

Hassenzahl, M. and Ullrich, D., To do or not to do: Differences in user experience and retrospective judgements depending on the presence or absence of instrumental goals. Interacting with Computers, 2007. 19: p. 429--437.

Digital Library

[8]

Hektner, J.M., Schmidt, J.A., and Csikszentmihalyi, M., Experience sampling method: Measuring the quality of everyday life. 2007: Sage Publications Inc.

[9]

Kahneman, D., Fredrickson, B.L., Schreiber, C.A., and Redelmeier, D.A., When more pain is preferred to less: Adding a better end. Psychological Science, 1993: p. 401--405.

[10]

Kahneman, D., Krueger, A.B., Schkade, D.A., Schwarz, N., and Stone, A.A., A Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method. 2004, American Association for the Advancement of Science. p. 1776--1780.

[11]

Karapanos, E., Hassenzahl, M., and Martens, J.-B., User experience over time, in CHI '08 extended abstracts on Human factors in computing systems. 2008, ACM: Florence, Italy.

Digital Library

[12]

Karapanos, E., Martens, J.B., and Hassenzahl, M., Reconstructing Experiences through Sketching. arXiv:0912.5343, 2009.

[13]

Karapanos, E., Zimmerman, J., Forlizzi, J., and Martens, J.-B., User Experience Over Time: An initial framework, in Proceedings of the Twenty-Seventh Annual SIGCHI Conference on Human Factors in Computing Systems -- CHI '09. 2009, ACM: Boston.

Digital Library

[14]

Khan, V.J., Markopoulos, P., Eggen, B., Ijsselsteijn, W., and de Ruyter, B. Reconexp: a way to reduce the data loss of the experiencing sampling method. in Proceedings of the 10th international conference on Human computer interaction with mobile devices and services 2008: ACM.

Digital Library

[15]

Kjeldskov, J., Skov, M.B., and Stage, J., A longitudinal study of usability in health care: Does time heal? International Journal of Medical Informatics, 2008.

[16]

Minge, M., Dynamics of User Experience, in Proceedings of the Nordichi '08 Workshop "Research Goals and Strategies for Studying User Experience and Emotion". 2008.

[17]

Norman, D.A., THE WAY I SEE IT. Memory is more important than actuality. interactions, 2009. 16(2): p. 24--26.

Digital Library

[18]

Prümper, J., Zapf, D., Brodbeck, F.C., and Frese, M., Some surprising differences between novice and expert errors in computerized office work. Behaviour & Information Technology, 1992. 11(6): p. 319--328.

[19]

Robinson, M.D. and Clore, G.L., Belief and feeling: Evidence for an accessibility model of emotional self-report. Psychological Bulletin, 2002. 128(6): p. 934--960.

[20]

von Wilamowitz Moellendorff, M., Hassenzahl, M., and Platz, A., Dynamics of user experience: How the perceived quality of mobile phones changes over time, in User Experience -- Towards a unified view, Workshop at the 4th Nordic Conference on Human-Computer Interaction. 2006.

Cited By

Xu HLee HLing WPan Y(2024)How to Keep Balance between Interaction and Automation? Toward User Overall Positive Experience of IoT-Based Smart Home DesignElectronics10.3390/electronics1307137513:7(1375)Online publication date: 5-Apr-2024
https://doi.org/10.3390/electronics13071375
Krapp ENeuhaus RHassenzahl MLaschke M(2024)In a Quasi-Social Relationship With ChatGPT. An Autoethnography on Engaging With Prompt-Engineered LLM PersonasProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685501(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685501
Martinelli SLopes LZaina L(2024)UX Research practices related to Long-Term UXInformation and Software Technology10.1016/j.infsof.2024.107431170:COnline publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1016/j.infsof.2024.107431
Show More Cited By

Index Terms

On the retrospective assessment of users' experiences over time: memory or actuality?
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Reconstructing experiences with iScale

We present iScale, a survey tool for the retrospective elicitation of longitudinal user experience data. iScale aims to minimize retrospection bias and employs graphing to impose a process during the reconstruction of one's experiences. Two versions, ...
A feasibility study on the use of audio-based ecological momentary assessment with persons with aphasia
ASSETS '23: Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility

We describe a smartphone/smartwatch system to evaluate anomia in individuals with aphasia by using audio-recording-based ecological momentary assessments. The system delivers object-naming assessments to a participant's smartwatch, whereby a prompt ...
Microinteraction Ecological Momentary Assessment Response Rates: Effect of Microinteractions or the Smartwatch?

Mobile-based ecological-momentary-assessment (EMA) is an in-situ measurement methodology where an electronic device prompts a person to answer questions of research interest. EMA has a key limitation: interruption burden. Microinteraction-EMA(µEMA) may ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

April 2010

2219 pages

ISBN:9781605589305

DOI:10.1145/1753846

General Chairs:
Elizabeth Mynatt
Georgia Institute of Technology
,
Don Schoner
Georgia Institute of Technology
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Scott Hudson
Carnegie Mellon University
,
Keith Edwards
Georgia Tech
,
Tom Rodden
University of Nottingham

Copyright © 2010 Copyright is held by the author/owner(s).

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Extended-abstract

Conference

CHI '10

Sponsor:

SIGCHI

CHI '10: CHI Conference on Human Factors in Computing Systems

April 10 - 15, 2010

Georgia, Atlanta, USA

Acceptance Rates

CHI EA '10 Paper Acceptance Rate 350 of 1,346 submissions, 26%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

46
Total Citations
View Citations
921
Total Downloads

Downloads (Last 12 months)33
Downloads (Last 6 weeks)3

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xu HLee HLing WPan Y(2024)How to Keep Balance between Interaction and Automation? Toward User Overall Positive Experience of IoT-Based Smart Home DesignElectronics10.3390/electronics1307137513:7(1375)Online publication date: 5-Apr-2024
https://doi.org/10.3390/electronics13071375
Krapp ENeuhaus RHassenzahl MLaschke M(2024)In a Quasi-Social Relationship With ChatGPT. An Autoethnography on Engaging With Prompt-Engineered LLM PersonasProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685501(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685501
Martinelli SLopes LZaina L(2024)UX Research practices related to Long-Term UXInformation and Software Technology10.1016/j.infsof.2024.107431170:COnline publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1016/j.infsof.2024.107431
Pereira EAyers-Glassey SWammes JSmilek D(2023)Attention in hindsight: Using stimulated recall to capture dynamic fluctuations in attentional engagementBehavior Research Methods10.3758/s13428-023-02273-456:6(5354-5385)Online publication date: 28-Nov-2023
https://doi.org/10.3758/s13428-023-02273-4
Cieplińska NJanowski LDe Moor K(2023)Quality Assessment of Video Services in the Long TermProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596509(431-434)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596509
Eslambolchilar PStawarz KVerdezoto Dias NMcNarry MCrossley SKnowles ZMackintosh K(2023)Tangible data visualization of physical activity for children and adolescentsInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2023.10056535:COnline publication date: 1-Mar-2023
https://dl.acm.org/doi/10.1016/j.ijcci.2023.100565
Kujala SMiron-Shatz TJokinen J(2022)The cross-sequential approachJournal of Usability Studies10.5555/3532689.353269314:2(105-116)Online publication date: 18-Apr-2022
https://dl.acm.org/doi/10.5555/3532689.3532693
Melo BAndrade RDarin TSantos CBento Villela MRios da Hora Rodrigues Kde Gois Ribeiro Darin T(2022)Longitudinal user experience studies in the IoT domainProceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems10.1145/3554364.3559135(1-13)Online publication date: 17-Oct-2022
https://dl.acm.org/doi/10.1145/3554364.3559135
Martinelli SLopes LZaina LSantos CBento Villela MRios da Hora Rodrigues Kde Gois Ribeiro Darin T(2022)UX research in the software industryProceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems10.1145/3554364.3559126(1-13)Online publication date: 17-Oct-2022
https://dl.acm.org/doi/10.1145/3554364.3559126
Bouzekri ERivière G(2022)Tangibilité et engagement dans un comportement environnemental : Vers une étude longitudinaleAdjunct Proceedings of the 33rd Conference on l'Interaction Humain-Machine10.1145/3502178.3529110(1-6)Online publication date: 5-Apr-2022
https://dl.acm.org/doi/10.1145/3502178.3529110
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents