Evaluating Intelligent User Interfaces with User Experiments
Pages 6 - 8
Abstract
User experiments are an essential tool to evaluate the user experience of intelligent user interfaces. This tutorial teaches the practical aspects of designing and setting up user experiments, as well as state-of-the-art methods to statistically evaluate the outcomes of such experiments.
References
[1]
Davis, F.D. 1989. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly. 13, 3, 319--340. http://dx.doi.org/10.2307/249008
[2]
DeVellis, R.F. 201 Scale development: theory and applications. SAGE.
[3]
Hassenzahl, M. 2008. User experience (UX). Proceedings of the 20th International Conference of the Association Francophone d'Interaction Homme-Machine (IHM '08), 11--15. http://dx.doi.org/10.1145/1512714.1512717
[4]
Knijnenburg, B.P. 2012. Conducting User Experiments in Recommender Systems. Proceedings of the Sixth ACM Conference on Recommender Systems (RecSys '12), 3-4. http://dx.doi.org/10.1145/2365952.2365956
[5]
Knijnenburg, B.P. and Willemsen, M.C. 2015. Evaluating Recommender Systems with User Experiments. Recommender Systems Handbook. F. Ricci, L. Rokach, and B. Shapira (Eds.). Springer US. 309--352. http://dx.doi.org/10.1007/978-1-4899-7637-6_9
[6]
Knijnenburg, B.P., Willemsen, M.C., Gantner, Z., Soncu, H. and Newell, C. 2012. Explaining the user experience of recommender systems. User Modeling and User-Adapted Interaction. 22, 4-5, 441--504. http://dx.doi.org/10.1007/s11257-011-9118-4
[7]
Lakens, D. 2014. Performing high-powered studies efficiently with sequential analyses. European Journal of Social Psychology. 44, 7, 701--710. http://dx.doi.org/10.1002/ejsp.2023.
[8]
Venkatesh, V., Morris, M.G., Davis, G.B. and Davis, F.D. 2003. User Acceptance of Information Technology: Toward a Unified View. MIS Quarterly. 27, 3, 425--478
Index Terms
- Evaluating Intelligent User Interfaces with User Experiments
Recommendations
Intelligent user interfaces
IUI '93: Proceedings of the 1st international conference on Intelligent user interfacesConducting user experiments in recommender systems
RecSys '12: Proceedings of the sixth ACM conference on Recommender systemsThere is an increasing consensus in the field of recommender systems that we should move beyond the offline evaluation of algorithms towards a more user-centric approach. This tutorial teaches the essential skills involved in conducting user experiments,...
A pragmatic procedure to support the user-centric evaluation of recommender systems
RecSys '11: Proceedings of the fifth ACM conference on Recommender systemsAs recommender systems are increasingly deployed in the real world, they are not merely tested offline for precision and coverage, but also "online" with test users to ensure good user experience. The user evaluation of recommenders is however complex ...
Comments
Information & Contributors
Information
Published In
March 2016
446 pages
ISBN:9781450341400
DOI:10.1145/2876456
- General Chairs:
- Jeffrey Nichols,
- Jalal Mahmud,
- John O'Donovan,
- Program Chairs:
- Cristina Conati,
- Massimo Zancanaro
Copyright © 2016 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 March 2016
Check for updates
Author Tags
Qualifiers
- Tutorial
Conference
IUI'16: 21st International Conference on Intelligent User Interfaces
March 7 - 10, 2016
California, Sonoma, USA
Acceptance Rates
IUI '16 Companion Paper Acceptance Rate 49 of 194 submissions, 25%;
Overall Acceptance Rate 746 of 2,811 submissions, 27%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 435Total Downloads
- Downloads (Last 12 months)6
- Downloads (Last 6 weeks)0
Reflects downloads up to 25 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in