research-article

A cross-cultural user evaluation of product recommender interfaces

Authors:

Pearl PuAuthors Info & Claims

RecSys '08: Proceedings of the 2008 ACM conference on Recommender systems

Pages 75 - 82

https://doi.org/10.1145/1454008.1454022

Published: 23 October 2008 Publication History

Abstract

We present a cross-cultural user evaluation of an organization-based product recommender interface, by comparing it with the traditional list view. The results show that it performed significantly better, for all study participants, in improving on their competence perceptions, including perceived recommendation quality, perceived ease of use and perceived usefulness, and positively impacting users' behavioral intentions such as intention to save effort in the next visit. Additionally, oriental users were observed reacting more significantly strongly to the organization interface regarding some subjective aspects, compared to western subjects. Through this user study, we also identified the dominating role of the recommender system's decision-aiding competence in stimulating both oriental and western users' return intention to an e-commerce website where the system is applied.

References

[1]

Agrawal, R., Imielinski, T. and Swami, A. 1993. Mining association rules between sets of items in large databases. In Proc. ACM SIGMOD, 207--216.

Digital Library

[2]

Barber, W. and Badre, A. 1998. Culturability: the merging of culture and usability. In Proc. Fourth Human Factors and the Web Conference.

[3]

Chau, P. Y. K., Cole, M., Massey, A. P., Montoya-Weiss, M. and O'Keefe, R. M. 2002. Cultural differences in the online behavior of consumers. Communications of the ACM 45 (10), 138--143.

Digital Library

[4]

Chen, L. and Pu, P. 2005. Trust building in recommender agents. In Proc. the Workshop at 2nd Inter. Conf. on E-Business and Telecommunication Networks (ICETE'02), 135--145.

[5]

Chen, L. and Pu, P. 2007. Preference-based organization interfaces: aiding user critiques in recommender systems. In Proc. Inter. Conf. on User Modeling (UM'07), 77--86.

Digital Library

[6]

Davis, F. D. 1989. Perceived usefulness, perceived ease of use and user acceptance of information technology. MIS Quarterly 13 (3), 319--340.

Digital Library

[7]

Falk, R. F. and Miller, N. B. 1992. A Primer for Soft Modeling. The University of Akron Press.

[8]

Gefen, D. 2000. E-commerce: the role of familiarity and trust. Inter. J. of Management Science 28, 725--737.

[9]

Grabner-Kräuter, S. and Kaluscha, E. A. 2003. Empirical research in on-line trust: a review and critical assessment. Inter. J. of Human-Computer Studies 58, 783--812.

Digital Library

[10]

Herlocker, J.L., Konstan, J.A. and Riedl, J. 2000. Explaining collaborative filtering recommendations. In ACM Conf. on Computer Supported Cooperative Work, 241--250.

Digital Library

[11]

Keeney, R. and Raiffa, H. 1976. Decisions with Multiple Objectives: Preferences and Value Tradeoffs. Cambridge University Press.

[12]

Koufaris, M., Kambil, A. and LaBarbera, P. A. 2001. Consumer behavior in web-based commerce: an empirical study. Inter. J. of Electronic Commerce 5 (2), 115--138.

Digital Library

[13]

Lee, K., Joshi, K. and McIvor, R. 2007. Understanding multicultural differences in online satisfaction. In Proc. of ACM SIGMIS Conf. Computer Personnel Doctoral Consortium and Research (SIGMIS-CPR'07), 209--212.

Digital Library

[14]

McCarthy, K., Reilly, J., McGinty, L. and Smyth, B. 2005. Experiments in dynamic critiquing. In Proc. Inter. Conf. on Intelligent User Interfaces (IUI'05), 175--182.

Digital Library

[15]

McSherry, D. 2004. Explanation in recommender systems. In Workshop Proc. European Conf. on Case-Based Reasoning (ECCBR'04), 125--134.

[16]

Pu, P. and Chen, L. 2005. Integrating tradeoff support in product search tools for e-commerce sites. In Proc. ACM Conf. on Electronic Commerce (EC'05), 269--278.

Digital Library

[17]

Pu, P. and Chen, L. 2006. Trust building with explanation interfaces. In Proc. Inter. Conf. on Intelligent User Interfaces (IUI'06), 93--100.

Digital Library

[18]

Sinha, R. and Swearingen, K. 2002. The role of transparency in recommender systems. In Extended Abstracts of Conference on Human Factors in Computing Systems (CHI'02), 830--831.

Digital Library

Cited By

Eder MKönczöl CKienzl JMosbacher JKubicek BSteinbauer-Wagner G(2024)Influence of Different Explanation Types on Robot-Related Human Factors in Robot Navigation Tasks2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN)10.1109/RO-MAN60168.2024.10731192(1084-1091)Online publication date: 26-Aug-2024
https://doi.org/10.1109/RO-MAN60168.2024.10731192
Jin YChen LCai WZhao X(2023)CRS-Que: A User-centric Evaluation Framework for Conversational Recommender SystemsACM Transactions on Recommender Systems10.1145/36315342:1(1-34)Online publication date: 2-Nov-2023
https://dl.acm.org/doi/10.1145/3631534
Jin YChen LCai WPu P(2021)Key Qualities of Conversational Recommender Systems: From Users’ PerspectiveProceedings of the 9th International Conference on Human-Agent Interaction10.1145/3472307.3484164(93-102)Online publication date: 9-Nov-2021
https://dl.acm.org/doi/10.1145/3472307.3484164
Show More Cited By

Index Terms

A cross-cultural user evaluation of product recommender interfaces
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
    2. Interaction paradigms
      1. Graphical user interfaces
  2. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

A user-centric evaluation framework for recommender systems
RecSys '11: Proceedings of the fifth ACM conference on Recommender systems

This research was motivated by our interest in understanding the criteria for measuring the success of a recommender system from users' point view. Even though existing work has suggested a wide range of criteria, the consistency and validity of the ...
A Cross-Cultural Analysis of Trust in Recommender Systems
UMAP '18: Proceedings of the 26th Conference on User Modeling, Adaptation and Personalization

User system trust is critical to the uptake of recommendations, and several factors of trust have been identified and compared. In this paper we present a cross-cultural, crowdsourced study examining user perceptions of nine factors of trust and link ...
User Acceptance of Recommender Systems: Influence of the Preference Elicitation Algorithm
SMAP '14: Proceedings of the 2014 9th International Workshop on Semantic and Social Media Adaptation and Personalization

We conducted a user study evaluating two preference elicitation approaches for collaborative filtering recommender systems: a basic KNN algorithm and a context aware algorithm. Using the technology acceptance model (TAM) as theoretical model, we ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

RecSys '08: Proceedings of the 2008 ACM conference on Recommender systems

October 2008

348 pages

ISBN:9781605580937

DOI:10.1145/1454008

General Chair:
Pearl Pu
Ecole Polytechnique Fédérale de Lausanne (EPFL), Switzerland
,
Program Chairs:
Derek Bridge
University College Cork, Ireland
,
Bamshad Mobasher
DePaul University, USA
,
Francesco Ricci
Free University Bozen-Bolzano, Italy

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

RecSys08

Sponsor:

RecSys08: ACM Conference on Recommender Systems

October 23 - 25, 2008

Lausanne, Switzerland

Acceptance Rates

Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
889
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)1

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Eder MKönczöl CKienzl JMosbacher JKubicek BSteinbauer-Wagner G(2024)Influence of Different Explanation Types on Robot-Related Human Factors in Robot Navigation Tasks2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN)10.1109/RO-MAN60168.2024.10731192(1084-1091)Online publication date: 26-Aug-2024
https://doi.org/10.1109/RO-MAN60168.2024.10731192
Jin YChen LCai WZhao X(2023)CRS-Que: A User-centric Evaluation Framework for Conversational Recommender SystemsACM Transactions on Recommender Systems10.1145/36315342:1(1-34)Online publication date: 2-Nov-2023
https://dl.acm.org/doi/10.1145/3631534
Jin YChen LCai WPu P(2021)Key Qualities of Conversational Recommender Systems: From Users’ PerspectiveProceedings of the 9th International Conference on Human-Agent Interaction10.1145/3472307.3484164(93-102)Online publication date: 9-Nov-2021
https://dl.acm.org/doi/10.1145/3472307.3484164
Pecune FMurali STsai VMatsuyama YCassell JOka NKoda TObaid MNakanishi HMubin OTanaka K(2019)A Model of Social Explanations for a Conversational Movie Recommendation SystemProceedings of the 7th International Conference on Human-Agent Interaction10.1145/3349537.3351899(135-143)Online publication date: 25-Sep-2019
https://dl.acm.org/doi/10.1145/3349537.3351899
Hong MAn SAkerkar RCamacho DJung J(2019)Cross-cultural contextualisation for recommender systemsJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-019-01479-915:2(1659-1670)Online publication date: 9-Sep-2019
https://doi.org/10.1007/s12652-019-01479-9
Berkovsky STaib RHijikata YBraslavsku PKnijnenburg BMitrovic TZhang JChen LChin D(2018)A Cross-Cultural Analysis of Trust in Recommender SystemsProceedings of the 26th Conference on User Modeling, Adaptation and Personalization10.1145/3209219.3209251(285-289)Online publication date: 3-Jul-2018
https://dl.acm.org/doi/10.1145/3209219.3209251
Jugovac MJannach D(2017)Interacting with Recommenders—Overview and Research DirectionsACM Transactions on Interactive Intelligent Systems10.1145/30018377:3(1-46)Online publication date: 19-Sep-2017
https://dl.acm.org/doi/10.1145/3001837
Mısırlı ABener AÇağlayan BÇalıklı GTurhan B(2013)Field StudiesRecommendation Systems in Software Engineering10.1007/978-3-642-45135-5_13(329-355)Online publication date: 20-Dec-2013
https://doi.org/10.1007/978-3-642-45135-5_13
Said ATikk DCremonesi P(2013)BenchmarkingRecommendation Systems in Software Engineering10.1007/978-3-642-45135-5_11(275-300)Online publication date: 20-Dec-2013
https://doi.org/10.1007/978-3-642-45135-5_11
Xiao BBenbasat I(2013)Research on the Use, Characteristics, and Impact of e-Commerce Product Recommendation Agents: A Review and Update for 2007–2012Handbook of Strategic e-Business Management10.1007/978-3-642-39747-9_18(403-431)Online publication date: 19-Nov-2013
https://doi.org/10.1007/978-3-642-39747-9_18
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents