Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/1085777.1085780acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmobilehciConference Proceedingsconference-collections
Article

Towards improving trust in context-aware systems by displaying system confidence

Published: 19 September 2005 Publication History

Abstract

For automatic or context-aware systems a major issue is user trust, which is to a large extent determined by system reliability. For systems based on sensor input which are inherently uncertain or even uncomplete there is little hope that they will ever be perfectly reliable. In this paper we test the hypothesis if explicitly displaying the current confidence of the system increases the usability of such systems. For the example of a context-aware mobile phone, the experiments show that displaying confidence information increases the user's trust in the system.

References

[1]
S. Banbury, S. Seldcon, M. Endsley, T. Gordon, and K. Tatlock. Being certain about uncertainty: How the representation of system reliability affects pilot decision making. In Proc. Human Factors and Ergonomics Society 42nd Annual Meeting, 1998.
[2]
V. Bellotti and K. Edwards. Intelligibility and accountability: Human considerations in context-aware systems. Human-Computer Interaction, 16(2):193--212, 2001.
[3]
C. Bubb-Lewis and M. Scerbo. Getting to know you: Human-computer communicationin adaptive automation. In M. Mouloua and J. Koonce, editors, Human-Automation Interaction: Research and Practice. Erlbaum Associates, 1997.
[4]
M. Chalmers and I. MacColl. Seamful and seamless design in ubiquitous computing. In Workshop: At the Crossroads: The Interaction of HCI and Systems Issues in Ubicomp, 2003.
[5]
P. de Vries, C. Midden, and D. Bouwhuis. The effects of errors on system trust, self-confidence, and the allocation of control in route planning. International Journal of Human-Computer Studies, 58(6):719--736, 2003.
[6]
M. Dzindolet, S. Peterson, R. Plmranky, L. Pierce, and H. Beck. The role of trust in automation reliance. International Journal of Human-Computer Studies, 58(6):697--718, 2003.
[7]
M. Eidelkind and S. Papantonopoulos. Operator trust and task delegation: Strategies in semi-autonomous agent systems. In M. Mouloua and J. Koonce, editors, Human-Automation Interaction: Research and Practice. Erlbaum Associates, 1997.
[8]
J. Fogarty, S. E. Hudson, and J. Lai. Examining the robustness of sensor-based statistical models of human interruptability. In Proc. ACM CHI, pages 207--214, 2004.
[9]
K. Gempler and C. Wickens. Display of predictor reliability on a cockpit display of traffic information. Technical Report ARL-98-6/Rockwell-98-1, Aviation Research Lab, Institute of Aviation, University of Illinois, 1998.
[10]
S. Greenberg. Context as a dynamic construct. Human-Computer Interaction, 16(2):257--268, 2001.
[11]
E. Horvitz. Principles of mixed-initiative user interfaces. In Proc. CHI, pages 159--166, 1999.
[12]
E. Horvitz and M. Barry. Display of information for time--critical decision making. In Proc. 11th Conf. on Uncertainty in Artificial Intelligence, pages 296--305. Morgan Kaufmann, 1995.
[13]
N. Kern, S. Antifakos, B. Schiele, and A. Schwaninger. A model of human interruptability: Experimental evaluation and automatic estimation from wearable sensors. In Proc. ISWC, pages 158--165, Washington DC, USA, Nov 2004.
[14]
N. Kern and B. Schiele. Context--aware notfication for wearable computing. In Proc. ISWC, pages 223--230, White Plains, NY, USA, October 2003.
[15]
P. Maes. Agents that reduce work and information overload. Communications of the ACM, 37:30--40, 1994.
[16]
J. Mankoff, S. Hudson, and G. Abowd. Interaction techniques for ambiguity resolution in recognition-based interfaces. In Proc. UIST, 2000.
[17]
B. Muir. Trust in automation: Part i. theoretical issues in the study of trust and human intervention in automated systems. Ergonomics, 37(11):1905--1922, 1994.
[18]
A. Newberger and A. Dey. System support for context monitoring and control. In Workshop: At the Crossroads: The Interaction of HCI and Systems Issues in Ubicomp, 2003.
[19]
D. Nicholls, V. Barsotti, P. Battino, P. Marti, and S. Pozzi. Presenting uncertainty to pilots and controllers. In 5th Intern. Seminar on ATM, FAA, and EuroControl, 2003.
[20]
E. Oztop, D. Wolpert, and M. Kawato. Mental state inference using visual control parameters. Cognitive Brain Research, (22):129--151, 2005.
[21]
R. Parasuraman. Human use and abuse of automation. In M. Mouloua and J. Koonce, editors, Human-Automation Interaction: Research and Practice. Erlbaum Associates, 1997.
[22]
D. Patterson, L. Liao, D. Fox, and H. Kautz. Inferring high-level behaviour from low-level sensors. In Proc. UbiComp, 2003.
[23]
I. Poupyrev, S. Maruyama, and J. Rekimoto. Ambient touch: Designing tactile interfaces for handheld devices. In Proc. UIST, 2002.
[24]
N. Sawhney and C. Schmandt. Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments. ACM Transactions on Computer-Human Interaction, 7(3):353--383, 2000.
[25]
T. Sheridan. Computer control and human alienation. In Technology Review, pages 61--73, 1980.
[26]
S. Tiernan, E. Cutrell, and M. Czerwinski. Effective notification systems depend on user trust. In Proc. Human-Computer Interaction - Interact, pages 684--685, 2001.
[27]
J. Williamson and R. Murray-Smith. Sonification of probabilistic feedback through granular synthesis. IEEE Multimedia, 12(2):45--52, April/June 2005.
[28]
C. Wisneski. The design of personal ambient displays. Master's thesis, MIT, 1999. Thesis Proposal M.Sc.

Cited By

View all
  • (2024)Exploring the Effects of User Input and Decision Criteria Control on Trust in a Decision Support Tool for Spare Parts Inventory ManagementProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701585(313-323)Online publication date: 1-Dec-2024
  • (2024)Beyond Code Generation: An Observational Study of ChatGPT Usage in Software Engineering PracticeProceedings of the ACM on Software Engineering10.1145/36607881:FSE(1819-1840)Online publication date: 12-Jul-2024
  • (2024)Fast-Forward Reality: Authoring Error-Free Context-Aware Policies with Real-Time Unit Tests in Extended RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642158(1-17)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. Towards improving trust in context-aware systems by displaying system confidence

    Recommendations

    Reviews

    Claudiu Popescu

    Ubiquitous computing, also called pervasive computing, refers to the usage of embedded computers (such as cellular phones) in various places. Context-aware computing is about providing services that are appropriate to a particular user, place, and time. For example, a cellular phone will always vibrate and never beep during a concert, if the system can know the location of the user and the concert schedule. This type of service brings privacy problems, and leads to questions about the trust and risk involved in interactions between users. This research contribution discusses the improvement of trust in context-aware systems. It is addressed to researchers or students who know the domain well. The authors describe an experiment regarding the effect of displaying system confidence. The main result is that users adapt to the system if the system confidence is displayed. Various aspects of context-aware computing are discussed, with references to numerous papers (there are 28 listed in the references section). At the end of the paper, conclusions and further research directions are outlined. The paper covers an interesting area, and makes some complex contributions. However, I wish the description of the field and the importance of this research were explained with more clarity. Nevertheless, this paper is a valuable scientific contribution. Online Computing Reviews Service

    Access critical reviews of Computing literature here

    Become a reviewer for Computing Reviews.

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    MobileHCI '05: Proceedings of the 7th international conference on Human computer interaction with mobile devices & services
    September 2005
    400 pages
    ISBN:1595930892
    DOI:10.1145/1085777
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 September 2005

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. context-aware systems
    2. system confidence
    3. trust
    4. uncertainty

    Qualifiers

    • Article

    Conference

    MobileHCI05

    Acceptance Rates

    Overall Acceptance Rate 202 of 906 submissions, 22%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)34
    • Downloads (Last 6 weeks)7
    Reflects downloads up to 08 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Exploring the Effects of User Input and Decision Criteria Control on Trust in a Decision Support Tool for Spare Parts Inventory ManagementProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701585(313-323)Online publication date: 1-Dec-2024
    • (2024)Beyond Code Generation: An Observational Study of ChatGPT Usage in Software Engineering PracticeProceedings of the ACM on Software Engineering10.1145/36607881:FSE(1819-1840)Online publication date: 12-Jul-2024
    • (2024)Fast-Forward Reality: Authoring Error-Free Context-Aware Policies with Real-Time Unit Tests in Extended RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642158(1-17)Online publication date: 11-May-2024
    • (2023)Learning calibrated uncertainties for domain shiftProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/162(1460-1469)Online publication date: 19-Aug-2023
    • (2023)XAIR: A Framework of Explainable AI in Augmented RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581500(1-30)Online publication date: 19-Apr-2023
    • (2023)Exploring the Impact of User and System Factors on Human-AI Interactions in Head-Worn Displays2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00025(109-118)Online publication date: 16-Oct-2023
    • (2023)Combining uncertainty information with AI recommendations supports calibration with domain knowledgeJournal of Risk Research10.1080/13669877.2023.225940626:10(1137-1152)Online publication date: 13-Oct-2023
    • (2023)Fairness Perceptions of Artificial Intelligence: A Review and Path ForwardInternational Journal of Human–Computer Interaction10.1080/10447318.2023.221089040:1(4-23)Online publication date: 26-May-2023
    • (2023)Meta-analysis Qualifying and Quantifying the Benefits of Automation Transparency to Enhance Models of Human PerformanceHuman-Computer Interaction10.1007/978-3-031-35596-7_16(243-261)Online publication date: 9-Jul-2023
    • (2022)Vertrauen in digitale Technik. Der Einfluss mobiler Apps auf die Bereitschaft zur VerhaltensänderungZeitschrift für Soziologie10.1515/zfsoz-2021-002850:6(373-395)Online publication date: 29-Mar-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media