Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/1502650.1502678acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
research-article

Fixing the program my computer learned: barriers for end users, challenges for the machine

Published: 08 February 2009 Publication History

Abstract

The results of a machine learning from user behavior can be thought of as a program, and like all programs, it may need to be debugged. Providing ways for the user to debug it matters, because without the ability to fix errors users may find that the learned program's errors are too damaging for them to be able to trust such programs. We present a new approach to enable end users to debug a learned program. We then use an early prototype of our new approach to conduct a formative study to determine where and when debugging issues arise, both in general and also separately for males and females. The results suggest opportunities to make machine-learned programs more effective tools.

References

[1]
Bandura, A. Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review 8, 2 (1977), 191--215.
[2]
Becker, B., Kohavi, R., and Sommerfield, D. Visualizing the simple Bayesian classifier. In Fayyad, U, Grinstein, G. and Wierse A. (Eds.) Information Visualization in Data Mining and Knowledge Discovery, (2001), 237--249.
[3]
Beckwith, L. Burnett, M., Wiedenbeck, S., Cook, C., Sorte, S., and Hastings, M. Effectiveness of end-user debugging software features: Are there gender issues? Proc. CHI (2005), 869--878.
[4]
Burnett, M., Cook, C., Pendse, O., Rothermel, G., Summet, J., and Wallace, C. End-user software engineering with assertions in the spreadsheet paradigm. International Conference on Software Engineering, 2003, 93--103.
[5]
Chan, H. and Darwiche, A. When do numbers really matter? Journal of Artificial Intelligence Research, 17 (2002), 265--287.
[6]
Chen, J. and Weld, D. S. Recovering from errors during programming by demonstration. Proc. IUI (2008), 159--168.
[7]
Compeau, D. and Higgins, C. Application of social cognitive theory to training for computer skills. Information Systems Research, 6,2 (1995), 118--143.
[8]
Davies, S. P. Display-based problem solving strategies in computer programming, Proc. Wkshp. Empirical Studies of Programmers, Ablex, (1996), 59--76.
[9]
Glass, A., McGuinness, D. and Wolverton, M. Toward establishing trust in adaptive agents, Proc. IUI (2008), 227--236.
[10]
Grigoreanu, V., Cao, J., Kulesza, T., Bogart, C., Rector, K., Burnett, M., Wiedenbeck, S. Can feature design reduce the gender gap in end-user software development environments? Proc. VL/HCC 2008, IEEE, (2008).
[11]
Ko, A. J. Asking and answering questions about the causes of software behaviors, Ph.D. thesis available as Human-Computer Interaction Institute Technical Report CMU-CS-08-122 (2008).
[12]
Ko, A. J., Myers, B., and Aung, H. Six learning barriers in end-user programming systems. Proc. VL/HCC 2004, IEEE Computer Society (2004), 199--206.
[13]
Kononenko, I. Inductive and Bayesian learning in medical diagnosis. Applied Artificial Intelligence, 7, (1993), 317--337.
[14]
Leave, C. and Diez, F. A review of explanation methods for Bayesian networks. The Knowledge Engineering Review, 17, 2, Cambridge University Press, (2002) 107--127.
[15]
Lieberman, H. (ed.) Your Wish is My Command: Programming By Example, Morgan Kaufmann Publishers, Inc (2001).
[16]
Little, G., Lau, T., Cypher, A., Lin, J., Haber, E., and Kandogan, E. Koala: Capture, share, automate, personalize business processes on the web. Proc. CHI (2007), 943--946.
[17]
McDaniel, R. and Myers, B. Getting more out of programming-by-demonstration, Proc. CHI (1999), 442--449.
[18]
Meyers--Levy, J. Gender differences in information processing: A selectivity interpretation. P. Cafferata & A. Tybout, (Eds) Cognitive and Affective Responses to Advertising, Lexington Books (1989).
[19]
Myers, B., Weitzman, D., Ko, A. J., and Chau, D. H., Answering why and why not questions in user interfaces. Proc.CHI (2006), 397--406.
[20]
Patel, K., Fogarty, J., Landay, J., and Harrison, B. (2008). Investigating statistical machine learning as a tool for software development. Proc. CHI (2008), 667--676.
[21]
Poulin, B., Eisner, R., Szafron, D., Lu, P., Greiner, R., Wishart, D. S., Fyshe, A., Pearcy, B., MacDonnell, C., and Anvik, J. Visual explanation of evidence in additive classifiers. Proc. IAAI, (2006).
[22]
Russell, S. J., and Norvig, P. Artificial Intelligence: A Modern Approach. Upper Saddle River, NJ: Prentice Hall. 2003.
[23]
Stumpf S., Rajaram V., Li L., Burnett M., Dietterich T., Sullivan E., Drummond R., Herlocker J. Toward harnessing user feedback for machine learning. Proc. IUI (2007), 82--91.
[24]
Stumpf, S., Sullivan, E., Fitzhenry, E., Oberst, I., Wong, W.-K., and Burnett, M. Integrating rich user feedback into intelligent user interfaces. Proc. IUI (2008), 50--59.
[25]
Subrahmaniyan, N., Beckwith, L., Grigoreanu, V., Burnett, M., Wiedenbeck, S., Narayanan, V., Bucht, K., Drummond, R., and Fern, X. (2008). Testing vs. code inspection vs. .. what else? Male and female end users' debugging strategies. Proc.CHI (2008), 617--626.
[26]
Vander Zanden, B. and Myers, B. Demonstrational and constraint-based techniques for pictorially specifying application objects and behaviors. Transactions on Computer-Human Interaction, 2,4 (1995), 308--356.
[27]
Wagner, E. and Lieberman, H. Supporting user hypotheses in problem diagnosis on the web and elsewhere. Proc. IUI (2004), 30--37.

Cited By

View all
  • (2024)Image-to-Text Translation for Interactive Image Recognition: A Comparative User Study with Non-expert UsersJournal of Information Processing10.2197/ipsjjip.32.35832(358-368)Online publication date: 2024
  • (2024)The application of explainable artificial intelligence (XAI) in electronic health record research: A scoping reviewDIGITAL HEALTH10.1177/2055207624127265710Online publication date: 30-Oct-2024
  • (2024)FrameKit: A Tool for Authoring Adaptive UIs Using KeyframesProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645176(660-674)Online publication date: 18-Mar-2024
  • Show More Cited By

Index Terms

  1. Fixing the program my computer learned: barriers for end users, challenges for the machine

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    IUI '09: Proceedings of the 14th international conference on Intelligent user interfaces
    February 2009
    522 pages
    ISBN:9781605581682
    DOI:10.1145/1502650
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 February 2009

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. debugging
    2. end-user programming
    3. machine learning

    Qualifiers

    • Research-article

    Conference

    IUI09
    IUI09: 14th International Conference on Intelligent User Interfaces
    February 8 - 11, 2009
    Florida, Sanibel Island, USA

    Acceptance Rates

    Overall Acceptance Rate 746 of 2,811 submissions, 27%

    Upcoming Conference

    IUI '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)19
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 10 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Image-to-Text Translation for Interactive Image Recognition: A Comparative User Study with Non-expert UsersJournal of Information Processing10.2197/ipsjjip.32.35832(358-368)Online publication date: 2024
    • (2024)The application of explainable artificial intelligence (XAI) in electronic health record research: A scoping reviewDIGITAL HEALTH10.1177/2055207624127265710Online publication date: 30-Oct-2024
    • (2024)FrameKit: A Tool for Authoring Adaptive UIs Using KeyframesProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645176(660-674)Online publication date: 18-Mar-2024
    • (2024)Why is "Problems" Predictive of Positive Sentiment? A Case Study of Explaining Unintuitive Features in Sentiment ClassificationProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3658547(161-172)Online publication date: 3-Jun-2024
    • (2024)User Characteristics in Explainable AI: The Rabbit Hole of Personalization?Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642352(1-13)Online publication date: 11-May-2024
    • (2024)XAI is in troubleAI Magazine10.1002/aaai.12184Online publication date: 29-Jul-2024
    • (2022)How to Support Users in Understanding Intelligent Systems? An Analysis and Conceptual Framework of User Questions Considering User Mindsets, Involvement, and Knowledge OutcomesACM Transactions on Interactive Intelligent Systems10.1145/351926412:4(1-27)Online publication date: 5-Nov-2022
    • (2022)Toward Involving End-users in Interactive Human-in-the-loop AI FairnessACM Transactions on Interactive Intelligent Systems10.1145/351425812:3(1-30)Online publication date: 26-Jul-2022
    • (2022)How Do People Rank Multiple Mutant Agents?Proceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490099.3511115(191-211)Online publication date: 22-Mar-2022
    • (2022)Challenges of human—machine collaboration in risky decision-makingFrontiers of Engineering Management10.1007/s42524-021-0182-09:1(89-103)Online publication date: 27-Jan-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media