Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
article

Knows what it knows: a framework for self-aware learning

Published: 01 March 2011 Publication History

Abstract

We introduce a learning framework that combines elements of the well-known PAC and mistake-bound models. The KWIK (knows what it knows) framework was designed particularly for its utility in learning settings where active exploration can impact the training examples the learner is exposed to, as is true in reinforcement-learning and active-learning problems. We catalog several KWIK-learnable classes as well as open problems, and demonstrate their applications in experience-efficient reinforcement learning.

Cited By

View all
  • (2023)Partial matrix completionProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3667433(30134-30145)Online publication date: 10-Dec-2023
  • (2021)Online selective classification with limited feedbackProceedings of the 35th International Conference on Neural Information Processing Systems10.5555/3540261.3541374(14529-14541)Online publication date: 6-Dec-2021
  • (2021)Towards optimally abstaining from prediction with OOD test examplesProceedings of the 35th International Conference on Neural Information Processing Systems10.5555/3540261.3541239(12774-12785)Online publication date: 6-Dec-2021
  • Show More Cited By
  1. Knows what it knows: a framework for self-aware learning

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Machine Language
    Machine Language  Volume 82, Issue 3
    March 2011
    203 pages

    Publisher

    Kluwer Academic Publishers

    United States

    Publication History

    Published: 01 March 2011

    Author Tags

    1. Active learning
    2. Computational learning theory
    3. Exploration
    4. Knows What It Knows (KWIK)
    5. Mistake bound
    6. Probably Approximately Correct (PAC)
    7. Reinforcement learning

    Qualifiers

    • Article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 08 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Partial matrix completionProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3667433(30134-30145)Online publication date: 10-Dec-2023
    • (2021)Online selective classification with limited feedbackProceedings of the 35th International Conference on Neural Information Processing Systems10.5555/3540261.3541374(14529-14541)Online publication date: 6-Dec-2021
    • (2021)Towards optimally abstaining from prediction with OOD test examplesProceedings of the 35th International Conference on Neural Information Processing Systems10.5555/3540261.3541239(12774-12785)Online publication date: 6-Dec-2021
    • (2021)Automatic unsupervised outlier model selectionProceedings of the 35th International Conference on Neural Information Processing Systems10.5555/3540261.3540604(4489-4502)Online publication date: 6-Dec-2021
    • (2021)Introspective perception: Learning to predict failures in vision systems2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS.2016.7759279(1743-1750)Online publication date: 11-Mar-2021
    • (2020)Beyond UCBProceedings of the 37th International Conference on Machine Learning10.5555/3524938.3525238(3199-3210)Online publication date: 13-Jul-2020
    • (2020)Agnostic Q-learning with function approximation in deterministic systemsProceedings of the 34th International Conference on Neural Information Processing Systems10.5555/3495724.3497596(22327-22337)Online publication date: 6-Dec-2020
    • (2020)Beyond perturbationsProceedings of the 34th International Conference on Neural Information Processing Systems10.5555/3495724.3497054(15859-15870)Online publication date: 6-Dec-2020
    • (2020)Identifying causal-effect inference failure with uncertainty-aware modelsProceedings of the 34th International Conference on Neural Information Processing Systems10.5555/3495724.3496700(11637-11649)Online publication date: 6-Dec-2020
    • (2020)Trust the model when it is confidentProceedings of the 34th International Conference on Neural Information Processing Systems10.5555/3495724.3496608(10537-10546)Online publication date: 6-Dec-2020
    • Show More Cited By

    View Options

    View options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media