Issue Downloads
Skip Table Of Content Section
research-article
Beat the Machine: Challenging Humans to Find a Predictive Model's “Unknown Unknowns”
We present techniques for gathering data that expose errors of automatic predictive models. In certain common settings, traditional methods for evaluating predictive models tend to miss rare but important errors—most importantly, cases for which the ...
research-article
Challenges with Label Quality for Supervised Learning
Organizations that develop and use technologies around information retrieval, machine learning, recommender systems, and natural language processing depend on labels for engineering and experimentation. These labels, usually gathered via human ...
research-article