Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                

Methods for the Design and Evaluation of HCI+NLP Systems

Hendrik Heuer, Daniel Buschek


Abstract
HCI and NLP traditionally focus on different evaluation methods. While HCI involves a small number of people directly and deeply, NLP traditionally relies on standardized benchmark evaluations that involve a larger number of people indirectly. We present five methodological proposals at the intersection of HCI and NLP and situate them in the context of ML-based NLP models. Our goal is to foster interdisciplinary collaboration and progress in both fields by emphasizing what the fields can learn from each other.
Anthology ID:
2021.hcinlp-1.5
Volume:
Proceedings of the First Workshop on Bridging Human–Computer Interaction and Natural Language Processing
Month:
April
Year:
2021
Address:
Online
Editors:
Su Lin Blodgett, Michael Madaio, Brendan O'Connor, Hanna Wallach, Qian Yang
Venue:
HCINLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
28–33
Language:
URL:
https://aclanthology.org/2021.hcinlp-1.5
DOI:
Bibkey:
Cite (ACL):
Hendrik Heuer and Daniel Buschek. 2021. Methods for the Design and Evaluation of HCI+NLP Systems. In Proceedings of the First Workshop on Bridging Human–Computer Interaction and Natural Language Processing, pages 28–33, Online. Association for Computational Linguistics.
Cite (Informal):
Methods for the Design and Evaluation of HCI+NLP Systems (Heuer & Buschek, HCINLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.hcinlp-1.5.pdf