tutorial

Conversational Information Seeking: Theory and Evaluation: CHIIR 2022 Half Day Tutorial

Authors:

Mohammad Aliannejadi,

Johanne R. TrippasAuthors Info & Claims

CHIIR '22: Proceedings of the 2022 Conference on Human Information Interaction and Retrieval

Pages 365 - 366

https://doi.org/10.1145/3498366.3505843

Published: 14 March 2022 Publication History

Abstract

Research in conversational information seeking (CIS) is moving very rapidly in various directions such as user interaction, system design, and evaluation. The tutorial focuses on the theoretical foundations and information-seeking processes for CIS, as well as their evaluation. The tutorial aims to introduce and communicate CIS research to the community and discuss it from different perspectives, such as theoretical modelling, evaluation, and user simulation. Also, it aims at gathering researchers and practitioners interested in this research direction for discussions, idea communications, and research promotions.

References

[1]

Mohammad Aliannejadi, Leif Azzopardi, Hamed Zamani, Evangelos Kanoulas, Paul Thomas, and Nick Craswel. 2021. Analysing Mixed Initiatives and Search Strategies during Conversational Search. In CIKM.

[2]

Mohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, Jeff Dalton, and Mikhail S. Burtsev. 2020. ConvAI3: Generating Clarifying Questions for Open-Domain Dialogue Systems (ClariQ). CoRR abs/2009.11352(2020).

[3]

Mohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, Jeffrey Dalton, and Mikhail S. Burtsev. 2021. Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions. In EMNLP.

[4]

Mohammad Aliannejadi, Hamed Zamani, Fabio Crestani, and W. Bruce Croft. 2019. Asking Clarifying Questions in Open-Domain Information-Seeking Conversations. In SIGIR. ACM, 475–484.

[5]

Avishek Anand, Lawrence Cavedon, Hideo Joho, Mark Sanderson, and Benno Stein. 2020. Conversational Search (Dagstuhl Seminar 19461). Dagstuhl Reports 9, 11 (2020), 34–83.

[6]

Leif Azzopardi, Mateusz Dubiel, Martin Halvey, and Jeffrey Dalton. 2018. Conceptualizing agent-human interactions during the conversational search process. In SIGIR 2nd International Workshop on Conversational Approaches to Information Retrieval (CAIR’18). 8 pages.

[7]

George Buchanan, Dana McKay, Charles LA Clarke, Leif Azzopardi, and Johanne R. Trippas. 2020. Made to Measure: A Workshop on Human-centred metrics for information seeking. In Proceedings of Conference on Information Interaction and Retrieval (CHIIR). 484–487.

Digital Library

[8]

J. Shane Culpepper, Fernando Diaz, and Mark D. Smucker. 2018. Research Frontiers in Information Retrieval: Report from the Third Strategic Workshop on Information Retrieval in Lorne (SWIRL 2018). SIGIR Forum 52, 1 (2018), 34–90.

Digital Library

[9]

Jeffrey Dalton, Chenyan Xiong, and Jamie Callan. 2020. CAsT 2020: The Conversational Assistance Track Overview. In TREC(NIST Special Publication, Vol. 1266). National Institute of Standards and Technology (NIST).

[10]

Margaret Li, Jason Weston, and Stephen Roller. 2019. ACUTE-EVAL: Improved Dialogue Evaluation with Optimized Questions and Multi-turn Comparisons. CoRR abs/1909.03087(2019).

[11]

Garry Marchionini. 1997. Information Seeking in Electronic Environments. Cambridge University Press.

Digital Library

[12]

Ida Mele, Cristina Ioana Muntean, Mohammad Aliannejadi, and Nikos Voskarides. 2021. MICROS: Mixed-Initiative ConveRsatiOnal Systems Workshop. In ECIR (2)(Lecture Notes in Computer Science, Vol. 12657). Springer, 710–713.

[13]

Filip Radlinski and Nick Craswell. 2017. A theoretical framework for conversational search. In Proceedings of Conference on Information Interaction and Retrieval (CHIIR). 117–126.

Digital Library

[14]

Alexandre Salle, Shervin Malmasi, Oleg Rokhlenko, and Eugene Agichtein. 2021. Studying the Effectiveness of Conversational Search Refinement Through User Simulation. In ECIR (1)(Lecture Notes in Computer Science, Vol. 12656). Springer, 587–602.

[15]

Ivan Sekulic, Mohammad Aliannejadi, and Fabio Crestani. 2022. Evaluating Mixed-initiative Conversational Search Systems via User Simulation. In WSDM.

[16]

Johanne R. Trippas. 2019. Spoken Conversational Search: Audio-only Interactive Information Retrieval. Ph. D. Dissertation. RMIT, Melbourne.

[17]

Johanne R. Trippas and David Maxwell. 2021. The PhD Journey: Reaching Out and Lending a Hand. In Proceedings of Conference on Information Interaction and Retrieval (CHIIR). 492–494.

[18]

Johanne R. Trippas and David Maxwell. 2022. First Early Career Researchers’ Roundtable for Information Access Research. In Proceedings of Conference on Information Interaction and Retrieval (CHIIR).

[19]

Johanne R. Trippas, Damiano Spina, Paul Thomas, Mark Sanderson, Hideo Joho, and Lawrence Cavedon. 2020. Towards a Model for Spoken Conversational Search. Information Processing & Management 57, 2 (2020), 102162.

Digital Library

[20]

Johanne R. Trippas, Paul Thomas, Damiano Spina, and Hideo Joho. 2020. Third CAIR Workshop. In Proceedings of Conference on Information Interaction and Retrieval (CHIIR). 492–494.

[21]

Shuo Zhang and Krisztian Balog. 2020. Evaluating Conversational Recommender Systems via User Simulation. In KDD. ACM, 1512–1520.

Cited By

Ji KPathiyan Cherumanal STrippas JHettiachchi DSalim FScholer FSpina D(2024)Towards Detecting and Mitigating Cognitive Bias in Spoken Conversational SearchAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680245(1-10)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3680245
Dalton JFischer SOwoicho PRadlinski FRossetto FTrippas JZamani HAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)Conversational Information SeekingProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3532678(3455-3458)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3532678

Index Terms

Conversational Information Seeking: Theory and Evaluation: CHIIR 2022 Half Day Tutorial
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Information systems
  1. Information retrieval
    1. Information retrieval query processing
    2. Users and interactive retrieval
      1. Task models

Index terms have been assigned to the content through auto-classification.

Recommendations

Conversational Information Seeking: Theory and Application
SIGIR '22: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval

Conversational information seeking (CIS) involves interaction sequences between one or more users and an information system. Interactions in CIS are primarily based on natural language dialogue, while they may include other types of interactions, such ...
Conversational Information Seeking

Conversational information seeking (CIS) is concerned with a sequence of interactions between one or more users and an information system. Interactions in CIS are primarily based on natural language dialogue, while they may ...
Towards Multi-Modal Conversational Information Seeking
SIGIR '21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval

Recent research on conversational information seeking (CIS) mostly focuses on uni-modal interactions and information items. This per- spective paper highlights the importance of moving towards de- veloping and evaluating multi-modal conversational ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHIIR '22: Proceedings of the 2022 Conference on Human Information Interaction and Retrieval

March 2022

399 pages

ISBN:9781450391863

DOI:10.1145/3498366

General Chairs:
David Elsweiler
University of Regensburg, Bavaria, Germany
,
Udo Kruschwitz
University of Regensburg, Bavaria, Germany
,
Bernd Ludwig
University of Regensburg, Bavaria, Germany

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 March 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Tutorial
Research
Refereed limited

Conference

CHIIR '22

Sponsor:

CHIIR '22: ACM SIGIR Conference on Human Information Interaction and Retrieval

March 14 - 18, 2022

Regensburg, Germany

Acceptance Rates

Overall Acceptance Rate 55 of 163 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
147
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ji KPathiyan Cherumanal STrippas JHettiachchi DSalim FScholer FSpina D(2024)Towards Detecting and Mitigating Cognitive Bias in Spoken Conversational SearchAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680245(1-10)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3680245
Dalton JFischer SOwoicho PRadlinski FRossetto FTrippas JZamani HAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)Conversational Information SeekingProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3532678(3455-3458)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3532678

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents