Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/1281192.1281247acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
Article

Expertise modeling for matching papers with reviewers

Published: 12 August 2007 Publication History

Abstract

An essential part of an expert-finding task, such as matching reviewers to submitted papers, is the ability to model the expertise of a person based on documents. We evaluate several measures of the association between an author in an existing collection of research papers and a previously unseen document. We compare two language model based approaches with a novel topic model, Author-Persona-Topic (APT). In this model, each author can write under one or more "personas," which are represented as independent distributions over hidden topics. Examples of previous papers written by prospective reviewers are gathered from the Rexa database, which extracts and disambiguates author mentions from documents gathered from the web. We evaluate the models using a reviewer matching task based on human relevance judgments determining how well the expertise of proposed reviewers matches a submission. We find that the APT topic model outperforms the other models.

References

[1]
K. Balog, L. Azzopardi, and M. de Rijke. Formal models for expert finding in enterprise corpora. In SIGIR, 2006.
[2]
C. Basu, H. Hirsh, W. Cohen, and C.Nevill-Manning. Recommending papers by mining the web. In IJCAI, 1999.
[3]
S. Benferhat and J.Lang. Conference paper assignment. Int. J. Intell. Syst, 16: 1183, 2001.
[4]
D. Blei, A. Ng, and M. Jordan. Latent Dirichlet allocation. Journal of Machine Learning Research, 3: 993--1022, January 2003.
[5]
C. Buckley and E. M. Voorhees. Retrieval evaluation with incomplete information. In SIGIR, 2004.
[6]
S. T. Dumais and J. Nielsen. Automating the assignment of submitted manuscripts to reviewers. In SIGIR, page 233, 1992.
[7]
S. Hettich and M. J. Pazzani. Mining for proposal reviewers: lessons learned at the national science foundation. In KDD, 2006.
[8]
A. McCallum, A. Corrada-Emmanuel, and X. Wang. Topic and role discovery in social networks. In IJCAI, 2005.
[9]
D. Petkova and W. B. Croft. Hierarchical language models for expert finding in enterprise corpora. In International Conference on Tools with Artificial Intelligence, 2006.
[10]
J. M. Ponte and W. B. Croft. A language modeling approach to information retrieval. In SIGIR, 1998.
[11]
M. A. Rodriguez and J. Bollen. An algorithm to determine peer-reviews. Technical report, Los Alamos National Laboratory, 2006.
[12]
M. Rosen-Zvi, T. Griffiths, M. Steyvers, and P. Smyth. The author-topic model for authors and documents. In UAI, 2004.
[13]
X. Wei and B. Croft. LDA-based document models for ad-hoc retrieval. In SIGIR 2006, 2006.
[14]
C. Zhai and J. Lafferty. A study of smoothing methods for language models applied to ad hoc information retrieval. In SIGIR, 2001.

Cited By

View all
  • (2025)An Automatic Paper-Reviewer Recommendation Algorithm Based on Depth and BreadthIEEE Transactions on Emerging Topics in Computational Intelligence10.1109/TETCI.2024.34026949:1(607-616)Online publication date: Feb-2025
  • (2024)The Sustainable Innovation of AI: Text Mining the Core Capabilities of Researchers in the Digital Age of Industry 4.0Sustainability10.3390/su1617776716:17(7767)Online publication date: 6-Sep-2024
  • (2024)Information Retrieval and Machine Learning Methods for Academic Expert FindingAlgorithms10.3390/a1702005117:2(51)Online publication date: 23-Jan-2024
  • Show More Cited By

Index Terms

  1. Expertise modeling for matching papers with reviewers

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    KDD '07: Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining
    August 2007
    1080 pages
    ISBN:9781595936097
    DOI:10.1145/1281192
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 12 August 2007

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. reviewer finding
    2. topic models

    Qualifiers

    • Article

    Conference

    KDD07

    Acceptance Rates

    KDD '07 Paper Acceptance Rate 111 of 573 submissions, 19%;
    Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

    Upcoming Conference

    KDD '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)39
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 08 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)An Automatic Paper-Reviewer Recommendation Algorithm Based on Depth and BreadthIEEE Transactions on Emerging Topics in Computational Intelligence10.1109/TETCI.2024.34026949:1(607-616)Online publication date: Feb-2025
    • (2024)The Sustainable Innovation of AI: Text Mining the Core Capabilities of Researchers in the Digital Age of Industry 4.0Sustainability10.3390/su1617776716:17(7767)Online publication date: 6-Sep-2024
    • (2024)Information Retrieval and Machine Learning Methods for Academic Expert FindingAlgorithms10.3390/a1702005117:2(51)Online publication date: 23-Jan-2024
    • (2024)Systematic mapping of automated reviewer recommendation solutionsJournal of Computer Science and Technology10.24215/16666038.24.e1624:2(e16)Online publication date: 18-Oct-2024
    • (2024)RevGNN: Negative Sampling Enhanced Contrastive Graph Learning for Academic Reviewer RecommendationACM Transactions on Information Systems10.1145/367920043:1(1-26)Online publication date: 4-Nov-2024
    • (2024)A multilayer network diffusion-based model for reviewer recommendationChinese Physics B10.1088/1674-1056/ad181d33:3(038901)Online publication date: 1-Mar-2024
    • (2024)Multi-objective optimization for assigning reviewers to proposals based on social networksJournal of Management Science and Engineering10.1016/j.jmse.2024.05.001Online publication date: Jun-2024
    • (2024)Matching papers and reviewers at large conferencesArtificial Intelligence10.1016/j.artint.2024.104119331:COnline publication date: 1-Jun-2024
    • (2023)Group fairness in peer reviewProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3668953(64885-64895)Online publication date: 10-Dec-2023
    • (2023)Counterfactual evaluation of peer-review assignment policiesProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3668685(58765-58786)Online publication date: 10-Dec-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media