research-article

Interrogative-guided re-ranking for question-oriented software text retrieval

Authors:

Ting Ye,

Bing Xie,

Yanzhen Zou,

Xiuzhao ChenAuthors Info & Claims

ASE '14: Proceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering

Pages 115 - 120

https://doi.org/10.1145/2642937.2642953

Published: 15 September 2014 Publication History

Get Access

Abstract

In many software engineering tasks, question-oriented text retrieval is often used to help developers search for software artifacts. In this paper, we propose an interrogative-guided re-ranking approach for question-oriented software text retrieval. Since different interrogatives usually indicate users' different search focuses, we firstly label 9 kinds of question-answer pairs according to the common interrogatives. Then, we train document classifiers by using 1,826 questions along with 2,460 answers from StackOverflow, apply the classifiers to our document repository and present a re-ranking approach to improve the retrieval precision. In software document classification, our classifiers achieve the average precision, recall and F-measure of 56.2%, 90.9% and 69.4% respectively. Our re-ranking approach presents 9.6% improvement in nDCG@1 upon the baseline, and we also obtain 8.1% improvement in nDCG@10 when more candidates are included.

References

[1]

C. M. Bishop et al. Pattern recognition and machine learning, volume 1. springer New York, 2006.

Digital Library

Google Scholar

[2]

D. H. Dalip, M. A. Gonçalves, M. Cristo, and P. Calado. Exploiting user feedback to learn to rank answers in q&a forums: a case study with stack overflow. In SIGIR, pages 543--552. ACM, 2013.

Digital Library

Google Scholar

[3]

A. Genkin, D. D. Lewis, and D. Madigan. Large-scale bayesian logistic regression for text categorization. Technometrics, 49(3):291--304, 2007.

Crossref

Google Scholar

[4]

S. Gottipati, D. Lo, and J. Jiang. Finding relevant answers in software forums. In ASE, pages 323--332. IEEE Computer Society, 2011.

Digital Library

Google Scholar

[5]

S. Haiduc, G. Bavota, A. Marcus, R. Oliveto, A. De Lucia, and T. Menzies. Automatic query reformulations for text retrieval in software engineering. In ICSE, pages 842--851. IEEE Press, 2013.

Digital Library

Google Scholar

[6]

K. Järvelin and J. Kekäläinen. Ir evaluation methods for retrieving highly relevant documents. In Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, pages 41--48. ACM, 2000.

Digital Library

Google Scholar

[7]

C. Liu, Y. Zou, S. Cai, B. Xie, and H. Mei. Finding the merits and drawbacks of software resources from comments. In ASE, pages 432--435. IEEE Computer Society, 2011.

Digital Library

Google Scholar

[8]

C. D. Manning, P. Raghavan, and H. Schütze. Introduction to information retrieval, volume 1. 2008.

Crossref

Google Scholar

[9]

D. Roobaert, G. Karakoulas, and N. V. Chawla. Information gain, correlation and support vector machines. In Feature Extraction, pages 463--470. Springer, 2006.

Crossref

Google Scholar

[10]

Y. Tian, J. Lawall, and D. Lo. Identifying linux bug fixing patches. In ICSE, pages 386--396. IEEE, 2012.

Digital Library

Google Scholar

[11]

C. Treude, O. Barzilay, and M.-A. Storey. How do programmers ask and answer questions on the web?: Nier track. In ICSE, pages 804--807. IEEE, 2011.

Digital Library

Google Scholar

Cited By

View all

Kou BChen MZhang T(2023)Automated Summarization of Stack Overflow Posts2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE)10.1109/ICSE48619.2023.00158(1853-1865)Online publication date: May-2023
https://doi.org/10.1109/ICSE48619.2023.00158
Gao ZXia XLo DGrundy JZhang XXing Z(2022)I Know What You Are Searching for: Code Snippet Recommendation from Stack Overflow PostsACM Transactions on Software Engineering and Methodology10.1145/355015032:3(1-42)Online publication date: 21-Jul-2022
https://dl.acm.org/doi/10.1145/3550150
Liu MPeng XMarcus AXing STreude CZhao C(2022)API-Related Developer Information Needs in Stack OverflowIEEE Transactions on Software Engineering10.1109/TSE.2021.312020348:11(4485-4500)Online publication date: 1-Nov-2022
https://doi.org/10.1109/TSE.2021.3120203
Show More Cited By

Index Terms

Interrogative-guided re-ranking for question-oriented software text retrieval
1. Information systems
  1. Information retrieval
2. Software and its engineering

Recommendations

Query polyrepresentation for ranking retrieval systems without relevance judgments

Ranking information retrieval (IR) systems with respect to their effectiveness is a crucial operation during IR evaluation, as well as during data fusion. This article offers a novel method of approaching the system-ranking problem, based on the widely ...
Semantic relation based personalized ranking approach for engineering document retrieval

Since engineering design is heavily informational, engineers want to retrieve existing engineering documents accurately during the product development process. However, engineers have difficulties searching for documents because of low retrieval ...
Re-ranking search results using query logs
CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge management

This work addresses two common problems in search, frequently occurring with underspecified user queries: the top-ranked results for such queries may not contain documents relevant to the user's search intent, and fresh and relevant pages may not get ...

Comments

Information & Contributors

Information

Published In

ASE '14: Proceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering

September 2014

934 pages

ISBN:9781450330138

DOI:10.1145/2642937

General Chair:
Ivica Crnkovic
Mälardalen University, Sweden
,
Program Chairs:
Marsha Chechik
University of Toronto, Canada
,
Paul Grünbacher
Johannes Kepler Universität Linz, Austria

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

ASE '14

Sponsor:

SIGAI
SIGSOFT
Mälardalen University

ASE '14: ACM/IEEE International Conference on Automated Software Engineering

September 15 - 19, 2014

Vasteras, Sweden

Acceptance Rates

ASE '14 Paper Acceptance Rate 82 of 337 submissions, 24%;

Overall Acceptance Rate 82 of 337 submissions, 24%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
278
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kou BChen MZhang T(2023)Automated Summarization of Stack Overflow Posts2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE)10.1109/ICSE48619.2023.00158(1853-1865)Online publication date: May-2023
https://doi.org/10.1109/ICSE48619.2023.00158
Gao ZXia XLo DGrundy JZhang XXing Z(2022)I Know What You Are Searching for: Code Snippet Recommendation from Stack Overflow PostsACM Transactions on Software Engineering and Methodology10.1145/355015032:3(1-42)Online publication date: 21-Jul-2022
https://dl.acm.org/doi/10.1145/3550150
Liu MPeng XMarcus AXing STreude CZhao C(2022)API-Related Developer Information Needs in Stack OverflowIEEE Transactions on Software Engineering10.1109/TSE.2021.312020348:11(4485-4500)Online publication date: 1-Nov-2022
https://doi.org/10.1109/TSE.2021.3120203
Nadi STreude C(2020)Essential Sentences for Navigating Stack Overflow Answers2020 IEEE 27th International Conference on Software Analysis, Evolution and Reengineering (SANER)10.1109/SANER48275.2020.9054828(229-239)Online publication date: Feb-2020
https://doi.org/10.1109/SANER48275.2020.9054828
Ahmad AFeng CGe SYousif A(2018)A survey on mining stack overflow: question and answering (Q&A) communityData Technologies and Applications10.1108/DTA-07-2017-005452:2(190-247)Online publication date: 3-Apr-2018
https://doi.org/10.1108/DTA-07-2017-0054
Zou YYe TLu YMylopoulos JZhang LCohen MGrunske LWhalen M(2015)Learning to rank for question-oriented software text retrievalProceedings of the 30th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE.2015.24(1-11)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1109/ASE.2015.24

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Query polyrepresentation for ranking retrieval systems without relevance judgments

Semantic relation based personalized ranking approach for engineering document retrieval

Re-ranking search results using query logs