research-article

How to formulate specific how-to questions in software development?

Authors:

Andrian Marcus,

Christoph Treude,

Yanjun YangAuthors Info & Claims

ESEC/FSE 2022: Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering

Pages 306 - 318

https://doi.org/10.1145/3540250.3549160

Published: 09 November 2022 Publication History

Abstract

Developers often ask how-to questions using search engines, technical Q&A communities, and interactive Q&A systems to seek help for specific programming tasks. However, they often do not formulate the questions in a specific way, making it hard for the systems to return the best answers. We propose an approach (TaskKG4Q) that interactively helps developers formulate a programming related how-to question. TaskKG4Q is using a programming task knowledge graph (task KG in short) mined from Stack Overflow questions, which provides a hierarchical conceptual structure for tasks in terms of [actions], [objects], and [constraints]. An empirical evaluation of the intrinsic quality of the task KG revealed that 75.0% of the annotated questions in the task KG are correct. The comparison between TaskKG4Q and two baselines revealed that TaskKG4Q can help developers formulate more specific how-to questions. More so, an empirical study with novice programmers revealed that they write more effective questions for finding answers to their programming tasks on Stack Overflow.

References

[1]

2021. Stack Overflow data dump version from March 4, 2021. https://archive.org/download/stackexchange/

[2]

2022. FuncVerbNet. https://github.com/FudanSELab/funcverbnet

[3]

2022. instance of. https://www.wikidata.org/wiki/Property:P31

[4]

2022. Java. https://www.wikidata.org/wiki/Q251

[5]

2022. part of. https://www.wikidata.org/wiki/Property:P361

[6]

2022. Programming Language. https://www.wikidata.org/wiki/Q9143

[7]

2022. Python. https://www.wikidata.org/wiki/Q28865

[8]

2022. Replication Package. https://fudanselab.github.io/Research-FSE2022-taskKG

[9]

2022. SpaCy. https://spacy.io

[10]

2022. subclass of. https://www.wikidata.org/wiki/Property:P279

[11]

2022. WikiData. https://wikidata.org/

[12]

Ahmad Abdellatif, Khaled Badran, Diego Costa, and Emad Shihab. 2021. A Comparison of Natural Language Understanding Platforms for Chatbots in Software Engineering. IEEE Transactions on Software Engineering, https://doi.org/10.1109/TSE.2021.3078384

Digital Library

[13]

Fouad Nasser A Al Omran and Christoph Treude. 2017. Choosing an NLP Library for Analyzing Software Documentation: A Systematic Literature Review and a Series of Experiments. In 14th International Conference on Mining Software Repositories, MSR 2017, May 20-28, 2017, Buenos Aires, Argentina. 187–197. https://doi.org/10.1109/MSR.2017.42

Digital Library

[14]

Miltiadis Allamanis and Charles A. Sutton. 2013. Why, When, and What: Analyzing Stack Overflow Questions by Topic, Type, and Code. In 10th Working Conference on Mining Software Repositories, MSR 2013, May 18-19, 2013, San Francisco, CA, USA. 53–56. https://doi.org/10.1109/MSR.2013.6624004

[15]

Antoaneta Baltadzhieva and Grzegorz Chrupala. 2015. Predicting the Quality of Questions on Stackoverflow. In Recent Advances in Natural Language Processing, RANLP 2015, 7-9 September, 2015, Hissar, Bulgaria. RANLP 2015 Organising Committee / ACL, 32–40.

[16]

Antoaneta Baltadzhieva and Grzegorz Chrupala. 2015. Question Quality in Community Question Answering Forums: a survey. SIGKDD Explor., 17, 1 (2015), 8–13. https://doi.org/10.1145/2830544.2830547

Digital Library

[17]

Stefanie Beyer, Christian Macho, Martin Pinzger, and Massimiliano Di Penta. 2018. Automatically Classifying Posts into Question Categories on Stack Overflow. In 26th Conference on Program Comprehension, ICPC 2018, May 27-28, 2018, Gothenburg, Sweden. 211–221. https://doi.org/10.1145/3196321.3196333

Digital Library

[18]

Stefanie Beyer and Martin Pinzger. 2014. A Manual Categorization of Android App Development Issues on Stack Overflow. In 30th IEEE International Conference on Software Maintenance and Evolution, ICSME 2014, September 29 - October 3, 2014, Victoria, BC, Canada. 531–535. https://doi.org/10.1109/ICSME.2014.88

Digital Library

[19]

Fabio Calefato, Filippo Lanubile, and Nicole Novielli. 2018. How to Ask for Technical Help? Evidence-based Guidelines for Writing Questions on Stack Overflow. Inf. Softw. Technol., 94 (2018), 186–207. https://doi.org/10.1016/j.infsof.2017.10.009

[20]

Kaibo Cao, Chunyang Chen, Sebastian Baltes, Christoph Treude, and Xiang Chen. 2021. Automated Query Reformulation for Efficient Search based on Query Logs From Stack Overflow. In 43rd IEEE/ACM International Conference on Software Engineering, ICSE 2021, 22-30 May 2021, Madrid, Spain. IEEE, 1273–1285. https://doi.org/10.1109/ICSE43902.2021.00116

Digital Library

[21]

Oscar Chaparro, Juan Manuel Florez, and Andrian Marcus. 2017. Using Observed Behavior to Reformulate Queries during Text Retrieval-based Bug Localization. In 2017 IEEE International Conference on Software Maintenance and Evolution, ICSME 2017, September 17-22, 2017, Shanghai, China. IEEE Computer Society, 376–387. https://doi.org/10.1109/ICSME.2017.100

[22]

Oscar Chaparro, Juan Manuel Florez, and Andrian Marcus. 2019. Using Bug Descriptions to Reformulate Queries during Text-retrieval-based Bug Localization. Empir. Softw. Eng., 24, 5 (2019), 2947–3007. https://doi.org/10.1007/s10664-018-9672-z

Digital Library

[23]

Oscar Chaparro, Juan Manuel Florez, Unnati Singh, and Andrian Marcus. 2019. Reformulating Queries for Duplicate Bug Report Detection. In 26th IEEE International Conference on Software Analysis, Evolution and Reengineering, SANER 2019, February 24-27, 2019, Hangzhou, China. IEEE, 218–229. https://doi.org/10.1109/SANER.2019.8667985

[24]

Jinho D. Choi, Joel R. Tetreault, and Amanda Stent. 2015. It Depends: Dependency Parser Comparison Using A Web-based Evaluation Tool. In 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, ACL 2015, July 26-31, 2015, Beijing, China, Volume 1: Long Papers. 387–396. https://doi.org/10.3115/v1/p15-1038

[25]

Zachary Eberhart, Aakash Bansal, and Collin Mcmillan. 2020. A Wizard of Oz Study Simulating API Usage Dialogues with a Virtual Assistant. IEEE Trans. Software Eng., https://doi.org/10.1109/TSE.2020.3040935

Digital Library

[26]

Sonia Haiduc, Gabriele Bavota, Andrian Marcus, Rocco Oliveto, Andrea De Lucia, and Tim Menzies. 2013. Automatic Query Reformulations for Text Retrieval in Software Engineering. In 35th International Conference on Software Engineering, ICSE 2013, May 18-26, 2013, San Francisco, CA, USA. IEEE Computer Society, 842–851. https://doi.org/10.1109/ICSE.2013.6606630

[27]

Abram Handler, Matthew Denny, Hanna M. Wallach, and Brendan O’Connor. 2016. Bag of What? Simple Noun Phrase Extraction for Text Analysis. In 1st Workshop on NLP and Computational Social Science, NLP+CSS@EMNLP 2016, November 5, 2016, Austin, TX, USA. Association for Computational Linguistics, 114–124. https://doi.org/10.18653/v1/W16-5615

[28]

Yasuhiro Hayase, Yu Kashima, Yuki Manabe, and Katsuro Inoue. 2011. Building Domain Specific Dictionaries of Verb-Object Relation from Source Code. In 15th European Conference on Software Maintenance and Reengineering, CSMR 2011, 1-4 March 2011, Oldenburg, Germany. 93–100. https://doi.org/10.1109/CSMR.2011.15

Digital Library

[29]

Emily Hill, Lori L. Pollock, and K. Vijay-Shanker. 2009. Automatically Capturing Source Code Context of NL-queries for Software Maintenance and Reuse. In 31st International Conference on Software Engineering, ICSE 2009, May 16-24, 2009, Vancouver, Canada. IEEE, 232–242. https://doi.org/10.1109/ICSE.2009.5070524

Digital Library

[30]

Emily Hill, Lori L. Pollock, and K. Vijay-Shanker. 2011. Improving source code search with natural language phrasal representations of method signatures. In 26th IEEE/ACM International Conference on Automated Software Engineering ASE 2011, November 6-10, 2011, Lawrence, KS, USA, Perry Alexander, Corina S. Pasareanu, and John G. Hosking (Eds.). IEEE Computer Society, 524–527. https://doi.org/10.1109/ASE.2011.6100115

Digital Library

[31]

Yuki Kashiwabara, Yuya Onizuka, Takashi Ishio, Yasuhiro Hayase, Tetsuo Yamamoto, and Katsuro Inoue. 2014. Recommending Verbs for Rename Method using Association Rule Mining. In 2014 Software Evolution Week - IEEE Conference on Software Maintenance, Reengineering, and Reverse Engineering, CSMR-WCRE 2014, February 3-6, 2014, Antwerp, Belgium. 323–327. https://doi.org/10.1109/CSMR-WCRE.2014.6747186

[32]

Niraj Kumar and Kannan Srinathan. 2008. Automatic keyphrase extraction from scientific documents using N-gram filtration technique. In Proceedings of the 2008 ACM Symposium on Document Engineering, Sao Paulo, Brazil, September 16-19, 2008. ACM, 199–208. https://doi.org/10.1145/1410140.1410180

Digital Library

[33]

Hongwei Li, Sirui Li, Jiamou Sun, Zhenchang Xing, Xin Peng, Mingwei Liu, and Xuejiao Zhao. 2018. Improving API Caveats Accessibility by Mining API Caveats Knowledge Graph. In 34th IEEE International Conference on Software Maintenance and Evolution, ICSME 2018, September 23-29, 2018, Madrid, Spain. 183–193. https://doi.org/10.1109/ICSME.2018.00028

[34]

Hongwei Li, Zhenchang Xing, Xin Peng, and Wenyun Zhao. 2013. What Help do Developers Seek, When and How? In 20th Working Conference on Reverse Engineering, WCRE 2013, October 14-17, 2013, Koblenz, Germany. IEEE Computer Society, 142–151. https://doi.org/10.1109/WCRE.2013.6671289

[35]

Zhixing Li, Tao Wang, Yang Zhang, Yun Zhan, and Gang Yin. 2016. Query Reformulation by Leveraging Crowd Wisdom for Scenario-based Software Search. In 8th Asia-Pacific Symposium on Internetware, Internetware 2016, September 18, 2016, Beijing, China. ACM, 36–44. https://doi.org/10.1145/2993717.2993723

Digital Library

[36]

Jiakun Liu, Sebastian Baltes, Christoph Treude, David Lo, Yun Zhang, and Xin Xia. 2021. Characterizing Search Activities on Stack Overflow. In 29th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2021, August 23-28, 2021, Athens, Greece. ACM, 919–931. https://doi.org/10.1145/3468264.3468582

Digital Library

[37]

Mingwei Liu, Xin Peng, Qingtao Jiang, Andrian Marcus, Junwen Yang, and Wenyun Zhao. 2018. Searching StackOverflow Questions with Multi-Faceted Categorization. In 10th Asia-Pacific Symposium on Internetware, Internetware 2018, September 16-16, 2018, Beijing, China. ACM, 10:1–10:10. https://doi.org/10.1145/3275219.3275227

Digital Library

[38]

Mingwei Liu, Xin Peng, Andrian Marcus, Shuangshuang Xing, Christoph Treude, and Chengyuan Zhao. 2021. API-Related Developer Information Needs in Stack Overflow. IEEE Transactions on Software Engineering.

[39]

Mingwei Liu, Xin Peng, Andrian Marcus, Zhenchang Xing, Wenkai Xie, Shuangshuang Xing, and Yang Liu. 2019. Generating Query-specific Class API Summaries. In 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/SIGSOFT FSE 2019, August 26-30, 2019, Tallinn, Estonia. ACM, 120–130. https://doi.org/10.1145/3338906.3338971

Digital Library

[40]

Yang Liu, Mingwei Liu, Xin Peng, Christoph Treude, Zhenchang Xing, and Xiaoxin Zhang. 2020. Generating Concept based API Element Comparison Using a Knowledge Graph. In 35th IEEE/ACM International Conference on Automated Software Engineering, ASE 2020, September 21-25, 2020, Melbourne, Australia. IEEE, 834–845. https://doi.org/10.1145/3324884.3416628

Digital Library

[41]

Meili Lu, Xiaobing Sun, Shaowei Wang, David Lo, and Yucong Duan. 2015. Query Expansion via WordNet for Effective Code Search. In 22nd IEEE International Conference on Software Analysis, Evolution, and Reengineering, SANER 2015, March 2-6, 2015, Montreal, QC, Canada. IEEE Computer Society, 545–549. https://doi.org/10.1109/SANER.2015.7081874

[42]

Meili Lu, Xiaobing Sun, Shaowei Wang, David Lo, and Yucong Duan. 2015. Query Expansion via WordNet for Effective Code Search. In 22nd IEEE International Conference on Software Analysis, Evolution, and Reengineering, SANER 2015, March 2-6,2015, Montreal, QC, Canada. IEEE Computer Society, 545–549. https://doi.org/10.1109/SANER.2015.7081874

[43]

Meili Lu, Xiaobing Sun, Shaowei Wang, David Lo, and Yucong Duan. 2015. Query expansion via WordNet for effective code search. In 22nd IEEE International Conference on Software Analysis, Evolution, and Reengineering, SANER 2015, March 2-6, 2015, Montreal, QC, Canada. IEEE Computer Society, 545–549. https://doi.org/10.1109/SANER.2015.7081874

[44]

Claudio Lucchese, Franco Maria Nardini, Raffaele Perego, Roberto Trani, and Rossano Venturini. 2018. Efficient and Effective Query Expansion for Web Search. In 27th ACM International Conference on Information and Knowledge Management, CIKM 2018, Torino, Italy, October 22-26, 2018. ACM, 1551–1554. https://doi.org/10.1145/3269206.3269305

Digital Library

[45]

Andrian Marcus, Andrey Sergeyev, Václav Rajlich, and Jonathan I. Maletic. 2004. An Information Retrieval Approach to Concept Location in Source Code. In 11th Working Conference on Reverse Engineering, WCRE 2004, November 8-12, 2004, Delft, The Netherlands. IEEE Computer Society, 214–223. https://doi.org/10.1109/WCRE.2004.10

[46]

Mary L McHugh. 2012. Interrater reliability: the kappa statistic. Biochemia Medica: Biochemia Medica, 22, 3 (2012), 276–282.

[47]

Seyed Mehdi Nasehi, Jonathan Sillito, Frank Maurer, and Chris Burns. 2012. What Makes a Good Code Example?: A Study of Programming Q&A in StackOverflow. In 28th IEEE International Conference on Software Maintenance, ICSM 2012, September 23-28, 2012, Trento, Italy. IEEE Computer Society, 25–34. https://doi.org/10.1109/ICSM.2012.6405249

Digital Library

[48]

Liming Nie, He Jiang, Zhilei Ren, Zeyi Sun, and Xiaochen Li. 2016. Query Expansion Based on Crowd Knowledge for Code Search. IEEE Trans. Serv. Comput., 9, 5 (2016), 771–783. https://doi.org/10.1109/TSC.2016.2560165

[49]

Francisca Pérez, Jaime Font, Lorena Arcega, and Carlos Cetina. 2019. Collaborative Feature Location in Models through Automatic Query Expansion. Autom. Softw. Eng., 26, 1 (2019), 161–202. https://doi.org/10.1007/s10515-019-00251-9

Digital Library

[50]

Luca Ponzanelli, Andrea Mocci, Alberto Bacchelli, Michele Lanza, and David Fullerton. 2014. Improving Low Quality Stack Overflow Post Detection. In 30th IEEE International Conference on Software Maintenance and Evolution, ICSME 2014, September 29 - October 3, 2014, Victoria, BC, Canada. IEEE Computer Society, 541–544. https://doi.org/10.1109/ICSME.2014.90

Digital Library

[51]

Md. Masudur Rahman, Jed Barson, Sydney Paul, Joshua Kayani, Federico Andres Lois, Sebastian Fernandez Quezada, Christopher Parnin, Kathryn T. Stolee, and Baishakhi Ray. 2018. Evaluating How Developers Use General-purpose Web-search for Code Retrieval. In 15th International Conference on Mining Software Repositories, MSR 2018, May 28-29, 2018, Gothenburg, Sweden. ACM, 465–475. https://doi.org/10.1145/3196398.3196425

Digital Library

[52]

Mohammad Masudur Rahman and Chanchal K. Roy. 2016. QUICKAR: Automatic Query Reformulation for Concept Location using Crowdsourced Knowledge. In 31st IEEE/ACM International Conference on Automated Software Engineering, ASE 2016, September 3-7, 2016, Singapore. ACM, 220–225. https://doi.org/10.1145/2970276.2970362

Digital Library

[53]

Mohammad Masudur Rahman and Chanchal K. Roy. 2017. Improved Query Reformulation for Concept Location using CodeRank and Document Structures. In 32nd IEEE/ACM International Conference on Automated Software Engineering, ASE 2017, October 30 - November 03, 2017, Urbana, IL, USA. IEEE Computer Society, 428–439. https://doi.org/10.1109/ASE.2017.8115655

[54]

Mohammad Masudur Rahman and Chanchal K. Roy. 2018. Effective Reformulation of Query for Code Search Using Crowdsourced Knowledge and Extra-Large Data Analytics. In 2018 IEEE International Conference on Software Maintenance and Evolution, ICSME 2018, September 23-29, 2018, Madrid, Spain. IEEE Computer Society, 473–484. https://doi.org/10.1109/ICSME.2018.00057

[55]

Sujith Ravi, Bo Pang, Vibhor Rastogi, and Ravi Kumar. 2014. Great Question! Question Quality in Community Q&A. In 8th International Conference on Weblogs and Social Media, ICWSM 2014,June 1-4, 2014, Ann Arbor, Michigan, USA. The AAAI Press. http://www.aaai.org/ocs/index.php/ICWSM/ICWSM14/paper/view/8080

[56]

Manuel Roldan-Vega, Greg Mallet, Emily Hill, and Jerry Alan Fails. 2013. CONQUER: A Tool for NL-Based Query Refinement and Contextualizing Code Search Results. In 2013 IEEE International Conference on Software Maintenance, ICSM 2013, September 22-28, 2013, Eindhoven, The Netherlands. IEEE Computer Society, 512–515. https://doi.org/10.1109/ICSM.2013.84

Digital Library

[57]

Christoffer Rosen and Emad Shihab. 2016. What are Mobile Developers Asking about? A Large Scale Study using Stack Overflow. Empir. Softw. Eng., 21, 3 (2016), 1192–1223. https://doi.org/10.1007/s10664-015-9379-3

Digital Library

[58]

David C. Shepherd, Zachary P. Fry, Emily Hill, Lori L. Pollock, and K. Vijay-Shanker. 2007. Using Natural Language Program Analysis to Locate and Understand Action-oriented Concerns. In 6th International Conference on Aspect-Oriented Software Development, AOSD 2007, March 12-16, 2007, Vancouver, British Columbia, Canada (ACM International Conference Proceeding Series, Vol. 208). ACM, 212–224. https://doi.org/10.1145/1218563.1218587

Digital Library

[59]

Ravindra Singh and Naurang Singh Mangat. 2013. Elements of Survey Sampling. 15, Springer Science & Business Media.

[60]

Bunyamin Sisman and Avinash C. Kak. 2013. Assisting Code Search with Automatic Query Reformulation for Bug Localization. In 10th Working Conference on Mining Software Repositories, MSR 2013, May 18-19, 2013, San Francisco, CA, USA. IEEE Computer Society, 309–318. https://doi.org/10.1109/MSR.2013.6624044

[61]

Sampath Srinivas. 1993. A Generalization of the Noisy-Or Model. In 9th Annual Conference on Uncertainty in Artificial Intelligence, UAI 1993, July 9-11, 1993, The Catholic University of America, Providence, Washington, DC, USA. 208–215.

[62]

Jiamou Sun, Zhenchang Xing, Rui Chu, Heilai Bai, Jinshui Wang, and Xin Peng. 2019. Know-How in Programming Tasks: From Textual Tutorials to Task-Oriented Knowledge Graph. In IEEE International Conference on Software Maintenance and Evolution, ICSME 2019, September 29 - October 4, 2019, Cleveland, OH, USA. IEEE, 257–268. https://doi.org/10.1109/ICSME.2019.00039

[63]

Yuan Tian, Ferdian Thung, Abhishek Sharma, and David Lo. 2017. APIBot: question answering bot for API documentation. In 32nd IEEE/ACM International Conference on Automated Software Engineering, ASE 2017, October 30 - November 03, 2017, Urbana, IL, USA. IEEE Computer Society, 153–158. https://doi.org/10.1109/ASE.2017.8115628

[64]

Christoph Treude, Ohad Barzilay, and Margaret-Anne D. Storey. 2011. How do Programmers Ask and Answer Questions on the Web? In 33rd International Conference on Software Engineering, ICSE 2011, May 21-28, 2011, Waikiki, Honolulu, HI, USA. ACM, 804–807. https://doi.org/10.1145/1985793.1985907

Digital Library

[65]

Christoph Treude, Martin P. Robillard, and Barthélémy Dagenais. 2015. Extracting Development Tasks to Navigate Software Documentation. IEEE Trans. Software Eng., 41, 6 (2015), 565–581. https://doi.org/10.1109/TSE.2014.2387172

Digital Library

[66]

Pradeep K. Venkatesh, Shaohua Wang, Ying Zou, and Joanna W. Ng. 2017. A Personalized Assistant Framework for Service Recommendation. In 2017 IEEE International Conference on Services Computing, SCC 2017, June 25-30, 2017, Honolulu, HI, USA. IEEE Computer Society, 92–99. https://doi.org/10.1109/SCC.2017.20

[67]

Chong Wang, Xin Peng, Mingwei Liu, Zhenchang Xing, Xuefang Bai, Bing Xie, and Tuo Wang. 2019. A Learning-Based Approach for Automatic Construction of Domain Glossary from Source Code and Documentation. In 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/SIGSOFT FSE 2019, August 26-30, 2019, Tallinn, Estonia. 97–108. https://doi.org/10.1145/3338906.3338963

Digital Library

[68]

Lu Wang, Xiaobing Sun, Jingwei Wang, Yucong Duan, and Bin Li. 2017. Construct Bug Knowledge Graph for Bug Resolution: Poster. In 39th International Conference on Software Engineering, ICSE 2017 - Companion Volume, May 20-28, 2017, Buenos Aires, Argentina. IEEE Computer Society, 189–191. https://doi.org/10.1109/ICSE-C.2017.102

Digital Library

[69]

Bernard L Welch. 1947. The Generalization of Student’s Problem when Several Different Population Variances are Involved. Biometrika, 34, 1/2 (1947), 28–35.

[70]

Wenkai Xie, Xin Peng, Mingwei Liu, Christoph Treude, Zhenchang Xing, Xiaoxin Zhang, and Wenyun Zhao. 2020. API method recommendation via explicit matching of functionality verb phrases. In 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/SIGSOFT FSE 2020, November 8-13, 2020, Virtual Event, USA. ACM, 1015–1026.

Digital Library

[71]

Shuangshuang Xing, Mingwei Liu, and Xin Peng. 2021. Automatic Code Semantic Tag Generation based on Software Knowledge Graph. Journal of Software.

[72]

Bowen Xu, Zhenchang Xing, Xin Xia, and David Lo. 2017. AnswerBot: Automated Generation of Answer Summary to Developersź Technical Questions. In 32nd IEEE/ACM International Conference on Automated Software Engineering, ASE 2017, October 30 - November 03, 2017, Urbana, IL, USA. 706–716. https://doi.org/10.1109/ASE.2017.8115681

[73]

Neng Zhang, Qiao Huang, Xin Xia, Ying Zou, David Lo, and Zhenchang Xing. 2022. Chatbot4QR: Interactive Query Refinement for Technical Question Retrieval. IEEE Trans. Software Eng., 48, 4 (2022), 1185–1211. https://doi.org/10.1109/TSE.2020.3016006

[74]

Neng Zhang, Jian Wang, Yutao Ma, Keqing He, Zheng Li, and Xiaoqing (Frank) Liu. 2018. Web Service Discovery based on Goal-oriented Query Expansion. J. Syst. Softw., 142 (2018), 73–91. https://doi.org/10.1016/j.jss.2018.04.046

Cited By

Du XLou YLiu MPeng XYang TChandra SBlincoe KTonella P(2023)KG4CraSolver: Recommending Crash Solutions via Knowledge GraphProceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3611643.3616317(1242-1254)Online publication date: 30-Nov-2023
https://dl.acm.org/doi/10.1145/3611643.3616317
Huang QSun YXing ZYu MXu XLu Q(2023)API Entity and Relation Joint Extraction from Text via Dynamic Prompt-tuned Language ModelACM Transactions on Software Engineering and Methodology10.1145/360718833:1(1-25)Online publication date: 23-Nov-2023
https://dl.acm.org/doi/10.1145/3607188
Liu MZhao CPeng XYu SWang HSha C(2023)Task-Oriented ML/DL Library Recommendation Based on a Knowledge GraphIEEE Transactions on Software Engineering10.1109/TSE.2023.328528049:8(4081-4096)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1109/TSE.2023.3285280
Show More Cited By

Index Terms

How to formulate specific how-to questions in software development?

Recommendations

Questions vs. Queries in Informational Search Tasks
WWW '15 Companion: Proceedings of the 24th International Conference on World Wide Web

Search systems traditionally require searchers to formulate information needs as keywords rather than in a more natural form, such as questions. Recent studies have found that Web search engines are observing an increase in the fraction of queries ...
RACK: code search in the IDE using crowdsourced knowledge
ICSE-C '17: Proceedings of the 39th International Conference on Software Engineering Companion

Traditional code search engines often do not perform well with natural language queries since they mostly apply keyword matching. These engines thus require carefully designed queries containing information about programming APIs for code search. ...
Characterizing Queries in Different Search Tasks
HICSS '12: Proceedings of the 2012 45th Hawaii International Conference on System Sciences

The purpose of this study is to explore the characteristics of queries of varied search tasks driven by different user intents. For this, the study collected empirical and descriptive evidence of twenty-nine subjects' information searching process on ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ESEC/FSE 2022: Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering

November 2022

1822 pages

ISBN:9781450394130

DOI:10.1145/3540250

General Chair:
Abhik Roychoudhury
National University of Singapore, Singapore
,
Program Chairs:
Cristian Cadar
Imperial College London, UK
,
Miryung Kim
University of California at Los Angeles, USA

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 November 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ESEC/FSE '22

Sponsor:

ESEC/FSE '22: 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering

November 14 - 18, 2022

Singapore, Singapore

Acceptance Rates

Overall Acceptance Rate 112 of 543 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
213
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Du XLou YLiu MPeng XYang TChandra SBlincoe KTonella P(2023)KG4CraSolver: Recommending Crash Solutions via Knowledge GraphProceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3611643.3616317(1242-1254)Online publication date: 30-Nov-2023
https://dl.acm.org/doi/10.1145/3611643.3616317
Huang QSun YXing ZYu MXu XLu Q(2023)API Entity and Relation Joint Extraction from Text via Dynamic Prompt-tuned Language ModelACM Transactions on Software Engineering and Methodology10.1145/360718833:1(1-25)Online publication date: 23-Nov-2023
https://dl.acm.org/doi/10.1145/3607188
Liu MZhao CPeng XYu SWang HSha C(2023)Task-Oriented ML/DL Library Recommendation Based on a Knowledge GraphIEEE Transactions on Software Engineering10.1109/TSE.2023.328528049:8(4081-4096)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1109/TSE.2023.3285280
Wang DXiao TTreude CKula RHata HKamei Y(2023)Understanding the Role of Images on Stack Overflow2023 IEEE/ACM 20th International Conference on Mining Software Repositories (MSR)10.1109/MSR59073.2023.00059(377-388)Online publication date: May-2023
https://doi.org/10.1109/MSR59073.2023.00059
Liu MYu SPeng XDu XYang TXu HZhang G(2023)Knowledge Graph based Explainable Question Retrieval for Programming Tasks2023 IEEE International Conference on Software Maintenance and Evolution (ICSME)10.1109/ICSME58846.2023.00023(123-135)Online publication date: 1-Oct-2023
https://doi.org/10.1109/ICSME58846.2023.00023
Treude C(2023)Navigating Complexity in Software Engineering: A Prototype for Comparing GPT-n Solutions2023 IEEE/ACM 5th International Workshop on Bots in Software Engineering (BotSE)10.1109/BotSE59190.2023.00008(1-5)Online publication date: May-2023
https://doi.org/10.1109/BotSE59190.2023.00008
Liu MYang TLou YDu XWang YPeng X(2023)CodeGen4Libs: A Two-Stage Approach for Library-Oriented Code Generation2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE)10.1109/ASE56229.2023.00159(434-445)Online publication date: 11-Sep-2023
https://doi.org/10.1109/ASE56229.2023.00159
Wang CLou YLiu JPeng X(2023)Generating Variable Explanations via Zero-shot Prompt Learning2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE)10.1109/ASE56229.2023.00130(748-760)Online publication date: 11-Sep-2023
https://doi.org/10.1109/ASE56229.2023.00130

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten