research-article

Comprehending studies on program comprehension

Authors:

Ivonne Schröter,

Janet Siegmund,

Thomas LeichAuthors Info & Claims

ICPC '17: Proceedings of the 25th International Conference on Program Comprehension

Pages 308 - 311

https://doi.org/10.1109/ICPC.2017.9

Published: 20 May 2017 Publication History

Abstract

Program comprehension is an important aspect of developing and maintaining software, as programmers spend most of their time comprehending source code. Thus, it is the focus of many studies and experiments to evaluate approaches and techniques that aim to improve program comprehension. As the amount of corresponding work increases, the question arises how researchers address program comprehension. To answer this question, we conducted a literature review of papers published at the International Conference on Program Comprehension, the major venue for research on program comprehension. In this article, we i) present preliminary results of the literature review and ii) derive further research directions. The results indicate the necessity for a more detailed analysis of program comprehension and empirical research.

References

[1]

V. R. Basili, F. Shull, and F. Lanubile. Building Knowledge Through Families of Experiments. IEEE Trans. Software Eng., 25(4):456--473, 1999.

Digital Library

[2]

F. Beck, O. Moseler, S. Diehl, and G. D. Rey. In Situ Understanding of Performance Bottlenecks through Visually Augmented Code. In ICPC, pages 63--72. IEEE, 2013.

[3]

R. M. M. Bezerra, F. Q. B. da Silva, A. M. Santana, C. V. C. Magalhaes, and R. E. S. Santos. Replication of Empirical Studies in Software Engineering: An Update of a Systematic Mapping Study. In ESEM, pages 1--4. IEEE, 2015.

[4]

O. P. Brereton, B. A. Kitchenham, D. Budgen, M. Turner, and M. Khalil. Lessons from Applying the Systematic Literature Review Process within the Software Engineering Domain. J. Syst. Software, 80(4):571--583, 2007.

Digital Library

[5]

S. Butler, M. Wermelinger, and Y. Yu. A Survey of the Forms of Java Reference Names. In ICPC, pages 196--206. IEEE, 2015.

Digital Library

[6]

J. C. Carver. Towards Reporting Guidelines for Experimental Replications: A Proposal. In RESE. 2010.

[7]

T. Dybå, V. B. Kampenes, and D. I. K. Sjøberg. A Systematic Review of Statistical Power in Software Engineering Experiments. Inform. Software Tech., 48(8):745--755, 2006.

[8]

A. Jedlitschka and D. Pfahl. Reporting Guidelines for Controlled Experiments in Software Engineering. In ISESE, pages 95--104. IEEE, 2005.

[9]

J. Jiang, J. Koskinen, A. Ruokonen, and T. Systa. Constructing Usage Scenarios for API Redocumentation. In ICPC, pages 259--264. IEEE, 2007.

Digital Library

[10]

N. Juristo and S. Vegas. Using Differences Among Replications of Software Engineering Experiments to Gain Knowledge. In ESEM, pages 356--366. IEEE, 2009.

Digital Library

[11]

B. A. Kitchenham and S. Charters. Guidelines for Performing Systematic Literature Reviews in Software Engineering. Technical Report EBSE-2007-01, Keele University and University of Durham, 2007.

[12]

B. A. Kitchenham, S. L. Pfleeger, L. M. Pickard, P. W. Jones, D. C. Hoaglin, K. El Emam, and J. Rosenberg. Preliminary Guidelines for Empirical Research in Software Engineering. IEEE Trans. Software Eng., 28(8):721--734, 2002.

Digital Library

[13]

B. A. Kitchenham, O. P. Brereton, D. Budgen, M. Turner, J. Bailey, and S. Linkman. Systematic Literature Reviews in Software Engineering - A Systematic Literature Review. Inform. Software Tech., 51(1):7--15, 2009.

Digital Library

[14]

A. J. Ko, T. D. Latoza, and M. M. Burnett. A Practical Guide to Controlled Experiments of Software Engineering Tools with Human Participants. Empir. Software Eng., 20(1):110--141, 2015.

Digital Library

[15]

W. Maalej, R. Tiarks, T. Roehm, and R. Koschke. On the Comprehension of Program Comprehension. ACM Trans. Software Eng. Methodol., 23(4):31:1--31:37, 2014.

Digital Library

[16]

P. Petersen, S. Hanenberg, and R. Robbes. An Empirical Comparison of Static and Dynamic Type Systems on API Usage in the Presence of an IDE: Java vs. Groovy with Eclipse. In ICPC, pages 212--222. ACM, 2014.

Digital Library

[17]

T. Roehm. Two User Perspectives in Program Comprehension: End Users and Developer Users. In ICPC '15, pages 129--139. IEEE, 2015.

Digital Library

[18]

J. Siegmund. Program Comprehension: Past, Present, and Future. In SANER, pages 13--20. IEEE, 2016.

[19]

J. Siegmund, N. Siegmund, and S. Apel. Views on Internal and External Validity in Empirical Software Engineering. In ICSE, pages 9--19. IEEE, 2015.

Digital Library

[20]

D. I. K. Sjøberg, B. Anda, E. Arisholm, T. Dyba, M. Jørgensen, A. Karahasanovic, E. F. Koren, and M. Vokác. Conducting Realistic Experiments in Software Engineering. In ISESE, pages 17--26. IEEE, 2002.

Digital Library

[21]

M. Wang, X. Shi, and K. Wong. Capturing Expert Knowledge for Automated Configuration Fault Diagnosis. In ICPC, pages 205--208. IEEE, 2011.

Digital Library

[22]

H. Zhang, M. A. Babar, and P. Tell. Identifying Relevant Studies in Software Engineering. Inform. Software Tech., 53(6):625--637, 2011.

Digital Library

Cited By

Wyrich MApel S(2024)Evidence Tetris in the Pixelated World of Validity ThreatsProceedings of the 1st IEEE/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering10.1145/3643664.3648203(13-16)Online publication date: 16-Apr-2024
https://dl.acm.org/doi/10.1145/3643664.3648203
Zid CZampetti FAntoniol GDi Penta MRoychoudhury APaiva AAbreu RStorey M(2024)A Study on the Pythonic Functional Constructs' UnderstandabilityProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639211(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3639211
van de Laar PCorvino RMooij Avan Wezep HRosmalen R(2024)Custom static analysis to enhance insight into the usage of in-house librariesJournal of Systems and Software10.1016/j.jss.2024.112028212:COnline publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1016/j.jss.2024.112028
Show More Cited By

Recommendations

Measuring program comprehension: a large-scale field study with professionals
ICSE '18: Proceedings of the 40th International Conference on Software Engineering

During software development and maintenance, developers spend a considerable amount of time on program comprehension. Previous studies show that program comprehension takes up as much as half of a developer's time. However, most of these studies are ...
On the Comprehension of Program Comprehension
Special Issue International Conference on Software Engineering (ICSE 2012) and Regular Papers

Research in program comprehension has evolved considerably over the past decades. However, only little is known about how developers practice program comprehension in their daily work. This article reports on qualitative and quantitative research to ...
A Comparison of Program Comprehension Strategies by Blind and Sighted Programmers

Programmers who are blind use a screen reader to speak source code one word at a time, as though the code were text. This process of reading is in stark contrast to sighted programmers, who skim source code rapidly with their eyes. At present, it is not ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICPC '17: Proceedings of the 25th International Conference on Program Comprehension

May 2017

399 pages

ISBN:9781538605356

General Chair:
Giuseppe Scanniello
University of Basilicata, Italy
,
Program Chairs:
David Lo
Singapore Management University, Singapore
,
Alexander Serebrenik
Eindhoven University of Technology, The Netherlands

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering
IEEE-CS: Computer Society
SADIO: SADIO

Publisher

IEEE Press

Publication History

Published: 20 May 2017

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE '17

Sponsor:

SIGSOFT
IEEE-CS
SADIO

ICSE '17: 39th International Conference on Software Engineering

May 20 - 28, 2017

Buenos Aires, Argentina

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
218
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wyrich MApel S(2024)Evidence Tetris in the Pixelated World of Validity ThreatsProceedings of the 1st IEEE/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering10.1145/3643664.3648203(13-16)Online publication date: 16-Apr-2024
https://dl.acm.org/doi/10.1145/3643664.3648203
Zid CZampetti FAntoniol GDi Penta MRoychoudhury APaiva AAbreu RStorey M(2024)A Study on the Pythonic Functional Constructs' UnderstandabilityProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639211(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3639211
van de Laar PCorvino RMooij Avan Wezep HRosmalen R(2024)Custom static analysis to enhance insight into the usage of in-house librariesJournal of Systems and Software10.1016/j.jss.2024.112028212:COnline publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1016/j.jss.2024.112028
Guerra EGomes EFerreira JWiese ILima PGerosa MMeirelles P(2024)How do annotations affect Java code readability?Empirical Software Engineering10.1007/s10664-024-10460-w29:3Online publication date: 3-May-2024
https://dl.acm.org/doi/10.1007/s10664-024-10460-w
Wyrich MBogner JWagner S(2023)40 Years of Designing Code Comprehension Experiments: A Systematic Mapping StudyACM Computing Surveys10.1145/362652256:4(1-42)Online publication date: 9-Nov-2023
https://dl.acm.org/doi/10.1145/3626522
Finnie-Ansley JDenny PLuxton-Reilly ASantos EPrather JBecker B(2023)My AI Wants to Know if This Will Be on the Exam: Testing OpenAI’s Codex on CS2 Programming ExercisesProceedings of the 25th Australasian Computing Education Conference10.1145/3576123.3576134(97-104)Online publication date: 30-Jan-2023
https://dl.acm.org/doi/10.1145/3576123.3576134
Gupta NRajput AChimalakonda SDwyer M(2022)COSPEXProceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion Proceedings10.1145/3510454.3516842(41-45)Online publication date: 21-May-2022
https://dl.acm.org/doi/10.1145/3510454.3516842
Hebig RHo-Quang TJolak RSchröder JLinero HÅgren MMaro S(2020)How do Students Experience and Judge Software Comprehension Techniques?Proceedings of the 28th International Conference on Program Comprehension10.1145/3387904.3389283(425-435)Online publication date: 13-Jul-2020
https://dl.acm.org/doi/10.1145/3387904.3389283
Stapleton SGambhir YLeClair AEberhart ZWeimer WLeach KHuang Y(2020)A Human Study of Comprehension and Code SummarizationProceedings of the 28th International Conference on Program Comprehension10.1145/3387904.3389258(2-13)Online publication date: 13-Jul-2020
https://dl.acm.org/doi/10.1145/3387904.3389258
Krüger JDumas MPfahl DApel SRusso A(2019)Tackling knowledge needs during software evolutionProceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3338906.3342505(1244-1246)Online publication date: 12-Aug-2019
https://dl.acm.org/doi/10.1145/3338906.3342505
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents