article

Perspective-Based Reading: A Replicated Experiment Focused on Individual Reviewer Effectiveness

Authors:

Victor BasiliAuthors Info & Claims

Empirical Software Engineering, Volume 11, Issue 1

Pages 119 - 142

https://doi.org/10.1007/s10664-006-5967-6

Published: 01 March 2006 Publication History

Abstract

This paper describes a replication conducted to compare the effectiveness of inspectors using Perspective Based Reading (PBR) to the effectiveness of inspectors using a checklist. The goal of this replication was to better understand the complementary aspects of the PBR perspectives. To this end, a brief discussion of the original study is provided as well as a more detailed description of the replication. A detailed statistical analysis is then provided along with analysis of the PBR perspectives.

For the individual PBR perspectives, we saw an interesting dichotomy: In the original study there was little overlap among the sets of defects found by each of the three perspectives, while in the replication two of the three perspectives found similar sets of defects on one of the two documents used in the study. Interestingly this document was the only case where the users of PBR were not more effective than the users of a checklist. This result leads to a new hypothesis that the complementary aspect of the PBR perspectives is the characteristic that provides the benefit over other defect detection techniques.

References

[1]

Basili V, Green S, Laitenberger O, Shull F, Sorumgaard S, Zelkowitz M (1996) The empirical investigation of perspective based reading. Empir Softw Eng-Int J. 1:133-164.

Crossref

Google Scholar

[2]

Ciolkowski M, Differding C, Laitenberger O, Munch J (1997) Empirical investigation of perspective-based reading: a replicated experiment. ISERN 97-13.

Google Scholar

[3]

Conradi R, Mahagheghi P, Arif T, Hegde LC, Bunde GA, Pedersen A (2003) Object-oriented reading techniques for inspection of uml models--an industrial experiment. Proc of Eur Conf on Object Oriented Program (ECOOP'03). Darmstadt, Germany, pp. 483-500.

Google Scholar

[4]

Laitenberger O, Atkinson C, Schlich M, El Emam K (2000) An experimental comparison of reading techniques for defect detection in uml design documents. J Syst Softw 53: 183-204.

Crossref

Google Scholar

[5]

Laitenberger O, El Emam K, Harbich TG (2001) An internally replicated quasi-experimental comparison of checklist and perspective based reading of code documents. IEEE Trans. Softw Eng 27:387-421.

Digital Library

Google Scholar

[6]

Mendonca M, Sunderhaft NL (1999) A state of the Art Report: Mining Software Engineering Data. Department of Defense (DoD) Data & Analysis Center for Software Engineering Data.

Google Scholar

[7]

Porter A, Votta L (1998) Comparing detection methods for software requirements inspections: a replication using professional subjects. Empir Softw Eng-Int J 3:355-379.

Crossref

Google Scholar

[8]

Regnell B, Runeson P, Thelin T (2000) Are the perspectives really different? Further experimentation on scenario-based reading of requirements. Empir Softw Eng 5:331-356.

Digital Library

Google Scholar

[9]

Robson C (2002) Real World Research. Blackwell Publishing, Malden: MA.

Google Scholar

[10]

Shull F (1998) Developing Techniques for Using Software Documents: A Series of Empirical Studies. Ph.D. Thesis. Department of Computer Science, University of Maryland, College Park.

Crossref

Google Scholar

[11]

Shull F, Basili V, Boehm B, Brown, AW, Costa P, Lindvall M, Port D, Rus I, Tesoriero R, Zelkowitz M (2002a). What we have learned about fighting defects. Proc IEEE Symp on Softw Metr 249-258.

Crossref

Google Scholar

[12]

Shull F, Basili V, Carver J, Maldonado J, Travassos G, Mendonca M, Fabbri S (2002b) Replicating Software Engineering Experiments: Addressing the Tacit Knowledge Problem. Proc of Int Symp Empir Softw Eng (ISESE'02). Nara, Japan, pp. 7-16.

Crossref

Google Scholar

[13]

Zhang Z, Basili V, Shneiderman B (1999) Perspective-based usability inspection: an empirical validation of efficacy. Empirical Software Engineering--An International Journal 4:43-70.

Crossref

Google Scholar

Cited By

View all

Daun MBrings J(2023)Investigating Factors Influencing Students’ Assessment of Conceptual ModelsProceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering10.1145/3593434.3593960(470-474)Online publication date: 14-Jun-2023
https://dl.acm.org/doi/10.1145/3593434.3593960
Daun MBrings J(2023)Aggregating N-fold Requirements Inspection ResultsProceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering10.1145/3593434.3593465(339-347)Online publication date: 14-Jun-2023
https://dl.acm.org/doi/10.1145/3593434.3593465
Daun MBrings JWeyer T(2023)Model inspections in the engineering of collaborative cyber‐physical systems with instance‐level review diagramsJournal of Software: Evolution and Process10.1002/smr.239235:5Online publication date: 25-Apr-2023
https://dl.acm.org/doi/10.1002/smr.2392
Show More Cited By

Index Terms

Perspective-Based Reading: A Replicated Experiment Focused on Individual Reviewer Effectiveness

Recommendations

Task-directed software inspection technique: an experiment and case study
CASCON '00: Proceedings of the 2000 conference of the Centre for Advanced Studies on Collaborative research

Research in software inspection has led to the development of inspection techniques focused on providing structure and guidance to the individual inspector, with the goal of improving effectiveness. This paper defines and investigates a new inspection ...
Combining data from reading experiments in software inspections: a feasibility study
Lecture notes on empirical software engineering

Software inspections have been around for 25 years, and most software engineering researchers and professionals know that they are mostly a cost-effective means for removing software defects. However, this does not mean that there is consensus about how ...
An Experimental Comparison of Checklist-Based Reading and Perspective-Based Reading for UML Design Document Inspection
ISESE '02: Proceedings of the 2002 International Symposium on Empirical Software Engineering

This paper describes an experimental comparison of two reading techniques, namely Checklist-based reading (CBR) and Perspective-based reading (PBR) for Object-Oriented (OO) design inspection. Software inspection is an effective approach to detect ...

Comments

Information & Contributors

Information

Published In

cover image Empirical Software Engineering

Empirical Software Engineering Volume 11, Issue 1

March 2006

163 pages

ISSN:1382-3256

Issue’s Table of Contents

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 March 2006

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Daun MBrings J(2023)Investigating Factors Influencing Students’ Assessment of Conceptual ModelsProceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering10.1145/3593434.3593960(470-474)Online publication date: 14-Jun-2023
https://dl.acm.org/doi/10.1145/3593434.3593960
Daun MBrings J(2023)Aggregating N-fold Requirements Inspection ResultsProceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering10.1145/3593434.3593465(339-347)Online publication date: 14-Jun-2023
https://dl.acm.org/doi/10.1145/3593434.3593465
Daun MBrings JWeyer T(2023)Model inspections in the engineering of collaborative cyber‐physical systems with instance‐level review diagramsJournal of Software: Evolution and Process10.1002/smr.239235:5Online publication date: 25-Apr-2023
https://dl.acm.org/doi/10.1002/smr.2392
Daun MBrings JWeyer T(2020)Do Instance-level Review Diagrams Support Validation Processes of Cyber-Physical System SpecificationsProceedings of the International Conference on Software and System Processes10.1145/3379177.3388893(11-20)Online publication date: 26-Jun-2020
https://dl.acm.org/doi/10.1145/3379177.3388893
Daun MBrings JKrajinski LWeyer TSutton SArmbrust OHebig R(2019)On the benefits of using dedicated models in validation processes for behavioral specificationsProceedings of the International Conference on Software and System Processes10.1109/ICSSP.2019.00016(44-53)Online publication date: 25-May-2019
https://dl.acm.org/doi/10.1109/ICSSP.2019.00016
Teixeira EFonseca LSoares SKulesza UPrikladnicki RGerosa MWerner CAndrade R(2018)Threats to validity in controlled experiments in software engineeringProceedings of the XXXII Brazilian Symposium on Software Engineering10.1145/3266237.3266264(52-61)Online publication date: 17-Sep-2018
https://dl.acm.org/doi/10.1145/3266237.3266264
Teixeira E(2018)Improving the Quality of Controlled Experiments in Software EngineeringACM SIGSOFT Software Engineering Notes10.1145/3178315.317832143:1(1-6)Online publication date: 28-Mar-2018
https://dl.acm.org/doi/10.1145/3178315.3178321
Daun MSalmon AWeyer TPohl KLv JZhang HBabar M(2015)The impact of students' skills and experiences on empirical resultsProceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering10.1145/2745802.2745829(1-6)Online publication date: 27-Apr-2015
https://dl.acm.org/doi/10.1145/2745802.2745829
Rocha ARamalho FMachado P(2015)Automating test-based inspection of design modelsSoftware Quality Journal10.1007/s11219-013-9219-x23:1(3-28)Online publication date: 1-Mar-2015
https://dl.acm.org/doi/10.1007/s11219-013-9219-x
Mäntylä MPetersen KLehtinen TLassenius CJalote PBriand LHoek A(2014)Time pressure: a controlled experiment of test case development and requirements reviewProceedings of the 36th International Conference on Software Engineering10.1145/2568225.2568245(83-94)Online publication date: 31-May-2014
https://dl.acm.org/doi/10.1145/2568225.2568245
Show More Cited By

Abstract

References

Cited By

Index Terms

Recommendations

Task-directed software inspection technique: an experiment and case study

Combining data from reading experiments in software inspections: a feasibility study

An Experimental Comparison of Checklist-Based Reading and Perspective-Based Reading for UML Design Document Inspection

Comments

Information

Published In

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations