research-article

A controlled experiment on white-box database testing

Authors:

Javier Tuya,

Javier Dolado,

Ma Jose Suarez-Cabal,

Claudio de la RivaAuthors Info & Claims

ACM SIGSOFT Software Engineering Notes, Volume 33, Issue 1

Article No.: 8, Pages 1 - 6

https://doi.org/10.1145/1344452.1344462

Published: 01 January 2008 Publication History

Get Access

Abstract

Controlled experiments are a powerful way to assess and compare the effectiveness of different techniques. In this paper we present the experimental results of the evaluation of the effectiveness of a structural test coverage criterion developed for SQL queries when used by a tester to guide the selection of database test cases. We describe a controlled experiment designed for comparing this criterion with other conventional criteria such as equivalence partitioning and boundary value analysis. The results show that 1) the use of the structural coverage allows the tester to develop more effective test cases, 2) the effectiveness is higher when considering the kind of faults that are more specifically related to SQL than other kinds of faults, and 3) the results give us some insight into how to improve the coverage criterion.

References

[1]

Bowen, P. L. and Rohde, F. H. (2002): Further evidence of the effects of normalization on end-user query errors: an experimental evaluation, International Journal of Accounting Information Systems, 3(4) 255--290.

Crossref

Google Scholar

[2]

Brass, S. and Goldberg, C. (2006): Semantic Errors in SQL Queries: A Quite Complete List. Journal of Systems and Software, 79(5) 630--644.

Digital Library

Google Scholar

[3]

Juristo, N., Moreno, A. M. and Vegas, S. (2004): Reviewing 25 Years of Testing Technique Experiments, Empirical Software Engineering, 9(1-2) 7--44.

Digital Library

Google Scholar

[4]

King, K. N. and Offutt, J. (1991): A Fortran Language System for Mutation-Based Software Testing. Software Practice and Experience, 21(7) 686-718.

Digital Library

Google Scholar

[5]

Reisner, P. (1977) Use of Psychological Experimentation as an Aid to Development of a Query Language, IEEE Transactions on Software Engineering, 3(3) 218--229.

Digital Library

Google Scholar

[6]

Siau, K. L., Chan, H. C. and Wei, K. L. (2004): Effects of Query Complexity and Learning on Novice User Query Performance With Conceptual and Logical Database Interfaces, IEEE Transactions on Systems, Man and Cybernetics-Part A: Systems and Humans, 34(2) 276--281.

Digital Library

Google Scholar

[7]

Suarez-Cabal, M. J. and Tuya, J. (2004): Using a SQL Coverage Measurement for Testing Database Applications, 12th ACM SIGSOFT Symposium on Foundations of Software Engineering. ACM Software Engineering Notes 19(6) 253--262.

Digital Library

Google Scholar

[8]

Suarez-Cabal, M. J. (2006): Improvement of test cases for database applications using coverage measurements of SQL Queries, PhD Thesis, University of Oviedo.

Google Scholar

[9]

Tuya, J., Suarez-Cabal, M. J. and de la Riva, C. (2006): SQLMutation: a Tool to Generate Mutants of SQL Database Queries, Second Workshop on Mutation Analysis (Mutation 2006), Raleigh, NC.

Digital Library

Google Scholar

[10]

Tuya, J., Suarez-Cabal, M. J. and de la Riva, C. (2007): Mutating Database Queries, Information and Software Technology, 49(4) 398--417.

Digital Library

Google Scholar

Cited By

View all

Ji ZMa PWang SBissyandé TKlein JBird CSarro F(2023)PerfCE: Performance Debugging on Databases with Chaos Engineering-Enhanced Causality AnalysisProceedings of the 38th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE56229.2023.00106(1454-1466)Online publication date: 11-Nov-2023
https://dl.acm.org/doi/10.1109/ASE56229.2023.00106
Almendros-Jiménez JBecerra-Terón A(2021)Discovery and diagnosis of wrong SPARQL queries with ontology and constraint reasoningExpert Systems with Applications10.1016/j.eswa.2020.113772165(113772)Online publication date: Mar-2021
https://doi.org/10.1016/j.eswa.2020.113772
Mayeda MAndrews A(2021)Evaluating software testing techniques: A systematic mapping study10.1016/bs.adcom.2021.01.002(41-114)Online publication date: 2021
https://doi.org/10.1016/bs.adcom.2021.01.002
Show More Cited By

Index Terms

A controlled experiment on white-box database testing

Recommendations

A practical guide to SQL white-box testing

SQL is a ubiquitous language used in a wide range of applications for accessing the data stored in relational databases. However, the usual software testing techniques are not designed to address some important features of SQL. We present a set of ...
Constraint-based test database generation for SQL queries
AST '10: Proceedings of the 5th Workshop on Automation of Software Test

Populating test databases with meaningful test data is a difficult task as it involves generating data for many joined tables that must be diverse enough to be able to reveal faults and small enough to make the testing process efficient. This paper ...
Using an SQL coverage measurement for testing database applications

Many software applications have a component based on database management systems in which information is generally handled through SQL queries embedded in the application code. When automation of software testing is mentioned in the research, this is ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGSOFT Software Engineering Notes

ACM SIGSOFT Software Engineering Notes Volume 33, Issue 1

January 2008

54 pages

ISSN:0163-5948

DOI:10.1145/1344452

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 January 2008

Published in SIGSOFT Volume 33, Issue 1

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Ministerio de Educación, Cultura y Deporte

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
646
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ji ZMa PWang SBissyandé TKlein JBird CSarro F(2023)PerfCE: Performance Debugging on Databases with Chaos Engineering-Enhanced Causality AnalysisProceedings of the 38th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE56229.2023.00106(1454-1466)Online publication date: 11-Nov-2023
https://dl.acm.org/doi/10.1109/ASE56229.2023.00106
Almendros-Jiménez JBecerra-Terón A(2021)Discovery and diagnosis of wrong SPARQL queries with ontology and constraint reasoningExpert Systems with Applications10.1016/j.eswa.2020.113772165(113772)Online publication date: Mar-2021
https://doi.org/10.1016/j.eswa.2020.113772
Mayeda MAndrews A(2021)Evaluating software testing techniques: A systematic mapping study10.1016/bs.adcom.2021.01.002(41-114)Online publication date: 2021
https://doi.org/10.1016/bs.adcom.2021.01.002
Zhou CFrankl P(2018)JDAMA: Java database application mutation analyserSoftware Testing, Verification & Reliability10.1002/stvr.46221:3(241-263)Online publication date: 21-Dec-2018
https://dl.acm.org/doi/10.1002/stvr.462
Rosero RGomez ORodriguez G(2017)An approach for regression testing of database applications in incremental development settings2017 6th International Conference on Software Process Improvement (CIMPS)10.1109/CIMPS.2017.8169952(1-4)Online publication date: Oct-2017
https://doi.org/10.1109/CIMPS.2017.8169952
Rosero RGomez ORodriguez G(2017)Regression Testing of Database Applications Under an Incremental Software Development SettingIEEE Access10.1109/ACCESS.2017.27495025(18419-18428)Online publication date: 2017
https://doi.org/10.1109/ACCESS.2017.2749502
Mallouli WLallali MMammar AMorales GCavalli AGabillon ASheng QMansoor W(2010)Modeling and Testing SecureWeb ApplicationsWeb-Based Information Technologies and Distributed Systems10.2991/978-94-91216-32-9_10(207-255)Online publication date: 2010
https://doi.org/10.2991/978-94-91216-32-9_10
Tuya JSuárez‐Cabal Mde la Riva C(2010)Full predicate coverage for testing SQL database queriesSoftware Testing, Verification and Reliability10.1002/stvr.42420:3(237-288)Online publication date: 15-Jan-2010
https://doi.org/10.1002/stvr.424
Mallouli WLallali MMorales GCavalli A(2008)Modeling and Testing Secure Web-Based SystemsProceedings of the 2008 IEEE International Conference on Signal Image Technology and Internet Based Systems10.1109/SITIS.2008.58(128-136)Online publication date: 30-Nov-2008
https://dl.acm.org/doi/10.1109/SITIS.2008.58

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A practical guide to SQL white-box testing

Constraint-based test database generation for SQL queries

Using an SQL coverage measurement for testing database applications

Comments

Published In

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

A practical guide to SQL white-box testing

Constraint-based test database generation for SQL queries

Using an SQL coverage measurement for testing database applications

Comments

Information

Published In

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations