research-article

Virtual DOM coverage for effective testing of dynamic web applications

Authors:

Zebao GaoAuthors Info & Claims

ISSTA 2014: Proceedings of the 2014 International Symposium on Software Testing and Analysis

Pages 60 - 70

https://doi.org/10.1145/2610384.2610399

Published: 21 July 2014 Publication History

Abstract

Test adequacy criteria are fundamental in software testing. Among them, code coverage criterion is widely used due to its simplicity and effectiveness. However, in dynamic web application testing, merely covering server-side script code is inadequate because it neglects client-side execution, which plays an important role in triggering client-server interactions to reach important execution states. Similarly, a criterion aiming at covering the UI elements on client-side pages ignores the server-side execution, leading to insufficiency.

In this paper, we propose Virtual DOM (V-DOM) Coverage, a novel criterion, for effective web application testing. With static analysis, we first aggregate all the DOM objects that may be produced by a piece of server script to construct a V-DOM tree. The tree models execution on both the client- and server-sides such that V-DOM coverage is more effective than existing coverage criteria in web application testing. We conduct an empirical study on five real world dynamic web applications. We find that V-DOM tree can model much more DOM objects than a web crawling based technique. Test selection based on V-DOM tree criterion substantially outperforms the existing code coverage and UI element coverage, by detecting more faults.

References

[1]

Phc: open source PHP compiler. http://www.phpcompiler.org/.

[2]

The LLVM Project: a collection of modular and reusable compiler and toolchain technologies. http://llvm.org/

[3]

Selenium: web browser automation. http://www.seleniumhq.org/.

[4]

S. Elbaum, G. Rothermel, S. Kanduri, and A. Malishevsky. Selecting a cost-effective test case prioritization technique. Software Quality Journal, 12(3):185–210, 2004.

Digital Library

[5]

N. Alshahwan, M. Harman, A. Marchetto, and P. Tonella. Improving web application testing using testability measures. In WSE’09, pages 49–58, 2009.

[6]

C. Fang, Z. Chen, and B. Xu. Comparing logic coverage criteria on test case prioritization. Science China Information Sciences, 55(12):2826–2840, 2012.

[7]

P. Ammann and J. Offutt. Introduction to Software Testing. Cambridge University Press, 2008.

Digital Library

[8]

S. Artzi, A. Kiezun, J. Dolby, F. Tip, D. Dig, and A. Paradkar. Finding bugs in dynamic web applications In ISSTA’08, pages 261–272, 2008.

Digital Library

[9]

P. Boldi, B. Codenotti, M. Santini, and S. Vigna. Ubicrawler: A scalable fully distributed web crawler. Software: Practice and Experience, 34(8):711–726, 2004.

Digital Library

[10]

S. Brin and L. Page. The anatomy of a large-scale hypertextual web search engine. Computer Networks and ISDN Systems, 30(1):107–117, 1998.

Digital Library

[11]

M. Burner. Crawling towards eternity: Building an archive of the World Wide Web. Web Techniques Magazine, 2(5), 1997.

[12]

J. Cho and H. Garcia-Molina. Parallel crawlers. Technical report, 2001.

[13]

A. Christensen, A. Feldthaus, and A. Moller. Precise analysis of string expressions. In SAS’03, pages 1–18, 2003.

Digital Library

[14]

C. Duda, G. Frey, D. Kossmann, R. Matter, and C. Zhou. Ajax crawl: making AJAX applications searchable. In ICDE’09, pages 78–89, 2009.

Digital Library

[15]

P. Frankl and E. Weyuker. An applicable family of data flow testing criteria. IEEE Transactions on Software Engineering, 14(10):1483–1498, 1988.

Digital Library

[16]

E. Geay, M. Pistoia, B. Ryder, and J. Dolby. Modular string-sensitive permission analysis with demand-driven preciion. In ICSE’09, pages 177–187, 2009.

Digital Library

[17]

P. Hooimeijier and W. Weimer. A decision procedure for subset constraints over regular languages. In PLDI’09, pages 188–198, 2009.

Digital Library

[18]

A. Kiezun, V. Ganesh, P. Guo, P. Hooimeijier, and M. Ernst. A solver for string constraints. In ISSTA’09, pages 105–116, 2009.

Digital Library

[19]

D. Kung, C. Liu, and P. Hsia. An object-oriented web test model for testing web applications. In APAQS’00, pages 111–120, 2000.

Digital Library

[20]

C. Liu, D. Kung, and P. Hsia. Object-based data flow testing of web applications. In APAQS’00, pages 7–16, 2000.

Digital Library

[21]

G. Lucca, A. Fasolino, F. Faralli, and U. Carlini. Testing web applications. In ICSM’2002, pages 310–319, 2002.

Digital Library

[22]

A. Mesbah, E. Bozdag, and A. van Deursen. Crawling AJAX by inferring user interface state changes. In ICWE’08, pages 122–134, 2008.

Digital Library

[23]

Y. Minamide. Static approximation of dynamically generated web pages. In WWW’05, pages 432–441, 2005.

Digital Library

[24]

A. Namin and J. Andrews. The influence of size and coverage on test suite effectiveness. In ISSTA’09, pages 57–68, 2009.

Digital Library

[25]

F. Ricca and P. Tonella. Analysis and testing of web applications. In ICSE’01, pages 25–34, 2010.

Digital Library

[26]

T. Tateishi, M. Pistoia, and O. Tripp. Path- and index-sensitive string analysis based on monadic second-order logic. In ISSTA’11, pages 166–176, 2011.

Digital Library

[27]

P. Tonella, F. Ricca, E. Pianta, and G. C. Evaluation methods for web application clustering. In WSE’03, pages 33–40, 2003.

[28]

G. Wassermann and Z. Su. Sound and precise analysis of web applications for injection vulnerabilities. In PLDI’07, pages 32–41, 2007.

Digital Library

[29]

G. Wassermann, D. Yu, A. Chander, D. Dhurjati, H. Inamura and Z. Su. Dynamic test input generation for web applications. In ISSTA’08, pages 249-260, 2008.

Digital Library

[30]

Y. Wei, M. Oriol, and B. Meyer. Is coverage a good measure of testing effectiveness? Technical report, ETH Zurich, 2010.

[31]

H. Samimi, M. Schäfer, S. Artzi, T. Millstein, F. Tip, and L. Hendren. Automated repair of HTML generation errors in PHP applications using string constraint solving. in ICSE’12, pages 277-287, 2012.

Digital Library

[32]

Y. Zou, C. Fang, Z. Chen, X. Zhang, and Z. Zhao. A hybrid coverage criterion for dynamic web testing. in SEKE’13, 2013.

[33]

A. Memon, M. Soffa, and M. Pollack. Coverage criteria for GUI testing. in FSE’01, pages 256–267, 2001.

Digital Library

Cited By

Abishek RVijay Anand M(2024)Automation Xtreme - A Web Automation AI ToolComputational Intelligence in Data Science10.1007/978-3-031-69986-3_4(51-64)Online publication date: 30-Aug-2024
https://doi.org/10.1007/978-3-031-69986-3_4
Ganji MAlimadadi STip FChandra SBlincoe KTonella P(2023)Code Coverage Criteria for Asynchronous ProgramsProceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3611643.3616292(1307-1319)Online publication date: 30-Nov-2023
https://dl.acm.org/doi/10.1145/3611643.3616292
Bai AHong JLanperne MPark JCerny TShahriar H(2023)Million.js: A Fast Compiler-Augmented Virtual DOM for the WebProceedings of the 38th ACM/SIGAPP Symposium on Applied Computing10.1145/3555776.3577683(1813-1820)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3555776.3577683
Show More Cited By

Index Terms

Virtual DOM coverage for effective testing of dynamic web applications

Recommendations

Million.js: A Fast Compiler-Augmented Virtual DOM for the Web
SAC '23: Proceedings of the 38th ACM/SIGAPP Symposium on Applied Computing

Interactive web applications created with declarative JavaScript User Interface (UI) libraries have increasingly dominated the modern internet. However, existing libraries are primarily made for runtime execution, and rely on the user to load and render ...
DOM-based test adequacy criteria for web applications
ISSTA 2014: Proceedings of the 2014 International Symposium on Software Testing and Analysis

To assess the quality of web application test cases, web developers currently measure code coverage. Although code coverage has traditionally been a popular test adequacy criterion, we believe it alone is not adequate for assessing the quality of web ...
Coverage criteria for automatic security testing of web applications
ICISS'10: Proceedings of the 6th international conference on Information systems security

In security testing of web applications, the selection of coverage criteria for adequacy evaluation of test cases is based on the trade off between test cost and vulnerability detection effectiveness. Coverage criteria used in traditional software ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ISSTA 2014: Proceedings of the 2014 International Symposium on Software Testing and Analysis

July 2014

460 pages

ISBN:9781450326452

DOI:10.1145/2610384

General Chair:
Corina S. Păsăreanu
NASA Ames, USA
,
Program Chair:
Darko Marinov
University of Illinois at Urbana-Champaign, USA

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

In-Cooperation

SIGPLAN: ACM Special Interest Group on Programming Languages

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 July 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ISSTA '14

Sponsor:

SIGSOFT

ISSTA '14: International Symposium on Software Testing and Analysis

July 21 - 25, 2014

CA, San Jose, USA

Acceptance Rates

Overall Acceptance Rate 58 of 213 submissions, 27%

Upcoming Conference

ISSTA '25

Sponsor:
sigsoft

34th ACM SIGSOFT International Symposium on Software Testing and Analysis

June 25 - 28, 2025

Trondheim , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
466
Total Downloads

Downloads (Last 12 months)42
Downloads (Last 6 weeks)13

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Abishek RVijay Anand M(2024)Automation Xtreme - A Web Automation AI ToolComputational Intelligence in Data Science10.1007/978-3-031-69986-3_4(51-64)Online publication date: 30-Aug-2024
https://doi.org/10.1007/978-3-031-69986-3_4
Ganji MAlimadadi STip FChandra SBlincoe KTonella P(2023)Code Coverage Criteria for Asynchronous ProgramsProceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3611643.3616292(1307-1319)Online publication date: 30-Nov-2023
https://dl.acm.org/doi/10.1145/3611643.3616292
Bai AHong JLanperne MPark JCerny TShahriar H(2023)Million.js: A Fast Compiler-Augmented Virtual DOM for the WebProceedings of the 38th ACM/SIGAPP Symposium on Applied Computing10.1145/3555776.3577683(1813-1820)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3555776.3577683
Kaur GTiwari R(2023)Comparison and Analysis of Popular Frontend Frameworks and Libraries: An Evaluation of Parameters for Frontend Web Development2023 4th International Conference on Electronics and Sustainable Communication Systems (ICESC)10.1109/ICESC57686.2023.10192987(1067-1073)Online publication date: 6-Jul-2023
https://doi.org/10.1109/ICESC57686.2023.10192987
Sherin SMuqeet AKhan MIqbal M(2023)QExplore: An exploration strategy for dynamic web applications using guided searchJournal of Systems and Software10.1016/j.jss.2022.111512195(111512)Online publication date: Jan-2023
https://doi.org/10.1016/j.jss.2022.111512
Ghoreshi MHaghighi H(2023)Object coverage criteria for supporting object-oriented testingSoftware Quality Journal10.1007/s11219-023-09643-331:4(1369-1414)Online publication date: 30-Jun-2023
https://doi.org/10.1007/s11219-023-09643-3
(2022)Dynamic Security Testing Techniques for the Semantic Web of ThingsTools, Languages, Methodologies for Representing Semantics on the Web of Things10.1002/9781394171460.ch5(75-91)Online publication date: 16-Sep-2022
https://doi.org/10.1002/9781394171460.ch5
Sherin SIqbal MKhan MJilani A(2020)Comparing Coverage Criteria for Dynamic Web application: An Empirical EvaluationComputer Standards & Interfaces10.1016/j.csi.2020.103467(103467)Online publication date: Aug-2020
https://doi.org/10.1016/j.csi.2020.103467
Nguyen HPhan HKästner CNguyen T(2019)Exploring output-based coverage for testing PHP web applicationsAutomated Software Engineering10.1007/s10515-018-0246-526:1(59-85)Online publication date: 1-Mar-2019
https://dl.acm.org/doi/10.1007/s10515-018-0246-5
Kwon JKo IRothermel GChaudron MCrnkovic IChechik MHarman M(2018)Prioritizing browser environments for web application test executionProceedings of the 40th International Conference on Software Engineering10.1145/3180155.3180244(468-479)Online publication date: 27-May-2018
https://dl.acm.org/doi/10.1145/3180155.3180244
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents