Composite metamorphic relations for integration testing
Pages 98 - 105
Abstract
Metamorphic testing is a testing method for problems without test oracles. Integration testing allows for detecting errors in complex systems that may not be found during the testing of their components. In this paper, we propose a novel approach that applies metamorphic testing in integration testing. The main idea is to develop a composite metamorphic relation for the system represented as an acyclic graph. This relation is a logical function of metamorphic relations for the parts of the system (vertices of the graph). It takes into account the features of the parts. Also, it can simplify the search for failure by identifying the subsystem with error. In this paper’s theoretical part, we describe an algorithm of relation design. Then, we apply our method to a bioinformatics system for comparative genetic analysis of tissues using production tools. This experiment proves our method can be applied to real-life pipelines and find errors in them.
References
[1]
W.K. Chan, T.Y. Chen, Heng Lu, T.H. Tse, and S.S. Yau. 2005. A metamorphic approach to integration testing of context-sensitive middleware-based applications. In Fifth International Conference on Quality Software (QSIC’05). 241–249. https://doi.org/10.1109/QSIC.2005.3
[2]
Tsong Yueh Chen, Fei-Ching Kuo, Huai Liu, Pak-Lok Poon, Dave Towey, T. H. Tse, and Zhi Quan Zhou. 2018. Metamorphic Testing: A Review of Challenges and Opportunities. 51, 1, Article 4 (Jan. 2018), 27 pages. https://doi.org/10.1145/3143561
[3]
F Favero, T Joshi, A M Marquard, N J Birkbak, M Krzystanek, Q Li, Z Szallasi, and A C Eklund. 2015. Sequenza: allele-specific copy number and mutation profiles from tumor sequencing data.Annals of oncology : official journal of the European Society for Medical Oncology 26 (1)(2015), 64–79. https://doi.org/10.1093/annonc/mdu479
[4]
Eleni Giannoulatou, Shin-Ho Park, David T. Humphreys, and Joshua WK Ho. 2014. Verification and validation of bioinformatics software without a gold standard: a case study of BWA and Bowtie. BMC Bioinformatics 15 (12 2014). https://doi.org/10.1186/1471-2105-15-S16-S15
[5]
Sangtae Kim, Konrad Scheffler, Aaron L Halpern, Mitchell A Bekritsky, Eunho Noh, Morten Källberg, Xiaoyu Chen, Yeonbin Kim, Doruk Beyter, Peter Krusche, and Christopher T Saunders. 2018. Strelka2: fast and accurate calling of germline and somatic variants.Nat Methods. 15 (8)(2018). https://doi.org/
[6]
Heng Li. 2013. Aligning sequence reads, clone sequences and assembly contigs with BWA-MEM. arxiv:1303.3997 [q-bio.GN]
[7]
Huai Liu, Xuan Liu, and Tsong Yueh Chen. 2012. A New Method for Constructing Metamorphic Relations. In 2012 12th International Conference on Quality Software. 59–68. https://doi.org/10.1109/QSIC.2012.10
[8]
Alex B Riley, Dohyup Kim, and Allison K Hansen. 2017. Genome Sequence of Candidatus Carsonella ruddii Strain BC, a Nutritional Endosymbiont of Bactericera cockerelli.Genome announcements 5 (17) (April 2017). https://doi.org/10.1128/genomeA.00236-17
[9]
Joshua Y.S. Tang, Andrian Yang, Tsong Yueh Chen, and Joshua W.K. Ho. 2017. Harnessing Multiple Source Test Cases in Metamorphic Testing: A Case Study in Bioinformatics. In 2017 IEEE/ACM 2nd International Workshop on Metamorphic Testing (MET). 10–13. https://doi.org/10.1109/MET.2017.4
[10]
Michael Troup, Andrian Yang, Amir Hossein Kamali, Eleni Giannoulatou, Tsong Yueh Chen, and Joshua W. K. Ho. 2016. A Cloud-Based Framework for Applying Metamorphic Testing to a Bioinformatics Pipeline. In Proceedings of the 1st International Workshop on Metamorphic Testing (Austin, Texas) (MET ’16). Association for Computing Machinery, New York, NY, USA, 33–36. https://doi.org/10.1145/2896971.2896975
[11]
Zhenglong Xiang, Hongrun Wu, and Fei Yu. 2019. A Genetic Algorithm-Based Approach for Composite Metamorphic Relations Construction. Information 10, 12 (2019). https://doi.org/10.3390/info10120392
[12]
Zhi Quan Zhou, ShuJia Zhang, Markus Hagenbuchner, T. H. Tse, Fei-Ching Kuo, and T. Y. Chen. 2012. Automated functional testing of online search services. Software Testing, Verification and Reliability 22, 4(2012), 221–243. https://doi.org/10.1002/stvr.437 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/stvr.437
Index Terms
- Composite metamorphic relations for integration testing
Recommendations
Feedback-Directed Metamorphic Testing
Over the past decade, metamorphic testing has gained rapidly increasing attention from both academia and industry, particularly thanks to its high efficacy on revealing real-life software faults in a wide variety of application domains. On the basis of a ...
Metamorphic Testing: A Review of Challenges and Opportunities
Metamorphic testing is an approach to both test case generation and test result verification. A central element is a set of metamorphic relations, which are necessary properties of the target function or algorithm in relation to multiple inputs and ...
A New Method for Constructing Metamorphic Relations
QSIC '12: Proceedings of the 2012 12th International Conference on Quality SoftwareA fundamental problem for software testing is the oracle problem, which means that in many practical situations, it is extremely expensive, if not impossible, to verify the test result given any possible program input. Metamorphic testing is an approach ...
Comments
Information & Contributors
Information
Published In
May 2022
286 pages
ISBN:9781450396226
DOI:10.1145/3543712
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 20 September 2022
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICCTA 2022
ICCTA 2022: 2022 8th International Conference on Computer Technology Applications
May 12 - 14, 2022
Vienna, Austria
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 37Total Downloads
- Downloads (Last 12 months)5
- Downloads (Last 6 weeks)0
Reflects downloads up to 25 Jan 2025
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format