A Dynamic Identification Method of Metamorphic Relation Based on Separation of Input Pattern and Output Pattern
Authors: 
Fan Wang, Xiaohua Yang, Meng Li, Jie Liu, Shiyu Yan, Shengfu FuAuthors Info & Claims
Fan Wang, Xiaohua Yang, Meng Li, Jie Liu, Shiyu Yan, Shengfu FuAuthors Info & ClaimsPages 16 - 24
Abstract
Due to the high cost and extended period of the benchmark development, there are few verification examples for verifying nuclear power independence software. This case is named the test oracle problem. As a result, it is a challenge to adequate verification. Because metamorphic testing is no need to construct verification examples, it is critical to alleviating the above problem. Some domestic independent nuclear design software has successfully applied metamorphic testing in the verification activities. Since Oracle problem has become a common challenge in software verification in nuclear power field, metamorphic testing has broad application prospects. Aiming at great arbitrariness and low efficiency of existing methods, we introduce a dynamic identification method based on the separation of input and output patterns. In this paper, this method is applied to the burnup program (namely NUIT) to determine a set of metamorphic relations between burnup depth and nuclide density. Other burnup programs can directly apply them and learn from this example. And this method can be extended and used in the different professional nuclear fields, such as reactor physics, thermal hydraulics, source term, and radiation shielding.
References
[1]
Meng L, Li-Jun W, Yu-Yan L, Research on Testing Adequacy Criterion of Reactor Physics Code of NESTOR[C]// International Conference on Nuclear Engineering. 2017: V002T03A043.
[2]
Patel K, Hierons R M. A Mapping Study on Testing Non-Testable Systems[J]. Software Quality Journal, 2018, 26(4): 1373–1413.
[3]
Earl, T, Barr, The Oracle Problem in Software Testing: A Survey[J]. IEEE Transactions on Software Engineering, 2015, 41(5):507-525.
[4]
Sun Chang-ai, Liu Yiqiang, Wang Zuoyi, μMT: A Data Mutation Directed Metamorphic Relation Acquisition Methodology[C]//International Workshop on Metamorphic Testing. New York: Association for Computing Machinery, 2016: 12-18.
[5]
Xie, Xiaoyuan, Chen, METRIC: METamorphic Relation Identification based on the Category-choice framework[J]. Journal of Systems & Software, 2016, 116(2): 177-190.
[6]
Wu P.Iterative metamorphic testing[C]∥Proceeding of the 29th Annual International Computer Software and Applications Conference (COMPSAC2005). Edinburgh: IEEE Computer Society, 2005:19-24.
[7]
Dong G W, Nie C H, Xu B W, An effective iterative metamorphic testing algorithm based on program path analysis[C]∥Proceeding of 7th Annual International Conference on Quality Software (QSIC 2007). Portland: IEEE Computer Society, 2007:292-297.
[8]
Hu P, Zhang Z, Chan W K, An Empirical Comparison between Direct and Indirect Test Result Checking Approaches[C]//Proceedings of the Third International Workshop on Software Quality Assurance, SOQUA 2006. New York, New York, USA: ACM Press, 2006: 6–13.
[9]
Olsen M, Raunak M. Increasing Validity of Simulation Models through Metamorphic Testing[J]. IEEE Transactions on Reliability, 2019, 68(1): 91–108.
[10]
Meng L, Lijun W, Wei Y, Metamorphic Testing of the NUIT Code Based on Burnup Time[J]. Annals of Nuclear Energy, 2021, 153: 108027.
[11]
Meng L, Lijun W, Shiyu Y, Metamorphic Relations Identification on Chebyshev Rational Approximation Method in the Nuclide Depletion Calculation Program[C]//2020 IEEE 20th International Conference on Software Quality, Reliability and Security Companion (QRS-C).
[12]
Meng L, Lijun W, Shiyu Y, Metamorphic Relation Generation for Physics Burnup Program Testing[J]. International Journal of Performability Engineering, 2020, 16(2):297.
[13]
Li M, Yan S, Yang X, Metamorphic Testing on Nuclide Inventory Tool[C]// 2020 International Conference on Nuclear Engineering collocated with the ASME 2020 Power Conference. 2020.
[14]
Xiaohua Y, Shiyu Y, Meng L, Verification Method of Metamorphic Test on Neutron Diffusion Program Based on Benchmark Problem[J]. Atomic Energy Science and Technology, 2017, 51(7):1239-1243.
[15]
Shiyu Y, Xiaohua Y, Meng L, Research of Verification Test for Heat Transfer Program Based on Metamorphic Testing[J]. Chinese Journal of Nuclear Science and Engineering, 2017, 37(3): 380-385.
[16]
Xiaohua Y, Shiyu Y, Jie L, Meng L. Hierarchical Classification Model for Metamorphic Relations of Scientific Computing Programs[J]. Computer Science, 2020, v.47(S2):567-571.
[17]
Chen Tsong Yueh, Kuo Fei Ching, Liu Ying, Metamorphic Testing and Testing with Special Values [C]//Acis International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/distributed Computing, 2004. New York: DBLP, 2004:128-134.
[18]
Mayer J, Guderlei R. An Empirical Study on the Selection of Good Metamorphic Relations[C]// 30th Annual International Computer Software and Applications Conference (COMPSAC 2006), 17-21 September 2006, Chicago, Illinois, USA. IEEE, 2006.
[19]
Fan Chao, Yang Xiaohua, Yan Shiyu, Design of a Dynamic Discovery Tool for Likely Metamorphic Relation[J]. Journal of University of South China (Science and Technology), 2018, 32(2): 81-86.
[20]
HUANG S, DING R H, LIH, Research on metamorphic testing of slope and aspect calculating programs[J]. Journal of Computer Applications, 2013,33(6):1657-1745.
[21]
Hui Z, Song H, Ren Z, Metamorphic Testing Integer Overflow Faults of Mission Critical Program: A Case Study[J]. Mathematical Problems in Engineering,2013, (2013-2-25), 2013, 2013(pt.1):61-61.
Recommendations
Feedback-Directed Metamorphic Testing
Over the past decade, metamorphic testing has gained rapidly increasing attention from both academia and industry, particularly thanks to its high efficacy on revealing real-life software faults in a wide variety of application domains. On the basis of a ...
Metamorphic Testing: A Review of Challenges and Opportunities
Metamorphic testing is an approach to both test case generation and test result verification. A central element is a set of metamorphic relations, which are necessary properties of the target function or algorithm in relation to multiple inputs and ...
A New Method for Constructing Metamorphic Relations
QSIC '12: Proceedings of the 2012 12th International Conference on Quality SoftwareA fundamental problem for software testing is the oracle problem, which means that in many practical situations, it is extremely expensive, if not impossible, to verify the test result given any possible program input. Metamorphic testing is an approach ...
Comments
Information & Contributors
Information
Published In
January 2022
159 pages
ISBN:9781450396219
DOI:10.1145/3514105
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 April 2022
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
icWCSN 2022
icWCSN 2022: 2022 9th international Conference on Wireless Communication and Sensor Networks
January 11 - 13, 2022
Dalian, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 60Total Downloads
- Downloads (Last 12 months)12
- Downloads (Last 6 weeks)0
Reflects downloads up to 10 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format