Experiment 6: Test Design Tools
Experiment 6: Test Design Tools
Experiment 6: Test Design Tools
Test coverage matrix is one of the out put of BenderRBT. Besides knowing how many test cases have to be built, the Coverage Matrix can be used to prioritize some of the testing. Some functions act as funnelling points for many other functions. If they are not working, you cannot get to the other functions to test them. Edit functions and database maintenance functions have this characteristic. These potential problem areas can be identified by looking for variations which show up in many tests. Give these high priority in testing. Another use is in subsetting the test library to only run tests associated with selected functions. The desired functions are identified by their variations. The tests which include those variations are extracted from the library and executed. This allows maintenance changes to be selectively tested without rerunning the entire test library. If time or resources will not allow the building of all the necessary tests, the test cases relating to those functions with the highest business risk can be built and run first, with the supplemental tests run at a later date.
Build and execute "executable" test cases DTT (Direct to Test) version of BenderRBT Test Case Design Tool is a framework tool that generates executable test scripts from the RBT output. It can generate those scripts to run on any of the major playback tools. Otherwise, QA can export the test descriptions to most of the major playback tools in the form of comments in shell scripts. This helps create self- documenting tests saving scripting time. Verify the test results C-E Graph itself is a test oracle, it provides the expected output to help verify test results. Verify the test coverage against the completion criteria BenderRBT has a feature called coverage analyzer which quantifies two types of coverage criteria; weak coverage criteria and strong coverage criteria. Defect reporting and Tracking the Testing effort Definition Matrix (another output of BenderRBT) helps tracking the testing effort. Good tracking requires quantified status. The number of tests built, run successfully, run but failed and tests yet to run are such numbers. These numbers can be refined by including the number of variations run successfully, number failing and variations not yet attempted. In fact, variations are superior to tests as the unit for measuring test status. The number of variations correlates directly to the number of functions and their functional complexity. The number of tests, however, reflects packaging decisions of how much function to test in a given test case. Two different testers could make very different test packaging decisions for the same set of functions. Defect fixing/ debugging Test definition matrix and test coverage matrix can be used in debugging. For example, you are running your test library and a number of tests fail. The problem might be isolated by seeing which functional variations they have in common. Automatic Regression Test selection BenderRBT tool makes regression test selection criteria more objective, automatic modification identifications and test suit maintenance.
SilkTest Classic uses the domain specific 4Test language for automation scripting. It is an object oriented language similar to C++. It uses the concepts of classes, objects, and inheritance.
Silk4J allows automation in Eclipse using Java as scripting language Silk4Net allows the same in Visual Studio using VB or C# SilkTest Workbench allows automation testing on a visual level (similar to former TestPartner) as well as using VB.Net as scripting language
Main features of SilkTest SilkTest Host: contains all the source script files. SilkTest Agent: translates the script commands into GUI commands (User actions). These commands can be executed on the same machine as the host or on a remote machine.
Features
Support for Windows and .NET compilers. Support for profiling 32- and 64-bit applications. Profiling Java and Silverlight Applications. Profiling scripts. Integration into Microsoft Visual Studio and Embarcadero RAD Studio IDEs.