2016 5th International Conference on Computer Science and Network Technology (ICCSNT)

Design and Implementation of Bank Financial

Business Automation Testing Framework Based on
QTP

Xianjie Xie1, Zhijun Yang2, 3, Jiankun Yu1,*, Weifeng Zhang3

1
School of Information
Yunnan University of Finance and Economics
Kunming, 650221, China
2
The Academy for Educational Science Research
Educational Department of Yunnan Province
Kunming, 650223, China
3
School of Information
Yunnan University
Kunming, 650091, China

Abstract—The current software testing in the aspects of of software, which is vital to the market competitiveness of
industrial benefits gradually causes the attention of the domestic banks. Software testing is a reliable means to guarantee the
financial bank. The innovation of software technology, the quality of bank software. Using software testing methods to
increase of software scale and the shortened developing period automate the testing of bank software, not only can improve the
make the traditional manual testing meeting enormous quality of the software, find out the flaws in the software, but
challenges, while the development of automated testing also can reduce the cost of the late, thus effectively saving
technology has promoted the progress of the software testing manpower resources cost and improving work efficiency. The
industry. Because of the particularity of financial and banking traditional test solution is to use the third party automated
services, the bank is under an obligation to ensure the quality and
testing tools. According to today's banking business
reliability of software. Therefore it’s vital to test the software. In
specific practice, although the powerful third-party testing tools
requirements, a separate test tool can’t reach the desired
can be used as a solution, it is hard to rely on certain tool to objectives, therefore it’s very necessary to set up a complete
implement automated testing, hence a framework of automated and applicable framework for automated testing.
test is required to be introduced for testing, which intends to The paper [2] proposed a regression test automation
handle high efficiency and high-quality testing for software framework that turns on the development of automated test
automation. This paper proposes a kind of software automation scripts test development process. By defining tables, data, and
testing framework based on QTP, mainly targeting on the core of
control spreadsheets which can be easily maintained, it offers a
the bank, credit, online banking to test the function of the three
full range of features interface to complete the test. In
major operations. The framework is a secondary development
based on QTP and mainly for regression testing of software,
regression testing, the test need only modify the spreadsheet
which integrates techniques including object recognition, data- definitions. The paper [3] establishes a framework for web
driven, and keyword-driven technology, checkpoint technology, application testing. The framework is built on an excel file
to proceed business-level testing. The paper expatiated on four which contains keywords imported into the frame by using
issues, which were the test system design, the test standardization, keyword driven framework Selenium web-driver API. The
the testing framework design and the testing of the paper [4] proposed an automatic test execution and
implementation. The practical application shows that the optimization of hybrid drive architecture, HTLP (hybrid test
framework can improve the operational efficiency, reduce the Language Processing) data-oriented keywords. The HTLP is
test cost, and guarantee the smooth progress of the software applied to open source software based on the application of
automation testing. good vtiger CRM5.
Keywords—software testing; test automation framework; QTP This paper is divided into three parts: The first part is the
automated testing tool introduction of testing tools QTP, mainly explaining its
working process and key technology. The second part
discusses the automated testing framework of bank financial
I. INTRODUCTION
services based on QTP, from two aspects including the build
The continuous development of banking and financial and design of testing system. The third part explores the
services put forward higher requirements to the bank software implementation process of automated testing framework,
of financial management, especially the quality and efficiency which consists of three parts: feasibility analysis,
implementation steps and results comparison.
* Corresponding author email address: yjk1102@163.com

978-1-5090-2129-1/16/$31.00 ©2016 IEEE 143 Changchun, China

 II. TESTING TOOLS QTP 1) Object recognition technology: QTP is usually by
QTP (Quick Test Professional) is an automated testing tool adding objects to the object library to identify objects at run
developed by HP company, which is the most popular time. There are four types of object recognition patterns in
automated testing tool on the market. It has a great reliability, object identification: mandatory attribute recognition, auxiliary
stability and scalability. Through Java, Web, ActiveX, .NET attribute recognition, sequential attribute recognition and
and other plug-ins, QTP offers an automated test environment intelligent recognition. In general, most of the tested objects
for all major application software, to facilitate functional can be identified by force mandatory attribute recognition.
testing and regression testing being performed on the software. When mandatory attribute recognition is not able to recognize
QTP supports the functions of record and playback, by which the object, it’s necessary to define the object by the aid of
engineers can record and capture the operating process of the attribute recognition and sequential recognition. Intelligent
software, automatic generation of functional tests or regression recognition is used in the case when the object property of the
test cases. Finally professional test engineers can write object database is not consistent with the property of the object
VBScript by Expert view to gain full control of the testing and being tested.
object properties. 2) Checkpoint technology: Checkpoint technology is used
to check whether the value of the measured object in the
A. QTP Automated Testing Processes process of the script is consistent with the former design, to
The processes of QTP automation testing include planning, check the run states in the test report. Checkpoints in the QTP
requirements analysis, test script development, debugging test are divided into two kinds including the built-in checkpoint and
scripts, a performance test script, result analysis, maintenance custom checkpoint. Built-in checkpoints can be added by
of seven stages. recording or manual approach. Custom checkpoint, with
greater flexibility, is used to judge whether checkpoints
1) Plan: Before the test, it’s required to determine whether attributes as expected by conditional statements.
the software is conforming to the requirements of QTP, taking
various factors into consideration, such as the function of the 3) Automation object model technology: Object interface
test software, operation steps, ease of use and cost, etc. provided by QTP allows the access and control of other
programs. QTP, configuration and activation of test cases can
2) Requirements analysis: It’s mainly to analyze the be activated by writing the script. The object model library of
correctness, consistency and feasibility of the test software QTP provides various kinds of object interfaces, by calling the
requirement. objects, methods and properties of the interface. QTP Test
3) Test script development: Record script by running the script can be written with a variety of programming languages
software with QTP, add checkpoints to the test script, then and under development environments, such as VBScript,
check the object properties, verify whether the function of the Visual Basic, Visual C ++, visual studio.NET, JavaScript, etc.
software is correct or wrong. Replace the fixed value of the 4) Synchronization point technology: In the process of
recording script with the parameters, with more complex tests automated testing, there may be a good example where the
being performed, then generate test cases. current statement is not executed, and the latter statement is
4) Debugging test scripts: The completion of test script executed. Add synchronization points to the script, if you
should be debugged, to ensure that the test case goes through encounter synchronization point during the execution of the
all the wrong ways. script, the script will be suspended. Then the object waiting to
be measured acquires a preset value of attribute before starting
5) Perform test script: Run the test script in this stage, the next statement, if the measured object in the preset time
whose main function is to test the software. During this process, interval don’t get a preset value, it will report an error message.
the tester can also debug the script until it meets the former
design. 5) Plug-in extension technology: QTP supports different
application types. For different application types, it loads
6) Result analysis: View the generated test results after different plug-ins for test, with unique license for each plug-in.
each test script execution, to determine the defects existing in The built-in plug-ins has three types including Web, ActiveX,
the software. and Visual Basic, while peripheral plug-ins includes
7) Maintenance: Update script to solve a variety of defects Delphi, .Net, Java, etc.
found in the implementation of test scripts, a good test
framework and test set can ensure the minimum cost of III. INTRODUCTION OF BANK SOFTWARE AUTOMATION TESTING
maintenance. FRAMEWORK BASED ON QTP
Along with the continuous development of software
B. QTP Key Technologies automation testing technology and the unceasing expansion of
In the process of QTP automated testing, the key user needs, automated testing has become ever more noticeable.
technologies are mainly identifying objects with image QTP automated testing technology has become the mainstream
recognition technique, checking the state of the property with of software automation testing tools, because of its powerful
checking point technique, as well as the automation object object library, supporting a variety of different programming
model technology, synchronization point technology and plug- platforms and plug-ins and so on. But it's not enough to only
in extension technology. rely on the simple recording and playback functions to operate

144
the software automatically test. Limited testing data and the mainly including two parts, i.e., test standardization and
enormous workload, will not meet customers’ needs. framework test design.
Introducing automated testing framework for banking financial
business test can effectively improve test efficiency and reduce 1) Test standardization: Test standardization is to make
maintenance costs. the QTP automated test standard in order to reduce
unnecessary trouble.
A. Testing System Design a) Standardization of testing tools: Which mainly
Compared with the manual test, the automated testing has indicates the standardization of the use of testing tools, such as
significant advantages, such as high test speed and high management mode of object library, associated drive script
efficiency. Of course, there are also risks in automated testing, and batch processing, testing tool settings, storage analysis of
therefore it’s necessary to set up a test system before designing test results, data source management and maintenance, scene
the framework and conduct the evaluation and consideration of error recovery and resource, environment definition, etc.
appropriate conditions to prevent automated test lead halfway. b) Standardization of configuration management:
The test system mainly includes organizational structure, Which is mainly being used to work together with code
technology and methods, support tools, asset management, management, deployment of test version and management of
asset management, team building and so on. testing assets.
1) Organizational structure: In the bank, it needs to have 2) Test Standardization: The design of the automated
specialized departments being responsible for testing related testing framework involves three systems including the core
issues. In the meantime, the roles or responsibilities are needed business of the bank, credit and online banking. The test
to be defined, such as testing center, the quality and safety objective is to define the interface, interaction, data validity and
commissioner, the test person in charge of the assigned by the storage of the system under the premise of each function of
technical department. three different systems in normal. Test cases and data will
2) Technology and methods: Various technical methods cover all kinds of normal and abnormal conditions, including
may be used in the process of automated testing. From category different card states verification, verification of discrete
point of view, it mainly includes text analysis technology, contract IOU, cost information verification, to assure the
automated test technology, performance testing technology, successful application of the framework. Then it puts forward a
security testing, etc. From the test process point of view, it kind of automation testing framework based on QTP, which
includes the test plan method and its template, the test case mainly includes five parts: test driver layer, data layer,
design method and its template, the test result analysis method abstraction layer, test case layer and object layer, operate layer.
and the test report template and so on. The overall design is as shown in Figure 1.

3) Support tools: Choose appropriate tools to support

business test management, test implementation and software
quality analysis, which can be got by self-researching or be
purchased. According to the classification point, the tools
related to testing generally are as follows: test design and
execution management tool, defect management tools,
automated testing tools, performance testing tools, safety
testing tools, unit testing tools, integration testing tools,
configuration management tools.
4) Asset management: Effectively manage all stages of
documentation, testing data, code, scripts, tools, etc.. The assets
of the document category include test requirements, test plans,
test case documentation, documentation of test data, defect
analysis reports, test reports of various types of templates and
the actual submission at least.
Fig. 1. Design of automated testing framework based on QTP
5) Team building: It means to cultivate and build the test
team according to the enterprise's own construction ideas on a) Test driver layer: As a core part of the framework,
test, thus being equipped with the ability to carry out the test module of driver starts QTP by loading the configuration file,
functions. calls test data and cases, then extracts the library data of
corresponding function and loads the object library and
B. Design of Bank Business Automation Testing Framework function library to complete the automated test. Driver module
Based on QTP contains TestSet and TestCase driver, in which data driven or
Automated testing framework is a collection of all the keyword driven mode can be used.
processes in the automated testing process. A good testing
framework is conducive to the test, as well as the cost of the x When the test target flows constantly, only the data
reduction, post maintenance convenience. Therefore we put changes, then a data-driven test is being used. The data
forward a kind of automation testing framework based on QTP, are input and output from a separate data file, and the

145
 script describes a specific process executed in the test 1) Benefit-cost analysis: For the meaning of introducing
script. Such a script is used as a drive, with test data and automated testing framework, we made the analysis from the
test scripts (steps) for separation. With a script for cost-benefit formula. Assuming that there are m tests,
different data for testing, it relies on the script variables development costs in the beginning is D i (i 1,2,..., m) ,
for data transfer. Such framework can be used to reduce
maintenance cost is E , manual testing each test run number is
the number of scripts, thus improving the script reuse
rate, and avoiding duplication of scripts. n , a single script the cost of implementation of the manual is
Oi (i 1,2,..., m) , the return numbers is a , then the benefit-cost
x Keyword-driven testing is based on data-driven, as well is as shown in Formula (1).
as the use of keywords corresponding to all the basic
m
operations, each with a corresponding function
implementation. In the case to build a good testing
¦D i E
(1)
Benefit  cos t i 1
framework, the main task is to design key data tables, m

without the need to pay attention to the development of ¦ (n u a u O )

i 1
i

basic functions. Keyword-driven test cases can not only

effectively achieve the separation of data, business, We can see that the lower benefit cost, the greater income
script, but also achieve a separation of interface element of automated testing.
names and the test object, which simplifies the 2) Tested software environment analysis: This test is
development of the script and speeds up the primarily targeted on the business of financial banks, which is
development. involved the core, credit and online banking three systems. The
b) Data layer: All the test data are stored in the access test objective is to determine the function of the three systems,
file, with script having direct access to get them, which can and verify the interface, interaction, data validity and storage in
facilitate the realization of the data sharing between the scripts. the system. Test cases and data will cover all types of normal
and abnormal conditions, including different card states
c) Abstraction layer: This layer is used to store the verification, contract verification, cost information verification,
function library and script library. It stores project’s general etc. to assure the successful operation of the system.
function method, and some common functions of the project
on this layer. For example, logging reception function can be B. Automated Testing Framework Implementation Steps
made into a public function, which will be used in almost all
transactions, as well as report processing, exception handling, Design automation test framework is not the ultimate goal,
log records function. but to complete the test more efficiently. So in order to make
the automation framework better execute, there must be a
d) Test case layer and object layer: This layer is used to complete implementation process as a guarantee. The main
store test cases and objects, create different test scripts steps of the implementation are test plans, requirements
according to different test cases. Automated testing is usually analysis, test design, test execution, test reports several aspects,
based on test points of test cases. The object library stores all as shown in TableΣ.
the tested program objects that can be identified by QTP. In
the process of development, all developers continue to update
the object library, forming a total project object library. TABLE I. BASED BANKING AND FINANCIAL MANAGEMENT SOFTWARE
QTP AUTOMATED TESTING FRAMEWORK IMPLEMENTATION STEPS
Different scripts developed by developers can execute on
machines that share the project object library. Main Park Work Description Main Effect
e) Operate layer: This layer is divided into two parts: Match with the development
plan as the basis for the
part of the staff collect test objects, write code and do project manager to manage
debugging, and another part of the staff manage the script, Incorporate automated
the project schedule. In
define test sets, run the test set, view the results, report defects, Test Plan assessment and planning
addition to the guidance of
into the overall plan
etc. the test work, but also can be
bound to the development of
the submitted plans
IV. IMPLEMENT AUTOMATED TESTING FRAMEWORK FOR Synchronous analysis
Find the lack of demand,
BANKING FINANCIAL SERVICES BASED ON QTP Demand automation feasibility
errors, inconsistencies and
analysis and related test points
other issues
A. Feasibility Analysis of Automated Testing Framework priority
1. Follow the requirements
Generally speaking, automated testing framework is built Case development and
Test design and test cases
Implementation
on the specific implementation of the system characteristics, 2. Detailed design test
with the lowest cost being exchanged for higher benefits as a Automated execution
To prepare for the test
start point. Bank financial business process operation is execution
1. Implement test cases, find
relatively stable. When the developer adjusts the code to Test Perform automation and defects and improve the
submit a version, he can trigger the operation of regression execution maintenance according quality of software products.
tests by calling the prepared test data and test cases, and then to the actual needs and 2. Promote development
complete regression testing process without manual importance according to the planning
intervention. phase

146
 Main Park Work Description Main Effect test, its test time is reduced, with work efficiency improved
Evaluate the quality of a effectively. At the same time, it can detect whether there is any
Automation Report flaw in the bank's three major businesses and generate test
certain version.
Test report Tip each time point or the reports based on it, to help developers find defects and protect
Automation ROI reports overall situation each time, the development of commercial banks.
project and system quality

C. Analysis of Results ACKNOWLEDGMENT

From July to September in 2015, financial software of This work was supported by the National Natural Science
certain bank, Web module and so on were developed with QTP Foundation of China under Grant Nos. 61461054.
test script by the test team, in which a total of 315 test cases
were completed, with 185 object libraries. For comparison, we
REFERENCES
took 100 test cases from them for testing, conducted five tests,
regarded the average test time of 5 times as the test time. The [1] Lalwani T, Kanoujia S N, Howarth T, et al. QuickTest Professional
Unplugged[M]. KnowlegeInbox, 2011.
results of such tests are as shown in TableΤ.
[2] Liu Z, Chen Q, Jiang X. A Maintainability Spreadsheet-Driven
Regression Test Automation Framework[C]//Computational Science and
TABLE II. COMPARATIVE RESULTS OF THE IMPLEMENTATION OF QTP Engineering (CSE), 2013 IEEE 16th International Conference on. IEEE,
AUTOMATED TESTING FRAMEWORK 2013: 1181-1184.
[3] Aiya K V, Verma H. Keyword driven automated testing framework for
Test case Test takes web application[C]//2014 9th International Conference on Industrial and
Test mode Pass rate
number time(minutes) Information Systems (ICIIS). IEEE, 2014: 1-6.
Based on the [4] Mann M, Sangwan O P, Tomar P. Hybrid test language processing
implementation of based framework for test case optimization[J]. CSI Transactions on ICT,
100 28 92%
QTP automated 1-11.
testing framework
Common [5] Chen NengJi,Software Testing Guide:Fundamentals,Tools and
implementation of Practice(Second Edition)[J]. 2008.
100 33 81% [6] Grechanik M, Xie Q, Fu C. Maintaining and evolving GUI-directed test
automated testing
framework scripts[C]//2009 IEEE 31st International Conference on Software
Engineering. IEEE, 2009: 408-418.
Manual testing 100 140~160 86%
[7] Kaur M, Kumari R. Comparative study of automated testing tools:
Testcomplete and quicktest pro[J]. International Journal of Computer
It took 28 minutes to test 100 use cases by QTP-based Applications, 2011, 24(1): 1-7.
automation framework, which passed the 95 test cases, with 5 [8] Graham D, Fewster M. Experiences of test automation: case studies of
defects being found. It took 33 minutes to test conventional software test automation[M]. Addison-Wesley Professional, 2012.
automation framework, which passed the 81 test cases. For [9] Zhou R Z, Wei Z K, Tang S G, et al. Study on application of .NET
manual testing, according to common experience, each test reflection in automated testing[C]//12th International Conference on
case probably took 1-2 minutes, it took 140 to 160 minutes to Advanced Communication Technology (ICACT). 2010: 797-800.
finish testing all the test cases. Through the 86 test cases, it can [10] Patwa P. Hybrid test automation frameworks implementation using
be seen that QTP-based automation test framework compared QTP[J]. Technical Article.
to routine testing framework and the manual test has a faster [11] Jain A, Jain M, Dhankar S. A Comparison of RANOREX and QTP
test speed, with highest pass rate of test cases among them, Automated Testing Tools and their impact on Software Testing[J].
IJEMS, 2014, 1(1): 8-12.
which greatly improves the work efficiency.
[12] Bhargava A. Designing and Implementing Test Automation Frameworks
with QTP[M]. Packt Publishing Ltd, 2013.
V. CONCLUSIONS [13] Kaur H, Gupta G. Comparative Study of Automated Testing Tools:
Selenium, Quick Test Professional and Testcomplete[J]. Harpreet kaur et
Domestic automation testing is gradually developing. As al Int. Journal of Engineering Research and Applications ISSN, 2013:
the most important financial industry, banks have strict 2248-9622.
requirements on their own business. And the emergence of [14] Wang F, Du W. A test automation framework based on
automated testing just satisfies their requirements. In order to web[C]//Computer and Information Science (ICIS), 2012 IEEE/ACIS
guarantee the smooth progress of the automation test, the 11th International Conference on. IEEE, 2012: 683-687.
automation testing framework is put forward. A suitable [15] Jain A, Jain M, Dhankar S. A Comparison of RANOREX and QTP
framework for automated testing can ensure the smooth Automated Testing Tools and their impact on Software Testing[J].
IJEMS, 2014, 1(1): 8-12.
progress of the test work, avoid the risk of automated testing
and make the testing process quite clear and obvious. Therefore, [16] Xie Q, Grechanik M, Fu C. Rest: A tool for reducing effort in script-
based testing[C]//Software Maintenance, 2008. ICSM 2008. IEEE
this paper puts forward a software automation testing International Conference on. IEEE, 2008: 468-469.
framework for bank financial management based on QTP, and [17] Nagowah L, Roopnah P. AsT-A simple automated system testing
makes automated test in three aspects including the core tool[C]//Computer Science and Information Technology (ICCSIT), 2010
business, credit and online banking. Compared with the manual 3rd IEEE International Conference on. IEEE, 2010, 9: 301-306.

147