By Rex Black President RBCS and President of ISTQB [Note: This article originally appeared in Software Test and Performance magazine and Testing Experience magazine. In honor of the groundbreaking release of the RBCS Advanced Test Analyst course, Rex Black has updated the figures and facts in this article as of March, 2008.] If youre a professional tester, test manager, quality assurance staff member, or programmer responsible for testing your own code, you have already discovered that, far from being trivial and straightforward, testing is hard. Theres a lot to know. Unfortunately, most practitioners tend to carry out testing as if it were 1978, not 2008. Common practices lag best practices by around 30 years. ISTQB certification is about raising common practices to the level of best practices. Suppose you are a tester on a project to develop a new system at your company. Somebody e-mails you some screen prototypes with notes that describe the input and output ranges for each field, the actions taken based on particular inputs, and the possible states associated with key objects managed by the system. Would you know how to start designing tests for such a system? ISTQB certified testers do. Suppose you are a programmer on the same project. You are using a newly purchased tool to help generate and execute unit tests on your code. It reports the statement, branch, condition, and multi-condition decision coverage achieved by the tests, and flags constructs that were not tested. Would you know how to create additional tests for the uncovered constructs? ISTQB certified testers do. Suppose you are a test manager on this project. After four weeks of testing, the project manager asks you, Based on testing so far, what are the remaining risks to the quality of the system? Would you know how to do risk-based test status reporting? ISTQB certified testers do. Copyright (c) 2006-2008 Rex Black All Rights Reserved
ISTQB Certification
Page 2 of 9
ISTQB certified testers know how to do these things and more because they have mastered the topics laid out in one or more of the ISTQB syllabi. They feel confident that they have mastered these topics, and can prove to others that they have, because they have passed one or more of the ISTQB recognized examinations, rigorously developed to check each examinees abilities to recall, understand, and apply key testing concepts. In this article, I will explain how the ISTQB certification program works. Youll become familiar with the Foundation and Advanced syllabi, and youll know where to find online copies of each so you can learn more. Ill tell you how you can prepare for the exam, laying out options from self-guided self-study to attending courses. Ill discuss the exams and what to expect when taking them.
What is the ISTQB Program?
In a nutshell, any tester certification program worth your consideration should confirm, through objective, carefully designed examinations, your professional capabilities. Not only does the ISTQB program do so, it is also practical and realworld focused. We address only concepts that you can apply to your work. We support your career path by providing levels of certification that correspond to your experience and roles. Further, we promote and advance software testing as a profession, not merely an ancillary role on a software development team. So far, the ISTQB program might sound like other tester certification programs youve heard of. Here are a couple unique characteristics. First, the ISTQB syllabi are developed by working groups composed of worldwide experts in the field of software testing, including practitioners, consultants, trainers, and academics. Thus, at each level of the program, you are guided by the distilled wisdom of over 100 experts. Second, while the ISTQB accredits certain training courses, there is no requirement to take expensive training or to purchase pricy study guides. You are free to take the exam with as much or as little help as you need.
Who Are These People Anyway?
The ISTQB program, like all software tester certifications, is ultimately a fiat certification. That is, the people who create, administer, and run the certification stand behind it, and the quality of the certificationor lack thereofarises from the knowledge, reputation, and abilities of the people involved. So, youll want to know the ISTQB. The International Software Testing Qualification Board (ISTQB) is a fast-growing, highly dynamic, and extremely democratic organization. We are a united assembly of member boards, with each board representing major software and Copyright (c) 2006-2008 Rex Black All Rights Reserved
ISTQB Certification
Page 3 of 9
system developing countries and regions. As of March 2008, we have 38 member
boards. We intend to admit or two or three new boards in our July 2008 meeting, with over 40 boards by the end of 2008. We are a collegial group, focused on cooperating and sharing what works between the member boards. I am the ISTQB President, Erik van Veenendaal is Vice President, Chris Carter is Secretary, and Horst Pohlmann is Treasurer. The ISTQB gets its work done through working groups. We have working groups that develop, maintain, and update the various syllabi and the glossary, as well as defining processes, marketing collateral, and governance matters. Each member board can participate in the working groups. Across the various member boards, we have over 2,000 person-years of testing experience. The American Software Testing Qualification Board (ASTQB) is the member board for the United States. Like all member boards, we are composed of recognized experts in the field, and include a mix of practitioners, consultants, trainers, and academics. The current officers are Patricia McQuaid, President; Joe Gance, Vice President; and, Randy Rice, Treasurer. I serve as ISTQB Representative. Wayne Middleton, Taz Daughtrey, Jerry Everett, and Andrew Pollner are Directors. Debra Friedenberg is Technical Advisory Group Chair. She and her half-dozen or so technical advisory group members handle the essential member board functions of creating exam questions and exams and accrediting training courses. Finally, Lois Kostroski is the Managing Director, who arranges for administration of the exams, the Website, and other such details.
What is the Value of ISTQB Certification?
Volunteers run the ISTQB program. Of course, many of us benefit from our involvement, whether in terms of professional prestige, advancement at work, or business opportunities. However, we participate because we believe in this program and the value it delivers. For the test professional, programmer, manager, and other examinees, holding an ISTQB certificate demonstrates mastery of the best practices and key concepts in the field. This can help advance your career. In addition, by distinguishing yourself from the mass of lesser-qualified test practitioners, holding one or more ISTQB certificates can create opportunities in a competitive, outsourced, and increasingly commoditized job market. So far, test professionals around the world have earned over 80,000 Foundation and Advanced certificates. Most people who go through ISTQB training and take ISTQB exams are doing so at the behest and at the expense of their employers. Hundreds of smart, wellmanaged organizations around the world have learned to value the ISTQB certifications because employing ISTQB certified testers ensures better testing, Copyright (c) 2006-2008 Rex Black All Rights Reserved
ISTQB Certification
Page 4 of 9
resulting in better software, reduced risk, and lower costs of poor quality, and delivers test consistency and re-usability. Finally, the ISTQB delivers value to the software testing profession itself. As I mentioned earlier, common practices lag best practices by about 30 years. If programming were stuck in the same rut, 90% of the code would still be written in COBOL, and only 10% of the code would be written in Java. How has software programming progressed while software testing remains stuck in the 70s? Is it that software testers love disco music and sideburns, or has something else happenedor not happened? Programming, as a profession, has built on its best work. Assembly languages gave way to higher-order languages. Higher-order languages enable structured programming. Structured programming fostered object-oriented programming. Yet, in software testing, we still have practitioners who are unaware of the concepts of equivalence partitioning, boundary value analysis, and error guessing. Worse yet, some people in our field are reinventing and renaming these concepts, leading to inefficiency and confusion. We at the ISTQB say that we software testers should start building on our best work and stop going in circles. We have learned a lot since Glenford Myers, Richard Bender, Bill Hetzel, and Boris Beizer established software testing as a field. Lets use their concepts and the concepts that have grown from them to define the profession and what professional testers need to know. I invite you to join us as we lead the way towards a truly professional field of software testing, built on a solid foundation.
What Are the Levels of Certification?
The ISTQB certification program is comprised of three levels of certification: Foundation, Advanced, and Expert. At each level, the ISTQB asserts that people claiming to be test professionals should have a particular amount of practical, hands-on experience as well as knowing and being able to apply particular key ideas. The experience required and concepts to be mastered for each level are defined in the syllabus (plural, syllabi) for that level. Another way to think of the syllabi is as bodies of knowledge or standards for professionalism defined at major stages of a testers career. The Foundation Certification is the entry-level certification, designed for people entering the field and for experienced practitioners wishing to start moving up the ladder of ISTQB certifications. The goals of the Foundation Certification are to ensure a broad understanding of the fundamental best practices and key concepts in software testing, and to provide a foundation for professional growth. The syllabus covers six main topics: fundamentals of testing; testing in the software lifecycle; static techniques like reviews; behavioral (black-box) and Copyright (c) 2006-2008 Rex Black All Rights Reserved
ISTQB Certification
Page 5 of 9
structural (white-box) test design; test management; and, testing tools. Syllabusbased Foundation training courses are typically three to five days. The Advanced Certification is the mid-level certification, designed for those with at least five years experience as testers. The goals of the Advanced Certification are to ensure an understanding of advanced best practices and key concepts in software testing amongst committed test professionals, and to support on-going professional growth. The syllabus is divided into three main areas:
Advanced Test Analyst: Advanced behavioral and experienced-based
testing, risk-based testing, and testing standards for business-oriented testers;
Advanced Technical Test Analyst: Advanced test automation, structural
testing, and non-functional testing for technically-oriented testers and programmers; and,
Advanced Test Manager: Sophisticated test management concepts for
managers, including risk-based test, testing processes, improving test process, and test team development.
For each of the three areas, a syllabus-based training course will be five days. The Expert Certification, which will begin to be deployed in 2008, is for leaders of the field of software testing, those with eight or more years of experience. The goals of the Expert Certification are to ensure consistent understanding and execution of proven cutting-edge techniques by seasoned test professionals, and to lead the software testing profession. Since experts tend to specialize, we will offer various expert syllabi addressing topics like test process improvement, test automation, test management, and industry-specific test techniques. Syllabusbased training courses will again be offered. RBCS, will offer an expert course on improving the test process in 2008.
What Are the Exams Like?
The ISTQB Foundation and Advanced exams contain from 30 to 65 questions. Youll have 60 minutes to complete the exam if you are taking the Foundation exam. You currently have 90 minutes to complete the exam if you are taking an Advanced exam, but that will go up to 120 minutes as the transition to the new Advanced syllabus completes. There is only one Foundation exam. There are three Advanced exams:
Advanced Test Analyst: Targeted mostly at testers doing business-oriented,
behavioral (black-box) testing, especially those in independent test teams;
Advanced Test Manager: Targeted mostly at test managers, development
managers, and project managers responsible for testing;
Copyright (c) 2006-2008 Rex Black All Rights Reserved
ISTQB Certification
Page 6 of 9
Advanced Technical Test Analyst: Targeted mostly at testers involved in
automation, and at testers and programmers who are doing structural (white box) testing.
Each exam is created according to ISTQB guidelines by drawing from a pool of
150 or more carefully crafted questions. Thus, if you retake an exam, you will see different questions. The exam questions are multiple-choice. However, they are not the easy multiple-choice questions you might remember from high school. These questions are specifically designedwith the help of psychometricians, professional exam creatorsto measure the extent to which the examinee has mastered the key concepts in the syllabi. The key concepts in each syllabus are defined in terms of learning objectives. Each learning objective has an associated level of mastery associated with it: 1) precise recollection; 2) detailed understanding; 3) the ability to thoroughly apply the concept to a real-world problem; or, 4) the ability to analyze a scenario and pick appropriate ways to handle it. On the next page, youll find an example exam question, drawn from my companys Foundation training materials. The Foundation syllabus says that all testers should be able to write test cases using equivalence partitioning and boundary value analysis. Specifically, there is a level-three learning objective associated with being able to do so. The sidebar shows a sample exam question designed to verify a testers mastery of this concept. Study the sample question. What do you think the right answer is? Can you explain why? See the end of this article to check your work.
How Do I Prepare for the Exams?
You have four main options to prepare for the exam: self-guided self-study, use of books, e-learning courses, and instructor-lead courses. Ill present these options in that order, though you should not assume that any one option is necessarily better or worse. You have your own needs in terms of studying and preparation, and your own most effective learning style. Self-guided self-study would occur when you download the syllabus and glossary from the Internet (see below) and then use those documents to guide your preparation. The use of the syllabus and glossary is essential no matter what mode of preparation you choose, but, for very experienced testers who have carried out testing efforts following standards like IEEE 829 and have read two or three of the books on testing referenced in the syllabus, this alone might be sufficient.
Copyright (c) 2006-2008 Rex Black All Rights Reserved
ISTQB Certification
Page 7 of 9
As I mentioned, there are books and standards which are referenced by the syllabus. You could pick up a few of these books, along with copies of the standards, and study them, again using the syllabus and glossary as resources and guides. Alternatively, you could buy just one book that is entirely focused on the syllabus you are interested in. Along with Erik van Veenendaal, Dorothy Graham, and Isabel Evans, I wrote such a book on the Foundation syllabus, Foundations of Software Testing. I am working on three books for the new Advanced syllabus now, to be released starting in mid-2008.
Sample Exam Question
A field accepts an integer input from 1 to 99 representing the quantity of an item to be purchased. Consider the following numbers: I.
II.
III.
IV.
52
V.
99
VI.
100
VII.
129
Which of the following statements are true?
A. II, IV, and VII are boundary values, while are I, III, V, and VI members of the invalidtoo low, valid, and invalidtoo high equivalence partitions B. I, III, V, and VI are boundary values, while II, IV, and VII are members of the invalidtoo low, valid, and invalidtoo high equivalence partitions C. All seven values are boundary values and members of one of the three equivalence partitions D. Only I, III, V, and VI are members of one of the three equivalence partitions Select the one right choice above.
If you find that you have trouble teaching yourself concepts from books and documents, and need more structure to make things stick, then perhaps an elearning course is for you. For example, Villanova University offers an Copyright (c) 2006-2008 Rex Black All Rights Reserved
ISTQB Certification
Page 8 of 9
accredited e-learning course for the Foundation exam. RBCS offers e-learning courses for Foundation, Advanced Test Analyst, and Advanced Test Manager exams. If you dont have time to attend an instructor-lead course but need the structure of a class, this approach might work. Finally, if you need the structure of a live course, like interacting with fellow professionals, want networking opportunities, and appreciate the convenience of a single, three to five day session followed by the exam, then perhaps an instructor-lead course is for you. Such courses are available in more than 40 countries, including all the countries covered by the ISTQB member boards plus some additional countries. In North America, major ISTQB training providers include my own company, RBCS, along with SQE, Method Park, and ALPI. No matter what mode of preparation you choose, make sure you do prepare and prepare thoroughly. As I often say to attendees of my training courses, not everyone who doesnt study will fail the exam, but almost everyone who fails the exam didnt study.
Conclusion So, you should now have a good idea of how the ISTQB certification program works, including the structure and goals of the board. You know the Foundation and Advanced syllabi, and where they fit into your particular career path. Youre ready to pick which ISTQB certifications are right for you and start down the path of study and preparation. In short, you are ready to join the thousands of people around the world who are bringing the best ideas and concepts of testing to their day-to-day work, establishing software testing as a profession. I hope you take the next step and become an ISTQB certified tester, as I am proud to be.
Where Do I Go for More Information?
www.rbcs-us.com www.astqb.org www.istqb.org
Author Biography With a quarter-century of software and systems engineering experience, Rex Black is President of RBCS (www.rbcs-us.com), a leader in software, hardware, and systems testing. For over a dozen years, RBCS has delivered services in consulting, outsourcing and training for software and hardware testing. Employing the industrys most experienced and recognized consultants, RBCS Copyright (c) 2006-2008 Rex Black All Rights Reserved
ISTQB Certification
Page 9 of 9
conducts product testing, builds and improves testing groups and hires testing staff for hundreds of clients worldwide. Ranging from Fortune 20 companies to start-ups, RBCS clients save time and money through improved product development, decreased tech support calls, improved corporate reputation and more. As the leader of RBCS, Rex is the most prolific author practicing in the field of software testing today. His popular first book, Managing the Testing Process, has sold over 30,000 copies around the world, including Japanese, Chinese, and Indian releases. His three other books on testing, Critical Testing Processes, Foundations of Software Testing, and Pragmatic Software Testing, have also sold tens of thousands of copies, including Hebrew, Indian, Chinese, Japanese and Russian editions. He has written over twenty-five articles, presented hundreds of papers, workshops, and seminars, and given about thirty keynote speeches at conferences and events around the world. Rex is the President of both the International Software Testing Qualifications Board and the American Software Testing Qualifications Board.
Answer to the Sample Exam Question
The correct answer is B. The rule defining valid and invalid inputs creates three equivalence partitions: invalidtoo low; valid; and, invalidtoo high. Any integer zero or less is a member of the invalidtoo low partition. Any integer from 1 to 99 is a member of the valid partition. Any integer 100 or greater is a member of the invalidtoo high partition. 0 is the largest member of the invalidtoo low partition and lies on the boundary with the valid partition. 1 and 99 are the smallest and largest members, respectively, of the valid partition, lying on the boundaries with the invalidtoo low partition and the invalidtoo high partition, respectively. 100 is the smallest member of the invalidtoo high partition and lies on the boundary with the valid partition.
Copyright (c) 2006-2008 Rex Black All Rights Reserved
