QA Complete User's Guide
QA Complete User's Guide
QA Complete User's Guide
ALMComplete | QAComplete
Overview
ALMComplete is an award winning software lifecycle management tool that helps Information Technology (IT) departments manage all components of software development including managing customer requirements, project deliverables, test management, defects, and support tickets.
As a web-based application, you can access your data anywhere you have connectivity. Please use
only one browser session for one log in: we do not currently support logging in multiple times using
the same browser or additional tab within the same browser. However, you can log in from your
desktop twice using different browsers, such as one session of IE and on session of Firefox or Chrome,
and this still consumes only one license.
Coupled with collaborative tools like document sharing, team calendars, interactive dashboards, knowledge bases and threaded discussions, teams begin communicating more effectively and begin delivering solutions quickly and with high quality.
This Users Guide provides information on using the features of all ALMComplete Editions. If you see
features in this document that you do not have and are interested in, please take a look at our Editions on the next page and contact SmartBear at +1 978-236+7900 or visit www.smartbear.com for
information.
ALMComplete and our other editions are offered as Software as a Service (Cloud) or as On-Premises
(formerly SoftwarePlanner Enterprise) for those interested in hosting your web application on your
own servers.
Youll find that a resolution of 1280 by 1020 or greater works best.
Page 2 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Helpful Resources
Below are some resources you might find useful:
SmartBear Software www.smartbear.com
Support Click Help Center at the top right of your screen or go to: SmartBear Support
Forums www.smartbear.com/forums
Training - Training
SoftwarePlanner
Youll find the term SoftwarePlanner in several places in this guide and in other documentation. SoftwarePlanner refers to the engine and database of all ALMComplete and QAComplete and features.
Page 3 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Administrators Guide
Page 4 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Backups
Software as a Service customers can sign up for our automatic backup service. The backup service will
send you a link to a zipped file. The zipped file contains CSV formatted Agile Tasks, Requirements,
Tests, Defects, Contacts, and List data. Access to configuring Automatic Backup Service is controlled by
a Security permission in your Security Group.
To configure the backup, go to Setup and choose Automatic Backup Service. Select the desired frequency in the drop down. Enter the email address that will receive the link.
You can also set a password on the zip file, so that the CSV files can only be opened.
If you enter a Confirmation Email, the system sends a notification that the backup was enabled to this
address.
Due to bandwidth and CSV limitations, Project Plan Tasks, Attachments and Shared Documents are
not included. The CSV file is the equivalent of the Export to CSV (All Fields).
Page 5 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Licensing Model
The licensing model is either a Concurrent User model or Named User model.
Concurrent Users
The Concurrent User model means that you can setup as many individual users as you like, but only a
certain number of users can log in simultaneously based on the number of licenses youve purchased.
This allows you to create as many users as you need, but purchases only sufficient licenses for the
team members that will log in concurrently.
Named Users
The Named User model means you have a list of specific users, and only these users can log in.
Page 6 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Security
Security allows you to grant your team members different permissions for different Projects. For
example, you may want to grant one team Read Only access to data in one Project, but full permissions to a different Project.
The first step in establishing security is to determine the roles of your teams. You have different types
of teams in your organization (security administrators, project managers, analysts, programmers, testers, sales people, marketing personnel, documentation specialists, etc.). Each of these team roles may
have different security needs: a project manager may need full rights to all areas, where a sales person
may need more limited rights.
NOTE:New features are frequently controlled by a new security setting. Security permission is off by
default when new features are deployed, since we cannot predict which of your users should have
access. When new features are available, have your Security Admin enable permission to the features
for your security groups.
Setting up Security Groups
Once you determine the various roles for your teams, define the Security Groups that represent those
roles. Each group is a set of security rights for that role. You may have a few security administrators, a
few project managers, many programmers and testers. Each team member will be assigned to a specific Security Group for each Project.
To establish a new security group, go to the Setup tab and choose Security / Security Groups. A list of
security groups appear. Note the example security groups below (Channel Manager Consulting, etc).
The number of users in the group appears under # Users column. Click Add New to create a new security group.
Page 7 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
The detailed Security Group Privileges form appears. Here, you define the permissions for this group:
Page 8 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Once you have defined the rights for the security group, all users in this group on a particular Project
will have those rights.
When setting Security Privileges, each area has a block of checkboxes for Security Settings.
The top row of checkboxes is used for Full Access, Read, Add, Update and Delete privileges.
Another set of checkboxes determine additional privileges:
Page 9 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Allow access to items other than mine? check this box if the users are allowed privileges to items
owned by or assigned to other users.
Allow approving of items? Check this box if the users are allowed to change the status to Approve
or Reject. If not checked, the user cannot see nor select any status that contains the text Approve
or Reject.
Allow assigning of items? Check this box if the users are allowed to assign items to other users.
Allow closing of items? Check this box if the users are allowed to change the status to Closed. If not
checked, the user cannot see nor select any status that contains the text Closed.
The next two rows of checkboxes determine the privileges for Escalation Rules and Folder Maintenance. You can set the privileges to Full, Read, Add, Update, Delete for Escalation Rules and Folder
Maintenance for each area.
Page 10 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
List Manager
In the List Manager block, you can set privileges for List Maintenance and for each List that youve
built. Once you create a List, it will be displayed here where you can set privileges to the list.
Page 11 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Allow access to Project Plans other than mine check this box if the users are allowed privileges to
Project Plans owned by or assigned to other users.
Allow assigning of Project Plans check this box if the users are allowed to assign Project Plans to
other users
Project Plan Task Templates check this box if the users are allowed to maintain Task Templates
Project Plan Tasks (Project Team Members) set Read and/or Update privileges to Project Plan
Tasks
Allow viewing of costs Check this box if the users are allowed to view Actual Cost fields on the Project Plan Task
Shared Documents
In the Shared Documents block, there is an additional check box for Skip document review process
(post in final status). If this box is unchecked, the users in this Security Group upload documents as
Preliminary. Check this box if the users are granted permission to upload documents as Final
Test Management
Test Management controls permission to the Test Library, Test Runs, Test Sets and Configurations, Versioning, Test Automations, Hosts and Schedules, and the Run History.
Page 12 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Allow access to items other than mine? Select this check box to allow users access items owned by
or assigned to other users.
Allow assigning of items? Select this check box to allow users to assign items to other users.
Allow running tests from the test library? Select this check box to enable a Run Now icon from the
Test Library. This bypasses the creation of a Test Set and allows your team to run single tests directly
from the test library list.
Automation Runs Select this check box to enable the Automation screen.
Test Automation controls permission to the Automation tab on Tests in the Test Library, where you
associate your Test with automated or unit tests created with supported testing tools.
Test Hosts controls permission to Test Hosts used by Automated tests.
Test Schedules controls permission to Schedules used by your Automated tests
Test Runs
l
Allow editing Steps during Test Run? Grants permission to change Test Steps on the fly, during a
Test Run. Users with this permission can change, add or delete Steps within a Test while in the midst
of a Test Run; the changes can update the original Test in the Test Library or only affect the current
Test Run.
Test Versioning
l
Test Versioning: This enables the Test Versioning feature. With this permission, users can read or
delete Test Versions in the Test Library. You will need to enable this for your Security Administrator
group at a minimum to enable the Versioning feature.
Allow Test Version Rollback: With this permission, you can select a previous version of a Test in the
Test Library, and turn it into the currently active version.
Test Sets
l
Allow deleting Test Run History? Grants permission to delete historical data for Test Runs. This can
be useful if Test Sets were run in error, or against an incorrect build.
NOTE: Deleting Test Run History will recalculate average run time and change Last Run details on the
Test and on the Test Set.
Configurations
l
Allows standard Read, Add, Update and Delete to Configurations and Configuration Folders.
Page 13 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Additional checkboxes control permission to global settings that affect all areas.
l
Manage company bulletins: allows maintaining the company bulletin, found on the Home Page
Manage custom email alerts: allows maintaining custom emails alerts, found on the Home Page
Manage custom fields: allows the creation and maintenance of custom fields.
Manage project bulletins: allows maintaining the company bulletin, found on the Home Page
Page 14 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Manage workflow and state transitions: allows maintaining workflow, found on Setup / System Configuration / Screen Layouts
Manage Automatic Backup Service: allows selection of the optional automatic backup service, available to Cloud / Software as a Service customers only.
Manage License: grants permission to post updates to your license (number of users)
Manage Team Member Work Hours: grants permission to post hours for other team members.
Without this, you can only post hours to items assigned to you.
Override records locked by other users:grants permission to override a lock on a record currently in
use by another team member. Allowing this gives the user permission to override edits in progress
by other team members and should be used with caution. Please refer to Record Locking for additional information.
View administrative reports: grants permission to view and run Administrative Reports.
View timesheets reports: grants permission to view and run Timesheet Reports.
Other Areas includes Security Settings for Source Control Management (SCM) Change Lists and permission to maintaining your custom Support Managers.
Click Submit to save the Security Settings for the Security Group.
Page 15 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Calendar Sharing
If you would like to share calendars between team members, you can set up automatic rules for giving
specific groups of people rights to each others calendars. When a security group is setup, you will
notice a Calendar Delegation button. When this is clicked, it allows you to set the rules for allowing
this set of users in the security group to share their calendar with others.
For example, in the Channel Manager Consultants security group, we have decided to automatically
give read access to the calendar for our Channel Manager Consultants:
When adding users to the Channel Manager Consultants, they will automatically have permission to
all calendars for all users in all projects.
Page 16 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Fill in the details for the new user. Notice the Security privileges choice list shows all the security groups
you set up previously. Select a security group, and the new user will be set up in the selected group for
the current project.
If you want the user to change their password on the first login, check User(s) must change password
at next login. After you press Submit, the user will receive a registration email with information on how
to log in and reset the password.
Page 17 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Once this is done, you can edit the user record (notice the Active flag is not checked).
On the edit form, check the Restore this User and click Submit:
Page 18 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
NOTE: Do not make any other changes to the user record until it is restored. Once restored (after Submit) you can edit and make further changes. The user is now re-instated and can log in.
You may want to review their security permissions to ensure they have the correct access to the correct Projects.
Page 19 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
About Projects
Think of a Project as a workspace that divides your data for security purposes. Your team will determine if it is best to use one single project, or if separating the data into multiple projects makes sense.
Using a Single Project
The simplest way to store your data is in a single project. You can use filters to return information
within the project based on specific criteria. A single project also reduces maintenance, as you can
setup your choice lists, custom fields, and screen layouts once without worrying about synchronizing
those in multiple projects.
Yourteamscan be assigned to different security groups within the project.
Using Multiple Projects
If you have different departments or teams within your organization that will work with the features in
a different ways, such as different custom fields, workflow, screen layouts and/or choice list values,
you may want to define more than one project.
You may also prefer to use multiple projects to secure the data so that some teams can access certain
projects but not others. For example, if you have multiple departments and you do not want one
department to see another departments information, you can accomplish this by using multiple projects and setting security to prevent unauthorized project access.
Finally, you may want to separate your data into multiple projects for business reasons (by product
line, etc).
Creating a New Project
To create a new project, go to the Setup tab and click Projects (Open & Create). To add a new project, click Add New.
Page 20 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Check the boxes to generate the desired information - Folder Structure, Choice Lists, Custom Fields,
Agile Tasks.
Check your list of Selected Users and Submit.
Securing a Project
To manage security for a project, go to the Setup tab and select Projects (Open & Create). Notice the
Manage Security Rights button; use this to maintain your team's permission to the project.
Page 21 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
From the list of users, use the Security Group drop down to select each team member's security level.
Click Submit.
Synchronizing Projects
The Sync Project feature will copy Custom Fields and Choice Lists from one project to another. If you
use a standard set of Custom Fields and Choice Lists across multiple projects, this allows you to keep
the values in sync across project in one step.
IMPORTANT: all existing Custom Fields configuration and Choice list values on the target "To" project
will be replaced by the Custom Fields and Choice lists on the Source Project. This action cannot be
undone.
Go to Setup / System Configuration and select Sync Project System Options.
Page 22 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
For Source Project, select the project that holds the desired Custom Field and Choice List definitions.
Use the checkbox in Copy To This Project to select that projects that need Custom Fields and Choice
Lists updated.
When you click Submit, the Custom Fields and Choice Lists are copied from the Source Project and
replace all values in the target Copy To projects.
Archiving a Project
If you are done with a project, you can archive it to prevent any further modification or data, without
actually deleting it. This allows you to hide the project from further use, and if necessary, open it up
again later.
To archive a project, go to the Setup tab, click Projects (Open and Create), then edit the project.
Uncheck the Active Project? checkbox and click SUBMIT. This will archive the project; it disappears
from view in the Projects drop-down lists, reports, etc. You can come back here later and check the
Active Project checkbox to remove the archive flag, should you want to view or report on the project
again.
Page 23 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
IMPORTANT: DELETING a projectwith Delete this record (are you sure) REMOVES all data in the project, then deletes the project. The project and project data cannot be recovered.
ARCHIVINGthe project removes it from the project drop down selector, but keeps all project related
data intact.
Assigning Projects Rights to a User
You can set up one or more projects and secure each project separately. Once projects have been
setup and users are added via the method above, you can give specific users different rights for each
project and can restrict a user from accessing specific projects. To do this, go to the Setup tab, click
Security / Users, and click the Security Privs button for the user.
From here, you will see each project and choose the security group you wish to apply for each project
for this user. If you want to restrict them from accessing the project, choose (None Cannot access).
Page 24 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
The Security Admin? is the same box that is on the user record. This grants the user administrative permissions and updates the field on the user's record. The user will be allowed to edit users, security
groups, and security settings across projects. Make sure this box is checked for your Security Administrators.
Page 25 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 26 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Check Box This provides a custom field that is shown as a checkbox (on or off).
Choice List (Based on Another Field) This allows you to create a custom field that derives the items
in the combo box from another feature area.
Choice List (List of all Project Users) This allows you to create a custom field whose combo box is
filled with a list of all the users that have access to the project you are working in.
Choice List (List of all Users) This allows you to create a custom field whose combo box is filled with
a list of all users, regardless if they have access to the project you are working in.
Choice List (List of Values) This allows you to define a list of selectable values in a drop down box.
Choice List (Multiselect) - This allows you to define a list of selectable values that appear in a drop
down box, with a checkbox on each value for multiple selections.
Date This provides a date entry field with a clickable button to allow choosing the date from a calendar popup.
Phone This provides a custom field whose values must be in phone format (xxx-xxx-xxxx).
SSN This provides a custom field whose values must be in social security number format (xxx-xxxxxx).
Text This provides a custom field that can be regular text entry. Custom fields 1 through 10 can be
up to 8000 characters and allow basic formatting. You can override this and restrict the field to plain
text only by using underscore [_ ] in the field name. This overrides the automatic rich text editor
formatting and creates a plain text field. Custom 11 through 90 are limited to 100 characters.
Choice List (Based on SQL) On-Premises feature. You can enter a SQL statement that will return a
list of items based on your query. These display in a choice list drop down. (Note: This type of field is
not compatible with Fast Edit or Import.)
Choice List (List with Sublist based on SQL) - On-Premises clients can enter a SQL statement that will
return a list of items based on a SQL query and put those into a drop down choice list.
Page 27 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Then enter the field name Contact Name and select Choice List (Based on Another Field):
Click Set choice list based on another field, to select Contact Manager and Contact Person:
Page 28 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Once you press Submit, the new field named Contact Person will contain a list of your Contacts:
Page 29 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
From here you can edit, add or remove items from the choice list:
Page 30 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
On the Listing Screen tab, select the default fields that will appear on the List. You can select all fields
except for large text fields (up to 100 characters wide).
Each team member can modify the appearance of the listing screens directly on each entity. For
example, once you select the default fields for the listing screen for Defects, when your team members
go to the Defects tab, they have the Choose Fields options to change the list for themselves. These
changes do not affect other users.
The Column Layout Preference is a default value. Your team members can modify the number of
columns for themselves.
Page 31 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Fields that you make Required will show as always Required in Workflow. If a field is required only
when the item has a certain Status, see the Workflow section.
Page 32 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Status of New: A new defect is reported, you will require that the title, description, status and priority of the defect is entered. If the defect is reviewed and it is not really a defect, it can be closed.
Status of Assigned: Once the new defect has been reviewed, it is assigned to a developer to be fixed.
At this point, you want the title, description, priority and severity to be locked, and the assigned to
field to be required.
Status of Resolved: Once the developer fixes the defect, the status is set to Resolved and the resolution code and description is required.
Setting up Workflow
There are a number of different ways to get to Workflow maintenance:
Page 33 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
From any Listing, click the Actions drop down and select Workflow
From an Edit form, click Choice Lists, then click Workflow and State Transitions
From Setup, go to System Configuration -> Screen Layouts. Select any module and then click Workflow and State Transitions.
For this example, go to the Defects Add/Edit screen and click Choice List. Then click Workflow and
State Transitions:
From here you can set the options to match your workflow you defined graphically:
Page 34 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Then once a programmer sets a status to Resolve Now, it will prompt them for only the Resolution
Code and Description. Once they enter that and press Submit, it will save the record and automatically set the status to Resolved.
Setting up Automatic Assignment
If you wish to have an item automatically assigned to a specific person once it reaches a specific status,
you can update your workflow rules for this. To do that, choose the status, and then choose the
Page 35 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Notice that you can also set the automatically assign to to [Remove Assignment]. If this is set, it will
automatically remove the assignment when it enters that status. This can be helpful for removing
assignment when items are closed, etc.
Setting up Automatic Assignment based on Functional Areas (Defects Only)
The Defects workflow has a special type of auto-assignment feature that allows you to automatically
assign defects based on the functional area of the defect. To use this feature, you must first setup
your Defect Functional Areas from the Choice Lists area. If you dont see Functional Area as one of
your Defect Choice lists, check Screen Layouts in Setup to add Functional Area to the Defect Add/Edit
screen. Then you can define a list of values for your Functional Areas.
Once that is done, you can setup the assignment rules for each functional area:
Page 36 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Once this is done, set the automatically assign to to [Functional Area Assignee]:
Page 37 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Support Manager
ALMComplete includes a customizable Support Manager. This allows you to create your own entry
page for your customers where they can submit issues to your Support Team.
For more information on creating your own Support Manager Web page, please see our Support Manager Users Guide: About ALMComplete's Support Manager.
Page 38 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
To get started, click on an area (e.g. Defects), then click Add New Rule.
This will take you into a wizard that allows you to define your escalation rule. From the first page of
the wizard, name the rule and set the status and the duration in which the item stays in that status
that will cause the escalation rule to be triggered. For example, if you wish to have the rule triggered
when a defect has been in Active status for 2 days, you will set it up as shown below.
Page 39 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Then click Next and go to the next page of the wizard. From here, you can add additional criteria for
the escalation. In our case, we will add criteria to the rule to exclude any items that have been escalated today and whose last update has been made in the past 2 days:
Page 40 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Then click Next and go to the next page of the wizard. From here, you can have the escalation rule
automatically update any field(s) on the record upon triggering the rule. In the example below, it will
automatically update the assignee when the rule is triggered.
Page 41 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 42 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
If you check Make Public, anyone on your team can use the template. If unchecked, only you can use
it.
Page 43 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 44 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Security Settings: Allow all users to see list of project users determines if team members other than
Security Administrators can see the Users on this project list in Setup.
Escalation Non Working Days allows you to switch off the automatic emails sent from Escalation Rules
for selected week days. If you do not need the escalation reminders to be sent on weekends, check off
Sat and Sun to switch it off. If you want the rule to fire but not send email, then use the Rules Fired
checkboxes the escalation rule will run but the email will not be sent.
Page 45 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Email Alerts
There are three standard types of email alerts:
Assignment Alerts Notifies you when things are assigned to you.
Ownership Alerts Notifies you when people change records that you are the owner of.
All Changes Notifies you when anything changes.
In addition to the standard email alerts, you can create custom email alerts. For example, if you wish
to trigger an email alert when an items priority changes to Urgent, you can do that. To create a custom alert, go to the Home tab, click Email Alerts, then click Add New:
Once here, you can choose the area to set the alert for (Defects, Contact Manager, Agile Tasks, etc),
then you can choose what field will trigger the alert (Quick Task Priority in our example), the value of
the field that triggers the alert (Urgent in our example), then the Body of the email you wish to send
when the alert is triggered. Note that it will automatically place the details of the item into the alert
(like the details of the Quick Task that was changed in our example), so the email message is just the
header text that is shown at the top of the email alert.
Page 46 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 47 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Record Locking
A built-in security feature prevents your team members from unintentionally stepping on each others changes.
When a team member selects a Requirement, Test, Defect, or other object for editing purposes, the
record is locked. Should a second team member happen to open up the same record, they will see a
read only version. The name of the person who has the record locked appears in the heading.
For example, one of your team members opens a Defect. A second team member tries to open the
same Defect and sees this:
The second team member can click OK to view the defect, but will not be able to make any changes to
it. The name of the team member with the lock appears up in the green bar. All fields are display only.
If the team member has permission to unlock records (based on a security setting), the Override read
only icon will be available in the upper right corner next to the Refresh icon.
Page 48 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
This allows the team member to open up the Defect for editing, but must take care when saving the
Defect, since changes in process by the first team member may be overwritten.
Record Locking Security Entity
If you need to allow certain users to override a lock, go to Setup / Security and select the desired Security Group. Scroll down to Management Features and check the box for Override records locked by
other users.
Page 49 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Use this with caution: keep in mind that this will open up the selected item for editing by multiple users
at the same time. The last person to save the item will override any changes made by the other users.
Page 50 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 51 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
If you wish to delete an imported batch (in case of an error), you can go to the Setup tab, choose
Import, then choose Delete Imported Batches. From here, choose the area you imported into (such
as Defects). It will show you the batches you have imported. Select the batch and choose Delete Now.
Exporting Data
To export data, go to the listing screen and click Actions / Export. For example, to export your defects,
go to the Defects Listing screen and click Actions/ Export:
Page 52 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 53 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Integrations
Both On-Premises and SaaS clients can integrate some features with third party tools.
For information on integrating with Atlassian JIRA with the QAComplete - JIRAConnector, please see:
Integration With JIRA
For information on integrating Test Management with test automation tools, please see:
Integrating Automated Testing Tools
You can request information about additional third party integrations from:
OpsHub Integrations
Accessing the API
The API enables you to directly access the data and write code that reads, adds, updates and deletes
information from the database. It includes coding examples of using the API to access the data.
For information on using the API, please see:
ALMComplete Web Service API
Using the Data Dictionary
The Data Dictionary describe the base tables, views and fields for each major feature.
For information on using the Data Dictionary, please see:
Using the Data Dictionary
Integrate bugs you create in JIRA into your application/testing lifecycle in ALMComplete|QAComplete.
Page 54 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
To configure and control the service, you use the QAComplete - JIRA Connector Configuration Tool.
The tool is shipped and installed together with the synchronization service.
To start the synchronization, click Run Service.
Page 55 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Atlassian JIRA 4.0 - 6.3 must be installed on the server that hosts your JIRA database.
JIRA must accept remote calls. For information on how to enable JIRA for remote API calls, please
see the JIRA documentation.
The ALMComplete|QAComplete account you use for the integration must belong to a security
group that has all privileges for items you synchronize with JIRA.
The JIRA account you use for the integration must have Administrator privileges.
The computer where the QAComplete - JIRA Connector service runs must have access to your JIRA
database and ALMComplete|QAComplete database.
To synchronize your workflow across ALMComplete|QAComplete and JIRA, export your JIRA workflow
to an .xml file and import it into the QAComplete - JIRA Connector.
To export JIRA workflow:
1. In your JIRA client, login to your JIRA project.
2. Click
3. Select the Workflows section and find the workflow you need to export.
4. In the Operations column, click View.
5. Click Export and then click As XML.
6. In the Opening Your Workflow dialog, click Open With or Save File.
7. Locate the file and make sure it has an XML extension.
You can import the workflow data when you create a new synchronization profile or on the JIRA Workflow page when you edit a profile.
Preparation in ALM|QAComplete
Page 56 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Synchronization Profiles
For each pair of items you synchronize, you create a separate synchronization profile. A profile stores
the information that QAComplete - JIRA Connector uses to connect to your ALMComplete|QAComplete and JIRA instances with rules describing how the service copies data from one system to the other.
In Release 10.0, you can synchronize ALM|QAComplete Defects with JIRA Issues, type "Bug". The profile you create describes how defects in an ALMComplete|QAComplete project are synchronized with
Issues/Bug in a JIRA project and how fields are mapped between the two.
You can create and configure profiles with the QAComplete - JIRA Connector Configuration Tool.
To set up a synchronization profile:
l
Page 57 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
The QAComplete - JIRA Connector comes with a default synchronization profile. This profile maps
default QAComplete choice list values to the corresponding default values in JIRA. When creating your
customized profile, use the default profile as a starting point by copying it to your new profile.
Note: if you have customized the JIRA choice list values, the JIRAValues below will be different for your
instance.
Configuration
Once you have a copy of the Default Profile, complete the Settings, ALM/QAComplete and JIRA tabs.
Once you've configured the profile, click the Mapping tab.
Mapping
The default profile maps the following values between QAComplete Defects and JIRA bugs.
key
String
summary String
status
Lookup
priority
Lookup
resolution Lookup
reporter Lookup
description RichText
assignee Lookup
JIRA KEY
The default mapping assumes that Custom1 in Defects maps to the "key" field in JIRA. Change this to
the correct custom field used in your system.
Status Mapping
QAComplete Status Codes are mapped to default JIRA status values. You can modify the mapping for
changes you may have in either system.
1
3
6
4
5
Backlog
In Progress
Closed
Reopen
Resolved
Page 58 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Priority Mapping
QAComplete Priority Codes are mapped to default JIRA priorities. You can modify the mapping for
changes you may have in either system.
1
2
3
10000
4
5
Blocker
Critical
Major
Normal
Minor
Trivial
Resolution Mapping
QAComplete Resolutions Codes are mapped to default JIRA resolutions. You can modify the mapping
for changes you may have in either system.
10205
10002
10205
3
10000
10004
10005
10001
JIRA Label
Won't Do
Duplicate
Won't Do
Done
Fixed
Cannot Reproduce
Invalid
Workaround Exists
Won't Fix
Mapping is fully customizable, so you can add mapped fields and modify the mapping as needed. If
you use required fields in either JIRAor ALM/QAComplete, make sure that all required fields are fully
mapped.
Creating a New Synchronization Profile
Create a synchronization profile for the items you want synchronized. You can create separate profiles
to synchronize Defects in different ALM|QAComplete Projects with Bugs in different JIRA Projects.
To create a new profile, in Synchronization Tool, click Manage and then click Add.
Note: To create a new synchronization profile (or edit an existing one), stop the service first. When you
are done creating or editing the profile, restart the service.
Page 59 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Browse for the .xml file storing the exported workflow. For information on how to export JIRA
workflow to a file, please see Requirements and Prerequisites.
Select the needed file and click Open.
Note: You can import the workflow data later on the JIRA Workflow page by editing the profile.
4. Click OK.
To copy settings from an existing profile, select the desired profile in the Copy settings from list and
click OK.
To configure or edit an existing profile, select it in the Synchronization Profiles dialog and click Edit.
Configuring General Settings of the Synchronization Profile
On the Settings tab of the Synchronization Profile Properties dialog, you define the synchronize direction and configure notification emails:
Page 60 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Choose JIRA -> ALM\QAComplete or ALM\QAComplete -> JIRA to enable the one-way synchronization. When an item in the source (first) system changes, the service updates the corresponding item in the destination (second) system.
l JIRA -> ALM\QAComplete: JIRA issues are pushed to ALM|QAComplete defects. When the
JIRA issue is changed, the change is pushed to QAComplete. If the QAComplete defect is
changed, it does NOT update the JIRAissue.
l Note: Changes made in QAComplete will be overwritten by changes made later in
JIRA.
l
ALM\QAComplete -> JIRA: ALM|QAComplete defects are pushed to JIRA. When the
QAComplete issues is changed, the changed is pushed to JIRA. If the JIRA issue is changed,
it does NOT update the QAComplete defect.
l Note: Changes made in JIRA will be overwritten by changes made later in QAComplete.
Page 61 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
In User Name and Password, enter the account name and password used to connect to the
email server.
In From, enter the email address to use as the "From" address for notifications.
In To, enter the email address to receive the notifications. To send notifications to several recipients, enter their email addresses separated by comma.
On the ALM/QAComplete tab of the Synchronization Profile Properties dialog, specify the location of
your ALMComplete|QAComplete web service and login information for the project you want to synchronize with JIRA.
Note: the Department ID, Project ID and User ID are the unique numeric identifiers found in
ALM|QAComplete.
1. In Server endpoint, enter the URL of your ALMComplete|QAComplete web service.
For SaaS clients, the URL address is http://ws.softwareplanner.com/psws.asmx.
Page 62 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
On the Setup tab, in the tree on the left, select Projects (Open & Create).
Note the values in the ID and Dept Id columns for the desired Project.
If the columns are hidden, click Choose Fields and add the columns to the Chosen Fields list.
On the Setup tab, in the tree on the left, select Security | Users.
Find the desired user and note the value in the UserId column.
If the column is hidden, click Choose Fields and add the column to the Chosen Fields list.
3. The Item type is the ALM|QAComplete items to synchronize with JIRA issues. Leave the default
value of Bugs.
4. The Item data culture is the locale used in ALMComplete|QAComplete. Leave the default value of
en-US.
5. In Synchronized tool name, enter an identifying name for the JIRAinstance that you are synchronizing with ALMComplete|QAComplete. Enter JIRA. This name is used in ALMComplete|QAComplete synchronization messages.
Page 63 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
On the JIRA tab of the Synchronization Profile Properties dialog, specify the JIRA database that you
want to synchronize with ALMComplete|QAComplete:
1. In WSDL Link, change [jira server host] to your JIRA instance, with the path to your JIRA web service.
2. In Project Key, enter the project key of the JIRA project that you want to integrate with the
ALMComplete|QAComplete project.
3. In User name and Password, enter the name and password for user account used to access and
update JIRA items.
Page 64 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
On the Mapping tab of the Synchronization Profile Properties dialog, you set up synchronization
rules for each individual field. These rules define what the service copies from specific fields on one system to corresponding fields in the other.
NOTE: make sure you know of all required fields in both ALM/QAComplete Defects and in JIRA. You
need to map all required fields for a successful synchronization.
1. In the table, click in an ALMComplete|QAComplete field to open a drop-down list of fields. Select the
desired field to synchronize with the corresponding data in JIRA. You can set synchronization rules
for both the built-in and custom fields.
2. Click in the Jira field cell to open the drop-down list of JIRA fields. Select the field that corresponds to
the ALM|QAComplete field.
Page 65 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
If a field to be synchronized is a lookup field (values are defined in a choice list), set the mapping rules
for each value:
1. On the Mapping tab page, select the lookup field.
2. In the ALM/QAComplete Value column, enter a value from the choice list in ALMComplete|QAComplete.
3. In the JIRA Value column, for each value, set the corresponding value used in JIRA.
In this example, the numeric user ID of the assignee in QAComplete is associated with JIRA's alphabetical user identifier.
Page 66 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
This example uses the default JIRA status values.Your JIRA status IDs may differ.
Synchronizing Workflows
A workflow defines what stages an item passes during its lifecycle in the system. You can synchronize
your ALMComplete|QAComplete workflow with JIRA workflow so that when an item transfers to a
new state in one system, it automatically transfers to the appropriate state in another system.
To synchronize workflow, first you must export the workflow from JIRA. See Exporting JIRA Workflow.
The JIRA Workflow tab of the Synchronization Profile Properties dialog displays the imported
JIRAworkflow.
Page 67 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Important: To view the JIRA workflow, upload the workflow data first. To do it, click Load JIRA Workflow and browse for the exported XML storing the JIRAworkflow. You can also load the workflow data
in the Add Synchronization Profile dialog when you create a new profile.
To synchronize your ALMComplete|QAComplete workflow with your JIRA workflow, synchronize the
statuses the item can have:
1. On the Mapping page, select the field that holds the item status in ALMComplete|QAComplete.
2. For that field, set the field that holds the item's status in JIRA.
3. In the ALM/QAComplete value column, enter a valid status based on the ALMComplete|QAComplete choice list. In the Jira value column, for each AlmComplete|QAComplete status,
Page 68 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 69 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
The page lists all synchronization events that occurred for profile selected in the Synchronization Profiles list. Check the status column to see whether the synchronization event passed or failed.
To update the log, click Refresh log data.
To view synchronization actions performed during a specific time period, set the From and To dates.
To remove the filter, click Clear filter.
To view information only for the most recent synchronization action, select View last synchronization
only.
To view information on synchronized items, switch to the Synchronized Items tabbed page.
Page 70 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
The page lists all ALMComplete|QAComplete entities synchronized with appropriate JIRA issues by ID.
Page 71 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
You can modify the built in Crystal based reports (Requires your own Crystal Report
license and resource)
Updates are scheduled approximately twice a year (Requires your own resources perform the update)
Updates are seamless and regularly scheduled, requiring no effort on your part
Page 72 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 73 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Check the box to allow this group permission to Active Directory Authentication setup.
Active Directory Authentication Setup
Once permission to Active Directory Setup has been given, you will see and Active Directory Authentication Setup in Go to Setup / System Configuration.
Page 74 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Enter the Lookup Value for the selected Query Attribute and Password and click Test Login.
Test LDAP Authentication returns information about the connection and the authentication for
troubleshooting.
Page 75 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Log each active directory password authentication gives you the option to post all authentication
events to an audit file. This is great for troubleshooting any Active Directory Authentication or configuration issues.
At Login, automatically create a new SoftwarePlanner user if successfully authenticated in Active Directory: Check this box if you want your Active Directory users automatically set up in Setup / Security /
Users without intervention from you. You must be using email address as the Query Attribute.
The next four fields are the default settings for new users created from Active Directory Authentication,
which occurs when the box is checked.
Automatically Add Users to: Select a default project for the new users
New Users should be added to this Security Group: Select the Security group that the new users will
belong to.
Default Time Zone for new users: select the default Time Zone for new users
Send Notification email to: Enter an email address, and this person will be alerted when a new user is
created from Active Directory Authentication.
In the box below When creating a new user in SoftwarePlanner, if they are using Active Directory
authentication, use this Email Body for the new user email alert enter the text that you want in the
email alert body.
And finally, At login, if the user cannot be found in Active Directory, disable the SoftwarePlanner user
account? If you check this box, when a user with a valid email address in Setup / Security / Users is
NOT authenticated in Active Directory but tries to log in, Active Directory Authentication takes precedence and locks them out. We advise you leave this unchecked until you have tested Active Directory Authentication and have it working the way you want then check it if this is a security setting
that appeals to you.
Be sure to click Save Changes.
Page 76 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
In AD Search Value, put the value that will be used by the Query Attribute property for locating this
user in Active Directory Authentication.
Page 77 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Security
In Security Groups, security settings specific to the On-Premises solution control permission to the onpremises specific features:
Manage Active Directory Authentication: allows access to Active Directory Authentication
Setup in System Configuration.
Manage Reports: allows access to Report Setup, Report Maintenance, Report Groups
and Report Scheduler.
Manage Dashboards: allows access to Manage Dashboard Charts and Manage Dashboard Pages under Report Setup. Requires permission to Reports.
Page 78 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 79 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 80 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 81 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Once this is done, the Defects screen now has a combo box that lists users that have the Security
Admin checkbox checked:
Page 82 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
IMPORTANT: Please notice that the values in the Application column must be unique. They are categorized by Product Line only to simplify selecting the Application. Only the selected Application value
is actually stored on the record.
For this example, define a custom field in Requirements that looks like this:
Page 83 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Our sample Select statement refers to Field1 and Field2. These are the field names directly from the
Lists table, not the labels from your field definitions. The syntax must be exactly as depicted: each field
must be followed by Code1 and Desc1, the next field followed by Code2 and Desc2 and the
third field, if used, followed by Code3 and Desc3. The process uses these to build the relationship
between the fields.
The name of your list goes in the ListTypeCode value. Our example list is called Applications. If you
are referencing a table other than a List, you would use the actual table and field names from that
table.
Click Verify SQL to try it out:
Page 84 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Notice that when I select Testing and QA in the first field, the second field lists the Applications in the
Testing and QA Product Line.
Click Submit.
Back to the Requirement: youll see your Custom field for Application on the Add or Edit form.
Page 85 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Click on the second Drop down to see the list of Applications filtered by Product Line.
Make your selection and Submit.
Another example:
You might have Product Line, Application and Module in another list, and youd like to combine this
information into the Choice List with Sublist. You can actually concatenate the fields from your List (or
other table) into the new Custom Field.
Heres the sample list:
Page 86 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
The custom field is called Product, App and Module and the definition looks like this:
Select distinct
Field1 Code1, Field1 Desc1,
Field1 + ' | ' +Field2 Code2, Field2 Desc2,
Field1 + ' | ' + Field2 + ' | ' + Field3 Code3, Field3 Desc3
From Lists
where ListTypeCode = 'FunctionalArea'
Order by Field1, Field2, Field3
Page 87 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Its important to note that this is a single custom field, NOT a logical relationship between multiple
fields.
Page 88 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
To setup Email Alert Templates that can be customized, a set of Preferences need to be created for
your department. Once the System Preferences have been created with initial default data, you can
alter the default email alert template .
First, check if you already have any overrides: Quick Search on EmailAlerts to find any pre-existing
email alert preferences. If you do not find any preferences for EmailAlerts, please contact our support
team for assistance.
If they exist, you can replace or modify the Subject text in the Value field to customize the subject for
the corresponding email alert. Replace or modify the HTML in the Value field to customize the email
alert in any of the HTML fields. The HTML value can be modified up to 2000 characters.
We use tokens as place holders which will be replaced based on the data of the record being sent for
the Email Alert. For example, if the Email Alert Subject looks like this:
Page 89 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 90 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Users Guide
Page 91 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
The Releases tab allows you to select a Release / Iteration and Build. When you select a Release, the
data in the List on the right is filtered to items linked only to the selected Release, Iteration and Build.
To view data across All Releases, click the root at the top of the list that says Releases. To view data
unrelated to a Release, click (No Releases).
l
With a Release selected, as you add data, your new items are automatically linked to the selected
Release.
The Folders tab allows you to organize your data into logical folders and subfolders.
The Groups tab allows you to group your data by selected fields.
Using Folders
Another organization tool is Search folders. Folders allow you to organize your data into logical areas.
For example, if you are managing contacts, you may have different types of contacts (opportunities,
potential, etc), so you may want to put them into separate folders:
Page 92 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
If you are managing defects, requirements, or tests, you may want to organize them in other ways.
Page 93 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
If you wish to create a subfolder of an existing folder, choose the Parent Folder name from the drop
down. Enter a Folder Name and Description (optional) and press Submit. The folder will appear in the
left side navigation panel.
The Parent Folders roll up all items within the subfolders below, allowing you to view all items in subfolders by selecting the parent folder. The number of items in each folder appears next to the folder
name. If you are filtering for data, the number changes to the count of items found by the filter within
that folder.
Click the highest or root level to see all items across all folders.
Deleting a Folder
If you Delete a folder, the data in the folder is NOT deleted . The folder name is simply removed from
the records, and you will find them in the root section with no folder name. Use Fast Edit to move
the records from one folder to another.
Archiving a Folder
If you wish to archive (hide) the folder, simply edit the Folder by going to the Folders, highlighting the
folder and pressing Edit, then uncheck the Is Active flag. This will hide the search folder but does not
delete any of the data associated with the folder. You can come back and check the Is Active checkbox
to make the folder active again.
Page 94 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 95 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 96 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Page 97 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
The dark blue tool bar takes you to other options for the current modules. The light blue toolbar
across the top of the list shows the available actions for the list of data. Hover over each link to view a
description of the function.
The Actions column on the listing includes icons for actions you take for the individual item: Edit, generate a Printer Friendly version, Email someone about the item, and Post your time to the item.
l
Choose Fields for this listing: Allows you to select and order the desired columns of data
Manage Workflow
Import and Export: Allows you to import data from CSV, or export the data to a CSV file
Show Traceability: Changes the list so that the Traceability links are shown below each item
Items that are affected by due dates (Estimated Date Complete) are color coded: if overdue, the text is
red, if due today, green. Other items are shown as black.
Page 98 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Quickly Search
If you wish to quickly search the list, click Quick Search, enter a search phrase, and choose a field to
search, then press Submit. The Ids field allows you to search for items by multiple ID numbers,
Page 99 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Using Filters
If you wish to filter the list with specific sets of criteria, click the Filters button at the top of the screen.
Give the filter a Name (Save Filter As) and it will be available for re-use. Filters can be yours only - for
your use - or can be Public for use by all team members.
When you click on this icon, youll see the standard Send Email form.
On this form, enter the To email address. You can also enter a CC and/or BCC address.
The Notify Additional People link displays a checklist of project users for selection, including the Owner
and Assigned To for easy and quick selection.
Attach Details does exactly that the email will include the printer-friendly version of the item. And if
you want to include a link to the item in the body of the email, check the box for Include Take Me
There Link.
At the bottom of the form, you can click on Click here to see the details that will be attached to check
out what will be sent.
And then when youre ready, click the Send button.
Sending Email from the Contacts Listing Screen
The Contacts tab has a special email function so that you can send a mass email to a distribution list.
This function is also available on the list of Users in Setup.
Filter the list to the desired distribution list, then use the Send Email icon on the toolbar:
The To email addresses are based on your filter criteria. You can use CC or BCC to copy in additional
addresses. Select an email template or just enter the email body. The email body field accepts most
formatting, including Tags that provide a list of applicable tokens.
To edit an existing item, click the Edit button or simply click on the row:
Editing Records
Click the Edit icon to open a record in Edit mode. Each area has the same functionality on the Edit
Panel.
The fields displayed on the Add or Edit form are controlled in Setup. If you use Workflow, the fields
may change as you change the Status.
After editing your record, click Submit to save your changes.
The Edit Form
Standard functions appear across all areas on the Edit form.
Across the top are links for Actions, Choice Lists, Custom Fields, and Help:
Tip! If you are editing a date field, place your cursor inside the date field and press the + on your keyboard to increment the date by one day or on your keyboard to decrement the date by one day.
About Rich Text Fields
Large text fields, such as a Description field, have basic rich text formatting capability. The tool bar
appears at the top of the field when you click in the field.
The Tag drop down will insert the current date, your initials or name into the text field.
The Font drop down provides you with basic fonts.
Select text and click Bold, Italic or Underline to change the formatting.
The Grow Text and Shrink Text will change the size of selected text.
The Font Color changes the color of selected text: the highlighter changes the color of the background.
The hyperlink icon pops up a window where you can paste a URL.
Basic numbering and bulleting is provided.
View Source displays the HTML coding for the field.
The record is deleted from the database along with notes, attachments, and traceability links.
You can also click on the email icon at the top of the edit form to send an email to anyone:
History of Changes
All changes made to a record are audited and a complete history appears on the History tab:
History records the date/time the change was made, the field changed (or note added) old and new values, and the user who made the changes. It will also show what user has viewed any attached files.
About Notes
You can make notes and keep a history of all notes for the item. When editing an item, a special field
named Latest Notes shows the latest note that was associated with the item.
To add a Note, click the Notes tab and click the Add New at the bottom. The Note field has basic formatting capabilities, much like the Rich Text fields. Simply enter the information you wish to record for the
selected item and click Submit.
Attaching Files
You can attach any type of file to the item (contracts, proposals, screen shots, etc) and they can be in
any format (MS Word, MS Excel, PDF, text file, gif file, etc). You can also insert a link to a URL or UNC
path.
You can enter a user friendly title. Click Browse to browse to the location of your file attachment. You
can enter a URL or UNC path in Web Site Address or UNC path.
If you replace an existing file, it gives you the option of versioning the file so that you can keep the new
as well as the old version.
Associating Tasks
If you use Project Management, you can link requirements, test sets and defects to a Project Plan for
tracking time against associated detailed tasks. For example, once a requirement is approved, you
may want to create tasks on a Project Plan in Project Management for tracking time and progress. To
add tasks to a project plan from within a requirement, edit the requirement and click the Tasks tab:
To add tasks for this specification to an existing project plan, click the Add New Task link. Note that
you can also add tasks from an existing Task Template if you have tasks that are commonly used in Project Plans.
Once a Task is created for a Project Plan, all time and progress, including posting hours and percent
complete, is controlled in Project Management and is display only on the Requirement or Defect.
Please refer to Advanced Project Management for further information on Project Plan Tasks.
About Traceability
Traceability links items for cross-referencing. You can access Traceability from several different options:
from the Edit form for any item, or from the Actions drop down on the List of items by selecting Show
Traceability.
For example, if you want to reference specific Tests that cover a Requirement, use Link To Items on the
Requirement and select the Tests. Open the Requirement in Edit mode. Click Link To Items, select
Tests, then the Folder where the Tests reside. The drop down selection allows you to select multiple
items in one step:
Close the Link to Item dialog, and youll see the Tests linked to the Requirement
When linking Agile Tasks or Defects to Releases, youll see an additional field on the Link to Item dialog.
This allows you to select a Link Type for example, you can link a Defect to a Release / Iteration or
Build, and specify Found In Release or Fixed In Release.
The values for the Link As Type are on the Agile Tasks or Defects Tab under Actions / Manage Choice
Lists.
Adding New Linked Items
Some artifacts allow you to create a linked item by clicking on the Add Linked Item icon from the Edit
form.
When you click Add Linked Item, you can select the type of item you wish to create. You can create a
new Agile Task, Defect, Requirement or Test and it will automatically be linked to the selected record.
The new item will be pre-filled with whatever data makes sense from the original record.
After you click Add Linked Item and select the type of item to create, a new window opens where you
can make changes to the new item. Complete the form and Submit. The new item will automatically be
linked. You can also Submit/Add Another and continue creating new items with automatic links.
Based on security settings, you may have permission to edit the Project Bulletin and Company Bulletin.
Project Mgt Tab
The Project Management dashboards shows status of Requirements, Tasks and Project Plans. Some
charts a drillable click on the chart to view the details.
Requirements by Status (Current Project)
Project Plan Status (Current Project)
Slipping Agile Tasks by Assignee (Current Project)
Slipping Project Plan Tasks by Assignee (Current Project)
QA Tab
The QA dashboard shows dashboards critical to coverage analysis, test and defect status. Graphs
include trending and drillable status graphs.
l
Defects by Requirement
My Assignments Tab
The My Assignments dashboard shows a quick view of your assigned items: Agile Tasks, Project Plan
Tasks, Requirements and Defects.
l
Burndown Tab
The Burndown dashboard shows how you are progressing in your Release or Agile sprint. Velocity
charts show estimates (Est. Hrs), actual hours, and estimated hours remaining. Burndown chart shows
your progress.
About Releases
Organize your data by Release, Iteration and/or Build using the Releases tab. Requirements, Tests,
Test Sets, Agile Tasks, Project Plans and Defects can be associated with a Release, Release / Iteration or
Release / Iteration / Build, providing you with in-depth analysis of the progress, status and success of a
Release of your product.
If you define Release Link Types, artifacts can be linked to Releases by Release Link Type. This allows
you to link a Defect to several Releases, using Release Link Types such as Found In Release, Fixed In
Build, Deployed In Release.
The Release Link Type is defined for each module from the Actions drop down in Manage Choice Lists.
Defining Release, Iterations and Builds
When organizing your Releases, you will want to start with a Folder Structure. Generally the Folder represents your application or product. Within the folder, you will organize your Releases with Iterations
(Sprints) and Builds.
Select the Releases tab.
The left side of this screen is the Navigation Panel. This is where you add and edit folders for your
release. You can use the plus symbol to expand the folder to view the Releases within.
Highlight your new folder, and on the right panel click Add New:
On the Add Release form, describe your Release with a name, status and estimated dates. You can also
enter more descriptive information.
If you want to specify the Start and End Dates, enter them here. If you want to leave the dates blank
and let the system calculate them, check the Auto Adjust Est Dates? checkbox.
The listing form changes to display the Release Hierarchy. Notice the icons have changed, and you can
add iterations or builds in the hierarchy of your Release.
When you click Add New, the Add dialog asks if you want to add an Iteration or Build to the release.
Complete the information for the first Sprint in this release and click Submit.
If you track Builds within either the Release or the Sprint, click the green plus icon again and select
Build.
Now the Hierarchy shows the Release, the first Sprint, and the first Build:
The icons in the action columns allow you to Edit the item. Click the green plus icon to add another iteration or build. Click the red X to delete the iteration or build. Click the Drill Down Report icon to generate the detailed Drill Down report.
Linking Artifacts to a Release
After you define your Release, Iteration or Build, you can tag Requirements, Tests and Defects as
belonging to a specific Release using Traceability. Link the items to a Release through the Release or
through the Requirement Test Management or Defect tab.
On the Release tab, use the Link To icon to navigate to the traceability screen, where you can link items
to the Release.
On the other modules, the left side navigation panel shows Releases. Use the navigation panel to display data for All Releases, data not linked to a Release, or select a Release:
Release Link Types are completely user-defined. Add Release Link Types that you will use when referencing items to the Release. For example, you might want to associated Defects with the Release /
Sprint "Found In" and "Fixed In"
Once Release Types are defined, you can use them to explain the relationship between the Defect (or
other artifacts) and one or many Releases.
You can filter your Defects by Found In Release or Fixed In Release on the left navigation panel. This
allows you to view a group of Defects Found In a given Release or Fixed in a given Release.
Release Roll-up
As you link artifacts to your Release or Iteration, the Release rolls up the total number of linked items
by artifact type. You can view the numbers by adding columns to the Release list with Choose Fields,
or have your system administrator add them to the Release Add/Edit form in Setup - Screen Layouts.
The system rolls up the number of linked Project Plans, Project Plan Tasks, Requirements, Tests that
are linked to the Requirement, Tests linked directly to the Release, Test Sets, Defects and Agile Tasks.
If you enter Estimated Hours on Project Plan Tasks, Requirements, Agile Tasks or Defects, these values
will also be rolled up to the Release. As your team posts work hours, the Release calculates the variance between your original estimates and actual hours.
Variance calculations:
Total Estimated Hours less (Estimated Hours Remaining plus Actual Hours posted) equals Variance in
Hours
(Variance in hours divided by Total Estimated hours) times 100 equals the Variance Percent.
Release Dashboards
As your Release progresses, you can analyze it with our built in dashboards. To view Release Dashboards, go to Releases and click the Dashboard link.
Below are some standard Release dashboards. Dashboards can be filtered for all releases or a specific
release.
Release Reports
Drill Down Report
The Drill Down Report is available from the Release listing screen. Click the Drill Down Report icon to
see a detailed report shows the details of the Release, followed by all items linked to the Release.
The auto numbering is triggered by typing your abbreviation followed by a dash and four Xs: AAAXXXX where AAA is any alphanumeric value followed by a dash and four Xs.The four Xs are replaced by
the next sequential number when you click Submit.
In the examples above, if you entered WEB-XXXX My New Requirement in the title of the requirement, on Submit, it changes to "WEB-0002 My New Requirement" since 0002 is the next available
sequential number.
Below is an example of an organized set of requirements that also have good naming conventions:
You can reorganize the edit screen by adding custom fields, change the position in which fields appears
on the edit screen, and you can arrange the edit screen in 1 or 2 column formats. You also specify
which fields are shown, required or optional. Customizing the appearance of the Requirements screen
is covered in the Administrators Guide.
You can attach files (like requirement documents, contracts, etc) by editing an item, then clicking the
FILES tab, then clicking Add New. You can keep a running set of notes on an item by editing an item,
then clicking the NOTES tab, then clicking Add New.
Integrating Requirements with Project Management
If you plan to use Project Management, integrate Requirements area with Project Plan Tasks You
may want to define your requirements for your software release, then create a project plan tied to the
release.
To create a project plan, click the Project Management tab.
In the left side on the Releases tab, select your Release.
Switch from the Release tab on the left to the Project Plans tab.
Click Manage Plans, then Add New.
A wizard appears that allows you to pull existing requirements onto a project plan. Once the items
appear on the project plan, you can decompose your requirement into tasks that must be completed
and assign them to the appropriate people, and then link each of the tasks to the requirement:
Once they are linked, you are also able to see this linkage from the requirement itself by editing the
Requirement and clicking the Tasks tab. Below is an example of a requirement that has 3 associated
tasks:
As team members log hours to each task (either from the Task on the Requirement or My Hours from
the Project Management tab), the team member will enter the hours worked and either the estimated
hours remaining or the percentage complete (the other field will be automatically be calculated). Once
this is done, it will update both the project plan and the requirement with the estimated hours, actual
hours, estimated start and finish dates, actual start and finish dates and percentage complete at the
requirement level (the numbers are rolled up). This allows your team to quickly identify the progress
of each requirement and determine variances. Below is how the item looks on the project plan that is
associated with the requirement:
Some charts are drillable. Click the chart to view the details.
To run reports, go to the Reports tab and choose Requirement Reports. You will find the following
reports:
Requirements by Assignee, Project, Status This graphs the requirements by assignee, identifying
how many items are assigned to each team member. You can drill down on the charts and summarized information to view the details of each Requirement. This can be run for a single project or all
projects and can hide closed items if desired.
Requirements by Assignee, Status, Project Similar to the prior report, this one sorts the data by
assignee, status then project and is drillable.
Requirements by Project, Folder, Status Similar to the prior report, this one sorts the data by project, folder and status. If your folders represent releases, this is an easy way to analyze requirements
by software release.
Requirements by Project, Status Similar to the prior report, this one sorts by project and status and
is drillable. When run for all projects, it allows you to compare the number and status of requirements
across all your projects.
In the example above, we can see that we have 13 requirements in the Orders Application, Release 1.0.
Notice that you can show this information across projects, you can filter the data, and you can group it
by any major and minor grouping you desire.
Project Management
Project Management provides a hierarchical features that allow you to manage all software projects
across all teams and obtain visibility and metrics across all your projects. You can use this to track the
status, hours logged, variances and percentage complete of all projects and individual tasks within
each project. You can quickly identify slipping tasks and who is causing the slippage so that you can
give them help before it impacts others.
To create a new project plan, click the Project Management tab and select Project Plans. In the left navigation panel, click Releases and select your Release, then click Project Plans and choose Manage
Plans. From here you can create a project plan from scratch or you can use the wizard to create a project plan from a list of existing requirements, tests and/or defects.
Use the left side Navigation panel to manage and navigate your Project Plans. Select the Hierarchical
View to see the example as pictured. My Tasks displays only your assignments.
Use Manage Security Rights to select the team members for the Project Plan.
On the Hierarchical View, use the green + icon to add new tasks under existing ones or the red X icon to
delete tasks. Use the left and right orange arrows to indent or un-indent tasks. Once a task is entered
with an associated estimated hours and assignee, the estimated finish date is automatically calculated
based on dependencies, and resource availability.
If assigning an item will over-allocate a resource, you will notice a red exclamation icon next to the
assignment. When clicked, this brings up the Resource Availability Report, showing the assignments
for your team members.
To move items from this project plan to another, click the Fast Edit button at the top of the screen. To
add additional Requirements or defects to the project plan, click the ADD WIZARD button from the top
of the screen. You can also use this to create additional tasks based on task template.
Over Allocation
If a Team Members time has been over allocated, you will see the Over Allocation item next to the
Assigned To field. This is calculated by the Team Members Work Time, tasks assigned to the Team
Member, Estimated Start Date and Estimated Hours on the Tasks.
You can also link requirements and defects to an existing project plan from the hierarchical project
plan screen. Once the items appear on the project plan, you can decompose your requirement into
tasks that must be completed and assign them to the appropriate people, and then link each of the
tasks to the requirement.
Once tasks are added to the project plan, the project manager can level resources, set assignment
information, set predecessors, etc.
To set the working hours, billing rates, holidays and vacations for a resource, click the Work Time button at the top of the project plan hierarchical view. You can set up work days, hours, rates, and nonwork days for your team member.
Once tasks are added to the project plan, the project manager can level resources, set assignment
information, set predecessors, etc. As team members work on items associated with the requirement, they can edit the specification, go to the Tasks tab and click My Hours to enter the hours they
worked on the item:
Click Post My Hours and select the Date Worked, Project Plan Task, and enter Hours Worked and
either Hours Remaining or Percent complete.
Based on a Security Group setting, Project Managers can view, edit and post time for team members
from the My Hours link.
After you select a user, you can edit existing Work Hours or post new Work Hours:
Install the plugin: Go to our Downloads Page, and select the plugin for either MS Project 2007 or MS
Project 2010, whichever version is on your desktop.
l
Once installed, open up MS Project, and youll see the Import and Export on the Add Ins tab.
In MS Project, click on Add Ins and select Export to Software Planner. On the Export window, look
for the Settings button.
In the message box, you should see List of projects was loaded successfully.
Close the window with the X in the upper right corner.
Once youve entered your Settings, you can import and export Project Plans.
In MS Project, open a new Project.
Click SoftwarePlanner and select Import Project Plan.
Your Project Plan will be loaded into the current MS Project form, where you can review, edit, or use
any MS Project function and save the Project Plan as an MS Project MPP file.
In MS Project, select the MPP file that youd like to export to ALMComplete.
Click on SoftwarePlanner and select Export Project Plan.
On the Export window, give the Project Plan a new name.
The Owner drop down will display SoftwarePlanner users that have permission to Project Plans. Select
an owner. The Assignee field is optional: use the drop down to select the Assignee for the main Project
Plan.
The table lists the Resource Names on your MS Project file. You can map the Resources to Project Plan
Assignees by selecting the Assignee from the drop down.
If the names match exactly (Sam Smith matches Smith, Sam), this mapping will be done automatically for you. You can make adjustments and change assignees here as needed.
Click Export.
The message box confirms that your Project Plan was created, and it gives you the new Project Plan Id
number.
The next time you log in to ALMComplete and go to the same Project that you selected in the Plugin
Settings, your new Project Plan will appear, ready for you to link up your Requirements, work with
your schedule, and post hours to the Project Plan Tasks.
Drillable Dashboards
Some of the project management dashboards are drillable. Click the chart to drill down into the
details.
On this chart, you can drill down to the Resource Availability Report for a selected user.
You can run this report for any time frame by changing the Date Range. It defaults to starting with
today and ending in 30 days.
The report shows the Team Members normal Work Hours per day, if any Vacation or Holidays are
within the Date Range, total Available hours, how many of those hours are assigned and how many
are still available.
Each day is listed on the report. The date is red for days that the Team Member is over allocated, black
for unassigned or not working, green for properly allocated.
Click on the plus sign to see the details for the day:
The day is expanded to show you what Project, Project Plan, Task, Estimated start and finish dates,
allocated hours, estimated and actual hours. This is reported across Projects so you can see exactly
what the Team Member has been assigned.
Additionally, you can access the following reports by going to the Reports tab / Project Management.
Gantt Chart This report shows the tasks in a graphical format to allow you to determine the dependency between tasks and the progression towards completion. The Gantt chart can be run across projects, for specific project plans and/or assignees and by date range.
Project Plan Task Index Cards Run for a specific release, this returns a quick view of assigned project
plan task in index card format.
Project Profitability Report by Project Plan Assignee (Project Manager) Run for a specific time period,
this report analyzes all completed project plans (percentage complete of 100%) and shows the profitability of each task on the project plan. The profitability is calculated as the external costs minus the
Timesheet reports show who worked on what and are found under Reports / Timesheets.
Timesheets by Project Plan, Week This report shows all timesheets entered for each project plan and
separates them by week. It can be run to begin showing timesheets at any week desired.
Timesheets by Week This report shows all timesheets entered for each week, regardless of what project plan they were applied to. It can be run to begin showing timesheets at any week desired. This
can be used to determine what each individual has worked on for each week.
Variance Reports
You can organize your Agile Tasks in any way you need. For example, you may consider organizing
them by software release and agile sprint, then by product lines, etc.
Posting Time to Agile Tasks
Team members can post hours to Agile Tasks, the same way you can post hours to any other assignment.
Agile Task Dashboards
Agile Task Dashboards allow you to quickly view slipping Agile Tasks.
Slipping Agile Tasks by Assignee (Current Project)
My Slipping Agile Tasks (Active Projects)
Test Library
In Test Management, you can organize your Tests into a Test Library, build Test Sets to run for a
Release, and then run Sets for a Release and Configuration. Dashboards and Reports show you
Requirements Coverage and Test Run status so you know exactly where you are in your test cycle.
Tests in the library can be Manual tests, with details step by step instructions, or Automated tests with
an associated test automation script.
To get started with Test Management, determine the organizational structure for your Test Library,
then build your Tests. The Test Library can include custom fields specific to your needs, plus the standard built in Test fields.
Click on the Test Management Tab, then select Test Library.
In the left side Navigation panel, click the Folders tab to start organizing the folder structure for organizing your Test Library. Your folder structure can represent any logical organization that suits your
style: you may want to organize by application and functional area, type of test (regression, smoke),
etc.
Once you have the folder structure defined, select the desired folder for adding your Tests.
In the Test Library in Test Management, click Add New. The Add Test form opens:
Give the test a Title and complete any required fields and other data. Use the Description or Notes
fields to give additional instructions or information about this test. At the bottom of the Add Test form
On the Steps tab, add each step and expected result that needs to be taken within the Test. Use Tab
to move from Step to Expected Result to the next row. New rows are automatically opened up as you
write your steps.
NOTE: Rich text is disabled by default for Test Steps. You can enable rich text on the Steps in Setup to
provide basic formatting, but rich text is NOT available when editing steps during a test run.
On the Steps tab, you'll see a Test Selection panel on the right. This allows you to select an existing Test
and copy Steps into your new test. Use the Folder and Filter drop downs to navigate to any other Test
that youve created. If you have steps that you need to repeat for many tests, such as a login routine,
this makes it simple to grab and repeat:
You can move the Test Selection panel out of the way by clicking the double-chevron in the light blue
bar.
In the Step Edit area, you can insert a step with the green plus symbol, delete a step with the red X,
and drag and drop steps into the desired order.
The Critical checkbox flags a step as one that must pass in order for the Test to pass. If a Critical step
fails, the entire Test fails.
Adding a test from a recent entry allows you to quickly create a duplicate test, then make any changes
you may need.
In the Test Library in Test Management, click Add New.
At the top of the form is a drop down field for Auto-fill from Recent Entry. Click this drop down to see
Tests that youve recently created. You can select a Test that is close to how you want the new Test
defined. The Auto-fill loads the Tests and Test Step fields on you new test, duplicating the selected
test..
Make your edits to the new Test. When you click Submit, youll see that the Auto-fill has pre-filled the
Steps on the new test copies from the selected Auto-fill test. Make your adjustments and edits, then
Save.
Adding New Tests from Requirements
The Add Test form opens in a new window. The Title and Description are auto-filled from the Requirement.
The new Test is automatically linked to the Requirement, and you can use Submit/Add Another to
keep adding Tests to the Requirement.
After creating Tests through the Requirement, return to Test Management / Test Library to define the
Steps for your tests.
In the Step where the tester needs to enter specific First Names, use:
[?FirstName]
as the new token.
After you define your Steps and Expected Results, click the Token Values tab. This tab provides the ability to upload a CSV file containing the actual values you want to use when running the Test.
About the Token Value CSV File
First row contains TOKEN NAMES (without the square bracket and question mark)
Second and subsequent rows contain the VALUES that will replace the Token Names when running
the test
Example:
To pass values into a test with the three tokens [?FirstName], [?LastName], [?Password] the CSV file
would look like this:
On the Token Values tab, you will see a list of the Tokens found in the Steps on the Test.
This allows you to double check your CSV file to make sure you have covered all the Tokens in the Test.
When you have the correct CSV file, click the Browse button, locate the file and attach it. Then click Submit to save your change.
When uploading your CSV file, the upload verifies that there are no more than 30 Token columns. If
you attempt to upload a CSV file with more than 30 columns, you will see an error. Tokens are limited
to a maximum of 30 per Test.
The Delete button on the Token Values tab will delete the attached CSV file.
You do not need to provide a Token Value CSV File. If the Test Runner does not find the CSV file, or
does not find matching Tokens and Token Values, it simple displays the Token Name, allowing you to
fill in the values as you run the test.
Note: you cannot upload Token files to Automated Tests. Tokens are used for manual testing only.
The import process requires that your test data be in a plain text CSV file. Your file needs a header row
with the column names. The import will match up the column headers to field names, but you can also
change the mapping if required.
The CSV file must be formatted correctly in order to create the appropriate Steps within your Test.
There are two different CSV layouts that can be imported, controlled by a system setting: one where
each row represents a single test, with Steps in one cell, or one where each row represent a step within
a test. The default setting is for one row per step.
If Test Steps are combined in one field, this import profile will identify line breaks in the field and create
separate Steps within the new Tests. If you are exporting Test from the Test Cases tab and importing
into Test Management Test Library, this is the profile for you.
If your CSV file contains multiple steps in one cell, it might look something like this if you open it in a
spreadsheet application:
To import this file into your Test Library, go to Test Management and select Test Library. Click the
Actions drop down and select Import Tests from CSV file.
Browse to your file and click Next Page. If your column headers match Test field names, the import will
map the column to the Field Name. Use the drop down under Field Name to map any columns that
were not automatically recognized. Verify the mapping, then click Import Now.
The import breaks the single Step field into separate Steps.
The default import profile handles CSV files where each Test is represented in multiple rows, one row
for each Test Step within the Test. It is critical that all TEST level details match in order for the import to
recognize that these STEPSbelong together. The import will combine matching TEST data (Test Title,
Test Description, and all other core Test fields) into one Test with multiple steps.
When using Import Profile 2, the import process reads the CSV rows in order. If consecutive rows have
the same Test Title, Test Description, and any other Test level data, the consecutive rows will be rolled
into one Test with multiple Steps.
In this example, weve opened the CSV file in a spreadsheet application. The header row consists of
labels that match the corresponding fields in Tests and Test Steps.
As the import reads this example, it recognizes rows 2 through 8 belong together because the title and
all Test level details EXACTLY match from row to row. The Test related rows are combined into a single
Test, and the Steps are added to the Test.
The rows for each test must be consecutive. The import process goes through the rows in consecutive
order to match up the Tests and the appropriate Steps.
All Test data must match exactly. Any change in Test data (Title, Assigned To, Etc.) tells the import to
create the next Test.
When you select a CSV file to import, verify the fields are mapped the way you need them.
It is possible to switch the default profile if you prefer.Software as a Service customers can request a
change through our Support Team. Simply click on Help Center, then Submit a Support Ticket. Attach
an example of your CSV file so our support team can advise you on the best option.
On-premises customers' Security Administrators can access this without going through support.
Please See "On-Premises Setup Options "
Exporting Tests
When Exporting, use a Filter to select the Tests that youd like to export, or select a specific Folder of
tests. The records selected by the current Filter or in the selected folder will be the records in your
exported CSV or XML file.
Export Tests XML
Export Tests to XML creates an XML formatted document of your test data.
There are two options when exporting Tests to XML format: (visible fields only) and (all fields). Both
exports will include all Step related data for the Test. Export (visible fields only) will include Test related
fields currently displayed on the Test Library Listing. Export (all fields) includes all Test related fields and
all Step related fields.
Export Tests (visible fields only)
Export Tests (visible fields only) creates a CSV file for your test data that includes the columns displayed
on the listing and all Step related data. Each Test is split into multiple rows: one row per Step within the
Test. Test related data is repeated per row. Steps and Expected Results are included.
Export Tests (all fields) creates a CSV file for your test data that includes all Test related data and all
Step related data. Each Test is split into multiple rows: one row per Step within the Test. Test related
data is repeated per row. Step and Expected Results are included.
Test Versioning is controlled by security settings, like any other area. To enable Versioning, go to Setup
/ Security and click Manage Security Rights for the desired Security Group. Scroll down to the Test Management section and check the boxes related to Versioning.
Test Version Triggers
Any change to Steps and Expected Results will trigger a new Version of your Test. You can also flag
other fields to trigger a new Version.
Go to Setup / System Configuration and select Test Versioning (this only appears for users in a Security
Group with full permission to Versioning).
Select the fields that are critical to you and click Submit. Notice that your Test Library Custom Fields are
included in the selection, so if a change to a custom field should trigger a new version, you can select
those fields as well.
Steps and Expected Results do not display on the selectable fields, since changes to Steps and Expected Results always trigger a new version.
In the Test Library, as you edit Tests, any changes to the fields selected in Setup will generate a new version. Versions are automatically numbered in the Version field on the Test.
Go to the Versions tab to view Versions of the test.
On the Versions tab, the current Version is designated with a green arrow.
Should you wish to roll back to a previous version, click the Roll Back icon.
Versions that have never been in a Test Run can be deleted by clicking the red X. The delete option will
not appear if the version has run history behind it.
This example shows two fields with the Show in Run? checkbox checked. The information in these two
fields will display when running your Test.
Note: Once custom fields are defined, they automatically display on the Add/Edit form. Note: The position of the fields can be re-arranged in Setup / System Configuration / Screen Layouts.
Now, when you run the Test, whether from the Test Library or in a Test Set, your selected Custom
Fields display at the top:
For more information on custom fields, See "Customizing the System to Your Needs"
SmartBear's TestComplete. For more information about TestComplete, please see TestComplete by
SmartBear.
SmartBear's Ready! API. For more information about Ready! API, please see Ready! API by
SmartBear.
SmartBear's SoapUI. For more information on SoapUI, please see SoapUI by SmartBear.
Selenium WebDriver for the following unit testing frameworks:
l JUnit
l
TestNG
NUnit
For more information about Selenium, please see Selenium - Web Browser Automation.
You can also automate the running of ordinary JUnit and NUnit unit tests (that do not use Selenium
modules).
Note: Starting with version 10.50, TestComplete supports integration with Selenium tests. In TestComplete, you can run Selenium tests created by using JUnit, TestNG, NUnit, PyUnit, Ruby Test::Unit and
PHPUnit unit testing frameworks.
You can add your Selenium tests to your TestComplete project, and then integrate the project with
Test Management.
In your automated testing tool, create automated tests that will perform the needed actions to test
your application or feature.
Pack your automated test files into a .zip archive. You can store the zipped test on a shared network
folder or web site. You can also upload the files directly to your Tests in the Test Library.
Install and configure Test Agent on the test lab computers that will run your automated tests.
In Test Management, associate your automated tests with Tests in the Test Library, whether pointing to the shared drive or uploading directly to the Test Library tests.
In Test Management, you can also create Automation Schedules to run the automated tests on a
desired schedule, or submit the Tests to run on demand.
When the Automated Tests run, the Test Agent on the Test Host:
l Connects to the ALMComplete|QAComplete web service.
l
Important: The Test Agent can be set to log off of Windows on the Host machine. This effectively
closes any open applications, logs out, then logs back in with the credentials from the Test Agent
configuration. There is an option on the configuration form to first check if that user is currently
logged in, and avoid the log out process.
l
After the test run is complete, results are posted to the Test and/or Test Sets in Test Management.
You can review the results on the Test Management Dashboards and in reports.
SoapUI by SmartBear.
TestNG
NUnit
The Test Agent needs to be installed and configured on each computer that will run automated tests
so that results are posted to Test Management. The Agent is also used for scheduled automation runs.
When you install the Test Agent on a Host machine, the Agent will automatically create a Test Host
record in Test Management.
Note: You can also use Selenium Test Agents to automate running of ordinary unit tests (that do not
use Selenium modules) created with JUnit, TestNG and NUnit unit testing frameworks.
Requirements
To install the Test Agent, your test machine must meet the following requirements:
l
Appropriate Java unit testing framework, JUnit or TestNG, installed and configured.
To run Selenium automated web tests created with an appropriate Java unit framework:
l Selenium WebDriver modules installed and configured in your JUnit or TestNG framework.
If you want to use Maven to run tests:
l Maven 3.2.3 or later modules installed and configured.
l
The PATH environment variable on the test machine must specify the path to the Maven
modules.
To register the Test Agent on a computer, do not use an account with Active Directory Authentication.
Use a non-Active Directory user account.
You can enable and disable Active Directory Authentication for a user in Setup | Security | Users in
ALMComplete|QAComplete.
Default Ports
By default, the ports used by the Test Agent and related processes are:
l
Download the Agent installation file from our web site: Test Management - Test Agent
(You can also download the agent from Test Management / Test Hosts from the Download Test
Agent link in the light blue toolbar.)
In the User and Password text boxes, enter the email address and the password that will be used to
log in to ALMComplete|QAComplete account.
Note For On-Premises Only: You cannot register the Test Agent with an account that uses Active Directory Authentication. Register the Test Agent using a non-Active Directory account.
Click Next to continue.
If the specified ALM|QAComplete account belongs to multiple departments (that is, this user sees a
list of departments when logging in), the Select Department page appears. Select the department
whose tests you want to run on this computer and click Next.
On the Logon page of the installation wizard, enter the credentials of the user that will run your automated tests on this machine.
l In the User Name and Password text boxes, enter the name and the password of the user
account.
Click Next to complete the installation.
Once you install Test Agent on your test computer, the Agent will automatically create a Test Host
record in ALMComplete|QAComplete's Test Management.
Configuring the Test Agent
Once the Test Agent is installed on your test computer, you can check or modify the Agent configuration.
For On-Premises customers, the address must point to the Agent on your server
l http://[your server name]/rest-api/service
To change the ALM|QAComplete login credentials, click Change and enter the email address and
password to use to log in to your ALMComplete|QAComplete account. Note: for security purposes,
when you click Change, you must enter new credentials.
Click Submit.
Note: If the specified ALM|QAComplete account belongs to multiple departments, you will be
prompted to select a department to use this computer with.
Set the Use active session option by checking or unchecking the box.
l If checked: the Test Agent will check if the Local User is currently logged in to the Host machine.
If so, it will not perform the logout process. If this user is not logged in, the Agent will close any
open applications, log out of the Host machine, log in as the user specified here, run the test,
and log out.
l
If not checked: the Test Agent will always close open applications on the Host machine, log out,
log in, run the test, and log out.
Configuring Test Agent to Run Selenium and Unit Tests with JUnit and TestNG
l To set paths needed to run tests with Java unit testing frameworks, click Advanced Settings.
l
In the Advanced Settings dialog, enter the path to the Java Runtime executable (java.exe).
For example, if you have several Java versions installed, specify the path to the Java Runtime version
you will use to run tests.
In the Java Class Path field, enter the path to the required framework library (junit-n.nn.jar or
testng-n.n.n.jar). (You can skip this step if you are going to use Maven to run tests).
Click OK to save your changes.
Configuring Test Agent to Run Selenium and Unit Tests with NUnit
l To set the path needed to run tests with NUnit testing framework, click Advanced Settings.
l
In the Advanced Settings dialog, enter the path to the NUnit executable (nunit-console.exe).
In the Advanced Settings dialog, enter the path to the test runner tool (testrunner.bat) that is
installed with Ready!API or SoapUI.
By default, Test Agent will search for the test runner tool in the folder where Ready! API/SoapUI is
installed.
Click OK to save the changes.
Click the drop down in Select Item Title and check the Configurations that you want associated with
the Test Host.
If you run your TestComplete automated tests on a virtual machine, we recommend that you disable
automatic log opening after test runs to improve performance.
l
If you have TestComplete, select Tools | Options from the main menu.
If you have TestExecute, right-click the TestExecute icon in the notification area and select Options.
Clear the Activate after test run check box and click OK.
TestComplete Tests
When you associate an automated (or unit) test with the Test, Test Management automatically recognizes that the Test is Automated and selects the Automated check box. You can use the choice list for
Execution Type to also designate a test as Automated, or modify the Execution Type choice list values
for anything that is meaningful to you.
Note: When running Automated Tests, any Steps that may be on the Test are ignored.
To run your Automated Test on demand, please see "Running Automated Tests".
To Schedule your Automated Test to run automatically, please see "Scheduling Automated Tests".
Create and organize test items that will run those tests.
If needed, zip up your TestComplete project suite. Include all files and folders that belong to the project suite.
Make note of where the project suite or the archive (zip) file resides.
You can place the project suite or the archive on a local folder on the test host where it will run or in
a shared network folder. Make sure that the project suite can access all need test files.
Alternatively, you can upload the archive to the server (see below).
In Test Library, open an existing Test for the TestComplete project suite or add a new Test.
Select a Default Host Name. If you skip this step, after you assign an automated test and click Submit, the system will remind you that the Test Host is missing.
Save the changes.
You can leave the Title blank, and the system will use the name of the specified TestComplete file, or
you can enter a meaningful Title.
Enter a time out value in seconds. If the test takes longer than the given time out, the test runner
will stop running.
l The Test Runner passes the timeout value to TestComplete/TestExecute as a run parameter.
The minimum value is 30 seconds: if you specify a lower value, it still uses 30 seconds. If the test
takes longer than the specified time out, it will log an error and end. For more information
about how TestComplete uses the time out, please see http://support.smartbear.com/viewarticle/55587/.
In Url, UNC or local path, enter the path to your TestComplete project suite or to the archive
(zip) that contains the project suite.
The path format depends on the project suite location. Below are examples of possible values:
Description
C:\MyTests\MyProjectSuite.pjs
-- or -file:///C:\MyTests\MyProjectSuite.pjs
C:\MyTests\
-- or -file:///C:\MyTests\
C:\MyTests\MyProjectSuite.zip
-- or -file:///C:\MyTests\MyProjectSuite.zip
\\Tests-PC\SharedFolder\MyProjectSuite.pjs
-- or -file:///Tests-PC\SharedFolder\MyProjectSuite.pjs
\\Tests-PC\SharedFolder\
-- or -file:///Tests-PC\SharedFolder\
\\Tests-PC\SharedFolder\MyProjectSuite.zip
-- or -file:///Tests-PC\SharedFolder\MyProjectSuite.zip
Or, simply use File Attachments to upload the archive (zip) file that contains the project suite. Click
Browse and navigate to the zipped file.
The Run Mode specifies how the test agent will get your TestComplete test files and run the test.
l To copy test files to the test host and run the test in a temporary folder there, choose Copy the
test project to and run it in a temporary folder in the Run Mode drop-down list.
If Url, UNC or local path specifies the UNC path to a project suite file (.pjs), all the contents of
the folder where the project suite file resides will be copied to the test host.
To run the test directly in the folder where the test files reside, choose Run the test project in
place (if possible) from the Run Mode drop-down list. If the test files reside in a shared network folder or in a local folder on the test host, the test agent will run the test directly in that
folder.
The Entry Point is used if you want to run a portion of your TestComplete project suite:
l To run the entire project suite, leave Entry Point blank.
l
To run a specific project within the project suite, enter the project name.
To run a specific keyword test, script or project item, enter the path to the item.
Description
(no value)
TestProject1
Click Submit.
Launch the Test Agent Settings tool (Start | All Programs | SmartBear | TestAgent | Test Agent Settings).
Click Advanced Settings.
If needed, specify the path to the test runner tool (testrunner.bat) that will run the API tests.
The tool is installed with Ready! API or SoapUI and resides in the folder where Ready! API or SoapUI
is installed.
In Test Library, open an existing Test for the Ready! API or SoapUI test or add a new Test.
Select a Default Host Name. If you skip this step, after you assign an automated test and click Submit, the system will remind you that the Test Host is missing.
Save the changes.
Enter a time out value in seconds. If the test takes longer than the given time out, the test runner
will stop running.
To run a specific test suite in your project, enter its name in Test Suite. For example, Simple
TestSuite.
To run a specific test case in your project, enter its name in Test Case. For example, Search
TestCase.
In Report Type, choose the format for exporting the test results report.
In Custom Args, enter additional command line arguments to pass to the testrunner tool that will
run your test. You can find information on command line arguments in the Ready! API or SoapUI
documentation.
In Url, UNC or local path, enter the path to your Ready! API or SoapUI project (.xml) or to the
archive (.zip) that contains your project.
Below are examples of possible paths:
Value
Description
C:\MyTests\MySOAPProject.xml
-- or -file:///C:\MyTests\MySOAPProject.xml
C:\MyTests\
-- or -file:///C:\MyTests\
C:\My Tests\MySOAPProject.zip
-- or -file:///C:\My Tests\MySOAPProject.zip
\\Tests-PC\SharedFolder\MySOAPProject.xml
-- or -file:///Tests-PC\SharedFolder\MySOAPProject.xml
\\Tests-PC\SharedFolder\
-- or -file:///Tests-PC\SharedFolder\
Description
occur.
\\Tests-PC\SharedFolder\MySOAPProject.zip
-- or -file:///Tests-PC\SharedFolder\MySOAPProject.zip
Or, simply upload your project or zipped file using File Attachments. Click Browse and navigate to
the desired file.
The Run Mode specifies how the test agent will get your test files and run the test.
l To copy test files to the test host and run the test in a temporary folder there, choose Copy the
test project to and run it in a temporary folder in the Run Mode drop-down list.
l
To run the test directly in the folder where the test files reside, choose Run the test project in
place (if possible) from the Run Mode drop-down list. If the test files reside in a shared network folder or in a local folder on the test host, the test agent will run the test directly in that
folder.
Click Submit.
Important: You can use JUnit (Selenium) Test Agent to automate running of both Selenium JUnit tests
and ordinary JUnit unit tests that do not use Selenium modules. The procedure of assigning tests to
Test Library Tests is the same for both test types.
This instruction demonstrates how to assign a Selenium JUnit tests to a Test Library Test. Use the same
procedure to assign an ordinary JUnit unit test to a Test.
1. Configure the Test Agent
Launch the Test Agent Settings tool (Start | All Programs | SmartBear | TestAgent | Test Agent Settings).
Click Advanced Settings.
If needed, specify the path to the Java Runtime executable (java.exe). For example, if you have several Java versions installed, specify the path to the Java Runtime version you will use to run tests.
Specify the path to the junit-n.nn.jar file location (you can skip this step if you use Maven to run
tests).
If needed, zip up the folder where your Selenium WebDriver tests created with JUnit reside.
Make note of where the test files or archive (zip) file reside.
You can place the test files (or the zip file that contains the test files) in a local folder on the test host
where the tests will run or in a shared network folder.
Alternatively, you can upload the archive file to the server (see below).
In Test Library, open an existing Test for the Selenium WebDriver test or add a new Test.
Select a Default Host Name. If you skip this step, after you assign an automated test and click Submit, the system will remind you that the Test Host is missing.
Save the changes.
You can leave the Title blank, and the system will use the name of the attached Selenium test, or
you can enter a meaningful Title.
The Timeout tells the Test Runner how long to let the test run. Enter the time out value in seconds.
If the test takes longer than the given time out, the test runner will stop running.
In Url, UNC or local path, enter the path to the folder where your Selenium WebDriver test files
reside or to the archive (.zip) that contains the test files.
Below are examples of possible paths:
Value
Description
C:\MyJUnitTests\
-- or -file:///C:\MyJUNitTests\
C:\MyJUnitTests\MyJUnitTest.zip
-- or -file:///C:\MyJUnitTests\MyJUnitTest.zip
\\Tests-PC\SharedFolder\
-- or -file:///Tests-PC\SharedFolder\
\\Tests-PC\SharedFolder\MyJUnitTest.zip
-- or -file:///Tests-PC\SharedFolder\MyJUnitTest.zip
Alternately, upload your zipped file using File Attachments. Click Browse and navigate to the zipped
test files.
The Run Mode specifies how the test agent will get your test files and run the test.
l To copy test files to the test host and run the test in a temporary folder there, choose Copy the
test project to and run it in a temporary folder in the Run Mode drop-down list.
l
To run the test directly in the folder where the test files reside, choose Run the test project in
place (if possible) from the Run Mode drop-down list. If the test files reside in a shared network folder or in a local folder on the test host, the test agent will run the test directly in that
folder.
If you want to run your Selenium test by using Maven, select Use Maven Project.
Important: You can use TestNG (Selenium) Test Agent to automate running of both Selenium TestNG
tests and ordinary TestNG unit tests that do not use Selenium modules. The procedure of assigning
tests to Test Library Tests is the same for both test types.
This instruction demonstrates how to assign a Selenium TestNG tests to a Test Library Test. Use the
same procedure to assign an ordinary TestNG unit test to a Test.
1. Configure the Test Agent
Launch the Test Agent Settings tool (Start | All Programs | SmartBear | TestAgent | Test Agent Settings).
Click Advanced Settings.
If needed, specify the path to the Java Runtime executable (java.exe). For example, if you have several Java versions installed, specify the path to the Java Runtime version you will use to run tests.
Specify the path to the testng-n.n.n.jar file location (you can skip this step if you will use Maven to
run tests).
If needed, zip up the folder where your Selenium WebDriver tests created with TestNG reside.
Make note of where the test files or the archive (zip) file reside.
You can place the test files or the archive file on a local folder on the test host where the tests will
run or in a shared network folder.
Alternatively, you can upload the archive to the server (see below).
In Test Library, open an existing Test for the Selenium WebDriver test or add a new Test.
Select a Default Host Name. If you skip this step, after you assign an automated test and click Submit, the system will remind you that the Test Host is missing.
Save the changes.
Description
C:\MyTestNGTests\
-- or -file:///C:\MyTestNGTests\
C:\MyJUnitTests\MyTestNGTest.zip
Description
-- or -file:///C:\MyJUnitTests\MyTestNGTest.zip
\\Tests-PC\SharedFolder\
-- or -file:///Tests-PC\SharedFolder\
\Tests-PC\SharedFolder\MyTestNGTest.zip
-- or -file:///Tests-PC\SharedFolder\MyTestNGTest.zip
Alternately, upload your zipped file using File Attachments. Click Browse and navigate to the zipped
test files.
The Run Mode specifies how the test agent will get your test files and run the test.
l To copy test files to the test host and run the test in a temporary folder there, choose Copy the
test project to and run it in a temporary folder in the Run Mode drop-down list.
l
To run the test directly in the folder where the test files reside, choose Run the test project in
place (if possible) from the Run Mode drop-down list. If the test files reside in a shared network folder or in a local folder on the test host, the test agent will run the test directly in that
folder.
If you want to run your test by using Maven, select Use Maven Project.
Enter the test case class name in Test Class.
If you use Maven to run tests, you can leave the field empty to run all test cases defined in your Selenium test.
Click Submit.
Important: You can use NUnit (Selenium) Test Agent to automate running of both Selenium NUnit
tests and ordinary NUnit unit tests that do not use Selenium modules. The procedure of assigning
tests to Test Library Tests is the same for both test types.
This instruction demonstrates how to assign a Selenium NUnit tests to a Test Library Test. Use the
same procedure to assign an ordinary NUnit unit test to a Test.
Launch the Test Agent Settings tool (Start | All Programs | SmartBear | TestAgent | Test Agent Settings).
If needed, zip up your Selenium NUnit test project (together will all libraries and files the project
uses).
Make note of where the project or the archive (zip file) resides.
You can place the project (or the zip file containing the project) on a local folder on the test host
where it will run or in a shared network folder. Make sure that the project can access all need test
files.
Alternatively, you can upload the archive file to the server (see below).
In Test Library, open an existing Test for the NUnit test or add a new Test.
Select a Default Host Name. If you skip this step, after you assign an automated test and click Submit, the system will remind you that the Test Host is missing.
Save the changes.
Description
The NUnit project (.nunit) residing in
the local folder on the test host.
Description
C:\MyTests\
-- or -file:///C:\MyTests\
C:\MyTests\MyNUnitTest.zip
-- or -file:///C:\MyTests\MyNUnitTest.zip
\\Tests-PC\SharedFolder\MyNUnitTest.nunit
The NUnit project (.nunit) residing in a
-- or -shared folder on a computer in your
file:///Tests-PC\SharedFolder\MyNUnitTest.nunit network.
\\Tests-PC\SharedFolder\
-- or -file:///Tests-PC\SharedFolder\
\\Tests-PC\SharedFolder\MyNUnitTest.zip
-- or -file:///Tests-PC\SharedFolder\MyNUnitTest.zip
Alternately, upload your zipped files using File Attachments. Click Browse and navigate to the
zipped Selenium test files.
The Run Mode specifies how the test agent will get your Selenium test files and run the test.
l To copy test files to the test host and run the test in a temporary folder there, choose Copy the
test project to and run it in a temporary folder in the Run Mode drop-down list.
l
To run the test directly in the folder where the test files reside, choose Run the test project in
place (if possible) from the Run Mode drop-down list. If the test files reside in a shared network folder or in a local folder on the test host, the test agent will run the test directly in that
folder.
To run a specific test case, test fixture or a namespace, enter its full name in Test Case, Test Fixture
or Namespace.
Click Submit.
You can configure Automated Tests or Test Sets to run independently of any user interaction by putting them on a Test Schedule. The Schedule can be a one-time scheduled run, or it can be a recurring
schedule repeated on specific days of the week.
In Test Management, click Test Schedules.
On the Test Schedules listing form, click Add New to create a new schedule.
On the Add Test Schedule form, enter the information for the new schedule.
l
In Run On, choose the days of the week to run the Automated Test.
In Start Time, select the hour of the day when you want the Automated Test to run.
Use the Start Date and End Date to define the date range that the schedule will be active. The schedule won't run until your start date, then will run as scheduled until the end date.
In the Agent list, select an automated testing tool you want to use to run tests:
l TestComplete/TestExecute
l
Ready! API/SoapUI
JUnit (Selenium)
TestNG (Selenium)
NUnit (Selenium)
In the Hosts list, select the Test Host that will run the automated test. The list is populated with the
machines where the Test Agent is installed and running. For more information on Test Agents and
Hosts, please see "About Test Hosts" and "The Test Agent".
In Items to Run, link your Automated Tests or Test Sets. These Tests or Test Sets will run on the Test
Host in the order of selection.
Click Submit to save the schedule. At the scheduled time, the Test Agent will kick off the associated
Test or Test Set on the Test Host selected for the Schedule.
Note: If the Tests are associated with a Test Host, the Host on the Schedule takes precedence: your
test run on the Test Host on the Schedule, not the Host associated with the Test in the Test Library.
Test Sets
Use Test Sets to organize Tests from the library into groups of tests in preparation for the Test Run.
Once you have your Tests defined in the library and your Configurations defined, start building your
Test Sets.
In Test Management, click Test Sets in the dark blue toolbar. On the left navigation panel, select the
Release and Sprint for the Test Sets. Once you select a Release, the items you build will automatically
be associated with that Release.
If you selected a Folder on the Folder Tab in the left navigation panel, the Test Set will not only be automatically linked up to the selected Release, but it will be stored in the selected Folder. Create a Title,
select a Status and enter a description for your Test Set.
If the Tests in this set MUST be run in sequential order, check the Check if all tests in this set must be
run in sequential order checkbox. This forces the Test Runner to only process the tests in the defined
order.
When you scroll to the bottom of the Add form, youll notice the link to the selected Release is automatically created.
Click Submit.
Now you have a form where you select and sequence the Tests that belong in this Test Set. On the
right, use the Folder and Filter drop downs to navigate to the desired Tests, then drag and drop them
into the Test Set.
You can re-sequence the tests, remove them with the unlink icon, and mark them as critical with the
Stop on Failure checkbox. If this box is checked and the test fails during a run, the rest of the tests will
be Blocked. The "Is Active" checkbox allows you to temporarily exclude a Test from being included
when running the Test Set.
Make your selections, Close and then Submit. Your selected items will be linked to the Test Set.
Once linked, you can run the Test Set against any linked Release using any linked Configuration
NOTE: If the Test Set has an incomplete Run pending, the Tests in the open Run are not changed.
Changes to the Test Set will be in effect for the next Test Set Run.
After clicking Add or Edit Tests, you can make changes to the sequence, add or remove Test from the
Set, and modify the Assignee on the Test within the Set.
The Assigned To is informational only. Actually, any of your Team Members with permission to Test
Sets can run all of the Tests within the Set. The Test Runner will record the person who actually ran the
Test.
Configurations
You may need to repeat the exact same test or test set under various configurations. For example, if
building a web application, you will want to repeat your tests using different browsers. Desktop applications may need to be tested under several different operating systems, or it may be a combination of
both.
Use Configurations to define the variety of environments you will use to repeat your testing.
On the Test Management tab, select Configurations in the dark blue task bar. Notice that Configurations are independent of Releases.
Running Tests
You can run Tests directly from the Test Library, or your Test Sets.
If running a single Test directly from the Test Library is allowed, you will see a Run Now icon in the
Actions column.
The Test Runner window opens up.
On the list of Test Sets, there is a blue Run Now icon. When you click Run Now, the Test Runner grabs a
snapshot of the Tests in the Set and prepares the Test Run.
The Test Runner opens up in a new, sizeable window.
Select the Release first. If the Test Set is linked to Configurations, check the boxes for the desired Configurations.
Click Run to start the Test Runner.
If the Test Set is associated with only one or no Release and Configuration, it will skip this step and
continue to the Test Runner.
If the Test Set is linked to multiple configurations, you can select on or more. The Test Runner will open
a separate window for each configuration.
Note: The Test Runner takes a 'snapshot' of the Tests and Test Sets as they exist when you hit Run.
This means if you edit the Test or Test Set after starting a run - but not finishing the run - the active run
When you run a Manual Test or Test Set, you will see the Test in the Test Runner form. Tests in a Set
are in sequential order.
The Assigned To column is a drop down choice list of team members that can be changed.
Note: When you start a Test Run, the Test Runner takes a snapshot of the tests within the run. Should
another team member change any test included in the run, the new changes do not affect the run in
progress.
When you start your first Test in the Set, the Runner starts a timer to track the time it takes to run
each test. This becomes part of the test run history. The Test Set Progress bar shows the percent complete for the tests within the test set. The Pause button at the bottom allows you to stop and restart
the timer.
Recording Actual Results
As you progress through each Step on the Tests, enter your Actual Results. Each step has a pass icon
and a fail icon so you can pass / fail as you proceed through each step.
Once the steps are completed, click Next Test to continue to the next Test in the Test Run or to complete the run.
Pausing a Test Run
You can Pause the test run, which allows you to continue at a later time or hand the run to another
team member to complete.
To Pause the run, click the End Run button. The End Run dialog appears.
IMPORTANT: If you select any of the END options on the End Run form, the test run is COMPLETED.
The test history will reflect your selection: End as Passed marks any test not yet touched as Passed,
End as Failed marks any tests not yet run as Failed, End as Incomplete marks the Tests Incomplete.
This effectively FINISHES the run of this Test Set. Use this with caution.
Use the PAUSE options if you will be completing this test at another time.
l
Pause - The Test Set Run is Paused and Last Run Status on the Set is In Progress. You can continue
the Test Set Run from the Test Set / Run History tab.
Pause and mark Blocked - The Test Set Run is paused and Last Run Status on the Set is Blocked.
Steps that are not passed or failed are marked Awaiting Run. Tests that are incomplete are marked
Blocked. You can continue the Test Set Run from the Test Set / Run History tab.
End as Passed The Test Set Run is ended. Any Tests that were not run are marked Passed in the
Run History. The Last Run Status on the Test Run depends on the status of the individual tests: if all
Pass, the Test Run is passed; if any Fail, the Test Run is Failed.
End as Failed The Test Set Run is ended. Any Tests that were not run are marked Failed in the Run
History. The Test Run is Failed
End as Incomplete The Test Set Run is ended. The Last Run Status on the set is Incomplete. Any
Tests that were not run are marked Skipped in the Run History.
If you ended a test run and marked it either Paused or Paused and Blocked, you or another team member can continue the run from the Test Set - Run History tab. On the Test Listing grid, click the number
in the Run History column to go directly to the Run History tab on the set. If the Test Run can be continued, you will see the Run Now icon.
Continue by clicking the Run Test icon for the Test on the Run History tab.
Automatically Creating a Defect from a Failed Test
When a Test Step in the Test Run is failed, you have the option to automatically create a linked Defect.
If you failed any step, when you click Next Test, the Auto Create Defect dialog appears.
Click Yes to automatically generate a new Defect. The new Defect opens up in an Add Defect form. You
can make changes to the Defect so that all details are ready for your team to address.
Steps to Reproduce on the Defect will default to the Step, Step Status and Expected Result of the Steps
within the failed Test.
At the bottom of the Add Defect form, youll see that Auto Create Defect has also automatically linked
this Defect to the Test, the Test Set, and the Release.
Click Submit when the Defect is complete. If you need to create multiple defects linked to the Test Set,
click Submit and Add Another. Each Defect created will be automatically linked.
Editing Test Steps During a Test Run
Based on a security setting, you may be able to edit the test steps during a test run.
If your security group does not have permission to edit tests during a run, the test runner does not display the editing icons:
Team members with permission to edit steps during the run will see an Actions column:
Use the Actions column to make changes on the fly to the steps in the run. Click the edit icon, and the
step opens in an Edit Step window.
You can make adjustments to the Step and Expected result and click OK.
If you made changes to the Steps, you can push your changes to the Test in the Test Library. When
you click Next Test, a dialog pops up asking Do you want to update the Test Library with your
changes?
Click Yes, and the changes you made will be made to the original Test in the Test Library. Click No, and
the changes you made are recorded as part of this test run only and will not affect the original Test.
NOTE: Rich text is not available when editing Test Steps during a Test Run. If you use any formatting in
Steps, consider carefully if you want to update the library: you will lose the formatting.
The Test is duplicated within the Test Runner for each row of values found in the associated Token
Value CSV file. In this example, we have four user log ins that we want to test.
Click the Run icon on the first test.
Step through your Test Run, posting your Pass/Fail and actual Results. When you click Next Test, the
next test will display the values from the next row in your Token Value CSV file.
Missing Token Values
If your Test has Tokens defined in the Steps or Expected Results, but you do not have a Token Value
CSV file attached, you can still run the Test.
Instead of replacing the Token Names with values, you will see the formatted Token Names during the
Test Run. It is up to you to edit the Test Step and manually enter the desired Value as you run the test.
Note: Tokenized Tests can be edited during the Test Run, but changes will NOT be updated to the Test
Library.
If a Tokenized Test is missing a CSV file, or if the CSV file is missing values for Token Names, this does
not prevent you from adding the Test to a Set and running the Test. We recommend you edit the
Steps during the run to document the values used at run time.
Only one Token Value CSV file can be attached to a Test. You can remove the CSV file from the Token
Values tab and re-upload if changes need to be made.
TokenNames must be plain alpha/numeric text only (no punctuation, no extended characters).
If any Step or Expected Result on a Test has a TokenName (in the format [?tokenname]), the test is
flagged as a Tokenized Test in a system controlled checkbox field called Is Tokenized?. This allows you
to filter and sort for Tokenized Tests in the Test Library.
To run the Test as part of a Test Set, create a Test Set and add your automated Test to the Set. Click
the Run button in the Actions column on the Test Set List.
l The Test Set can be linked to your Release, Iteration or Build.
To run the Test independently of a Test Set, you can click the Run button in the Actions column on
the Test Library List.
l A Test can also be linked to a Release, Iteration or Build.
The Test Runner window opens. If the Test or Test Set is linked to a Release, select the desired Release
First. Select the Test Host in the Run By Host drop down, and click Run.
Your tests will run immediately on the associated Test Host. The Test Agent on the selected Test Host
will perform the following steps:
l
Start the appropriate automated testing tool (TestComplete/TestExecute, Ready! API, SoapUI or a
unit testing framework).
Run the automated test.
When complete, the results are posted as Run Results to the Test and/or Test Set.
Important Notes:
l
If you assign TestComplete automated tests to your Tests in Test Management, TestComplete or
TestExecute must NOT be actively running on the Test Host when the Automated Test is run. Otherwise, the test will return an error. TestComplete/TestExecute will be automatically started up by the
test runner.
If the required testing tool is not installed on the Test Host or the Test Agent is not configured properly to run that testing tool, the test will fail.
If your Test Host has an earlier version of Test Agent that does not support the assigned automated
test, the test will not run.
The Test Agent can be set to log off of Windows on the Host machine. This effectively closes any
open applications, logs out, then logs back in with the credentials from the Test Agent configuration.
There is an option on the configuration form to first check if that user is currently logged in, and
avoid the log out process.
From here, you can drill into the details of each Test Run. Click the Printer Friendly icon to view a printable format of the run history. Click the View Run icon to see a read-only version of the Test Runner,
where you can drill into each Test in the run and into the Test Steps to view results.
When you delete Test Run History, the deletion will clean up and recalculate the Average Run Time for
the tests and test sets involved. If you are deleting the most recent run for a Test Set, it will also clean
up the Last Run information on the Set and on the Tests.
Run History from the Test Library
To drill into Run History for a specific Test, you can go to the Test Library, open the Test in Edit mode,
then click the Run History tab. Click the Printer Friendly icon to view a printable format of the run history. Click the View Run icon to bring up read-only version of the Test Runner. If the Test was run as
part of a Test Set, you'll see the full view of the Test Set, where you can drill into each Test in the run
and into the Test Steps to view results.
If you use TestComplete, Ready! API or SoapUI to run automated tests, the test runner will post the
appropriate log file. Open the attached log file or download the file and view the detailed test results.
If you use NUnit to run Selenium automated tests or unit tests, the test runner will post NUnit test
project log file. Download the file and view test results on your computer.
If your Selenium automated test or unit test fails, the test runner will post the console output of the
appropriate unit testing framework (JUnit, TestNG or NUnit) as Test Step Results.
Test Library dashboards can be selected by Filter and Folder or Filter and Release.
Test Library by Assignee - Shows status of Tests in the Test Library, grouped by assignee.
Requirement Test Coverage - Shows information on Tests grouped by the associated Requirements
Tests by Last Run Status (Current Project) - Shows last run result of tests in the test library.
Some charts are drillable - click on the chart to drill into additional details:
Test Runs by Test Set - Shows results of all test set runs.
Test Runs by Configuration - Shows results of test set runs grouped by configuration to which the
test set is linked.
l Note: If you want results of your automated tests to be included into this chart, link hosts
where your automated tests run to appropriate configurations.
Test Runs by Requirements - Shows results of test set runs grouped by requirements to which the
test sets are linked.
Test Runs by Assignee - Shows results of test set runs grouped by users to whom the test sets are
assigned.
Test Library Report: Filter and sort your Test Library, drilling all the way into the Steps. Use Linked
items to review what items are associated with your Tests.
Test Runs Report: Filter and sort Test Run History, drilling all the way into the detailed step run results.
Test Sets Report: Filter and sort Test Sets, and drill all the way into the Tests associated with the Set,
the Test Steps, and Last Run results.
Automated Test Runs - This run is used by the legacy Test Automation system and does not apply to
the new Integration in Release 9.9.0.
Number of Test Steps by Test Set - Display summary information on the number of steps in each
test and test set.
Number of Test Steps Run by Test Set - Display summary information on passed and failed steps in
each test set.
Requirements Missing Tests Lists requirement with no associated tests
Requirements Traceability Matrix Analyzes coverage for requirements showing associated tests
and defects.
Test Coverage Run Details by Configuration Analyzes test run status by configuration with drill
down details.
Test Run Coverage Details by Test Set Analyzes test runs by test set.
Test Coverage Run Summary by Configuration Returns a summary of test run results by release,
configuration and test set.
Test Coverage Run Summary by Requirement Returns a summary of test run results by release,
requirement, test set and configuration.
Test Coverage Run Summary by Test Set Returns a summary of test run results by release, test set
and configuration.
Test Library Detail by Assignee Analyzes tests in the test library by assignee, returning design
status, associated runs and requirements.
Test Library Last Run Status by Requirement - Shows Requirement Folder, Requirement, Linked
Tests and the most recent run status for the Tests
Test Run History by Test Set Shows Test Set folder, Test Set, Configuration, Date Run and run
information for the Test in the Set. History is listed with most recent run first.
Column
Actions
Assigned To
Attachments
and Notes
Avg Run
Time
Date Created
Date Last
Escalated
Date Last
Run
Date
Updated
Execution
Type
Folder Name
ID
Import Id
Tokenized
Iteration
Description
Actions you can perform on a Test
Team member assigned to the Test
Navigate directly to the Attachments or Notes tab of the Test
Average time it's taken to run the Test, based on Test Run History
Date the Test was created
Date that an Escalation Rule last touched the Test
Date of the most recent Run for the Test
Date the test was last Updated
Execution Type for this Test. Execution Types are defined under Choice Lists
Folder/subfolder where the test resides.
Unique Identifier for the Test
If the Test was imported from a CSV file, this identifies all Tests imported at the same time
from the same CSVfile.
Indicates if the Test is includes parameters (tokens). See ""
If the Test includes a token file, this is the number of iterations of the test based on the valPage 245 of 299
2015 SmartBear Software, All Rights Reserved. Visit us at www.smartbear.com
Description
Count
ues in the file.
Last EscalThe name of the Escalation Rule that most recently touched the Test.
ation Rule
Last Run By Team member that last executed the Test
Last Run Con- The configuration used with the last execution of the Test
fig
Last Run
Release/Iteration/Build used with the last execution of the Test
Release
Last Run
Status of the last execution of the Test (Pass/Fail)
Status
Last Run Test If the Test was run as part of a Test Set, the name of the last Test Set used when executing
Set
the Test
Nbr EscalNumber of times an Escalation rule has touched the Test
ations
Owner
Team member who owns the Test (typically the person who created the Test)
Priority
Priority of the Test. Priorities are defined under Choice Lists
Status
Status of the Test. Status values are defined under Choice Lists
Automated Indicates that the Test is associated with a TestComplete, Ready! API, SoapUI, Selenium,
or unit test, and is automated. See: See "Creating Automated Tests"
Active Test Indicates if this is an Active or Disabled Test. Inactive Tests will not be run.
Test Type
Test Type. Values are defined under Choice Lists
Title
Short descriptive name of the Test
Token File
Name of the Token CSV file associated with the Test
Title
Updated By Team member who last updated the Test
Version
Current Version of the Test. See "About Test Versioning"
On the Add Test screen, specify the test parameters and click Submit.
On the Edit Test screen, specify other information on the test, for example, create test steps or
assign an automation to the test, and click Save.
On the Edit Test screen, make the desired modifications to the test.
Click Save.
Running Tests
To run an individual test without adding it to a test set:
l
Find the test you want to run and click the button in the Actions column.
Specify the new test set parameters in the Add Test Set window and click Submit.
Select Import Tests from CSV file from the Actions menu.
On the Import Wizard screen, click Browse and browse for the CSV file that stored the data.
On the next page of the wizard, you map data in the source file to the appropriate columns in the
Test Library listing screen.
Check that all columns are mapped correctly, then click Import Now.
Important: To import tests into your Test Library, format your source CSV file in a special way. To learn
more about it, see See "Importing and Exporting Tests"
To export test data to an external file:
l
Filter tests in the Test Library listing screen so that the screen shows only the tests you want to
export.
Select Export Tests XML to export tests to an XML file.
-- or --
The Test Library screen will display defects, releases and configurations linked to each test.
To hide linked items, clear the Show Traceability check box in the Actions menu.
Managing Workflow
To configure workflow for your tests:
l
This can also be done from Setup / Screen Layouts. See "Customizing the System to Your Needs"
Adding Custom Fields
To add custom fields to the Test Library:
l
On the Custom Fields form, configure the columns you want to add:
Choose the type of the data that the column will show in the Field Type list.
In the Field Size, enter the number of characters the data in your custom column can take.
If you want your custom column also to appear in the Test Runner window during the test run,
select the Show in Run? check box.
Click Submit Changes.
Test Sets groups Tests into a logical order, so you can run related Tests in a single Test Run. On the
Test Sets listing form, you can view, create and run Test Sets. Use the Navigation panel to filter for Test
Column
Actions
Assigned To
Attachments and
Notes
Avg Run Time
Date Created
Date Last Run
Date Updated
Execution Type
Folder Name
ID
Is Active?
Is Sequential?
Last Run By
Last Run Config
Last Run Release
Last Run Status
Owner
Priority
Status
Title
Updated By
Description
Actions you can perform on the Test Set
Team member assigned to the Test Set
Navigate directly to the Attachments or Notes tab of the Test Set
Average time it's taken to run the Test Set, based on Test Run History
Date the Test Set was created
Date of the most recent Run for the Test Set
Date the Test Set was last Updated
Execution Type for this Test Set. Execution Types are defined under Choice Lists
Folder/subfolder where the Test Set resides.
Unique Identifer for the Test Set
Indicates if this an Active or Disabled Test Set. Inactive Test Sets cannot be run
Indicates of Tests in the Test Set MUST be run in sequential order
Team member that last executed the Test Set
The configuration used with the last execution of the Test Set
Release/Iteration/Build used with the last execution of the Test Set
Status of the last execution of the Test Set (Pass/Fail)
Team member who owns the Test Set (typically the person who created the Test
Set)
Priority of the Test Set. Priorities are defined under Choice Lists
Status of the Test Set. Status values are defined under Choice Lists
Short descriptive name of the Test Set
Team member who last updated the Test
On the Add Test Set screen, specify the Set information and click Submit.
On the Add Tests, select the Tests that belong to the Test Set.
Click Save.
On the Edit Test Set screen, make the desired modifications to the test.
On the Tests tab, make the desired modifications to the Tests in the Set
Click Save.
Find the Set you want to run and click the button in the Actions column.
The Test Set List display defects, releases and configurations linked to each test.
To hide linked items, clear the Show Traceability check box in the Actions menu.
This can also be done from Setup / Screen Layouts. See "Customizing the System to Your Needs"
Managing Workflow
To configure workflow for your Test Sets:
l
This can also be done from Setup / Screen Layouts. See "Customizing the System to Your Needs"
Adding Custom Fields
To add custom fields to the Test Sets:
On the Custom Fields form, configure the columns you want to add:
Choose the type of the data that the column will show in the Field Type list.
In the Field Size, enter the number of characters the data in your custom column can take.
Configurations List
Test Management / Configurations
Configurations represent the various environments or test lab machines that you will use to run your
Tests or Test Sets.
Available columns depend on how your administrators have set up Configurations in Setup. If you do
not have any of the following columns available, it is likely due to how your system was originally set
up. Use Choose Fields to add or removed columns.
Note: Only columns that are less than 100 characters wide are available on the List. Others are available on the Add/Edit form.
Column
Actions
Attachments and
Notes
Configuration Name
Folder Name
ID
Is Active?
Owner
Updated By
Description
Actions you can perform on the Configuration
Navigate directly to the Attachments or Notes tab of the Configuration
Short descriptive name of the Configuration
Folder/subfolder where the Configuration resides.
Unique Identifier for the Configuration
Indicates if this an Active or Disabled Configuration
Team member who owns the Configuration (typically the person who created the
Configuration)
Team member who last updated the Configuration
On the Add Configuration form, specify the information and click Submit.
Click Save.
Editing Configurations
l On the Configurations list, find the Configuration you want to edit and click the button in the
Actions column.
l
Click Save.
On the Custom Fields form, configure the columns you want to add:
Choose the type of the data that the column will show in the Field Type list.
In the Field Size, enter the number of characters the data in your custom column can take.
Run History shows you information on all Tests Sets or individual Tests that were run. A Run might be
an individual Test run from the Test Library, or the Run of a Test Set. The list shows you who started
the run, the related Release, configuration, and other historical information. Use Choose Fields to
select and order the desired Columns.
Column
# Awaiting Run
#Blocked
#Failed
#Passed
#Tests
Actions
Date Finished
Date Started
Is Sequential
Release Name
Description
Number of Tests that have not yet been run
Number of Tests that were blocked in this run
Number of Tests that failed in this run
Number of Tests that passed in this run
Number of Total Tests in this run (Tests in the Test Set)
Actions you can perform for the Run
Date and time when this run was completed
Date and time when this run was started
Indicates if the Tests in the Test Set had to be run in sequential order
The Release the Test or Test Set was run against
Description
Run by Id
User ID of the team member that started the run
Run by Name
Name of the team member that started the run
Run Time
Time it took to complete the run
Run Time Formatted Time it took to complete the run, in 00:00:00 format
Status
Status of the run (pass/fail/incomplete)
Test Run Id
Unique identifier for this run
Test Set Id
Unique identifier of the Test Set that was run
Test Set Name
Name (Title) of the Test Set that was run
Click the View Run icon to bring up a display-only version of the Test runner, where you can also drill
into the detailed results.
Deleting a Run
l To remove the Run History entirely, click the Delete icon next to the run. Delete will force a recalculation of the average run time for the Tests and Test Sets within the run. This action cannot be
undone.
(continued in Test Schedules)
Test Schedules
Test Management / Test Schedules
Test Schedules shows you a list of scheduled automated tests that will run on your Test Hosts at specific times. From here, you can view, add, edit and delete the defined schedules. The list shows you the
Host, Title and schedule information. Use Choose Fields to add, remove and re-order the columns.
Available columns are based on your system configuration.
Column
Description
Actions
Actions you can perform on the selected Schedule
Attachments and Notes Navigate directly to the Attachments or Notes tab of the Test
Agent
The automated testing tool:
l TestComplete or TestExecute
Description
l
JUnit (Selenium)
TestNG (Selenium)
NUnit (Selenium)
Team member who created the Schedule
Date the Schedule was added
Date of the most recent run for this schedule
Date the schedule was last updated
Indicates if the Schedule is currently enabled
End date for the schedule.
Name of the remote machine that will run the test
Unique identifier of the schedule
Days of the week the schedule will run
Date the schedule will start
Time the schedule will run the test
Title of the schedule
Team member who last updated the schedule
l
Created By
Date Created
Date Last Launched
Date Update
Enabled
End Date
Host Name
Id
Run on
Start Date
Start Time
Title
Updated By
Click Submit.
Click Submit.
Disabling Schedules
Instead of completely deleting a schedule, you can disable it. The schedule will no longer run, but you
can view it for historical purposes.
On the Test Schedules list, find the Schedule you want to disable.
Click Submit.
Deleting Schedules
To view all items linked to Test Sets
l
On the Test Schedules list, find the Schedule you want to delete.
On the "Do you want to delete this record" dialog, click Yes.
Test Hosts shows you a list of machines discovered by the Test Agent, when it was installed on your
test machines. From here, you can view the available Hosts, add descriptions, notes and attachments.
Available columns depend on your system's configuration.
Column
Description
Actions
Actions you can perform on the selected Test Host
Attachments Navigate directly to the Attachments or Notes tab of the Test
and Notes Host
Agents
The automated testing tool:
l TestComplete or TestExecute
l
JUnit (Selenium)
TestNG (Selenium)
NUnit (Selenium)
Team member who created the Host
Date the Host was added
l
Created By
Date
Created
Date Update Date the Host was last updated
Description
Host Name
Id
Is Active?
OS
Test Hosts are created when you install the Test Agent on your test machines. The Host Name, OS,
Agent, Is Active and Configuration are all controlled by the Test Agent and are not editable. Description, Note and custom field are input capable. You cannot add Test Hosts manually.
Editing Test Hosts
l
On the Test Host list, find the Host you want to edit and click the
Click Submit.
On the Test Host list, find the Host you want to delete and click the
column.
At the bottom of the edit form, click Delete and confirm by clicking Yes.
Test Cases
Prior to Release 9.6.0, the Test Cases module provided a basic test management feature. If you are still
using Test Cases, please continue to About Test Cases (Release 9.6.0) and earlier
l
Automation Bridge
Install the Test Agent on your test computers. See "Installing the Test Agent".
Create Tests in the Test Library, and associate your TestComplete projects with the Tests. See "Creating Automated Tests".
Add your Tests to Test Sets (optional) and run them either on demand or on a schedule. See "Running Automated Tests" and Scheduling Automated Tests.
Software Planner allows you to organize your test cases any way you wish. For example, you may consider organizing test cases by software release, agile sprint, etc. Or you may decide to do it by product
line, component or functional area, etc. For more information on organizing your data, refer to this
section of the document: Users Guide Organizing Your Data.
Using a Test Library in Test Cases (Release 9.6.0 and earlier)
You can re-use Test Cases from Release to Release by organizing them into release folders, using Fast
Edit to copy them to new folders for each release. In this scenario, you may wish to store master versions of your Test Cases in a Test Library folder, separated by Functional Area.
First, create a Folder for your Test Cases. Organize your Test Cases in subfolders as needed.
Use Fast Edit to copy from your Test Library into your Release folders.
If at any time, you need to change the Steps or Expected Results in the Test Library, Software Planner
will recognize the Test Cases in the Release folders that are related to the Test Library, and ask if you
want to synchronize.
Click Yes, and you will see a list of related Test Cases.
The Test Case Id is a clickable link that takes you to the Printer Friendly version of the Test Case, where
you can review the Test Case details.
Select any or all of the Test Cases to synchronize. Click Submit, and the Test Case Steps and Expected
Results will be updated with your changes to the original Test Case in the Test Case Library.
Organizing Regression Test Cases
If your team is using manual test cases for regression, it is good practice to house a set of regression
test cases that can be used from release to release. To do this, simply create a folder named Regression Template in Test Cases and store your regression test cases there. At the end of each release, it is
good practice to review test cases for new features that were added in the subsequent release and convert test cases from that to your regression set.
Below is how your Regression Template might look:
To add a new Test Case, go to the Test Case tab and click the ADD NEW button at the top of the screen.
To update an item, click the EDIT button for the desired item, make your changes and press SUBMIT.
To delete an item, click the EDIT button for the desired item, scroll to the bottom of the page and
check the DELETE THIS RECORD checkbox, press SUBMIT.
You can attach files (like test plans, etc) by editing an item, then clicking the FILES tab, then clicking Add
New. You can keep a running set of notes on an item by editing an item, then clicking the NOTES tab,
then clicking Add New.
Test Case Traceability (Release 9.6.0 and earlier)
When developing test cases, it is important to ensure that you are prepared to fully test all features of
a specific requirement. The act of linking test cases to a Requirement with the goal of ensuring
adequate test coverage is called Test Case Traceability. Software Planner has several ways to ensure
your test cases have traceability.
The first step is to link the test cases back to a requirement(s). To do this, click Requirements / Traceability.
An alternative way to link test cases to a requirement is to edit the requirement and click Link to
Items
To run a traceability report for a specific requirement, edit the requirement and click the Traceability
Report.
Another way to see traceability is to run a Test Case to Requirement Traceability report. Do this by
clicking the Reports tab / Test Case Reports / choose Test Case to Requirement Traceability report.
This report lists each requirement and all the associated test cases (with their current status):
Other reports that aid in traceability are in the Requirements Reports section of the Reports tab:
Requirements Missing Test Cases Traceability Shows each requirement that has no associated test
cases.
Requirements Missing Test Cases Traceability by Folder - Shows each requirement that has no associated test cases, grouping this by folder.
Automatically Creating Defects from Failed Test Cases (Release 9.6.0 and earlier)
Software Planner can save your QA staff time by automatically generating defects when test cases fail.
To do this, edit a test case and change the status to Failed. At the bottom of the screen is a checkbox
named Automatically Generate Defect upon Failed Test Case? If this is clicked, it will create a defect,
automatically filling in details from the test case (like steps to reproduce, expected results, etc).
Once you check (or uncheck) the box and fail a Test Case, that sets the default for the next time you
open a Test Case.
It will also create a linkage between the failed test case and the associated defect. When the defect is
Closed, the Test Case will automatically be Passed. You can quickly see which defects were linked from
test cases by clicking Defects / Traceability. Once this is done, it shows the test case(s) linked to the
defect and you can drill into the list of test cases by clicking the link:
You can also manually link a test case to a defect by editing a test case and clicking the NEW DEFECT
button at the top of the screen. Conversely, you can automatically create a test case from an existing
defect by editing a defect and clicking the NEW TEST CASE button at the top of the screen.
Failed Test Case: Defect to Requirement Traceability (Release 9.6.0 and earlier)
A Defect can be automatically linked to a Requirement if it is associated with a Test Case linked to the
Requirement.
First, link your Test Cases to a Requirement.
When you run the tests, use Automatically Generate Defect Upon Failed Test Case. When you fail the
Test Case, Software Planner looks for a link between the Test Case and Requirement. If it finds a linked
Requirement, it will then link the Defect not only to the Test Case but also to the Requirement.
The legacy Automation Bridge was used to post TestComplete results to Test Management's Automation Runs. From Automation Runs, recurring schedules for tests can be configured to run the
TestComplete projects unattended.
On you TestComplete machines, where you've downloaded the Automation Bridge, TestComplete will
have the automation plugin.
l
Start TestComplete.
Open a Project.
Look for the Automation Bridge icon in the toolbar and click on it:
Enter the Web Service Address. For Software as a Service customers, this is http://ws.softwareplanner.com/psWS.asmx.
On the TestComplete Bridge tab, enter the Email that you use to log in to ALMComplete|QAComplete and your password, then click Load Projects. The registration will validate your
credentials, then load the Project drop down with your ALMComplete|QAComplete projects.
Select the Project that will store your Automation results.
Use the ellipse next to the PJS Directory field to navigate to the folder that holds your TestComplete
project suites (PJS Files).
The Host Name will be auto-filled with the TestComplete machine name. You can modify this value
to make it easy to recognize your machine.
The Active checkbox should be checked. You can uncheck this to disable the automation bridge.
Click OK.
Automation Scheduler
Once the automation bridge is configured, you can set a schedule for the TestComplete tests from the
Test Management / Automation / Automation Scheduler.
Click on Automation Scheduler.
Use the drop down lists to select the Automation Type, Host Name, Project Suite and Project.
The scheduler will check approximately every 5 minutes, looking for an active scheduler. When it finds
something to run, it will start up TestComplete on the Host and run the project suite. Results will post
back to Automation.
Automation Runs
Once automated tests have been run, you can view the results in Automation Runs
TestComplete logs (that are smaller than 30 Mg) can be viewed from the Automation Runs results list.
Analyzing the Test Runs
Enter the Web Service Address and Application Host as pictured, then your login email address and
password. Click the Check button. Your login will be verified, and a list of Projects loaded. Select the
Project that will store the Defects. Check the Save Settings box and click OK.
Then fill out the Defect form and Submit. The new defect will be added to the selected Project.
To add a new defect, go to the defect listing screen and click the ADD NEW button at the top of the
screen. To update an item, click the EDIT button for the desired item, make your changes and press
SUBMIT. To delete an item, click the EDIT button for the desired item, scroll to the bottom of the page
and click the DELETE button. If you do not have security rights to update or delete items, those buttons will be hidden.
Tip! If you wish to add a new item that is similar to an existing item you recently added, notice you can
choose a recently entry to auto-fill the data on the screen:
You can reorganize the edit screen by adding custom fields, change the position in which fields appears
on the edit screen, and you can arrange the edit screen in 1 or 2 column formats. You also specify
which fields are shown, required or optional
You can attach files (like screen shots, etc) by editing an item, then clicking the FILES tab, then clicking
Add New. You can keep a running set of notes on an item by editing an item, then clicking the NOTES
tab, then clicking Add New.
Creating a Test from a Defect
If you have a defect that would make a great test (to ensure it is tested in subsequent releases), you
can edit a defect then click the Add Linked Item button at the top of the screen. This allows you to create any type of item with details from the Defect and automatically link them.
A new Add Test form pops up. Some of the information from the Defect will be auto-filled for you. You
can edit the information and complete the defect, then Submit and the new Test will be automatically
linked to the Defect.
After youve stubbed out the Test, go to the Test Library to add the detailed steps.
Uploading Documents
To upload documents, click Shared Documents, choose a folder, and then click the Upload Wizard button at the top of the screen. Windows Internet Explorer users can upload using drag and drop by clicking Actions / Turn Drag and Drop Upload On.
Click Continue:
Downloading Documents
To download one or more documents, click the Download Wizard button from the Shared Documents
screen, then choose the files to download:
Once the posting is sent, it emails everyone in the forum (if they have their messages email alert set).
You can respond through the emails by using the Send Reply Now link in the email, or from the forum
post in Collaboration.
If you view the thread within ALMComplete, it shows the entire thread:
Contact Management
The contact management feature allows sales teams to track prospects and other teams to track
vendors and other contacts.
To track contacts, click the Contacts tab.
To add new contacts, click the Add New button at the top of the page.
Sending Bulk Emails
If you wish to send bulk emails (newsletters, marketing promotions, etc), you can do that via the contact manager. You can create email templates so that your team can re-use emails that have been well
thought out and can be sent out frequently. You can send bulk emails immediately or you can schedule them to be sent at a later date. If you enter URLs inside the email, it will track who clicked on each
From here, you can create a template or type your email then send it:
For example, lets create a list of Features or functional areas. Once you click Add New, enter the name
of the list (e.g. Features) and make it Company Wide (this means that the same list of values will be
seen in all projects). If you make it Project Specific, only items created in the current project can be
seen in the current project, which allows you to have different data by project.
Defining List Columns
Once the list is created, you can then define the fields (or columns) of information to track. Click Manage Lists, then click the Manage Fields for this list next to your new List.
Once the Fields link is clicked, you can define each field of information you wish track. Below you can
see that we have setup 6 fields for our Feature list
Feature Name
Description
Recent Updates
Included in ALMComplete
Included in QAComplete
Included in DevComplete
You will notice that the field types are identical to the types offered when setting up custom fields,
providing you with an array of different field type variations.
On your list, you can define the fields as Text, CheckBox, Choice Lists, Currency, Date, Numeric, and
Percentage, giving you full control over the data you want to store.
Once the new List has been created, you must grant security permissions to the list so that specific
people have rights to the list. You can do this on the Setup tab under Security.
Once you have permissions set for the list, it appears in the navigation panel, allowing you to view,
add, update and delete items from the list.
Ad-hoc reports are automatically created for the list.
List Title Setup
The first time you add a record to the list, you will see a Title Setup pop up:
The fields selected here appear when searching for list items. Your list items will be sorted by the fields
you select here on Link to Items.
If you need to change the title setup, you can get back to this from the Traceability screen from any
module, click the Actions drop down and turn on Traceability. Click Link to Item and select your List
the Setup: Title option will appear.
Most pie charts can be rotated or viewed in 2d or 3d. Right click on the chart to see the available
options.
Ad-hoc Detail reports are great for creating custom reports that pull back specific fields of data based
on selected filter criteria. Each area of the software comes with ad-hoc detail reports (Agile Tasks,
Requirements, Defects, etc). To run an ad-hoc Detail report, click the Reports tab / Ad-hoc Detail
Reports. Below is an example of an ad-hoc Defect report, notice you can specify what fields to show on
the report, the position of the fields, the sort order, and the filter criteria. You can also email the
report to others.
When using Filters on an ad-hoc report, be sure to give the Filter a name.
Here is an example of how the report might look once generated:
A Defect Summary report returns the data grouped into a graph format:
You can save your ad-hoc detail selection criteria by giving the report a Name in the Save As Personal
Report field. This stores your Chosen Fields, Sort Order and Filter so you can run exactly the same
report again without going through the report criteria selection process.
Normally Waterfall projects are shipped in Releases (e.g. Release 1.0, Release 2.0, Release 3.0) and
these releases are normally between 6 months to 2 years in duration.
If your team is using the Waterfall method, youll define your Release and Release schedule based on
the Waterfall workflow, possibly with an Iteration for each phase of development below the Release.
Youll likely use Project Management to track the tasks associated with each Waterfall process. You will
also need to keep track of future requirements (or requirements), we suggest creating a Product Backlog folder under the requirements area to keep track of future enhancement requirements. Below is
an example of setting up a Waterfall environment:
Notice that Release 1.0 above is not achieved until several iterations (or sprints) is performed. If your
team is using the Agile methodology, on the Releases tab create a folder for your application or
product, then create a Release with Iterations under the Release for each Sprint.
You will also need to keep track of future requirements; we suggest creating a Product Backlog folder
under the requirements area to keep track of future enhancement requirements. Below is an example
of setting up Releases an Agile environment:
Collaboration
You should also consider creating a Discussion Forum for each sprint, allowing your teams to more
closely collaborate by posting questions/answers in the forums (like design questions, etc). Another
great use for forums is to post daily updates to the forum so that team members know what code
modules were changed, what specifications they related to, and the status of how the coding in that
area is progressing.
Templates
Also, if you need templates for the Agile methodology (like Work Orders, etc), go to http://smartbear.com/community/resources/templates/.