Menu

Organize Test Execution

Overview

Properly organizing Test Execution is critical to your team’s success. The organization not only affects how testers will use qTest on a daily basis but also heavily influences reporting in Insights.

Test Execution Organization

Releases

Releases are either manually created in the qTest UI or pulled directly from Jira. Whether using the Jira Integration or UI, any created Releases in the Test Plan mirror those in Test Execution:

Releases.png

Releases_1.png

Test Cycles

Test Cycles are containers you can nest under Releases. Think of them as a page break, or a way to identify the overall element that you’re testing:

EBJ1_Sprint_1.png

In this example, we are using Cycles to define the type of testing we are doing: UAT, Regression, etc.

Another way to use Test Cycles is to indicate the Component, Feature, or what you’re testing during execution

ENJ_Sprint_3.png

Note: You can nest Cycles under other Cycles to create Sub-Cycles

Fix_Version_2.0.png

Test Suites

Test Suites are containers that nest under Test Cycles. They are for more granular grouping of Test Runs. In this example, we are in the "User Testing" Test Cycle, and are looking at various Applications:

Test_Suites_1.png  Test_Suites_2.png

As long as you understand the hierarchy of objects in qTest, you can use the containers to accomplish any configuration needed:

Release>Cycle>Suite>Test Run

Here are some examples:

Heirarchy_ex1.png

Hierarchy_ex2.png


Again, the takeaway here is the hierarchy. As long as you nest things appropriately, your users will be able to find what they are testing.

The Relationship Between a Test Suite and a Test Cycle

The difference between Test Suites and Test Cycles are their properties. If you select the property tab you can see the default properties of each artifact.

Test Cycle:

TC_vs_TS_1.png

Test Suite:

TS_properties.png

When you place a test run into the Cycle or Suite, it will inherit the property field values that are selected at the time when that test run is added. If you update the property of the Suite or Cycle after that test run is already in the folder, the Test Run properties will not change automatically (you will have to update the test run properties directly).

Another major difference is the filter capabilities in qTest Insights. It’s very easy to filter by Cycle in the reporting. There is no option to filter by Suite that’s easily accessible in the Filtering area (although you can specify by filter in the “Explore Data area”).

So it is easier to target data that is based on a Cycle. You may find it advantageous to use both a Cycle and a Suite to get the best of both worlds. See the snapshot below of the reporting filter.

FilterByCylce.png

Folder Structure and Reporting in Insights

Keep in mind, the way you structure Test Execution also impacts how you report in Insights.

Insights allows you to drill down by Test Cycle, Module, (folder from Requirements/Test Design) or Release (Sprint or Fix Version from Jira).

Folder_Structure...Insights.png

Note: All filters applied are persistent, meaning they will remain active until removed by a user.

Powered by Zendesk