Menu

qTest Manager 8.4.4 OnPremise Release Notes - June, 2017

Installation/Deployment Packages

Linux Docker deployment packages

  • One Docker deployment package to deploy qTest Manager, qTest Sessions and qTest Parameters NEW

Linux non-Docker installation/upgrade package

  • One package for installing or upgrading qTest Manager
  • One package for installing or upgrading qTest Sessions
  • One package for installing qTest Parameters NEW

Windows installation packages

  • One package for installing or upgrading qTest Manager
  • One package for installing or upgrading qTest Sessions
  • One package for installing qTest Parameters NEW

Plugin/Tool Updates

  • qTest for JIRA Server - Test Management v6.11.3
  • Automation Agent Tool v1.3.0
  • eggPlant Connector 1.1.1

qTest Parameterization

  • qTest features a new module, qTest Parameters, to manage testing data. It is available for Premium and Elite users. You can now include parameters in Test Cases and also define parameter values to create Test Runs
  • NOTE: In order to use this new module, you will need to install Parameters (in addition to upgrading qTest Manager, Sessions, and Insights)
  • Once Parameters is installed, users are able to select qTest Parameters from the 9-box icon in the top-right corner of the qTest header
    9box

  NOTE: qTest Parameters works best on the latest versions of Chrome, Firefox, Safari 9 & 10, and IE11. You may receive the following "Outdated Browser" page, if you open qTest Parameters in Safari versions before 9, or IE versions before 11

Outdated browser

Parameters

Landing qTest Parameters via the 9box, the Parameters page provides you with a list of parameters which belong to all qTest Manager's projects you have access to.

parametersgrid

Functionalities on the Parameter Grid

  • Search the parameters by their identifier. This is a contain-search which means it finds all parameters' identifiers that contain your typing-words
  • Filter parameters by their assigned projects, status (active/inactive), used/unused (in either a Test Case or a Dataset)
  • Sort parameters by most recent, A-Z, Z-A
  • Clear All Filters
  • Pagination
  • Export multiple selected parameters
  • Archive multiple selected parameters

Create a Parameter

  • This feature helps create a new parameter, assign it to desired projects, and add parameter values
  • Create Another: Once this option is on, it will retain the Create Parameter window so you can easily continue to create more parameters
  • Use the Hot-key: Shift-Enter to quickly create the parameter

Create Parameter

Import Parameters

  • This feature allows user to import multiple parameters and their values into certain projects, using a .xls or .xlsx file (Maximum Size: 10MB)
  • Template of the import file is provided as a guide
  • Drag and drop the file or select the import file from your directory
  • If there are duplicate parameters (e.g. if a parameter in the import already exists in qTest Parameters), there are 3 options: 1) Overwrite duplicates parameters 2) Add data to existing parameters or 3) Skip duplicate parameters
  • Import Result dialog shows the number of successful imported parameters, number of failures, and also the list of parameters that failed to import successfully
    Import Parameters
  • Import Result dialog shows the number of successful imported parameters, number of failures, and also the list of parameters that failed to import successfully
    import result

Edit a parameter

  • Ability to edit a parameter's details like identifier, description, status, projects
  • Ability to add/edit/archive parameter's values
  • Ability to search/sort parameter's values
  • Test Cases Tab: Provide a list of Test cases which are using the parameter. User can click on either Test case ID or Test case name to open it in a new browser tab
  • Datasets Tab: Provide a list of Datasets which are using the parameter. User can click on the Dataset Name to open the Dataset Profile page in a new browser tab

Archive a parameter

  • Provide ability to temporarily delete a parameter
  • There is a daily job to permanently remove 30-day archived parameters out of the system
  • Warn user if he wants to delete (archive) a parameter which is used by a Test case. Archive parameter if user confirms
  • Not allow a parameter to be archived if there is a Dataset using it

Archive Parameter

Datasets

Click on the Datasets tab from the qTest Parameters page to see a grid of all datasets.

Functionalities on the Datasets Grid

  • Search the datasets by their name. This is a contain-search which means it finds all datasets' names that contain your typing-words
  • Statistic number on top of the grid quickly tells how many datasets are active/ inactive
  • Filter datasets grid by their status (active/inactive)
  • Sort datasets grid by most recent, A-Z, Z-A
  • Pagination
  • Delete multiple selected datasets

Create a Dataset

This feature helps create a new dataset with basic information and a large amount of data.

createds2

Create Dataset and manually select data for each data row

  • Build Dataset structure: specify parameters to become Dataset columns (A Dataset can have 25 columns as maximum)
  • Ability to add either one row or a bunch of rows (maximum: 25 rows/time) into the Dataset
  • Remove unwanted columns/rows Prepare data for the dataset by select value for every cell

Generate data automatically

  • 2 methods/algorithms to automatically generate data:
    • Unique Values: Parameter values will not be repeated, no 2 rows will have the same parameter value
    • Unique Combinations: Each row in the data grid will contain a unique combination. Parameter values can be repeated, however, no 2 rows will have the same combination of data. (Maximum number of combinations can be generated is 1 million)

Clear data

  • Clear Values: All values/data of the Dataset will be cleared out, but its structure (selected columns) remains unchanged
  • Reset Table: Dataset's structure and data are all removed. The Dataset turns back to its initial state where user can rebuild it from scratch

Edit / Delete a Dataset

From the Dataset Grid page, click on a Dataset name to open its profile page. This view provides following functionalities:

  • Ability to edit a parameter's details like name, description, status
  • Ability to add/edit/delete dataset's structure and content
  • Ability to automatically generate data for the dataset
  • Ability to delete a dataset: allow a dataset to be deleted even if it is being used in qTest Manager

editds2

Using qTest Parameterization

Parameterization Settings

In order to use Parameters in a qTest project, the feature needs to be activated under the project level settings. It is activated by default for all projects. If you plan not to use parameters in your project, please switch it off.

Parameterization Settings

Design Test Cases with parameters

  • In qTest Parameters, your parameters need to be assigned to your qTest project so they can be added to your Test Cases
  • Currently, you can only add parameters in Test Step Description. Type the parameter name following @ which will provide a selection and then select one of the parameters from the drop down list (e.g. @Month)

qTest-Test-Design-Add-parameters

  NOTE: It is highly recommended that you only add up to 25 parameters in one Test Case

Create Test Runs from Test Cases with parameters

Currently, qTest does not allow the user to select the parameter value when executing the Test Run. Therefore, the parameter values must be specified first when creating the Test Run.

  • In addition to creating Test Runs from Test Execution tab, we provide another way for you to create Test Runs from a specific Test Case
    qTest-Test-Design-Create-Test-Runs
  • If a Test Case includes parameters, qTest will prompt you to assign parameter values in order to create Test Runs. If a Test Case includes inactive or deleted parameters, you cannot create any new Test Runs
  • You can create up to 100 Test Runs with different parameter values from a Test Case at a time
  • There are 3 ways for you to assign parameter values when creating Test Runs: Manually, Randomize data, and From Dataset
  • Manually: Manually select parameter values one by one
  • Randomize data: System randomly selects parameter values. You can choose one of these 2 options:
    • Unique Data Combinations Only: Each Test Run will contain a unique combination. Parameter values can be repeated, however, no 2 rows will have the same combination of data
    • Unique Values Only: No 2 rows will have the same parameter value

    For both 2 options, qTest only supports selecting 100 data combinations from up to 2 billion available data combinations. If there are more than 2 billion available combinations, randomizing data may be slow.

  • From Dataset: use pre-defined data from Dataset(s) to create Test Runs
    qTest-Create-Test-Runs-Assign-param-values

Executing Test Runs

  • A Test Run is not executable if its associated Test Case version includes a parameter that is inactive, deleted, or does not have any values. Parameters without assigned values are highlighted in red
    qTest-Test-Execution-Unexecutable-Test-Runs
  • You can click on highlighted parameters to select their values
    qTest-Test-Execution-Inline-assign-values

  IMPORTANT: Once you select a parameter value, you will not be able to change it. It is a known issue

New Features

Improved workflow - Ability to create Test Runs from a Test Case

  • Previously, there was only one way to create Test Runs (from Test Execution). Now, there is a second option to create Test Run(s) directly from the Test Case in Test Design. Click on the new Create Test Runs button and select the Test Execution location (e.g. within a specific Test Suite) to create the Test Run(s)
    qTest-Test-Design-Create-Test-Runs

New Automation Agent for JBehave (Automation Integration v2)

  • qTest Manager features Automation Scheduling which allows you to schedule and kick off automation tests that reside on your local machine and report the results of these tests back to your qTest server. Please click here for more background on this existing Automation V2 Integration
  • In addition to the existing support for TestNG, JUnit and Cucumber for Java, we now provide an out of the box Automation Agent for JBehave. This integration will follow the existing Automation V2 Integration
  • Please download our latest version of our Automation Agent Tool (v1.3.0)

New APIs

  • Batch submit test logs to qTest Manager and create Test Cases and Test Runs in a user-defined hierarchical structure
  • Get users in a project
  • Query users by their assigned project names
  • Query users by usernames
  • Assign users to a user profile or admin profile
  • Get available user profiles and admin profiles
  • Queries for Test Cycle and Test Suite by their names or ID

Enhancements

Look and Feel

  • New common header (across QASymphony products) providing you with the ability to quickly open any applications you have licensed to
  • New look for the top navigation header
    New-Header1
  • Improved login experience for eXplorer + Sessions plan
  • Improved loading performance of the navigation trees:
    • Main trees: Test Plan, Requirements, Test Design, and Test Execution
    • Tree dialogs: Add Requirements to Release Scope, Link Test Cases to Requirement, Link Requirements to Test Case, Create Test Runs on Test Case, Add Test Runs by Requirement, Test Design, and Test Execution

Security

  • Users are locked after a number of failed login attempts
    • For security purposes users will be locked out after multiple failed login attempts. This function cannot be disabled
    • Site Administrators can modify the maximum number of failed login attempts in qTest Administration > Security
    Account-Login-Management

Others

Associations between Sessions and other qTest objects are automatically created for traceability

  • If you link a Session with a Test Case, the Session is automatically linked with any Requirements linked to the Test Case
  • If you execute a Test Run with a recorded Session (using Desktop or Web Explorer), the Session is automatically linked to the associated Test Case

eggPlant Integration V1: new option not to override existing Test Cases' Steps

  • A new key is added to config.properties file: submit.automatedstepresults
  • By default the key’s value is yes
    • If its value is yes, results of each test step are submitted to qTest Manager
    • If its value is no, automated test step logs are omitted. Only the result of the overall test run’s log are submitted to qTest Manager. However, associated Test Cases’ steps are not overwritten
  • Click here to learn further of our eggPlant integration

API Updates

  • API sessions will not count towards your qTest session limit. This applies to both session limits: 1) Max 3 sessions per user and 2) Max concurrent sessions per account (if subscription is based on concurrent license model)
  • Test Case creator and Test Run creator information is included in the following API
    • Get all Test Cases under Root/Module
    • Get Test Case by ID
    • Get Test Case by Test Case Version Id
    • Get all Test Runs under Root/Release/Test Cycle/Test Suite
    • Get Test Run by Id
  • The following APIs support Test Steps to call other Test Cases:
  • Retrieve associated objects of given objects: you are able to get Test Runs which are associated with external Defects
  • Create a New Project and activate the project's Automation Integration Settings

Known Issues

qTest Parameters

  • Although qTest supports creating 100 Test Runs with parameters at a time, it is highly recommended to create up to 50 Test Runs only, or you may experience a slow page loading qTest does not support cloning projects with parameters
  • Test Run Configurations cannot be applied to Test Runs created from Test Cases with parameters
  • In TestPad, you are not able to edit Test Step Description and Expected Result of Test Runs with parameters
  • When assigning parameter values in Test Runs, once you select a parameter value, you will not be able to change it
  • Once you correct parameters in a Test Run to make it executable, you will need to reload the Test Run page so you can see the Run/Quick Run button
  • Once you re-activate parameters in a Test Case to create Test Runs, you will need to reload the Test Case page so you can see the Create Test Run button
  • Resetting the Sample Project in qTest Manager will not remove the association between sample Test Cases and parameters. In qTest Paramaters, clicking on an associated sample Test Case which has been reset will direct you to an error page in qTest Manager
  • You are not able to batch update Test Case Version of Test Runs whose parameters have not been assigned with values
  • When performing free text or free text search, parameter IDs and parameter value IDs are displayed in the search result panel, instead of the parameter names and values
  • It takes 5 minute to sync up between qTest Manger and qTest Parameters if there are any changes to the qTest Manager project that includes parameters
  • Feature "Automatically generate data" is currently based on every value included in a parameter. The system will skip the parameter's value-duplicated validation. Therefore, if a parameter has duplicate values, "Automatically generate data" may create rows with duplicate data
  • Order of datarows in Dataset are changed after manually creating a new Dataset
Subscribe To Our Blog
Powered by Zendesk