Menu

Create and Configure Portfolio Reporting

Overview

This article explains how to create and configure your Portfolio Reports to be available for selection in the Report Gallery. You will need to create custom site fields specific to Portfolio Reporting and apply those to your qTest projects in Manager before you can use Portfolio Reporting. 

To create and configure your Portfolios, you must be an Insights Editor

Portfolio Introduction Video

Hint: Watch the introduction video in fullscreen to get the best picture quality!

Prerequisites

The steps below outline the required setup in qTest Manager that must take place before you can create or configure your Portfolio Reporting. 

Define Custom Portfolio Site Fields

Define custom Portfolio Site Fields with values in qTest Manager Site Administration. These custom site field values are used to group Releases or Test Suites across qTest Projects, so they are reportable on the Portfolio Report you create. Read this article for instructions on how to create a site field. 
Note: You must be a Site Administrator to create a Site Field.

Below are the two types of site fields needed to use a Portfolio Report:

  • Release Artifact
    1. Portfolio Site Field-must use a combo box or a multi-select combo box as the control type. 
    2. Portfolio Date Field-must use the date picker control type.

  • Test Suite Artifact
    1. Portfolio Site Field-must use a combo box or a multi-select combo box as the control type. 
    2. Portfolio Date Field-must use the date picker control type.

 

portfolio_site_fields.png

The values you enter for the Portfolio Site Field will be seen and selected in the individual qTest Project. Assigning these values to the project creates a tag so your Portfolio Report can pull the data. These values are also used as a filter in the Portfolio Overview, and Portfolio Progress reports. 

Example: Perhaps your software requires different coding languages for different releases that you want to report on over several projects. Therefore, the values might be your different coding languages: Java, C++, and Python.

site_field_values.png

Assign Site Fields to a Template and Add to a Project

Once you have entered and enabled the custom site fields in Site Administration, you will need to assign the site fields to your qTest Projects using a Template. Read this article for instructions on how to create a template.

  1. Create a template or edit an existing template, so that you can easily add these custom site fields to your qTest Projects. 
  2. If creating a new Template, select the checkbox for each Project you want to assign to the template and Save.
  3. To edit an existing Template, select the template name from the 'Template List,' and the newly created site fields will appear near the bottom of the screen. Select the Template Field checkbox to enable these fields for the chosen Template. Save.

Example: In this example, we have two Projects: Project X and Project Y that are both associated with the template named "Portfolio Template."

portfolio_template.png

Use Portfolio Site Fields in qTest Projects

Now that you have created the site fields and assigned them to a template, you will link the values to your qTest Projects. Selecting the portfolio values on either the Release or Test Suite properties, tags those objects in Manager, so that they can be reportable in Insights on your Portfolio Report.

  1. Navigate to the Project in qTest Manager you would like to tag with your Portfolio Site Field values. (These are the values you created in Step#1 of defining your custom site fields.)
    • If you created Portfolio site fields for a Release, you would select the Release for the qTest Project you want to see in your Portfolio Report.
    • If you created Portfolio site fields for a Test Suite, you would select the Test Suite properties for the qTest Project.
  2. Locate the Portfolio Site Field in the appropriate artifact and select the value(s) from the drop-down list.
  3. Save your changes.

Example: Project X used Java for one release named Version 2.0 while using C++ for the second release named Version 3.0. Therefore, the Java value is assigned to Release 2.0 on the Test Plan page, and the C++ value is assigned to the Release named Version 3.0. add_values_to_project.png

Create Portfolio Report

Portfolios allow you to view cross-project data, which includes test run status, Jira defect status, progress and defect trends summarized across projects for health analysis. Portfolio Reporting is currently available for Release and Test Suite data.

The Portfolio Configuration page allows you to create, view and manage your Portfolios. The Portfolio Site and Date fields are configured in qTest Manager (described above) and a prerequisite to using Portfolio Reports.

Portfolio Configuration Video

Hint: Watch the configuration video in fullscreen to get the best picture quality!

To use this feature, do the following:

  1. From Insights, select the Settings tab.
  2. Select the Portfolio Configuration option in the Portfolio Settings section.
  3. The Portfolio page will display. 

Add a New Portfolio

  1. Select the 'Add Portfolio' button in the top, right corner of the page.
  2. Enter the appropriate information for the new Portfolio in the dialogue box:
    • Portfolio Name: enter a name for the portfolio
    • Artifact Type: select the artifact type, either Release or Test Suite
    • Site Field: select the Site Field from the drop-down menu. The site field(s) visible in this drop-down are populating from the custom site fields in Manager, associated with the artifact type chosen above. Custom site fields with a control type of combo box or multi-select combo box will display.
    • Date Field: select the Date Field from the drop-down. The date options visible in this drop-down are populating from the custom site fields in Manager, associated with the artifact type chosen above. Custom site fields with a control type of date field will display.
  3. Save Portfolio.

define_portfolio.png

Conditional Status Formatting

You can create Conditional Formatting for an individual Portfolio Report that defines criteria for selected Test Runs and Defect Status data. You will create a rule, using a conditional expression, to define the data results with the selected color within the Portfolio Overview table and Portfolio Details table. 
Note: This section is optional as your Portfolio Reports will still reflect data, however, the conditional status formatting provides a visual identifier for quick understanding of the information displayed.

To use this feature:

  1. From Insights, select the Settings tab.
  2. In the drop-down menu, select Portfolio Configuration. 
  3. The 'Portfolios' page displays.
  4. Choose a previously created portfolio report on the left-hand side and the information for the selected report loads.
    OR
    Select Add to create a new portfolio report and follow the instructions listed above to add a new Portfolio.
    Note: The information displayed in the Portfolio Details, Conditional Formatting, and Unlinked Jira Defects sections of the screen will be for the specific Portfolio Report you are currently creating or editing. 

Add Conditional Status Formatting

  1. Select Add in the Conditional Formatting section of the screen, and the 'Select Field Criteria' dialog opens.
  2. Use drag and drop to move test run and defect fields from the 'Available Fields' column to the 'Selected Fields' column. Select OK.
    Note: The values shown in the 'Available Fields' column populate from both your Test Run statuses in Manager and your mapped Insights Defect values. 
    conditional_formatting_select_fields.png
  3. The Conditional Formatting dialog opens, and you will create your conditional expressions through the following:
    • Threshold Colorchoose the color you want to associate with this threshold criteria. You will see this highlight color in the Portfolio Details grid for the values that meet the rule criteria.
    • Conditional Expression: the conditional expression defines the criteria for each Status Field. Select Show to view your expression in literal terms.
      conditional_expression_gif.gif
  4. Select Update, and the conditional formatting will save. 
  5. Continue the process above to include more conditional formatting if you desire.
  6. Select Save at the top of the Portfolios page to save your changes to the individual portfolio you have selected.
  7. You can add, edit or delete conditional formatting that you assign to a Portfolio report using the icons in the action column on the Portfolio Configuration page. 

Unlinked Jira Defects Mapping

Unlinked Jira Defects Mapping is available in Portfolio Reporting for projects with a Jira integration and allows you to incorporate unlinked defects to your portfolio reports. Here you will map Jira defects to a qTest project(s) Release/Test Suite artifact so that they can be reportable in Insights. 

You will see Unlinked Jira Defects in the following areas:

  • Portfolio Overview:
    • Portfolio Overview table-Defects and Severity columns
    • Portfolio Details table
    • Defect Status by Portfolio for Test Suite/Release charts
  • Portfolio Progress:
    • Defect Status by Test Suite/Release charts
    • Defect Status Trend by Release/Test Suite charts

To map Unlinked Jira defects:

  1. In the Unlinked Defects Mapping section of Portfolio Configuration, select the qTest Project(s) you want to map to Jira defects.
  2. In the Jira field drop-down, select the Jira field that is populating from the selected qTest Project(s). These could vary from project to project, based on the Jira fields that are being used in the integrated project(s) you are selecting.
  3. Select Save at the top of the Portfolios page to save your changes to the individual portfolio you have selected.

Jira Defects Severity Value Mapping

Insights also offers Defect Severity Mapping, a feature with which you can standardize all of your team's Jira Defect Severity values in both Insights and Jira. To learn more, refer to Mapping Jira Defect Severity Values.

Edit an Existing Portfolio

  1. From Insights, select the Settings tab.
  2. Select the Portfolio Configuration option in the Portfolio Settings section.
  3. The Portfolios page loads and you will locate the portfolio name you would like to edit on the left-hand side of the screen, and select the pencil icon
  4. The properties for the Portfolio you chose loads, and you can edit the values, conditional formatting, or the unlinked defect mapping.
  5. Save Portfolio.

Now that you have created and saved your Portfolio Report, you can view it in the Report Gallery tab.

Powered by Zendesk