This release includes a new Report Gallery tab which enables you to view a variety of pre-configured reports that help you understand your data and gain insights quickly.
The following reports are now available within the Report Gallery:
- Portfolio Overview
- Portfolio Progress
- Defect Analysis
Portfolio Reporting allows you to group releases or test suites across projects and view data summarized together. If you manage many Releases across Projects or use strategic themes for your Releases, but they are across qTest Projects, this report is for you!
Portfolio Reporting provides cross-project data through two reports:
- Portfolio Overview: allows you to view cross-Project data, Test Run status, and JIRA defect status at the portfolio level for health analysis.
- Portfolio Progress: displays reports for Test Runs, JIRA defect status, progress, and defect trend by Release or Test Suite across projects.
Portfolio Reporting is currently available for Release and Test Suite data. Configuration is required before beginning use.
Read this article for more information on Portfolio Reporting and how to get started.
- Before creating a portfolio, you must tag Releases or Test Suites using a Site Field. Site Fields are used by the portfolio report as a cross-project aggregator. It is recommended to create a new site field called portfolio at the admin level and tag all Releases or Test Suites with the site field across the needed projects
- The Portfolio Site and Date fields are configured in qTest Manager at the Site Field level.
- The new features listed below are important for the configuration process of Portfolio Reporting. If you do not set up Portfolio then the report will be blank.
Portfolio Report Settings
The Portfolio Report settings page allows you to create, view and manage your Portfolios. Using the settings, you can edit the following:
- Portfolio Configuration: Define your portfolio's basic settings and properties.
- Jira Defect Status Mapping: Standardize your cross-project Jira Defect Status values onto one streamlined set of Insights Defect Status values.
- Jira Defect Severity Mapping: Standardize your cross-project Jira Defect Status values onto one streamlined set of Insights Defect Status values.
- Jira Defect Custom Fields: Choose which Jira Defect Custom Fields you want to populate in your Portfolio Reports.
The Defect Analysis Report is now available within the Report Gallery. Here, you can view both the latest Test Run results and Defect Statuses concerning both linked and unlinked Defects. This report allows you to analyze the quality of development.
The Defect Analysis Report includes three charts:
- Latest Test Run Results: Pie chart displaying the latest test run results by status.
- Defect Status: Pie chart displaying the number of defects of each status (including Jira defects linked and unlinked).
- Defect Details: Table data for all the defects created in Jira or Manager. The data is ordered by ID and excludes these statuses: Closed, Deferred, Withdrawn and Rejected.
You can apply the Global Filter to the Report and then save filter settings so that teams can re-visit the report without having to reconfigure filters. You will also be able to create an embedded URL for their Defect Analysis Reports.
Note: The Defect Analysis Report will not have any statuses automatically applied in the filter. You will have to select statuses to generate charts and data.
Jira Defect Custom Fields in the Explore Data/ External Defects (Linked) report
Your Jira Defect Custom fields are now available in the Explore Data/ External Defects (Linked) report. This feature allows you to view custom fields brought in from Jira within Insights reporting making defect traceability within qTest Insights even richer. To make use of this feature, follow these steps:
- In Insights, select the Settings tab. Choose Jira Defect Custom Fields in the drop-down menu.
- Choose you Jira Defect Custom Fields that you want to populate in your report by dragging and dropping them from Available Jira Fields to Selected Jira Fields.
- Select Save. These fields will now populate in your Explore Data/ External Defects (linked) report.
Improved Manager Combined Reports
The Manager Combined Report is now separated into three different reports. Each report will contain more standard defect fields for each kind of defect:
- Manager Combined/ qTest Manager
- Manager Combined/ Jira
- Manager Combined/ Rally
The following Jira System Fields are now available in the Explore/ Manager Combined/ Jira Report:
- Jira Project
- Jira Issue Type
- Jira Priority
- Jira Status
- Jira Created Date
- Jira Assignee
- Jira Reporter
- Jira Resolution
- Jira Resolved Date
- Jira Affects Versions
- Jira Fix Versions
The Rapid Dashboard is an alternative to the Shareable Dashboard as it loads quicker using a pre-generated dashboard URL. You can generate a Rapid Dashboard URL for a ‘Shared Dashboard’ that has been ‘Saved with Filters.’
The Rapid Dashboard provides read-only data that refreshes every hour. Therefore it is not real-time. Additionally, you need to have an active Dashboard Token generated before using the Rapid Dashboard feature.
To use the Rapid Dashboard, do the following:
- From the Insights homepage, select the Dashboards tab.
- In the Dashboards drop-down, select Manage and the Manage Dashboards page displays.
- Locate the group of Shared Dashboards within the Saved with Filters section of the screen.
- Select the Rapid Dashboard checkbox that is aligned with the dashboard for which you want to create a Rapid Dashboard URL.
Note: Once you disable a Rapid Dashboard, the Rapid Dashboard URL will no longer be visible for you to copy or share with others. You would be required to generate a new Rapid Dashboard URL.
- Once the checkbox is selected, it may take up to 15 minutes to generate the Rapid Dashboard URL. You will see the following message to confirm the URL generation process has begun.
- To use the Rapid Dashboard URL, select the blue, Action icon to the left of the Dashboard name.
- The Rapid Dashboard URL link will be disabled (grey font) until the URL generation is complete.
Hint: You can refresh the screen to check the status.
Once complete, the Rapid Dashboard URL will be enabled (black font) as seen below.
- Select the enabled Rapid Dashboard URL link to copy or email the URL.
- The Rapid Dashboard URL will not generate for old charts on existing dashboards. Therefore you can only generate a Rapid dashboard for newly created charts.
New Test Run by Test Case Type Chart
A new chart for a Test Run by Test Case Type is now available in the Dashboard Gallery. This chart provides the number of Test Runs in each project by Test Case Status. There is also a local filter for "Latest Execution End Date" so that you can limit the data returned by a specific date range.
Additionally, you can export the data table into a PDF or Excel format.
In Explore Data, the term 'Defects (Linked)' has been renamed to 'Defects (External)' to better represent the type of defect data.
- Linked Defects are defects from an External Instance that have been linked to qTest Test Runs.
- Unlinked Defects are defects that, while from an External Instance, are not linked to any qTest objects. This is currently only available for Jira.
External defects from Jira, VersionOne, and Rally populate in qTest Insights Explore Data Defects Reports.
Additionally, the External Defects are now separated by the tool name in the Explore Data >Defect External drop-down menu. Previously, all External Defects, whether from Rally or Jira, would populate in the same section. This change improves both site organization and load-time.
Defect Status (External) Panel
A Defect Status (External) Panel is now available in the Dashboard Gallery and allows you to view external defects both linked and unlinked to qTest Test runs. Previously, there was only a panel for Linked Defects. This panel is available to add to your Dashboard and you can filter the viewable data using the embedded filter.
The panel counts all available external defects integrated to the site (Jira linked, Jira unlinked, Rally linked, VersionOne linked) and also contains a local filter for all available defect integration.
Bug Fixes and Improvements
- Ticket 18313: There is no longer an issue viewing charts in delivered PDF's.
- Ticket 18855: There is no longer a mismatch between the Insights Velocity report and data in Manager.
- Ticket 19588: Dashboards opened from the "Saved with Filers" option in an internet tab retain the same Dashboard name even if you selected a different Dashboard from "Saved with Filters."
- Tickets 19692, 19672, 19650: You can now aggregate the sum for the following columns in their associated Explore Data Reports.
- Test Run Logs report>Execution in Minutes column
- Test Run report>Latest Execution Minutes column
Note: If you have a Saved Report using these columns, you will need to rebuild your report to allow for improvement.
- Ticket 19648: Custom Charts on a Dashboard will no longer include drill-down links.
- Ticket 20254: The back button now works when in Portfolio Overview.
- Ticket 20898: In Explore Defects, you can now access the defect (qTest) field "description," and export defect details. Previously, this feature was not accessible.
- Ticket 20766: Data now consistently displays in both Dashboards and Explore Data. Previously, data did not display correctly in Dashboards.