Legacy Cross Project Reporting

All qTest cross project reporting should be done through qTest Insights - our self-service business intelligence tool for test analytics. 

IMPORTANT: This article refers to our legacy reporting.  All future cross project reporting should be done in qTest Insights. 

Accessing Legacy Cross Project Reports

1. Under Site Administration, click the Reports tab.
2. The two reports are listed in the left menu.
3. Click on the links to open each report.

Defects Across Projects

This report provides you the detailed data of all Defects from multi-projects at the report run time.  Follow these steps to view the report.

1. Select Defects from the menu on the left-hand side.
2. By default, the report is loaded with no data.  Users must select the project to show the report.
3. After selecting one or more projects from the drop down list, click Show to view the data grid.
4. It may take a while for the report to be processed.  The result is paging. You can navigate to the other pages to view the data.
   
   
5. The report can be exported to an Excel file by clicking the Download XLS button.  You can leverage the file for further analysis.

   

Test Execution Across Projects

This report provides you detailed data of all of Test Execution from multi-projects at the report run time.  Follow these steps to view the report.

1. Select Test Executions from the menu on the left-hand side.
2. By default, the report is loaded with no data.  Users must select the project to show the report.
3. After selecting one or more projects from the drop down list, click Show to view the data grid.
   
   
4. It may take a while for the report to be processed.  The result is paging. You can navigate to the other pages to view the data.
5. The report can be exported to an Excel file by clicking the Download XLS button.  You can leverage the file for further analysis.

   

To view those reports on multiple projects, do the following,

1. Create a project group.  The project group will have its own values for Test Runs Status, Defect Status and Release.  The Site Administrator must map the values of each selected project with the group values.
2. Share a project group with certain users or project user profiles.
3. qTest Manager users who have been shared with a project group will see its reports in the Report tab of any accessible projects. 

Create a Project Group

1. In the Site Administration page, click the Project Groups tab.
2. Click the + Add new group button. 
   
   
   
   
3. Click the project group name to rename it.
4. Select which projects to add to the project group by checking on their respective check boxes.
5. Click the Mapping button. 
   
   
   
   
6. Since each project has its own custom field settings, you must map the Test Run Status, Release and Defect Status of the project group with the values defined in each project.
7. A project group is pre-populated with default value sets for Test Run Status and Defect Status when it is created.  You can edit or define new values by clicking the Gear icon next to Test Run Status, Release or Defect Status.
   
   

Editing a Project Group

1. Hover over the desired project group.  Click on the Gear icon.  You can edit the project group name and add or remove projects to the group. 
   
   
   
   
   
   
2. Click the Mapping button and select the Gear icon next to Test Run Status, Release or Defect Status to edit their values.
3. Click a display name to rename the value.
   • Toggle the Active check box to activate and deactivate the value.
   • For Test Run and Defect Status, you can select a color to represent the value.
   • Re-order or remove a value by clicking on the corresponding icons in the Action column.
   • Click + Add Value to add new custom values.
     
     
     
     
   • Select project values from the corresponding drop down box.  One project group value can be mapped with multiple project values.
   • One project value cannot be mapped to multiple project group values.  You must map the project group's values of Test Run Status, Release and Defect Status with the values from each selected project.
     
     
     
     To delete a Project Group, hover over the desired project group.  Click on its x icon.
     
     

Sharing a Project Group

For a user to view the cross project reports of your project group, the project group must be shared with the user.

1. Hover over the project group you want to share and click the share icon.

   

2. The Share Project Group pop-up displays.  Select specific user profiles or users with whom you want to share the project group.  Click the Add button to add them to the grid.

   Each selected profile or user will be added as one record on the grid.

   • Shared with specific user profiles: Users can view cross project reports in the Report tab of any projects to which they have access with the specified profiles.
   • Shared with individual users: These users can view cross project reports in the Report tab of any projects they have access

   

To unshare a project group, do the following.

1. Hover on the project group you want to share and click on the share icon.  On the grid, hover over the desired user or profile.  Click the X icon to remove it.

   "

Viewing Cross Project Reports

These reports show data based on the project group defined by the Site Admin.  Once the project group has been created and shared with users, these users can view reports by doing the following.

1. Select a qTest Manager project.
2. Select the Report tab on the top navigation.
3. On the left panel, click Cross Project Reports to expand it.  You will see all project groups shared with you.
4. Expand the folder of a project group and select a report you want to view.

IMPORTANT: For now, our reports have not supported defects tracked in the external system.  If your projects are integrated with an external defect tracker, the report will show no defect. 

Test Execution Summary

This Report provides the Test Execution details at report run time.  The report can be filtered by Release and Test Run Type.  To view this report, follow these steps.

1. Select Test Execution Summary Report under a project group from the left menu.
2. Select a Release and a Test Execution Type.
3. Click the Show button to view the report.

In the Report Settings section, you can select one Release and one Test Execution Type to filter the report.

The Latest Information section shows the current number of Test Runs and the detailed number of Test Runs being grouped by the latest execution results in the selected Release.  Execution result values are defined in the Project Group's settings and are mapped with the project values.

The Chart and Legends area shows your Test Execution data reported in the form of a Pie Chart.  The chart shows the portions of the Test Runs grouped by their latest execution results.

In addition to the Chart, the report provides a detailed table of each Test Execution that meets your selected filter.

You can export the grid to an Excel file.  The file can be exported to different formats such as XLS, PDF, and CVS.  Click the Mail button to receive an email containing the exported report. 

Testing Velocity

This Report provides the Rollup of time per Test Execution to a test suite/cycle/build/release and the difference between planned and actual time.

1. Select the Testing Velocity Report under a project group from the left menu.
2. Filter the report by Release and Test Run Type.
3. Select a Time Unit to display Execution Time in the report.
4. Click the Show button to generate the report.

In the Report Settings section, select a Release and a Test Execution Type to filter the report.  Select a Time Unit to display the data.

The Summary with Latest Information section shows the latest information for execution time in four terms.

• Total Planned Time: Sum of planned execution time of all Test Run Logs in the selected Report Settings.
• Total Actual Time: Sum of the actual execution time of all Test Run Logs in the selected Report Settings.
• Planned Time: Sum of planned execution time of all latest Test Logs of Test Runs in the selected Report Settings.
• Actual Time: Sum of actual execution time of all latest Test Logs of Test Runs in the selected Report Settings

The Data Grid contains a detailed Report of Test Execution Time.

You can export the grid to an Excel file.  The file can be exported to different formats such as XLS, PDF, and CVS.  Click the Mail button to receive an email containing the exported report. 

Execution Status with Defects

This report provides an overview of the execution status of a specific Release along with the total test cases executed and their associated defects.

1. Select the Execution Status With Defects report under a project group from the left menu.
2. Select a specific Release and a Test Case Type.
3. Click the Show button to view the report.

In the Report Settings section, select a Release and Test Case Type to filter the report.

The Data Grid contains the detailed data of the test cases that were executed and their associated defects.

You can export the grid to an Excel file.  The file can be exported to different formats such as XLS, PDF, and CVS.  Click the Mail button to receive an email containing the exported report.