Menu

Creating Custom Reports

Explore Data

Under Explore Data you can filter and group data in different views build your custom reports.

exploredata.png

NOTE: This feature is only available to users with Editor privilege

  • Requirements: Provide analysis view on Requirements data. 
  • Test Cases: Provide analysis view on Test Cases data.
  • Test Runs: Provide analysis view on Test Runs data.
  • Test Run Logs: Provide analysis view for each Test Run log result.
  • Defects (qTest): Provide analysis view on qTest Defects data.
  • Defects (Linked): Provide analysis view on Defects data from external tracker such as JIRA, VersionOne, and Rally | CA Technologies. Defects from external trackers have to be associated with qTest Test Run to be counted as Defects (Linked).
  • Manager Combined: This view combines test run data with a test case, requirement, and defect data. It's especially useful to build traceability reports.
  • Sessions: provide data of sessions recorded (using qTest Sessions) together with their associated defects, requirements, test cases, test runs.
  • Screens: provide screen information of recorded sessions, including their associated notes, defects

 custom1.png

 

 Options on Explore Data

  • Filter: filter data for your chart.  This will allow selecting of fields to build your chart or crosstab.
  • Create Chart: Click this tab and start creating your own chart. The chart will be built based on data of the data analysis grid. You can then turn the chart into different chart types like Bar, Line, Curved Line, Pie, Heat map, Gauge, and Scatter Plot.
  • Create Crosstab: Click this tab and start creating your own crosstab. The crosstab will be built based on data of the data analysis grid
  • Select fields to build your chart or crosstab
  • Create Formula: you can create new column from a formula.
  • Save Report: Give your report a name and save it so that you can manage and schedule it later.

 Chart and Cross Tab Functions 

  • Build your chart:  Check example articles on how to build chart/crosstab
  • Add Panel:  Add a panel based on your chart/crosstab
  • Remove:  Delete your chart/crosstab

 Analysis Grid 

Click the gear icon on the data grid section.

analysis1.png

  • Hide/show columns on the grid: all property columns of the object are listed out so that you can select columns you want to be displayed in the data grid.
  • Sort: Select “Sort”, you can sort any column of the data grid by ascending/ descending.
  • Group: Select “Group”, you can organize rows in the data grid with grouping and sub-grouping.
  • Aggregate: You can calculate totals, averages, and such for the top and grouped levels.

Export: Click the icon to  Export data to pdf, CSV, or Excel.

analysis2.png 

  • Click on column name to sort, filter, group, aggregate, add to chart, etc.
  • Drag & drop column around the grid: hold the icon  (left side of column header) to drag and drop your column to another position.
  • Resize column width: hold the icon  (right side of column header) and move the mouse to resize the column.

Note:

  • Click linked data on the grid to drill down to other data set. 
  • Data with a (Linked) label supports going to the external system like JIRA, VerionOne, and Rally | CA Technologies if you click on the Defect ID or Summary.
  • Access qTest by clicking on object names and IDs shown in the report: user can click to go back to qTest tab and view details on those objects.

Create Custom Chart

In this example, we're trying to build a chart of # of Test Runs by Test Cycle.

1. Select Test Runs under Explore Data section to open the Test Run Data page.

test_runs_explore_data.png

2. Click + Chart button to start building a chart of Test Runs by Test Cycle. Clear gear icon  to open the report settings, operators are listed below:

  • Label Column: Select "Test Cycle"
  • Data Column: Select "Test Run ID" value for this field to calculate the total # of test runs
  • Data Aggregation: Select "Distinct Count"
  • Compare Column: If you also want to show latest results, Select "Latest Result" 
  • Bar Orientation: Select Horizontal or Vertical

 The chart is automatically generated whenever you change any field's value.

countruns_bytest_cycle.png

Create Custom Crosstab

The below example describes how to build a crosstab based on the number of Defects by Status and Severity.crosstab.png

 

 Under Explore Data section, click Defects (qTest) to open Defect Data page.

 Click + Crosstab to start building the Crosstab.

  • Specify fields for crosstab row (Severity), crosstab column (Status), and crosstab cell (Defect ID) and the aggregation function (Count)
  • The example chart shows number of qTest Defects by Status and Severity

In the snapshot above, the sample in blue rectangles shows there is one new fatal defect.

Create Custom Formula 

From each subpage of Explore Data, you can create a Formula column. Formulas are expressions that must contain data columns and can include constants, functions, and operators.

  • Columns are values that come from the data.
    • Their names are enclosed in square brackets, like [ShippedDate].
    • Depending on their data type, they may be used as text strings, numbers, and date/time values.
  • Constants are simply specific fixed values that you enter into a Formula.
  • Functions return values, usually computations based on columns and constants.
  • Operators do arithmetic and logical comparisons.
    • Logical comparisons must be used with Case statements.

Check Formula Help for supported Functions and Operators.

formula.png

 Select Defects under Explore Data section to open the Defect Data page.

 Select Formula to start to build a new formula column.

In this example, we want to build a formula column named "Defect Severity", and we want to categorize High, Fatal defects into Critical, Major, Average into Medium and others into Low.

  • Insert a column: select the Severity 
  • Formula: input the following expression and click Add button.

case [Severity]
when 'High' then 'Critical'
when 'Fatal' then 'Critical'
when 'Major' then 'Medium'
when 'Average' then 'Medium'
else 'Low'
end

View the new column labeled "Defect Severity" displayed as the last column in the data table.

Tips for Formulas

1) To do decimal arithmetic, you must explicitly cast the column data type to be a float instead of just an integer 

For example: To calculate the percentage of not passing runs, a formula like "[Runs not passing]/[Total Run Logs]" will not work, and you should use the following:

(Cast([Runs not passing] as float)) / (Cast([Total Run Logs] as float))

2) Explicitly define the date format in date_part function.

For example: To get the year "2016" from a date "2016-10-07", use following function, note that you need to specify the right date format (in this example: YYYY-MM-DD)

date_part('year', to_date([Created Date], 'YYYY-MM-DD'))

 

Subscribe To Our Blog
Powered by Zendesk