Report XRay Test runs against their components

Questions & Answers
1

Hi,

I’m trying to get an overview of all Test runs against their corresponding components, however I can’t get this to work with a current calculated measure.

Goal: present a graph in the form of stacked bar holding the test run results (PASS / FAIL / …) of my test cases, mapped against the corresponding components linked to these test cases. This will help us to understand the amount of execution, coverage and maturity per component.
→ Basically I want to report similar statistics as for the measure “XRay Test Runs”, but with the option to report these numbers against their components.

Example:
|COMPNENT NAME | PASS |FAIL | PRECONDITION FAIL | ABORTED |
|COMP. DB|12500|145|33|100|
|COMP. FRONT-END|1325|345|12|43|
|COMP. API|3452|34|6|56|
|COMP. MOBILE|3466|123|59|3|

Currrent approach:

  • At the Y-axes, I have added “Project” as dimension, for which I selected category “Component”
  • For the X axes I’m using a calculated measure (see below), with as second dimension “XRay Test Execution status”
  • In the “Pages” area I can switch between platforms, environments, test plans,…
  • Measure to get the components tracked:

sum(
Filter(
Descendants([Xray Test].CurrenthierarchyMember, [Xray Test].[Test]),
[Measures].[Xray Tests created]>0
),
([Measures].[Xray Test Runs],
[Component].DefaultMember)
)

This calculated measure returns a very small subset of the numbers I’m getting when using “XRay Test runs” and furthermore there is still no split in components.

Any thoughts what I’m overlooking here?

2

Hi @Stijn,

You are very close with your calculation! The only thing is that when filtering Tests, you would need to ignore the Execution status as well. The further Test run measure will put that context back. Plase try the following:

Sum(
  Filter(
    Descendants([Xray Test].CurrentMember, [Xray Test].[Test]), 
    ([Measures].[Xray Tests created], 
    [Xray Test Execution Status].DefaultMember) > 0
  ), 
  ([Measures].[Xray Test Runs], 
  [Project].DefaultMember)
)

Lauma / support@eazybi.com

1 Like
3

thanks a lot, this worked!

4

Hi @Stijn & @lauma.cirule

do you get the Component from the Issue Type ‘Xray Test’ or ‘Xray Test Execution’?
We want to use the Component contained in the Xray Test and need a similar solution for that. Means, we contain Xray Tests with different Components in one Xray Test Execution and need an overview about the coverage of each Component.

Thanks and regards
Lars

5

Hi @Lars_H,

The majority of Xray-specific measures are grouped by fields of “Test Execution” issues, and only a few represent the fields of Test issues.
Measures representing Xray test executions and test run results are grouped by fields of Test Execution issues. For example, the measure “Xray Test Runs” used with dimension “Component” or “Project” would show test run count by component of Test Execution issues. See also the documentation section on Xray measures: Xray Test Management.

This is quite a common use case to analyze testing results by Test issue components, and we are looking forward to implementing new dimensions to support those use cases.
Meanwhile, you can use a workaround with calculated measure:

Sum(
  --filter set of Tests
  Filter(
    Descendants([Xray Test].CurrentMember,[Xray Test].[Test]),
    --Test has selected compoenent
    DefaultContext((
      [Measures].[Xray Tests created],
      [Xray Test].CurrentHierarchyMember,
      [Component].CurrentHierarchyMember
    )) > 0 ),
  --sum up test runs ignoring component assigned to Test Execution
  ([Measures].[Xray Test Runs],
  [Component].CurrentHierarchy.DefaultMember)
)

Best,
Zane / support@eazybi.com

6

Dear @zane.baranovska

your calculated measure works. Thanks a lot for your support.

Best wishes,
Lars

1 Like
7

Hi,

eazyBI has a new functionality for Xray data. Now, you can import Test fields as separate dimensions to group and filter test runs and executions using Test fields without complex calculations (this improves report performance). The feature is available on Cloud and since eazyBI version 7.2.

More details on documentation: Xray Test Management.

Check out this Community post for a solution with the new dimension for Test Compoent:

Best,
Zane / support@eazyBI.com

1 Like