Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a test case identifier on the flow level (similar to current tag) #2227

Open
OphelieC opened this issue Jan 6, 2025 · 1 comment
Open

Comments

@OphelieC
Copy link

OphelieC commented Jan 6, 2025

Use case

We need to be able to track our test results to submit test reports to stakeholders and/or a compliance organism. In my case, we are using Xray, a JIRA app, to track coverage of security, safety and privacy requirements.

Other test case management app such as Testrail, also exist on the market and would most probably benefit from this.

The test case id wouldn't change on its own. Some flows (if not all) would be manually given a specific test case id that matches a test case key from our test case management app. That id would be shown in the .xml report that can then be used to upload the results of the test execution in the test case management app.

Currently, the JUnit report that Maestro provides includes such a field, but there is no way to change it.

<?xml version='1.0' encoding='UTF-8'?>
<testsuites>
  <testsuite name="Test Suite" device="xxxxxx" tests="1" failures="0" time="12">
    <testcase id="test-login" name="test-login" classname="test-login" time="12" status="SUCCESS"/>
  </testsuite>
</testsuites>

Proposal

The YAML of the flow could look like this:

appId: com.example
name: Test the login process
testCase: T-001
---
- launchApp

The JUnit output would then look like this:

<?xml version='1.0' encoding='UTF-8'?>
<testsuites>
  <testsuite name="Test Suite" device="xxxxxx" tests="1" failures="0" time="12">
    <testcase id="T-001" name="test-login" classname="test-login" time="12" status="SUCCESS"/>
  </testsuite>
</testsuites>

Anything else?

Xray documentation about uploading test execution results

Copy link

linear bot commented Jan 6, 2025

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant