Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add report section summarizing failing assertions from all tests in a plan #1253

Open
mcking65 opened this issue Oct 21, 2024 · 0 comments
Open
Assignees
Labels
enhancement New feature or request

Comments

@mcking65
Copy link

mcking65 commented Oct 21, 2024

On report pages and in candidate review, we need a summary of assertion failures and an easy way to navigate to them.

This summary would include:

  1. A heading
  2. A summary statement
  3. A table of failing assertions

Content for the heading:

Summary of Failing Assertions (n must, n should)

Under the heading, a summary statement of form:

X assertions failed for Y commands in Z tests.

Columns in the table:

  1. Test name(make it a link to that test)
  2. Command
  3. Assertion Priority
  4. Assertion (show the phrase form of the assertion)
  5. {AT} Response: {AT} is the name of the AT, e.g., "JAWS Response"

In the candidate review experience, this summary would be the first page when the user opens the candidate review experience. It would have its own link at the beginning of the left nav just before test 1. Do not give it a number in the list; just name it "summary of Failing Assertions".

On report pages, this section would appear just after the summary of tests and before test 1.

For example, on the report page
JAWS and Chrome for Action Menu Button Example Using aria-activedescendant | ARIA-AT Reports,
this section would appear after the section titled "Results for JAWS and Chrome" and before the section titled "Test 1: Navigate forwards to a menu button in reading mode (16 passed, 0 failed)".

Accessibility Note: be sure the table is labeled by the heading.

@mcking65 mcking65 converted this from a draft issue Oct 21, 2024
@mcking65 mcking65 changed the title Add report table summarizing failing assertions from all tests in a plan Add report section summarizing failing assertions from all tests in a plan Oct 21, 2024
@mcking65 mcking65 added the enhancement New feature or request label Oct 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Development

No branches or pull requests

2 participants