Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Plan changing assertion verdicts to PASS/FAIL from GOOD/NO/INCORRECT output #961

Closed
3 tasks done
jugglinmike opened this issue Jun 29, 2023 · 1 comment
Closed
3 tasks done

Plan changing assertion verdicts to PASS/FAIL from GOOD/NO/INCORRECT output #961

jugglinmike opened this issue Jun 29, 2023 · 1 comment

Comments

@jugglinmike
Copy link
Contributor

jugglinmike commented Jun 29, 2023 •
edited by mcking65
Loading

Currently, assertion verdicts can have one of three possible values. The words used to describe those values are contextual:

Working Mode term ARIA-AT App term
supported good output
not supported no output
incorrectly supported incorrect output

The community group agreed to reduce the number of states to just two: "pass" and "fail." See #945 for the discussions that motivated this change.

Implementation Requirements

This issue is complete when the following issues are fully specified and planned.
@jugglinmike jugglinmike mentioned this issue Jun 29, 2023
Closed
@mcking65 mcking65 changed the title Reduce assertion verdicts from three states to two states Plan changes required to reduce number of possible assertion verdicts from three states to two states Aug 2, 2023
@mcking65 mcking65 changed the title Plan changes required to reduce number of possible assertion verdicts from three states to two states Plan changes required to reduce number of assertion verdicts from three to two Aug 4, 2023
@mcking65 mcking65 changed the title Plan changes required to reduce number of assertion verdicts from three to two Plan changing assertion verdicts to PASS/FAIL from GOOD/NO/INCORRECT output Aug 5, 2023
This was referenced Aug 5, 2023
Closed
Closed
Closed
Closed
@ccanash
Copy link

ccanash commented Dec 12, 2023

Closing as done as the associated tasks are already in production. cc @mcking65

@ccanash ccanash closed this as completed Dec 12, 2023
@ccanash ccanash moved this from In Progress to In production / Completed in Refactor ARIA-AT test structure and test result presentation project Dec 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
Refactor ARIA-AT test structure and test result presentation project
Status: In production / Completed
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jugglinmike @ccanash