Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for selective test run with a testplan #372

Closed
delatrie opened this issue Aug 2, 2023 · 1 comment · Fixed by #390 or #392
Closed

Add support for selective test run with a testplan #372

delatrie opened this issue Aug 2, 2023 · 1 comment · Fixed by #390 or #392
Assignees
Labels
task:new feature Requesting new capability or software feature theme:core

Comments

@delatrie
Copy link
Contributor

delatrie commented Aug 2, 2023

There is a general mechanism used by Allure integrations to run tests selectively. It uses a testplan - a .json file with the following schema:

{
    "type": "object",
    "properties": {
        "tests": {
            "type": "array",
            "items": {
                "type": "object",
                "properties": {
                    "id": { "type": "string" },
                    "selector": { "type": "string" }
                }
            }
        }
    }
}

A path to a testplan is provided as a value of the ALLURE_TESTPLAN_PATH environment variable.

If a valid testplan file is provided, only matched tests should be run. A test is matched if there is at least one entry in the tests array, such that:

  1. It has either the id property, or the selector property or both, AND
  2. If the id property is present in the entry, it must be the same as the Allure ID of the test, AND
  3. If the selector property is present in the entry, it must be the same as the fullName of the test.

Motivation

Put allure-csharp integrations in line with other Allure integrations in terms of features.

@delatrie
Copy link
Contributor Author

Done. Included in 2.10.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
task:new feature Requesting new capability or software feature theme:core
Projects
None yet
1 participant