Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature: Weighting metadata preference for WPT dashboard or Interop scoring (file | subtest | other?) #6466

Open
cookiecrook opened this issue Jun 27, 2024 · 0 comments

Comments

@cookiecrook
Copy link
Contributor

Feature: Weighting metadata preference for WPT dashboard or Interop scoring (file/subtest/other)

I noticed weighting for this directory was giving 33% weight to 2% of the subtests. In this particular case, the test files were broken up arbitrarily for authoring convenience, so weighting evenly per subtest failure would be a better choice.

However, that's not always the case in other directories... /encoding tests for example would count for ~60% of the WPT score if all subtests were weighted evenly. So that wouldn't be the best solution either.

Perhaps in wpt-metadata, a top-level directory or subdirectory could hint which choice [ file | subtest | other? ] would be a better selection for scoring Inerop and other WPT CI results.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant