Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RFC 106: Move wpt.fyi metrics generation into the WPT org #106

Merged
merged 5 commits into from
Mar 8, 2022
Merged
Changes from 2 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 19 additions & 0 deletions rfcs/wpt-results-analysis.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
# RFC 106: Move wpt.fyi metrics generation into WPT org

## Summary

Move https://github.com/Ecosystem-Infra/wpt-results and https://github.com/Ecosystem-Infra/wpt-results-analysis into the web-platform-tests GitHub org.

## Details

The following metrics on wpt.fyi are generated by wpt-results-analysis:

- Browser Specific Failures
- Compat 2021
- Interop 2022

wpt-results-analysis depends on wpt-results, a highly compressed form of all full wpt.fyi runs ever, currently ~52k stored in a ~385M Git repository. This makes it possible to load thousands (or all) runs into memory at the same time, speeding up metrics generation.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we rename wpt-results, as I think we don't want people thinking it's a canonical data-source? I'm much happier with making everyone treat wpt.fyi's API as the canonical source, and treat wpt-results as an internal implementation detail of result-analysis. Maybe wpt-results-analysis-cache?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

wpt-results-analysis-cache sounds good to me.

Ideally wpt.fyi itself would maintain a representation of results that can be efficiently queried, but that's would be a large undertaking.


## Risks

wpt-results-analysis depends on nodegit, which only works on Node.js 14.