Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update progress score #22

Closed
bramus opened this issue Aug 26, 2022 · 12 comments
Closed

Update progress score #22

bramus opened this issue Aug 26, 2022 · 12 comments

Comments

@bramus
Copy link
Collaborator

bramus commented Aug 26, 2022

Quoting #20 (comment)

A decision on how progress on the overall investigation effort will be scored, and that the viewport team makes a first recommendation on what the current score should be?

@bramus
Copy link
Collaborator Author

bramus commented Sep 7, 2022

Discussed during #20. Lacking a proper framework, it feels like picking an abitrary number.

We do see two parts:

  1. Identifying the issues
  2. Pursuing fixes for the issues

We think we are over 50%, but lacking a proper framework we don’t know which exact score to give us yet.

@foolip
Copy link
Member

foolip commented Sep 8, 2022

@bramus this is going to be somewhat subjective, no doubt about it. Are you done with the first step and what remains is pursuing fixes? If so, and if you think the first part represents about half of the work, then calling it 50% and scoring the rest based on the number of issues resolved sounds fine. How many distinct issues are you splitting this into?

@bramus
Copy link
Collaborator Author

bramus commented Sep 15, 2022

Sounds good. Would say we’re at 60% in that case.

@bramus bramus closed this as completed Sep 15, 2022
@foolip
Copy link
Member

foolip commented Sep 15, 2022

Thanks @bramus! I'll bring this up in the interop meeting today, and work on the code to integrate the score of investigation efforts into the total score.

@jensimmons
Copy link

In mid-September you judged this effort to be 60% complete. It's now two months later. Is 60% still the correct number? Could you update your score?

@jensimmons jensimmons reopened this Nov 28, 2022
@jensimmons jensimmons changed the title Determine how to score progress Update progress score Nov 28, 2022
@bramus bramus added Agenda+ and removed Agenda+ labels Dec 14, 2022
@bramus
Copy link
Collaborator Author

bramus commented Dec 14, 2022

We discussed this during #28.

Overall we think we’ve discussed all problem areas that we have identified, except for one: -webkit-fill-available (#18). This is still a bit of a dark area that has not been properly discussed. Events also weren’t discussed in this effort.

As a result, we think we can end up with a rather high score of 85% to 90%.

This score is under the assumption that the remainder of the current open Discussed issues get closed by doing the follow-up work at the proper venues. @bramus will do so this week.

@bramus bramus closed this as completed Dec 14, 2022
@foolip
Copy link
Member

foolip commented Dec 14, 2022

Thanks for the update @bramus! Do you think that 60% is accurate as of today, or when should we update the score to 85%, 90% or something between 60% and those?

@bramus
Copy link
Collaborator Author

bramus commented Dec 19, 2022

The proposed score of 85%-90% is accurate as of last week.

@foolip
Copy link
Member

foolip commented Dec 19, 2022

@bramus shall we call it 90% then? I have to pick a specific number :)

@foolip
Copy link
Member

foolip commented Dec 19, 2022

I've sent web-platform-tests/wpt.fyi#3084 to call it 90%. We'll need sign-off from the interop team before we merge that, I'll put it on the agenda for the next meeting (Thursday).

@foolip
Copy link
Member

foolip commented Dec 19, 2022

If I got the math right, that should give exactly a 1% bump in everyone's scores.

@bramus
Copy link
Collaborator Author

bramus commented Dec 19, 2022

Perfect!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants