Skip to content
This repository has been archived by the owner on Jun 6, 2024. It is now read-only.

Need job usage report #2127

Open
scarlett2018 opened this issue Feb 2, 2019 · 4 comments
Open

Need job usage report #2127

scarlett2018 opened this issue Feb 2, 2019 · 4 comments

Comments

@scarlett2018
Copy link
Member

scarlett2018 commented Feb 2, 2019

Queuing time, Job Status Summary, Job completion w/o system error, Long running jobs completion rate, etc.
User Usage Summary, VC Usage Summary.

By time, by status, by user

USTC Xinwei had shared sample scripts offline.

image

Retry should also be considered.
For failure jobs, failure reasons should also reported for ops improvement and DRI.

@scarlett2018 scarlett2018 changed the title Need usage report Need job status report Mar 15, 2019
@scarlett2018 scarlett2018 added this to the 0.12.0 milestone Mar 15, 2019
@scarlett2018 scarlett2018 changed the title Need job status report Need job usage report Mar 19, 2019
@xudifsd
Copy link
Member

xudifsd commented Mar 26, 2019

These info can be get from launcher from :9086/v1/Frameworks, if combined info from #2073 , we can calculated resource that wasted(the job finally failed/killed).

@scarlett2018
Copy link
Member Author

These info can be get from launcher from :9086/v1/Frameworks, if combined info from #2073 , we can calculated resource that wasted(the job finally failed/killed).

Would you like to merge #2073 with this item? what's the estimation to have both #2127 and #2073 in place? Let's combine them if it makes tracking easier.

@xudifsd
Copy link
Member

xudifsd commented Mar 26, 2019

No, I think #2073 is relatively easy to implement, but this requires more efforts. Let's track them in different issues.

@scarlett2018
Copy link
Member Author

There are some experiment for job dashboard done in PowerBI, it's time to revisit, whether these things work well for v1.x. And whether there are any new needs to better understand the overall job utilization.

@scarlett2018 scarlett2018 added this to the Backlog milestone Jul 22, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

3 participants