Skip to content
This repository has been archived by the owner on Jun 6, 2024. It is now read-only.

make yarn exporter export per node metrics #2231

Closed
xudifsd opened this issue Feb 28, 2019 · 3 comments
Closed

make yarn exporter export per node metrics #2231

xudifsd opened this issue Feb 28, 2019 · 3 comments
Assignees
Milestone

Comments

@xudifsd
Copy link
Member

xudifsd commented Feb 28, 2019

What would you like to be added:

emit yarn_gpus_used with each node's info.

Why is this needed:

Current result for query of yarn_gpus_used is yarn_gpus_used{cluster="cluster_0",instance="xx.xx.xx.xx:9459",job="pai_serivce_exporter",pai_service_name="hadoop-resource-manager",scraped_from="hadoop-resource-manager-ds-9tkc4"}

this metrics from http://xx.xx.xx.xx:8088/ws/v1/cluster/metrics , should change it to http://xx.xx.xx.xx:8088/ws/v1/cluster/nodes, which has more information, should be good for debugging and calculating free gpu of each node.

Without this feature, how does the current module work

Can not break down yarn_gpus_used

Components that may involve changes:
yarn-exporter

@xudifsd xudifsd self-assigned this Feb 28, 2019
@xudifsd xudifsd added this to the 0.11.0 milestone Feb 28, 2019
@xudifsd
Copy link
Member Author

xudifsd commented Feb 28, 2019

this blocking #2208

@fanyangCS
Copy link
Contributor

@xudifsd and @mzmssg , is it possible to get that from RM?

@mzmssg
Copy link
Member

mzmssg commented Feb 28, 2019

@fanyangCS
previous and new metrics are both from RM, we just switch yarn-exporter source to a more detailed API.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

4 participants