Prometheus metrics

[pingsutw]

TL;DR

Emit some metrics from the agent service.

• http://localhost:9090/

# HELP python_gc_objects_collected_total Objects collected during gc
# TYPE python_gc_objects_collected_total counter
python_gc_objects_collected_total{generation="0"} 2855.0
python_gc_objects_collected_total{generation="1"} 595.0
python_gc_objects_collected_total{generation="2"} 40.0
# HELP python_gc_objects_uncollectable_total Uncollectable object found during GC
# TYPE python_gc_objects_uncollectable_total counter
python_gc_objects_uncollectable_total{generation="0"} 0.0
python_gc_objects_uncollectable_total{generation="1"} 0.0
python_gc_objects_uncollectable_total{generation="2"} 0.0
# HELP python_gc_collections_total Number of times this generation was collected
# TYPE python_gc_collections_total counter
python_gc_collections_total{generation="0"} 684.0
python_gc_collections_total{generation="1"} 62.0
python_gc_collections_total{generation="2"} 5.0
# HELP python_info Python platform information
# TYPE python_info gauge
python_info{implementation="CPython",major="3",minor="10",patchlevel="11",version="3.10.11"} 1.0
# HELP flyte_agent_req_success_count_total Total number of successful requests
# TYPE flyte_agent_req_success_count_total counter
flyte_agent_req_success_count_total{operation="get",task_type="sleep"} 60.0
# HELP flyte_agent_req_success_count_created Total number of successful requests
# TYPE flyte_agent_req_success_count_created gauge
flyte_agent_req_success_count_created{operation="get",task_type="sleep"} 1.694202247743242e+09
# HELP flyte_agent_req_failure_count_total Total number of failed requests
# TYPE flyte_agent_req_failure_count_total counter
# HELP flyte_agent_req_latency Time spent processing agent request
# TYPE flyte_agent_req_latency summary
flyte_agent_req_latency_count{operation="get",task_type="sleep"} 60.0
flyte_agent_req_latency_sum{operation="get",task_type="sleep"} 3.2433389551006258
# HELP flyte_agent_req_latency_created Time spent processing agent request
# TYPE flyte_agent_req_latency_created gauge
flyte_agent_req_latency_created{operation="get",task_type="sleep"} 1.694202247690391e+09
# HELP flyte_agent_input_literal_size Size of input literal
# TYPE flyte_agent_input_literal_size summary

Type

• Bug Fix
• Feature
• Plugin

Are all requirements met?

• Code completed
• Smoke tested
• Unit tests added
• Code documentation added
• Any pending items have an associated Issue

Complete description

Use prometheus-client to add the metrics.

Tracking Issue

flyteorg/flyte#3936

Follow-up issue

NA

[codecov]

Codecov Report

Patch coverage has no change and project coverage change: -0.39% ⚠️

Comparison is base (ba571cd) 18.73% compared to head (2f4833f) 18.35%.
Report is 7 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #1815      +/-   ##
==========================================
- Coverage   18.73%   18.35%   -0.39%     
==========================================
  Files         332      335       +3     
  Lines       31390    32081     +691     
  Branches     3081     3161      +80     
==========================================
+ Hits         5882     5889       +7     
- Misses      25424    26107     +683     
- Partials       84       85       +1     

Files Changed	Coverage Δ
flytekit/clis/sdk_in_container/serve.py	0.00% <0.00%> (ø)
flytekit/extend/backend/agent_service.py	0.00% <0.00%> (ø)

... and 21 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.