[SDK] Get Trial Metrics from Katib DB

[andreyvelich]

Related: #2022.

I've added API to get Trial metrics from the Katib DB using Katib DB Manager gRPC API.
Usage:

cl = KatibClient()
trial_name = cl.get_experiment(name="test-experiment-1")["status"]["succeededTrialList"][0]
cl.get_trial_metrics(name=trial_name)[0]

"
time_stamp: "2022-12-05T14:42:08Z"
metric {
  name: "Train-accuracy"
  value: "0.112390"
}
"

Since we don't publish our gRPC as Python package, we can't modify the requirements for our Katib SDK.
In the setup.py script I copied the Katib gRPC APIs file to the appropriate location, so we can use it in the Katib client.

What do you think about it @johnugeorge @gaocegege @tenzen-y @kimwnasptd @anencore94 ?

In the long-term (if we are going to create Katib API Server) we might want to consider publishing the Katib API Server Python APIs to PyPI, so other users can make integration on top of it (what @anencore94 mentioned here: #2022 (comment)).

Kubeflow Pipelines team also publish their python kfp-server-api to the public registry.

/assign @johnugeorge @kimwnasptd @tenzen-y @anencore94

/hold for review

[google-oss-prow]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: andreyvelich

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [andreyvelich]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[johnugeorge]

How do we ensure files are uptodate and in sync?

[andreyvelich]

@johnugeorge It's a good point.

Maybe instead of checking that file kubeflow/katib/katib_api_pb2.py doesn't exist, we should check if ../../../pkg/apis/manager/v1beta1/python/api_pb2.py file exists and always replace it with the newest ?

katib_grpc_api_file = "../../../pkg/apis/manager/v1beta1/python/api_pb2.py"

# Copy Katib gRPC Python APIs to use it in the Katib SDK Client.
# We need to copy this file only on the SDK building stage, not on installation stage.
if os.path.exists(katib_grpc_api_file):
    shutil.copy(
        katib_grpc_api_file, "kubeflow/katib/katib_api_pb2.py",
    )

In that case, on the SDK building stage we always copy the newest gRPC APIs file ?

Any other suggestions @johnugeorge @tenzen-y ?

[johnugeorge]

Yeah. I think, "always copy" is the safer solution

[tenzen-y]

In that case, on the SDK building stage we always copy the newest gRPC APIs file?

sgtm

[andreyvelich]

@johnugeorge @tenzen-y I've made the change. It would be great if you could take a look.

[johnugeorge]

/lgtm

/hold
/assign @tenzen-y

[tenzen-y]

@andreyvelich Sorry for the late response.
Thanks for implementing this! This feature looks great!
/lgtm
/hold cancel