Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Katib ROCKs #17

Open
15 of 16 tasks
i-chvets opened this issue Jul 27, 2023 · 2 comments
Open
15 of 16 tasks

Katib ROCKs #17

i-chvets opened this issue Jul 27, 2023 · 2 comments

Comments

@i-chvets
Copy link
Contributor

i-chvets commented Jul 27, 2023

Description

Katib ROCKs are part of main epic for building secure images using ROCKs.
This issue is created to summarize details on ROCK design and track progress on ROCK creation for Katib.

Dockerfiles for Katib images:
https://github.com/kubeflow/katib/tree/master/cmd

Some sample work has been completed:
Python sample ROCK
Go sample ROCK

Remaining ROCKs:
Python based:
katib/cmd/suggestion/hyperband/v1beta1
katib/cmd/suggestion/pbt/v1beta1
katib/cmd/suggestion/skopt/v1beta1
katib/cmd/suggestion/optuna/v1beta1
katib/cmd/suggestion/nas/darts/v1beta1
katib/cmd/suggestion/nas/enas/v1beta1

Go based:
katib/cmd/suggestion/goptuna/v1beta1
katib/cmd/cert-generator/v1beta1 (#19)

When building ROCKs best practices should be followed.

Progress: Katib ROCKs

Completed ROCKs should be checked and corresponding PR should be indicated.

Not supported Katib images

The following images will not be converted to ROCKs, because those are used as simple examples and will not be used by end-users in production:

  • kubeflowkatib/darts-cnn-cifar10-cpu
  • kubeflowkatib/enas-cnn-cifar10-cpu
  • kubeflowkatib/mxnet-mnist
  • kubeflowkatib/pytorch-mnist-cpu
  • kubeflowkatib/simple-pbt
This was referenced Aug 17, 2023
i-chvets added a commit that referenced this issue Aug 21, 2023
Details are in #17

Katib ROCKs are part of main epic for building secure images using ROCKs.
ROCK for Katib suggestion-pbt is part of katib-config.

## Summary of changes:
- Initial ROCK created using best practices.

Manual test:
```
$ docker run suggestion-pbt_v0.15.0_22.04_1:v0.15.0_22.04_1 exec pebble exec bash -c 'export PYTHONPATH=/usr/local/lib/python3.10/dist-packages/:/opt/katib:/opt/katib/pkg/apis/manager/v1beta1/python:/opt/katib/pkg/apis/manager/health/python && python3 /opt/katib/cmd/suggestion/pbt/v1beta1/main.py'
2023-08-17T15:51:25.953Z [pebble] Started daemon.
2023-08-17T15:51:25.961Z [pebble] POST /v1/exec 7.498212ms 202
2023-08-17T15:51:25.968Z [pebble] GET /v1/tasks/1/websocket/control 7.135306ms 200
2023-08-17T15:51:25.968Z [pebble] GET /v1/tasks/1/websocket/stdio 22.686µs 200
2023-08-17T15:51:25.968Z [pebble] GET /v1/tasks/1/websocket/stderr 37.241µs 200
2023-08-17T15:51:25.978Z [pebble] POST /v1/exec 7.934274ms 202
2023-08-17T15:51:25.986Z [pebble] GET /v1/tasks/2/websocket/control 8.524151ms 200
2023-08-17T15:51:25.987Z [pebble] GET /v1/tasks/2/websocket/stdio 34.744µs 200
2023-08-17T15:51:25.987Z [pebble] GET /v1/tasks/2/websocket/stderr 33.835µs 200
```

Pebble service
```
$ docker run suggestion-pbt_v0.15.0_22.04_1:v0.15.0_22.04_1 exec pebble restart suggestion-pbt
2023-08-17T15:51:04.178Z [pebble] Started daemon.
2023-08-17T15:51:04.186Z [pebble] POST /v1/exec 8.107546ms 202
2023-08-17T15:51:04.194Z [pebble] GET /v1/tasks/1/websocket/control 7.225593ms 200
2023-08-17T15:51:04.194Z [pebble] GET /v1/tasks/1/websocket/stdio 36.127µs 200
2023-08-17T15:51:04.195Z [pebble] GET /v1/tasks/1/websocket/stderr 27.456µs 200
2023-08-17T15:51:04.206Z [pebble] POST /v1/services 9.485233ms 202
2023-08-17T15:51:04.238Z [pebble] Service "suggestion-pbt" starting: python3 main.py
2023-08-17T15:51:05.277Z [pebble] GET /v1/changes/1/wait 1.08205558s 200
2023-08-17T15:51:05.285Z [pebble] Stopping all running services.
2023-08-17T15:51:05.309Z [pebble] Service "suggestion-pbt" stopped
```
DnPlas added a commit that referenced this issue Aug 22, 2023
@i-chvets
Copy link
Contributor Author

The following images will not be converted to ROCKs, because those are used as simple examples and will not be used by end-users in production:

  • kubeflowkatib/darts-cnn-cifar10-cpu
  • kubeflowkatib/enas-cnn-cifar10-cpu
  • kubeflowkatib/mxnet-mnist
  • kubeflowkatib/pytorch-mnist-cpu
  • kubeflowkatib/simple-pbt

Updated description with this comment.

@i-chvets
Copy link
Contributor Author

@i-chvets To create issue to track not used Katib images elimnationm work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant