-
Notifications
You must be signed in to change notification settings - Fork 60
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add NIM flag logic #312
Add NIM flag logic #312
Conversation
Hi @trujillm. Thanks for your PR. I'm waiting for a opendatahub-io member to verify that this patch is reasonable to test. If it is, they should reply with Once the patch is verified, the new status will be reflected by the I understand the commands that are listed here. Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
6d6274a
to
0e9e122
Compare
@spolti do you know if I need to change something for the image tag failure? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please, change the target branch to incubating
.
The main
branch is now a stable/downstream branch.
config/base/params.env
Outdated
tgis-image=quay.io/opendatahub/text-generation-inference:stable-eba83ba | ||
ovms-image=quay.io/opendatahub/openvino_model_server:2024.3-release-4c8c52c | ||
vllm-image=quay.io/opendatahub/vllm:stable-849f0f5 | ||
nim-state=removed |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
so in opendatahub-io/opendatahub-operator#1330, if not specify nim-state in DSC, it should pass down "managed" as default.
but here, if not get value from Operator, the default is removed.
isnt that inconsistent?
if the requirement from UX is, unless user explicitly set "removed" in DSC, then it is always "managed", then it should be nim-state=managed
here, right?
in reality, it does not matter managed/remove/ "" in params.env since it will always be overrwritten by Operator. But if run odh-model-controller without Operator, then set "removed" here is different than "managed" also cause confusion in the code.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@zdtsw I think the intent here was to add removed explicitly as a safety in case someone ever decides to change in params.env without taking modlemesh into consideration.
/retest |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@trujillm I reviewed the commit and it is OK to me. Just, please, rebase on top of incubation
to bring only your changes.
config/base/params-vllm-gaudi.env
Outdated
@@ -1 +1 @@ | |||
vllm-gaudi-image=quay.io/opendatahub/vllm:fast-gaudi |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@trujillm may you rebase your PR on incubation
?
Looks like you did your changes on top of the main
branch, which is no longer our default branch, and there are a lot of changes because of the different base branch.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@israel-hdez I believe I have corrected please verify and let me know if you need anything else from my side
/ok-to-test |
0e9e122
to
aee3e05
Compare
Signed-off-by: mtrujillo <trujillo169@hotmail.com>
f8c02d4
to
84ba988
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
/lgtm
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: israel-hdez, spolti, trujillm The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
9d6de07
into
opendatahub-io:incubating
Add NIM flag logic
Description
This will get the nim flag state of removed or managed from params.env and add to the environment variables for odh-model-controller to be utilize
How Has This Been Tested?
Unit tests