Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add NIM flag logic #312

Merged

Conversation

trujillm
Copy link
Contributor

Add NIM flag logic

Description

This will get the nim flag state of removed or managed from params.env and add to the environment variables for odh-model-controller to be utilize

How Has This Been Tested?

Unit tests

  • The commits are squashed in a cohesive manner and have meaningful messages.
  • Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
  • The developer has manually tested the changes and verified that the changes work

Copy link
Contributor

openshift-ci bot commented Nov 26, 2024

Hi @trujillm. Thanks for your PR.

I'm waiting for a opendatahub-io member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

config/base/params.env Outdated Show resolved Hide resolved
@trujillm
Copy link
Contributor Author

@spolti do you know if I need to change something for the image tag failure?

Copy link
Contributor

@israel-hdez israel-hdez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please, change the target branch to incubating.
The main branch is now a stable/downstream branch.

@Jooho Jooho changed the base branch from main to incubating November 26, 2024 17:33
@trujillm trujillm requested a review from israel-hdez November 26, 2024 18:01
tgis-image=quay.io/opendatahub/text-generation-inference:stable-eba83ba
ovms-image=quay.io/opendatahub/openvino_model_server:2024.3-release-4c8c52c
vllm-image=quay.io/opendatahub/vllm:stable-849f0f5
nim-state=removed
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so in opendatahub-io/opendatahub-operator#1330, if not specify nim-state in DSC, it should pass down "managed" as default.
but here, if not get value from Operator, the default is removed.
isnt that inconsistent?
if the requirement from UX is, unless user explicitly set "removed" in DSC, then it is always "managed", then it should be nim-state=managed here, right?
in reality, it does not matter managed/remove/ "" in params.env since it will always be overrwritten by Operator. But if run odh-model-controller without Operator, then set "removed" here is different than "managed" also cause confusion in the code.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zdtsw I think the intent here was to add removed explicitly as a safety in case someone ever decides to change in params.env without taking modlemesh into consideration.

@Jooho
Copy link
Contributor

Jooho commented Nov 29, 2024

/retest

Copy link
Contributor

@israel-hdez israel-hdez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@trujillm I reviewed the commit and it is OK to me. Just, please, rebase on top of incubation to bring only your changes.

@@ -1 +1 @@
vllm-gaudi-image=quay.io/opendatahub/vllm:fast-gaudi
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@trujillm may you rebase your PR on incubation?
Looks like you did your changes on top of the main branch, which is no longer our default branch, and there are a lot of changes because of the different base branch.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@israel-hdez I believe I have corrected please verify and let me know if you need anything else from my side

@israel-hdez
Copy link
Contributor

/ok-to-test

Signed-off-by: mtrujillo <trujillo169@hotmail.com>
Copy link
Contributor

@israel-hdez israel-hdez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@openshift-ci openshift-ci bot added the lgtm label Dec 2, 2024
Copy link
Contributor

openshift-ci bot commented Dec 2, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: israel-hdez, spolti, trujillm

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-merge-bot openshift-merge-bot bot merged commit 9d6de07 into opendatahub-io:incubating Dec 2, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants