Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RHOAIENG-7127] Changing image in serving runtime now updates isvc. Can use annotatio… #515

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

andresllh
Copy link
Member

@andresllh andresllh commented Mar 3, 2025

…n to specify behavior for auto-updates.

What this PR does / why we need it:

Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #3299

Type of changes
Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

Feature/Issue validation/testing:

Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so it can be reproduced.
Please also list any relevant details for your test configuration.

  • Test A No Annotation
  1. Created a serving runtime
  2. Created an isvc that uses that serving runtime and no annotation
  3. Verified that the deployment has been created with the image specified in the serving runtime
  4. Updated the serving runtime spec.containers[0].image with a new image
  5. Verified that the deployment now had the updated image
  • Test B Annotation set to auto-update=true
  1. Created a serving runtime
  2. Created an isvc that uses that serving runtime with the annotation set to true
  3. Verified the deployment was created correctly
  4. Updated the serving runtime spec.containers[0].image with a new image
  5. Verified that the deployment now had the updated image
  • Test C Annotation set to auto-update=false
  1. Created a serving runtime
  2. Created an isvc that uses that serving runtime with the annotation set to true
  3. Verified the deployment was created correctly
  4. Updated the serving runtime spec.containers[0].image with a new image
  5. Verified that the deployment DID NOT have the updated image
  • Logs

Special notes for your reviewer:

  1. Please confirm that if this PR changes any image versions, then that's the sole change this PR makes.

Checklist:

  • Have you added unit/e2e tests that prove your fix is effective or that this feature works?
  • Has code been commented, particularly in hard-to-understand areas?
  • Have you made corresponding changes to the documentation?

Release note:


Re-running failed tests

  • /rerun-all - rerun all failed workflows.
  • /rerun-workflow <workflow name> - rerun a specific failed workflow. Only one workflow name can be specified. Multiple /rerun-workflow commands are allowed per comment.

Copy link

openshift-ci bot commented Mar 3, 2025

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

Copy link

openshift-ci bot commented Mar 3, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: andresllh

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved label Mar 3, 2025
@andresllh andresllh force-pushed the feature/RHOAIENG-7127-servingruntime-predictor-pod-image-not-changed branch from b88ba52 to b9b4dcb Compare March 3, 2025 18:19
…n to specify behavior for auto-updates.

Signed-off-by: Andres Llausas <[email protected]>

Updated tests

Updated tests

Made update suggested by Edgar, moved around unit tests.

All tests passing

Updated tests

Updated tests
@andresllh andresllh force-pushed the feature/RHOAIENG-7127-servingruntime-predictor-pod-image-not-changed branch from c46147f to 0427e13 Compare March 10, 2025 12:57
@andresllh andresllh changed the title Changing image in serving runtime now updates isvc. Can use annotatio… [RHOAIENG-7127] Changing image in serving runtime now updates isvc. Can use annotatio… Mar 12, 2025
@andresllh andresllh marked this pull request as ready for review March 12, 2025 14:02
@andresllh
Copy link
Member Author

@spolti
Copy link
Member

spolti commented Mar 12, 2025

Very nice @andresllh, a few things:

  • can you also test having multiple inference services with different serving runtimes, and, you update one serving runtime only the ISVC that uses the changed SV is updated?

Also, I think that is a great candidate to go first on upstream (if the priority is not that high).

… is updated and annotation is true or missing.
@spolti
Copy link
Member

spolti commented Mar 12, 2025

Did you run this test as well?

can you also test having multiple inference services with different serving runtimes, and, you update one serving runtime only the ISVC that uses the changed SV is updated?

@andresllh
Copy link
Member Author

andresllh commented Mar 12, 2025

Did you run this test as well?

can you also test having multiple inference services with different serving runtimes, and, you update one serving runtime only the ISVC that uses the changed SV is updated?

@spolti
Yes, I added another unit test and also tested this in my cluster manually.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: New/Backlog
Development

Successfully merging this pull request may close these issues.

Update InferenceService when ServingRuntimes are updated
3 participants