Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RHOAIENG-5073] - Routing and Headless Service Support in KServe Raw Mode Deployment #288

Conversation

spolti
Copy link
Member

@spolti spolti commented Apr 4, 2024

Cherry-picks #280

@openshift-ci openshift-ci bot added the approved label Apr 4, 2024
@spolti spolti requested review from Jooho and removed request for davidesalerno and terrytangyuan April 4, 2024 20:21
@spolti spolti requested a review from terrytangyuan April 4, 2024 20:45
envtest: $(ENVTEST) ## Download envtest-setup locally if necessary.
$(ENVTEST): $(LOCALBIN)
test -s $(LOCALBIN)/setup-envtest || GOBIN=$(LOCALBIN) go install sigs.k8s.io/controller-runtime/tools/setup-envtest@latest
test -s $(LOCALBIN)/setup-envtest || GOBIN=$(LOCALBIN) go install sigs.k8s.io/controller-runtime/tools/setup-envtest@$(ENVTEST_PACKAGE_VERSION)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unnecessary change

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

without it CI fails, same as here:
opendatahub-io/odh-model-controller#184

@spolti
Copy link
Member Author

spolti commented Apr 5, 2024

/test

Copy link

openshift-ci bot commented Apr 5, 2024

@spolti: No presubmit jobs available for opendatahub-io/[email protected]

In response to this:

/test

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Copy link
Member

@terrytangyuan terrytangyuan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

Copy link

openshift-ci bot commented Apr 5, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: spolti, terrytangyuan

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:
  • OWNERS [spolti,terrytangyuan]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-merge-bot openshift-merge-bot bot merged commit 7bc82f2 into opendatahub-io:release-v0.11.1 Apr 5, 2024
20 checks passed
@spolti spolti deleted the RHOAIENG-5073-0.11.1 branch April 5, 2024 14:08
xieshenzh pushed a commit to xieshenzh/kserve that referenced this pull request Jul 11, 2024
israel-hdez added a commit to israel-hdez/kserve that referenced this pull request Mar 11, 2025
This fixes a regression, because in ODH the Services had been headless for Raw deployment mode (see opendatahub-io#288). Such default changed to headed services when the feasibility to configure the behavior was introduced, but despite the upstream project has always been using headed services, in ODH this  breaks backwards compatibility.

Thus, this restores the ODH default of using headless services for Raw deployment. Users can still use the inferenceservice-config ConfigMap to switch to headed Services.

Signed-off-by: Edgar Hernández <[email protected]>
israel-hdez added a commit to israel-hdez/kserve that referenced this pull request Mar 11, 2025
This fixes a regression, because in ODH the Services had been headless for Raw deployment mode (see opendatahub-io#288). Such default changed to headed services when the feasibility to configure the behavior was introduced, but despite the upstream project has always been using headed services, in ODH this  breaks backwards compatibility.

Thus, this restores the ODH default of using headless services for Raw deployment. Users can still use the inferenceservice-config ConfigMap to switch to headed Services.

Signed-off-by: Edgar Hernández <[email protected]>
openshift-merge-bot bot pushed a commit that referenced this pull request Mar 13, 2025
This fixes a regression, because in ODH the Services had been headless for Raw deployment mode (see #288). Such default changed to headed services when the feasibility to configure the behavior was introduced, but despite the upstream project has always been using headed services, in ODH this  breaks backwards compatibility.

Thus, this restores the ODH default of using headless services for Raw deployment. Users can still use the inferenceservice-config ConfigMap to switch to headed Services.

Signed-off-by: Edgar Hernández <[email protected]>
israel-hdez added a commit to israel-hdez/kserve that referenced this pull request Mar 13, 2025
This fixes a regression, because in ODH the Services had been headless for Raw deployment mode (see opendatahub-io#288). Such default changed to headed services when the feasibility to configure the behavior was introduced, but despite the upstream project has always been using headed services, in ODH this  breaks backwards compatibility.

Thus, this restores the ODH default of using headless services for Raw deployment. Users can still use the inferenceservice-config ConfigMap to switch to headed Services.

Signed-off-by: Edgar Hernández <[email protected]>
israel-hdez added a commit to israel-hdez/kserve that referenced this pull request Mar 13, 2025
This fixes a regression, because in ODH the Services had been headless for Raw deployment mode (see opendatahub-io#288). Such default changed to headed services when the feasibility to configure the behavior was introduced, but despite the upstream project has always been using headed services, in ODH this  breaks backwards compatibility.

Thus, this restores the ODH default of using headless services for Raw deployment. Users can still use the inferenceservice-config ConfigMap to switch to headed Services.

Signed-off-by: Edgar Hernández <[email protected]>
openshift-merge-bot bot pushed a commit that referenced this pull request Mar 13, 2025
This fixes a regression, because in ODH the Services had been headless for Raw deployment mode (see #288). Such default changed to headed services when the feasibility to configure the behavior was introduced, but despite the upstream project has always been using headed services, in ODH this  breaks backwards compatibility.

Thus, this restores the ODH default of using headless services for Raw deployment. Users can still use the inferenceservice-config ConfigMap to switch to headed Services.

Signed-off-by: Edgar Hernández <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants