Code

[pull] master from kserve:master#472

Code

Open

pull[bot] wants to merge 76 commits intoopendatahub-io:masteropendatahub-io/kserve:masterfrom kserve:masterkserve/kserve:masterCopy head branch name to clipboard

Commits

Commits on Dec 23, 2024

• Remove redundant namespace yaml (#4148)

  Show description for b836fc8
  greenmoon55

  authored
  b836fc8

  Copy full SHA for b836fc8

• Fix Localmodel agent build (#4150)

  Show description for cb38637
  greenmoon55

  authored
  cb38637

  Copy full SHA for cb38637

Commits on Dec 24, 2024

• Fix model server fails to gracefully shutdown (#4116)

  Show description for 41a1fd7
  

  sivanantha321

  and

  yuzisun

  authored
  41a1fd7

  Copy full SHA for 41a1fd7

• Ensure root model directory exists and add protection for jobs created (#4152)

  Show description for 07edb56
  yuzisun

  authored
  07edb56

  Copy full SHA for 07edb56

Commits on Dec 26, 2024

• Enable transformer deeper readiness check tests (#4121)

  Show description for 61b0746
  sivanantha321

  authored
  61b0746

  Copy full SHA for 61b0746

• Update HuggingFace server dependencies versions (#4147)

  Show description for 5e5bff8
  AyushSawant18588

  authored
  5e5bff8

  Copy full SHA for 5e5bff8

• Add workflow for verifying go mod (#4137)

  Show description for 874a4a4
  

  sivanantha321

  and

  yuzisun

  authored
  874a4a4

  Copy full SHA for 874a4a4

Commits on Dec 27, 2024

• Fix for CVE-2024-52304 - aiohttp upgrade (#4113)

  Show description for ff13ef8
  

  andyi2it

  and

  yuzisun

  authored
  ff13ef8

  Copy full SHA for ff13ef8

Commits on Dec 30, 2024

• Allow other engine builders other than docker (#3906)

  Show description for 7bec6fb
  spolti

  authored
  7bec6fb

  Copy full SHA for 7bec6fb

Commits on Jan 2, 2025

• Add localmodelnode crd to helm chart (#4161)

  Show description for 8f79c44
  greenmoon55

  authored
  8f79c44

  Copy full SHA for 8f79c44

Commits on Jan 3, 2025

• Fixes Non-linear parsing of case-insensitive content (#4158)

  Show description for 5b718bc
  spolti

  authored
  5b718bc

  Copy full SHA for 5b718bc

• Helm chart - option to run daemonset as root (#4164)

  Show description for 3e842b8
  

  greenmoon55

  and

  yuzisun

  authored
  3e842b8

  Copy full SHA for 3e842b8

Commits on Jan 5, 2025

• Replace nodeGroup with nodeGroups in charts/kserve-crd (#4166)

  Show description for 7b2681f
  

  ritzdevp

  and

  Rituraj Singh

  authored
  7b2681f

  Copy full SHA for 7b2681f

Commits on Jan 7, 2025

• Add affinity and tolerations to localmodel daemonset (#4173)

  Show description for 3597fa7
  greenmoon55

  authored
  3597fa7

  Copy full SHA for 3597fa7

Commits on Jan 8, 2025

• Fix s3 download PermanentRedirectError for legacy s3 endpoint (#4157)

  Show description for cb8a657
  

  bentohset

  and

  lizzzcai

  authored
  cb8a657

  Copy full SHA for cb8a657

• Make label and annotation propagation configurable (#4030)

  Show description for 654d314
  spolti

  authored
  654d314

  Copy full SHA for 654d314

Commits on Jan 11, 2025

• Add ModelCache e2e test (#4136)

  Show description for b7155b3
  sivanantha321

  authored
  b7155b3

  Copy full SHA for b7155b3

Commits on Jan 12, 2025

• Update vllm to 0.6.6 (#4176)

  Show description for 717c6ae
  

  rajatvig

  and

  yuzisun

  authored
  717c6ae

  Copy full SHA for 717c6ae

Commits on Jan 13, 2025

• [bugfix] fix s3 storage download filename bug (#4162)

  Show description for 1b64da9
  anencore94

  authored
  1b64da9

  Copy full SHA for 1b64da9

Commits on Jan 16, 2025

• Add hf to storageuri prefix list (#4184)

  Show description for 8a32b6f
  tjandy98

  authored
  8a32b6f

  Copy full SHA for 8a32b6f

• Add Support for OpenAI-compatible Embeddings API (#4129)

  Show description for 990e412
  FabianScheidt

  authored
  990e412

  Copy full SHA for 990e412

• fix: typo in _construct_http_status_error method (#4190)

  Show description for d377350
  

  Mgla96

  and

  sivanantha321

  authored
  d377350

  Copy full SHA for d377350

Commits on Jan 19, 2025

• Fix raw logger e2e test (#4185)

  Show description for a1ad62b
  sivanantha321

  authored
  a1ad62b

  Copy full SHA for a1ad62b

Commits on Jan 21, 2025

• Feat: Support configuring isvc resource defaults (#4032)

  Show description for b164ea0
  andyi2it

  authored
  b164ea0

  Copy full SHA for b164ea0

Commits on Jan 22, 2025

• keep replicas when autoscaler set external (#4196)

  Show description for 6653b89
  

  Jooho

  and

  sivanantha321

  authored
  6653b89

  Copy full SHA for 6653b89

• Increase kserve controller readiness probe time period (#4200)

  Show description for 6f842d6
  sivanantha321

  authored
  6f842d6

  Copy full SHA for 6f842d6

• Fix golangci-lint binary path selection based on GOBIN (#4198)

  Show description for 1d0afe1
  Jooho

  authored
  1d0afe1

  Copy full SHA for 1d0afe1

• Add option to disable volume management in localModel config (#4186)

  Show description for 96f43de
  

  ritzdevp

  and

  Rituraj Singh

  authored
  96f43de

  Copy full SHA for 96f43de

Commits on Jan 24, 2025

• set MaxUnavailable(0%)/MaxSurge(100%) for rollingUpdate in multinode case (#4188)

  Show description for ea1f055
  Jooho

  authored
  ea1f055

  Copy full SHA for ea1f055

Commits on Jan 25, 2025

• Gracefully shutdown the router server (#3367)

  Show description for 549ab62
  sivanantha321

  authored
  549ab62

  Copy full SHA for 549ab62

• Add workflow for manual huggingface vLLM image publish (#4092)

  Show description for 5aedc95
  sivanantha321

  authored
  5aedc95

  Copy full SHA for 5aedc95

• Gateway API Migration - Raw Deployment (#3952)

  Show description for 7f4cad9
  

  sivanantha321

  and

  yuzisun

  authored
  7f4cad9

  Copy full SHA for 7f4cad9

Commits on Jan 26, 2025

• add make goal to build huggingface cpu image (#4202)

  Show description for b80c906
  spolti

  authored
  b80c906

  Copy full SHA for b80c906

• Cleanup the filepath in createNewFile to avoid path traversal issue (#4205)

  Show description for c7b6ad0
  

  hdefazio

  and

  yuzisun

  authored
  c7b6ad0

  Copy full SHA for c7b6ad0

• Enhance multinode health_check python and manifests (#4197)

  Show description for 4c940e1
  Jooho

  authored
  4c940e1

  Copy full SHA for 4c940e1

Commits on Jan 27, 2025

• Publish 0.15-rc0 release (#4213)

  Show description for 41a0904
  yuzisun

  authored
  41a0904

  Copy full SHA for 41a0904

Commits on Jan 30, 2025

• Fix Gateway API flaky test (#4214)

  Show description for 736cc48
  sivanantha321

  authored
  736cc48

  Copy full SHA for 736cc48

Commits on Jan 31, 2025

• Remove linux/arm64/v8 as platform option to fix build errors (#4217)

  Show description for a2296cc
  gavrissh

  authored
  a2296cc

  Copy full SHA for a2296cc

Commits on Feb 1, 2025

• Fix: isvc resource config name in inferenceservice configmap (#4215)

  Show description for c418bea
  

  sukumargaonkar

  and

  yuzisun

  authored
  c418bea

  Copy full SHA for c418bea

Commits on Feb 3, 2025

• Fix CI not using localmodelnode agent dev image (#4221)

  Show description for 7f2e443
  sivanantha321

  authored
  7f2e443

  Copy full SHA for 7f2e443

Commits on Feb 4, 2025

• Fix model download path (#4112)

  Show description for 0c42913
  

  hakuro95

  and

  yuzisun

  authored
  0c42913

  Copy full SHA for 0c42913

Commits on Feb 7, 2025

• Support Multiple NodeGroups In LocalModelCache (#4170)

  Show description for 198c835
  

  HotsauceLee

  and

  yuzisun

  authored
  198c835

  Copy full SHA for 198c835

• Inference Graph: use plain text HTTP when part of Istio Mesh (#4031)

  Show description for 895f9fd
  

  israel-hdez

  and

  yuzisun

  authored
  895f9fd

  Copy full SHA for 895f9fd

Commits on Feb 12, 2025

• Better compatibility with in-place upgrades when auth proxy disabled (#4234)

  Show description for cbbf41a
  israel-hdez

  authored
  cbbf41a

  Copy full SHA for cbbf41a

• Increase request timeout seconds for art explainer (#4241)

  Show description for 0b49aad
  sivanantha321

  authored
  0b49aad

  Copy full SHA for 0b49aad

• fix: add trainedmodels custom resource to kubeflow-kserve clusterroles (#4225)

  Show description for 0ec3460
  

  3 peopleauthored
  0ec3460

  Copy full SHA for 0ec3460

Commits on Feb 13, 2025

• Fix CVE-2025-24357 and Bump vLLM to 0.7.2 (#4223)

  Show description for 974ac97
  sivanantha321

  authored
  974ac97

  Copy full SHA for 974ac97

• Bump Go to 1.23 (#4239)

  Show description for 6d71f39
  

  rajatvig

  and

  sivanantha321

  authored
  6d71f39

  Copy full SHA for 6d71f39

Commits on Feb 16, 2025

• Remove modelmesh installation from helm chart (#4243)

  Show description for e83a197
  sivanantha321

  authored
  e83a197

  Copy full SHA for e83a197

Commits on Feb 17, 2025

• Bump golang-lint to 1.63 and fix all linter errors (#3967)

  Show description for e5b7919
  sivanantha321

  authored
  e5b7919

  Copy full SHA for e5b7919

Commits on Feb 20, 2025

• Fix request metadata headers parsing in logger (#4249)

  Show description for 2a8d5fd
  

  tylerhyang

  and

  Tyler Yang

  authored
  2a8d5fd

  Copy full SHA for 2a8d5fd

Commits on Feb 21, 2025

• Add predictor healthcheck to OpenAIProxyModel (#4250)

  Show description for 952711a
  greenmoon55

  authored
  952711a

  Copy full SHA for 952711a

Commits on Feb 25, 2025

• Expose podSpec fields for Inferencegraph (#4091)

  Show description for 20c5a52
  sivanantha321

  authored
  20c5a52

  Copy full SHA for 20c5a52

Commits on Feb 26, 2025

• Fix localmodel test (#4268)

  Show description for 8f2409b
  greenmoon55

  authored
  8f2409b

  Copy full SHA for 8f2409b

Commits on Feb 28, 2025

• Force symlink for ModelCar (#4274)

  Show description for ea8bb6d
  pmtk

  authored
  ea8bb6d

  Copy full SHA for ea8bb6d

Commits on Mar 1, 2025

• Refactor vLLM + Embed support (#4177)

  Show description for 1cee348
  gavrissh

  authored
  1cee348

  Copy full SHA for 1cee348

Commits on Mar 3, 2025

• Fix triton health check (#4277)

  Show description for 2925c91
  greenmoon55

  authored
  2925c91

  Copy full SHA for 2925c91

Commits on Mar 4, 2025

• Upgrade vLLM version to 0.7.3 (#4281)

  Show description for 0a24d86
  gavrissh

  authored
  0a24d86

  Copy full SHA for 0a24d86

• 0.15.0-rc1 release (#4285)

  Show description for 8b744a9
  greenmoon55

  authored
  8b744a9

  Copy full SHA for 8b744a9

Commits on Mar 5, 2025

• Add model_version field to InferRequest (#4287)

  Show description for 88c98d9
  greenmoon55

  authored
  88c98d9

  Copy full SHA for 88c98d9

• quick_install.sh failed to uninstall incomplete installation and has small syntax bug (#4275)

  Show description for 153189a
  zozowell

  authored
  153189a

  Copy full SHA for 153189a

Commits on Mar 6, 2025

• update openshift guide (#4210)

  Show description for 41f771d
  spolti

  authored
  41f771d

  Copy full SHA for 41f771d

• Collocation transformer and predictor spec (#4255)

  Show description for 9716122
  sivanantha321

  authored
  9716122

  Copy full SHA for 9716122

• Move arguments from 'args' to 'command' for huggingface server multnode SR (#4289)

  Show description for 7fe14e0
  Jooho

  authored
  7fe14e0

  Copy full SHA for 7fe14e0

• Include reasoning parser option in vLLM for reasoning models (#4282)

  Show description for 3f84f2b
  gavrissh

  authored
  3f84f2b

  Copy full SHA for 3f84f2b

Commits on Mar 7, 2025

• KServe Keda Integration (#3652)

  Show description for d78fd25
  

  andyi2it

  and

  yuzisun

  authored
  d78fd25

  Copy full SHA for d78fd25

• add huggingfaceserver-multinode to helm chart (#4293)

  Show description for 4c13709
  Jooho

  authored
  4c13709

  Copy full SHA for 4c13709

• Add missing CRDs for Keda (#4296)

  Show description for d5704af
  andyi2it

  authored
  d5704af

  Copy full SHA for d5704af

Commits on Mar 8, 2025

• Add well-known label to InferenceGraphs (#4236)

  Show description for 4612cd6
  israel-hdez

  authored
  4612cd6

  Copy full SHA for 4612cd6

Commits on Mar 10, 2025

• Docs update for speculative_decoding in huggingfaceserver (#4272)

  Show description for 0188b63
  

  nickaggarwal

  and

  Nilesh Agarwal

  authored
  0188b63

  Copy full SHA for 0188b63

Commits on Mar 12, 2025

• Merging kfp into kserve docs. (#4270)

  Show description for 3a8ec64
  

  5 peopleauthored
  3a8ec64

  Copy full SHA for 3a8ec64

• fix conflict isvc name for keda e2e (#4305)

  Show description for 3d6a77c
  Jooho

  authored
  3d6a77c

  Copy full SHA for 3d6a77c

Commits on Mar 13, 2025

• update golangci-lint verstion to 1.64 (#4302)

  Show description for d0b7f31
  Jooho

  authored
  d0b7f31

  Copy full SHA for d0b7f31

Commits on Mar 14, 2025

• fix: add huggingfaceserver gpu images to kustomization.yaml and use it in multinode sr (#4306)

  Show description for 47f3014
  Jooho

  authored
  47f3014

  Copy full SHA for 47f3014

Commits on Mar 16, 2025

• Fix watch for k8s service events (#4260)

  Show description for cfba881
  sivanantha321

  authored
  cfba881

  Copy full SHA for cfba881

• Fix rest server multiprocess workers not working (#4271)

  Show description for 1212148
  

  sivanantha321

  and

  yuzisun

  authored
  1212148

  Copy full SHA for 1212148