-
Notifications
You must be signed in to change notification settings - Fork 13
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
kserve - initial additions, serving runtimes #10
base: main
Are you sure you want to change the base?
Conversation
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: spolti The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
Welcome @spolti! |
serving-catalog/kserve/servingruntime/xgbserver-serving-runtime.yaml
Outdated
Show resolved
Hide resolved
go.mod
Outdated
module wg-serving | ||
|
||
go 1.22 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is not needed
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
oops, not sure how it ended up here, thanks for the heads up.
serving-catalog/kserve/README.md
Outdated
# TODOs | ||
|
||
- [ ] Add the inference services | ||
- [ ] Use kustomize to deploy the runtimes and inference services | ||
- [ ] Update the catalog once the examples are ready | ||
- [ ] Update the validate script to check the KServe examples | ||
- [ ] Update the catalog.md once the inference services and the kustomize deployment are ready | ||
- [ ] Add custom Serving Runtimes |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Are these TODOs for this PR?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not for the PR exclusively, but to use as guidance for upcoming work and adjustments.
cf2e9b4
to
23c4370
Compare
1328a9a
to
9bf9ea6
Compare
Signed-off-by: Spolti <[email protected]>
Co-authored-by: Roland Huß <[email protected]>
Co-authored-by: Roland Huß <[email protected]>
Co-authored-by: Roland Huß <[email protected]>
@terrytangyuan please take a look, I've changed it a little bit, if that sounds good, we can add the vllm example later |
Signed-off-by: Spolti <[email protected]>
No description provided.