-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Roll out model with istio #1823
Conversation
"apiVersion: ambassador/v0", | ||
"kind: Mapping", | ||
"name: tfserving-predict-mapping-" + modelName, | ||
"prefix: /tfserving/models/" + modelName, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We don't need to address it in this PR; but do we need to have individual rewrite rules for different paths and methods?
Could we just have a single rewrite rule
/tfserving/models/modelName -> /v1/models/
This is great. Thanks. /lgtm Can you resolve the conflicts? |
test comment |
test comment |
/lgtm |
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: jlewi The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
* roll out model with istio * fix test * fix test * fix test * fix test
* application path update: certmanager, istio, authservice * application path update: certmanager, istio, kfserving, knative * delete deprecated/unused component application path update: namespace, roles, katib, central dashboard * application path update: notebook, tensorboard, mpi, xgboost... * application path update: dex, mxnet, kfp-argo * add kfp-tekton to ibm distribution update oidc appid to create secret for clientId and secret move kubeflow istio resources to own application folder * ibm 1.3 kfdef * change kubeflow istio resources to own applicaiton * add fixed nodeport for istio ingressgateway * Don't overwrite all namespaces to kubeflow * add kfdef for ibm kubeflow 1.3 add dex for single user add oauthservice for dex * add new line at end of file * kfdef reporef name fix * kfdef reporef kustomization fix * add moficodes and pvaneck to IBM distribution owners remove adrian555 from IBM Distribution owners * add kfserving to kfdef * remove duplicate compononet from kfdef * reorder profile component profile crds need to be created before we try to create profile instance Co-authored-by: Tommy Li <Tommy.chaoping.li@ibm.com>
Separate the service part (model) and the deployment (version) of TF serving.
To serve a model, we should deploy service + deployment as:
Service
Deployment
To rollout the version v2,
/cc @jlewi
related:
#1309
This change is