Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Operator sets HTTPS on the Engine's liveness and ready checks #2586

Closed
adriangonz opened this issue Oct 27, 2020 · 1 comment
Closed

Operator sets HTTPS on the Engine's liveness and ready checks #2586

adriangonz opened this issue Oct 27, 2020 · 1 comment
Assignees
Milestone

Comments

@adriangonz
Copy link
Contributor

Describe the bug

When the user chooses to deploy their models with the Java engine, the operator sets the container's liveness and ready checks to be called with HTTPS. Since the engine gets exposed through HTTP, this means that it never becomes "ready" and the model never gets deployed.

In other words, the generated container for the engine, ends up with this config:

seldon-container-engine:
	Liveness:   http-get https://:admin/live delay=20s timeout=60s period=5s #success=1 #failure=3
	Readiness:  http-get https://:admin/ready delay=20s timeout=60s period=5s #success=1 #failure=3

This seems to be happening in these lines:

ReadinessProbe: &corev1.Probe{Handler: corev1.Handler{HTTPGet: &corev1.HTTPGetAction{Port: intstr.FromString("admin"), Path: "/ready", Scheme: corev1.URISchemeHTTPS}},
InitialDelaySeconds: 20,
PeriodSeconds: 5,
FailureThreshold: 3,
SuccessThreshold: 1,
TimeoutSeconds: 60},
LivenessProbe: &corev1.Probe{Handler: corev1.Handler{HTTPGet: &corev1.HTTPGetAction{Port: intstr.FromString("admin"), Path: "/live", Scheme: corev1.URISchemeHTTPS}},
InitialDelaySeconds: 20,
PeriodSeconds: 5,
FailureThreshold: 3,
SuccessThreshold: 1,
TimeoutSeconds: 60},

To reproduce

  1. Deploy a model using the Java engine
  2. Check the generated pod spec

Expected behaviour

The liveness and readiness probes should be configured with HTTP.

Environment

  • Seldon Core: 1.3.0 (not sure when it started happening)
@adriangonz adriangonz added bug triage Needs to be triaged and prioritised accordingly labels Oct 27, 2020
@adriangonz adriangonz added this to the 1.5 milestone Oct 27, 2020
@adriangonz adriangonz self-assigned this Oct 27, 2020
@adriangonz
Copy link
Contributor Author

/priority p0

@adriangonz adriangonz removed the triage Needs to be triaged and prioritised accordingly label Oct 27, 2020
@ukclivecox ukclivecox modified the milestones: 1.5, 1.6 Nov 30, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants