Autoscaling to 0

[nickwalton]

Does Cortex support auto scaling down to 0 if there is no current traffic? Couldn't find documentation about auto scaling.

[ospillinger]

Yes, you would need to set min_replicas on each API to 0. I'll clarify this in the docs.

[nickwalton]

Awesome thanks!

[ospillinger]

@deliahu corrected me that we can only autoscale down to 1 replica right now because the autoscaler is based on CPU which is undefined when there are no replicas. I'm sorry about the miscommunication and we'll look into how we can support autoscaling to 0.

[nickwalton]

Gotcha. Well if you are able to enable it then that would be a great feature. I'll add it as a feature request #445

[deliahu]

Thanks @nickwalton, I agree and we'll definitely look into it! According to kubernetes/kubernetes#69687 it should be possible if we use custom metrics for autoscaling instead of CPU utilization.