allow user to serve new model with same bundle

[jfri3d]

What is the desired change?

An improvement to the current approach for serving is required since it is poor at updating either source code or swapping a newly trained model.

How will this change improve kaos?

The current workflow for serving a new model with the same bundle requires the following steps:

1. serve the model

kaos serve deploy -s <bundle> -m XXX:YYY

2. slightly “tweak” the bundle

3. serve the “tweak” bundle with the new model

kaos serve deploy -s <bundle*> -m AAA:BBB

Any thoughts on the implementation approach?

• adapt existing serve pipeline to be dynamic
  • similar to train with create vs. update
  • pass model as argument to serve in docker?!?
• ideally the user can easily swap a new model without rebuilding the entire image…