module does not work once deployed to kubernetes

[nyejon]

Hi,

I have wrapped a model, and when doing "docker run model_image" locally after building the image, the server starts with no import errors.

However, once I try and run the image on kubernetes I get this error in the pod logs:

seldon_core.microservice:main:265 - INFO: Importing submodule ['nlppipeline.nlppipeline', 'NLPPipeline']
/
Traceback (most recent call last):
File "/usr/local/bin/seldon-core-microservice", line 8, in
sys.exit(main())
File "/usr/local/lib/python3.7/site-packages/seldon_core/microservice.py", line 266, in main
interface_file = importlib.import_module(parts[0])
File "/usr/local/lib/python3.7/importlib/init.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1006, in _gcd_import
File "", line 983, in _find_and_load
File "", line 965, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'nlppipeline.nlppipeline'

I'm a bit stuck what the problem could be.

I am trying to call the seldon-core-microservice with the following command:

seldon-core-microservice nlppipeline.NLPPipeline REST --service-type MODEL --persistence 0

It differs from the examples that I am calling it from outside the module, rather than the example using the "NLPPipeline" as the model name directly.

[nyejon]

OK, I got this working.

If you use a module, for some reason the base python path is seen as the root directory in docker.

Therefore, to get the module working one has to not change the WORKDIR in docker and use the full path as the model name.

Here is an example of the new Dockerfile:

FROM python:3.7

ENV PYTHONUNBUFFERED 1
# copying source files into app folder of container
RUN pip install --upgrade pip pipenv
COPY ["Pipfile", "Pipfile.lock", "./"]
# installing requirements.txt with pipenv
RUN pipenv install --system --deploy

COPY . /src/model_template

EXPOSE 5000

# Define environment variable
ENV MODEL_NAME src.model_template.BaseSeldonModel.BaseSeldonModel
ENV API_TYPE REST
ENV SERVICE_TYPE MODEL
ENV PERSISTENCE 0
ENV LOG_LEVEL_ENV DEBUG

CMD exec seldon-core-microservice $MODEL_NAME $API_TYPE --service-type $SERVICE_TYPE --persistence $PERSISTENCE --log-level $LOG_LEVEL_ENV