diff --git a/demos/gptj_causal_lm/python/README.md b/demos/gptj_causal_lm/python/README.md index 63240705a0..ac7ca7ab2e 100755 --- a/demos/gptj_causal_lm/python/README.md +++ b/demos/gptj_causal_lm/python/README.md @@ -1,4 +1,6 @@ -# GPT-J Causal Language Modeling Demo {#ovms_demo_gptj_causal_lm} +# [DEPRECATED] GPT-J Causal Language Modeling Demo {#ovms_demo_gptj_causal_lm} + +**This demo is deprecated and will be removed in 2024.0. Check out new [python demos](../../python_demos) for latest examples with language models.** ### Introduction This demo illustrates usage of GPT-like models in OpenVINO™ Model Server. GPT-J 6B model used in this example can be found at [huggingface](https://huggingface.co/EleutherAI/gpt-j-6B) (~25GB). Steps below automate download and conversion steps to be able to load it using OpenVINO™. Example python client provided at the end of the document requests Model Server for the next word of the sentence until `EOS` (end of sequence) token is received. diff --git a/demos/gptj_causal_lm/python/requirements.txt b/demos/gptj_causal_lm/python/requirements.txt index 97ca8bbc96..3e87601365 100755 --- a/demos/gptj_causal_lm/python/requirements.txt +++ b/demos/gptj_causal_lm/python/requirements.txt @@ -2,6 +2,6 @@ accelerate==0.20.3 numpy==1.23 torch==1.13.1 onnx==1.15.0 -optimum[openvino,nncf]==1.14.1 +optimum[openvino,nncf]>=1.14.1 ovmsclient -openvino +openvino==2023.2.0