Skip to content

Commit

Permalink
GPTJ demo fix and deprecation node [Release 2023.3] (openvinotoolkit#…
Browse files Browse the repository at this point in the history
  • Loading branch information
mzegla authored and Xaenalt committed Feb 27, 2024
1 parent 1d9f925 commit bc82619
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 3 deletions.
4 changes: 3 additions & 1 deletion demos/gptj_causal_lm/python/README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,6 @@
# GPT-J Causal Language Modeling Demo {#ovms_demo_gptj_causal_lm}
# [DEPRECATED] GPT-J Causal Language Modeling Demo {#ovms_demo_gptj_causal_lm}

**This demo is deprecated and will be removed in 2024.0. Check out new [python demos](../../python_demos) for latest examples with language models.**

### Introduction
This demo illustrates usage of GPT-like models in OpenVINO™ Model Server. GPT-J 6B model used in this example can be found at [huggingface](https://huggingface.co/EleutherAI/gpt-j-6B) (~25GB). Steps below automate download and conversion steps to be able to load it using OpenVINO™. Example python client provided at the end of the document requests Model Server for the next word of the sentence until `EOS` (end of sequence) token is received.
Expand Down
4 changes: 2 additions & 2 deletions demos/gptj_causal_lm/python/requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,6 @@ accelerate==0.20.3
numpy==1.23
torch==1.13.1
onnx==1.15.0
optimum[openvino,nncf]==1.14.1
optimum[openvino,nncf]>=1.14.1
ovmsclient
openvino
openvino==2023.2.0

0 comments on commit bc82619

Please sign in to comment.