Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

notebook "llm rag llama-index" fail to initial #2587

Open
JamieVC opened this issue Dec 10, 2024 · 3 comments
Open

notebook "llm rag llama-index" fail to initial #2587

JamieVC opened this issue Dec 10, 2024 · 3 comments

Comments

@JamieVC
Copy link

JamieVC commented Dec 10, 2024

To compare multiple LLM models to OEM/ODM, we are running this sample.

  1. install new env based on openvino guide: https://github.com/openvinotoolkit/openvino_notebooks/wiki/Windows
  2. run >jupyter lab notebooks\llm-rag-llamaindex\llm-rag-llamaindex.ipynb
  3. run the first section in https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/llm-rag-llamaindex/llm-rag-llamaindex.ipynb

-error log-

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
gradio 5.8.0 requires huggingface-hub>=0.25.1, but you have huggingface-hub 0.23.5 which is incompatible.
llama-index-embeddings-openvino 0.5.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
llama-index-embeddings-openvino 0.5.0 requires llama-index-embeddings-huggingface<0.5.0,>=0.4.0, but you have llama-index-embeddings-huggingface 0.3.1 which is incompatible.
llama-index-llms-openvino 0.4.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
llama-index-llms-openvino 0.4.0 requires llama-index-llms-huggingface<0.5.0,>=0.4.0, but you have llama-index-llms-huggingface 0.3.3 which is incompatible.
llama-index-postprocessor-openvino-rerank 0.4.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
llama-index-embeddings-openvino 0.5.0 requires huggingface-hub<0.24.0,>=0.23.0, but you have huggingface-hub 0.26.5 which is incompatible.
llama-index-embeddings-openvino 0.5.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
llama-index-embeddings-openvino 0.5.0 requires llama-index-embeddings-huggingface<0.5.0,>=0.4.0, but you have llama-index-embeddings-huggingface 0.3.1 which is incompatible.
llama-index-llms-huggingface 0.3.3 requires huggingface-hub<0.24.0,>=0.23.0, but you have huggingface-hub 0.26.5 which is incompatible.
llama-index-llms-openvino 0.4.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
llama-index-llms-openvino 0.4.0 requires llama-index-llms-huggingface<0.5.0,>=0.4.0, but you have llama-index-llms-huggingface 0.3.3 which is incompatible.
llama-index-postprocessor-openvino-rerank 0.4.0 requires huggingface-hub<0.24.0,>=0.23.0, but you have huggingface-hub 0.26.5 which is incompatible.
llama-index-postprocessor-openvino-rerank 0.4.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
Looking in indexes: https://pypi.org/simple, https://storage.openvinotoolkit.org/simple/wheels/nightly
Requirement already satisfied: openvino>=2024.2 in c:\windows\system32\openvino_env\lib\site-packages (2025.0.0.dev20241209)
Requirement already satisfied: numpy<2.2.0,>=1.16.6 in c:\windows\system32\openvino_env\lib\site-packages (from openvino>=2024.2) (1.26.4)
Requirement already satisfied: openvino-telemetry>=2023.2.1 in c:\windows\system32\openvino_env\lib\site-packages (from openvino>=2024.2) (2024.5.0)
Requirement already satisfied: packaging in c:\windows\system32\openvino_env\lib\site-packages (from openvino>=2024.2) (24.2)
Looking in indexes: https://pypi.org/simple, https://storage.openvinotoolkit.org/simple/wheels/nightly
Requirement already satisfied: openvino-tokenizers>=2024.2 in c:\windows\system32\openvino_env\lib\site-packages (from openvino-tokenizers[transformers]>=2024.2) (2025.0.0.0.dev20241209)
Requirement already satisfied: openvino~=2025.0.0.dev in c:\windows\system32\openvino_env\lib\site-packages (from openvino-tokenizers>=2024.2->openvino-tokenizers[transformers]>=2024.2) (2025.0.0.dev20241209)
Requirement already satisfied: transformers>=4.36.0 in c:\windows\system32\openvino_env\lib\site-packages (from transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (4.46.3)
Requirement already satisfied: tiktoken in c:\windows\system32\openvino_env\lib\site-packages (from openvino-tokenizers[transformers]>=2024.2) (0.8.0)
Requirement already satisfied: numpy<2.2.0,>=1.16.6 in c:\windows\system32\openvino_env\lib\site-packages (from openvino~=2025.0.0.dev->openvino-tokenizers>=2024.2->openvino-tokenizers[transformers]>=2024.2) (1.26.4)
Requirement already satisfied: openvino-telemetry>=2023.2.1 in c:\windows\system32\openvino_env\lib\site-packages (from openvino~=2025.0.0.dev->openvino-tokenizers>=2024.2->openvino-tokenizers[transformers]>=2024.2) (2024.5.0)
Requirement already satisfied: packaging in c:\windows\system32\openvino_env\lib\site-packages (from openvino~=2025.0.0.dev->openvino-tokenizers>=2024.2->openvino-tokenizers[transformers]>=2024.2) (24.2)
Requirement already satisfied: filelock in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (3.16.1)
Requirement already satisfied: huggingface-hub<1.0,>=0.23.2 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.26.5)
Requirement already satisfied: pyyaml>=5.1 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (6.0.2)
Requirement already satisfied: regex!=2019.12.17 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2024.11.6)
Requirement already satisfied: requests in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2.32.3)
Requirement already satisfied: tokenizers<0.21,>=0.20 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.20.3)
Requirement already satisfied: safetensors>=0.4.1 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.4.5)
Requirement already satisfied: tqdm>=4.27 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (4.67.1)
Requirement already satisfied: sentencepiece!=0.1.92,>=0.1.91 in c:\windows\system32\openvino_env\lib\site-packages (from transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.2.0)
Requirement already satisfied: protobuf in c:\windows\system32\openvino_env\lib\site-packages (from transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (5.29.1)
Requirement already satisfied: fsspec>=2023.5.0 in c:\windows\system32\openvino_env\lib\site-packages (from huggingface-hub<1.0,>=0.23.2->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2024.9.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in c:\windows\system32\openvino_env\lib\site-packages (from huggingface-hub<1.0,>=0.23.2->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (4.12.2)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\windows\system32\openvino_env\lib\site-packages (from requests->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (3.4.0)
Requirement already satisfied: idna<4,>=2.5 in c:\windows\system32\openvino_env\lib\site-packages (from requests->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\windows\system32\openvino_env\lib\site-packages (from requests->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2.2.3)
Requirement already satisfied: certifi>=2017.4.17 in c:\windows\system32\openvino_env\lib\site-packages (from requests->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2024.8.30)
Requirement already satisfied: colorama in c:\windows\system32\openvino_env\lib\site-packages (from tqdm>=4.27->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.4.6)
@brmarkus
Copy link

brmarkus commented Dec 10, 2024

Can you try to create a new (not used before) Python virtual environment, activate it and run the notebook again from within the activated Python virtual environment?
Which OS, which version of Python do you use?

@Wilson120603
Copy link

Wilson120603 commented Dec 11, 2024

Can you try to create a new (not used before) Python virtual environment, activate it and run the notebook again from within the activated Python virtual environment? Which OS, which version of Python do you use?

Hi
OS version is 24H2 26100.2314 and python version is 3.10.11
We've tried to delete openvino_env and openvino_notebooks folder under C:\Windows\System32 and re-download with step then still pop out same failure.

@Wilson120603
Copy link

pip list
Package Version


about-time 4.2.1
accelerate 1.2.1
aiofiles 23.2.1
aiohappyeyeballs 2.4.4
aiohttp 3.11.10
aiosignal 1.3.2
alive-progress 3.2.0
annotated-types 0.7.0
anyio 4.7.0
argon2-cffi 23.1.0
argon2-cffi-bindings 21.2.0
arrow 1.3.0
asttokens 3.0.0
async-lru 2.0.4
async-timeout 4.0.3
attrs 24.3.0
autograd 1.7.0
babel 2.16.0
beautifulsoup4 4.12.3
bleach 6.2.0
certifi 2024.12.14
cffi 1.17.1
charset-normalizer 3.4.0
click 8.1.7
cma 3.2.2
colorama 0.4.6
coloredlogs 15.0.1
comm 0.2.2
contourpy 1.3.1
cycler 0.12.1
dataclasses-json 0.6.7
datasets 3.2.0
debugpy 1.8.11
decorator 5.1.1
defusedxml 0.7.1
Deprecated 1.2.15
dill 0.3.8
dirtyjson 1.0.8
distro 1.9.0
exceptiongroup 1.2.2
executing 2.1.0
faiss-cpu 1.9.0.post1
fastapi 0.115.6
fastjsonschema 2.21.1
ffmpy 0.4.0
filelock 3.16.1
filetype 1.2.0
fonttools 4.55.3
fqdn 1.5.1
frozenlist 1.5.0
fsspec 2024.9.0
gradio 5.9.1
gradio_client 1.5.2
grapheme 0.6.0
greenlet 3.1.1
h11 0.14.0
httpcore 1.0.7
httpx 0.28.1
huggingface-hub 0.27.0
humanfriendly 10.0
idna 3.10
ipykernel 6.29.5
ipython 8.30.0
ipywidgets 8.1.5
isoduration 20.11.0
jedi 0.19.2
Jinja2 3.1.4
jiter 0.8.2
joblib 1.4.2
json5 0.10.0
jsonpatch 1.33
jsonpointer 3.0.0
jsonschema 4.23.0
jsonschema-specifications 2024.10.1
jstyleson 0.0.2
jupyter_client 8.6.3
jupyter_core 5.7.2
jupyter-events 0.10.0
jupyter-lsp 2.2.5
jupyter_server 2.14.2
jupyter_server_terminals 0.5.3
jupyterlab 4.3.3
jupyterlab_pygments 0.3.0
jupyterlab_server 2.27.3
jupyterlab_widgets 3.0.13
kiwisolver 1.4.7
langchain 0.3.12
langchain-core 0.3.25
langchain-text-splitters 0.3.3
langsmith 0.2.3
llama-cloud 0.1.6
llama-index 0.11.23
llama-index-agent-openai 0.3.4
llama-index-cli 0.3.1
llama-index-core 0.11.23
llama-index-embeddings-huggingface 0.3.1
llama-index-embeddings-openai 0.2.5
llama-index-embeddings-openvino 0.5.0
llama-index-indices-managed-llama-cloud 0.6.0
llama-index-legacy 0.9.48.post4
llama-index-llms-huggingface 0.3.3
llama-index-llms-langchain 0.4.2
llama-index-llms-openai 0.2.16
llama-index-llms-openvino 0.4.0
llama-index-multi-modal-llms-openai 0.2.3
llama-index-postprocessor-openvino-rerank 0.4.0
llama-index-program-openai 0.2.0
llama-index-question-gen-openai 0.2.0
llama-index-readers-file 0.3.0
llama-index-readers-llama-parse 0.3.0
llama-index-vector-stores-faiss 0.2.1
llama-parse 0.5.17
markdown-it-py 3.0.0
MarkupSafe 2.1.5
marshmallow 3.23.1
matplotlib 3.10.0
matplotlib-inline 0.1.7
mdurl 0.1.2
minijinja 2.5.0
mistune 3.0.2
mpmath 1.3.0
multidict 6.1.0
multiprocess 0.70.16
mypy-extensions 1.0.0
natsort 8.4.0
nbclient 0.10.1
nbconvert 7.16.4
nbformat 5.10.4
nest-asyncio 1.6.0
networkx 3.3
ninja 1.11.1.3
nltk 3.9.1
nncf 2.15.0.dev0+c4799898
notebook_shim 0.2.4
numpy 1.26.4
onnx 1.17.0
openai 1.57.4
openvino 2025.0.0.dev20241216
openvino-telemetry 2024.5.0
openvino-tokenizers 2025.0.0.0.dev20241216
optimum 1.23.3
optimum-intel 1.22.0.dev0+9c4bccc
orjson 3.10.12
overrides 7.7.0
packaging 24.2
pandas 2.2.3
pandocfilters 1.5.1
parso 0.8.4
pillow 11.0.0
pip 24.3.1
platformdirs 4.3.6
prometheus_client 0.21.1
prompt_toolkit 3.0.48
propcache 0.2.1
protobuf 5.29.1
psutil 6.1.0
pure_eval 0.2.3
pyarrow 18.1.0
pycparser 2.22
pydantic 2.10.3
pydantic_core 2.27.1
pydot 2.0.0
pydub 0.25.1
Pygments 2.18.0
pymoo 0.6.1.3
PyMuPDF 1.25.1
pyparsing 3.2.0
pypdf 5.1.0
pyreadline3 3.5.4
python-dateutil 2.9.0.post0
python-json-logger 3.2.1
python-multipart 0.0.20
pytz 2024.2
pywin32 308
pywinpty 2.0.14
PyYAML 6.0.2
pyzmq 26.2.0
referencing 0.35.1
regex 2024.11.6
requests 2.32.3
requests-toolbelt 1.0.0
rfc3339-validator 0.1.4
rfc3986-validator 0.1.1
rich 13.9.4
rpds-py 0.22.3
ruff 0.8.3
safehttpx 0.1.6
safetensors 0.4.5
scikit-learn 1.6.0
scipy 1.14.1
semantic-version 2.10.0
Send2Trash 1.8.3
sentence-transformers 3.3.1
sentencepiece 0.2.0
setuptools 75.6.0
shellingham 1.5.4
six 1.17.0
sniffio 1.3.1
soupsieve 2.6
SQLAlchemy 2.0.36
stack-data 0.6.3
starlette 0.41.3
striprtf 0.0.26
sympy 1.13.1
tabulate 0.9.0
tenacity 8.5.0
terminado 0.18.1
text-generation 0.7.0
threadpoolctl 3.5.0
tiktoken 0.8.0
tinycss2 1.4.0
tokenizers 0.20.3
tomli 2.2.1
tomlkit 0.13.2
torch 2.5.1+cpu
tornado 6.4.2
tqdm 4.67.1
traitlets 5.14.3
transformers 4.46.3
typer 0.15.1
types-python-dateutil 2.9.0.20241206
typing_extensions 4.12.2
typing-inspect 0.9.0
tzdata 2024.2
uri-template 1.3.0
urllib3 2.2.3
uvicorn 0.34.0
wcwidth 0.2.13
webcolors 24.11.1
webencodings 0.5.1
websocket-client 1.8.0
websockets 14.1
wheel 0.45.1
widgetsnbextension 4.0.13
wrapt 1.17.0
xxhash 3.5.0
yarl 1.18.3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants