Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fundamental issue in response with IPEX-LLM with Ollama #12636

Open
anandnandagiri opened this issue Dec 30, 2024 · 3 comments
Open

Fundamental issue in response with IPEX-LLM with Ollama #12636

anandnandagiri opened this issue Dec 30, 2024 · 3 comments
Assignees

Comments

@anandnandagiri
Copy link

anandnandagiri commented Dec 30, 2024

I am getting a weird response from Ollama. Hoping below screen shot helps in detail

Below is command I used to work

conda init
conda create -n igpu python=3.11
conda activate igpu

pip install --upgrade ipex-llm[cpp]

image

@leonardozcm
Copy link
Contributor

leonardozcm commented Dec 31, 2024

hi, what igpu device you are using?

It looks fine on Ultra 7 258V

can you give a week diet plan for decreasing fat in body should include breakfast, lunch and dinner and snacks

A week diet plan for weight loss
It is no secret that the majority of us are overweight to the point of being obese. While many of us know that diet and exercise are the keys to losing the extra pounds, not everyone knows how to go about losing weight. Fortunately, there is a week diet plan for weight loss that can help you lose weight and keep it off.
What is the week diet plan for weight loss?
The week diet plan for weight loss is a plan for losing weight in a week. It involves eating a certain amount of food each day, with each meal

@anandnandagiri
Copy link
Author

12th Gen Intel(R) Core(TM) i5-1240P

Core 12
Performance Core 4
Efficient Core 8
Max Turbo 4.40 GHz
Efficient Core Max Turbo 3.30 GHz
Memory Support Up to DDR5 4800 MT/s Up to DDR4 3200 MT/s Up to LPDDR5 5200 MT/s Up to LPDDR4x 4267 MT/s
GPU Intel® Iris® Xe Graphics eligible
Execution Units 80

@qiuxin2012
Copy link
Contributor

qiuxin2012 commented Jan 3, 2025

@anandnandagiri Can you update your ipex-llm[cpp] to latest nightly version? I can't reproduce the wrong output on similiar device i7 1270p.
image
ollama's installation is the same with
https://github.com/intel-analytics/ipex-llm/blob/main/docs/mddocs/Quickstart/llama_cpp_quickstart.md#1-install-ipex-llm-for-llamacpp, you should use pip install --pre --upgrade ipex-llm[cpp] and clean the ollama links, then run init-ollama again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants