Skip to content

Issues: abetlen/llama-cpp-python

Roadmap for v0.2
#487 opened Jul 18, 2023 by abetlen
Open
Add batched inference
#771 opened Sep 30, 2023 by abetlen
Open 37
Improve installation process
#1178 opened Feb 12, 2024 by abetlen
Open 8
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

492 Open 693 Closed
492 Open 693 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Unable to Build llama-cpp-python with Vulkan (Core Dump on Model Load)
#1923 opened Feb 6, 2025 by Talnz007
Distributed Inference
#1921 opened Feb 5, 2025 by lipere123
1
Macos Metal Github Release for python 3.12 is broken
#1918 opened Feb 4, 2025 by haixuanTao
See No CUDA toolset found log after -- CUDA Toolkit found. log
#1917 opened Feb 3, 2025 by TomaszDlubis
How to run CLIP model on GPU?
#1916 opened Feb 3, 2025 by zhu-j-faceonlive
Cuda Build Failed, Please take a look at this
#1915 opened Feb 1, 2025 by RealUnrealGameDev
RPC is broken due to change of interface in llama.cpp main repository (rpc : early register backend devices #11262)
#1914 opened Jan 30, 2025 by j-lag
Automate upstream llama.cpp sync
#1910 opened Jan 26, 2025 by bgs4free
4
pip install llama-cpp-python got stuck forever at "Configuring CMake" in docker
#1908 opened Jan 24, 2025 by jiafatom
1
openai API max_completion_tokens argument is ignored
#1907 opened Jan 24, 2025 by BenjaminMarechalEVITECH
4 tasks done
openai API n argument is ignored
#1906 opened Jan 24, 2025 by BenjaminMarechalEVITECH
4 tasks done
Wrong chat format for llava 1.5
#1905 opened Jan 24, 2025 by BenjaminMarechalEVITECH
4 tasks done
Add minicpm-o and qwen2-vl to the list of supported multimodal models.
#1904 opened Jan 24, 2025 by kseyhan
2
OSError: exception: access violation reading 0x0000000000000000
#1903 opened Jan 24, 2025 by andretisch
Question - Batch Processing
#1902 opened Jan 22, 2025 by virentakia
Generate answer from embedding vectors
#1897 opened Jan 16, 2025 by leewoosub
llama_cpp_python-0.3.4-cp310-CU12 deepseekv3 /home/runner/work/llama-cpp-python/llama-cpp-python/vendor/llama.cpp/src/llama.cpp:5474: GGML_ASSERT(hparams.n_expert <= LLAMA_MAX_EXPERTS) failed
#1896 opened Jan 15, 2025 by PeifengRen
2
Does it support the gguf format model of Qwen2-VL-2B-Instruct
#1895 opened Jan 9, 2025 by helloHKTK
5
cohere2 architecture issue
#1893 opened Jan 8, 2025 by MertcanTekin
Dependency issues with uvicorn
#1892 opened Jan 8, 2025 by jaslatendresse
4 tasks done
4
Implementation doubt
#1889 opened Jan 7, 2025 by lmbelo
1
The C compiler identification is unknown
#1888 opened Jan 6, 2025 by makrse
MiniCPM-V 2.6 memory leak occurred !!!
#1886 opened Dec 30, 2024 by Liwx1014
1 task
3
Feature request: add support for streaming tool use
#1883 opened Dec 25, 2024 by lsorber
2
How to create .so file for llama-cpp-python please help!
#1881 opened Dec 24, 2024 by ayush20501
ProTip! What’s not been updated in a month: updated:<2025-01-06.