Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

build : on Mac OS enable Metal by default #2901

Merged
merged 12 commits into from
Sep 4, 2023
Merged

Conversation

ggerganov
Copy link
Owner

No description provided.

Makefile Outdated Show resolved Hide resolved
Makefile Show resolved Hide resolved
@tobi
Copy link
Collaborator

tobi commented Sep 1, 2023

This is exciting. What about defaulting to appropriate -ngl as well?

Makefile Outdated Show resolved Hide resolved
@ggerganov
Copy link
Owner Author

With this change, we should use Metal by default on Mac OS - both llama.cpp and the examples

common/common.cpp Outdated Show resolved Hide resolved
examples/perplexity/perplexity.cpp Show resolved Hide resolved
@ggerganov ggerganov merged commit e36ecdc into master Sep 4, 2023
6 of 26 checks passed
@PawKanarek PawKanarek mentioned this pull request Sep 5, 2023
cebtenzzre added a commit to cebtenzzre/llama.cpp that referenced this pull request Sep 7, 2023
This was broken by commit e36ecdc ("build : on Mac OS enable Metal by
default (ggerganov#2901)").
cebtenzzre added a commit that referenced this pull request Sep 8, 2023
This was broken by commit e36ecdc ("build : on Mac OS enable Metal by
default (#2901)").
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants