Skip to content

Commit

Permalink
more perfo with llamafile tinyblas on x86_64.
Browse files Browse the repository at this point in the history 
- add bf16 suport
- change dispache strategie (thanks:
ikawrakow/ik_llama.cpp#71 )
- reduce memory bandwidth
  • Loading branch information
@Djip007
Djip007 committed Dec 8, 2024
1 parent 19d8762 commit 058e4c6
Showing 1 changed file with 186 additions and 172 deletions.
Loading

0 comments on commit 058e4c6

Please sign in to comment.