Code

metal : add BF16 support#8439

Code

Merged

ggerganov merged 7 commits intomasterggerganov/llama.cpp:masterfrom gg/metal-bf16ggerganov/llama.cpp:gg/metal-bf16Copy head branch name to clipboardNov 6, 2024

+317-184

Commits

Commits on Nov 6, 2024

• ggml : add initial BF16 support

  Show description for 6109cf1
  ggerganov

  committed
  6109cf1

  Copy full SHA for 6109cf1

• metal : add mul_mat_id BF16 support

  Show description for c915d0a
  ggerganov

  committed
  c915d0a

  Copy full SHA for c915d0a

• metal : check for bfloat support on the Metal device

  Show description for 3ee077a
  ggerganov

  committed
  3ee077a

  Copy full SHA for 3ee077a

• metal : better var names [no ci]

  ggerganov

  committed
  a408f51

  Copy full SHA for a408f51

• metal : do not build bfloat kernels when not supported

  Show description for ad12269
  ggerganov

  committed
  ad12269

  Copy full SHA for ad12269

• metal : try to fix BF16 support check

  Show description for 6969829
  ggerganov

  committed
  6969829

  Copy full SHA for 6969829

• metal : this should correctly check bfloat support

  ggerganov

  committed
  670b8db

  Copy full SHA for 670b8db