Add ALiBi to supported features (#366)

HabanaAI · Oct 7, 2024 · 88e5abe · 88e5abe
1 parent a262b06
commit 88e5abe
Show file tree

Hide file tree

Showing 2 changed files with 2 additions and 2 deletions.
diff --git a/README_GAUDI.md b/README_GAUDI.md
@@ -81,13 +81,13 @@ Supported Features
 -   Inference with [HPU
     Graphs](https://docs.habana.ai/en/latest/PyTorch/Inference_on_PyTorch/Inference_Using_HPU_Graphs.html)
     for accelerating low-batch latency and throughput
+-   Attention with Linear Biases (ALiBi)
 
 Unsupported Features
 ====================
 
 -   Beam search
 -   LoRA adapters
--   Attention with Linear Biases (ALiBi)
 -   Quantization (AWQ, FP8 E5M2, FP8 E4M3)
 -   Prefill chunking (mixed-batch inferencing)
 

diff --git a/docs/source/getting_started/gaudi-installation.rst b/docs/source/getting_started/gaudi-installation.rst
@@ -76,13 +76,13 @@ Supported Features
 -  Tensor parallelism support for multi-card inference
 -  Inference with `HPU Graphs <https://docs.habana.ai/en/latest/PyTorch/Inference_on_PyTorch/Inference_Using_HPU_Graphs.html>`__
    for accelerating low-batch latency and throughput
+-  Attention with Linear Biases (ALiBi)
 
 Unsupported Features
 ====================
 
 -  Beam search
 -  LoRA adapters
--  Attention with Linear Biases (ALiBi)
 -  Quantization (AWQ, FP8 E5M2, FP8 E4M3)
 -  Prefill chunking (mixed-batch inferencing)