Skip to content

Commit

Permalink
inference DLC (#728)
Browse files Browse the repository at this point in the history
  • Loading branch information
pagezyhf authored Oct 28, 2024
1 parent 5652735 commit 23574fc
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/containers.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ print(f"llm image uri: {llm_image}")
| Type | Optimum Version | Image URI |
|-----------------------------|-----------------|---------------------------------------------|
| Training | 0.0.24 | `763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-training-neuronx:2.1.2-transformers4.41.1-neuronx-py310-sdk2.19.1-ubuntu20.04` |
| Inference | 0.0.24 | `763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-inference-neuronx:2.1.2-transformers4.41.1-neuronx-py310-sdk2.19.1-ubuntu20.04` |
| Inference | 0.0.25 | `763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-inference-neuronx:2.1.2-transformers4.43.2-neuronx-py310-sdk2.20.0-ubuntu20.04` |
| Text Generation Inference | 0.0.25 | `763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-tgi-inference:2.1.2-optimum0.0.25-neuronx-py310-ubuntu22.04` |
Expand Down

0 comments on commit 23574fc

Please sign in to comment.