Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Docs] Update quick start to mention Llama 3 8B #2196

Merged
merged 1 commit into from
Apr 22, 2024
Merged

[Docs] Update quick start to mention Llama 3 8B #2196

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions docs/get_started/quick_start.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ Quick Start
Examples
--------

To begin with, try out MLC LLM support for int4-quantized Llama2 7B.
To begin with, try out MLC LLM support for int4-quantized Llama3 8B.
It is recommended to have at least 6GB free VRAM to run it.

.. tabs::
Expand Down Expand Up @@ -133,7 +133,7 @@ It is recommended to have at least 6GB free VRAM to run it.

|

**Requirement**. Llama2-7B model needs an iOS device with a minimum of 6GB RAM, whereas the RedPajama-3B model runs with at least 4GB RAM.
**Requirement**. Llama3-8B model needs an iOS device with a minimum of 6GB RAM, whereas the RedPajama-3B model runs with at least 4GB RAM.

**Tutorial and source code**. The source code of the iOS app is fully `open source <https://github.com/mlc-ai/mlc-llm/tree/main/ios>`__,
and a :ref:`tutorial <deploy-ios>` is included in documentation.
Expand All @@ -154,7 +154,7 @@ It is recommended to have at least 6GB free VRAM to run it.

|

**Requirement**. Llama2-7B model needs a device with a minimum of 6GB RAM, whereas the RedPajama-3B model runs with at least 4GB RAM.
**Requirement**. Llama3-8B model needs a device with a minimum of 6GB RAM, whereas the RedPajama-3B model runs with at least 4GB RAM.
The demo is tested on

- Samsung S23 with Snapdragon 8 Gen 2 chip
Expand Down