Skip to content

Commit

Permalink
[Doc]: Updating GitHub link (#5)
Browse files Browse the repository at this point in the history
* updating github link

* Changing project references

* minor change

* should_use_given_dir flag from prefill_profiler
  • Loading branch information
anmolagarwalcp810 authored Jul 9, 2024
1 parent 5d160db commit 09816a4
Show file tree
Hide file tree
Showing 4 changed files with 4 additions and 6 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ Tool to benchmark LLM Inference Systems

### Clone repository
```bash
git clone https://github.com/gatech-sysml/metron.git
git clone https://github.com/project-metron/metron.git
```

### Create conda environment
Expand Down
2 changes: 1 addition & 1 deletion docs/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -40,5 +40,5 @@ If you use our work, please consider citing our paper:
Acknowledgement
---------------
`metron <https://github.com/gatech-sysml/metron>`_ code was originally created as a fork from `LLMPerf <https://github.com/ray-project/llmperf>`_ project.
`metron <https://github.com/project-metron/metron>`_ code was originally created as a fork from `LLMPerf <https://github.com/ray-project/llmperf>`_ project.

2 changes: 1 addition & 1 deletion docs/installation.rst
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ Clone Repository

.. code-block:: shell
git clone https://github.com/gatech-sysml/metron.git
git clone https://github.com/project-metron/metron.git
Create Conda Environment
~~~~~~~~~~~~~~~~~~~~~~~~
Expand Down
4 changes: 1 addition & 3 deletions docs/tutorials/prefill_profiler.rst
Original file line number Diff line number Diff line change
Expand Up @@ -21,8 +21,7 @@ And, then run the following command:
--timeout 600 \
--num-concurrent-requests 1 \
--fixed-request-generator-decode-tokens 16 \
--output-dir "prefill_experiments/prefill_profiler_vllm_llama-3-8b" \
--should-use-given-dir true
--output-dir "prefill_experiments/prefill_profiler_vllm_llama-3-8b"
Adjusting Prompt Lengths
~~~~~~~~~~~~~~~~~~~~~~~~
Expand All @@ -44,6 +43,5 @@ To profile a custom range of prompt lengths, use the flag ``--prefill-lengths``
--num-concurrent-requests 1 \
--fixed-request-generator-decode-tokens 16 \
--output-dir "prefill_experiments/prefill_profiler_vllm_llama-3-8b" \
--should-use-given-dir true \
--prefill-lengths 256 512 1024 2048 4096 8192 16384 32768 65536

0 comments on commit 09816a4

Please sign in to comment.