Skip to content

Files

This branch is 642 commits ahead of, 29 commits behind vllm-project/vllm:main.

benchmarks

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
Feb 2, 2025
Feb 2, 2025
Feb 2, 2025
Feb 3, 2025
Feb 2, 2025
Feb 12, 2025
Dec 4, 2024
Feb 10, 2025
Feb 10, 2025
Feb 11, 2025
Feb 2, 2025
Feb 2, 2025
Feb 17, 2025
Feb 2, 2025
Feb 2, 2025
Feb 2, 2025
Feb 17, 2025
Feb 17, 2025
Feb 17, 2025
Feb 17, 2025
Nov 7, 2024
Mar 27, 2024

Benchmarking vLLM

Downloading the ShareGPT dataset

You can download the dataset by running:

wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json

Downloading the ShareGPT4V dataset

The json file refers to several image datasets (coco, llava, etc.). The benchmark scripts will ignore a datapoint if the referred image is missing.

wget https://huggingface.co/datasets/Lin-Chen/ShareGPT4V/resolve/main/sharegpt4v_instruct_gpt4-vision_cap100k.json
mkdir coco -p
wget http://images.cocodataset.org/zips/train2017.zip -O coco/train2017.zip
unzip coco/train2017.zip -d coco/

Downloading the BurstGPT dataset

You can download the BurstGPT v1.1 dataset by running:

wget https://github.com/HPMLL/BurstGPT/releases/download/v1.1/BurstGPT_without_fails_2.csv