Bi-KV

Bipartite KVCache

Requirements

pip install transformers
pip install sentencepiece

python LLMScheduler.py

Name		Name	Last commit message	Last commit date
Latest commit History 18 Commits
dataloader		dataloader
datasets		datasets
inputGenerator		inputGenerator
.gitignore		.gitignore
LLMScheduler.py		LLMScheduler.py
README.md		README.md
Storage.py		Storage.py
config.py		config.py
qwen2.py		qwen2.py
test.py		test.py