Releases: FasterDecoding/Medusa
Releases · FasterDecoding/Medusa
Medusa-v0.1
Medusa is a easy-to-use framework that democratizes the acceleration techniques for LLM generation. Medusa-v0.1 uses several extra light-weighted decoding head, and exclude the need for draft model.