Skip to content

huggingface transformer with RWKV world model and trainning with lora.

Notifications You must be signed in to change notification settings

xiaol/Huggingface-RWKV-World

Repository files navigation

Huggingface-RWKV-World

Can use huggingface transformer libs to run world, should notice the tokenizer and vocabs files are different from old models.

  1. Add Classifier-Free Guidance sampling

todo: fix slow inference test with pytorch 2.0

original coded by staring2022

About

huggingface transformer with RWKV world model and trainning with lora.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published