Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
a fix to large prompts where we got an issue when going for speed. there we run into issues because of different tensorsizes with torch.cat. maybe someday I find how to fix that, for now we test the size and if different we fall back to slow but safe
- Loading branch information