Add 4-bit support to IA3 - Outperforms QLoRA in both speed and memory consumption #1231
Job | Run time |
---|---|
2m 43s | |
7m 46s | |
7m 0s | |
11m 46s | |
8m 43s | |
4m 22s | |
10m 24s | |
8m 6s | |
6m 33s | |
8m 29s | |
1h 15m 52s |
Job | Run time |
---|---|
2m 43s | |
7m 46s | |
7m 0s | |
11m 46s | |
8m 43s | |
4m 22s | |
10m 24s | |
8m 6s | |
6m 33s | |
8m 29s | |
1h 15m 52s |