Commit 0cd9608
authored
Give
Exllama generates logits in torch Half-dtype, but Outlines requires the
Float-dtype.
This small change converts the logits to the required dtype (whatever
that might be), solving issue #583.
Tested with Exllama on the example code on the github front page, and
#583 is resolved.biased_logits the same dtype as logits
1 parent eb692f6 commit 0cd9608
1 file changed
+1
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
282 | 282 | | |
283 | 283 | | |
284 | 284 | | |
285 | | - | |
| 285 | + | |
286 | 286 | | |
287 | 287 | | |
288 | 288 | | |
0 commit comments