-
Notifications
You must be signed in to change notification settings - Fork 11.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Parallel Quantize.sh, add & #106
Comments
The fix need to be more elaborate, because if you pass Can you come up with a solution that does not have this issue? |
Yes, this works. But now I realised this completely defeats the purpose of the remove flag. The remove flag is there to save disk space after each conversion has been done. So this means the remove flag only makes sense when processing the files one after each other. @ggerganov Do you think it makes sense to run the script in parallel by default and switch to serial processing when |
ah I see what you mean, swapping disk resources |
I think it is better to multi-thread the If you agree, either reformulate this issue and add "good first issue" tag or create a new one and close this. |
I agree. This makes sense especially for this reason:
ACK FWIW, I really respect your shell skills @tljstewart 👍 |
Done another way (rewrite to python) in #222 |
@prusnak
./quantize "$i" "${i/f16/q4_0}" 2 &
The text was updated successfully, but these errors were encountered: