-
Notifications
You must be signed in to change notification settings - Fork 3.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
wchess: whisper assisted chess #1595
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Awesome job!
I encounter some bugs from time to time with the chess logic, but it's not a big issue since the main point of the example is to demonstrate the voice recognition functionality.
Btw, I have now added the grammar to be displayed in the UI so this makes debugging a bit easier.
Fun use of chessboardjs here 🤓 🎉 |
* wchess: whisper assisted chess * wchess: fix allowed moves in check * wchess: touchstart, touchend events * wchess: css, disabled button * wchess : html touches * wchess : minor fixes and code style * wchess : bump encoder context to 1280 * wchess : index.html * wchess : fix CI warnings * wchess : add array header * wchess : build static library * wchess : display grammar * wchess : update UX * wchess : add comment * wchess : add README --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* origin/master: bench.py : add different large models (ggerganov#1655) wchess : update README.md release : v1.5.2 wchess : update readme wchess : whisper assisted chess (ggerganov#1595) sync : ggml (Metal fixes, new ops, tests) (ggerganov#1633) cmake : target windows 8 or above for prefetchVirtualMemory in llama-talk (ggerganov#1617) cmake : Fix bug in httplib.h for mingw (ggerganov#1615) metal : fix `ggml_metal_log` vargs (ggerganov#1606) whisper.objc : disable timestamps for real-time transcription whisper : more debug messages + fix fallback logic metal : fix soft_max kernel src1 argument (ggerganov#1602) sync : ggml (new ops, new backend, etc) (ggerganov#1602) server : pass max-len argument to the server (ggerganov#1574) ios : Remove `#if arch(arm)` check for using Metal (ggerganov#1561) ggml : Fix 32-bit compiler warning (ggerganov#1575) ggml : re-enable blas for src0 != F32 (ggerganov#1583)
* wchess: whisper assisted chess * wchess: fix allowed moves in check * wchess: touchstart, touchend events * wchess: css, disabled button * wchess : html touches * wchess : minor fixes and code style * wchess : bump encoder context to 1280 * wchess : index.html * wchess : fix CI warnings * wchess : add array header * wchess : build static library * wchess : display grammar * wchess : update UX * wchess : add comment * wchess : add README --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
wchess.asm: Web assembly + chessboardjs library
wchess.cmd: Command line binary for testing and debugging.
Note: It seems to me that the (grammar) end-of-token modification used earlier might have had a positive effect. So it may be worth looking into it again.