Releases: naeruru/mimiuchi
mimiuchi v0.4.1
Download the desktop app to interface with applications like VRChat. Currently, you can only use speech-to-text on the web version, so the desktop app is just a middle application. You can technically use other apps to accomplish this (by using the webhook on the website).
Instructions for VRChat
English: How to use Speech-to-text with VRChat
- Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
- install and open the desktop app (mimiuchi_0.4.1.exe)
- go to mimiuchi.com
- toggle the mic button on the website (make sure to grant permission)
- toggle the broadcast button on the website (this will toggle it on the desktop app too)
you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
- VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
- デスクトップアプリをインストールして、開きます (mimiuchi_0.4.1.exe)
- mimiuchi.comにアクセスします
- ウェブサイトでマイクボタンをトグルします (許可する必要があります)
- ウェブサイトでブロードキャストボタンをトグルします
Changes
- added tiktok and yukumo voices to the TTS options. there's so many!
- complete refactor to composition api (thanks @jeremio and @fuwako)
let me know if you have any suggestions or issues !!
mimiuchi v0.3.4
Download the desktop app to interface with applications like VRChat. Currently, you can only use speech-to-text on the web version, so the desktop app is just a middle application. You can technically use other apps to accomplish this (by using the webhook on the website).
Instructions for VRChat
English: How to use Speech-to-text with VRChat
- Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
- install and open the desktop app (mimiuchi_0.3.4.exe)
- go to mimiuchi.com
- toggle the mic button on the website (make sure to grant permission)
- toggle the broadcast button on the website (this will toggle it on the desktop app too)
you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
- VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
- デスクトップアプリをインストールして、開きます (mimiuchi_0.3.4.exe)
- mimiuchi.comにアクセスします
- ウェブサイトでマイクボタンをトグルします (許可する必要があります)
- ウェブサイトでブロードキャストボタンをトグルします
Changes
Planned
- Whisper inference (eventually)
- DeepL option
let me know if you have any suggestions or issues !!
mimiuchi v0.3.3
Download the desktop app to interface with applications like VRChat. Currently, you can only use speech-to-text on the web version, so the desktop app is just a middle application. You can technically use other apps to accomplish this (by using the webhook on the website).
Instructions for VRChat
English: How to use Speech-to-text with VRChat
- Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
- install and open the desktop app (mimiuchi_0.3.3.exe)
- go to mimiuchi.com
- toggle the mic button on the website (make sure to grant permission)
- toggle the broadcast button on the website (this will toggle it on the desktop app too)
you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
- VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
- デスクトップアプリをインストールして、開きます (mimiuchi_0.3.3.exe)
- mimiuchi.comにアクセスします
- ウェブサイトでマイクボタンをトグルします (許可する必要があります)
- ウェブサイトでブロードキャストボタンをトグルします
Changes
- Revised word replace (thanks @fuwako)
- Add language pinning (thanks @fuwako)
- Add ability to exit settings with ESC key (thanks @fuwako)
- Add Spanish UI (thanks @adrianpaniagualeon)
- Add code linter (thanks @jeremio)
- A few layout adjustments
- Random bug fixes
Planned
- Whisper inference (eventually)
- DeepL option
let me know if you have any suggestions or issues !!
mimiuchi v0.3.2
Download the desktop app to interface with applications like VRChat. Currently, you can only use speech-to-text on the web version, so the desktop app is just a middle application. You can technically use other apps to accomplish this (by using the webhook on the website).
Instructions for VRChat
English: How to use Speech-to-text with VRChat
- Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
- install and open the desktop app (mimiuchi_0.3.0.exe)
- go to mimiuchi.com
- toggle the mic button on the website (make sure to grant permission)
- toggle the broadcast button on the website (this will toggle it on the desktop app too)
you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
- VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
- デスクトップアプリをインストールして、開きます (mimiuchi_0.3.0.exe)
- mimiuchi.comにアクセスします
- ウェブサイトでマイクボタンをトグルします (許可する必要があります)
- ウェブサイトでブロードキャストボタンをトグルします
Changes
- (BETA) On-device translations. Translate sentences to almost 200 other languages. Requires local CPU resources.
- Added ability to play SFX noise in VRChat when sending text to textbox
- Update notifications in settings menu
- Enabling the "show original before translating" now also shows the original in VRChat.
- Fix issue where some languages would send blank data to the textbox when hearing white noise.
Planned
- Whisper inference (eventually)
- DeepL option
let me know if you have any suggestions or issues !!
mimiuchi v0.3.1
Download the desktop app to interface with applications like VRChat. Currently, you can only use speech-to-text on the web version, so the desktop app is just a middle application. You can technically use other apps to accomplish this (by using the webhook on the website).
Instructions for VRChat
English: How to use Speech-to-text with VRChat
- Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
- install and open the desktop app (mimiuchi_0.3.0.exe)
- go to mimiuchi.com
- toggle the mic button on the website (make sure to grant permission)
- toggle the broadcast button on the website (this will toggle it on the desktop app too)
you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
- VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
- デスクトップアプリをインストールして、開きます (mimiuchi_0.3.0.exe)
- mimiuchi.comにアクセスします
- ウェブサイトでマイクボタンをトグルします (許可する必要があります)
- ウェブサイトでブロードキャストボタンをトグルします
Changes
- (BETA) On-device translations. Translate sentences to almost 200 other languages. Requires local CPU resources.
- Enabling the "show original before translating" now also shows the original in VRChat.
- Fix issue where some languages would send blank data to the textbox when hearing white noise.
Planned
- Whisper inference (eventually)
- DeepL option
let me know if you have any suggestions or issues !!
mimiuchi v0.3.0
Download the desktop app to interface with applications like VRChat. Currently, you can only use speech-to-text on the web version, so the desktop app is just a middle application. You can technically use other apps to accomplish this (by using the webhook on the website).
Instructions for VRChat
English: How to use Speech-to-text with VRChat
- Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
- install and open the desktop app (mimiuchi_0.3.0.exe)
- go to mimiuchi.com
- toggle the mic button on the website (make sure to grant permission)
- toggle the broadcast button on the website (this will toggle it on the desktop app too)
you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
- VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
- デスクトップアプリをインストールして、開きます (mimiuchi_0.3.0.exe)
- mimiuchi.comにアクセスします
- ウェブサイトでマイクボタンをトグルします (許可する必要があります)
- ウェブサイトでブロードキャストボタンをトグルします
Changes
- On-device translations. Translate sentences to almost 200 other languages. Requires local CPU resources.
- Fonts. Lots of fonts.
- Additional line break customization
- Adds ability to download session transcript (will clear on app exit)
- Fix issue where mic access would not fully terminate when turning mic off
- Fix issue where webhook would fire even when not broadcasting
Planned
- Whisper inference (eventually)
let me know if you have any suggestions or issues !!
mimiuchi v0.2.2
Instructions for VRChat
English: How to use Speech-to-text with VRChat
- Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
- install and open the desktop app
- go to mimiuchi.com
- toggle the mic button on the website (make sure to grant permission)
- toggle the broadcast button on the website (this will toggle it on the desktop app too)
you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
- VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
- デスクトップアプリをインストールして、開きます
- mimiuchi.comにアクセスします
- ウェブサイトでマイクボタンをトグルします (許可する必要があります)
- ウェブサイトでブロードキャストボタンをトグルします
Changes
- bug fixes with webhook
Known issues
- Edge is overly sensitive and can often interpret background noise as words. Use the Sensitivity gate if you are worried it might pick up background noise. It will only start sending text when the gate is passed.
- Mic does not fully shutdown when you turn off speech recognition in some rare edge cases
Planned
- Whisper inference
let me know if you have any suggestions or issues !!
mimiuchi v0.2.1
Instructions for VRChat
English: How to use Speech-to-text with VRChat
- Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
- install and open the desktop app
- go to mimiuchi.com
- toggle the mic button on the website (make sure to grant permission)
- toggle the broadcast button on the website (this will toggle it on the desktop app too)
you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
- VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
- デスクトップアプリをインストールして、開きます
- mimiuchi.comにアクセスします
- ウェブサイトでマイクボタンをトグルします (許可する必要があります)
- ウェブサイトでブロードキャストボタンをトグルします
Changes
- Add webhooks
- Properly queue text past chatbox limit
- add more STT languages
Known issues
- bug where you can't use a webhook unless the websocket works
- Edge is overly sensitive and can often interpret background noise as words. Use the Sensitivity gate if you are worried it might pick up background noise. It will only start sending text when the gate is passed.
- Mic does not fully shutdown when you turn off speech recognition in some rare edge cases
Planned
- Whisper inference
let me know if you have any suggestions or issues !!
mimiuchi v0.2.0
Instructions for VRChat
English: How to use Speech-to-text with VRChat
- Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
- install and open the desktop app
- go to mimiuchi.naeris.net
- toggle the mic button on the website (make sure to grant permission)
- toggle the broadcast button on the website (this will toggle it on the desktop app too)
you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
- VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
- デスクトップアプリをインストールして、開きます
- mimiuchi.naeris.netにアクセスします
- ウェブサイトでマイクボタンをトグルします (許可する必要があります)
- ウェブサイトでブロードキャストボタンをトグルします
Changes
- added text-to-speech (Web Speech API only for now)
- custom window bar
- new connections page to adjust websocket (and future connections)
- default websocket changed to 7714
- websocket json object was changed from
data.text
todata.transcript
Known issues
- Edge is overly sensitive and can often interpret background noise as words
- Quest Pro mic is close to its speakers, so the application will interpret text from other people talking
let me know if you have any suggestions or issues !!
mimiuchi v0.1.1
Changes
- adjust how the scrollbar works
- fix issue with textbox region on first load
- change loading animation
If you have suggestions or issues, please let me know!
How to use Speech-to-text with VRChat
- install and open the desktop app
- go to mimiuchi.naeris.net
- toggle the mic button on the website (make sure to grant permission)
- toggle the broadcast button on the website (this will toggle it on the desktop app too)
- that's it~! speak and it will transmit all text to VRChat.
you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.