Skip to content

Releases: naeruru/mimiuchi

mimiuchi v0.4.1

22 Jul 02:52
9eb8a74
Compare
Choose a tag to compare

Download the desktop app to interface with applications like VRChat. Currently, you can only use speech-to-text on the web version, so the desktop app is just a middle application. You can technically use other apps to accomplish this (by using the webhook on the website).

Instructions for VRChat

English: How to use Speech-to-text with VRChat
  1. Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
  2. osc
  3. install and open the desktop app (mimiuchi_0.4.1.exe)
  4. go to mimiuchi.com
  5. toggle the mic button on the website (make sure to grant permission)
  6. toggle the broadcast button on the website (this will toggle it on the desktop app too)
  7. toggle
that's it~! speak and it will transmit all text to VRChat.

you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
  1. VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
  2. osc
  3. デスクトップアプリをインストールして、開きます (mimiuchi_0.4.1.exe)
  4. mimiuchi.comにアクセスします
  5. ウェブサイトでマイクボタンをトグルします (許可する必要があります)
  6. ウェブサイトでブロードキャストボタンをトグルします
  7. toggle
やった~!話すと、テキストがVRChatに送信されます。アプリで日本語を選択することも可能です。
language

Changes

  • added tiktok and yukumo voices to the TTS options. there's so many!
  • complete refactor to composition api (thanks @jeremio and @fuwako)

let me know if you have any suggestions or issues !!

mimiuchi v0.3.4

25 Apr 01:59
761ec9e
Compare
Choose a tag to compare

Download the desktop app to interface with applications like VRChat. Currently, you can only use speech-to-text on the web version, so the desktop app is just a middle application. You can technically use other apps to accomplish this (by using the webhook on the website).

Instructions for VRChat

English: How to use Speech-to-text with VRChat
  1. Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
  2. osc
  3. install and open the desktop app (mimiuchi_0.3.4.exe)
  4. go to mimiuchi.com
  5. toggle the mic button on the website (make sure to grant permission)
  6. toggle the broadcast button on the website (this will toggle it on the desktop app too)
  7. toggle
that's it~! speak and it will transmit all text to VRChat.

you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
  1. VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
  2. osc
  3. デスクトップアプリをインストールして、開きます (mimiuchi_0.3.4.exe)
  4. mimiuchi.comにアクセスします
  5. ウェブサイトでマイクボタンをトグルします (許可する必要があります)
  6. ウェブサイトでブロードキャストボタンをトグルします
  7. toggle
やった~!話すと、テキストがVRChatに送信されます。アプリで日本語を選択することも可能です。
language

Changes

  • Added themes (thanks @fuwako)
  • Update OSC param triggers page (thanks @fuwako)

Planned

  • Whisper inference (eventually)
  • DeepL option

let me know if you have any suggestions or issues !!

mimiuchi v0.3.3

08 Apr 22:22
f2406ac
Compare
Choose a tag to compare

Download the desktop app to interface with applications like VRChat. Currently, you can only use speech-to-text on the web version, so the desktop app is just a middle application. You can technically use other apps to accomplish this (by using the webhook on the website).

Instructions for VRChat

English: How to use Speech-to-text with VRChat
  1. Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
  2. osc
  3. install and open the desktop app (mimiuchi_0.3.3.exe)
  4. go to mimiuchi.com
  5. toggle the mic button on the website (make sure to grant permission)
  6. toggle the broadcast button on the website (this will toggle it on the desktop app too)
  7. toggle
that's it~! speak and it will transmit all text to VRChat.

you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
  1. VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
  2. osc
  3. デスクトップアプリをインストールして、開きます (mimiuchi_0.3.3.exe)
  4. mimiuchi.comにアクセスします
  5. ウェブサイトでマイクボタンをトグルします (許可する必要があります)
  6. ウェブサイトでブロードキャストボタンをトグルします
  7. toggle
やった~!話すと、テキストがVRChatに送信されます。アプリで日本語を選択することも可能です。
language

Changes

  • Revised word replace (thanks @fuwako)
  • Add language pinning (thanks @fuwako)
  • Add ability to exit settings with ESC key (thanks @fuwako)
  • Add Spanish UI (thanks @adrianpaniagualeon)
  • Add code linter (thanks @jeremio)
  • A few layout adjustments
  • Random bug fixes

Planned

  • Whisper inference (eventually)
  • DeepL option

let me know if you have any suggestions or issues !!

mimiuchi v0.3.2

02 Dec 21:35
34b19b6
Compare
Choose a tag to compare

Download the desktop app to interface with applications like VRChat. Currently, you can only use speech-to-text on the web version, so the desktop app is just a middle application. You can technically use other apps to accomplish this (by using the webhook on the website).

Instructions for VRChat

English: How to use Speech-to-text with VRChat
  1. Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
  2. osc
  3. install and open the desktop app (mimiuchi_0.3.0.exe)
  4. go to mimiuchi.com
  5. toggle the mic button on the website (make sure to grant permission)
  6. toggle the broadcast button on the website (this will toggle it on the desktop app too)
  7. toggle
that's it~! speak and it will transmit all text to VRChat.

you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
  1. VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
  2. osc
  3. デスクトップアプリをインストールして、開きます (mimiuchi_0.3.0.exe)
  4. mimiuchi.comにアクセスします
  5. ウェブサイトでマイクボタンをトグルします (許可する必要があります)
  6. ウェブサイトでブロードキャストボタンをトグルします
  7. toggle
やった~!話すと、テキストがVRChatに送信されます。アプリで日本語を選択することも可能です。
language

Changes

  • (BETA) On-device translations. Translate sentences to almost 200 other languages. Requires local CPU resources.
  • Added ability to play SFX noise in VRChat when sending text to textbox
  • Update notifications in settings menu
  • Enabling the "show original before translating" now also shows the original in VRChat.
  • Fix issue where some languages would send blank data to the textbox when hearing white noise.

Planned

  • Whisper inference (eventually)
  • DeepL option

let me know if you have any suggestions or issues !!

mimiuchi v0.3.1

23 Nov 03:49
0a7a1b8
Compare
Choose a tag to compare

Download the desktop app to interface with applications like VRChat. Currently, you can only use speech-to-text on the web version, so the desktop app is just a middle application. You can technically use other apps to accomplish this (by using the webhook on the website).

Instructions for VRChat

English: How to use Speech-to-text with VRChat
  1. Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
  2. osc
  3. install and open the desktop app (mimiuchi_0.3.0.exe)
  4. go to mimiuchi.com
  5. toggle the mic button on the website (make sure to grant permission)
  6. toggle the broadcast button on the website (this will toggle it on the desktop app too)
  7. toggle
that's it~! speak and it will transmit all text to VRChat.

you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
  1. VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
  2. osc
  3. デスクトップアプリをインストールして、開きます (mimiuchi_0.3.0.exe)
  4. mimiuchi.comにアクセスします
  5. ウェブサイトでマイクボタンをトグルします (許可する必要があります)
  6. ウェブサイトでブロードキャストボタンをトグルします
  7. toggle
やった~!話すと、テキストがVRChatに送信されます。アプリで日本語を選択することも可能です。
language

Changes

  • (BETA) On-device translations. Translate sentences to almost 200 other languages. Requires local CPU resources.
  • Enabling the "show original before translating" now also shows the original in VRChat.
  • Fix issue where some languages would send blank data to the textbox when hearing white noise.

Planned

  • Whisper inference (eventually)
  • DeepL option

let me know if you have any suggestions or issues !!

mimiuchi v0.3.0

20 Oct 05:50
a194130
Compare
Choose a tag to compare

Download the desktop app to interface with applications like VRChat. Currently, you can only use speech-to-text on the web version, so the desktop app is just a middle application. You can technically use other apps to accomplish this (by using the webhook on the website).

Instructions for VRChat

English: How to use Speech-to-text with VRChat
  1. Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
  2. osc
  3. install and open the desktop app (mimiuchi_0.3.0.exe)
  4. go to mimiuchi.com
  5. toggle the mic button on the website (make sure to grant permission)
  6. toggle the broadcast button on the website (this will toggle it on the desktop app too)
  7. toggle
that's it~! speak and it will transmit all text to VRChat.

you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
  1. VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
  2. osc
  3. デスクトップアプリをインストールして、開きます (mimiuchi_0.3.0.exe)
  4. mimiuchi.comにアクセスします
  5. ウェブサイトでマイクボタンをトグルします (許可する必要があります)
  6. ウェブサイトでブロードキャストボタンをトグルします
  7. toggle
やった~!話すと、テキストがVRChatに送信されます。アプリで日本語を選択することも可能です。
language

Changes

  • On-device translations. Translate sentences to almost 200 other languages. Requires local CPU resources.
  • Fonts. Lots of fonts.
  • Additional line break customization
  • Adds ability to download session transcript (will clear on app exit)
  • Fix issue where mic access would not fully terminate when turning mic off
  • Fix issue where webhook would fire even when not broadcasting

Planned

  • Whisper inference (eventually)

let me know if you have any suggestions or issues !!

mimiuchi v0.2.2

15 Jul 23:09
fb51c6b
Compare
Choose a tag to compare

Instructions for VRChat

English: How to use Speech-to-text with VRChat
  1. Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
  2. osc
  3. install and open the desktop app
  4. go to mimiuchi.com
  5. toggle the mic button on the website (make sure to grant permission)
  6. toggle the broadcast button on the website (this will toggle it on the desktop app too)
  7. toggle
that's it~! speak and it will transmit all text to VRChat.

you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
  1. VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
  2. osc
  3. デスクトップアプリをインストールして、開きます
  4. mimiuchi.comにアクセスします
  5. ウェブサイトでマイクボタンをトグルします (許可する必要があります)
  6. ウェブサイトでブロードキャストボタンをトグルします
  7. toggle
やった~!話すと、テキストがVRChatに送信されます。アプリで日本語を選択することも可能です。
language

Changes

  • bug fixes with webhook

Known issues

  • Edge is overly sensitive and can often interpret background noise as words. Use the Sensitivity gate if you are worried it might pick up background noise. It will only start sending text when the gate is passed.
  • Mic does not fully shutdown when you turn off speech recognition in some rare edge cases

Planned

  • Whisper inference

let me know if you have any suggestions or issues !!

mimiuchi v0.2.1

15 Jul 00:59
fbcf9dc
Compare
Choose a tag to compare

Instructions for VRChat

English: How to use Speech-to-text with VRChat
  1. Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
  2. osc
  3. install and open the desktop app
  4. go to mimiuchi.com
  5. toggle the mic button on the website (make sure to grant permission)
  6. toggle the broadcast button on the website (this will toggle it on the desktop app too)
  7. toggle
that's it~! speak and it will transmit all text to VRChat.

you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
  1. VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
  2. osc
  3. デスクトップアプリをインストールして、開きます
  4. mimiuchi.comにアクセスします
  5. ウェブサイトでマイクボタンをトグルします (許可する必要があります)
  6. ウェブサイトでブロードキャストボタンをトグルします
  7. toggle
やった~!話すと、テキストがVRChatに送信されます。アプリで日本語を選択することも可能です。
language

Changes

  • Add webhooks
  • Properly queue text past chatbox limit
  • add more STT languages

Known issues

  • bug where you can't use a webhook unless the websocket works
  • Edge is overly sensitive and can often interpret background noise as words. Use the Sensitivity gate if you are worried it might pick up background noise. It will only start sending text when the gate is passed.
  • Mic does not fully shutdown when you turn off speech recognition in some rare edge cases

Planned

  • Whisper inference

let me know if you have any suggestions or issues !!

mimiuchi v0.2.0

07 Jun 20:14
734f52d
Compare
Choose a tag to compare

Instructions for VRChat

English: How to use Speech-to-text with VRChat
  1. Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
  2. osc
  3. install and open the desktop app
  4. go to mimiuchi.naeris.net
  5. toggle the mic button on the website (make sure to grant permission)
  6. toggle the broadcast button on the website (this will toggle it on the desktop app too)
  7. toggle
that's it~! speak and it will transmit all text to VRChat.

you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
  1. VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
  2. osc
  3. デスクトップアプリをインストールして、開きます
  4. mimiuchi.naeris.netにアクセスします
  5. ウェブサイトでマイクボタンをトグルします (許可する必要があります)
  6. ウェブサイトでブロードキャストボタンをトグルします
  7. toggle
やった~!話すと、テキストがVRChatに送信されます。アプリで日本語を選択することも可能です。
language

Changes

  • added text-to-speech (Web Speech API only for now)
  • custom window bar
  • new connections page to adjust websocket (and future connections)
  • default websocket changed to 7714
  • websocket json object was changed from data.text to data.transcript

Known issues

  • Edge is overly sensitive and can often interpret background noise as words
  • Quest Pro mic is close to its speakers, so the application will interpret text from other people talking

let me know if you have any suggestions or issues !!

mimiuchi v0.1.1

22 May 10:28
d06b74c
Compare
Choose a tag to compare

Changes

  • adjust how the scrollbar works
  • fix issue with textbox region on first load
  • change loading animation

If you have suggestions or issues, please let me know!

How to use Speech-to-text with VRChat

  • install and open the desktop app
  • go to mimiuchi.naeris.net
  • toggle the mic button on the website (make sure to grant permission)
  • toggle the broadcast button on the website (this will toggle it on the desktop app too)
  • that's it~! speak and it will transmit all text to VRChat.

you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.