Skip to content

AlmostInteractive/ESP32-S3-Box-3-Voice-Assistant-Sensor-Dock

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

96 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ESP32-S3-Box-3-Voice-Assistant-Sensor-Dock

This config integrates Voice Assistant with the S3 Box 3's sensor dock. Full HA integration for everything actionable and adjustable on the device. Top-left physical button turns on/off the screen (device remains fully active). Bottom-left physical button resets the device. Red circle touch button toggles Voice Assistant mute. Top MUTE button will cause an unfixable error in the VA and the device must be reset to fix it, so don't touch that button.

Features:

  • Voice assistant with on-device and in-HA wakeword
  • Three VA response modes: Speech, Beeps, and Mute (settings page and red-circle button)
  • Touchscreen
  • IR learning
  • IR blasting
  • Temperature sensor
  • Battery sensor
  • Radar presence detection

NB: This and similar configs seem to have an issue where the touchscreen sometimes fails to initialize (write failure). To cope with this, I've added a failure detection and failure state which will automatically reboot after 10 seconds until the touchscreen initializes correctly. Pushing the top-left physical button during the countdown will cancel the reboot.

Status Page

status

Shows the status of wifi and HA connections, battery charge (if inserted), LED power, and temperature. Shows cute little pictures to depict the VA status. Nothing interactable.

IR Learning Page

irlearn

Touch and IR slot button to begin recording to that slot. Following the on-screen prompts, press the button on your control two times to learn the IR code. You can record over an existing IR slot.

IR Blast Page

irblast

Touch an IR slot button to emit the learned IR code. Note that in my testing the LED emitter was weak. The device had to be within 1.3m before it would register.

Voice Assistant Page

va

Shows the complete status of the Voice Assistant, including last STT phrase it heard and TTS reply. Nothing interactable.

Settings Page

settings

Allows toggling the VA speaker mute (NB: does not prevent the VA from listening). Adjust speaker volume and sleep / screen saver delay.

Resources

https://github.com/BigBobbas/ESP32-S3-Box3-Custom-ESPHome

https://github.com/esphome/firmware/tree/main/wake-word-voice-assistant

https://github.com/AlmostInteractive/ESP32-S3-Box3-IR-Blaster-Learning-Example/

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Packages

No packages published

Contributors 2

  •  
  •