When using the start listening feature, I'm getting terrible performance for my video, e.g. in Zoom.

[hyper-charlie]

Description

When using the start listening feature, I'm getting terrible performance for my video, e.g. in Zoom. Also the audio is reported to crackle and create noise for the other participants.

Device Information

Platform: macos
Architecture: aarch64
OS Version: 26.2.0
App Version: 1.0.5

---

This issue was submitted from the Hyprnote desktop app.

[hyper-charlie]

Log Analysis

Summary

ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.

Raw Logs (last 10KB)

RROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T19:43:13.112899Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T19:43:14.118380Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T19:43:15.927421Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T19:43:19.335622Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T19:43:25.941524Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T20:03:18.036485Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T20:03:22.208280Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T20:03:22.612923Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T20:03:23.208194Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T20:03:24.202125Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T20:03:26.001499Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T20:03:29.401816Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T20:03:36.008626Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T20:03:49.014716Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T20:03:53.204377Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T20:03:53.609399Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T20:03:54.206051Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T20:03:55.209157Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T20:03:57.013719Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T21:04:13.459787Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T21:04:37.249790Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T21:04:37.655510Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T21:04:38.233129Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T21:04:39.237128Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T21:04:41.202395Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T21:04:44.610121Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T21:04:51.217705Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T22:05:17.301056Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T22:05:21.312575Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T22:05:21.721381Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T22:05:22.309831Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T22:05:23.308753Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T22:05:25.109246Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T22:05:28.326976Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T22:05:34.935115Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:06:18.599358Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:06:22.971979Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:06:23.380127Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:06:23.969792Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:06:24.975610Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:06:26.784128Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:06:30.189052Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:06:36.794895Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:06:49.793715Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:06:53.968930Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:06:54.368017Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:06:54.994942Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:06:55.966751Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:51:22.354999Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:51:48.995483Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:51:49.398566Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:51:49.998530Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:51:51.004386Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:51:52.809920Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:51:56.218087Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-06T23:52:02.827331Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-07T00:07:17.885548Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]
2026-02-07T00:07:22.066891Z ERROR tauri_plugin_tracing::ext: [String("error sending request for url (https://auth.hyprnote.com/auth/v1/token?grant_type=refresh_token)")]

[devin-ai-integration]

Codebase Exploration — Relevant Context

Relevant Files and Components

Audio capture (macOS):

• crates/audio/src/speaker/macos.rs — macOS speaker capture via CoreAudio process tap + aggregate device. Uses a ring buffer (CHUNK_SIZE=256, BUFFER_SIZE=65536 samples) with an IO proc callback that runs on the real-time audio thread.
• crates/audio/src/speaker/mod.rs — Speaker stream abstraction, flattens Vec<f32> chunks into individual f32 samples.
• crates/audio/src/mic.rs — Mic capture via cpal with build_input_stream.
• crates/audio/src/lib.rs — AudioOutput::silence() plays infinite silence at 48kHz/2ch to the default output.

Listener plugin (orchestration):

• plugins/listener/src/actors/source/mod.rs — SourceActor starts a silence stream (AudioOutput::silence()) on init (line 121), initializes DeviceChangeWatcher, and creates the audio Pipeline.
• plugins/listener/src/actors/source/stream.rs — Sets up mic and speaker resampled streams targeting 16kHz, runs the async select loop to feed chunks into the actor.
• plugins/listener/src/actors/source/pipeline.rs — The hot path. For every audio chunk pair, runs: AEC → VAD masking → amplitude computation → recorder write → listener (STT) send.

CPU-intensive processing on the audio path:

• crates/aec/src/lib.rs — AEC runs two ONNX neural network inferences per block (128-sample block shift, 512-sample block), plus FFT/IFFT. Uses the 128 feature (smallest model), but still non-trivial per-chunk cost.
• crates/vad-ext/src/masking.rs + streaming.rs — VAD classifies every frame on the audio pipeline.

Recording:

• plugins/listener/src/actors/recorder.rs — WAV writer with stereo interleaved output, flushing every 1s.

---

Likely Causes of Performance Issues

1. Silence Stream Interference

When the listener starts, AudioOutput::silence() plays an infinite silent audio stream to the default output device via rodio. This is likely needed to keep the CoreAudio tap active, but it creates a competing audio output stream alongside Zoom. On macOS, this could cause audio mixing conflicts in the system audio pipeline, potentially explaining the crackling and noise other participants hear.

2. AEC Model Inference on the Hot Path

The AEC was recently enabled (commit 5b6d0859f — "enable AEC"). It runs two ONNX model inferences + FFT/IFFT per 128-sample block on every audio chunk in Pipeline::dispatch(). At 16kHz, that's ~125 inferences/second per model. This is the most CPU-intensive operation in the pipeline and could cause:

• High CPU usage competing with Zoom for resources (video encoding/decoding)
• Audio processing falling behind, causing buffer overflows/underflows

3. CoreAudio Aggregate Device + Process Tap

The macOS speaker capture creates a private aggregate device with a process tap (crates/audio/src/speaker/macos.rs). The IO proc callback runs on CoreAudio's real-time thread. While the recent commit 2856598bb ("make macOS speaker capture RT-safe") improved this, the ring buffer producer-consumer pattern still has potential for dropped samples (tracked via dropped_samples atomic counter, logged as warnings).

4. Cumulative Pipeline Work per Chunk

Each chunk goes through: Joiner → AEC (2x ONNX + FFT) → VAD → amplitude → recorder WAV write → STT WebSocket send. All of this happens synchronously in the actor message handler before processing the next chunk.

---

Recent Relevant Changes

Commit	Description	Relevance
5b6d0859f	"enable AEC"	High — Added AEC + VAD masking to the pipeline
2856598bb	"make macOS speaker capture RT-safe" (#3053)	Medium — Improved RT safety of audio callback
c71f005bd	"increase speaker buffer size" (#2942)	Medium — Increased ring buffer to prevent drops
2b070af84	"record mic and speaker as separate stereo channels" (#3406)	Low — More I/O per chunk
bf9c7b835	"remove MicStream read_data accumulation" (#3295)	Low — Fixed a mic stream issue

---

Potential Approaches

1. Profile AEC cost: Run the AEC benchmark (cargo bench -p aec --no-default-features --features 128) on Apple Silicon to measure per-block latency. If it exceeds the real-time budget (~8ms per 128 samples at 16kHz), consider making AEC optional or running it on a separate thread with a bounded channel.

2. Investigate silence stream necessity: Check if the CoreAudio tap can be kept alive without playing silence to the default output. The tap_auto_start key is currently set to false — setting it to true might eliminate the need for the silence stream.

3. Move heavy processing off the actor thread: The AEC + VAD + recorder writes could be offloaded to a dedicated processing thread/task, letting the source actor focus on low-latency audio ingestion.

4. Add CPU usage telemetry: Instrument the pipeline to measure time spent in each stage (AEC, VAD, recording, STT send) to identify the bottleneck.

---

Additional Information That Would Help

• Does the issue happen with all STT providers or only specific ones (local vs cloud)?
• Does disabling recording improve performance?
• What is the system's CPU usage during the issue? (Activity Monitor)
• How long has this been happening — specifically, did it start around app version 1.0.2+ when AEC was enabled?