Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added new demos: WebAudio and Virtual Backgrounds #2941

Merged
merged 1 commit into from
Apr 11, 2022

Conversation

lminiero
Copy link
Member

@lminiero lminiero commented Apr 8, 2022

As te title says, this adds nothing to Janus, but only adds a couple of demos focused entirely on the client side. Specifically, I added a couple of very basic demos:

  1. webaudio.html/:js shows how to use Web Audio to do some processing of what comes from the microphone, before sending it to Janus; it's very basic, since on the capture side it only adds a compressor, where you can dynamically tweak the parameters via some form inputs; the audio is then sent to the EchoTest plugin, which sends it back, and so WebAudio is used again just to visualize the output as well (which should help see the effect of the compressor).
  2. virtualbg.html/.js instead shows how you can use MediaPipe to add a virtual background to the local camera before sending it to Janus: since the EchoTest is used here as well, you can see that what you send is exactly what you receive.

Both demos are quite basic and are not meant to provide something production ready: there's much more you can do with Web Audio than that, for instance, and the same could be said for virtual backgrounds (where you may want to blur, instead of using a background, or use a green screen like this excellent webrtcHacks blog post describes).

That said, hopefully they'll provide useful to people that want to tinker with features like this, as I wanted to stress out these are things you typically do on the client side, and have nothing to do with Janus.

@lminiero
Copy link
Member Author

Merging.

@lminiero lminiero merged commit 48aac05 into master Apr 11, 2022
@lminiero lminiero deleted the webaudio-mediapipe branch April 11, 2022 12:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant