Merged MCU streams do not work with audio only publishers

[KamilBeda]

We are experiencing an issue with our app when trying to create merged MCU streams with different users publishing audio-only or camera + audio content. The issue occurs when an audio-only publisher joins the room: the stream breaks down and there is no audio output on the receiver end, with the video appearing black.

Environment

• Operating system and version: Manjaro / MacOS
• Java version: default install on AWS
• Ant Media Server version: 2.5.1
• Browser name and version: any modern browser

Steps to reproduce

1. Create WebRTCAdaptor for publisher and set mediaConstraints.video to false
2. Join the room and start publishing in MCU mode
3. Try to preview the merged stream in playOnly mode

Expected behavior

Publisher can join the room with audio only and stream recievers can hear audio output.
Streams merging merges video+audio streams with audio only streams.
I think that https://github.com/ant-media/StreamApp/blob/master/src/main/webapp/conference.html example should be extended to include audioOnly query parameter which makes the stream audio only.

Actual behavior

the stream breaks down when the audio-only publisher joins the room, with no audio output and a black video. When we preview the individual streams, they work as expected, but the merged stream is broken.
I don't know if this is related to this issue but the example MCU audio only example at https://ovh36.antmedia.io:5443/WebRTCAppEE/mcu.html?audioOnly is borken in the same way for me. There is no audio output when I join the room in playOnly mode at https://ovh36.antmedia.io:5443/WebRTCAppEE/mcu.html?playOnly

[mekya]

Thank you @KamilBeda . I think we've resolved this issue in the latest snapshot but let's confirm it.

[PiotrBaczkowski]

Is there way we can get latest snapshot on aws marketplace to verify?

[mekya]

Hi @PiotrBaczkowski ,

We eventually expect to have new release 2.5.2.

Yes, of course you can get the latest snapshot to try on aws marketplace from contact@antmedia.io
If you have an account at antmedia.io, then it's always available in the Subscriptions> Downloads and updated automatically with changelog https://antmedia.io/changelog/changelog.html

Regards
Oguz

[Mohit-3196]

Hi @KamilBeda,
How are you?
I made some tests and it seems that audio only MCU is not working as expected.
Even when trying to create a MCU room with audio only streams only, still there are some issue.
I will make some more tests and keep you updated.

Thank you

[burak-58]

ant-media/Plugins#53