Training on non-vocal data, for noise removal? #554
Replies: 5 comments 3 replies
-
|
Very interested about this too, I am a sound designer as well |
Beta Was this translation helpful? Give feedback.
-
|
+1 from me |
Beta Was this translation helpful? Give feedback.
-
|
+1 for me |
Beta Was this translation helpful? Give feedback.
-
|
@Landeplage @g-frega Yes this is possible. To create a dataset for separating bird sounds you need two sounds, first you need the bird sound(s) with zero to as little background noise as possible. Second you need sounds that you want to separate the bird sounds from, the second sound can not contain bird sounds. I would be interested in collaborating on something like this, I can train the models if someone can provide the data, I have no idea how well this would perform but if anyone is interested my discord username is kimberleyjsn or email kimberleyjensenox1@gmail.com |
Beta Was this translation helpful? Give feedback.
-
|
Hi, I have already created exactly such a model. This model will be added soon in one of the next UVR GUI updates. In the meantime, you can use it on my UVR Online website. You can test the premium version for 7 days for free: https://www.patreon.com/uvronline
|
Beta Was this translation helpful? Give feedback.
-
|
Can u provide the model open download link? is it opensource? |
Beta Was this translation helpful? Give feedback.
-
|
https://huggingface.co/jarredou/aufr33_MelBand_Denoise/tree/main |
Beta Was this translation helpful? Give feedback.
-
|
Will this able to solve laughing background noise? @aufr33 |
Beta Was this translation helpful? Give feedback.
-
I've been testing UVR for a few days, and it's really amazing what the MDX-Net process can do.
I'm a sound designer and recordist, and so immediately I got the idea to use this method for non-musical audio as well. Is it possible to train it to remove noise from recordings? I'm thinking sounds like birds, preamp noise, traffic, talking. If the issue would be gathering data for this, I know about 2700 recordists who could be interested in lending their recordings to use.
I'm not sure what the training data requirements are, but I assume that one would need both a mixed recording along with already separated recordings?
A similar tool exists for removing the sound of birds from recordings:
https://www.boomlibrary.com/sound-effects/debird/
iZotope RX is another industry-standard noise removal tool, although I'm not sure whether they use machine learning for their algorithms, but they definitely moving in that direction:
https://www.izotope.com/en/products/rx.html
Beta Was this translation helpful? Give feedback.
All reactions