Dev pr2 : handle multi-speaker and GST in synthetizer class

[kirianguiller]

Hi guys,

Here the second split of the PR I did earlier this week.

This new content is for handling multi speaker and GST inference in the Synthesizer class (that is used in server.py or in the google colab for Chinese that I mentioned in the first point). Now, you can pass the following two optional parameters to the Synthesizer.tts() method :
speaker_json_key and style_wav . speaker_json_key is the name of the key of one of the speaker in the provided speakers.json . style_wav is either a path to a wav file for GST style transfer, or is a dict containing the {"token1":0.25, "token2" -0.1, etc...}. *The next step is to also give the user the possibility to directly provide the optional parameter speaker_embedding that is a speaker embedding (as a numpy array or a list?) that will be passed to Tacotron at inference time.

The synthesizer class is now simplier to use, and we can see in this google colab that this reduces the number of lines required for having working generation samples.

Thanks :)

[erogol]

Sorry for being slow. I'll check the PR definitely the latest tomorrow.

[kirianguiller]

No problem ! Just let me know if you have any requests for modification :)

[erogol]

I think the only immediate requirement is writing some testing code for the synthesizer. I'll write one for the current synthesizer in the dev branch then you can rebase and add more for multi-speaker and GST changes you made.

[erogol]

ok we already have test_synthesizer.py :)

Can you implement test cases for your changes - GST and multi-speaker?

[kirianguiller]

Yes ! I will implement this and push the changes at the beginning of next week :)

[erogol]

@kirianguiller any updates?

[kirianguiller]

@kirianguiller any updates?

Yes sorry, quite busy weeks I had here. Thanks for reminding me though. I will implement the test for the code I added and work on the new conflicts.

[erogol]

@kirianguiller I am also on this PR. Maybe better if you wait me to push my updates. I also rebased the latest dev.

I'll ping you.

[kirianguiller]

Oh cool ! Thank you. I am waiting for your changes then :)

[erogol]

I close this for the sake of #441