Add Hugging Face transformers v4.32.0 compatibility

[oleksiishevchuk]

Describe the feature you'd like
Add compatibility with Hugging Face transformers v4.32.0

How would this feature be used? Please describe.
It would unblock usage of transformers v4.32.0 with the Bark text-to-speech model

Describe alternatives you've considered

Additional context
Bark text-to-speech model was added in the transformers v4.31.0/v4.32.0
huggingface/transformers#24086
huggingface/transformers#24952
https://github.com/huggingface/transformers/releases/tag/v4.31.0
https://github.com/huggingface/transformers/releases/tag/v4.32.0