Why is datasets constrained to 2.4.0 ?

[Alex-S-H-P]

Hi, my project requires pathos and text attack. Unfortunately, both are incompatible as of right now, since they require different versions of dill.

Underversioning would not work in my case, since I use pretty recent functionalities and have other conflicting dependencies when I try.

I have found, in the dependency chain, that your package requires datasets, from hugging face, to be of version 2.4.0. Newer versions of the package would solve this issue for me, since the last version of datasets can be manually installed in my project.

Is there a functionality that breaks when updating this dependency?

[jxmorris12]

No, we're just behind. Feel free to open a PR to upgrade datasets (and transformers?) versions :)