kedro-datasets: Nightly build failure

[github-actions]

GitHub Actions workflow Run nightly tests on all plugins #299 failed.

[github-actions]

GitHub Actions workflow Run nightly tests on all plugins #300 failed.

[github-actions]

GitHub Actions workflow Run nightly tests on all plugins #302 failed.

[github-actions]

GitHub Actions workflow Run nightly tests on all plugins #303 failed.

[github-actions]

GitHub Actions workflow Run nightly tests on all plugins #304 failed.

[github-actions]

GitHub Actions workflow Run nightly tests on all plugins #305 failed.

[github-actions]

GitHub Actions workflow Run nightly tests on all plugins #307 failed.

[github-actions]

GitHub Actions workflow Run nightly tests on all plugins #309 failed.

[noklam]

E RuntimeError: Failed to import transformers.pipelines because of the following error (look up to see its traceback):
E cannot import name 'split_torch_state_dict_into_shards' from 'huggingface_hub' (/workspace/kedro-plugins/.venv/lib/python3.10/site-packages/huggingface_hub/init.py)

I can reproduce this when I run pip install .[test]. This does not happen when I run pip install .[huggaceface]. It could be some secondary dependencies issue.

[noklam]

pip install .[huggingface] -> huggingface-hub 0.24.3

pip install .[test] - > huggingface-hub 0.17.3

[noklam]

a new failing doctest now

/home/runner/work/kedro-plugins/kedro-plugins/kedro-datasets/kedro_datasets/huggingface/hugging_face_dataset.py:31: DocTestFailure
=========================== short test summary info ============================
FAILED kedro_datasets/huggingface/hugging_face_dataset.py::kedro_datasets.huggingface.hugging_face_dataset.HFDataset

[github-actions]

GitHub Actions workflow Run nightly tests on all plugins #310 failed.

[github-actions]

GitHub Actions workflow Run nightly tests on all plugins #311 failed.