Modalities not detected for some datasets using the Webdatasets format

[ProGamerGov]

I have found 2 examples of the modality detection code failing to recognize modalities in text and image datasets using the Webdataset format:

• https://huggingface.co/datasets/ProGamerGov/synthetic-dataset-1m-dalle3-high-quality-captions

• https://huggingface.co/datasets/CaptionEmporium/midjourney-niji-1m-llavanext

I'm not sure where in the modality detection code that things are failing: https://github.com/huggingface/dataset-viewer/blob/main/services/worker/src/worker/job_runners/dataset/modalities.py

[severo]

Thanks for opening. Note that you can force the modality: https://huggingface.co/docs/hub/datasets-cards#force-set-a-dataset-modality

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.