Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

snapshot_download下载数据集出错 #7

Closed
ioo0s opened this issue Jun 25, 2024 · 4 comments
Closed

snapshot_download下载数据集出错 #7

ioo0s opened this issue Jun 25, 2024 · 4 comments
Assignees
Labels
bug Something isn't working enhancement New feature or request

Comments

@ioo0s
Copy link

ioo0s commented Jun 25, 2024

问题描述

使用snapshot_download无法下载数据集


requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http://ip:port/hf/api/models/namespace/dataset_name/revision/main

需求

如下,是否能封装类似modelscope的数据下载+加载的接口

from modelscope.msdatasets import MsDataset
ds = MsDataset.load('afqmc_small', split='train')
@Rader Rader added the enhancement New feature or request label Jun 26, 2024
@Rader
Copy link
Collaborator

Rader commented Jul 3, 2024

http://ip:port/hf/api/models/namespace/dataset_name/revision/main
这个请求数据集的url 路径不对,其中的 models 应该替换为 datasets

@SeanHH86 仓库下载时需要指定仓库类型。目前 OpenCSG 一共有4种类型的仓库:model,dataset,code,space

@Rader Rader added the bug Something isn't working label Jul 3, 2024
@SeanHH86
Copy link
Collaborator

SeanHH86 commented Jul 3, 2024

是的,非常好的建议,已安排在计划中。

@SeanHH86
Copy link
Collaborator

Download dataset is supported now.

@SeanHH86
Copy link
Collaborator

Fixed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants