Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Belle-whisper-large-v3-zh 运行失败,Error no file named model.safetensors found in directory #2094

Closed
1 of 3 tasks
reinforceli opened this issue Aug 15, 2024 · 5 comments
Labels
Milestone

Comments

@reinforceli
Copy link

System Info / 系統信息

服务端:python310, torch2.3.1+cu121, windows10
客户端使用python38调用 xinference-client

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?

  • docker / docker
  • pip install / 通过 pip install 安装
  • installation from source / 从源码安装

Version info / 版本信息

xinference-client-0.14.1.post1
xinference 0.14.1.post1

The command used to start Xinference / 用以启动 xinference 的命令

单节点启动
xinference-local

Reproduction / 复现过程

image

Expected behavior / 期待表现

能正常运行

@XprobeBot XprobeBot added this to the v0.14 milestone Aug 15, 2024
@reinforceli
Copy link
Author

换成 transformers-4.40.0 可以运行,transformers-4.43 版本就报错

Copy link

This issue is stale because it has been open for 7 days with no activity.

@github-actions github-actions bot added the stale label Aug 23, 2024
Copy link

This issue was closed because it has been inactive for 5 days since being marked as stale.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Aug 28, 2024
@Halflifefa
Copy link

换成 transformers-4.40.0 可以运行,transformers-4.43 版本就报错

原因是xinference/model/audio/whisper.py中设置了使用safetensors,但模型权重是bin,不是safetensors,需要改一下该文件的60行代码,这应该是一个bug

# 原始代码
use_safetensors=True,
# 改为False
use_safetensors=False,

@skytodmoon
Copy link

mark.met the same problem;
1.Change the code
2.Change the pytorch.bin

Charmnut pushed a commit to Charmnut/inference that referenced this issue Sep 12, 2024
…ssing (xorbitsai#2094)

Signed-off-by: Charmnut <charmnut@foxmail.com>
Charmnut pushed a commit to Charmnut/inference that referenced this issue Sep 12, 2024
…ssing (xorbitsai#2094)

Signed-off-by: Charmnut <charmnut@foxmail.com>
qinxuye pushed a commit that referenced this issue Sep 12, 2024
…ssing (#2094) (#2290)

Signed-off-by: Charmnut <charmnut@foxmail.com>
Co-authored-by: Charmnut <charmnut@foxmail.com>
@qinxuye qinxuye reopened this Sep 12, 2024
@qinxuye qinxuye closed this as completed Sep 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

5 participants