Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BUG: launch jina-embeddings-v2-base-en failed #707

Closed
zxhlyh opened this issue Dec 2, 2023 · 1 comment · Fixed by #710
Closed

BUG: launch jina-embeddings-v2-base-en failed #707

zxhlyh opened this issue Dec 2, 2023 · 1 comment · Fixed by #710
Labels
bug Something isn't working
Milestone
v0.7.0

Comments

@zxhlyh
Copy link

zxhlyh commented Dec 2, 2023

Describe the bug

launch jina-embeddings-v2-base-en failed

To Reproduce

  1. Your Python version. 3.11.3
  2. The version of xinference you use. 0.6.5
    screenshot-20231202-190001
    screenshot-20231202-185930

Expected behavior

Run successfully
@XprobeBot XprobeBot added the bug Something isn't working label Dec 2, 2023
@XprobeBot XprobeBot added this to the v0.6.6 milestone Dec 2, 2023
@codingl2k1
Copy link
Contributor

codingl2k1 commented Dec 4, 2023 •
edited
Loading

Related issue: UKPLab/sentence-transformers#2352

The root cause is that the sentence-transformers does compatible with the latest transformers which requires trust_remote_code=True when loading some model.

@codingl2k1 codingl2k1 mentioned this issue Dec 4, 2023
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
v0.7.0
Development

Successfully merging a pull request may close this issue.

BUG: Auto patch trust remote code for embedding model codingl2k1/inference
3 participants
@zxhlyh @XprobeBot @codingl2k1