modelscope qwen 7b/14b #123
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
wenmengzhou
reviewed
Nov 28, 2023
| "use_raw_prompt": true, | ||
| "top_p": 0.8, | ||
| "top_k": 10, | ||
| "seed": 123, |
| except RuntimeError as e: | ||
| yield {'llm_text': str(e)} | ||
| except Exception: | ||
| except RuntimeError: | ||
| s = self.llm.generate(llm_artifacts) |
There was a problem hiding this comment.
这里换了一下是遇到了啥情况么？还是有什么考虑
There was a problem hiding this comment.
当llm没有streaming gen时，会raise RuntimeError。所以原逻辑不会调用generate。
zzhangpurdue
approved these changes
Nov 28, 2023
Zhikaiiii
added a commit
that referenced
this pull request
Jul 12, 2024
<!-- Thank you for your contribution! --> <!-- Unless your change is trivial, please create an issue to discuss the change before creating a PR --> ## Change Summary <!-- Please give a short summary of the changes. --> ## Related issue number <!-- WARNING: please use "fix #123" style references so the issue is closed when this PR is merged. --> ## Checklist * [ ] The pull request title is a good summary of the changes - it will be used in the changelog * [ ] Unit tests for the changes exist * [ ] Run `pre-commit install` and `pre-commit run --all-files` before git commit, and passed lint check. * [ ] Some cases need DASHSCOPE_TOKEN_API to pass the Unit Tests, I have at least **pass the Unit tests on local** * [ ] Documentation reflects the changes where applicable * [ ] My PR is ready to review, **please add a comment including the phrase "please review" to assign reviewers**
Zhikaiiii
added a commit
that referenced
this pull request
Jul 26, 2024
<!-- Thank you for your contribution! --> <!-- Unless your change is trivial, please create an issue to discuss the change before creating a PR --> ## Change Summary skip api test for all forked pr <!-- Please give a short summary of the changes. --> ## Related issue number <!-- WARNING: please use "fix #123" style references so the issue is closed when this PR is merged. --> ## Checklist * [ ] The pull request title is a good summary of the changes - it will be used in the changelog * [ ] Unit tests for the changes exist * [ ] Run `pre-commit install` and `pre-commit run --all-files` before git commit, and passed lint check. * [ ] Some cases need DASHSCOPE_TOKEN_API to pass the Unit Tests, I have at least **pass the Unit tests on local** * [ ] Documentation reflects the changes where applicable * [ ] My PR is ready to review, **please add a comment including the phrase "please review" to assign reviewers**
Zhikaiiii
added a commit
that referenced
this pull request
Jul 30, 2024
<!-- Thank you for your contribution! --> <!-- Unless your change is trivial, please create an issue to discuss the change before creating a PR --> ## Change Summary fix bugs add instruction for usage <!-- Please give a short summary of the changes. --> ## Related issue number <!-- WARNING: please use "fix #123" style references so the issue is closed when this PR is merged. --> ## Checklist * [ ] The pull request title is a good summary of the changes - it will be used in the changelog * [ ] Unit tests for the changes exist * [ ] Run `pre-commit install` and `pre-commit run --all-files` before git commit, and passed lint check. * [ ] Some cases need DASHSCOPE_TOKEN_API to pass the Unit Tests, I have at least **pass the Unit tests on local** * [ ] Documentation reflects the changes where applicable * [ ] My PR is ready to review, **please add a comment including the phrase "please review" to assign reviewers**
Zhikaiiii
added a commit
that referenced
this pull request
Jul 30, 2024
<!-- Thank you for your contribution! --> <!-- Unless your change is trivial, please create an issue to discuss the change before creating a PR --> ## Change Summary add build error msg ## Related issue number <!-- WARNING: please use "fix #123" style references so the issue is closed when this PR is merged. --> ## Checklist * [ ] The pull request title is a good summary of the changes - it will be used in the changelog * [ ] Unit tests for the changes exist * [x] Run `pre-commit install` and `pre-commit run --all-files` before git commit, and passed lint check. * [ ] Some cases need DASHSCOPE_TOKEN_API to pass the Unit Tests, I have at least **pass the Unit tests on local** * [ ] Documentation reflects the changes where applicable * [ ] My PR is ready to review, **please add a comment including the phrase "please review" to assign reviewers**
yingdachen
added a commit
that referenced
this pull request
Aug 13, 2024
<!-- Thank you for your contribution! --> <!-- Unless your change is trivial, please create an issue to discuss the change before creating a PR --> ## Change Summary <!-- Please give a short summary of the changes. --> Support Azure openai, reference [here](https://learn.microsoft.com/zh-cn/azure/ai-services/openai/chatgpt-quickstart?tabs=command-line%2Cpython-new&pivots=programming-language-python) ## Related issue number #243 <!-- WARNING: please use "fix #123" style references so the issue is closed when this PR is merged. --> ## Checklist * [x] The pull request title is a good summary of the changes - it will be used in the changelog * [ ] Unit tests for the changes exist * [x] Run `pre-commit install` and `pre-commit run --all-files` before git commit, and passed lint check. * [x] Some cases need DASHSCOPE_TOKEN_API to pass the Unit Tests, I have at least **pass the Unit tests on local** * [x] Documentation reflects the changes where applicable * [x] My PR is ready to review, **please add a comment including the phrase "please review" to assign reviewers** Please review @zzhangpurdue
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.