Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Re-Iterate, Fix vLLM Benchmark and add Readme #142

Merged
merged 9 commits into from
Jan 29, 2024

Conversation

Anindyadeep
Copy link
Member

@Anindyadeep Anindyadeep commented Jan 23, 2024

Checks:

  • Checksetup.sh and bench.sh have Python files configured for both Mac and Linux and installation working.
  • Check if int32 < int16 and int8 < int4 patterns follow
  • Check the log file name and where it is kept
  • Check if all precisions can be covered or not and if not put an issue
  • Check if all devices can be covered or not otherwise put an issue or find an issue (it's just memory issue and too slow, mentioned in Readme)
  • Check the Benchmark README

Sorry, something went wrong.

Anindyadeep added 2 commits January 24, 2024 00:21

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
@Anindyadeep Anindyadeep self-assigned this Jan 23, 2024
@Anindyadeep Anindyadeep marked this pull request as draft January 24, 2024 10:40

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Merge from main.

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Merge from main.

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
…rking params
@Anindyadeep Anindyadeep changed the title Readme for vLLM. Re-Iterate, Fix LightningAI Benchmark and add Readme Jan 27, 2024
@Anindyadeep Anindyadeep changed the title Re-Iterate, Fix LightningAI Benchmark and add Readme Re-Iterate, Fix vLLM Benchmark and add Readme Jan 27, 2024
@Anindyadeep Anindyadeep requested a review from nsosio January 27, 2024 04:58
@Anindyadeep Anindyadeep marked this pull request as ready for review January 27, 2024 04:58
@nsosio nsosio merged commit 57b2d21 into premAI-io:main Jan 29, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants