Implement LLaMA #9
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Collaborator
Author
|
@zhuohan123 Please feel free to approve and merge this PR once you think it's ready. |
zhuohan123
approved these changes
Mar 29, 2023
v1nc3nt27
pushed a commit
to v1nc3nt27/vllm
that referenced
this pull request
Sep 12, 2023
dont error if user doesnt have kernels installed
bigPYJ1151
pushed a commit
to bigPYJ1151/vllm
that referenced
this pull request
Dec 29, 2023
zeroorhero
pushed a commit
to zeroorhero/vllm
that referenced
this pull request
Sep 23, 2024
Kuntai disagg refactor
1 task
1 task
This was referenced Oct 12, 2024
1 task
1 task
1 task
1 task
1 task
juncgu
pushed a commit
to juncgu/vllm
that referenced
this pull request
May 8, 2025
Suggestion: Generalize/streamline async loading (remote prefill) side
1 task
1 task
1 task
1 task
1 task
zyongye
pushed a commit
to zyongye/vllm
that referenced
this pull request
Aug 5, 2025
zyongye
pushed a commit
to zyongye/vllm
that referenced
this pull request
Aug 6, 2025
zyongye
pushed a commit
to zyongye/vllm
that referenced
this pull request
Aug 7, 2025
1 task
1 task
heheda12345
added a commit
to heheda12345/vllm
that referenced
this pull request
Sep 29, 2025
* code from ds Signed-off-by: youkaichao <youkaichao@gmail.com> * doc from ds Signed-off-by: youkaichao <youkaichao@gmail.com> * Fixes for support_materials/2-tilelang/ Signed-off-by: mgoin <mgoin64@gmail.com> * Fix example 1 Signed-off-by: mgoin <mgoin64@gmail.com> * Fix Einsum in deepgemm * Fix `libc10.so` unimported error * fix reference code Signed-off-by: youkaichao <youkaichao@gmail.com> * adding missing indexer args * passing index args into the module * init Signed-off-by: Chen Zhang <zhangch99@outlook.com> * build indexer k cache medadata * prefill indexer, but weight_proj will output -inf * unqiantized paged indexer, still have -inf issue * remove support material * adding topk_indices mask * add weight scale * unittest infrastructure and fix weight_proj, numeric error due to quantization * varlen prefill passed * paged prefill * add indices mask --------- Signed-off-by: youkaichao <youkaichao@gmail.com> Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: Chen Zhang <zhangch99@outlook.com> Co-authored-by: youkaichao <youkaichao@gmail.com> Co-authored-by: mgoin <mgoin64@gmail.com> Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com> Co-authored-by: Chen Zhang <zhangch99@outlook.com>
isaick
pushed a commit
to isaick/vllm
that referenced
this pull request
Oct 19, 2025
uvloop fix for throughput.py
1 task
yma11
pushed a commit
to yma11/vllm
that referenced
this pull request
Nov 10, 2025
* add wf8af8 pass Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com> * remove redundant func Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com> * add env into vllm.envs Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com> --------- Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
4 tasks
dik654
pushed a commit
to dik654/vllm-for-study
that referenced
this pull request
Nov 18, 2025
…ections Manufacturing enhancements: - Add complete Vision Inspection MCP with Vision AI defect detection - Add Manufacturing MES MCP with PostgreSQL integration - Include detailed defect classification and statistics - Add ROI analysis showing 78% cost reduction and 99.6% time savings Healthcare enhancements: - Enhance existing Medical OCR, Drug Interaction, and EHR MCPs - Add ROI analysis showing 97.2% time reduction - Include medical accident prevention benefits (5억원 annual savings) - Demonstrate HIPAA-compliant prescription OCR workflow Summary: - Sections vllm-project#5-8: Fully detailed implementations (2,000+ lines each) - Sections vllm-project#9-10: Enhanced with complete code + ROI - Sections vllm-project#11-20+: Comprehensive summaries covering all major industries - Total guide provides 20+ real-world MCP + Agent architecture patterns
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
TODO: