Collapse file tree

Files

 main

/

csrc

/

Copy path

Directory actions

More options

More options

Directory actions

More options

More options

Latest commit

g-eoj

[Model] H2O Danube3-4b (vllm-project#6451)

Jul 27, 2024

14dbd5a · Jul 27, 2024

History

History

Open commit details

This branch is 4971 commits behind vllm-project/vllm:main.

/

csrc

/

Top

Folders and files

Name		Name	Last commit message	Last commit date
parent directory ..
attention		attention	[Model] H2O Danube3-4b (vllm-project#6451)	Jul 27, 2024
cpu		cpu	[Hardware] [Intel] Enable Multiprocessing and tensor parallel in CPU …	Jul 26, 2024
moe		moe	[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custo…	Jun 9, 2024
prepare_inputs		prepare_inputs	[Core] draft_model_runner: Implement prepare_inputs on GPU for advanc…	Jul 17, 2024
punica		punica	[Kernel] Add punica dimensions for Granite 3b and 8b (vllm-project#5930)	Jun 29, 2024
quantization		quantization	[Bug Fix] Illegal memory access, FP8 Llama 3.1 405b (vllm-project#6852)	Jul 27, 2024
activation_kernels.cu		activation_kernels.cu	[Model] Port over CLIPVisionModel for VLMs (vllm-project#5591)	Jun 20, 2024
cache.h		cache.h	Add fp8 support to reshape_and_cache_flash (vllm-project#6667)	Jul 24, 2024
cache_kernels.cu		cache_kernels.cu	Add fp8 support to reshape_and_cache_flash (vllm-project#6667)	Jul 24, 2024
cuda_compat.h		cuda_compat.h	[Kernel][ROCm][AMD] enable fused topk_softmax kernel for moe layer (v…	Jun 2, 2024
cuda_utils.h		cuda_utils.h	[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custo…	Jun 9, 2024
cuda_utils_kernels.cu		cuda_utils_kernels.cu	[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custo…	Jun 9, 2024
custom_all_reduce.cu		custom_all_reduce.cu	[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custo…	Jun 9, 2024
custom_all_reduce.cuh		custom_all_reduce.cuh	[CI/Build] Enforce style for C++ and CUDA code with clang-format (v…	May 22, 2024
custom_all_reduce_test.cu		custom_all_reduce_test.cu	[CI/Build] Enforce style for C++ and CUDA code with clang-format (v…	May 22, 2024
dispatch_utils.h		dispatch_utils.h	[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custo…	Jun 9, 2024
layernorm_kernels.cu		layernorm_kernels.cu	[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custo…	Jun 9, 2024
moe_align_block_size_kernels.cu		moe_align_block_size_kernels.cu	[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custo…	Jun 9, 2024
ops.h		ops.h	[Kernel][Core] Add AWQ support to the Marlin kernel (vllm-project#6612)	Jul 21, 2024
pos_encoding_kernels.cu		pos_encoding_kernels.cu	[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custo…	Jun 9, 2024
reduction_utils.cuh		reduction_utils.cuh	[Kernel] Dynamic Per-Token Activation Quantization (vllm-project#5037)	Jun 7, 2024
registration.h		registration.h	[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custo…	Jun 9, 2024
torch_bindings.cpp		torch_bindings.cpp	Add fp8 support to reshape_and_cache_flash (vllm-project#6667)	Jul 24, 2024
View all files