File tree
1,772 files changed
+52638
-26507
lines changed- .buildkite
- lm-eval-harness
- nightly-benchmarks
- scripts
- scripts
- hardware_ci
- .github
- ISSUE_TEMPLATE
- scripts
- workflows
- benchmarks
- cutlass_benchmarks
- disagg_benchmarks
- fused_kernels
- kernels
- deepgemm
- overheads
- cmake
- external_projects
- csrc
- attention
- mla
- cpu
- cutlass_extensions
- mamba
- causal_conv1d
- mamba_ssm
- moe
- marlin_moe_wna16
- permute_unpermute_kernels
- quantization
- cutlass_w8a8
- c3x
- fp8
- fused_kernels
- gptq_marlin
- machete
- rocm
- sparse/cutlass
- docker
- docs
- api
- vllm
- assets
- contributing
- deployment
- design
- arch_overview
- v1
- metrics
- prefix_caching
- features/disagg_prefill
- kernel
- logos
- cli
- community
- configuration
- contributing
- dockerfile
- model
- deployment
- frameworks
- integrations
- design
- kernel
- v1
- features
- quantization
- getting_started
- installation
- ai_accelerator
- cpu
- gpu
- mkdocs
- hooks
- javascript
- overrides
- stylesheets
- models
- extensions
- serving
- integrations
- source
- _static
- _templates/sections
- api
- community
- contributing/model
- deployment
- frameworks
- integrations
- design/kernel
- features
- quantization
- getting_started
- installation
- ai_accelerator
- cpu
- models
- extensions
- serving
- integrations
- training
- usage
- examples
- offline_inference
- basic
- disaggregated-prefill-v1
- openai_batch
- profiling_tpu
- qwen2_5_omni
- online_serving
- disaggregated_serving
- opentelemetry
- prometheus_grafana
- others
- lmcache
- disagg_prefill_lmcache_v1
- configs
- requirements
- tests
- async_engine
- basic_correctness
- benchmarks
- compile
- piecewise
- core
- block
- e2e
- detokenizer
- distributed
- encoder_decoder
- engine
- entrypoints
- llm
- offline_mode
- openai
- correctness
- tool_parsers
- fastsafetensors_loader
- kernels
- attention
- core
- mamba
- moe
- quantization
- kv_transfer
- lora
- metrics
- mistral_tool_use
- model_executor
- models
- language
- generation
- pooling
- multimodal
- generation
- vlm_utils
- pooling
- processing
- quantization
- mq_llm_engine
- multi_step
- multimodal
- assets
- neuron
- 1_core
- 2_core
- plugins_tests
- plugins
- lora_resolvers
- vllm_add_dummy_model
- vllm_add_dummy_model
- vllm_add_dummy_platform
- vllm_add_dummy_platform
- prefix_caching
- prompt_adapter
- quantization
- reasoning
- runai_model_streamer_test
- samplers
- spec_decode
- e2e
- standalone_tests
- tensorizer_loader
- tokenization
- tool_use
- tpu
- lora
- tracing
- v1
- core
- e2e
- engine
- entrypoints
- llm
- openai
- kv_connector
- nixl_integration
- unit
- metrics
- sample
- shutdown
- spec_decode
- structured_output
- tpu
- worker
- worker
- vllm_test_utils
- vllm_test_utils
- weight_loading
- worker
- tools
- profiler
- vllm
- adapter_commons
- assets
- attention
- backends
- mla
- ops
- blocksparse_attention
- utils
- benchmarks
- compilation
- core
- block
- device_allocator
- distributed
- device_communicators
- kv_transfer
- kv_connector
- v1
- kv_lookup_buffer
- kv_pipe
- engine
- multiprocessing
- output_processor
- entrypoints
- cli
- benchmark
- openai
- tool_parsers
- executor
- inputs
- logging_utils
- lora
- ops
- torch_ops
- triton_ops
- xla_ops
- punica_wrapper
- model_executor
- guided_decoding
- layers
- fused_moe
- configs
- mamba
- ops
- quantization
- compressed_tensors
- schemes
- kernels
- mixed_precision
- scaled_mm
- quark
- schemes
- utils
- model_loader
- models
- multimodal
- platforms
- plugins
- lora_resolvers
- profiler
- prompt_adapter
- reasoning
- spec_decode
- third_party
- transformers_utils
- chat_templates
- configs
- processors
- tokenizers
- triton_utils
- usage
- v1
- attention/backends
- mla
- core
- sched
- engine
- executor
- metrics
- sample
- ops
- tpu
- spec_decode
- stats
- structured_output
- worker
- worker
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
1,772 files changed
+52638
-26507
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
| 2 | + | |
2 | 3 | | |
3 | 4 | | |
4 | 5 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
| 2 | + | |
2 | 3 | | |
3 | 4 | | |
4 | 5 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
| 2 | + | |
2 | 3 | | |
3 | 4 | | |
4 | 5 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
| 2 | + | |
2 | 3 | | |
3 | 4 | | |
4 | 5 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
113 | 113 | | |
114 | 114 | | |
115 | 115 | | |
116 | | - | |
| 116 | + | |
117 | 117 | | |
118 | 118 | | |
119 | 119 | | |
| |||
Lines changed: 1 addition & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
| 2 | + | |
2 | 3 | | |
3 | 4 | | |
4 | 5 | | |
| |||
Lines changed: 1 addition & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
| 2 | + | |
2 | 3 | | |
3 | 4 | | |
4 | 5 | | |
| |||
Lines changed: 1 addition & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
| 2 | + | |
2 | 3 | | |
3 | 4 | | |
4 | 5 | | |
| |||
Lines changed: 1 addition & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
| 2 | + | |
2 | 3 | | |
3 | 4 | | |
4 | 5 | | |
| |||
Lines changed: 1 addition & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
| 2 | + | |
2 | 3 | | |
3 | 4 | | |
4 | 5 | | |
| |||
0 commit comments