Skip to content
@hao-ai-lab

Hao AI Lab

Popular repositories Loading

  1. LookaheadDecoding LookaheadDecoding Public

    [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

    Python 1.2k 67

  2. Consistency_LLM Consistency_LLM Public

    [ICML 2024] CLLMs: Consistency Large Language Models

    Python 355 18

  3. MuxServe MuxServe Public

    Jupyter Notebook 46 3

  4. vllm-ltr vllm-ltr Public

    [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank

    Python 14 3

  5. dsc204a-w24 dsc204a-w24 Public

    Website for DSC 204a, Winter 2024

    SCSS 8 26

  6. dsc291-PA dsc291-PA Public

    Jupyter Notebook 2 2

Repositories

Showing 9 of 9 repositories
  • vllm Public Forked from vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    hao-ai-lab/vllm’s past year of commit activity
    Python 0 Apache-2.0 4,737 0 1 Updated Nov 22, 2024
  • Consistency_LLM Public

    [ICML 2024] CLLMs: Consistency Large Language Models

    hao-ai-lab/Consistency_LLM’s past year of commit activity
    Python 355 Apache-2.0 18 7 0 Updated Nov 16, 2024
  • vllm-ltr Public

    [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank

    hao-ai-lab/vllm-ltr’s past year of commit activity
    Python 14 Apache-2.0 3 0 0 Updated Nov 4, 2024
  • LookaheadDecoding Public

    [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

    hao-ai-lab/LookaheadDecoding’s past year of commit activity
    Python 1,150 Apache-2.0 67 33 0 Updated Oct 14, 2024
  • hao-ai-lab.github.io Public
    hao-ai-lab/hao-ai-lab.github.io’s past year of commit activity
    HTML 0 7 1 0 Updated Oct 13, 2024
  • MuxServe Public
    hao-ai-lab/MuxServe’s past year of commit activity
    Jupyter Notebook 46 3 2 0 Updated Jun 13, 2024
  • dsc291-PA Public
    hao-ai-lab/dsc291-PA’s past year of commit activity
    Jupyter Notebook 2 2 0 0 Updated Jun 6, 2024
  • dsc291-s24 Public Forked from hao-ai-lab/dsc204a-w24

    Website for DSC 291, Spring 2024

    hao-ai-lab/dsc291-s24’s past year of commit activity
    SCSS 0 26 0 0 Updated Jun 5, 2024
  • dsc204a-w24 Public

    Website for DSC 204a, Winter 2024

    hao-ai-lab/dsc204a-w24’s past year of commit activity
    SCSS 8 26 0 1 Updated Mar 24, 2024

Top languages

Loading…

Most used topics

Loading…