Skip to content

@hao-ai-lab Hao AI Lab

Change the repository type filter

All

    Repositories list

    9 repositories

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •4.7k•0•0•1•Updated Nov 22, 2024Nov 22, 2024

    • Consistency_LLM

      Public
      [ICML 2024] CLLMs: Consistency Large Language Models
      large-language-modelsefficient-llmefficient-llm-inference
      Python
      •
      Apache License 2.0
      •18•355•7•0•Updated Nov 16, 2024Nov 16, 2024

    • vllm-ltr

      Public
      [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
      Python
      •
      Apache License 2.0
      •3•14•0•0•Updated Nov 4, 2024Nov 4, 2024

    • LookaheadDecoding

      Public
      [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
      Python
      •
      Apache License 2.0
      •67•1.2k•33•0•Updated Oct 14, 2024Oct 14, 2024

    • hao-ai-lab.github.io

      Public
      HTML
      •7•0•1•0•Updated Oct 13, 2024Oct 13, 2024

    • MuxServe

      Public
      Jupyter Notebook
      •3•46•2•0•Updated Jun 13, 2024Jun 13, 2024

    • dsc291-PA

      Public
      Jupyter Notebook
      •2•2•0•0•Updated Jun 6, 2024Jun 6, 2024

    • dsc291-s24

      Public
      Website for DSC 291, Spring 2024
      SCSS
      •
      Other
      •26•0•0•0•Updated Jun 5, 2024Jun 5, 2024

    • dsc204a-w24

      Public
      Website for DSC 204a, Winter 2024
      SCSS
      •
      Other
      •26•8•0•1•Updated Mar 24, 2024Mar 24, 2024