Skip to content

Pinned Loading

  1. vllm vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 97.3k 25.1k

  2. vllm-omni vllm-omni Public

    A framework for efficient model inference with omni-modality models

    Python 7.9k 2.2k

  3. recipes recipes Public

    Common recipes to run vLLM

    JavaScript 1.1k 502

  4. llm-compressor llm-compressor Public

    State-of-the-art LLM compression, built for production inference with vLLM

    Python 4k 741

  5. speculators speculators Public

    A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

    Python 969 298

  6. semantic-router semantic-router Public

    An open, programmable decision layer for models and compute.

    Go 6.5k 1.1k

Repositories

Showing 10 of 55 repositories
  • vllm-ascend Public

    Community maintained hardware plugin for vLLM on Huawei Ascend

    vllm-project/vllm-ascend's past year of commit activity
    Python 3,124 Apache-2.0 2,788 1,976 (76 issues need help) 3,453 Updated Nov 20, 2026
  • vllm-sail Public

    Community maintained hardware plugin for vLLM on T-Head SAIL

    vllm-project/vllm-sail's past year of commit activity
    Python 30 Apache-2.0 24 49 43 Updated Nov 20, 2026
  • humming Public

    Humming is a high-performance, lightweight, and highly flexible JIT (Just-In-Time) compiled GEMM kernel library specifically designed for quantized inference.

    vllm-project/humming's past year of commit activity
    Python 374 Apache-2.0 88 8 16 Updated Nov 20, 2026
  • recipes Public

    Common recipes to run vLLM

    vllm-project/recipes's past year of commit activity
    JavaScript 1,095 Apache-2.0 502 69 176 Updated Nov 20, 2026
  • vllm-omni Public

    A framework for efficient model inference with omni-modality models

    vllm-project/vllm-omni's past year of commit activity
    Python 7,864 Apache-2.0 2,163 817 (146 issues need help) 1,156 Updated Nov 20, 2026
  • vllm-project/vllm-dashboard's past year of commit activity
    TypeScript 21 26 1 23 Updated Nov 20, 2026
  • vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    vllm-project/vllm's past year of commit activity
    Python 97,254 Apache-2.0 25,072 2,957 (22 issues need help) 5,000+ Updated Nov 20, 2026
  • vllm-torchtpu Public
    vllm-project/vllm-torchtpu's past year of commit activity
    Python 145 Apache-2.0 75 134 (1 issue needs help) 1,016 Updated Nov 20, 2026
  • router Public

    A high-performance and light-weight router for vLLM large scale deployment

    vllm-project/router's past year of commit activity
    Rust 527 Apache-2.0 266 110 (35 issues need help) 128 Updated Nov 20, 2026
  • semantic-router Public

    An open, programmable decision layer for models and compute.

    vllm-project/semantic-router's past year of commit activity
    Go 6,512 Apache-2.0 1,138 416 273 Updated Nov 20, 2026