Skip to content
Change the repository type filter

All

    Repositories list

    • uccl

      Public
      UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
      C++
      1191.2k5120Updated Feb 19, 2026Feb 19, 2026
    • nixl

      Public
      NVIDIA Inference Xfer Library (NIXL)
      C++
      244000Updated Nov 24, 2025Nov 24, 2025
    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      14k001Updated Nov 3, 2025Nov 3, 2025
    • Astro
      0120Updated Oct 31, 2025Oct 31, 2025
    • ray-uccl

      Public
      Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
      Python
      7.2k000Updated Jul 22, 2025Jul 22, 2025
    • nccl

      Public
      Optimized primitives for collective multi-GPU communication
      C++
      1.1k000Updated Jul 4, 2025Jul 4, 2025