llm-d

Type: All

Visibility: All

Sort by: Most downloads

30 packages

llm-d-cuda-gb200-dev
Published Apr 30, 2026 by llm-d in llm-d/llm-d

1.51k
charts/async-processor
Published Jul 16, 2026 by llm-d in llm-d/llm-d-async

1.47k
llm-d-rocm-dev
Published Feb 10, 2026 by llm-d in llm-d/llm-d

1.44k
llm-d
Published May 15, 2025 by llm-d in llm-d/llm-d-deployer

1.39k
batch-gateway-apiserver
Published Jun 10, 2026 by llm-d in llm-d/llm-d-batch-gateway

1.39k
batch-gateway-processor
Published Jun 10, 2026 by llm-d in llm-d/llm-d-batch-gateway

1.34k
batch-gateway-gc
Published Jun 10, 2026 by llm-d in llm-d/llm-d-batch-gateway

1.19k
llm-d-gke
Published Oct 9, 2025 by llm-d in llm-d/llm-d

1.07k
llm-d-kv-cache-manager
Published May 13, 2025 by llm-d in llm-d/llm-d-kv-cache

1.04k
llm-d-router-disagg-sidecar-dev
Published May 16, 2026 by llm-d in llm-d/llm-d-router

872
zmq-listener
Published Jan 18, 2026 by llm-d

809
charts/payload-processor
Published Jun 17, 2026 by llm-d in llm-d/llm-d-inference-payload-processor

797
llm-d-inference-payload-processor
Published Jun 17, 2026 by llm-d in llm-d/llm-d-inference-payload-processor

675
llm-d-cuda-debug
Published Feb 12, 2026 by llm-d in llm-d/llm-d

609
llm-d-latency-predictor-prediction-server-dev
Published Jun 12, 2026 by llm-d in llm-d/llm-d-latency-predictor

565
llm-d-latency-predictor-training-server-dev
Published Jun 12, 2026 by llm-d in llm-d/llm-d-latency-predictor

548
charts/batch-gateway
Published Jul 17, 2026 by llm-d in llm-d/llm-d-batch-gateway

452
charts/llm-d-async
Published Jul 23, 2026 by llm-d in llm-d/llm-d-async

313
llm-d-cuda-gb200
Published May 1, 2026 by llm-d in llm-d/llm-d

300
llm-d-hpu
Published Mar 5, 2026 by llm-d in llm-d/llm-d

295
llm-d-xpu-sglang
Published Jul 30, 2026 by llm-d in llm-d/llm-d

244
llm-d-rdma-tools
Published Jan 22, 2026 by llm-d in llm-d/llm-d

233
mooncake-master-store
Published Jun 23, 2026 by llm-d

156
llm-d-latency-predictor-test-dev
Published Jun 12, 2026 by llm-d in llm-d/llm-d-latency-predictor

154
llm-d-coordinator
Published May 27, 2026 by llm-d

92
llm-d-latency-predictor-test
Published Jun 16, 2026 by llm-d in llm-d/llm-d-latency-predictor

76
llm-d-pd-utils
Published May 13, 2025 by llm-d in llm-d/llm-d-pd-utils

35
llm-d-prism
Published Sep 10, 2026 by llm-d in llm-d/llm-d-prism

26
vllm-openai
Published Aug 12, 2026 by llm-d

17
llm-d-router-coordinator
Published Aug 6, 2026 by llm-d in llm-d/llm-d-router

7