AI Rank
← 开发者
#775 1

Cyrus Leung

@DarkLight1337 · Hong Kong
在 GitHub 打开
23.4k
加权贡献
2.73k
贡献次数
5
项目数
主要项目
上榜的 AI 项目3
27933
vllm-project/vllm
+51

A high-throughput and memory-efficient inference and serving engine for LLMs

93.6k· Python
1530652
1CatAI/1Cat-vLLM
+6

V100 / SM70-focused vLLM engineering fork for modern LLM inference.

1.27k· Python
1756444
weicj/vLLM-2080Ti-Definitive
+5

The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-request decode with support of FP8 weight ( Join Discord :https://discord.gg/VFqVVySdMS )

1.12k· Python