← Developers
Open on GitHub 
#775 1
Cyrus Leung
@DarkLight1337 · Hong Kong
23.4k
Weighted score
2.73k
Contributions
5
Repos
Top repos
- vllm-project/vllm
- weicj/vLLM-2080Ti-Definitive
- 1CatAI/1Cat-vLLM
- EleutherAI/lm-evaluation-harness
- vllm-project/speculators
Ranked AI repos3
27933
vllm-project/vllm
+51
A high-throughput and memory-efficient inference and serving engine for LLMs
93.6k· Python· Infrastructure
1530652
1CatAI/1Cat-vLLM
+6
V100 / SM70-focused vLLM engineering fork for modern LLM inference.
1.27k· Python· Infrastructure
1756444
weicj/vLLM-2080Ti-Definitive
+5
The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-request decode with support of FP8 weight ( Join Discord :https://discord.gg/VFqVVySdMS )
1.12k· Python· Infrastructure