← Developers
Open on GitHub 


#4061 5
Mark Kurtz
@markurtz · USA
6.24k
Weighted score
794
Contributions
5
Repos
Top repos
- vllm-project/llm-compressor
- neuralmagic/sparseml
- vllm-project/guidellm
- neuralmagic/deepsparse
- vllm-project/speculators
Ranked AI repos3
4055982
vllm-project/llm-compressor
+1
State-of-the-art LLM compression, built for production inference with vLLM
3.86k· Python· Infrastructure
823448
neuralmagic/sparseml
+0
Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
2.14k· Python· Infrastructure
3128981
vllm-project/guidellm
+2
Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
1.68k· Python· AI Engineering