Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
Open on GitHub