Officially maintained, supported by PaddlePaddle, including CV, NLP, Speech, Rec, TS, big models and so on.
Tile-Based Runtime for Ultra-Low-Latency LLM Inference
Open on GitHub