DefTruth

An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.

Robust Video Matting in PyTorch, TensorFlow, TensorFlow.js, ONNX, CoreML!

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

You Only Look Once for Panopitic Driving Perception.（MIR2022）

A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for DiTs.