Leo Gao

A framework for few-shot evaluation of language models.

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

Open-source release accompanying Gao et al. 2025