Ali Hassani

[CVPR 2023] OneFormer: One Transformer to Rule Universal Image Segmentation

Neighborhood Attention Transformer, arxiv 2022 / CVPR 2023. Dilated Neighborhood Attention Transformer, arxiv 2022

Fast Multi-dimensional Sparse Attention

Escaping the Big Data Paradigm with Compact Transformers, 2021 (Train your Vision Transformers in 30 mins on CIFAR-10 with a single GPU!)