Ecosystem & Stack: flash-attention
Deep Learning Architecture Library
PyTorch
3.1k
microsoft/torchscale
A PyTorch library providing advanced foundation architectures to efficiently and effectively scale Transformers for large language models and general-purpose AI.