Skip to main content
eleutherai
Projects
neox
Reports
Sparse attn benchmarks

Sparse attn benchmarks

(on A100s)
s black
Created on April 7|Last edited on April 8




406080100Step130140150160170
sparsity: all
sparsity: interspersed
sparsity: none
Run set
3


Created with ❤️ on Weights & Biases.

https://wandb.ai/eleutherai/neox/reports/Sparse-attn-benchmarks--Vmlldzo1OTA5NTc
Made with Weights & Biases. Sign up or log in to create reports like this one.