Skip to main content
marin-community
Projects
marin
Reports
Marin 32B WIP

Marin 32B WIP

David Leo Wright Hall
Created on June 27|Last edited on June 27




100M10G1Tthroughput/total_tokens234
Marin 32B+qk-norm+warmstart
Marin 32B run1
Run set
2



Run set
9


Created with ❤️ on Weights & Biases.

https://wandb.ai/marin-community/marin/reports/Marin-32B-WIP--VmlldzoxMzM3OTExOA
Made with Weights & Biases. Sign up or log in to create reports like this one.