Skip to main content
awfidius
Projects
pure-transformer
Reports
Loss depends on batch?

Loss depends on batch?

Batches are randomized, so loss should not depend so strongly on batch ID... debugging.
Andrew Fitzgibbon
Created on May 27|Last edited on May 27

Section 1


05k10k15k20k25k30kStep12345
1-bit-grad
1-bit-grad
Run: 1-bit-grad
1


Created with ❤️ on Weights & Biases.

https://wandb.ai/awfidius/pure-transformer/reports/Loss-depends-on-batch---VmlldzoyMDc3NTk0
Made with Weights & Biases. Sign up or log in to create reports like this one.