Skip to main content

B/32 patch dropout experiments

3 runs: a) bs 360k B/32 (pretty similar to bs90k) laion2B b) bs 90k B/32 laion1B (very similar to laion2B) b) bs90k B/32 with patch dropout laion2B
Created on December 4|Last edited on December 7

Eval


20406080100step0.20.30.40.50.60.70.8
20406080100step0.10.20.30.40.50.60.7
Run set
3


Train


Run: 2022_12_03-22_56_40-model_ViT-B-32-patch-dropout-lr_0.001-b_704-j_4-p_amp_bfloat16
7