Skip to main content
ruben_tito
Projects
DocCVQA
Reports
LayoutT5 pretraining graphics

LayoutT5 pretraining graphics

Rubèn Pérez Tito
Created on February 16|Last edited on May 11
  • Brown: Pretrain 31k (32x512), lr: 1e-5
  • Green: Pretrain 31k (16x1024), lr: 1e-5
  • Orange: Pretrain 31k (16x1024), lr: 2e-4

  • Purple: LayoutT5 Small - Pretrain 31k (16x1024), lr:2e-4

Val


5k10k15k20k25k30kStep22.533.5
5k10k15k20k25k30kStep22.22.42.62.8
LayoutT5 Base
3
LayoutT5 Small
1


Train


LayoutT5 Base
3
LayoutT5 Small
1


Hyperparameters


LayoutT5 Base
3
LayoutT5 Small
1


Created with ❤️ on Weights & Biases.

https://wandb.ai/ruben_tito/DocCVQA/reports/LayoutT5-pretraining-graphics--VmlldzoxNTY5MDky
Made with Weights & Biases. Sign up or log in to create reports like this one.