Skip to main content

LayoutT5 fine-tuning graphics

Experiments on fine-tuning with different settings, hyperparameters and OCRs.
Created on February 16|Last edited on May 11


Fine-tuning graphics

All fine-tuning experiment have been performed by using the same hyperparameters. The difference between each run relies on the pre-training performed before.
  • Red: No pretrain
  • Green: Pretrain 31k (32x512), lr 1e-5
  • Blue: Pretrain 31k (16x1024), lr 1e-5
  • Brown: Pretrain 31k (16x1024), lr 2e-4
  • Light blue: Pretrain 31k (16x1024), lr 2e-4. This is the only run where I change the fine-tunning configuration, which is the same as in pretrain (16x1024, lr 2e-4).

Val


No pretrain
1
Change BS x OCR during PT
2
Change of lr during PT
2
Change lr during PT and FT
2
LayoutT5 Small best config
1



Train


No pretrain
1
Change BS x OCR during PT
2
Change of lr during PT
2
Change lr during PT and FT
2
LayoutT5 Small Best config
1


Test


Run set
5
LayoutT5 Small
1


Hyperparameters


Run set
5
LayoutT5 Small
1


Pre-training effect

Val


w, w/o pretrain
2


Hyperparameters


w, w/o pretrain
2


Change of OCR

Val


OCR Change
2


Hyperparameters


Change of OCR
2