Skip to main content
fastai_community
Projects
glue-benchmark
Reports
Small LMs
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
Small LMs
Comparison of small language models performance on common downstream tasks
Arto
Created on April 7
|
Last edited on April 7
Comment
SST2
train_loss
train_loss
0
2k
4k
6k
8k
Step
0.1
0.2
0.3
0.4
0.5
0.6
0.7
valid_loss
valid_loss
3k
4k
5k
6k
7k
8k
Step
0.2
0.22
0.24
0.26
0.28
accuracy
accuracy
3k
4k
5k
6k
7k
8k
Step
0.89
0.9
0.91
0.92
0.93
Run set 2
4
MRPC
Run set
3
Add a comment