Skip to main content
eleutherai
Projects
distilling
Reports
Top-k Distillation
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
Top-k Distillation
Preetham Gali
Created on September 17
|
Last edited on October 2
Comment
Section 1
train/kld_loss
train/kld_loss
10k
20k
30k
40k
50k
60k
Step
5
10
15
group: LUiyBR824jRMrqDGCfGWVe_g6hibgxu
Run set
group: 2qb64HRVvbTxkAUpFAHti3_2965okl5
Run set
group: Med
Run set
train/lm_loss
train/lm_loss
10k
20k
30k
40k
50k
60k
Step
2
4
6
8
10
group: LUiyBR824jRMrqDGCfGWVe_g6hibgxu
Run set
group: 2qb64HRVvbTxkAUpFAHti3_2965okl5
Run set
group: Med
Run set
Run set
3
Run set 2
0
Add a comment