Skip to main content
eleutherai
Projects
distilling
Reports
Top-k Distillation

Top-k Distillation

Preetham Gali
Created on September 17|Last edited on October 2

Section 1


10k20k30k40k50k60kStep51015
group: LUiyBR824jRMrqDGCfGWVe_g6hibgxu Run set
group: 2qb64HRVvbTxkAUpFAHti3_2965okl5 Run set
group: Med Run set
10k20k30k40k50k60kStep246810
group: LUiyBR824jRMrqDGCfGWVe_g6hibgxu Run set
group: 2qb64HRVvbTxkAUpFAHti3_2965okl5 Run set
group: Med Run set
Run set
3
Run set 2
0


Created with ❤️ on Weights & Biases.

https://wandb.ai/eleutherai/distilling/reports/Top-k-Distillation--VmlldzoxMDMwNjc4
Made with Weights & Biases. Sign up or log in to create reports like this one.