Skip to main content
ltorroba
Projects
exploring-inverse-kd
Reports
Replicates

Replicates

Lucas F Torroba Hennigen
Created on January 27|Last edited on January 27

05001k1.5k2k2.5k3kStep50010001500200025003000
run_mode: grow-zero Small teacher (20 : 10 : 10)
run_mode: grow-random Small teacher (20 : 10 : 10)
run_mode: baseline-large Small teacher (20 : 10 : 10)
run_mode: baseline-small Small teacher (20 : 10 : 10)
run_mode: grow-zero Large teacher (100 : 50 : 10)
run_mode: grow-random Large teacher (100 : 50 : 10)
run_mode: baseline-large Large teacher (100 : 50 : 10)
run_mode: baseline-small Large teacher (100 : 50 : 10)
5001k1.5k2k2.5k3kStep5001000150020002500
run_mode: grow-zero Small teacher (20 : 10 : 10)
run_mode: grow-random Small teacher (20 : 10 : 10)
run_mode: baseline-large Small teacher (20 : 10 : 10)
run_mode: baseline-small Small teacher (20 : 10 : 10)
run_mode: grow-zero Large teacher (100 : 50 : 10)
run_mode: grow-random Large teacher (100 : 50 : 10)
run_mode: baseline-large Large teacher (100 : 50 : 10)
run_mode: baseline-small Large teacher (100 : 50 : 10)
Small teacher (20 : 10 : 10)
20
Large teacher (100 : 50 : 10)
20


Created with ❤️ on Weights & Biases.

https://wandb.ai/ltorroba/exploring-inverse-kd/reports/Replicates--VmlldzoxNDg5OTgz
Made with Weights & Biases. Sign up or log in to create reports like this one.