Skip to main content
ablateit
Projects
qlora_puffin_sweep_6
Reports
Ablate It Report
Log in
Sign up
Share
Comment
Star
Ablate It Report
Luigi D
Created on August 15
|
Last edited on August 15
Comment
Section 1
Parameter importance with respect to
eval/loss
Parameters
1-9
of 9
Config parameter
Importance
Correlation
lora_r
lora_r
learning_rate
learning_rate
weight_decay
weight_decay
Runtime
Runtime
lora_dropout
lora_dropout
warmpup_steps_factor_of_epoch
warmpup_steps_factor_of_epoch
gradient_accumulation_steps
gradient_accumulation_steps
sweep_name.value_qlora_puffin_sweep_7
sweep_name.value_qlora_puffin_sweep_7
ft_type.value_qlora
ft_type.value_qlora
Loading...
Sweep: qlora_puffin_sweep_7 1
720
Sweep: qlora_puffin_sweep_7 2
0
Add a comment