Skip to main content
ablateit
Projects
qlora_puffin_sweep_7
Reports
Ablate It Report
Log in
Sign up
Share
Comment
Star
Ablate It Report
Luigi D
Created on August 15
|
Last edited on August 15
Comment
Parameter importance with respect to
eval/loss
Parameters
1-4
of 4
Config parameter
Importance
Correlation
lora_r
lora_r
learning_rate
learning_rate
weight_decay
weight_decay
lora_dropout
lora_dropout
Loading...
2e+1
3e+1
4e+1
5e+1
6e+1
7e+1
8e+1
9e+1
1e+2
2e+2
lora_r
-Infinity
1e-1
2e-1
Infinity
lora_dropout
-Infinity
1e-1
2e-1
Infinity
weight_decay
1e-5
2e-5
3e-5
4e-5
5e-5
1e-4
2e-4
3e-4
4e-4
5e-4
1e-3
learning_rate
8e-1
9e-1
1e+0
2e+0
3e+0
4e+0
5e+0
6e+0
7e+0
eval/loss
Run set
116
Sweep: qlora_puffin_sweep_7 1
82
Sweep: qlora_puffin_sweep_7 2
0
Add a comment