Skip to main content
ablateit
Projects
qlora_puffin_sweep_7
Reports
(23/08/15 10:06:28)
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
(23/08/15 10:06:28)
Teknium
Created on August 15
|
Last edited on August 15
Comment
1
1
gradient_...
0.00000
0.00010
0.00020
0.00030
0.00040
0.00050
0.00060
0.00070
0.00080
0.00090
0.00100
learning_...
0.00
0.02
0.04
0.06
0.08
0.10
0.12
0.14
0.16
0.18
0.20
lora_dropout
0
20
40
60
80
100
120
140
160
180
200
220
240
260
lora_r
0.00
0.02
0.04
0.06
0.08
0.10
0.12
0.14
0.16
0.18
0.20
weight_decay
0.0
0.5
1.0
1.5
2.0
2.5
3.0
3.5
4.0
4.5
train/epoch
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1.0
1.1
1.2
1.3
1.4
1.5
1.6
train/loss
null
0.70
0.75
0.80
0.85
0.90
0.95
1.00
1.05
1.10
1.15
1.20
1.25
1.30
1.35
eval/loss
Sweep: qlora_puffin_sweep_7 1
111
Sweep: qlora_puffin_sweep_7 2
0
Add a comment