Skip to main content
zaydzuhri
Projects
fla
Workspace
Log in
Sign up
Overview
Workspace
Runs
Automat.
Sweeps
Reports
Artifacts
Zaydzuhri's workspace
Personal workspace
Automated workspace
Changes are only visible to you.
Runs
339
Name
1 visualized
transformer-vanilla.math.1B.batch16.seqlen4096.context4096.warmup400.update1.steps40000.lr5e-5.cosine
transformer-vanilla.math.1B.batch16.seqlen4096.context4096.warmup400.update1.steps40000.lr5e-5.cosine
1-1
of 1
Add panels
loss_metrics
3
loss_metrics/global_avg_loss, loss_metrics/global_avg_ntp_loss, loss_metrics/global_avg_myopic_loss, loss_metrics/global_avg_top_loss
loss_metrics/global_avg_loss, loss_metrics/global_avg_ntp_loss, loss_metrics/global_avg_myopic_loss, loss_metrics/global_avg_top_loss
5k
10k
15k
20k
Step
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
2
3
4
5
6
7
8
9
10
loss_metrics/global_max_loss
loss_metrics/global_max_loss
5k
10k
15k
20k
Step
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
2
3
4
5
6
7
8
loss_metrics/global_avg_loss
loss_metrics/global_avg_loss
5k
10k
15k
20k
Step
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
2
optimizer
3
optimizer/grad_norm
optimizer/grad_norm
5k
10k
15k
20k
Step
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
2
3
4
5
6
7
8
optimizer/lr
optimizer/lr
5k
10k
15k
20k
Step
0.00001
0.00002
0.00003
0.00004
optimizer/skipped_step
optimizer/skipped_step
5k
10k
15k
20k
Step
-2
-1
0
1
2
time_metrics
3
Charts
3
memory
6
1-6 of 6
optim
2
Add section