Skip to main content
kmfoda
Projects
DeMoCo
Log in
Sign up
Overview
Workspace
Runs
Automat.
Sweeps
Reports
Artifacts
Kmfoda's workspace
Personal workspace
Automated workspace
Changes are only visible to you.
Runs
5
Name
5 visualized
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_benchmark
DeMoCo_benchmark
1-5
of 5
Add panels
Charts
7
1-6 of 7
grad_norm_after_outer
grad_norm_after_outer
600
800
1k
1.2k
1.4k
Step
-2
-1
0
1
2
DeMoCo_pseudo_gradients_4_replicas
outer_step
outer_step
600
800
1k
1.2k
1.4k
Step
1
1.5
2
2.5
3
DeMoCo_pseudo_gradients_4_replicas
perplexity
perplexity
0
500
1k
1.5k
2k
Step
5e+37
1e+38
1.5e+38
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_benchmark
tokens_per_sec
tokens_per_sec
0
20k
40k
60k
80k
Step
1000000
2000000
3000000
4000000
5000000
6000000
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_benchmark
step
step
0
20k
40k
60k
80k
Step
20000
40000
60000
80000
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_benchmark
learning_rate
learning_rate
0
20k
40k
60k
80k
Step
0.0001
0.0002
0.0003
0.0004
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_pseudo_gradients_4_replicas
DeMoCo_benchmark
System
18
1-6 of 18
Add section