Skip to main content
nonenman
Projects
RC_project
Run groups
mlm_bipar
Workspace
Log in
Sign up
Overview
Workspace
Runs
Logs
Files
Artifacts
Nonenman's group workspace
Personal workspace
Automated workspace
Changes are only visible to you.
Group: mlm_bipar
Name
7 visualized
30_roberta-large_A100_48_384_2e-5_20-words_20epochs
30_roberta-large_A100_48_384_2e-5_20-words_20epochs
30_roberta-large_A100_48_384_2e-5_40-tokens_20epochs
30_roberta-large_A100_48_384_2e-5_40-tokens_20epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_20-words_100epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_20-words_100epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_40-tokens_100epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_40-tokens_100epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_35-words_10epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_35-words_10epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_40-tokens_10epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_40-tokens_10epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_15-tokens_10epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_15-tokens_10epochs
1-7
of 7
Add panels
eval
2
eval/avg_loss
eval/avg_loss
10k
20k
30k
Step
1
2
3
4
5
6
eval/perplexity
eval/perplexity
10k
20k
30k
Step
200
400
600
800
model
6
1-6 of 6
model/num_parameters
model/num_parameters
30_roberta-large_A100_48_384_2e-5_20-words_20epochs
30_roberta-large_A100_48_384_2e-5_40-tokens_20epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_20-words_100epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_40-tokens_100epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_35-words_10epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_40-tokens_10epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_15-tokens_10epochs
0
100,000,000
200,000,000
300,000,000
model/hidden_size
model/hidden_size
30_roberta-large_A100_48_384_2e-5_20-words_20epochs
30_roberta-large_A100_48_384_2e-5_40-tokens_20epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_20-words_100epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_40-tokens_100epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_35-words_10epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_40-tokens_10epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_15-tokens_10epochs
0
1,000
2,000
3,000
4,000
model/num_hidden_layers
model/num_hidden_layers
30_roberta-large_A100_48_384_2e-5_20-words_20epochs
30_roberta-large_A100_48_384_2e-5_40-tokens_20epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_20-words_100epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_40-tokens_100epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_35-words_10epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_40-tokens_10epochs
30_albert-xxlarge-v2_A100_24_384_2e-5_15-tokens_10epochs
0
10
20
train
5
1-5 of 5
Add section
4,000