Dahoas's workspace
Runs
579
State
Notes
User
Tags
Created
Runtime
Sweep
alpha
awac_scale
batch_size
betas
cfg/activations_checkpoint_granularity
cfg/activations_checkpoint_method
cfg/activations_checkpoint_num_layers
cfg/apex_transformer_log_level
cfg/apply_query_key_layer_scaling
cfg/data/data_impl
cfg/data/data_prefix
cfg/data/data_prefix/ignored
cfg/data/dataloader_type
cfg/data/eod_mask_loss
cfg/data/index_mapping_dir
cfg/data/num_workers
cfg/data/reset_attention_mask
cfg/data/reset_position_ids
cfg/data/seq_length
cfg/data/skip_warmup
cfg/data/splits_string
cfg/encoder_seq_length
cfg/ffn_hidden_size
cfg/fp16_lm_cross_entropy
cfg/fp32_residual_connection
cfg/global_batch_size
cfg/grad_allreduce_chunk_size_mb
cfg/grad_div_ar_fusion
cfg/gradient_accumulation_fusion
cfg/gradient_as_bucket_view
cfg/hidden_dropout
cfg/hidden_size
cfg/hysteresis
cfg/init_method_std
cfg/kv_channels
cfg/layernorm_epsilon
cfg/make_vocab_size_divisible_by
cfg/max_position_embeddings
cfg/megatron_amp_O2
cfg/micro_batch_size
cfg/native_amp_growth_interval
cfg/native_amp_init_scale
cfg/nsys_profile/enabled
cfg/nsys_profile/end_step
Crashed
-
pvduy
10mo 21d 3h 23m 42s
-
0.005
1
122.18182
16
["None","selective"]
["None","uniform"]
[1,"None"]
30
true
mmap
["{'dataset': 'hh'}","{'dataset': 'imdb-reviews'}"]
ignored
single
false
None
2
false
false
1365.33333
true
900,50,50
1365.33333
26487.46667
false
false
369.06667
125
true
true
true
0.1
6621.86667
2
0.007
None
0.00001
128
1740.8
[false,true]
7.5
1000
4294967296
false
10
Killed
-
jon-tow
3m 3s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
1-2
of 2