Igoro's group workspace
Group: 20B_eval_multi
Name
13 visualized
State
Notes
User
Tags
Created
Runtime
Sweep
activation
adlr_autoresume
adlr_autoresume_interval
apply_query_key_layer_scaling
attention-dropout
attention_config
attention_dropout
attention_softmax_in_fp32
batch_size
bias-gelu-fusion
bias_dropout_fusion
bias_gelu_fusion
char_level_ppl
checkpoint-activations
checkpoint-num-layers
checkpoint_activations
checkpoint_factor
checkpoint_in_cpu
checkpoint_num_layers
checkpoint_scale
checkpoint_validation_with_forward_pass
clip_grad
config_files.20B.yml
config_files.20B_P3.yml
config_files.20B_code.yml
config_files.20B_fork.yml
config_files.20B_math.yml
config_files.test20B.yml
contiguous_checkpointing
coord_check
curriculum_seqlen
data-impl
data-path
data_impl
data_path
deepscale
deepspeed
deepspeed_activation_checkpointing
deepspeed_mpi
deepspeed_slurm
detect_nvlink_pairs
distributed-backend
distributed_backend
dump_state
Crashed
-
sdtblck
21d 4h 55m 19s
-
-
-
-
-
0
-
-
-
-
true
-
-
-
true
1
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
mmap
/mnt/ssd-1/data/pile_20B_tokenizer/pile_20B_tokenizer_text_document
-
-
-
-
-
-
-
-
nccl
-
-
Finished
-
sdtblck
20s
-
-
-
-
-
0
-
-
-
-
true
-
-
-
true
1
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
mmap
/mnt/ssd-1/data/pile_20B_tokenizer/pile_20B_tokenizer_text_document
-
-
-
-
-
-
-
-
nccl
-
-
Finished
-
sdtblck
20s
-
-
-
-
-
0
-
-
-
-
true
-
-
-
true
1
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
mmap
/mnt/ssd-1/data/pile_20B_tokenizer/pile_20B_tokenizer_text_document
-
-
-
-
-
-
-
-
nccl
-
-
Finished
-
sdtblck
21s
-
-
-
-
-
0
-
-
-
-
true
-
-
-
true
1
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
mmap
/mnt/ssd-1/data/pile_20B_tokenizer/pile_20B_tokenizer_text_document
-
-
-
-
-
-
-
-
nccl
-
-
Finished
-
sdtblck
13h 20s
-
-
-
-
-
0
-
-
-
-
true
-
-
-
true
1
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
mmap
/mnt/ssd-1/data/pile_20B_tokenizer/pile_20B_tokenizer_text_document
-
-
-
-
-
-
-
-
nccl
-
-
Failed
-
sdtblck
51s
-
-
-
-
-
0
-
-
-
-
true
-
-
-
true
1
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
mmap
/mnt/ssd-1/data/pile_20B_tokenizer/pile_20B_tokenizer_text_document
-
-
-
-
-
-
-
-
nccl
-
-
Failed
-
sdtblck
12d 5h 19m 51s
-
-
-
-
-
0
-
-
-
-
true
-
-
-
true
1
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
mmap
/mnt/ssd-1/data/pile_20B_tokenizer/pile_20B_tokenizer_text_document
-
-
-
-
-
-
-
-
nccl
-
-
Finished
-
stellaathena
2d 22h 48s
-
-
-
-
-
0
-
-
-
-
true
-
-
-
true
1
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
mmap
/mnt/ssd-1/data/pile_20B_tokenizer/pile_20B_tokenizer_text_document
-
-
-
-
-
-
-
-
nccl
-
-
Failed
-
sdtblck
5d 1h 5m 49s
-
-
-
-
-
0
-
-
-
-
true
-
-
-
true
1
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
mmap
/mnt/ssd-1/data/pile_20B_tokenizer/pile_20B_tokenizer_text_document
-
-
-
-
-
-
-
-
nccl
-
-
Failed
-
sdtblck
2h 2m 52s
-
-
-
-
-
0
-
-
-
-
true
-
-
-
true
1
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
mmap
/mnt/ssd-1/data/pile_20B_tokenizer/pile_20B_tokenizer_text_document
-
-
-
-
-
-
-
-
nccl
-
-
Finished
-
sdtblck
1d 47m 8s
-
-
-
-
-
0
-
-
-
-
true
-
-
-
true
1
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
mmap
/mnt/ssd-1/data/pile_20B_tokenizer/pile_20B_tokenizer_text_document
-
-
-
-
-
-
-
-
nccl
-
-
Failed
-
sdtblck
59m 38s
-
-
-
-
-
0
-
-
-
-
true
-
-
-
true
1
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
mmap
/mnt/ssd-1/data/pile_20B_tokenizer/pile_20B_tokenizer_text_document
-
-
-
-
-
-
-
-
nccl
-
-
Finished
-
sdtblck
11s
-
-
-
-
-
0
-
-
-
-
true
-
-
-
true
1
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
mmap
/mnt/ssd-1/data/pile_20B_tokenizer/pile_20B_tokenizer_text_document
-
-
-
-
-
-
-
-
nccl
-
-
1-13
of 13