Ian_wandb's workspace
Runs
122
Name
122 visualized
State
eval/loss (Min)
Runtime
Created
train/epoch
eval/loss (Min)
train/loss
lora_dropout
lora_r
learning_rate
weight_decay
train_batch_size
Crashed
0.77621
2h 8m 3s
3
0.77621
41.2942
0.044677
32
0.00060881
0.019157
4
Finished
0.71181
2h 7m 43s
2.96
0.71181
0.5746
0.0026543
16
0.00066814
0.13346
4
Finished
0.79463
2h 7m 51s
3
0.79463
50.953
0.17715
8
0.00068423
0.064849
4
Finished
0.7268
2h 10m 18s
2.96
0.7268
0.6922
0.14216
128
0.00017965
0.13368
4
Crashed
0.70003
2h 7m 37s
2.96
0.70003
0.4564
0.11429
32
0.00063625
0.14287
4
Finished
0.698
2h 7m 52s
2.96
0.698
0.4259
0.0265
32
0.00066842
0.0070269
4
Finished
0.70221
2h 13m 8s
2.96
0.70221
0.5434
0.14881
256
0.00033093
0.18625
4
Finished
0.77521
2h 8m 4s
3
0.77521
7.259
0.044977
8
0.00049874
0.021715
4
Finished
0.70288
2h 7m 50s
3
0.70288
0.3635
0.1056
16
0.0003922
0.091612
4
Finished
0.73384
2h 7m 40s
2.96
0.73384
0.7062
0.085473
16
0.00013951
0.14945
4
Finished
0.70781
2h 9m 53s
2.96
0.70781
0.5407
0.095958
128
0.00084292
0.12531
4
Finished
0.70762
2h 7m 47s
2.96
0.70762
0.5897
0.11829
32
0.00024997
0.11435
4
Finished
0.71985
2h 7m 31s
2.96
0.71985
0.651
0.1021
16
0.00029228
0.03256
4
Crashed
0.77539
2h 10m 33s
3
0.77539
75.4271
0.024135
128
0.00079897
0.034127
4
Finished
0.70906
2h 9m 48s
2.96
0.70906
0.571
0.15088
128
0.00063348
0.13868
4
Finished
0.74934
2h 7m 47s
2.96
0.74934
0.6164
0.015201
16
0.00074719
0.15129
4
Crashed
0.7082
2h 7m 33s
3
0.7082
0.5483
0.14172
8
0.000118
0.18509
4
Finished
0.72205
2h 7m 49s
2.96
0.72205
0.4953
0.13167
16
0.00091476
0.15031
4
Crashed
0.70812
2h 8m 3s
3
0.70812
0.6357
0.053359
8
0.000037533
0.14426
4
Finished
0.91416
2h 13m 5s
2.96
0.91416
0.9109
0.08341
256
0.0000093736
0.06381
4
Finished
0.75698
2h 24m 21s
3
0.75698
7.5166
0.13304
128
0.00019098
0.14845
4
Finished
0.7129
2h 27m 34s
2.96
0.7129
0.5798
0.16991
128
0.00070378
0.034894
4
Finished
0.70763
2h 9m 55s
3
0.70763
0.6334
0.13222
16
0.000037268
0.088009
4
Crashed
0.71945
2h 8m 32s
3
0.71945
0.3595
0.19535
32
0.0002824
0.18385
4
Finished
0.76165
45m 15s
0.99
0.76165
0.6285
0.18819
256
0.00014203
0.17818
4
Finished
0.71126
2h 7m 20s
3
0.71126
0.5676
0.19228
8
0.00030413
0.011512
4
Finished
0.72056
2h 12m 50s
2.96
0.72056
0.6599
0.080808
256
0.00048292
0.15587
4
Finished
0.69544
2h 13m 23s
3
0.69544
0.5383
0.18206
256
0.00033692
0.099579
4
Finished
0.71898
2h 9m 43s
2.96
0.71898
0.6485
0.17279
128
0.00054269
0.030751
4
Finished
0.69488
2h 7m 50s
3
0.69488
0.5081
0.017988
16
0.00037496
0.10682
4
Finished
0.68955
2h 7m 53s
3
0.68955
0.4273
0.1585
16
0.00054776
0.094331
4
Crashed
0.77538
2h 7m 7s
2.96
0.77538
0.7832
0.013962
8
0.000072006
0.032323
4
Crashed
4.59237
1h 29m 3s
1.99
4.59237
43.9699
0.083069
256
0.00090464
0.0098696
4
Finished
0.72058
2h 9m 42s
2.96
0.72058
0.6919
0.062984
128
0.00024659
0.17581
4
Finished
0.82345
2h 13m 37s
3
0.82345
22.2518
0.17328
256
0.00084416
0.15126
4
Crashed
0.7618
2h 7m 8s
2.96
0.7618
0.7651
0.045649
8
0.00010651
0.00053749
4
Finished
0.71504
2h 7m 37s
3
0.71504
0.4537
0.052182
16
0.00025224
0.12299
4
Finished
0.69767
2h 7m 32s
2.96
0.69767
0.5231
0.093394
32
0.0008692
0.036053
4
Crashed
0.78952
2h 7m 38s
3
0.78952
17.9689
0.13118
32
0.00087807
0.014025
4
Finished
0.69435
2h 10m 12s
3
0.69435
0.5183
0.024099
128
0.00035464
0.10318
4
Finished
0.71346
2h 7m 17s
2.96
0.71346
0.6534
0.14567
32
0.00013314
0.085568
4
Finished
0.71731
2h 10m 17s
3
0.71731
0.6814
0.0057138
128
0.000087425
0.055235
4
Finished
0.80435
2h 7m 50s
3
0.80435
28.8157
0.13925
16
0.0009071
0.058349
4
Crashed
0.70928
2h 13m 6s
2.96
0.70928
0.6151
0.12312
256
0.0005174
0.069519
4
Finished
0.69619
2h 13m 8s
2.96
0.69619
0.4861
0.15886
256
0.00044753
0.11794
4
Finished
0.74006
2h 12m 47s
2.96
0.74006
0.7815
0.1459
256
0.00010621
0.094394
4
Finished
0.7003
2h 7m 26s
2.96
0.7003
0.4853
0.18597
16
0.00056786
0.13688
4
Finished
0.91802
2h 7m 20s
2.96
0.91802
0.983
0.18128
16
0.0000084928
0.010217
4
Finished
0.71397
2h 9m 46s
2.96
0.71397
0.601
0.11405
128
0.00049325
0.022747
4
Finished
0.76726
2h 9m 39s
2.96
0.76726
0.7733
0.033834
128
0.000095286
0.070891
4
Sweep
Notes
User
Tags
_name_or_path
adafactor
adam_beta1
adam_beta2
adam_epsilon
add_cross_attention
architectures
auto_find_batch_size
bf16
bf16_full_eval
bos_token_id
chunk_size_feed_forward
data_seed
dataloader_drop_last
dataloader_num_workers
dataloader_pin_memory
ddp_backend
ddp_broadcast_buffers
ddp_bucket_cap_mb
ddp_find_unused_parameters
ddp_timeout
debug
deepspeed
disable_tqdm
diversity_penalty
do_eval
do_predict
do_sample
do_train
early_stopping
encoder_no_repeat_ngram_size
eos_token_id
eval_accumulation_steps
eval_batch_size
eval_delay
eval_steps
evaluation_strategy
fp16
fp16_backend
fp16_full_eval
fp16_opt_level
fsdp
fsdp_config
fsdp_min_num_params
fsdp_transformer_layer_cls_to_wrap
ft_type
full_determinism
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
4
8
0
35
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
32
8
0
4
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
4
8
0
35
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
32
8
0
4
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
4
8
0
35
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
8
8
0
17
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
32
8
0
4
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
32
8
0
4
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
32
8
0
4
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
8
8
0
17
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
32
8
0
4
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
8
8
0
17
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
4
8
0
35
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
32
8
0
4
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
4
8
0
35
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
32
8
0
4
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
4
8
0
35
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
4
8
0
35
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
8
8
0
17
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
32
8
0
4
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
4
8
0
35
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
32
8
0
4
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
4
8
0
35
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
4
8
0
35
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
32
8
0
4
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
4
8
0
35
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
8
8
0
17
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
32
8
0
4
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
8
8
0
17
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
8
8
0
17
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
4
8
0
35
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
4
8
0
35
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
4
8
0
35
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
16
8
0
8
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
32
8
0
4
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
-
morgan
NousResearch/Llama-2-7b-hf
false
0.9
0.999
1.0000e-8
false
["LlamaForCausalLM"]
false
true
false
1
0
None
false
0
true
None
None
None
None
1800
[]
None
false
0
true
false
false
false
false
0
2
32
8
0
4
steps
false
auto
false
O1
[]
{'fsdp_min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}
0
None
qlora
false
1-50
of 122