ai2-llm

Akshitab's group workspace

Group: OLMo-1.7-7B

1-20

of 25

Tags

Notes

Author

epwalsh

State

Finished

Start time

April 18th, 2024 3:20:04 PM

Runtime

11m 20s

Tracked hours

9m 33s

Run path

ai2-llm/OLMo-7B/u3obk6mj

Linux-5.15.0-60-generic-x86_64-with-glibc2.31

Python version

3.10.14

Git repository

git clone https://github.com/allenai/OLMo.git

Git state

git checkout -b "OLMo-1.7-7B-run-025" 43a155faf0c41c849fc2e14fe375a6bc57ed89fb

Command

/home/petew/OLMo/scripts/copy_wandb_runs.py

System Hardware

CPU count	56
Logical CPU count	112
GPU count	4
GPU type	NVIDIA A100-PCIE-40GB

W&B CLI Version

0.16.6

Group

OLMo-1.7-7B

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 57 keys
- activation_checkpointing:
  "fine_grained"
- canceled_check_interval:
  50
- compile:
  null
- console_log_interval:
  1
- ▶
  data:{} 12 keys
- device_eval_batch_size:
  2
- device_train_batch_size:
  16
- device_train_grad_accum:
  8
- device_train_microbatch_size:
  2
- dry_run:
  false
- early_stopping_factor:
  null
- epoch:
  null
- eval_interval:
  1,000
- eval_on_load:
  false
- eval_subset_num_batches:
  -1
- ▶
  evaluators:[] 24 items
- extra_steps_after_cancel:
  10
- fast_forward_batches:
  null
- force_save_unsharded:
  false
- ▶
  fsdp:{} 4 keys
  - precision:
    "mixed"
  - sharding_strategy:
    "ShardingStrategy.SHARD_GRAD_OP"
  - use_orig_params:
    true
  - wrapping_strategy:
    "by_block_and_size"
- fused_loss:
  true
- gen1_gc_interval:
  32
- global_train_batch_size:
  1,024
- load_path:
  "s3://ai2-llm/checkpoints/OLMo-medium/mitchish7/step521000"
- load_path_sharded_checkpointer:
  null
- max_duration:
  "2ep"
- max_grad_norm:
  1
- max_grad_norm_ratio:
  null
- ▶
  model:{} 37 keys
- new_style_checkpoints:
  null
- no_pre_train_checkpoint:
  false
- ▶
  optimizer:{} 8 keys
- precision:
  "amp_bf16"
- python_profiling:
  false
- remote_save_folder:
  "s3://ai2-llm/checkpoints/OLMo-medium/mitchish7"
- reset_optimizer_state:
  false
- reset_trainer_state:
  false
- restore_dataloader:
  true
- run_name:
  "mitchish7"
- save_data_indices:
  true
- save_folder:
  "runs/"
- save_interval:
  1,000
- save_interval_ephemeral:
  null
- save_interval_unsharded:
  null
- save_num_checkpoints_to_keep:
  -1
- save_num_unsharded_checkpoints_to_keep:
  -1
- stop_at:
  null
- time_limit:
  null
- ▶
  tokenizer:{} 2 keys
  - identifier:
    "tokenizers/allenai_gpt-neox-olmo-dolma-v1_5.json"
  - truncate_direction:
    "right"
- torch_profiling:
  false

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 2134 keys
- eval/c4_en-validation/CrossEntropyLoss:
  2.3668363094329834
- eval/c4_en-validation/Perplexity:
  10.663602828979492
- eval/dolma_books-validation/CrossEntropyLoss:
  2.3824641704559326
- eval/dolma_books-validation/Perplexity:
  10.831561088562012
- eval/dolma_common-crawl-validation/CrossEntropyLoss:
  2.4259748458862305
- eval/dolma_common-crawl-validation/Perplexity:
  11.313252449035645
- eval/dolma_pes2o-validation/CrossEntropyLoss:
  1.9065165519714355
- eval/dolma_pes2o-validation/Perplexity:
  6.7296061515808105
- eval/dolma_reddit-validation/CrossEntropyLoss:
  2.621654272079468
- eval/dolma_reddit-validation/Perplexity:
  13.758464813232422
- eval/dolma_stack-validation/CrossEntropyLoss:
  0.8357164859771729
- eval/dolma_stack-validation/Perplexity:
  2.3064661026000977
- eval/dolma_wiki-validation/CrossEntropyLoss:
  2.040860176086426
- eval/dolma_wiki-validation/Perplexity:
  7.697227478027344
- eval/downstream/arc_challenge_len_norm:
  0.44481605291366577
- eval/downstream/arc_easy_acc:
  0.7298245429992676
- eval/downstream/boolq_acc:
  0.7605504393577576
- eval/downstream/commonsense_qa_len_norm:
  0.6494676470756531
- eval/downstream/copa_acc:
  0.8700000047683716
- eval/downstream/hellaswag_len_norm:
  0.7630950212478638
- eval/downstream/mmlu_humanities_mc_5shot_len_norm:
  0.4247104227542877
- eval/downstream/mmlu_humanities_mc_5shot_test_len_norm:
  0.4554728865623474
- eval/downstream/mmlu_humanities_var_len_norm:
  0.35107555985450745
- eval/downstream/mmlu_other_mc_5shot_len_norm:
  0.5577464699745178
- eval/downstream/mmlu_other_mc_5shot_test_len_norm:
  0.5694016218185425
- eval/downstream/mmlu_other_var_len_norm:
  0.5014084577560425
- eval/downstream/mmlu_social_sciences_mc_5shot_len_norm:
  0.5994065403938293
- eval/downstream/mmlu_social_sciences_mc_5shot_test_len_norm:
  0.5983100533485413
- eval/downstream/mmlu_social_sciences_var_len_norm:
  0.4171259105205536
- eval/downstream/mmlu_stem_mc_5shot_len_norm:
  0.38317757844924927
- eval/downstream/mmlu_stem_mc_5shot_test_len_norm:
  0.4138502180576325
- eval/downstream/mmlu_stem_var_len_norm:
  0.35736536979675293
- eval/downstream/openbook_qa_len_norm:
  0.4059999883174896
- eval/downstream/piqa_len_norm:
  0.7878128290176392
- eval/downstream/sciq_acc:
  0.9539999961853028
- eval/downstream/social_iqa_len_norm:
  0.5941658020019531
- eval/downstream/winogrande_acc:
  0.686661422252655
- eval/ice-validation/CrossEntropyLoss:
  2.299879550933838
- eval/ice-validation/Perplexity:
  9.972980499267578
- eval/m2d2_s2orc-validation/CrossEntropyLoss:
  2.7653002738952637
- eval/m2d2_s2orc-validation/Perplexity:
  15.883809089660645
- eval/pile-validation/CrossEntropyLoss:
  1.8023427724838257
- eval/pile-validation/Perplexity:
  6.063837051391602
- eval/wikitext_103-validation/CrossEntropyLoss:
  2.0783956050872803
- eval/wikitext_103-validation/Perplexity:
  7.991637229919434
- optim/clipping_rate:
  0
- throughput/device/tokens_per_second:
  7,306.430949515451
- throughput/total_tokens:
  2,279,017,021,440
- train/CrossEntropyLoss:
  2.051841974258423
- train/Perplexity:
  7.782222566017392

This run consumed these artifacts as inputs. Learn more

job

job-https___github.com_allenai_OLMo.git_scripts_copy_wandb_runs.py:v24

This run produced these artifacts as outputs. Total: 1. Learn more

wandb-history

run-u3obk6mj-history:v2