kastan

Kastan's group workspace

Group: gpt2_pp_manual

1-1

of 1

Tags

Notes

Author

kastan

State

Crashed

Start time

July 15th, 2022 6:04:47 PM

Runtime

29s

Tracked hours

27s

Run path

kastan/col_ai/27cf953t

Linux-4.18.0-305.49.1.el8_4.x86_64-x86_64-with-glibc2.28

Python version

3.9.12

Git repository

git clone https://github.com/hpcaitech/ColossalAI-Examples.git

Git state

git checkout -b "gpt2_pp_manual" f743872c2089d6bb5e593db6a8a48d427e6b2b1e

Command

/u/kastanday/new_colossal_ai/ColossalAI/examples/language/gpt/train_gpt.py --config gpt2_configs/gpt2_pp_manual.py --host gpub020 --world_size 2 --rank 8 --port 29500

System Hardware

CPU count	64
GPU count	4
GPU type	NVIDIA A40

W&B CLI Version

0.12.21

Group

gpt2_pp_manual

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 12 keys
- BATCH_SIZE:
  8
- ▶
  fp16:{} 1 key
  - mode:
    "AMP_TYPE.NAIVE"
- gpt2_small:
  "titans.model.gpt.gpt.gpt2_small"
- HIDDEN_SIZE:
  768
- ▶
  loss:{} 1 key
  - type:
    "titans.loss.lm_loss.gpt_lmloss.GPTLMLoss"
- ▶
  model:{} 2 keys
  - checkpoint:
    true
  - type:
    "titans.model.gpt.gpt.gpt2_small"
- NUM_EPOCHS:
  60
- NUM_MICRO_BATCHES:
  4
- ▶
  optimizer:{} 3 keys
  - lr:
    0.00015
  - type:
    "torch.optim.adam.Adam"
  - weight_decay:
    0.01
- ▶
  parallel:{} 2 keys
  - pipeline:
    1
  - ▶
    tensor:{} 2 keys
    - mode:
      null
    - size:
      1
- PIPELINE:
  1
- SEQ_LEN:
  1,024

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 5 keys
- hello_message:
  "Hi, we got started"
- loss:
  61.21485900878906
- per_step_metrics.loss:
  61.21485900878906
- per_step_metrics.samples_per_sec:
  74.712
- per_step_metrics.Tflops:
  34.645

This run produced these artifacts as outputs. Total: 1. Learn more

wandb-history

run-27cf953t-history:v0