Skip to main content
kastan
Projects
col_ai
Run groups
gpt2_pp
Overview
Group
Workspace
Runs
Logs
Files
Artifacts

Kastan's group workspace

gpt2_pp

What makes this group special?
Tags
Notes
Author
kastan
State
Crashed
Start time
June 22nd, 2022 4:18:11 PM
Runtime
7m 59s
Tracked hours
8m
Run path
kastan/col_ai/ydvlbw6a
OS
Linux-4.18.0-348.23.1.el8_5.x86_64-x86_64-with-glibc2.10
Python version
3.8.2
Git repository
git clone https://github.com/hpcaitech/ColossalAI-Examples.git
Git state
git checkout -b "gpt2_pp" 0837bc67d4d7032c6c29f18339aef6dff6c7b861
Command
train_gpt.py --config gpt2_configs/gpt2_pp.py --from_torch
System Hardware
CPU count128
GPU count4
GPU typeNVIDIA A100-SXM4-80GB
W&B CLI Version
0.12.18
Group
gpt2_pp
Config

Config parameters are your model's inputs. Learn more

  • ▶
    {} 22 keys
    • "nccl"
    • 8
    • "gpt2_configs/gpt2_pp.py"
    • "gpt2_configs/gpt2_pp.py"
    • "/u/kastan/colossal/data/train_data_FINAL.json"
    • ▶
      {} 1 key
      • "AMP_TYPE.NAIVE"
    • true
    • "titans.model.gpt.gpt.gpt2_small"
    • 768
    • null
    • null
    • ▶
      {} 1 key
      • "titans.loss.lm_loss.gpt_lmloss.GPTLMLoss"
    • ▶
      {} 2 keys
      • true
      • "titans.model.gpt.gpt.gpt2_small"
    • 60
    • 4
    • ▶
      {} 3 keys
      • 0.00015
      • "torch.optim.adam.Adam"
      • 0.01
    • ▶
      {} 2 keys
      • 2
      • ▶
        {} 2 keys
        • null
        • 1
    • 2
    • null
    • null
    • 1,024
    • null
Summary

Summary metrics are your model's outputs. Learn more

  • ▶
    {} 5 keys
    • "Hi, we got started"
    • 32.075740814208984
    • 32.075740814208984
    • 188.56
    • 114.02
Artifact Outputs

This run produced these artifacts as outputs. Total: 1. Learn more

1-1
of 1
Type
Name
Consumer count
wandb-history
run-ydvlbw6a-history:v0
0
Loading...