Skip to main content
kastan
Projects
col_ai
Run groups
u
Overview
Group
Workspace
Runs
Logs
Files
Artifacts

Kastan's group workspace

u

What makes this group special?
Tags
Notes
Author
kastan
State
Crashed
Start time
July 19th, 2022 12:18:38 AM
Runtime
3h 59m 18s
Tracked hours
3h 59m 5s
Run path
kastan/col_ai/vvvkt48x
OS
Linux-4.18.0-305.49.1.el8_4.x86_64-x86_64-with-glibc2.28
Python version
3.9.12
Command
/u/kastanday/new_colossal_ai/ColossalAI/examples/language/gpt/train_gpt.py --config /u/kastanday/new_colossal_ai/ColossalAI/examples/language/gpt/gpt2_configs/gpt2_3d_PP4_8B.py --host gpub003 --port 29500 --world_size 32 --rank 23
System Hardware
CPU count64
GPU count4
GPU typeNVIDIA A40
W&B CLI Version
0.12.21
Group
u
Config

Config parameters are your model's inputs. Learn more

  • ▶
    {} 23 keys
    • "nccl"
    • 256
    • "/u/kastanday/new_colossal_ai/ColossalAI/examples/language/gpt/gpt2_configs/gpt2_3d_PP4_8B.py"
    • "/u/kastanday/new_colossal_ai/ColossalAI/examples/language/gpt/gpt2_configs/gpt2_3d_PP4_8B.py"
    • "/u/kastanday/colossal_ai/raw_json_backup/train_data_FINAL.json"
    • ▶
      {} 1 key
      • "AMP_TYPE.NAIVE"
    • true
    • false
    • "titans.model.gpt.gpt.gpt2_8B"
    • "titans.model.gpt.gpt.gpt2_small"
    • "gpub003"
    • null
    • ▶
      {} 1 key
      • "titans.loss.lm_loss.gpt_lmloss.GPTLMLoss"
    • ▶
      {} 2 keys
      • true
      • "titans.model.gpt.gpt.gpt2_8B"
    • 60
    • 8
    • ▶
      {} 3 keys
      • 0.00015
      • "torch.optim.adam.Adam"
      • 0.01
    • ▶
      {} 2 keys
      • 4
      • ▶
        {} 2 keys
        • "3d"
        • 8
    • 29,500
    • 23
    • 1,024
    • 8
    • 32
Summary

Summary metrics are your model's outputs. Learn more

  • ▶
    {} 3 keys
    • "Hi, we got started"
    • null
    • 0.0001
Artifact Outputs

This run produced these artifacts as outputs. Total: 1. Learn more

1-1
of 1
Type
Name
Consumer count
wandb-history
run-vvvkt48x-history:v0
0
Loading...