Skip to main content
amr-amr
Projects
zsl
Run groups
37M
Overview
Workspace
Runs
Logs
Files
Artifacts

Amr-amr's group workspace

37M

What makes this group special?
Tags

1028-rmsnorm-37m

Notes
Tags
Main Results (OLMo)
Author
amr-amr
State
Finished
Start time
October 29th, 2024 5:34:25 PM
Runtime
10h 25m 45s
Tracked hours
10h 25m 40s
Run path
amr-amr/zsl/jqdakgv3
OS
Linux-5.15.0-101-generic-x86_64-with-glibc2.35
Python version
3.10.14
Git repository
git clone git@github.com:mirandrom/zsl-olmo.git
Git state
git checkout -b "1028-rmsnorm-37m" a756ab5509e5fc6cafa09b061cfe042b2d1e9fe4
Command
/home/mila/m/mirceara/proj/zsl-olmo/scripts/train.py /home/mila/m/mirceara/proj/zsl-olmo/zsl/exp/1028-rmsnorm/37m.yaml --run_name=1028-rmsnorm-37m --wandb.name=1028-rmsnorm-37m --wandb.group=1028-rmsnorm-37m --wandb.project=zsl-test --wandb.entity=amr-amr
System Hardware
CPU count48
Logical CPU count 48
GPU count2
GPU type[NVIDIA L40S, NVIDIA L40S]
W&B CLI Version
0.18.1
Group
37M
Config

Config parameters are your model's inputs. Learn more

  • ▶
    {} 64 keys
    • null
    • 0.0001
    • 50
    • ▶
      {} 3 keys
      • "inductor"
      • false
      • "default"
    • 1
    • ▶
      {} 15 keys
      • null
      • 16
      • 64
      • 1
      • 64
      • "fsdp"
      • false
      • null
      • null
      • 1,000
      • false
      • -1
      • [] 0 items
        • 10
        • null
        • false
        • ▶
          {} 5 keys
          • null
          • 1
          • 512
          • null
          • null
          • null
          • 262,144
          • 1
          • null
          • ▶
            {} 43 keys
            • null
            • null
            • false
            • ▶
              {} 11 keys
              • "amp_bf16"
              • false
              • null
              • false
              • false
              • true
              • "1028-rmsnorm-37m"
              • true
              • "/network/scratch/m/mirceara/zsl-olmo/out/1028-rmsnorm-37m"
                • ▶
                ▶
                46 ... 59
              • null
              • ▶
                {} 2 keys
                • "tokenizers/allenai_eleuther-ai-gpt-neox-20b-pii-special.json"
                • "right"
              • false
              • true
            Summary

            Summary metrics are your model's outputs. Learn more

            • ▶
              {} 540 keys
              • 0
              • 0.00000002274097177235
              • 0.00005171477823751047
              • 0.00000000002909995335
              • 0.0003304197161924094
              • 0.00000004968265443495
              • 0.00001969827826542314
              • 0.00000000041847061927
              • 0.00023522027186118064
              • 0.00000001361751156281
              • 0.00000157723366100981
              • 0.0000000004226685113
              • 0.00001949148281710222
              • 0.00000000803911159863
              • 0.00004875284139416181
              • 0.00000000018987593442
              • 0.00011843397805932908
              • 0.00000002467071169576
              • 0.0004003066860605031
              • 0.00000000003176988533
              • 0.0009353495552204548
              • 0.00000000344794326423
              • 0.00000154005135755142
              • 0.00000000018435956928
              • 0.00000599552640778711
              • 0.00000007379902910998
              • 0.00005414685074356385
              • 0.00000000031760744035
              • 0.00045201194006949663
              • 0.00000000782225839657
              • 0.00008215733396355063
              • 0.00000000000983279343
              • 0.00011400564108043908
              • 0.00000002381349695213
              • 0.0001621872652322054
              • 0.00000000001822122835
              • 0.0006881864974275231
              • 0.0000000043318673093
              • 0.00000314625413011527
              • 0.00000000021683886631
              • 0.00002021314139710739
              • 0.00000004659178642896
              • 0.00010252563515678048
              • 0.00000000033536873278
              • 0.0003013587847817689
              • 0.00000000938394872918
                • ▶
                ▶
                46 ... 95
                ▶
                ▶
                96 ... 145
                ▶
                ▶
                146 ... 195
                ▶
                ▶
                196 ... 245
                ▶
                ▶
                246 ... 295
                ▶
                ▶
                296 ... 345
                ▶
                ▶
                346 ... 395
                ▶
                ▶
                396 ... 445
                ▶
                ▶
                446 ... 495
                ▶
                ▶
                496 ... 535
              • 9,480,438,851.861216
              • 22.972496444532307
              • 3.444950580596924
              • 31.341734518584865
            Artifact Inputs

            This run consumed these artifacts as inputs. Learn more

            1-0
            of 0
            Type
            Name
            Consumer count
            No rows found
            Loading...
            Artifact Outputs

            This run produced these artifacts as outputs. Total: 1. Learn more

            1-1
            of 1
            Type
            Name
            Consumer count
            wandb-history
            run-jqdakgv3-history:v0
            0
            Loading...