Skip to main content
marin-community
Projects
marin
Reports
Olmo 1B replication

Olmo 1B replication

David Leo Wright Hall
Created on June 8|Last edited on May 12
NB we only log every 1000 steps from olmo, which smooths out the training curve a lot

Section 1


200k400k600kStep345678
There's no data for the selected runs.
Try a different X axis setting.
Current X axis: _step
1k2k3k4k5k6k7k8k9k10k20k30k40k50k60k70k80k90k100k200k300k400k500k600k700kStep3456
Run set
4
Name
4 visualized
State
Notes
User
Tags
Created
Runtime
Sweep
data.cache_dir
data.configs.dolma-algebraic-stack.plaintext
data.configs.dolma-algebraic-stack.stream
data.configs.dolma-algebraic-stack.text_key
data.configs.dolma-algebraic-stack.train_urls
data.configs.dolma-algebraic-stack.validation_urls
data.configs.dolma-arxiv.plaintext
data.configs.dolma-arxiv.stream
data.configs.dolma-arxiv.text_key
data.configs.dolma-arxiv.train_urls
data.configs.dolma-arxiv.validation_urls
data.configs.dolma-c4.plaintext
data.configs.dolma-c4.stream
data.configs.dolma-c4.text_key
data.configs.dolma-c4.train_urls
data.configs.dolma-c4.validation_urls
data.configs.dolma-cc-news.plaintext
data.configs.dolma-cc-news.stream
data.configs.dolma-cc-news.text_key
data.configs.dolma-cc-news.train_urls
data.configs.dolma-cc-news.validation_urls
data.configs.dolma-cc.plaintext
data.configs.dolma-cc.stream
data.configs.dolma-cc.text_key
data.configs.dolma-cc.train_urls
data.configs.dolma-cc.validation_urls
data.configs.dolma-falcon.plaintext
data.configs.dolma-falcon.stream
data.configs.dolma-falcon.text_key
data.configs.dolma-falcon.train_urls
data.configs.dolma-falcon.validation_urls
data.configs.dolma-flan.plaintext
data.configs.dolma-flan.stream
data.configs.dolma-flan.text_key
data.configs.dolma-flan.train_urls
data.configs.dolma-flan.validation_urls
data.configs.dolma-gutenberg.plaintext
data.configs.dolma-gutenberg.stream
data.configs.dolma-gutenberg.text_key
data.configs.dolma-gutenberg.train_urls
data.configs.dolma-gutenberg.validation_urls
data.configs.dolma-megawika.plaintext
data.configs.dolma-megawika.stream
data.configs.dolma-megawika.text_key
Crashed
dlwh
8b
exp2062
giraffe
llama
phase2
1h 4m 20s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Running
pinlinxu
speedrun
22h 57m 41s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Finished
pinlinxu
speedrun
12h 25m 32s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Finished
pinlinxu
speedrun
11h 46m 36s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Finished
pinlinxu
speedrun
31m 24s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Finished
held
9m 11s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
held
1m 30s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
held
1m 30s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
held
1m 30s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
held
1m 31s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
held
1m 31s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
held
1m 31s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
held
1m 31s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
held
1m 31s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
held
1m 31s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
held
1m 31s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
held
1m 31s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
held
1m 30s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
held
1m 45s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
held
1m 46s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
1-20
of 18,970



Run set
4


Created with ❤️ on Weights & Biases.

https://wandb.ai/marin-community/marin/reports/Olmo-1B-replication--Vmlldzo4MjYxMjU1
Made with Weights & Biases. Sign up or log in to create reports like this one.