fla Artifacts – Weights & Biases

Skip to main content

Artifacts

wandb-events

run-top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine-202509100619-events

run-top_transformer-top.code.340M.batch16.seqlen4096.context4096.warmup1000.update1.steps100000.lr3e-4.cosine-2025-u9IavA-events

run-top_transformer-top.340M.batch16.seqlen4096.context4096.warmup1000.update1.steps100000.lr3e-4.cosine-202506141231-events

run-mtp_transformer-mtp.340M.batch16.seqlen4096.context4096.warmup1000.update1.steps100000.lr3e-4.cosine-202507220732-events

run--myopic.340M.batch8.seqlen4096.context4096.warmup1000.update2.steps100000.lr3e-4.cosine-202505230849-events

run-mtp_transformer-mtp.1B.batch16.seqlen4096.context4096.warmup2000.update1.steps200000.lr2e-4.cosine-202507162201-events

run--myopic.1B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr2e-4.cosine-202506031052-events

run--vanilla.1B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr2e-4.cosine-202505060706-events

run-top_transformer-top.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine-202506191711-events

run-mtp_transformer-mtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine-202507150947-events

1 - 10 of 12

wandb-history

run-transformer-transformer.120M.batch8.seqlen2048.context2048.warmup1000.update1.steps15000.lr5e-4.cosine.A100-2-seTGqQ-history

run--transformer.120M.batch8.seqlen2048.context2048.warmup1000.update1.steps15000.lr5e-4.cosine.amd.max-202510211300-history

run-transformer-transformer.120M.batch8.seqlen2048.context2048.warmup1000.update1.steps15000.lr5e-4.cosine.A100.m-ac1ulQ-history

run--vanilla.340M.slimpajama.1B.batch8.seqlen2048.context2048.warmup1000.update1.steps15000.lr5e-4.cosine.amd-202-wqNgwg-history

run--transformer.120M.batch8.seqlen2048.context2048.warmup1000.update1.steps15000.lr5e-4.cosine.amd-202510202217-history

run-transformer-transformer.120M.batch8.seqlen2048.context2048.warmup1000.update1.steps15000.lr5e-4.cosine.A100-2-KeoAvw-history

run--transformer.120M.batch8.seqlen2048.context2048.warmup1000.update1.steps15000.lr5e-4.cosine.amd-202510202230-history

run--dsmtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine-202510161146-history

run--dsmtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine-202510151208-history

run--mono.ratio45.340M.slimpajama.1B.batch8.seqlen2048.context2048.warmup1000.update1.steps15000.lr5e-4.cosine-20-a6KvUw-history

1 - 10 of 325

run-top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine-202509100619-events

Version overview

Full Name

zaydzuhri/fla/run-top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine-202509100619-events:v0

Aliases

latest

v0

Tags

Digest

d13c6f0007506abacaa49c82a8a7d636

Created By

top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine

Created At

September 12th, 2025 05:41:39

Num Consumers

0

Num Files

1

Size

1.1MB

Description

Weights & Biases Run Events Data for top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine-202509100619