Skip to main content
zaydzuhri
Projects
fla
Overview
Workspace
Runs
Automat.
Sweeps
Reports
Artifacts

Zaydzuhri's workspace

50k100k150k200kStep0.60.70.80.912345678910
mtp_transformer-mtp.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_loss
mtp_transformer-mtp.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_ntp_loss
mtp_transformer-mtp.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_myopic_loss
mtp_transformer-mtp.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_top_loss
top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_loss
top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_ntp_loss
top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_myopic_loss
top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_top_loss
dsmtp_transformer-dsmtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_loss
dsmtp_transformer-dsmtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_ntp_loss
dsmtp_transformer-dsmtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_myopic_loss
dsmtp_transformer-dsmtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_top_loss
top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_loss
top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_ntp_loss
top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_myopic_loss
top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_top_loss
top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_loss
top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_ntp_loss
top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_myopic_loss
top_transformer-top.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_top_loss
transformer-vanilla.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_loss
transformer-vanilla.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_ntp_loss
transformer-vanilla.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_myopic_loss
transformer-vanilla.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_top_loss
transformer-vanilla.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_loss
transformer-vanilla.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_ntp_loss
transformer-vanilla.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_myopic_loss
transformer-vanilla.code.7B.batch8.seqlen4096.context4096.warmup400.update2.steps40000.lr2e-5.cosine loss_metrics/global_avg_top_loss
mtp_transformer-mtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_loss
mtp_transformer-mtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_ntp_loss
mtp_transformer-mtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_myopic_loss
mtp_transformer-mtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_top_loss
mtp_transformer-mtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_loss
mtp_transformer-mtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_ntp_loss
mtp_transformer-mtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_myopic_loss
mtp_transformer-mtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_top_loss
mtp_transformer-mtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_loss
mtp_transformer-mtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_ntp_loss
mtp_transformer-mtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_myopic_loss
mtp_transformer-mtp.7B.batch8.seqlen4096.context4096.warmup2000.update2.steps200000.lr1.2e-4.cosine loss_metrics/global_avg_top_loss