Skip to main content
zaydzuhri
Projects
fla
Workspace
Overview
Workspace
Runs
Automat.
Sweeps
Reports
Artifacts

Zaydzuhri's workspace

20k40k60k80k100kStep345678910
mtp_transformer-mtp.340M.batch16.seqlen4096.context4096.warmup1000.update1.steps100000.lr3e-4.cosine loss_metrics/global_avg_loss
mtp_transformer-mtp.340M.batch16.seqlen4096.context4096.warmup1000.update1.steps100000.lr3e-4.cosine loss_metrics/global_avg_ntp_loss
mtp_transformer-mtp.340M.batch16.seqlen4096.context4096.warmup1000.update1.steps100000.lr3e-4.cosine loss_metrics/global_avg_myopic_loss
mtp_transformer-mtp.340M.batch16.seqlen4096.context4096.warmup1000.update1.steps100000.lr3e-4.cosine loss_metrics/global_avg_top_loss
-myopic.340M.batch8.seqlen4096.context4096.warmup1000.update2.steps100000.lr3e-4.cosine loss_metrics/global_avg_loss
-myopic.340M.batch8.seqlen4096.context4096.warmup1000.update2.steps100000.lr3e-4.cosine loss_metrics/global_avg_ntp_loss
-myopic.340M.batch8.seqlen4096.context4096.warmup1000.update2.steps100000.lr3e-4.cosine loss_metrics/global_avg_myopic_loss
-myopic.340M.batch8.seqlen4096.context4096.warmup1000.update2.steps100000.lr3e-4.cosine loss_metrics/global_avg_top_loss
-vanilla.340M.batch16.seqlen4096.context4096.warmup1000.update1.steps100000.lr3e-4.cosine loss_metrics/global_avg_loss
-vanilla.340M.batch16.seqlen4096.context4096.warmup1000.update1.steps100000.lr3e-4.cosine loss_metrics/global_avg_ntp_loss
-vanilla.340M.batch16.seqlen4096.context4096.warmup1000.update1.steps100000.lr3e-4.cosine loss_metrics/global_avg_myopic_loss
-vanilla.340M.batch16.seqlen4096.context4096.warmup1000.update1.steps100000.lr3e-4.cosine loss_metrics/global_avg_top_loss