Skip to main content
zhehuaic
Projects
canary-v0_speechllm
Reports
AMP O2

AMP O2

Zhehuai Chen
Created on September 21|Last edited on September 23

Section 1


50k100k150k200k250ktrainer/global_step4567
prompt_amp_flash_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs512_mbs16_ep200
prompt_amp_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs512_mbs16_ep200
prompt_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs2048_mbs16_ep200
50k100k150k200k250ktrainer/global_step6065707580
prompt_amp_flash_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs512_mbs16_ep200
prompt_amp_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs512_mbs16_ep200
prompt_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs2048_mbs16_ep200
50k100k150k200k250ktrainer/global_step60657075808590
prompt_amp_flash_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs512_mbs16_ep200
prompt_amp_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs512_mbs16_ep200
prompt_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs2048_mbs16_ep200
50k100k150k200k250ktrainer/global_step6570758085
prompt_amp_flash_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs512_mbs16_ep200
prompt_amp_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs512_mbs16_ep200
prompt_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs2048_mbs16_ep200
50k100k150k200k250ktrainer/global_step25303540
prompt_amp_flash_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs512_mbs16_ep200
prompt_amp_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs512_mbs16_ep200
prompt_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs2048_mbs16_ep200
50k100k150k200k250ktrainer/global_step262830323436
prompt_amp_flash_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs512_mbs16_ep200
prompt_amp_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs512_mbs16_ep200
prompt_lhmerge5_p2g_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs2048_mbs16_ep200
Run set
464



Run set
464


Created with ❤️ on Weights & Biases.

https://wandb.ai/zhehuaic/canary-v0_speechllm/reports/AMP-O2--Vmlldzo5NDQxNTgy
Made with Weights & Biases. Sign up or log in to create reports like this one.