Skip to main content
zhehuaic
Projects
canary-v0_speechllm
Reports
w/ and w/o tp

w/ and w/o tp

Zhehuai Chen
Created on August 9|Last edited on August 9

Section 1


1k2k3k4k5ktrainer/global_step11.522.533.5
prompt_lhmerge5_p2b_tp2_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs128_mbs16_ep200
prompt_lhmerge5_p2b_oci_FC-GPT_llama_tiny_canaryset_b6s4kf-sunolong_noCC_langtemp0.5_dsettemp0.5_lr1e-4wd1e-3_CosineAnnealing_warmup2500_minlr1e-6_gbs2048_mbs16_ep200
Run set
466



Run set
467


Created with ❤️ on Weights & Biases.

https://wandb.ai/zhehuaic/canary-v0_speechllm/reports/w-and-w-o-tp--Vmlldzo4OTgyODUy
Made with Weights & Biases. Sign up or log in to create reports like this one.