Tulu3 8B SFT

[['?we=ai2-llm&wpn=open_instruct_public&xaxis=_step&ceik=chat_template_name&cen=chat_template_name&metrics=train_loss&metrics=learning_rate&metric_names=Training Loss&metric_names=Learning Rate', 'tulu?tag=no-tag-743-g52acdce&tag=tulu3_8b_sft&cl=Tulu3 8B SFT']]

Costa Huang

Created on March 24|Last edited on March 24

Comment

﻿
﻿
train_loss Tulu3 8B SFT
train_loss Tulu3 8B SFT
2k4k6k8k10k12k14kSteps150200250300350400train_loss
learning_rate Tulu3 8B SFT
learning_rate Tulu3 8B SFT
2k4k6k8k10k12k14kSteps0.0000010.0000020.0000030.000004learning_rate
Tulu3 8B SFT1
﻿
﻿

Add a comment