nemo-43b-sft-dolly-16nodes-steps312

Created on July 20|Last edited on July 20

Comment

Conclusion: Due to time limit, no final NeMo checkpoint saved!
Section 1﻿
global_step
global_step
0102030405060Step50100150200250300
grad_norm
grad_norm
0102030405060Step3456789
lr
lr
0102030405060Step0.0000020.0000040.0000060.000008
reduced_train_loss
reduced_train_loss
0102030405060Step0.60.811.21.41.61.8
train_backward_timing
train_backward_timing
0102030405060Step0.0000450.000050.0000550.00006
epoch
epoch
0102030405060Step-2-1012
Run: nemo-43b-sft-dolly-16nodes-312steps1
﻿
﻿
﻿
Run: nemo-43b-sft-dolly-16nodes-312steps1
﻿
﻿
﻿
Run: nemo-43b-sft-dolly-16nodes-312steps1
﻿
﻿

Add a comment