homebrewnlp

Clashluke's group workspace

Group: correct-decay

2021

587

4853

4888

1-4

of 4

Timestamps visible

2022-12-30 09:08:17

[ 15669/262144] Loss: 0.853 - Accuracy: 0.740 | LearningRate: 0.00896 | StepTime: 49.829325s - Rate: 471,960.1 Tokens/s

2022-12-30 09:09:07

[ 15673/262144] Loss: 0.865 - Accuracy: 0.736 | LearningRate: 0.00896 | StepTime: 49.798651s - Rate: 471,406.0 Tokens/s

2022-12-30 09:09:57

[ 15677/262144] Loss: 0.854 - Accuracy: 0.740 | LearningRate: 0.00896 | StepTime: 49.829795s - Rate: 470,853.0 Tokens/s

2022-12-30 09:10:45

[ 15681/262144] Loss: 0.861 - Accuracy: 0.737 | LearningRate: 0.00896 | StepTime: 49.823004s - Rate: 470,301.8 Tokens/s

2022-12-30 09:11:35

[ 15685/262144] Loss: 0.866 - Accuracy: 0.736 | LearningRate: 0.00896 | StepTime: 49.824798s - Rate: 469,752.1 Tokens/s

2022-12-30 09:12:25

[ 15689/262144] Loss: 0.869 - Accuracy: 0.735 | LearningRate: 0.00896 | StepTime: 49.813758s - Rate: 469,204.2 Tokens/s

2022-12-30 09:13:15

[ 15693/262144] Loss: 0.864 - Accuracy: 0.737 | LearningRate: 0.00896 | StepTime: 49.822765s - Rate: 468,657.7 Tokens/s

2022-12-30 09:14:05

[ 15697/262144] Loss: 0.854 - Accuracy: 0.740 | LearningRate: 0.00896 | StepTime: 49.825428s - Rate: 468,112.7 Tokens/s

2022-12-30 09:14:05

2022-12-30 09:14:04.229328 Saving structure to gs://homebrewnlp-eu/homebrewnlp-checkpoint-correct-decay_____TEMPORARY/structure.json

2022-12-30 09:14:05

2022-12-30 09:14:04.536103 Uploading 96 objects to gs://homebrewnlp-eu/homebrewnlp-checkpoint-correct-decay_____TEMPORARY/0/0/parameters.npz

2022-12-30 09:14:13

2022-12-30 09:14:11.288307 Uploading 24 objects to gs://homebrewnlp-eu/homebrewnlp-checkpoint-correct-decay_____TEMPORARY/0/0/variance.npz

2022-12-30 09:14:13

2022-12-30 09:14:11.578364 Uploading 96 objects to gs://homebrewnlp-eu/homebrewnlp-checkpoint-correct-decay_____TEMPORARY/0/1/parameters.npz