homebrewnlp

Clashluke's group workspace

Group: embedding_gradient_shrink-shampoo_fix

1111

2360

1-2

of 2

Timestamps visible

2022-11-04 08:10:07

[ 7917/262144] Loss: 0.889 - Accuracy: 0.729 | LearningRate: 0.00946 | StepTime: 44.007657s - Rate: 291,420.9 Tokens/s

2022-11-04 08:10:51

[ 7921/262144] Loss: 0.875 - Accuracy: 0.733 | LearningRate: 0.00946 | StepTime: 44.009866s - Rate: 291,118.2 Tokens/s

2022-11-04 08:11:35

[ 7925/262144] Loss: 0.890 - Accuracy: 0.729 | LearningRate: 0.00946 | StepTime: 44.004543s - Rate: 290,816.6 Tokens/s

2022-11-04 08:05:43

[ 7893/262144] Loss: 0.879 - Accuracy: 0.732 | LearningRate: 0.00946 | StepTime: 44.050555s - Rate: 293,278.1 Tokens/s

2022-11-04 08:06:27

[ 7897/262144] Loss: 0.888 - Accuracy: 0.729 | LearningRate: 0.00946 | StepTime: 44.013077s - Rate: 292,969.7 Tokens/s

2022-11-04 08:07:11

[ 7901/262144] Loss: 0.892 - Accuracy: 0.729 | LearningRate: 0.00946 | StepTime: 44.002367s - Rate: 292,662.4 Tokens/s

2022-11-04 08:07:55

[ 7905/262144] Loss: 0.888 - Accuracy: 0.730 | LearningRate: 0.00946 | StepTime: 43.984170s - Rate: 292,356.0 Tokens/s

2022-11-04 08:08:39

[ 7909/262144] Loss: 0.893 - Accuracy: 0.728 | LearningRate: 0.00946 | StepTime: 43.996710s - Rate: 292,050.3 Tokens/s

2022-11-04 08:09:23

[ 7913/262144] Loss: 0.888 - Accuracy: 0.729 | LearningRate: 0.00946 | StepTime: 43.986036s - Rate: 291,745.9 Tokens/s

2022-11-04 08:10:07

[ 7917/262144] Loss: 0.889 - Accuracy: 0.729 | LearningRate: 0.00946 | StepTime: 44.007025s - Rate: 291,442.1 Tokens/s

2022-11-04 08:10:51

[ 7921/262144] Loss: 0.875 - Accuracy: 0.733 | LearningRate: 0.00946 | StepTime: 43.986127s - Rate: 291,139.6 Tokens/s

2022-11-04 08:11:35

[ 7925/262144] Loss: 0.890 - Accuracy: 0.729 | LearningRate: 0.00946 | StepTime: 43.998249s - Rate: 290,837.9 Tokens/s