homebrewnlp

Clashluke's group workspace

Group: rnn-longctx-10xLR

198

1-1

of 1

Timestamps visible

2023-05-17 14:20:43

Parameters: 470,000,640

2023-05-17 14:20:43

Buffers: 940,001,280

2023-05-17 14:25:28

[ 2/65536] Loss: 5.677 - Accuracy: 0.002 | LearningRate: 0.00000 | StepTime: 285.438578s - Rate: 11,020.6 Tokens/s

2023-05-17 14:29:22

[ 3/65536] Loss: 5.638 - Accuracy: 0.003 | LearningRate: 0.00000 | StepTime: 233.530557s - Rate: 8,078.6 Tokens/s

2023-05-17 14:33:16

[ 4/65536] Loss: 5.515 - Accuracy: 0.003 | LearningRate: 0.00000 | StepTime: 233.511436s - Rate: 6,965.1 Tokens/s

2023-05-17 14:37:08

[ 5/65536] Loss: 5.257 - Accuracy: 0.172 | LearningRate: 0.00000 | StepTime: 233.492488s - Rate: 6,379.1 Tokens/s

2023-05-17 14:41:03

[ 6/65536] Loss: 4.984 - Accuracy: 0.163 | LearningRate: 0.00001 | StepTime: 233.512043s - Rate: 6,017.4 Tokens/s

2023-05-17 14:44:57

[ 7/65536] Loss: 4.664 - Accuracy: 0.169 | LearningRate: 0.00001 | StepTime: 233.531253s - Rate: 5,771.8 Tokens/s

2023-05-17 14:48:49

[ 8/65536] Loss: 4.470 - Accuracy: 0.162 | LearningRate: 0.00001 | StepTime: 233.539276s - Rate: 5,594.2 Tokens/s

2023-05-17 14:52:44

[ 9/65536] Loss: 4.353 - Accuracy: 0.161 | LearningRate: 0.00001 | StepTime: 233.513489s - Rate: 5,459.9 Tokens/s

2023-05-17 14:56:36

[ 10/65536] Loss: 4.216 - Accuracy: 0.162 | LearningRate: 0.00001 | StepTime: 233.510134s - Rate: 5,354.7 Tokens/s

2023-05-17 15:00:30

[ 11/65536] Loss: 4.142 - Accuracy: 0.166 | LearningRate: 0.00001 | StepTime: 233.531148s - Rate: 5,270.1 Tokens/s