homebrewnlp

Clashluke's group workspace

Group: one-per-step

436

434

1-2

of 2

Timestamps visible

2023-05-15 16:54:03

342 | /optimizer:0//body_ctx:0/reversible:7/write:3/_output:7/scale_norm_act_linear:27/weight0/ema:1/momentum_buffer | (8, 4096, 1024) | 134,217,728

2023-05-15 16:54:03

343 | /optimizer:0//body_ctx:0/reversible:7/write:3/_output:7/scale_norm_act_linear:27/weight1/ema:0/momentum_buffer | (8, 4096, 1024) | 134,217,728

2023-05-15 16:54:03

344 | /optimizer:0//body_ctx:0/reversible:7/write:3/_output:7/scale_norm_act_linear:27/weight1/ema:1/momentum_buffer | (8, 4096, 1024) | 134,217,728

2023-05-15 16:54:03

345 | /optimizer:0//body_ctx:0/reversible:7/write:3/input_fn:7/scale_norm_act_linear:24/weight0/ema:0/momentum_buffer | (8, 1024, 4096) | 134,217,728

2023-05-15 16:54:03

346 | /optimizer:0//body_ctx:0/reversible:7/write:3/input_fn:7/scale_norm_act_linear:24/weight0/ema:1/momentum_buffer | (8, 1024, 4096) | 134,217,728

2023-05-15 16:54:03

347 | /optimizer:0//body_ctx:0/reversible:7/write:3/input_fn:7/scale_norm_act_linear:25/weight2/ema:0/momentum_buffer | (8, 4096, 1024) | 134,217,728

2023-05-15 16:54:03

348 | /optimizer:0//body_ctx:0/reversible:7/write:3/input_fn:7/scale_norm_act_linear:25/weight2/ema:1/momentum_buffer | (8, 4096, 1024) | 134,217,728

2023-05-15 16:54:03

349 | /optimizer:0//body_ctx:0/reversible:7/write:3/scale_norm_act_linear:26/weight1/ema:0/momentum_buffer | (8, 4096, 1024) | 134,217,728

2023-05-15 16:54:03

350 | /optimizer:0//body_ctx:0/reversible:7/write:3/scale_norm_act_linear:26/weight1/ema:1/momentum_buffer | (8, 4096, 1024) | 134,217,728

2023-05-15 16:54:03

Parameters: 1,636,474,880

2023-05-15 16:54:03

Buffers: 3,272,949,760

2023-05-15 17:49:02

[ 16385/1073741824] Loss: 0.422 - Accuracy: 0.021 | LearningRate: 0.00001 | StepTime: 3299.817756s - Rate: 1,271.2 Tokens/s

2023-05-15 18:49:19

[ 32769/1073741824] Loss: 0.407 - Accuracy: 0.022 | LearningRate: 0.00001 | StepTime: 3184.520454s - Rate: 1,213.1 Tokens/s