homebrewnlp

Clashluke's group workspace

Group: ctx512-batch1024-smallmodel

467

1-3

of 3

Timestamps visible

2023-05-15 19:44:38

373 | /optimizer:0//body_ctx:0/block:0/reversible:6/read:3/linear:3/conv_weight/ema:1/momentum_buffer | (8, 512, 2048) | 33,554,432

2023-05-15 19:44:38

374 | /optimizer:0//body_ctx:0/block:0/reversible:7/write:3/_output:7/scale_norm_act_linear:27/weight0/ema:0/momentum_buffer | (8, 2048, 512) | 33,554,432

2023-05-15 19:44:38

375 | /optimizer:0//body_ctx:0/block:0/reversible:7/write:3/_output:7/scale_norm_act_linear:27/weight0/ema:1/momentum_buffer | (8, 2048, 512) | 33,554,432

2023-05-15 19:44:38

376 | /optimizer:0//body_ctx:0/block:0/reversible:7/write:3/_output:7/scale_norm_act_linear:27/weight1/ema:0/momentum_buffer | (8, 2048, 512) | 33,554,432

2023-05-15 19:44:38

377 | /optimizer:0//body_ctx:0/block:0/reversible:7/write:3/_output:7/scale_norm_act_linear:27/weight1/ema:1/momentum_buffer | (8, 2048, 512) | 33,554,432

2023-05-15 19:44:38

378 | /optimizer:0//body_ctx:0/block:0/reversible:7/write:3/input_fn:7/scale_norm_act_linear:24/weight0/ema:0/momentum_buffer | (8, 512, 2048) | 33,554,432

2023-05-15 19:44:38

379 | /optimizer:0//body_ctx:0/block:0/reversible:7/write:3/input_fn:7/scale_norm_act_linear:24/weight0/ema:1/momentum_buffer | (8, 512, 2048) | 33,554,432

2023-05-15 19:44:38

380 | /optimizer:0//body_ctx:0/block:0/reversible:7/write:3/input_fn:7/scale_norm_act_linear:25/weight2/ema:0/momentum_buffer | (8, 2048, 512) | 33,554,432

2023-05-15 19:44:38

381 | /optimizer:0//body_ctx:0/block:0/reversible:7/write:3/input_fn:7/scale_norm_act_linear:25/weight2/ema:1/momentum_buffer | (8, 2048, 512) | 33,554,432

2023-05-15 19:44:38

382 | /optimizer:0//body_ctx:0/block:0/reversible:7/write:3/scale_norm_act_linear:26/weight1/ema:0/momentum_buffer | (8, 2048, 512) | 33,554,432

2023-05-15 19:44:38

383 | /optimizer:0//body_ctx:0/block:0/reversible:7/write:3/scale_norm_act_linear:26/weight1/ema:1/momentum_buffer | (8, 2048, 512) | 33,554,432

2023-05-15 19:44:38

Parameters: 419,811,328

2023-05-15 19:44:38

Buffers: 839,622,656