Skip to main content
eleutherai
Projects
neox
Run groups
K3ZsCJD4ynEa5rxJF75NcygEVFMJLKVRSTW4JQPsJa56
Logs
Overview
Workspace
Runs
Logs
Files
Artifacts

Chilli's group workspace

Timestamps visible
2021-04-27 18:13:51
[2021-04-27 18:13:49,254] [INFO] [logging.py:60:log_dist] [Rank 0] rank=0 time (ms) | forward: 7175.37 | backward: 23796.00 | backward_inner: 23794.10 | backward_allreduce: 0.27 | step: 45360.16
2021-04-27 18:13:51
steps: 30 loss: 10.4437 iter time (s): 10.517 samples/sec: 9.128
2021-04-27 18:13:51
[2021-04-27 18:13:49,263] [INFO] [logging.py:60:log_dist] [Rank 0] rank=0 time (ms)
2021-04-27 18:15:36
[2021-04-27 18:15:29,793] [INFO] [logging.py:60:log_dist] [Rank 0] step=40, skipped=17, lr=[1.796875e-06], mom=[[0.9, 0.999]]
2021-04-27 18:15:36
[2021-04-27 18:15:34,098] [INFO] [logging.py:60:log_dist] [Rank 0] rank=0 time (ms) | batch_input: 279.19 | forward_microstep: 7158.08 | backward_microstep: 23767.37 | backward_inner_microstep: 23765.85 | backward_allreduce_microstep: 0.64 | step_microstep: 44830.51
2021-04-27 18:15:36
[2021-04-27 18:15:34,104] [INFO] [logging.py:60:log_dist] [Rank 0] rank=0 time (ms) | forward: 7157.63 | backward: 23767.04 | backward_inner: 23765.46 | backward_allreduce: 0.23 | step: 44830.62
2021-04-27 18:15:36
steps: 40 loss: 10.0771 iter time (s): 10.481 samples/sec: 9.159
2021-04-27 18:15:36
[2021-04-27 18:15:34,107] [INFO] [logging.py:60:log_dist] [Rank 0] rank=0 time (ms)
2021-04-27 18:17:19
[2021-04-27 18:17:14,751] [INFO] [logging.py:60:log_dist] [Rank 0] step=50, skipped=17, lr=[2.578125e-06], mom=[[0.9, 0.999]]
2021-04-27 18:17:21
[2021-04-27 18:17:19,136] [INFO] [logging.py:60:log_dist] [Rank 0] rank=0 time (ms) | batch_input: 210.23 | forward_microstep: 7167.33 | backward_microstep: 23727.74 | backward_inner_microstep: 23726.17 | backward_allreduce_microstep: 0.67 | step_microstep: 45260.32
2021-04-27 18:17:21
[2021-04-27 18:17:19,137] [INFO] [logging.py:60:log_dist] [Rank 0] rank=0 time (ms) | forward: 7166.84 | backward: 23727.41 | backward_inner: 23725.77 | backward_allreduce: 0.24 | step: 45260.41
2021-04-27 18:17:21
steps: 50 loss: 9.8853 iter time (s): 10.498 samples/sec: 9.144
2021-04-27 18:17:21
[2021-04-27 18:17:19,144] [INFO] [logging.py:60:log_dist] [Rank 0] rank=0 time (ms)