Timing/startup_time (24/01/12 13:07:04)

Created on January 12|Last edited on January 12
Comment
﻿
﻿
Timing/startup_time
Timing/startup_time
dist_info/machine: Aurora, world_size: 1200, num_params: 302106624, samples_per_iter: 1200, config.data.dataset: shakespeare_char, config.model.batch_size: 4, config.train.backend: DDPdist_info/machine: Aurora, world_size: 900, num_params: 707965440, samples_per_iter: 900, config.data.dataset: shakespeare_char, config.model.batch_size: 1, config.train.backend: DDPdist_info/machine: Aurora, world_size: 900, num_params: 707965440, samples_per_iter: 900, config.data.dataset: shakespeare_char, config.model.batch_size: 4, config.train.backend: DDPdist_info/machine: Aurora, world_size: 900, num_params: 302106624, samples_per_iter: 900, config.data.dataset: shakespeare_char, config.model.batch_size: 4, config.train.backend: DDPdist_info/machine: Aurora, world_size: 900, num_params: 10646784, samples_per_iter: 900, config.data.dataset: shakespeare_char, config.model.batch_size: 64, config.train.backend: DDPdist_info/machine: Aurora, world_size: 600, num_params: 302106624, samples_per_iter: 600, config.data.dataset: shakespeare_char, config.model.batch_size: 4, config.train.backend: DDPdist_info/machine: Aurora, world_size: 600, num_params: 10646784, samples_per_iter: 600, config.data.dataset: shakespeare_char, config.model.batch_size: 64, config.train.backend: DDPdist_info/machine: Aurora, world_size: 48, num_params: 10646784, samples_per_iter: 48, config.data.dataset: shakespeare_char, config.model.batch_size: 64, config.train.backend: DDPdist_info/machine: Polaris, world_size: 8, num_params: 707965440, samples_per_iter: 8, config.data.dataset: shakespeare_char, config.model.batch_size: 4, config.train.backend: DDPdist_info/machine: Polaris, world_size: 8, num_params: 302106624, samples_per_iter: 8, config.data.dataset: shakespeare_char, config.model.batch_size: 4, config.train.backend: DDP020406080100120140
Run set35
﻿
﻿
Add a comment