Skip to main content
patrickvonplaten
Projects
huggingface
Reports
Wav2Vec2 - DistributedDataParallel (DDP) - 8 GPU V100 - FP32

Wav2Vec2 - DistributedDataParallel (DDP) - 8 GPU V100 - FP32

num_gpu: 8; batch_size per GPU: 2; no gradient checkpointing; gradient accumulation 2; no group length; fp16 false
Patrick von Platen
Created on September 21|Last edited on September 21

Section 1


5001k1.5k2k2.5k3kStep3
5001k1.5k2k2.5k3kStep12
05001k1.5k2k2.5k3kStep5101520
Run: ./wav2vec2-large-xlsr-turkish-demo-dist
1



Created with ❤️ on Weights & Biases.

https://wandb.ai/patrickvonplaten/huggingface/reports/Wav2Vec2-DistributedDataParallel-DDP-8-GPU-V100-FP32--VmlldzoxMDQxODI2
Made with Weights & Biases. Sign up or log in to create reports like this one.