Skip to main content
carperai
Projects
trlx
Reports
Memory occupy with multi GPUs Training #548

Memory occupy with multi GPUs Training #548

Sorry
Created on August 28|Last edited on August 28

Section 1


100150200250300Time (seconds)7e+98e+99e+91e+101.1e+101.2e+101.3e+10
test_saving_t5/flan-t5-large/8gpus:main
test_saving_t5/flan-t5-large/1gpu:main
Run set
2


Created with ❤️ on Weights & Biases.

https://wandb.ai/carperai/trlx/reports/Memory-occupy-with-multi-GPUs-Training-548---Vmlldzo1MjUzMjMy
Made with Weights & Biases. Sign up or log in to create reports like this one.