How can I use multi gpu when using sweep?
sweep
Created on August 4|Last edited on August 4
Comment
Hi, I am wandb user.
Before I ask you a question, I am not good at English, so please understand.
Our team has 4 gpu resources and to improve the accuracy of the model, we are going to use the sweep function of the windb.
So I read the description of sweep in the official document and used it.
When I used sweep, the sweep id was created. The sweep id was assigned to use my gpu.
Here's the question.
As mentioned above, we have four gpu.(server or local)
We would like to use several gpu for sweep experiments in the same setting.
How to used that?
I tried using tutorial, but I couldn't find a way to use divided gpu as one sweep id.
I'd appreciate it if you could tell me how. Below is a simple picture.
p.s. I use pytorch
Add a comment