Add Accelerate SFT Trainer #280
Created on February 8|Last edited on February 8
Comment
CUDA_VISIBLE_DEVICES=0 accelerate launch --num_processes 1 --config_file ddp.yaml --mixed_precision fp16 --main_process_port 8880 examples/ppo_sentiments.py &
CUDA_VISIBLE_DEVICES=1 accelerate launch --num_processes 1 --config_file ddp.yaml --mixed_precision fp16 --main_process_port 8881 examples/sft_sentiments.py &
CUDA_VISIBLE_DEVICES=2 accelerate launch --num_processes 1 --config_file ddp.yaml --mixed_precision fp16 --main_process_port 8882 examples/ilql_sentiments.py &
CUDA_VISIBLE_DEVICES=3 python examples/randomwalks/ilql_randomwalks.py &
CUDA_VISIBLE_DEVICES=4 python examples/randomwalks/ppo_randomwalks.py &
CUDA_VISIBLE_DEVICES=5 accelerate launch --num_processes 1 --config_file ddp.yaml --mixed_precision fp16 --main_process_port 8885 examples/simulacra.py &
CUDA_VISIBLE_DEVICES=6 python examples/summarize_daily_cnn/t5_summarize_daily_cnn.py &
CUDA_VISIBLE_DEVICES=7 python examples/architext.py &
Section 1
Run set
8
Run set
8
Run set
8
Run set
8
Run set
8
Run set
8
Run set
8
Run set
8
Run set
8
Run set
8
Run set
8
Run set
8
Run set
8
Run set
8
Run set
8
Run set
8
Add a comment