apiche

Apiche's group workspace

Group: debug_gspo12

15430

5736

100864

1-3

of 3

Timestamps visible

2025-09-28 02:40:11

[finetune]: 09/28/2025 02:40:11.663 - INFO - pipelinerl.finetune_loop - Start step at 1759027211.6630638

2025-09-28 02:40:11

[finetune]: 09/28/2025 02:40:11.763 - INFO - pipelinerl.finetune_loop - Batch queue is empty, retrying with timeout 0.1

2025-09-28 02:40:11

[finetune]: 09/28/2025 02:40:11.914 - INFO - pipelinerl.finetune_loop - Batch queue is empty, retrying with timeout 0.15000000000000002

2025-09-28 02:40:12

[finetune]: 09/28/2025 02:40:12.139 - INFO - pipelinerl.finetune_loop - Batch queue is empty, retrying with timeout 0.22500000000000003

2025-09-28 02:40:12

[finetune]: 09/28/2025 02:40:12.477 - INFO - pipelinerl.finetune_loop - Batch queue is empty, retrying with timeout 0.3375

2025-09-28 02:40:12

[finetune]: 09/28/2025 02:40:12.984 - INFO - pipelinerl.finetune_loop - Batch queue is empty, retrying with timeout 0.5062500000000001

2025-09-28 02:40:13

[finetune]: 09/28/2025 02:40:13.744 - INFO - pipelinerl.finetune_loop - Batch queue is empty, retrying with timeout 0.7593750000000001

2025-09-28 02:40:14

[finetune]: 09/28/2025 02:40:14.660 - INFO - pipelinerl.finetune_loop - Starting data loader for stream training_data on partition 0

2025-09-28 02:40:14

[finetune]: 09/28/2025 02:40:14.883 - INFO - pipelinerl.finetune_loop - Batch queue is empty, retrying with timeout 1.1390625

2025-09-28 02:40:16

[finetune]: 09/28/2025 02:40:16.593 - INFO - pipelinerl.finetune_loop - Batch queue is empty, retrying with timeout 1.7085937500000001

2025-09-28 02:40:19

[finetune]: 09/28/2025 02:40:19.156 - INFO - pipelinerl.finetune_loop - Batch queue is empty, retrying with timeout 2.562890625

2025-09-28 02:40:23

[finetune]: 09/28/2025 02:40:23.001 - INFO - pipelinerl.finetune_loop - Batch queue is empty, retrying with timeout 3.8443359375000004