dal-nlp

Assenmacher-mat's group workspace

Group: distilbert_random_fnc1

785

773

775

1-5

of 5

Timestamps visible

2023-01-19 03:07:13

> Evaluation.

2023-01-19 03:07:13

[2023-01-19 04:07:12,169][root][INFO] - Evaluation with 4998 sample

2023-01-19 03:07:13

Testing: [ 0/63] eta: 0:00:19 loss: 0.6527 (0.6527) batch_acc: 76.2500 (76.2500) batch_f1: 0.5274 (0.5274) batch_acc_balanced: 0.5004 (0.5004) time: 0.3022 data: 0.0332 max mem: 7948

2023-01-19 03:07:21

Testing: [25/63] eta: 0:00:11 loss: 0.6186 (0.6304) batch_acc: 78.7500 (78.2692) batch_f1: 0.4264 (0.4320) batch_acc_balanced: 0.4135 (0.4281) time: 0.2977 data: 0.0302 max mem: 7948

2023-01-19 03:07:29

Testing: [50/63] eta: 0:00:03 loss: 0.5697 (0.6108) batch_acc: 78.7500 (78.4804) batch_f1: 0.4003 (0.4294) batch_acc_balanced: 0.4046 (0.4266) time: 0.2980 data: 0.0304 max mem: 7948

2023-01-19 03:07:31

Testing: Total time: 0:00:18

2023-01-19 03:07:31

Epoch [4]: Test Loss: 0.6110, Test Accuracy: 78.6915

2023-01-19 03:07:31

--------------------------------------------------------------------------------

2023-01-19 03:07:31

[2023-01-19 04:07:30,791][root][INFO] - Evaluation took 0.31 minutes

2023-01-19 03:07:31

[2023-01-19 04:07:30,792][root][INFO] - Evaluation stats: {'test_loss_epoch': 0.6110354198349847, 'test_batch_acc_epoch': 78.69147658453029, 'test_batch_f1_epoch': 0.4364413348559735, 'test_batch_acc_balanced_epoch': 0.4342233213741319}

2023-01-19 03:07:31

[2023-01-19 04:07:30,793][root][INFO] - Saving checkpoint for cycle 15

2023-01-19 03:07:35

[2023-01-19 04:07:33,265][root][INFO] - Saving results to /mnt/work/lrauch/glae-results/fnc1/distilbert/random/N_INIT100__ACQ_SIZE100__N_ACQ15/seed5/results.json

2023-01-19 03:07:35

Saving results to /mnt/work/lrauch/glae-results/fnc1/distilbert/random/N_INIT100__ACQ_SIZE100__N_ACQ15/seed5/results.json.

2023-01-19 03:07:35

[2023-01-19 04:07:33,727][root][INFO] - Experiment took 20.10 minutes