dal-nlp

Assenmacher-mat's group workspace

Group: distilbert_badge_fnc1

806

788

806

790

1-5

of 5

Timestamps visible

2023-01-22 11:22:28

> Evaluation.

2023-01-22 11:22:28

[2023-01-22 12:22:26,307][root][INFO] - Evaluation with 4998 sample

2023-01-22 11:22:28

Testing: [ 0/63] eta: 0:00:18 loss: 0.4672 (0.4672) batch_acc: 85.0000 (85.0000) batch_f1: 0.6343 (0.6343) batch_acc_balanced: 0.6649 (0.6649) time: 0.2968 data: 0.0284 max mem: 12288

2023-01-22 11:22:36

Testing: [25/63] eta: 0:00:11 loss: 0.2827 (0.3106) batch_acc: 90.0000 (90.3846) batch_f1: 0.6174 (0.6318) batch_acc_balanced: 0.6218 (0.6426) time: 0.2954 data: 0.0281 max mem: 12288

2023-01-22 11:22:42

Testing: [50/63] eta: 0:00:03 loss: 0.2699 (0.2949) batch_acc: 90.0000 (90.5147) batch_f1: 0.5758 (0.6270) batch_acc_balanced: 0.6001 (0.6426) time: 0.2953 data: 0.0279 max mem: 12288

2023-01-22 11:22:46

Testing: Total time: 0:00:18

2023-01-22 11:22:46

Epoch [4]: Test Loss: 0.2962, Test Accuracy: 90.3161

2023-01-22 11:22:46

--------------------------------------------------------------------------------

2023-01-22 11:22:46

[2023-01-22 12:22:44,769][root][INFO] - Evaluation took 0.31 minutes

2023-01-22 11:22:46

[2023-01-22 12:22:44,769][root][INFO] - Evaluation stats: {'test_loss_epoch': 0.29619065743117107, 'test_batch_acc_epoch': 90.31612644752725, 'test_batch_f1_epoch': 0.6271133951444358, 'test_batch_acc_balanced_epoch': 0.6427357074811361}

2023-01-22 11:22:46

[2023-01-22 12:22:44,770][root][INFO] - Saving checkpoint for cycle 15

2023-01-22 11:22:48

[2023-01-22 12:22:46,831][root][INFO] - Saving results to /mnt/work/lrauch/glae-results/fnc1/distilbert/badge/N_INIT100__ACQ_SIZE100__N_ACQ15/seed5/results.json

2023-01-22 11:22:48

Saving results to /mnt/work/lrauch/glae-results/fnc1/distilbert/badge/N_INIT100__ACQ_SIZE100__N_ACQ15/seed5/results.json.

2023-01-22 11:22:48

[2023-01-22 12:22:47,204][root][INFO] - Experiment took 30.01 minutes