dal-nlp

Assenmacher-mat's group workspace

Group: roberta_coreset_fnc1

793

803

1-5

of 5

Timestamps visible

2023-01-21 15:36:57

> Evaluation.

2023-01-21 15:36:57

[2023-01-21 16:36:56,802][root][INFO] - Evaluation with 4998 sample

2023-01-21 15:36:57

Testing: [ 0/63] eta: 0:00:35 loss: 0.8498 (0.8498) batch_acc: 70.0000 (70.0000) batch_f1: 0.2745 (0.2745) batch_acc_balanced: 0.3333 (0.3333) time: 0.5601 data: 0.0287 max mem: 15960

2023-01-21 15:37:11

Testing: [25/63] eta: 0:00:21 loss: 0.8600 (0.8506) batch_acc: 72.5000 (73.6538) batch_f1: 0.2122 (0.2312) batch_acc_balanced: 0.2500 (0.2724) time: 0.5612 data: 0.0304 max mem: 15960

2023-01-21 15:37:25

Testing: [50/63] eta: 0:00:07 loss: 0.8235 (0.8419) batch_acc: 73.7500 (73.8480) batch_f1: 0.2122 (0.2333) batch_acc_balanced: 0.2500 (0.2745) time: 0.5590 data: 0.0287 max mem: 15960

2023-01-21 15:37:33

Testing: Total time: 0:00:35

2023-01-21 15:37:33

Epoch [4]: Test Loss: 0.8401, Test Accuracy: 74.0096

2023-01-21 15:37:33

--------------------------------------------------------------------------------

2023-01-21 15:37:33

[2023-01-21 16:37:31,810][root][INFO] - Evaluation took 0.58 minutes

2023-01-21 15:37:33

[2023-01-21 16:37:31,811][root][INFO] - Evaluation stats: {'test_loss_epoch': 0.8401243298772781, 'test_batch_acc_epoch': 74.00960383237768, 'test_batch_f1_epoch': 0.2342548084833932, 'test_batch_acc_balanced_epoch': 0.275343470721622}

2023-01-21 15:37:33

[2023-01-21 16:37:31,812][root][INFO] - Saving checkpoint for cycle 15

2023-01-21 15:37:37

[2023-01-21 16:37:35,654][root][INFO] - Saving results to /mnt/work/lrauch/glae-results/fnc1/roberta/coreset/N_INIT100__ACQ_SIZE100__N_ACQ15/seed5/results.json

2023-01-21 15:37:37

Saving results to /mnt/work/lrauch/glae-results/fnc1/roberta/coreset/N_INIT100__ACQ_SIZE100__N_ACQ15/seed5/results.json.

2023-01-21 15:37:37

[2023-01-21 16:37:36,015][root][INFO] - Experiment took 57.66 minutes