dal-nlp

Assenmacher-mat's group workspace

Group: distilbert_coreset_fnc1

803

1-5

of 5

Timestamps visible

2023-01-21 10:07:31

> Evaluation.

2023-01-21 10:07:31

[2023-01-21 11:07:31,266][root][INFO] - Evaluation with 4998 sample

2023-01-21 10:07:33

Testing: [ 0/63] eta: 0:00:18 loss: 0.8797 (0.8797) batch_acc: 62.5000 (62.5000) batch_f1: 0.4254 (0.4254) batch_acc_balanced: 0.4212 (0.4212) time: 0.2910 data: 0.0295 max mem: 12288

2023-01-21 10:07:39

Testing: [25/63] eta: 0:00:10 loss: 0.8309 (0.8226) batch_acc: 63.7500 (64.2308) batch_f1: 0.3694 (0.3737) batch_acc_balanced: 0.3703 (0.3877) time: 0.2893 data: 0.0288 max mem: 12288

2023-01-21 10:07:47

Testing: [50/63] eta: 0:00:03 loss: 0.7407 (0.7967) batch_acc: 66.2500 (65.5392) batch_f1: 0.3919 (0.3909) batch_acc_balanced: 0.4045 (0.4052) time: 0.2892 data: 0.0285 max mem: 12288

2023-01-21 10:07:49

Testing: Total time: 0:00:18

2023-01-21 10:07:49

Epoch [4]: Test Loss: 0.7903, Test Accuracy: 65.7663

2023-01-21 10:07:49

--------------------------------------------------------------------------------

2023-01-21 10:07:49

[2023-01-21 11:07:49,353][root][INFO] - Evaluation took 0.30 minutes

2023-01-21 10:07:49

[2023-01-21 11:07:49,353][root][INFO] - Evaluation stats: {'test_loss_epoch': 0.7903474597703843, 'test_batch_acc_epoch': 65.76630651039713, 'test_batch_f1_epoch': 0.39646976048252647, 'test_batch_acc_balanced_epoch': 0.41181291051581065}

2023-01-21 10:07:51

[2023-01-21 11:07:49,354][root][INFO] - Saving checkpoint for cycle 15

2023-01-21 10:07:55

[2023-01-21 11:07:53,493][root][INFO] - Saving results to /mnt/work/lrauch/glae-results/fnc1/distilbert/coreset/N_INIT100__ACQ_SIZE100__N_ACQ15/seed5/results.json

2023-01-21 10:07:55

Saving results to /mnt/work/lrauch/glae-results/fnc1/distilbert/coreset/N_INIT100__ACQ_SIZE100__N_ACQ15/seed5/results.json.

2023-01-21 10:07:55

[2023-01-21 11:07:54,181][root][INFO] - Experiment took 31.10 minutes