dal-nlp

Assenmacher-mat's group workspace

Group: bert_coreset_fnc1_2560

3469

3397

3622

3829

3917

1-5

of 5

Timestamps visible

2023-02-03 19:23:55

[2023-02-03 20:23:54,252][root][INFO] - Evaluation with 4998 sample

2023-02-03 19:23:55

Testing: [ 0/63] eta: 0:00:47 loss: 0.3284 (0.3284) batch_acc: 86.2500 (86.2500) batch_f1: 0.6817 (0.6817) batch_acc_balanced: 0.6852 (0.6852) time: 0.7500 data: 0.0221 max mem: 15583

2023-02-03 19:24:15

Testing: [25/63] eta: 0:00:28 loss: 0.2750 (0.2817) batch_acc: 90.0000 (90.2885) batch_f1: 0.5846 (0.6142) batch_acc_balanced: 0.5908 (0.6250) time: 0.7501 data: 0.0215 max mem: 15583

2023-02-03 19:24:33

Testing: [50/63] eta: 0:00:09 loss: 0.2418 (0.2692) batch_acc: 92.5000 (90.9559) batch_f1: 0.6029 (0.6273) batch_acc_balanced: 0.6360 (0.6448) time: 0.7491 data: 0.0209 max mem: 15583

2023-02-03 19:24:41

/mnt/stud/home/mwirth/.conda/envs/uncertainty_evaluation/lib/python3.9/site-packages/sklearn/metrics/_classification.py:1999: UserWarning: y_pred contains classes not in y_true

2023-02-03 19:24:41

Testing: Total time: 0:00:46

2023-02-03 19:24:41

Epoch [4]: Test Loss: 0.2648, Test Accuracy: 91.2565

2023-02-03 19:24:41

--------------------------------------------------------------------------------

2023-02-03 19:24:41

[2023-02-03 20:24:41,095][root][INFO] - Evaluation took 0.78 minutes

2023-02-03 19:24:41

[2023-02-03 20:24:41,095][root][INFO] - Evaluation stats: {'test_loss_epoch': 0.264834311982942, 'test_batch_acc_epoch': 91.25650259798743, 'test_batch_f1_epoch': 0.6379667749514117, 'test_batch_acc_balanced_epoch': 0.6579292241316556}

2023-02-03 19:24:41

[2023-02-03 20:24:41,096][root][INFO] - Saving checkpoint for cycle 60

2023-02-03 19:24:48

[2023-02-03 20:24:45,734][root][INFO] - Saving results to /mnt/work/glae/glae-results/fnc1/bert/coreset/N_INIT100__ACQ_SIZE20__N_ACQ60/seed5/results.json

2023-02-03 19:24:48

Saving results to /mnt/work/glae/glae-results/fnc1/bert/coreset/N_INIT100__ACQ_SIZE20__N_ACQ60/seed5/results.json.

2023-02-03 19:24:48

[2023-02-03 20:24:47,102][root][INFO] - Experiment took 261.45 minutes