dal-nlp

Assenmacher-mat's group workspace

Group: distilbert_random_fnc1_2560

2937

2933

1-5

of 5

Timestamps visible

2023-02-07 02:48:40

> Evaluation.

2023-02-07 02:48:40

[2023-02-07 03:48:38,066][root][INFO] - Evaluation with 4998 sample

2023-02-07 02:48:40

Testing: [ 0/63] eta: 0:00:24 loss: 0.5984 (0.5984) batch_acc: 82.5000 (82.5000) batch_f1: 0.6170 (0.6170) batch_acc_balanced: 0.6120 (0.6120) time: 0.3932 data: 0.0217 max mem: 7948

2023-02-07 02:48:50

Testing: [25/63] eta: 0:00:14 loss: 0.5145 (0.5024) batch_acc: 85.0000 (85.1442) batch_f1: 0.5320 (0.5540) batch_acc_balanced: 0.5053 (0.5381) time: 0.3917 data: 0.0212 max mem: 7948

2023-02-07 02:48:58

Testing: [50/63] eta: 0:00:05 loss: 0.4249 (0.4783) batch_acc: 85.0000 (85.3676) batch_f1: 0.5311 (0.5534) batch_acc_balanced: 0.5255 (0.5415) time: 0.3916 data: 0.0210 max mem: 7948

2023-02-07 02:49:04

Testing: Total time: 0:00:24

2023-02-07 02:49:04

Epoch [4]: Test Loss: 0.4767, Test Accuracy: 85.4742

2023-02-07 02:49:04

--------------------------------------------------------------------------------

2023-02-07 02:49:04

[2023-02-07 03:49:02,557][root][INFO] - Evaluation took 0.41 minutes

2023-02-07 02:49:04

[2023-02-07 03:49:02,558][root][INFO] - Evaluation stats: {'test_loss_epoch': 0.47670714982918333, 'test_batch_acc_epoch': 85.47418969113524, 'test_batch_f1_epoch': 0.555492573140741, 'test_batch_acc_balanced_epoch': 0.5416639560086054}

2023-02-07 02:49:04

[2023-02-07 03:49:02,559][root][INFO] - Saving checkpoint for cycle 60

2023-02-07 02:49:08

[2023-02-07 03:49:05,955][root][INFO] - Saving results to /mnt/work/glae/glae-results/fnc1/distilbert/random/N_INIT100__ACQ_SIZE25__N_ACQ60/seed5/results.json

2023-02-07 02:49:08

Saving results to /mnt/work/glae/glae-results/fnc1/distilbert/random/N_INIT100__ACQ_SIZE25__N_ACQ60/seed5/results.json.

2023-02-07 02:49:08

[2023-02-07 03:49:07,039][root][INFO] - Experiment took 97.11 minutes