dal-nlp

Assenmacher-mat's group workspace

Group: roberta_coreset_fnc1_2560

3499

3498

3430

3438

3495

1-5

of 5

Timestamps visible

2023-02-04 19:50:39

> Evaluation.

2023-02-04 19:50:39

[2023-02-04 20:50:37,979][root][INFO] - Evaluation with 4998 sample

2023-02-04 19:50:39

Testing: [ 0/63] eta: 0:00:46 loss: 0.3016 (0.3016) batch_acc: 91.2500 (91.2500) batch_f1: 0.6901 (0.6901) batch_acc_balanced: 0.7083 (0.7083) time: 0.7425 data: 0.0214 max mem: 15960

2023-02-04 19:50:59

Testing: [25/63] eta: 0:00:28 loss: 0.1960 (0.2073) batch_acc: 91.2500 (92.6923) batch_f1: 0.5900 (0.6135) batch_acc_balanced: 0.5844 (0.6238) time: 0.7444 data: 0.0218 max mem: 15960

2023-02-04 19:51:17

Testing: [50/63] eta: 0:00:09 loss: 0.1688 (0.1951) batch_acc: 95.0000 (93.2843) batch_f1: 0.6288 (0.6260) batch_acc_balanced: 0.6262 (0.6313) time: 0.7430 data: 0.0212 max mem: 15960

2023-02-04 19:51:25

Testing: Total time: 0:00:46

2023-02-04 19:51:25

Epoch [4]: Test Loss: 0.1899, Test Accuracy: 93.4374

2023-02-04 19:51:25

--------------------------------------------------------------------------------

2023-02-04 19:51:25

[2023-02-04 20:51:24,468][root][INFO] - Evaluation took 0.77 minutes

2023-02-04 19:51:25

[2023-02-04 20:51:24,468][root][INFO] - Evaluation stats: {'test_loss_epoch': 0.1898678872911703, 'test_batch_acc_epoch': 93.43737492860915, 'test_batch_f1_epoch': 0.6333963425064079, 'test_batch_acc_balanced_epoch': 0.6377227728450843}

2023-02-04 19:51:25

[2023-02-04 20:51:24,470][root][INFO] - Saving checkpoint for cycle 60

2023-02-04 19:51:31

[2023-02-04 20:51:29,716][root][INFO] - Saving results to /mnt/work/glae/glae-results/fnc1/roberta/coreset/N_INIT100__ACQ_SIZE25__N_ACQ60/seed5/results.json

2023-02-04 19:51:31

Saving results to /mnt/work/glae/glae-results/fnc1/roberta/coreset/N_INIT100__ACQ_SIZE25__N_ACQ60/seed5/results.json.

2023-02-04 19:51:31

[2023-02-04 20:51:30,826][root][INFO] - Experiment took 286.80 minutes