dal-nlp

Assenmacher-mat's group workspace

Group: roberta_coreset_fnc1_nosub

798

803

798

811

803

1-5

of 5

Timestamps visible

2023-02-03 19:11:22

> Evaluation.

2023-02-03 19:11:22

[2023-02-03 20:11:20,191][root][INFO] - Evaluation with 4998 sample

2023-02-03 19:11:22

Testing: [ 0/63] eta: 0:00:35 loss: 0.8681 (0.8681) batch_acc: 70.0000 (70.0000) batch_f1: 0.2745 (0.2745) batch_acc_balanced: 0.3333 (0.3333) time: 0.5651 data: 0.0319 max mem: 15960

2023-02-03 19:11:36

Testing: [25/63] eta: 0:00:21 loss: 0.8379 (0.8320) batch_acc: 72.5000 (73.4615) batch_f1: 0.2183 (0.2600) batch_acc_balanced: 0.2500 (0.2895) time: 0.5659 data: 0.0327 max mem: 15960

2023-02-03 19:11:50

Testing: [50/63] eta: 0:00:07 loss: 0.8082 (0.8268) batch_acc: 72.5000 (73.5784) batch_f1: 0.2183 (0.2561) batch_acc_balanced: 0.2500 (0.2873) time: 0.5622 data: 0.0305 max mem: 15960

2023-02-03 19:11:56

Testing: Total time: 0:00:35

2023-02-03 19:11:56

Epoch [4]: Test Loss: 0.8251, Test Accuracy: 73.7495

2023-02-03 19:11:56

--------------------------------------------------------------------------------

2023-02-03 19:11:56

[2023-02-03 20:11:55,469][root][INFO] - Evaluation took 0.59 minutes

2023-02-03 19:11:56

[2023-02-03 20:11:55,469][root][INFO] - Evaluation stats: {'test_loss_epoch': 0.8251238228782775, 'test_batch_acc_epoch': 73.74949979076104, 'test_batch_f1_epoch': 0.2576716642523326, 'test_batch_acc_balanced_epoch': 0.2881889703120513}

2023-02-03 19:11:56

[2023-02-03 20:11:55,470][root][INFO] - Saving checkpoint for cycle 15

2023-02-03 19:12:02

[2023-02-03 20:11:59,684][root][INFO] - Saving results to /mnt/work/glae/glae-results/fnc1/roberta/coreset/nosub/N_INIT100__ACQ_SIZE100__N_ACQ15/seed5/results.json

2023-02-03 19:12:02

Saving results to /mnt/work/glae/glae-results/fnc1/roberta/coreset/nosub/N_INIT100__ACQ_SIZE100__N_ACQ15/seed5/results.json.

2023-02-03 19:12:02

[2023-02-03 20:12:00,192][root][INFO] - Experiment took 117.90 minutes