RoBERTa Hateval

Batch size is 16
Learning rate is 1e-05
Epsilon is 1e-08

======== Epoch 1 / 4========
TRAINING:
   Average training loss: 0.67
   Training epoch took:0:01:56

VALIDATION:
   Accuracy: 0.65
   F1 score: 0.58
   Validation Loss: 0.64
   Validation took: 0:00:04


======== Epoch 2 / 4========
TRAINING:
   Average training loss: 0.57
   Training epoch took:0:01:55

VALIDATION:
   Accuracy: 0.67
   F1 score: 0.67
   Validation Loss: 0.61
   Validation took: 0:00:04


======== Epoch 3 / 4========
TRAINING:
   Average training loss: 0.51
   Training epoch took:0:01:55

VALIDATION:
   Accuracy: 0.64
   F1 score: 0.64
   Validation Loss: 0.66
   Validation took: 0:00:04


======== Epoch 4 / 4========
TRAINING:
   Average training loss: 0.47
   Training epoch took:0:01:54

VALIDATION:
   Accuracy: 0.69
   F1 score: 0.68
   Validation Loss: 0.60
   Validation took: 0:00:04


Total training took 0:07:55 (h:mm:ss)RoBERTa Hateval

Batch size is 32
Learning rate is 1e-05
Epsilon is 1e-08

======== Epoch 1 / 4========
TRAINING:
   Average training loss: 0.49
   Training epoch took:0:01:46

VALIDATION:
   Accuracy: 0.70
   F1 score: 0.69
   Validation Loss: 0.59
   Validation took: 0:00:04


======== Epoch 2 / 4========
TRAINING:
   Average training loss: 0.44
   Training epoch took:0:01:46

VALIDATION:
   Accuracy: 0.70
   F1 score: 0.70
   Validation Loss: 0.59
   Validation took: 0:00:04


======== Epoch 3 / 4========
TRAINING:
   Average training loss: 0.42
   Training epoch took:0:01:45

VALIDATION:
   Accuracy: 0.70
   F1 score: 0.70
   Validation Loss: 0.59
   Validation took: 0:00:04


======== Epoch 4 / 4========
TRAINING:
   Average training loss: 0.38
   Training epoch took:0:01:46

VALIDATION:
   Accuracy: 0.71
   F1 score: 0.70
   Validation Loss: 0.64
   Validation took: 0:00:04


Total training took 0:07:17 (h:mm:ss)RoBERTa Hateval

Batch size is 64
Learning rate is 1e-05
Epsilon is 1e-08

======== Epoch 1 / 4========
TRAINING:
   Average training loss: 0.42
   Training epoch took:0:01:36

VALIDATION:
   Accuracy: 0.68
   F1 score: 0.68
   Validation Loss: 0.67
   Validation took: 0:00:04


======== Epoch 2 / 4========
TRAINING:
   Average training loss: 0.38
   Training epoch took:0:01:36

VALIDATION:
   Accuracy: 0.69
   F1 score: 0.69
   Validation Loss: 0.67
   Validation took: 0:00:04


======== Epoch 3 / 4========
TRAINING:
   Average training loss: 0.35
   Training epoch took:0:01:36

VALIDATION:
   Accuracy: 0.67
   F1 score: 0.66
   Validation Loss: 0.72
   Validation took: 0:00:04


======== Epoch 4 / 4========
TRAINING:
   Average training loss: 0.33
   Training epoch took:0:01:36

VALIDATION:
   Accuracy: 0.69
   F1 score: 0.69
   Validation Loss: 0.68
   Validation took: 0:00:04


Total training took 0:06:37 (h:mm:ss)RoBERTa Hateval

Batch size is 16
Learning rate is 2e-05
Epsilon is 1e-08

======== Epoch 1 / 4========
TRAINING:
   Average training loss: 0.45
   Training epoch took:0:01:55

VALIDATION:
   Accuracy: 0.68
   F1 score: 0.68
   Validation Loss: 0.74
   Validation took: 0:00:04


======== Epoch 2 / 4========
TRAINING:
   Average training loss: 0.36
   Training epoch took:0:01:55

VALIDATION:
   Accuracy: 0.70
   F1 score: 0.67
   Validation Loss: 0.88
   Validation took: 0:00:04


======== Epoch 3 / 4========
TRAINING:
   Average training loss: 0.32
   Training epoch took:0:01:55

VALIDATION:
   Accuracy: 0.70
   F1 score: 0.70
   Validation Loss: 0.80
   Validation took: 0:00:04


======== Epoch 4 / 4========
TRAINING:
   Average training loss: 0.25
   Training epoch took:0:01:54

VALIDATION:
   Accuracy: 0.70
   F1 score: 0.70
   Validation Loss: 0.92
   Validation took: 0:00:04


Total training took 0:07:54 (h:mm:ss)RoBERTa Hateval

Batch size is 32
Learning rate is 2e-05
Epsilon is 1e-08

======== Epoch 1 / 4========
TRAINING:
   Average training loss: 0.33
   Training epoch took:0:01:46

VALIDATION:
   Accuracy: 0.69
   F1 score: 0.69
   Validation Loss: 0.85
   Validation took: 0:00:04


======== Epoch 2 / 4========
TRAINING:
   Average training loss: 0.24
   Training epoch took:0:01:46

VALIDATION:
   Accuracy: 0.69
   F1 score: 0.68
   Validation Loss: 0.77
   Validation took: 0:00:04


======== Epoch 3 / 4========
TRAINING:
   Average training loss: 0.20
   Training epoch took:0:01:46

VALIDATION:
   Accuracy: 0.68
   F1 score: 0.68
   Validation Loss: 0.85
   Validation took: 0:00:04


======== Epoch 4 / 4========
TRAINING:
   Average training loss: 0.16
   Training epoch took:0:01:46

VALIDATION:
   Accuracy: 0.69
   F1 score: 0.68
   Validation Loss: 1.03
   Validation took: 0:00:04


Total training took 0:07:17 (h:mm:ss)RoBERTa Hateval

Batch size is 64
Learning rate is 2e-05
Epsilon is 1e-08

======== Epoch 1 / 4========
TRAINING:
   Average training loss: 0.22
   Training epoch took:0:01:36

VALIDATION:
   Accuracy: 0.69
   F1 score: 0.67
   Validation Loss: 1.10
   Validation took: 0:00:04


======== Epoch 2 / 4========
TRAINING:
   Average training loss: 0.17
   Training epoch took:0:01:36

VALIDATION:
   Accuracy: 0.68
   F1 score: 0.68
   Validation Loss: 0.99
   Validation took: 0:00:04


======== Epoch 3 / 4========
TRAINING:
   Average training loss: 0.15
   Training epoch took:0:01:35

VALIDATION:
   Accuracy: 0.69
   F1 score: 0.68
   Validation Loss: 1.08
   Validation took: 0:00:04


======== Epoch 4 / 4========
TRAINING:
   Average training loss: 0.10
   Training epoch took:0:01:36

VALIDATION:
   Accuracy: 0.67
   F1 score: 0.67
   Validation Loss: 1.22
   Validation took: 0:00:04


Total training took 0:06:36 (h:mm:ss)