Pre-trained model:
Pfeiffer Adapter trained on HellaSwag.
Adapter for distilbert-base-uncased in Pfeiffer architecture trained on the Hellaswag dataset for 15 epochs with early stopping and a learning rate of 1e-4.