Pre-trained model:
Adapter for distilbert-base-uncased in Pfeiffer architecture trained on the QQP dataset for 15 epochs with early stopping and a learning rate of 1e-4.
Pfeiffer Adapter trained on the QQP dataset.
Adapter in Pfeiffer architecture trained on the QQP task for 20 epochs with early stopping and a learning rate of 1e-4. See https://arxiv.org/pdf/2007.07779.pdf.
Adapter in Houlsby architecture trained on the QQP task for 20 epochs with early stopping and a learning rate of 1e-4. See https://arxiv.org/pdf/2007.07779.pdf.
Adapter for distilbert-base-uncased in Houlsby architecture trained on the QQP dataset for 15 epochs with early stopping and a learning rate of 1e-4.