Task Adapters

QNLI

Question Natural Language Inference is a version of SQuAD which has been converted to a binary classification task. The positive examples are (question, sentence) pairs which do contain the correct answer, and the negative examples are (question,sentence) from the same paragraph which do not contain the answer.

nli/qnli@ukp gpt2

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 16 Head:

Adapter for gpt2 in Pfeiffer architecture trained on the QNLI dataset for 10 epochs with a learning rate of 1e-4.

nli/qnli@ukp gpt2

1 version Architecture: houlsby non-linearity: swish reduction factor: 16 Head:

Adapter for gpt2 in Houlsby architecture trained on the QNLI dataset for 10 epochs with a learning rate of 1e-4.