Task Adapters

CoLA

The Corpus of Linguistic Acceptability (CoLA) in its full form consists of 10657 sentences from 23 linguistics publications, expertly annotated for acceptability (grammaticality) by their original authors. The public version provided here contains 9594 sentences belonging to training and development sets, and excludes 1063 sentences belonging to a held out test set.

Website

lingaccept/cola@ukp distilbert-base-uncased

1 version Architecture: houlsby Head:

Adapter for distilbert-base-uncased in Houlsby architecture trained on the CoLA dataset for 15 epochs with early stopping and a learning rate of 1e-4.

lingaccept/cola@ukp distilbert-base-uncased

1 version Architecture: pfeiffer Head:

Adapter for distilbert-base-uncased in Pfeiffer architecture trained on the CoLA dataset for 15 epochs with early stopping and a learning rate of 1e-4.