Task Adapters

CoLA

The Corpus of Linguistic Acceptability (CoLA) in its full form consists of 10657 sentences from 23 linguistics publications, expertly annotated for acceptability (grammaticality) by their original authors. The public version provided here contains 9594 sentences belonging to training and development sets, and excludes 1063 sentences belonging to a held out test set.

Website

lingaccept/cola@ukp facebook/bart-base

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 16 Head:

Adapter for bart-base in Pfeiffer architecture trained on the CoLA dataset for 15 epochs with early stopping and a learning rate of 1e-4.

lingaccept/cola@ukp facebook/bart-base

1 version Architecture: houlsby non-linearity: swish reduction factor: 16 Head:

Adapter for bart-base in Houlsby architecture trained on the CoLA dataset for 15 epochs with early stopping and a learning rate of 1e-4.