Task Adapters

STS-B

The Semantic Textual Similarity Benchmark is a collection of sentence pairs drawn from news headlines and other sources. They were annotated with a score from 1 to 5 denoting how similar the two sentences are in terms of semantic meaning.

Website

sts/sts-b@ukp gpt2

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 16 Head:

Adapter for gpt2 in Pfeiffer architecture trained on the STS-B dataset for 10 epochs with a learning rate of 1e-4.

sts/sts-b@ukp gpt2

1 version Architecture: houlsby non-linearity: swish reduction factor: 16 Head:

Adapter for gpt2 in Houlsby architecture trained on the STS-B dataset for 10 epochs with a learning rate of 1e-4.