Language Adapters

el/wiki

Language modeling for the Greek language on Wikipedia. Greek is an independent branch of the Indo-European family of languages, native to Greece, Cyprus, Albania and other parts of the Eastern Mediterranean and the Black Sea.

el/wiki@ukp xlm-roberta-base

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Greek Wikipedia Articles for 250k steps and a batch size of 64.