Language Adapters

el/wiki

Language modeling for the Greek language on Wikipedia. Greek is an independent branch of the Indo-European family of languages, native to Greece, Cyprus, Albania and other parts of the Eastern Mediterranean and the Black Sea.

el/wiki@ukp bert-base-multilingual-cased

2 versions Architecture: pfeiffer non-linearity: gelu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Greek Wikipedia Articles for 250k steps and a batch size of 64.

el/wiki@ukp bert-base-multilingual-cased

2 versions Architecture: houlsby non-linearity: gelu reduction factor: 2 Head:

Houlsby Adapter trained with Masked Language Modelling on Greek Wikipedia Articles for 250k steps and a batch size of 64.