Language Adapters

tr/wiki

Language modeling for the Turkish language on Wikipedia. Turkish, also referred to as Istanbul Turkish or Turkey Turkish, is the most widely spoken of the Turkic languages, with around 70 to 80 million speakers, mostly in Turkey.

tr/wiki@ukp xlm-roberta-base

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Turkish Wikipedia Articles for 250k steps and a batch size of 64.