Language Adapters

tk/wiki

Language modeling for the Turkmen language on Wikipedia. Turkmen is an Oghuz Turkic language spoken by the Turkmens of Central Asia and the official language of Turkmenistan.

tk/wiki@ukp xlm-roberta-base

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Turkmen Wikipedia Articles for 50k steps and a batch size of 64.

tk/wiki@ukp xlm-roberta-large

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Turkmen Wikipedia Articles for 50k steps and a batch size of 64.