Language Adapters

sw/wiki

Language modeling for the Swahili language on Wikipedia. Swahili, also known by its native name Kiswahili, is a Bantu language and the first language of the Swahili people.

sw/wiki@ukp xlm-roberta-large

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Swahili Wikipedia Articles for 100k steps and a batch size of 64.