Language Adapters

is/wiki

Language modeling for the Icelandic language on Wikipedia. Icelandic is a North Germanic language spoken by about 314,000 people, the vast majority of whom live in Iceland where it is the national language.

is/wiki@ukp xlm-roberta-base

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Icelandic Wikipedia Articles for 100k steps and a batch size of 64.