Language Adapters

ar/wiki

Language modeling for the Arabic language on Wikipedia. Arabic is a Semitic language that first emerged in the 1st to 4th centuries CE. It is now the lingua franca of the Arab world.

ar/wiki@ukp xlm-roberta-large

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Arabic Wikipedia Articles for 250k steps and a batch size of 64.