Language Adapters

xmf/wiki

Language modeling for the Mingrelian language on Wikipedia. Megrelian is a Kartvelian language spoken in Western Georgia (regions of Samegrelo and Abkhazia), primarily by the Megrelians.

xmf/wiki@ukp xlm-roberta-large

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Mingrelian Wikipedia Articles for 50k steps and a batch size of 64.