Language Adapters

mhr/wiki

Language modeling for the Meadow Mari language on Wikipedia. Meadow Mari or Meadow-Eastern Mari or Eastern Mari is a standardised dialect of the Mari language used by about half a million people mostly in the European part of the Russian Federation.

mhr/wiki@ukp xlm-roberta-large

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Meadow Mari Wikipedia Articles for 50k steps and a batch size of 64.