Language Adapters

ht/wiki

Language modeling for the Haitian Creole language on Wikipedia. Haitian Creole is a French-based creole language spoken by 10–12 million people worldwide, and the only language of most Haitians.

ht/wiki@ukp xlm-roberta-base

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Haitian Creole Wikipedia Articles for 50k steps and a batch size of 64.