Pre-trained model:
Houlsby Adapter trained with Masked Language Modelling on Meadow Mari Wikipedia Articles for 50k steps and a batch size of 64.
Pfeiffer Adapter trained with Masked Language Modelling on Meadow Mari Wikipedia Articles for 50k steps and a batch size of 64.