Language Adapters

fi/wiki

Language modeling for the Finnish language on Wikipedia. Finnish, whose endonym is suomi or suomen kieli is a Uralic language of the Finnic branch spoken by the majority of the population in Finland and by ethnic Finns outside Finland.

fi/wiki@ukp bert-base-multilingual-cased

2 versions Architecture: houlsby non-linearity: gelu reduction factor: 2 Head:

Houlsby Adapter trained with Masked Language Modelling on Finnish Wikipedia Articles for 250k steps and a batch size of 64.

fi/wiki@ukp bert-base-multilingual-cased

2 versions Architecture: pfeiffer non-linearity: gelu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Finnish Wikipedia Articles for 250k steps and a batch size of 64.