Language Adapters

es/wiki

Language modeling for the Spanish language on Wikipedia. Spanish, or Castilian, is a Romance language that originated in the Iberian Peninsula and today is a global language with more than 483 million native speakers, mainly in Spain and the Americas.

es/wiki@ukp bert-base-multilingual-cased

2 versions Architecture: houlsby non-linearity: gelu reduction factor: 2 Head:

Houlsby Adapter trained with Masked Language Modelling on Spanish Wikipedia Articles for 250k steps and a batch size of 64.

es/wiki@ukp bert-base-multilingual-cased

2 versions Architecture: pfeiffer non-linearity: gelu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Spanish Wikipedia Articles for 250k steps and a batch size of 64.