Language Adapters

th/wiki

Language modeling for the Thai language on Wikipedia. Thai, Central Thai, is the official language of Thailand and the first language of the Central Thai people.

th/wiki@ukp xlm-roberta-base

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Thai Wikipedia Articles for 250k steps and a batch size of 64.