Language Adapters

zh/wiki

Language modeling for the Chinese language on Wikipedia. Chinese is a family of East Asian analytic languages that form the Sinitic branch of the Sino-Tibetan languages.

zh/wiki@ukp xlm-roberta-large

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Chinese Wikipedia Articles for 250k steps and a batch size of 64.

zh/wiki@ukp xlm-roberta-base

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Chinese Wikipedia Articles for 250k steps and a batch size of 64.