Language Adapters

ja/wiki

Language modeling for the Japanese language on Wikipedia. Japanese is an East Asian language spoken by about 128 million people, primarily in Japan, where it is the national language.

ja/wiki@ukp bert-base-multilingual-cased

2 versions Architecture: pfeiffer non-linearity: gelu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Japanese Wikipedia Articles for 250k steps and a batch size of 64.

ja/wiki@ukp bert-base-multilingual-cased

1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head:

Pfeiffer Adapter trained with Masked Language Modelling on Japanese Wikipedia Articles for 250k steps and a batch size of 64.

ja/wiki@ukp bert-base-multilingual-cased

2 versions Architecture: houlsby non-linearity: gelu reduction factor: 2 Head:

Houlsby Adapter trained with Masked Language Modelling on Japanese Wikipedia Articles for 250k steps and a batch size of 64.