AdapterHub
  •   Explore
  •   Docs
  •   Blog
  •  
  •  
  1. Explore
  2. Language

Language Adapters

Pre-trained model:

All architectures
All architectures
bert xlm-roberta distilbert gpt2 bart roberta mbart

vi/wiki

Language modeling for the Vietnamese language on Wikipedia. Vietnamese is an Austroasiatic language that originated in Vietnam, where it is the national and official language. Spoken natively by an estimated 95 million people (as of 2018), it is the native language of the Vietnamese (Kinh) people, as well as a first or second language for the many ethnic minorities of Vietnam.
vi/wiki@ukp xlm-roberta-base
1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head: 

Pfeiffer Adapter trained with Masked Language Modelling on Vietnamese Wikipedia Articles for 250k steps and a batch size of 64.

vi/wiki@ukp bert-base-multilingual-cased
1 version Architecture: pfeiffer non-linearity: gelu reduction factor: 2 Head: 

Paper

Brought to you with ❤️ by the AdapterHub Team