AdapterHub
  •   Explore
  •   Docs
  •   Blog
  •  
  •  
  1. Explore
  2. Language

Language Adapters

Pre-trained model:

All architectures
All architectures
bert xlm-roberta distilbert gpt2 bart roberta mbart

gn/wiki

Language modeling for the Guarani language on Wikipedia. Guarani specifically the primary variety known as Paraguayan Guarani, is an indigenous language of South America that belongs to the Tupi–Guarani family of the Tupian languages.
gn/wiki@ukp xlm-roberta-large
1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head: 

Pfeiffer Adapter trained with Masked Language Modelling on Guarani Wikipedia Articles for 50k steps and a batch size of 64.

gn/wiki@ukp bert-base-multilingual-cased
2 versions Architecture: pfeiffer non-linearity: gelu reduction factor: 2 Head: 

Pfeiffer Adapter trained with Masked Language Modelling on Guarani Wikipedia Articles for 50k steps and a batch size of 64.

gn/wiki@ukp xlm-roberta-base
1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head: 

Pfeiffer Adapter trained with Masked Language Modelling on Guarani Wikipedia Articles for 50k steps and a batch size of 64.

gn/wiki@ukp bert-base-multilingual-cased
2 versions Architecture: houlsby non-linearity: gelu reduction factor: 2 Head: 

Houlsby Adapter trained with Masked Language Modelling on Guarani Wikipedia Articles for 50k steps and a batch size of 64.

gn/wiki@ukp bert-base-multilingual-cased
1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head: 

Pfeiffer Adapter trained with Masked Language Modelling on Guarani Wikipedia Articles for 50k steps and a batch size of 64.

Paper

Brought to you with ❤️ by the AdapterHub Team