AdapterHub
  •   Explore
  •   Docs
  •   Blog
  •  
  •  
  1. Explore
  2. Language

Language Adapters

Pre-trained model:

All architectures
All architectures
bert xlm-roberta distilbert gpt2 bart roberta mbart

tr/wiki

Language modeling for the Turkish language on Wikipedia. Turkish, also referred to as Istanbul Turkish or Turkey Turkish, is the most widely spoken of the Turkic languages, with around 70 to 80 million speakers, mostly in Turkey.
tr/wiki@ukp xlm-roberta-base
1 version Architecture: pfeiffer non-linearity: relu reduction factor: 2 Head: 

Pfeiffer Adapter trained with Masked Language Modelling on Turkish Wikipedia Articles for 250k steps and a batch size of 64.

tr/wiki@ukp bert-base-multilingual-cased
1 version Architecture: pfeiffer non-linearity: gelu reduction factor: 2 Head: 

Paper

Brought to you with ❤️ by the AdapterHub Team