AdapterHub
  •   Explore
  •   Upload
  •   Docs
  •   Blog
  •  
  •  
  1. Explore
  2. Task

Task Adapters

Pre-trained model:

All architectures
All architectures
bert bart xlm-roberta distilbert gpt2 roberta mbart

SST-2

The Stanford Sentiment Treebank is a binary single-sentence classification task consisting of sentences extracted from movie reviews with human annotations of their sentiment.
  Website
sentiment/sst-2@ukp facebook/bart-base
1 version Architecture: houlsby non-linearity: swish reduction factor: 16 Head: 

Adapter for bart-base in Houlsby architecture trained on the SST-2 dataset for 15 epochs with early stopping and a learning rate of 1e-4.

sentiment/sst-2@ukp roberta-large
1 version Architecture: houlsby Head: 

Adapter (with head) trained using the `run_glue.py` script with an extension that retains the best checkpoint (out of 30 epochs).

sentiment/sst-2@ukp distilbert-base-uncased
1 version Architecture: pfeiffer Head: 

Adapter for distilbert-base-uncased in Pfeiffer architecture trained on the SST-2 dataset for 15 epochs with early stopping and a learning rate of 1e-4.

sentiment/sst-2@ukp gpt2
1 version Architecture: pfeiffer non-linearity: relu reduction factor: 16 Head: 

Adapter for gpt2 in Pfeiffer architecture trained on the SST-2 dataset for 10 epochs with a learning rate of 1e-4.

sentiment/sst-2@ukp roberta-large
1 version Architecture: pfeiffer Head: 

Adapter (with head) trained using the `run_glue.py` script with an extension that retains the best checkpoint (out of 30 epochs).

sentiment/sst-2@ukp distilbert-base-uncased
1 version Architecture: houlsby Head: 

Adapter for distilbert-base-uncased in Houlsby architecture trained on the SST-2 dataset for 15 epochs with early stopping and a learning rate of 1e-4.

sentiment/sst-2@ukp facebook/bart-base
1 version Architecture: pfeiffer non-linearity: relu reduction factor: 16 Head: 

Adapter for bart-base in Pfeiffer architecture trained on the SST-2 dataset for 15 epochs with early stopping and a learning rate of 1e-4.

sentiment/sst-2@ukp roberta-base
1 version Architecture: houlsby Head: 

Adapter (with head) trained using the `run_glue.py` script with an extension that retains the best checkpoint (out of 30 epochs).

sentiment/sst-2@ukp bert-base-uncased
1 version Architecture: pfeiffer Head: 

Adapter in Pfeiffer architecture trained on the binary SST task for 20 epochs with early stopping and a learning rate of 1e-4. See https://arxiv.org/pdf/2007.07779.pdf.

sentiment/sst-2@ukp roberta-base
1 version Architecture: pfeiffer Head: 

Pfeiffer Adapter trained on the SST-2 task.

sentiment/sst-2@ukp bert-base-uncased
1 version Architecture: houlsby Head: 

Adapter in Houlsby architecture trained on the binary SST task for 20 epochs with early stopping and a learning rate of 1e-4. See https://arxiv.org/pdf/2007.07779.pdf.

AdapterHub/bert-base-uncased-pf-sst2 bert-base-uncased
huggingface.co Head: 

# Adapter `AdapterHub/bert-base-uncased-pf-sst2` for bert-base-uncased An [adapter](https://adapterhub.ml) for the `bert-base-uncased` model that was trained on the...

AdapterHub/roberta-base-pf-sst2 roberta-base
huggingface.co Head: 

# Adapter `AdapterHub/roberta-base-pf-sst2` for roberta-base An [adapter](https://adapterhub.ml) for the `roberta-base` model that was trained on the...

Paper | Imprint & Privacy

Brought to you with ❤️  by authors from: