b8b160fa025373ee90b2de6d565e40ad74f262b6
Transformer encoder models (MLM) transformer huggingface-transformers transformer-encoder mlm

 

challenge
GLUE-LM-GAP
submitter
kaczla
submitted
2023-02-13 08:56:46.803491 UTC
original repo
gonito_prods://gitlab.com/kaczla/glue-lm-gap.git / branch encoder
publicly available at
ssh://git.wmi.amu.edu.plglue-lm-gap / branch submission-07996
browsable at
https://git.wmi.amu.edu.plglue-lm-gap/tree/submission-07996
clone by
git clone --single-branch ssh://git.wmi.amu.edu.plglue-lm-gap -b submission-07996
# model_name dev-0 PerplexityHashed test-A PerplexityHashed
223 XLM-RoBERTa-large N/A N/A
222 XLM-RoBERTa-base N/A N/A
221 XLM-en N/A N/A
220 XLM-17-lang N/A N/A
219 XLM-100-lang N/A N/A
218 SportsBERT N/A N/A
217 SciBERT-uncased N/A N/A
216 SciBERT-cased N/A N/A
215 RoBERTa-large N/A N/A
214 RoBERTa-base N/A N/A
213 PolishRoBERT-base N/A N/A
212 MobileBERT-uncased N/A N/A
211 MiniLM-L6-H768-RoBERTa-large N/A N/A
210 MiniLM-L6-H768-BERT-large-uncased N/A N/A
209 MiniLM-L6-H768-BERT-base-uncased N/A N/A
208 MiniLM-L6-H384-XLMR-Large N/A N/A
207 MiniLM-L6-H384-RoBERTa-large N/A N/A
206 MiniLM-L6-H384-BERT-large-uncased N/A N/A
205 MiniLM-L6-H384-BERT-base-uncased N/A N/A
204 MiniLM-L12-H384-XLMR-Large N/A N/A
203 MiniLM-L12-H384-RoBERTa-large N/A N/A
202 German-BERT-base-cased N/A N/A
201 FinBERT N/A N/A
200 DistilRoBERTa-base N/A N/A
199 DistilBERT-base-uncased N/A N/A
198 DistilBERT-base-cased N/A N/A
197 CodeBERT-base N/A N/A
196 CamemBERT-base N/A N/A
195 BioMed-RoBERTa-base N/A N/A
194 BERT-large-uncased N/A N/A
193 BERT-large-cased N/A N/A
192 BERT-base-uncased N/A N/A
191 BERT-base-multilingual-uncased N/A N/A
190 BERT-base-multilingual-cased N/A N/A
189 BERT-base-cased N/A N/A
188 ALBERT-xxlarge N/A N/A
187 ALBERT-xlarge N/A N/A
186 ALBERT-large N/A N/A
185 ALBERT-base N/A N/A
Parameter Value
method simple
token_length 1
top_k 15