e0ad7c77e0e9dd5c9458d4f39bdd8702fe9ef917
Transformer decoder models (CLM) transformer huggingface-transformers transformer-encoder clm

 

challenge
GLUE-LM-GAP
submitter
kaczla
submitted
2023-02-06 14:35:25.817957 UTC
original repo
gonito_prods://gitlab.com/kaczla/glue-lm-gap.git / branch decoder
publicly available at
ssh://git.wmi.amu.edu.plglue-lm-gap / branch submission-07995
browsable at
https://git.wmi.amu.edu.plglue-lm-gap/tree/submission-07995
clone by
git clone --single-branch ssh://git.wmi.amu.edu.plglue-lm-gap -b submission-07995
# model_name dev-0 PerplexityHashed test-A PerplexityHashed
71 DistilGPT-2 8885.673813 9714.724445
65 GPT-2-base 4732.154178 4700.318867
53 GPT-2-medium 2591.721115 2250.943823
50 OPT-125M 2560.284962 2021.615293
48 OPT-350M 2257.973076 1767.228754
Parameter Value
depth 1
top_k 15