e61f9189d09638cbc6e83834ea5500302f443244
Add

 

challenge
Searching for Legal Clauses by Analogy. Few-shot Contract Discovery Shared Task
submitter
p/tlen
submitted
2019-11-09 21:57:27.877048 UTC
original repo
ssh://gitolite@gonito.net/filipg/contract-discovery / branch sentence-transformer
publicly available at
ssh://git.wmi.amu.edu.plcontract-discovery / branch submission-04962
browsable at
https://git.wmi.amu.edu.plcontract-discovery/tree/submission-04962
clone by
git clone --single-branch ssh://git.wmi.amu.edu.plcontract-discovery -b submission-04962
# model seed_segm dev-0 Soft-F1.0 test-A Soft-F1.0
194 bert-base-wikipedia-sections-mean-tokens sentence 0.18379 0.17820
190 bert-base-nli-cls-token sentence 0.25245 0.23645
189 bert-large-nli-cls-token sentence 0.24320 0.23837
188 bert-base-nli-max-tokens sentence 0.26575 0.23863
187 bert-large-nli-max-tokens sentence 0.24740 0.24532
186 bert-large-nli-mean-tokens sentence 0.25880 0.24702
185 bert-base-wikipedia-sections-mean-tokens 0.26412 0.24783
184 bert-base-nli-mean-tokens sentence 0.26746 0.24869
182 bert-large-nli-stsb-mean-tokens sentence 0.26955 0.26415
181 bert-base-nli-stsb-mean-tokens sentence 0.30414 0.27325
179 bert-base-nli-cls-token 0.30920 0.29310
178 bert-large-nli-cls-token 0.30278 0.29366
177 bert-large-nli-max-tokens 0.30165 0.29568
176 bert-base-nli-max-tokens 0.31252 0.29688
175 bert-large-nli-mean-tokens 0.31277 0.29843
173 bert-large-nli-stsb-mean-tokens 0.31910 0.31047
171 bert-base-nli-mean-tokens 0.32887 0.31309
170 bert-base-nli-stsb-mean-tokens 0.34472 0.31566
Parameter Value
chooser Kbest-1
distance cosine-similarity
method sentence-transformers-package
seed_agg mean
seed_agg_type post