Semantic Retrieval on Contract Discovery

Metric: Soft-F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Soft-F1▼	Extra Data	Paper	Date↕	Code
1	Human baseline	0.84	No	Contract Discovery: Dataset and a Few-Shot Seman...	2019-11-10	Code
2	k-NN with sentence n-grams, GPT-2 embeddings, fICA	0.51	No	Contract Discovery: Dataset and a Few-Shot Seman...	2019-11-10	Code
3	DBTW, GPT-1 embeddings, fICA	0.51	No	Dynamic Boundary Time Warping for Sub-sequence M...	2020-10-27	-
4	LSA baseline	0.39	No	Contract Discovery: Dataset and a Few-Shot Seman...	2019-11-10	Code
5	Universal Sentence Encoder	0.38	No	Contract Discovery: Dataset and a Few-Shot Seman...	2019-11-10	Code
6	Sentence BERT	0.31	No	Contract Discovery: Dataset and a Few-Shot Seman...	2019-11-10	Code

#1Human baselineSOTA
0.84
Soft-F1· 2019-11-10
Contract Discovery: Dataset and a Few-Shot Semantic Retrieval Challenge with Competitive Baselines Code
#2k-NN with sentence n-grams, GPT-2 embeddings, fICA
0.51
Soft-F1· 2019-11-10
Contract Discovery: Dataset and a Few-Shot Semantic Retrieval Challenge with Competitive Baselines Code
#3DBTW, GPT-1 embeddings, fICA
0.51
Soft-F1· 2020-10-27
Dynamic Boundary Time Warping for Sub-sequence Matching with Few Examples
#4LSA baseline
0.39
Soft-F1· 2019-11-10
Contract Discovery: Dataset and a Few-Shot Semantic Retrieval Challenge with Competitive Baselines Code
#5Universal Sentence Encoder
0.38
Soft-F1· 2019-11-10
Contract Discovery: Dataset and a Few-Shot Semantic Retrieval Challenge with Competitive Baselines Code
#6Sentence BERT
0.31
Soft-F1· 2019-11-10
Contract Discovery: Dataset and a Few-Shot Semantic Retrieval Challenge with Competitive Baselines Code