Open Information Extraction on CaRB

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	MacroIE	54.8	No	A Survey on Neural Open Information Extraction: ...	2022-05-24	-
2	OpenIE 6 (CIGL-OIE)	54	No	OpenIE6: Iterative Grid Labeling and Coordinatio...	2020-10-07	Code
3	IMoJIE	53.5	No	OpenIE6: Iterative Grid Labeling and Coordinatio...	2020-10-07	Code
4	IMoJIE	53.3	No	A Survey on Neural Open Information Extraction: ...	2022-05-24	-
5	OpenIE 6	52.7	No	OpenIE6: Iterative Grid Labeling and Coordinatio...	2020-10-07	Code
6	OpenIE6	52.7	No	A Survey on Neural Open Information Extraction: ...	2022-05-24	-
7	Multi2OIE	52.3	No	A Survey on Neural Open Information Extraction: ...	2022-05-24	Code
8	Multi2OIE	52.3	No	A Survey on Neural Open Information Extraction: ...	2022-05-24	-
9	GPT-3.5-Turbo w/ Selected Demo & Uncertainty	52.1	No	Improving Open Information Extraction with Large...	2023-09-07	-
10	OpenIE4	51.6	No	A Survey on Neural Open Information Extraction: ...	2022-05-24	Code
11	OpenIE4	51.6	No	A Survey on Neural Open Information Extraction: ...	2022-05-24	-
12	LLaMA-2-70B w/ Selected Demo & Uncertainty	51.5	No	Improving Open Information Extraction with Large...	2023-09-07	-
13	NOIE	51.1	No	A Survey on Neural Open Information Extraction: ...	2022-05-24	-
14	RnnOIE	49	No	A Survey on Neural Open Information Extraction: ...	2022-05-24	Code
15	RnnOIE	49	No	A Survey on Neural Open Information Extraction: ...	2022-05-24	-
16	OpenIE 4	48.8	No	-	-	Code
17	SpanOIE	48.5	No	OpenIE6: Iterative Grid Labeling and Coordinatio...	2020-10-07	Code
18	SpanOIE [48]	48.5	No	A Survey on Neural Open Information Extraction: ...	2022-05-24	-
19	OpenIE5	48	No	OpenIE6: Iterative Grid Labeling and Coordinatio...	2020-10-07	Code
20	OpenIE 5	46.7	No	-	-	-
21	ClausIE	45	No	OpenIE6: Iterative Grid Labeling and Coordinatio...	2020-10-07	Code
22	ClausIE	45	No	OpenIE6: Iterative Grid Labeling and Coordinatio...	2020-10-07	Code
23	ClausIE [9]	45	No	A Survey on Neural Open Information Extraction: ...	2022-05-24	-
24	MinIE	41.9	No	OpenIE6: Iterative Grid Labeling and Coordinatio...	2020-10-07	Code
25	OLLIE	41.1	No	-	-	-
26	LLaMA-2-13B w/ Selected Demo & Uncertainty	36.2	No	Improving Open Information Extraction with Large...	2023-09-07	-
27	PropS	31.9	No	Getting More Out Of Syntax with PropS	2016-03-04	-
28	SenseOIE	28.2	No	OpenIE6: Iterative Grid Labeling and Coordinatio...	2020-10-07	Code
29	SenseOIE [30]	28.2	No	A Survey on Neural Open Information Extraction: ...	2022-05-24	-

#1MacroIESOTA
54.8
F1· 2022-05-24
A Survey on Neural Open Information Extraction: Current Status and Future Directions
#2OpenIE 6 (CIGL-OIE)SOTA
54
F1· 2020-10-07
OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction Code
#3IMoJIE
53.5
F1· 2020-10-07
OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction Code
#4IMoJIE
53.3
F1· 2022-05-24
A Survey on Neural Open Information Extraction: Current Status and Future Directions
#5OpenIE 6
52.7
F1· 2020-10-07
OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction Code
#6OpenIE6
52.7
F1· 2022-05-24
A Survey on Neural Open Information Extraction: Current Status and Future Directions
#7Multi2OIE
52.3
F1· 2022-05-24
A Survey on Neural Open Information Extraction: Current Status and Future Directions Code
#8Multi2OIE
52.3
F1· 2022-05-24
A Survey on Neural Open Information Extraction: Current Status and Future Directions
#9GPT-3.5-Turbo w/ Selected Demo & Uncertainty
52.1
F1· 2023-09-07
Improving Open Information Extraction with Large Language Models: A Study on Demonstration Uncertainty
#10OpenIE4
51.6
F1· 2022-05-24
A Survey on Neural Open Information Extraction: Current Status and Future Directions Code
#11OpenIE4
51.6
F1· 2022-05-24
A Survey on Neural Open Information Extraction: Current Status and Future Directions
#12LLaMA-2-70B w/ Selected Demo & Uncertainty
51.5
F1· 2023-09-07
Improving Open Information Extraction with Large Language Models: A Study on Demonstration Uncertainty
#13NOIE
51.1
F1· 2022-05-24
A Survey on Neural Open Information Extraction: Current Status and Future Directions
#14RnnOIE
49
F1· 2022-05-24
A Survey on Neural Open Information Extraction: Current Status and Future Directions Code
#15RnnOIE
49
F1· 2022-05-24
A Survey on Neural Open Information Extraction: Current Status and Future Directions
#16OpenIE 4
48.8
F1
No paperCode
#17SpanOIE
48.5
F1· 2020-10-07
OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction Code
#18SpanOIE [48]
48.5
F1· 2022-05-24
A Survey on Neural Open Information Extraction: Current Status and Future Directions
#19OpenIE5
48
F1· 2020-10-07
OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction Code
#20OpenIE 5
46.7
F1
No paper
#21ClausIE
45
F1· 2020-10-07
OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction Code
#22ClausIE
45
F1· 2020-10-07
OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction Code
#23ClausIE [9]
45
F1· 2022-05-24
A Survey on Neural Open Information Extraction: Current Status and Future Directions
#24MinIE
41.9
F1· 2020-10-07
OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction Code
#25OLLIE
41.1
F1
No paper
#26LLaMA-2-13B w/ Selected Demo & Uncertainty
36.2
F1· 2023-09-07
Improving Open Information Extraction with Large Language Models: A Study on Demonstration Uncertainty
#27PropSSOTA
31.9
F1· 2016-03-04
Getting More Out Of Syntax with PropS
#28SenseOIE
28.2
F1· 2020-10-07
OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction Code
#29SenseOIE [30]
28.2
F1· 2022-05-24
A Survey on Neural Open Information Extraction: Current Status and Future Directions