Dependency Parsing on Penn Treebank

Metric: UAS (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	UAS▼	Extra Data	Paper	Date↕	Code
1	Label Attention Layer + HPSG + XLNet	97.42	No	Rethinking Self-Attention: Towards Interpretabil...	2019-11-10	Code
2	DMPar + XLNet	97.3	No	-	-	Code
3	Deep Biaffine + RoBERTa	97.29	No	Deep Biaffine Attention for Neural Dependency Pa...	2016-11-06	Code
4	ACE	97.2	No	Automated Concatenation of Embeddings for Struct...	2020-10-10	Code
5	HPSG Parser (Joint) + XLNet	97.2	No	Head-Driven Phrase Structure Grammar Parsing on ...	2019-07-05	Code
6	MFVI	96.91	No	Second-Order Neural Dependency Parsing with Mess...	2020-10-10	Code
7	RNG Transformer	96.66	No	Recursive Non-Autoregressive Graph-to-Graph Tran...	2020-03-29	Code
8	CVT + Multi-Task	96.61	No	Semi-Supervised Sequence Modeling with Cross-Vie...	2018-09-22	Code
9	SpanRel	96.44	No	Generalizing Natural Language Analysis through S...	2019-11-10	Code
10	CRFPar	96.14	No	Efficient Second-Order TreeCRF for Neural Depend...	2020-05-03	Code
11	Left-to-Right Pointer Network	96.04	No	Left-to-Right Dependency Parsing with Pointer Ne...	2019-03-20	Code
12	Graph-based parser with GNNs	95.97	No	-	-	Code
13	Deep Biaffine	95.87	No	Deep Biaffine Attention for Neural Dependency Pa...	2016-11-06	Code
14	Stack-Pointer Network	95.87	No	Stack-Pointer Networks for Dependency Parsing	2018-05-03	Code
15	jPTDP	95.51	No	An improved neural network model for joint POS t...	2018-07-11	Code
16	Experiment-bert	95.42	No	-	-	-
17	Andor et al.	94.61	No	Globally Normalized Transition-Based Neural Netw...	2016-03-19	Code
18	Distilled neural FOG	94.26	No	Distilling an Ensemble of Greedy Dependency Pars...	2016-09-24	Code
19	Weiss et al.	94.01	No	Structured Training for Neural Network Transitio...	2015-06-19	-
20	BIST transition-based parser	93.99	No	Simple and Accurate Dependency Parsing Using Bid...	2016-03-14	Code
21	Arc-hybrid	93.56	No	Training with Exploration Improves a Greedy Stac...	2016-03-11	-
22	BIST graph-based parser	93.1	No	Simple and Accurate Dependency Parsing Using Bid...	2016-03-14	Code
23	Ensemble (selected w/ society entropy)	67.3	No	Error Diversity Matters: An Error-Resistant Ense...	2024-12-16	Code
24	Iterative reranking	66.2	No	Unsupervised Dependency Parsing: Let's Use Super...	2015-04-18	-
25	Combined System	64.4	No	-	-	-
26	Tree Substitution Grammar DMV	55.7	No	-	-	-
27	Shared Logistic Normal DMV	41.4	No	-	-	-
28	DMV	35.9	No	-	-	-

#1Label Attention Layer + HPSG + XLNetSOTA
97.42
UAS· 2019-11-10
Rethinking Self-Attention: Towards Interpretability in Neural Parsing Code
#2DMPar + XLNet
97.3
UAS
No paperCode
#3Deep Biaffine + RoBERTaSOTA
97.29
UAS· 2016-11-06
Deep Biaffine Attention for Neural Dependency Parsing Code
#4ACE
97.2
UAS· 2020-10-10
Automated Concatenation of Embeddings for Structured Prediction Code
#5HPSG Parser (Joint) + XLNet
97.2
UAS· 2019-07-05
Head-Driven Phrase Structure Grammar Parsing on Penn Treebank Code
#6MFVI
96.91
UAS· 2020-10-10
Second-Order Neural Dependency Parsing with Message Passing and End-to-End Training Code
#7RNG Transformer
96.66
UAS· 2020-03-29
Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement Code
#8CVT + Multi-Task
96.61
UAS· 2018-09-22
Semi-Supervised Sequence Modeling with Cross-View Training Code
#9SpanRel
96.44
UAS· 2019-11-10
Generalizing Natural Language Analysis through Span-relation Representations Code
#10CRFPar
96.14
UAS· 2020-05-03
Efficient Second-Order TreeCRF for Neural Dependency Parsing Code
#11Left-to-Right Pointer Network
96.04
UAS· 2019-03-20
Left-to-Right Dependency Parsing with Pointer Networks Code
#12Graph-based parser with GNNs
95.97
UAS
No paperCode
#13Deep Biaffine
95.87
UAS· 2016-11-06
Deep Biaffine Attention for Neural Dependency Parsing Code
#14Stack-Pointer Network
95.87
UAS· 2018-05-03
Stack-Pointer Networks for Dependency Parsing Code
#15jPTDP
95.51
UAS· 2018-07-11
An improved neural network model for joint POS tagging and dependency parsing Code
#16Experiment-bert
95.42
UAS
No paper
#17Andor et al.SOTA
94.61
UAS· 2016-03-19
Globally Normalized Transition-Based Neural Networks Code
#18Distilled neural FOG
94.26
UAS· 2016-09-24
Distilling an Ensemble of Greedy Dependency Parsers into One MST Parser Code
#19Weiss et al.SOTA
94.01
UAS· 2015-06-19
Structured Training for Neural Network Transition-Based Parsing
#20BIST transition-based parser
93.99
UAS· 2016-03-14
Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature Representations Code
#21Arc-hybrid
93.56
UAS· 2016-03-11
Training with Exploration Improves a Greedy Stack-LSTM Parser
#22BIST graph-based parser
93.1
UAS· 2016-03-14
Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature Representations Code
#23Ensemble (selected w/ society entropy)
67.3
UAS· 2024-12-16
Error Diversity Matters: An Error-Resistant Ensemble Method for Unsupervised Dependency Parsing Code
#24Iterative rerankingSOTA
66.2
UAS· 2015-04-18
Unsupervised Dependency Parsing: Let's Use Supervised Parsers
#25Combined System
64.4
UAS
No paper
#26Tree Substitution Grammar DMV
55.7
UAS
No paper
#27Shared Logistic Normal DMV
41.4
UAS
No paper
#28DMV
35.9
UAS
No paper