Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/ACE

ACE

Reported on 41 benchmarks across 11 tasks · 2 papers · 34 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing33 results

Part-Of-Speech TaggingonRitter
Acc· 2020-10-10
93.4
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Part-Of-Speech TaggingonARK
Acc· 2020-10-10
94.4
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Part-Of-Speech TaggingonTweebank
Acc· 2020-10-10
95.8
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Semantic ParsingonDM
In-domain· 2020-10-10
95.6
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Semantic ParsingonDM
Out-of-domain· 2020-10-10
92.6
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Semantic ParsingonPSD
In-domain· 2020-10-10
83.8
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Semantic ParsingonPSD
Out-of-domain· 2020-10-10
83.4
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Semantic ParsingonPAS
In-domain· 2020-10-10
95.8
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Semantic ParsingonPAS
Out-of-domain· 2020-10-10
94.6
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Sentiment AnalysisonSemEval-2014 Task-4
Laptop (F1)· 2020-10-10
87.4
best: 92.3 (InstructABSA)
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Sentiment AnalysisonSemEval-2014 Task-4
Restaurant (F1)· 2020-10-10
92
best: 92.76 (InstructABSA)
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Sentiment Analysison SemEval 2015 Task 12
Restaurant (F1)· 2020-10-10
80.3
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
ChunkingonCoNLL 2003 (German)
F1· 2020-10-10
95
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
ChunkingonPenn Treebank
F1 score· 2020-10-10
97.3
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
ChunkingonCoNLL 2000
Exact Span F1· 2020-10-10
97.3
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
ChunkingonCoNLL 2003 (English)
F1· 2020-10-10
92.5
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Aspect-Based Sentiment Analysis (ABSA)onSemEval-2014 Task-4
Laptop (F1)· 2020-10-10
87.4
best: 92.3 (InstructABSA)
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Aspect-Based Sentiment Analysis (ABSA)onSemEval-2014 Task-4
Restaurant (F1)· 2020-10-10
92
best: 92.76 (InstructABSA)
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Aspect-Based Sentiment Analysis (ABSA)on SemEval 2015 Task 12
Restaurant (F1)· 2020-10-10
80.3
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Shallow SyntaxonCoNLL 2003 (German)
F1· 2020-10-10
95
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Shallow SyntaxonPenn Treebank
F1 score· 2020-10-10
97.3
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Shallow SyntaxonCoNLL 2000
Exact Span F1· 2020-10-10
97.3
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Shallow SyntaxonCoNLL 2003 (English)
F1· 2020-10-10
92.5
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Aspect ExtractiononSemEval-2014 Task-4
Laptop (F1)· 2020-10-10
87.4
best: 92.3 (InstructABSA)
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Aspect ExtractiononSemEval-2014 Task-4
Restaurant (F1)· 2020-10-10
92
best: 92.76 (InstructABSA)
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Aspect Extractionon SemEval 2015 Task 12
Restaurant (F1)· 2020-10-10
80.3
SOTA
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Dependency ParsingonPenn Treebank
LAS· 2020-10-10
95.8
best: 96.26 (Label Attention Layer + HPSG + XLNet)
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Dependency ParsingonPenn Treebank
UAS· 2020-10-10
97.2
best: 97.42 (Label Attention Layer + HPSG + XLNet)
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Named Entity Recognition (NER)onCoNLL 2003 (German)
F1· 2020-10-10
87
best: 88.38 (ACE + document-context)
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Named Entity Recognition (NER)onCoNLL 2003 (English)
F1· 2020-10-10
93.64
best: 94.6 (ACE + document-context)
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Named Entity Recognition (NER)onCoNLL 2002 (Spanish)
F1· 2020-10-10
91.7
best: 95.9 (ACE + document-context)
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Named Entity Recognition (NER)onCoNLL 2002 (Dutch)
F1· 2020-10-10
94.6
best: 95.7 (ACE + document-context)
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006
Named Entity Recognition (NER)onCoNLL 2003 (German) Revised
F1· 2020-10-10
90.5
best: 92.23 (FLERT XLM-R)
Automated Concatenation of Embeddings for Structured Prediction arXiv:2010.05006

Methodology4 results

Multi-agent Reinforcement LearningonSMAC 3s5z_vs_3s6z
Median Win Rate· 2022-11-29
100
SOTA
ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency arXiv:2211.16068
Multi-agent Reinforcement LearningonSMAC corridor
Median Win Rate· 2022-11-29
100
SOTA
ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency arXiv:2211.16068
Multi-agent Reinforcement LearningonSMAC MMM2
Median Win Rate· 2022-11-29
100
SOTA
ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency arXiv:2211.16068
Multi-agent Reinforcement LearningonSMAC 6h_vs_8z
Median Win Rate· 2022-11-29
93.75
SOTA
ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency arXiv:2211.16068

Playing Games4 results

SMAConSMAC 3s5z_vs_3s6z
Median Win Rate· 2022-11-29
100
SOTA
ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency arXiv:2211.16068
SMAConSMAC corridor
Median Win Rate· 2022-11-29
100
SOTA
ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency arXiv:2211.16068
SMAConSMAC MMM2
Median Win Rate· 2022-11-29
100
SOTA
ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency arXiv:2211.16068
SMAConSMAC 6h_vs_8z
Median Win Rate· 2022-11-29
93.75
SOTA
ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency arXiv:2211.16068