Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/DeBERTa

DeBERTa

Reported on 25 benchmarks across 9 tasks · 4 papers · 15 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing8 results

Question AnsweringonSVAMP
Accuracy· 2023-06-24
63.5
best: 94.2 (GPT-4 DUP)
SOTA
Math Word Problem Solving by Generating Linguistic Variants of Problem Statements arXiv:2306.13899
Text ClassificationonR8
Accuracy· 2022-11-30
98.451
SOTA
Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets arXiv:2211.16878
Text ClassificationonSST-2
Accuracy· 2022-11-30
94.78
SOTA
Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets arXiv:2211.16878
Text ClassificationonSTOPS-41
Accuracy· 2022-11-30
89.73
SOTA
Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets arXiv:2211.16878
Question AnsweringonParaMAWPS
Accuracy (%)· 2020-06-05
74.1
best: 79.1 (DeBERTa (VM))
SOTA
DeBERTa: Decoding-enhanced BERT with Disentangled Attention arXiv:2006.03654
Natural Language InferenceonWNLI
Accuracy· 2020-06-05
94.5
best: 95.9 (Turing NLR v5 XXL 5.4B (fine-tuned))
SOTA
DeBERTa: Decoding-enhanced BERT with Disentangled Attention arXiv:2006.03654
Question AnsweringonSVAMP
Execution Accuracy· 2023-06-24
63.5
best: 93.9 (GPT-4 (Teaching-Inspired))
Math Word Problem Solving by Generating Linguistic Variants of Problem Statements arXiv:2306.13899
Text ClassificationonMR
Accuracy· 2022-11-30
90.21
best: 93.3 (VLAWE)
Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets arXiv:2211.16878

Methodology8 results

ClassificationonR8
Accuracy· 2022-11-30
98.451
SOTA
Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets arXiv:2211.16878
ClassificationonSST-2
Accuracy· 2022-11-30
94.78
SOTA
Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets arXiv:2211.16878
ClassificationonSTOPS-41
Accuracy· 2022-11-30
89.73
SOTA
Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets arXiv:2211.16878
Data MiningonIMDb Movie Reviews
Accuracy· 2023-08-07
95.1
best: 95.6 (ELECTRA)
Analysis of the Evolution of Advanced Transformer-Based Language Models: Experiments on Opinion Mining arXiv:2308.03235
Data MiningonIMDb Movie Reviews
F1· 2023-08-07
95.1
best: 95.6 (ELECTRA)
Analysis of the Evolution of Advanced Transformer-Based Language Models: Experiments on Opinion Mining arXiv:2308.03235
Interpretable Machine LearningonIMDb Movie Reviews
Accuracy· 2023-08-07
95.1
best: 95.6 (ELECTRA)
Analysis of the Evolution of Advanced Transformer-Based Language Models: Experiments on Opinion Mining arXiv:2308.03235
Interpretable Machine LearningonIMDb Movie Reviews
F1· 2023-08-07
95.1
best: 95.6 (ELECTRA)
Analysis of the Evolution of Advanced Transformer-Based Language Models: Experiments on Opinion Mining arXiv:2308.03235
ClassificationonMR
Accuracy· 2022-11-30
90.21
best: 93.3 (VLAWE)
Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets arXiv:2211.16878

Knowledge Base6 results

Mathematical Question AnsweringonSVAMP
Accuracy· 2023-06-24
63.5
best: 94.2 (GPT-4 DUP)
SOTA
Math Word Problem Solving by Generating Linguistic Variants of Problem Statements arXiv:2306.13899
Mathematical ReasoningonSVAMP
Accuracy· 2023-06-24
63.5
best: 94.2 (GPT-4 DUP)
SOTA
Math Word Problem Solving by Generating Linguistic Variants of Problem Statements arXiv:2306.13899
Mathematical Question AnsweringonParaMAWPS
Accuracy (%)· 2020-06-05
74.1
best: 79.1 (DeBERTa (VM))
SOTA
DeBERTa: Decoding-enhanced BERT with Disentangled Attention arXiv:2006.03654
Mathematical ReasoningonParaMAWPS
Accuracy (%)· 2020-06-05
74.1
best: 79.1 (DeBERTa (VM))
SOTA
DeBERTa: Decoding-enhanced BERT with Disentangled Attention arXiv:2006.03654
Mathematical Question AnsweringonSVAMP
Execution Accuracy· 2023-06-24
63.5
best: 93.9 (GPT-4 (Teaching-Inspired))
Math Word Problem Solving by Generating Linguistic Variants of Problem Statements arXiv:2306.13899
Mathematical ReasoningonSVAMP
Execution Accuracy· 2023-06-24
63.5
best: 93.9 (GPT-4 (Teaching-Inspired))
Math Word Problem Solving by Generating Linguistic Variants of Problem Statements arXiv:2306.13899

Reasoning3 results

Math Word Problem SolvingonSVAMP
Accuracy· 2023-06-24
63.5
best: 94.2 (GPT-4 DUP)
SOTA
Math Word Problem Solving by Generating Linguistic Variants of Problem Statements arXiv:2306.13899
Math Word Problem SolvingonParaMAWPS
Accuracy (%)· 2020-06-05
74.1
best: 79.1 (DeBERTa (VM))
SOTA
DeBERTa: Decoding-enhanced BERT with Disentangled Attention arXiv:2006.03654
Math Word Problem SolvingonSVAMP
Execution Accuracy· 2023-06-24
63.5
best: 93.9 (GPT-4 (Teaching-Inspired))
Math Word Problem Solving by Generating Linguistic Variants of Problem Statements arXiv:2306.13899