Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/ALBERT

ALBERT

Reported on 15 benchmarks across 11 tasks · 4 papers · 5 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing8 results

Dialogue UnderstandingonSpoken-SQuAD
F1 score· 2022-04-29
77.1
SOTA
End-to-end Spoken Conversational Question Answering: Task, Dataset and Model arXiv:2204.14272
Question AnsweringonMultiTQ
Hits@1· 2019-09-26
10.8
best: 79.7 (Prog-TQA)
SOTA
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations arXiv:1909.11942
Natural Language InferenceonMultiNLI
Matched· 2019-09-26
91.3
best: 92.6 (Turing NLR v5 XXL 5.4B (fine-tuned))
SOTA
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations arXiv:1909.11942
Text ClassificationonUK Key Stage Readability
F1· 2024-11-26
67.8
best: 99.6 (ELECTRA + ANN)
What Differentiates Educational Literature? A Multimodal Fusion Approach of Transformers and Computational Linguistics arXiv:2411.17593
Question AnsweringonMultiTQ
Hits@10· 2019-09-26
45.9
best: 91 (Prog-TQA)
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations arXiv:1909.11942
Natural Language InferenceonWNLI
Accuracy· 2019-09-26
91.8
best: 95.9 (Turing NLR v5 XXL 5.4B (fine-tuned))
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations arXiv:1909.11942
Semantic Textual SimilarityonSTS Benchmark
Pearson Correlation· uses extra data· 2019-09-26
0.925
best: 0.929 (MT-DNN-SMART)
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations arXiv:1909.11942
Sentiment AnalysisonSST-2 Binary classification
Accuracy· 2019-09-26
97.1
best: 97.5 (T5-11B)
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations arXiv:1909.11942

Methodology5 results

ClassificationonUK Key Stage Readability
F1· 2024-11-26
67.8
best: 99.6 (ELECTRA + ANN)
What Differentiates Educational Literature? A Multimodal Fusion Approach of Transformers and Computational Linguistics arXiv:2411.17593
Data MiningonIMDb Movie Reviews
Accuracy· 2023-08-07
93
best: 95.6 (ELECTRA)
Analysis of the Evolution of Advanced Transformer-Based Language Models: Experiments on Opinion Mining arXiv:2308.03235
Data MiningonIMDb Movie Reviews
F1· 2023-08-07
93
best: 95.6 (ELECTRA)
Analysis of the Evolution of Advanced Transformer-Based Language Models: Experiments on Opinion Mining arXiv:2308.03235
Interpretable Machine LearningonIMDb Movie Reviews
Accuracy· 2023-08-07
93
best: 95.6 (ELECTRA)
Analysis of the Evolution of Advanced Transformer-Based Language Models: Experiments on Opinion Mining arXiv:2308.03235
Interpretable Machine LearningonIMDb Movie Reviews
F1· 2023-08-07
93
best: 95.6 (ELECTRA)
Analysis of the Evolution of Advanced Transformer-Based Language Models: Experiments on Opinion Mining arXiv:2308.03235

Speech2 results

DialogueonSpoken-SQuAD
F1 score· 2022-04-29
77.1
SOTA
End-to-end Spoken Conversational Question Answering: Task, Dataset and Model arXiv:2204.14272
Spoken Language UnderstandingonSpoken-SQuAD
F1 score· 2022-04-29
77.1
SOTA
End-to-end Spoken Conversational Question Answering: Task, Dataset and Model arXiv:2204.14272