Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/∞-former (Sticky memories)

∞-former (Sticky memories)

Reported on 17 benchmarks across 5 tasks · 1 paper · 16 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Speech4 results

DialogueonCMU-DoG
F1· 2021-09-01
9.01
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301
DialogueonCMU-DoG
Meteor· 2021-09-01
7.55
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301
DialogueonCMU-DoG
ROUGE-1· 2021-09-01
15.37
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301
DialogueonCMU-DoG
Rouge-L· 2021-09-01
12.56
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301

Adversarial4 results

Text GenerationonCMU-DoG
F1· 2021-09-01
9.01
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301
Text GenerationonCMU-DoG
Meteor· 2021-09-01
7.55
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301
Text GenerationonCMU-DoG
ROUGE-1· 2021-09-01
15.37
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301
Text GenerationonCMU-DoG
Rouge-L· 2021-09-01
12.56
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301

Methodology4 results

ChatbotonCMU-DoG
F1· 2021-09-01
9.01
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301
ChatbotonCMU-DoG
Meteor· 2021-09-01
7.55
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301
ChatbotonCMU-DoG
ROUGE-1· 2021-09-01
15.37
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301
ChatbotonCMU-DoG
Rouge-L· 2021-09-01
12.56
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301

Natural Language Processing4 results

Dialogue GenerationonCMU-DoG
F1· 2021-09-01
9.01
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301
Dialogue GenerationonCMU-DoG
Meteor· 2021-09-01
7.55
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301
Dialogue GenerationonCMU-DoG
ROUGE-1· 2021-09-01
15.37
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301
Dialogue GenerationonCMU-DoG
Rouge-L· 2021-09-01
12.56
SOTA
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301

Medical1 result

Language ModellingonWikiText-103
Test perplexity· 2021-09-01
24.22
best: 2.4 (RETRO (7.5B))
$\infty$-former: Infinite Memory Transformer arXiv:2109.00301