TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Medical/Language Modelling/OpenWebText

Language Modelling on OpenWebText

Metric: eval_perplexity (lower is better)

LeaderboardDataset
Loading chart...

Results

Submit a result
#Model↕eval_perplexity▲Extra DataPaperDate↕Code
1MDLM-Prime15.36NoBeyond Masked and Unmasked: Discrete Diffusion M...2025-05-24-
2ARM17.54NoSimple and Effective Masked Diffusion Language M...2024-06-11Code
3EDLM-coAR17.58NoEnergy-Based Diffusion Language Models for Text ...2024-10-28-
4GPT2-Hermite18.39NoPolynomial, trigonometric, and tropical activati...2025-02-03Code
5GPT2-Tropical18.64NoPolynomial, trigonometric, and tropical activati...2025-02-03Code
6GPT2-Fourier18.72NoPolynomial, trigonometric, and tropical activati...2025-02-03Code
7GPT2-GELU19.24NoPolynomial, trigonometric, and tropical activati...2025-02-03Code
8BD3-LMs20.73NoBlock Diffusion: Interpolating Between Autoregre...2025-03-12Code
9EDLM-NCE21.52NoEnergy-Based Diffusion Language Models for Text ...2024-10-28-
10GenMD421.8NoSimplified and Generalized Masked Diffusion for ...2024-06-06Code
11MDLM22.98NoSimple and Effective Masked Diffusion Language M...2024-06-11Code
12SEDD24.1NoDiscrete Diffusion Modeling by Estimating the Ra...2023-10-25Code