TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Medical/Language Modelling/OpenWebText

Language Modelling on OpenWebText

Metric: eval_loss (lower is better)

LeaderboardDataset
Loading chart...

Results

Submit a result
#Model↕eval_loss▲Extra DataPaperDate↕Code
1GPT2-Hermite2.91NoPolynomial, trigonometric, and tropical activati...2025-02-03Code
2GPT2-Tropical2.92NoPolynomial, trigonometric, and tropical activati...2025-02-03Code
3GPT2-Fourier2.93NoPolynomial, trigonometric, and tropical activati...2025-02-03Code
4GPT2-GELU2.95NoPolynomial, trigonometric, and tropical activati...2025-02-03Code