Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/LAAT

LAAT

Reported on 90 benchmarks across 2 tasks · 3 papers · 8 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Medical45 results

Medical Code PredictiononMIMIC-IV-ICD-10-full
Precision@8· 2023-04-27
6697
SOTA
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-III
Precision@15· 2020-07-13
59.1
best: 62.4 (GKI-ICD)
SOTA
A Label Attention Model for ICD Coding from Clinical Text arXiv:2007.06351
Medical Code PredictiononMIMIC-III
Precision@5· 2020-07-13
81.3
best: 82.9 (RAC)
SOTA
A Label Attention Model for ICD Coding from Clinical Text arXiv:2007.06351
Medical Code PredictiononMIMIC-III
Precision@8· 2020-07-13
73.8
best: 77.7 (GKI-ICD)
SOTA
A Label Attention Model for ICD Coding from Clinical Text arXiv:2007.06351
Medical Code PredictiononMIMIC-IV-ICD10-top50
AUC (Macro)· 2023-04-27
93.21
best: 93.6 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD10-top50
AUC (Micro)· 2023-04-27
95.49
best: 95.69 (PLM-ICD)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD10-top50
F1 (macro)· 2023-04-27
68.15
best: 70.31 (PLM-ICD)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD10-top50
F1 (micro)· 2023-04-27
72.56
best: 74.15 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD10-top50
Precision@5· 2023-04-27
64.39
best: 65.16 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD9-full
F1 Macro· 2023-04-27
13.12
best: 14.4 (PLM-ICD)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD9-full
F1 Micro· 2023-04-27
60.31
best: 62.45 (PLM-ICD)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD9-full
Macro AUC· 2023-04-27
95.18
best: 96.79 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD9-full
Micro AUC· 2023-04-27
99.47
best: 99.56 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD9-full
Precision@8· 2023-04-27
67.47
best: 70.34 (PLM-ICD)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD-10-full
Macro-AUC· 2023-04-27
92.96
best: 97.07 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD-10-full
Macro-F1· 2023-04-27
4.47
best: 5.71 (Joint LAAT)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD-10-full
Micro-AUC· 2023-04-27
99.14
best: 99.61 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD-10-full
Micro-F1· 2023-04-27
55.4
best: 56.95 (PLM)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD9-top50
AUC Macro· 2023-04-27
94.88
best: 95.13 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD9-top50
AUC Micro· 2023-04-27
96.29
best: 96.46 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD9-top50
F1 Macro· 2023-04-27
69.99
best: 71.85 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD9-top50
F1 Micro· 2023-04-27
74.46
best: 75.78 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV-ICD9-top50
Precision @5· 2023-04-27
62.01
best: 62.6 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Medical Code PredictiononMIMIC-IV ICD-9
AUC Macro· 2023-04-21
96
best: 97.2 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-9
AUC Micro· 2023-04-21
99.3
best: 99.4 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-9
Exact Match Ratio· 2023-04-21
0.9
best: 1 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-9
F1 Macro· 2023-04-21
26.4
best: 29.8 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-9
F1 Micro· 2023-04-21
61.7
best: 62.6 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-9
Precision@15· 2023-04-21
52.7
best: 53.5 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-9
Precision@8· 2023-04-21
68.9
best: 70 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-9
R-Prec· 2023-04-21
61.7
best: 62.7 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-9
mAP· 2023-04-21
66.3
best: 68 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-10
AUC Macro· 2023-04-21
95.4
best: 96.6 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-10
AUC Micro· 2023-04-21
99
best: 99.2 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-10
Exact Match Ratio· 2023-04-21
0.4
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-10
F1 Macro· 2023-04-21
20.3
best: 21.1 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-10
F1 Micro· 2023-04-21
57.9
best: 58.5 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-10
Precision@15· 2023-04-21
54.3
best: 55 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-10
Precision@8· 2023-04-21
68.9
best: 69.9 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-10
R-Prec· 2023-04-21
57.2
best: 57.9 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-IV ICD-10
mAP· 2023-04-21
60.6
best: 61.9 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Medical Code PredictiononMIMIC-III
Macro-AUC· 2020-07-13
91.9
best: 96.2 (GKI-ICD)
A Label Attention Model for ICD Coding from Clinical Text arXiv:2007.06351
Medical Code PredictiononMIMIC-III
Macro-F1· 2020-07-13
9.9
best: 24.7 (PLM-CA)
A Label Attention Model for ICD Coding from Clinical Text arXiv:2007.06351
Medical Code PredictiononMIMIC-III
Micro-AUC· 2020-07-13
98.8
best: 99.3 (GKI-ICD)
A Label Attention Model for ICD Coding from Clinical Text arXiv:2007.06351
Medical Code PredictiononMIMIC-III
Micro-F1· 2020-07-13
57.5
best: 61.2 (GKI-ICD)
A Label Attention Model for ICD Coding from Clinical Text arXiv:2007.06351

Methodology45 results

Multi-Label ClassificationonMIMIC-IV-ICD-10-full
Precision@8· 2023-04-27
6697
SOTA
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-III
Precision@15· 2020-07-13
59.1
best: 62.4 (GKI-ICD)
SOTA
A Label Attention Model for ICD Coding from Clinical Text arXiv:2007.06351
Multi-Label ClassificationonMIMIC-III
Precision@5· 2020-07-13
81.3
best: 82.9 (RAC)
SOTA
A Label Attention Model for ICD Coding from Clinical Text arXiv:2007.06351
Multi-Label ClassificationonMIMIC-III
Precision@8· 2020-07-13
73.8
best: 77.7 (GKI-ICD)
SOTA
A Label Attention Model for ICD Coding from Clinical Text arXiv:2007.06351
Multi-Label ClassificationonMIMIC-IV-ICD10-top50
AUC (Macro)· 2023-04-27
93.21
best: 93.6 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD10-top50
AUC (Micro)· 2023-04-27
95.49
best: 95.69 (PLM-ICD)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD10-top50
F1 (macro)· 2023-04-27
68.15
best: 70.31 (PLM-ICD)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD10-top50
F1 (micro)· 2023-04-27
72.56
best: 74.15 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD10-top50
Precision@5· 2023-04-27
64.39
best: 65.16 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD9-full
F1 Macro· 2023-04-27
13.12
best: 14.4 (PLM-ICD)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD9-full
F1 Micro· 2023-04-27
60.31
best: 62.45 (PLM-ICD)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD9-full
Macro AUC· 2023-04-27
95.18
best: 96.79 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD9-full
Micro AUC· 2023-04-27
99.47
best: 99.56 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD9-full
Precision@8· 2023-04-27
67.47
best: 70.34 (PLM-ICD)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD-10-full
Macro-AUC· 2023-04-27
92.96
best: 97.07 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD-10-full
Macro-F1· 2023-04-27
4.47
best: 5.71 (Joint LAAT)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD-10-full
Micro-AUC· 2023-04-27
99.14
best: 99.61 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD-10-full
Micro-F1· 2023-04-27
55.4
best: 56.95 (PLM)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD9-top50
AUC Macro· 2023-04-27
94.88
best: 95.13 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD9-top50
AUC Micro· 2023-04-27
96.29
best: 96.46 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD9-top50
F1 Macro· 2023-04-27
69.99
best: 71.85 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD9-top50
F1 Micro· 2023-04-27
74.46
best: 75.78 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV-ICD9-top50
Precision @5· 2023-04-27
62.01
best: 62.6 (MSMN)
Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classification arXiv:2304.13998
Multi-Label ClassificationonMIMIC-IV ICD-9
AUC Macro· 2023-04-21
96
best: 97.2 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-9
AUC Micro· 2023-04-21
99.3
best: 99.4 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-9
Exact Match Ratio· 2023-04-21
0.9
best: 1 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-9
F1 Macro· 2023-04-21
26.4
best: 29.8 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-9
F1 Micro· 2023-04-21
61.7
best: 62.6 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-9
Precision@15· 2023-04-21
52.7
best: 53.5 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-9
Precision@8· 2023-04-21
68.9
best: 70 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-9
R-Prec· 2023-04-21
61.7
best: 62.7 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-9
mAP· 2023-04-21
66.3
best: 68 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-10
AUC Macro· 2023-04-21
95.4
best: 96.6 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-10
AUC Micro· 2023-04-21
99
best: 99.2 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-10
Exact Match Ratio· 2023-04-21
0.4
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-10
F1 Macro· 2023-04-21
20.3
best: 21.1 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-10
F1 Micro· 2023-04-21
57.9
best: 58.5 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-10
Precision@15· 2023-04-21
54.3
best: 55 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-10
Precision@8· 2023-04-21
68.9
best: 69.9 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-10
R-Prec· 2023-04-21
57.2
best: 57.9 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-IV ICD-10
mAP· 2023-04-21
60.6
best: 61.9 (PLM-ICD)
Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Study arXiv:2304.10909
Multi-Label ClassificationonMIMIC-III
Macro-AUC· 2020-07-13
91.9
best: 96.2 (GKI-ICD)
A Label Attention Model for ICD Coding from Clinical Text arXiv:2007.06351
Multi-Label ClassificationonMIMIC-III
Macro-F1· 2020-07-13
9.9
best: 24.7 (PLM-CA)
A Label Attention Model for ICD Coding from Clinical Text arXiv:2007.06351
Multi-Label ClassificationonMIMIC-III
Micro-AUC· 2020-07-13
98.8
best: 99.3 (GKI-ICD)
A Label Attention Model for ICD Coding from Clinical Text arXiv:2007.06351
Multi-Label ClassificationonMIMIC-III
Micro-F1· 2020-07-13
57.5
best: 61.2 (GKI-ICD)
A Label Attention Model for ICD Coding from Clinical Text arXiv:2007.06351