James Mullenbach, Sarah Wiegreffe, Jon Duke, Jimeng Sun, Jacob Eisenstein
Clinical notes are text documents that are created by clinicians for each patient encounter. They are typically accompanied by medical codes, which describe the diagnosis and treatment. Annotating these codes is labor intensive and error prone; furthermore, the connection between the codes and the text is not annotated, obscuring the reasons and details behind specific diagnoses and treatments. We present an attentional convolutional network that predicts medical codes from clinical text. Our method aggregates information across the document using a convolutional neural network, and uses an attention mechanism to select the most relevant segments for each of the thousands of possible codes. The method is accurate, achieving precision@8 of 0.71 and a Micro-F1 of 0.54, which are both better than the prior state of the art. Furthermore, through an interpretability evaluation by a physician, we show that the attention mechanism identifies meaningful explanations for each code assignment
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Medical Code Prediction | MIMIC-III | Macro-AUC | 89.5 | CAML |
| Medical Code Prediction | MIMIC-III | Macro-F1 | 8.8 | CAML |
| Medical Code Prediction | MIMIC-III | Micro-AUC | 98.6 | CAML |
| Medical Code Prediction | MIMIC-III | Micro-F1 | 53.9 | CAML |
| Medical Code Prediction | MIMIC-III | Precision@15 | 56.1 | CAML |
| Medical Code Prediction | MIMIC-III | Precision@8 | 70.9 | CAML |
| Medical Code Prediction | MIMIC-III | Macro-AUC | 89.7 | DR-CAML |
| Medical Code Prediction | MIMIC-III | Macro-F1 | 8.6 | DR-CAML |
| Medical Code Prediction | MIMIC-III | Micro-AUC | 98.5 | DR-CAML |
| Medical Code Prediction | MIMIC-III | Micro-F1 | 52.9 | DR-CAML |
| Medical Code Prediction | MIMIC-III | Precision@15 | 54.8 | DR-CAML |
| Medical Code Prediction | MIMIC-III | Precision@8 | 69 | DR-CAML |
| Medical Code Prediction | MIMIC-III | Micro-F1 | 44.1 | SVM |
| Medical Code Prediction | MIMIC-III | Macro-AUC | 80.6 | CNN |
| Medical Code Prediction | MIMIC-III | Macro-F1 | 4.2 | CNN |
| Medical Code Prediction | MIMIC-III | Micro-AUC | 96.9 | CNN |
| Medical Code Prediction | MIMIC-III | Micro-F1 | 41.9 | CNN |
| Medical Code Prediction | MIMIC-III | Precision@15 | 44.3 | CNN |
| Medical Code Prediction | MIMIC-III | Precision@8 | 58.1 | CNN |
| Medical Code Prediction | MIMIC-III | Macro-AUC | 82.2 | Bi-GRU |
| Medical Code Prediction | MIMIC-III | Macro-F1 | 3.8 | Bi-GRU |
| Medical Code Prediction | MIMIC-III | Micro-AUC | 97.1 | Bi-GRU |
| Medical Code Prediction | MIMIC-III | Micro-F1 | 41.7 | Bi-GRU |
| Medical Code Prediction | MIMIC-III | Precision@15 | 44.5 | Bi-GRU |
| Medical Code Prediction | MIMIC-III | Precision@8 | 58.5 | Bi-GRU |
| Medical Code Prediction | MIMIC-III | Macro-AUC | 56.1 | Logistic Regression |
| Medical Code Prediction | MIMIC-III | Macro-F1 | 1.1 | Logistic Regression |
| Medical Code Prediction | MIMIC-III | Micro-AUC | 93.7 | Logistic Regression |
| Medical Code Prediction | MIMIC-III | Micro-F1 | 27.2 | Logistic Regression |
| Medical Code Prediction | MIMIC-III | Precision@15 | 41.1 | Logistic Regression |
| Medical Code Prediction | MIMIC-III | Precision@8 | 54.2 | Logistic Regression |
| Multi-Label Classification | MIMIC-III | Macro-AUC | 89.5 | CAML |
| Multi-Label Classification | MIMIC-III | Macro-F1 | 8.8 | CAML |
| Multi-Label Classification | MIMIC-III | Micro-AUC | 98.6 | CAML |
| Multi-Label Classification | MIMIC-III | Micro-F1 | 53.9 | CAML |
| Multi-Label Classification | MIMIC-III | Precision@15 | 56.1 | CAML |
| Multi-Label Classification | MIMIC-III | Precision@8 | 70.9 | CAML |
| Multi-Label Classification | MIMIC-III | Macro-AUC | 89.7 | DR-CAML |
| Multi-Label Classification | MIMIC-III | Macro-F1 | 8.6 | DR-CAML |
| Multi-Label Classification | MIMIC-III | Micro-AUC | 98.5 | DR-CAML |
| Multi-Label Classification | MIMIC-III | Micro-F1 | 52.9 | DR-CAML |
| Multi-Label Classification | MIMIC-III | Precision@15 | 54.8 | DR-CAML |
| Multi-Label Classification | MIMIC-III | Precision@8 | 69 | DR-CAML |
| Multi-Label Classification | MIMIC-III | Micro-F1 | 44.1 | SVM |
| Multi-Label Classification | MIMIC-III | Macro-AUC | 80.6 | CNN |
| Multi-Label Classification | MIMIC-III | Macro-F1 | 4.2 | CNN |
| Multi-Label Classification | MIMIC-III | Micro-AUC | 96.9 | CNN |
| Multi-Label Classification | MIMIC-III | Micro-F1 | 41.9 | CNN |
| Multi-Label Classification | MIMIC-III | Precision@15 | 44.3 | CNN |
| Multi-Label Classification | MIMIC-III | Precision@8 | 58.1 | CNN |
| Multi-Label Classification | MIMIC-III | Macro-AUC | 82.2 | Bi-GRU |
| Multi-Label Classification | MIMIC-III | Macro-F1 | 3.8 | Bi-GRU |
| Multi-Label Classification | MIMIC-III | Micro-AUC | 97.1 | Bi-GRU |
| Multi-Label Classification | MIMIC-III | Micro-F1 | 41.7 | Bi-GRU |
| Multi-Label Classification | MIMIC-III | Precision@15 | 44.5 | Bi-GRU |
| Multi-Label Classification | MIMIC-III | Precision@8 | 58.5 | Bi-GRU |
| Multi-Label Classification | MIMIC-III | Macro-AUC | 56.1 | Logistic Regression |
| Multi-Label Classification | MIMIC-III | Macro-F1 | 1.1 | Logistic Regression |
| Multi-Label Classification | MIMIC-III | Micro-AUC | 93.7 | Logistic Regression |
| Multi-Label Classification | MIMIC-III | Micro-F1 | 27.2 | Logistic Regression |
| Multi-Label Classification | MIMIC-III | Precision@15 | 41.1 | Logistic Regression |
| Multi-Label Classification | MIMIC-III | Precision@8 | 54.2 | Logistic Regression |