Table 3 Agreement of asthma ascertainment between NLP and manual chart review (criterion validity)
From: Automated chart review utilizing natural language processing algorithm for asthma predictive index
Test cohort (n = 427) | Kappa-index | Overall agreement rate | Sensitivity | Specificity | PPVa | NPVb |
|---|---|---|---|---|---|---|
Overall | 0.86 | 97% | 86% | 98% | 88% | 98% |
Sex | ||||||
 Male (n = 209) | 0.89 | 98% | 90% | 98% | 90% | 98% |
 Female (n = 218) | 0.82 | 97% | 80% | 99% | 85% | 98% |
Race | ||||||
 Caucasian (n = 315) | 0.83 | 97% | 81% | 98% | 88% | 98% |
 Non-Caucasian (n = 106) | 0.94 | 99% | 100% | 98% | 90% | 100% |
Gestational age | ||||||
 Late Preterm (n = 197) | 0.82 | 96% | 84% | 98% | 84% | 98% |
 Term (n = 230) | 0.90 | 98% | 88% | 99% | 93% | 99% |