Skip to main content

Table 3 Agreement of asthma ascertainment between NLP and manual chart review (criterion validity)

From: Automated chart review utilizing natural language processing algorithm for asthma predictive index

Test cohort (n = 427) Kappa-index Overall agreement rate Sensitivity Specificity PPVa NPVb
Overall 0.86 97% 86% 98% 88% 98%
Sex
 Male (n = 209) 0.89 98% 90% 98% 90% 98%
 Female (n = 218) 0.82 97% 80% 99% 85% 98%
Race
 Caucasian (n = 315) 0.83 97% 81% 98% 88% 98%
 Non-Caucasian (n = 106) 0.94 99% 100% 98% 90% 100%
Gestational age
 Late Preterm (n = 197) 0.82 96% 84% 98% 84% 98%
 Term (n = 230) 0.90 98% 88% 99% 93% 99%
  1. aPPV: Positive Predictive Value
  2. bNPV: Negative Predictive Value