Skip to main content

Table 2 Performances of the computer-aided detection system and radiologists in the reader test

From: Deep learning computer-aided detection system for pneumonia in febrile neutropenia patients: a diagnostic cohort study

Reader Sensitivity P value Specificity P value
CAD system 86.6% (58/67, 76.2–92.9%)a Reference 64.8% (127/196, 58.1–71.5%)a Reference
Radiologist-alone interpretation
 Average 75.2% (252/335, 65.7–82.8%)  < 0.001b 75.4% (739/980, 70.9–79.4%)  < 0.001b
 Radiologist A (8 years experience) 79.1% (53/67, 67.7–87.2%) 0.019b 76.0% (149/196, 69.5–81.5%)  < 0.001b
 Radiologist B (6 years experience) 71.6% (48/67, 59.8–81.1%) 0.001b 81.1% (159/196, 75.0–86.0%)  < 0.001b
 Radiologist C (7 years experience) 64.2% (43/67, 52.1–74.7%)  < 0.001b 88.3% (173/196, 83.0–92.1%)  < 0.001b
 Radiologist D (7 years experience) 86.6% (58/67, 79.2–92.9%)  > 0.999b 44.9% (88/196, 38.1–51.9%)  < 0.001b
 Radiologist E (5 years experience) 74.6% (50/67, 62.3–83.6%) 0.003b 86.7% (170/196, 81.2–90.8%)  < 0.001b
Interpretation with CAD
 Average 79.4% (266/335, 69.9–86.5%) 0.003c 76.8% (753/980, 72.1–81.0%) 0.101c
 Radiologist A (8 years experience) 85.1% (57/67, 74.4–91.8%) 0.039c 75.5 (148/196, 69.0–81.0%) 0.841c
 Radiologist B (6 years experience) 76.1% (51/67, 64.5–84.8%) 0.174c 79.6% (156/196, 73.4–84.7%) 0.365c
 Radiologist C (7 years experience) 73.1% (49/67, 61.3–82.4%) 0.010c 87.8% (172/196, 82.4–91.7%) 0.763c
 Radiologist D (7 years experience) 86.6% (58/67, 79.2–92.9%)  > 0.999c 53.6% (105/196, 46.6–60.4%)  < 0.001c
 Radiologist E (5 years experience) 76.1% (51/67, 64.5–84.8%) 0.314c 87.8% (172/196, 82.4–91.7%) 0.316c
  1. Numbers in parentheses indicate numerators/denominators, 95% confidence intervals
  2. The experience of each radiologist indicates the length of their experiences in the interpretation of chest X-rays
  3. CAD, computer-aided detection
  4. aPerformance of the CAD system at the predefined threshold (probability score of 15%)
  5. bComparison of performance between the CAD system and the radiologist-alone interpretation
  6. cComparison of performance between radiologist-alone interpretation and interpretation with CAD