Deep learning computer-aided detection system for pneumonia in febrile neutropenia patients: a diagnostic cohort study

Table 2 Performances of the computer-aided detection system and radiologists in the reader test

Reader	Sensitivity	P value	Specificity	P value
CAD system	86.6% (58/67, 76.2–92.9%)^a	Reference	64.8% (127/196, 58.1–71.5%)^a	Reference
Radiologist-alone interpretation
Average	75.2% (252/335, 65.7–82.8%)	< 0.001^b	75.4% (739/980, 70.9–79.4%)	< 0.001^b
Radiologist A (8 years experience)	79.1% (53/67, 67.7–87.2%)	0.019^b	76.0% (149/196, 69.5–81.5%)	< 0.001^b
Radiologist B (6 years experience)	71.6% (48/67, 59.8–81.1%)	0.001^b	81.1% (159/196, 75.0–86.0%)	< 0.001^b
Radiologist C (7 years experience)	64.2% (43/67, 52.1–74.7%)	< 0.001^b	88.3% (173/196, 83.0–92.1%)	< 0.001^b
Radiologist D (7 years experience)	86.6% (58/67, 79.2–92.9%)	> 0.999^b	44.9% (88/196, 38.1–51.9%)	< 0.001^b
Radiologist E (5 years experience)	74.6% (50/67, 62.3–83.6%)	0.003^b	86.7% (170/196, 81.2–90.8%)	< 0.001^b
Interpretation with CAD
Average	79.4% (266/335, 69.9–86.5%)	0.003^c	76.8% (753/980, 72.1–81.0%)	0.101^c
Radiologist A (8 years experience)	85.1% (57/67, 74.4–91.8%)	0.039^c	75.5 (148/196, 69.0–81.0%)	0.841^c
Radiologist B (6 years experience)	76.1% (51/67, 64.5–84.8%)	0.174^c	79.6% (156/196, 73.4–84.7%)	0.365^c
Radiologist C (7 years experience)	73.1% (49/67, 61.3–82.4%)	0.010^c	87.8% (172/196, 82.4–91.7%)	0.763^c
Radiologist D (7 years experience)	86.6% (58/67, 79.2–92.9%)	> 0.999^c	53.6% (105/196, 46.6–60.4%)	< 0.001^c
Radiologist E (5 years experience)	76.1% (51/67, 64.5–84.8%)	0.314^c	87.8% (172/196, 82.4–91.7%)	0.316^c

Numbers in parentheses indicate numerators/denominators, 95% confidence intervals
The experience of each radiologist indicates the length of their experiences in the interpretation of chest X-rays
CAD, computer-aided detection
^aPerformance of the CAD system at the predefined threshold (probability score of 15%)
^bComparison of performance between the CAD system and the radiologist-alone interpretation
^cComparison of performance between radiologist-alone interpretation and interpretation with CAD

ISSN: 1471-2466