Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Automated chart review utilizing natural language processing algorithm for asthma predictive index

BMC Pulmonary Medicine volume 18, Article number: 34 (2018) Cite this article

Abstract

Background

Thus far, no algorithms have been developed to automatically extract patients who meet Asthma Predictive Index (API) criteria from the Electronic health records (EHR) yet. Our objective is to develop and validate a natural language processing (NLP) algorithm to identify patients that meet API criteria.

Methods

This is a cross-sectional study nested in a birth cohort study in Olmsted County, MN. Asthma status ascertained by manual chart review based on API criteria served as gold standard. NLP-API was developed on a training cohort (n = 87) and validated on a test cohort (n = 427). Criterion validity was measured by sensitivity, specificity, positive predictive value and negative predictive value of the NLP algorithm against manual chart review for asthma status. Construct validity was determined by associations of asthma status defined by NLP-API with known risk factors for asthma.

Results

Among the eligible 427 subjects of the test cohort, 48% were males and 74% were White. Median age was 5.3 years (interquartile range 3.6–6.8). 35 (8%) had a history of asthma by NLP-API vs. 36 (8%) by abstractor with 31 by both approaches. NLP-API predicted asthma status with sensitivity 86%, specificity 98%, positive predictive value 88%, negative predictive value 98%. Asthma status by both NLP and manual chart review were significantly associated with the known asthma risk factors, such as history of allergic rhinitis, eczema, family history of asthma, and maternal history of smoking during pregnancy (p value < 0.05). Maternal smoking [odds ratio: 4.4, 95% confidence interval 1.8–10.7] was associated with asthma status determined by NLP-API and abstractor, and the effect sizes were similar between the reviews with 4.4 vs 4.2 respectively.

Conclusion

NLP-API was able to ascertain asthma status in children mining from EHR and has a potential to enhance asthma care and research through population management and large-scale studies when identifying children who meet API criteria.

Peer Review reports

Background

According to a report from the Agency for Healthcare Research and Quality, asthma is one of the five most burdensome diseases in the United States [1]. Asthma is the most common chronic illness in childhood, affecting 4–17% of children in the United States [2] and 2.8–37% of children worldwide depending on countries [3] with significant healthcare, social, and academic burden. [4, 5] Despite the availability of evidence-based guidelines for asthma management and effective asthma therapies, there has been virtually no change between 1990 and 2010 in years lived with asthma-related morbidity in the United States [2].

One of the major challenges in the current asthma research is inconsistency in study results reported in genome-wide association studies [6], clinical trials [7, 8], and studies addressing heterogeneity of asthma [9, 10], making it difficult to apply these results to clinical practice and advancement of the field. Apart from the true biological heterogeneity of asthma, other important sources of variability in the above studies include inconsistent asthma criteria (physician diagnosis vs. subjective determination based on diverse asthma criteria) and ascertainment processes (chart review vs. surveys), which may obscure a better understanding of biological heterogeneity of asthma. As an example, literature showed asthma status according to parental report was associated with significant misclassification bias [11], and studies including younger children (e.g., < 3 years old) for whom asthma diagnosis rarely occur may not use physician diagnosis nor International Classification of Diseases (ICD) codes for asthma. The latter is very important for many reasons. First, the burden of disease is greatest in preschoolers with a significantly higher proportion of emergency department visits, more hospitalizations, more sleep disturbances, and more limitation of family activities/play than older children [12, 13]. Second, the irreversible impairment in lung function may occur during the preschool period, suggesting a window of opportunity to perhaps prevent irreversible damage [14]. It is possible that the repeated and cumulative lung injury caused by various respiratory infections that are frequent at this age may be causal or important intercurrent factors affecting lung growth and asthma persistence. Despite these limitations, these approaches are still frequently used for large-scale asthma studies. While implementing laboratory tests can be considered, it can be impractical for studies based on large cohorts.

Until today, manual chart review is the most accurate method to identify asthma cases regardless of physician diagnosis of asthma, but this becomes a challenge for large-scale studies. There is an emerging need for developing a medical informatics approach like natural language processing (NLP) that processes free-text and classifies asthma status at a patient level in the era of electronic health records (EHR).

In the medical community, Asthma Predictive Index (API) [15] is a validated criterion and can be a potential option for asthma studies and help to reduce the variability described above in the future research work for asthma in children. We recently demonstrated feasibility of using NLP algorithms for an existing other asthma criteria, Predetermined Asthma Criteria [16,17,18], which was originally developed by Yunginger et al. [19] and has been used extensively in research for asthma epidemiology [20, 21]. At present, given the potential suitability of API to a retrospective study [22, 23], the recommended use of API by National Asthma Education and Prevention Program guidelines [24], and unavailability of NLP algorithm for API, developing and validating an NLP-based API algorithm would be worthwhile.

To date, there is no NLP algorithm enabling automated chart review for EHR to ascertain asthma status in children based on API. Therefore, the main aim of this study was to develop and validate an NLP algorithm to identify patients that meet API positive criteria by assessing criterion and construct validity in a retrospective study.

Methods

The study was approved by the institutional review boards at the Mayo Clinic and Olmsted Medical Center, located in Olmsted County, Minnesota.

Study setting

Demographic characteristics of the population of Rochester and Olmsted County were similar to those of the U.S. Caucasian population, with the exception of a higher proportion of the working population of this community being employed in the health care industry [19]. Olmsted County has a few important epidemiological advantages for conducting retrospective studies such as this because medical care is virtually self-contained within the community. In addition, research authorization for using medical records for research purposes is obtained from the patients the first time they ever register with a provider in the community. The rate of granting this authorization is about 95% in Olmsted County [25]. Once this permission is granted, each patient is assigned a unique identifier under the auspices of the Rochester Epidemiology Project, which has been continuously funded by the National Institute of Health (NIH) since 1966 [26]. Using this unique identifier, all clinical diagnoses and events, and detailed information from every interaction among the patients and providers are retrieved from detailed patient-based medical records [26]. As this resource has been electronically available since 1997 (i.e., the inception of the EHR at Mayo Clinic), it enables us to retrieve all asthma-related events and associated free-text information (e.g., symptoms, visits, and medications) electronically to ascertain asthma status based on API [15].

Study design

This is a cross-sectional study nested in a birth cohort study, which was designed to develop and validate an NLP algorithm for ascertaining asthma status by API (NLP-API) using convenience samples. The NLP algorithm was developed on the training cohort and evaluated on an independent test cohort for which asthma status by manual chart review (CW) was already available based on API. Criterion validity was assessed by determining concordance of asthma status by API between NLP-API and manual chart review. Construct validity of NLP-API was assessed by determining the association between asthma status ascertained by NLP algorithms and the known risk factors for asthma.

Study subjects

There were two cohorts enrolled in this study. The first cohort was used to develop the NLP algorithm (i.e., training cohort, n = 87) and the second one was used for validating the results (i.e., test cohort, n = 427). The training cohort was made up of subjects who were all born after the implementation of the EHR at the Mayo Clinic (i.e.1998–2002) [16]. Briefly, the training cohort were children who were enrolled in the Mayo Clinic sick child care program and their parents agreed to participate in a previous study assessing factors associated with parents’ care-seeking behavior for mild acute illness of young children. Of the original 115 children, subjects were excluded due to the following reasons: 1) change of research authorization status (n = 3), 2) adopted children (n = 4; one of the major criteria of API is parental history of asthma), and 3) primary care at a non-Mayo site (n = 21; NLP was only available for Mayo EHR during the study period).

The validation part of the study utilized a random sample of the 2002–2006 population-based birth cohort who had been enrolled in a previous asthma study and had medical records mainly at Mayo Clinic, Rochester, Minnesota [27]. Briefly, the original study enrolled 579 subjects comprised of 282 late-preterm infants (34 0/7 to 36 6/7 weeks of gestation) and 297 gender- and birth year-matched term infants (37 0/7 to 40 6/7 weeks of gestation) randomly selected from the 2002–2006 birth cohort born in Olmsted County, Minnesota. In this study, a total of 152 subjects were excluded due to the following reasons: 1) change in research authorization status (n = 17), 2) adopted children (n = 3), and 3) primary care outside Mayo Clinic (n = 132), leaving 427 study subjects for this present study.

Asthma predictive index (API)

The presence of asthma was defined if frequent wheezing episodes (i.e., two or more wheezing episodes within one year) AND either one of the major criteria or two of the minor criteria are satisfied (Table 1) [15, 22, 23]; otherwise, study subjects were considered non-asthmatics. An index date of asthma was defined as the earliest date when the API criteria were met. The operational procedures for API for retrospective studies were described in a previous study [23].

Table 1 Asthma Predictive Index (API) for asthmaa ascertainment
Full size table

Development of NLP algorithm for API

The overall process for the NLP-API algorithm to ascertain asthma status is depicted in Fig. 1. Our NLP algorithm used three different sources of data—i.e., clinical notes, laboratory data, and patient-provided information. Parents’ asthma information (one of major criteria) was identified from both clinical notes (family history section of the patient’s chart) and patient-provided information, and an eosinophil value was extracted from the lab data if tested for any reason. The other items of API criteria (i.e., eczema, allergic rhinitis, and wheezing ± colds) were extracted from clinical notes using pattern-based rules, assertion status (e.g., non-negated, associated with patient), and section constraints (e.g., diagnosis section). Then, we developed expert rules implementing API criteria (Table 1). Our algorithm was built in the open-source NLP pipeline MedTagger (https://sourceforge.net/projects/ohnlp/files/MedTagger/) developed by Mayo Clinic [16]. In this pipeline, there are two basic conceptual blocks to identify API-positive asthmatics. 1) A text processing component which finds evidence text in EHRs to match specific API criteria, and 2) A patient classification component which decides the patient’s API status based on available evidence.

Fig. 1
figure 1

Overview of NLP-API algorithm (Abbreviation: PPI – Patient Provided Information)

Full size image

Asthma risk factor variables

These variables were collected during the previous study [27] and utilized for this study to assess construct validity (i.e., association between NLP-API (vs. manual chart review) and asthma risk factors for comparison purpose). These included birth weight, small for gestational age, mode of delivery (Cesarean section vs. vaginal delivery), gestational age, a family history of asthma and other atopic conditions such as allergic rhinitis or atopic dermatitis, a history of patient’s allergic rhinitis or eczema, maternal smoking during pregnancy, passive smoking exposure after birth (up to the first 6 years of life), and breast-feeding history. As all asthmatics did not fulfill the same criteria, we also assessed individual items included in API as risk factors for determining construct validity.

Statistical analysis

Performance of NLP-API was assessed for both criterion and construct validity. For criterion validity, we calculated agreement rate, Kappa index, and validation index (sensitivity, specificity, positive predictive value, and negative predictive value) for concordance in asthma status between NLP-API and manual chart review as gold standard. Using logistic regression models, construct validity was assessed by determining the association of asthma status ascertained by NLP-API with the known risk factors for asthma as NLP-API is expected to be correlated with the known risk factors if NLP algorithm reflects true asthma. The associations were summarized by odds ratios and their corresponding 95% confidence intervals. All analyses were performed using JMP statistical software package (Ver 10; SAS Institute, Inc., Cary, NC).

Results

Study subjects

Characteristics of the test cohort are summarized in Table 2. 209 (48%) were male, and 315 (74%) were female. The median age (interquartile range) at the last follow-up date was 5.3 years (3.6, 6.7). 36 (8%) met the API by manual chart review, and 39 (9%) and 102 (24) had history of allergic rhinitis and eczema by physician diagnosis during the study period.

Table 2 Demographics of the test cohort
Full size table

Concordance in asthma status between NLP-API and manual chart review (criterion validity)

For the test cohort, Kappa index and agreement for asthma status between NLP algorithm and manual chart review were 0.86 and 97%, respectively. Sensitivity, specificity, positive predictive value, and negative predictive value for NLP algorithm in predicting asthma status were 86%, 98%, 88%, and 98%, respectively. Overall, these results were similar with regard to gender, ethnicity and gestational age (Table 3).

Table 3 Agreement of asthma ascertainment between NLP and manual chart review (criterion validity)
Full size table

Association of asthma status of NLP-API with the known risk factors (construct validity)

The results for construct validity are summarized in Table 4. A correlation analysis of each of the risk factors with asthma status by NLP and manual chart review was run on the test cohort independently. Asthma status by both NLP and manual chart review were significantly associated with the known asthma risk factors. For example, children with asthma compared to those without asthma had higher odds for having a history of allergic rhinitis, eczema, family history of asthma, and maternal history of smoking during pregnancy (p value < 0.05). For the factors of family history of other atopic conditions, passive smoking exposure, gestational age, birth weight, childcare attendance, and breastfeeding history, the direction and effect sizes were comparable between manual chart review and NLP-API, although the associations were not statistically significant.

Table 4 Associations of asthma status determined by NLP and manual chart review with known risk factors for asthma (construct validity)
Full size table

Discussion

Our study results suggest that developing an NLP algorithm for API mining from EHR was feasible, as demonstrated by both criterion and construct validity. Our NLP-API algorithm has a potential to overcome the current challenges for asthma ascertainment in asthma care and research, enabling large-scale asthma studies by identifying children who meet API, current asthma guideline-recommended criteria [24].

Our study results show that the NLP-API asthma status was highly correlated with manual chart review, and this concordance was not affected by gender, ethnicity, or gestational age, suggesting criterion validity (Table 3). The study findings suggest 88% positive predictive value and 99% negative predictive value for ascertaining asthma. Discrepancies between NLP-API and manual chart review were in part because 1) the abstractors reviewed parental records for parental history of asthma, but NLP used only child’s medical records (e.g., the note section of Family history), and 2) NLP often misinterpreted “cold” in “wheezing without cold” although both NLP and human abstractor used the pre-defined definition of “cold” [22, 23]. Also, the associations of known risk factors for asthma (e.g., maternal smoking during pregnancy) with the NLP-API determined asthma status were similar to those determined by manual chart review, suggesting construct validity. In contrast, the widely used method of ascertaining asthma status such as ICD-9 codes showed poor sensitivity as noted in our previous study—sensitivity of ICD codes was 31% whereas the NLP had 97% sensitivity although different asthma criteria was used [16, 28]. Studies based on self-reporting of asthma status such as questionnaire and survey data are subject to significant misclassification bias. For example, almost a quarter of parents whose children were admitted to the hospital for asthma did not report a history of asthma in their children [11]. There have been studies based on ascertaining asthma status with the help of lab tests (e.g., eosinophils) or biomarkers for asthma ascertainment [29], but these tests are impractical when a large number of patients or large study cohorts are involved. Importantly, our study results suggest that the NLP algorithm for API not only ascertains asthma status but also identifies associated individual risk factors such as a family history of asthma, allergic rhinitis, and atopic dermatitis which are part of API [30].

EHRs have been around since the 1960s when they were introduced as a technique to guide and teach medical professionals about how to handle medical knowledge [31]. In the early twenty-first century, a need for standardizing national data, as transmitting health information across organizational and regional boundaries was brought forth [32]. The Health Information Technology for Economic and Clinical Health (HITECH) Act of 2009 directed the Office of the National Coordinator for Health Information Technology (ONC) to promote the adoption and meaningful use of electronic health records. By 2014, 3 out of 4 (76%) hospitals had adopted at least a basic EHR system [33], and there are growing trends of applying EHR to clinical and translational research. For example, clinical studies are facilitating investigators in identifying the characteristics of patients and discovering phenotypes from EHR such as Electronic Medical Records and Genomics (eMERGE) [34]. NLP algorithms have been used for automated encoding of text data into structured data [35], extraction of molecular pathways from articles [36], translation of information from chest radiographs [37] as well as identification of medical complications in postoperative patients from EHR [38]. Thus, given the growing worldwide deployment of EHR systems and the usefulness of free-text embedded in medical records in capturing text-based events, an NLP algorithm will be an important tool to overcome the current challenges of processing large-scale data in disease ascertainment or phenotypic characterization.

Indeed, in our previous studies [16,17,18], we were able to establish the application of NLP algorithms for asthma ascertainment using an existing other asthma criteria, and to our knowledge, this was the first exploration to apply NLP algorithms to asthma ascertainment as other algorithms using NLP for asthma were for identifying physician diagnosis of asthma or asthma guideline, but not for applying existing asthma criteria [39,40,41]. This current study is an extension of our previous work by adding an NLP algorithm for API. Given the lack of gold standard to ascertain asthma status, National Asthma Education and Prevention Program guidelines suggest using API for asthma management. API has been used for prospective as well as retrospective studies [22, 42]. As EHRs are likely to continue to be used in clinical research described above, an NLP algorithm for API can be beneficial in the future.

Our study results have several implications in clinical practice, research, and public health. In clinical practice, it enables clinicians and health care systems to apply NLP-API for population management strategies. Using NLP-API, health care systems may identify children who meet API during early childhood (e.g., < 3 years old) on a regular basis for their better access to preventive and therapeutic interventions for asthma, and temporal and geographic trends of outcomes to these interventions may be assessed and monitored at a population level. The impact of a delay in diagnosis of asthma on asthma outcomes can also be examined. Allocation of resources could then be guided by this surveillance system. In research, while NLP-API addresses the limitations of the current methods of asthma ascertainment, it is an innovative approach enabling large-scale clinical studies minimizing methodological heterogeneity of asthma ascertainment due to human biases and mistakes when they review medical records, especially for a large volume of patients. There is a noteworthy finding in our error analysis to examine discrepancies of patient’s API status between NLP-API and manual chart review. Independent third reviewer (an allergist) assessed the discrepancies, and we found that the NLP-API was able to capture API-positive patients that were missed by manual chart review as humans could miss or overlook asthma-related events during the review of large volumes of medical records. Thus, the NLP approach might potentially open up a venue to improve or correct human errors in processing a large volume of data or text review, and this needs to be further studied. Use of a computer based algorithm for ascertaining asthma becomes helpful in public health surveillance as it allows health care systems to monitor the trends of asthma prevalence and incidence in real-time and assess the impact of asthma on serious health outcomes (e.g., susceptibility to serious and common infections including vaccine preventable diseases) [21].

The main strength of our study is the epidemiological advantages of conducting retrospective studies in a study setting that is virtually a self-contained health care environment. In addition, under the auspices of the Rochester Epidemiology Project, we were able to capture all inpatient and outpatient asthma-related events for this present study from birth to the last follow-up date [26]. Our NLP algorithm has a unique capability to determine asthma index (inception) date, which helps researchers discern temporality [22]. An additional strength of this study is the unique aspect of NLP algorithm incorporating free-text data (e.g., asthma symptoms), lab data (e.g., eosinophil count), and structured data (e.g., self-reported response collected at clinic visit).

Limitations of our study includes a retrospective study design with a relatively small sample size, and thus, we were not able to fully address the associations between asthma status and certain risk factors such as second-hand smoking exposure and breastfeeding history. Although it was not statistically significant, NLP-API still showed strong associations with the expected direction for these factors. Another potential limitation is the portability of applying NLP-API to different EHR and health care systems. Appropriate adjustments to NLP algorithms may be necessary to address the intrinsic heterogeneity of EHR in order to produce a desirable performance of NLP algorithms at a different study setting. While our previous study demonstrated the portability of NLP asthma ascertainment tool based on a different asthma criteria using EHR [18, 43], the study result of NLP-API needs to be validated in different clinical settings to ensure the portability. In addition, there were the difficulties of semantic understanding of complex assertion status in clinical narratives (e.g., identifying asthma-related concepts that are negated, hypothetical, or associated with other family members), resulting in false negatives and false positives. Intrinsic limitation of EHR reliability collected from the sources may not represent complete history of patient’s conditions (eg, parents’ asthma collected from family history section and patient provided information) and thus affect the final asthma ascertainment. Our earlier work based on a prospective cohort study showed a close correlation between medical events (mild acute illnesses) in EMR and those captured by prospective follow up [44, 45]. Lastly, our cohorts used for the training (Mayo Clinic sick child care cohort) and test (preterm-weighted cohort) from a single center may not represent general population in children.

Conclusion

In conclusion, our NLP-API algorithm may prove to be valuable not only in the research realm where it can aid with large-scale clinical studies, but it also has the ability to help the clinician as a population management tool as well becoming a method of surveillance for the public health sector.

Abbreviations

API:

Asthma Predictive Index

EHR:

Electronic Health Record

ICD:

International Classification of Diseases

NIH:

National Institute of Health

NLP:

Natural Language Processing

References

  1. Stanton MW. The High Concentration of U.S. Health Care Expenditures. Agency for Healthcare Research and Quality 2006. https://meps.ahrq.gov/data_files/publications/ra19/ra19.pdf. Accessed 23 Jan 2018. Research in Action.

  2. Centers for Disease Control and Prevention. Vital signs: asthma prevalence, disease characteristics, and self-management education: United States, 2001--2009. MMWR Morb Mortal Wkly Rep. 2011;60(17):547–52.

    Google Scholar 

  3. Asher MI, et al. Worldwide time trends in the prevalence of symptoms of asthma, allergic rhinoconjunctivitis, and eczema in childhood: ISAAC phases one and three repeat multicountry cross-sectional surveys. Lancet. 2006;368(9537):733–43.

    Article  PubMed  Google Scholar 

  4. Nurmagambetov T, et al. State-level medical and absenteeism cost of asthma in the United States. J Asthma. 2017;54(4):357–70.

    Article  PubMed  Google Scholar 

  5. Mukherjee M, et al. The epidemiology, healthcare and societal burden and costs of asthma in the UK and its member nations: analyses of standalone and linked national databases. BMC Med. 2016;14(1):113.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Deborah AM. Genetics of asthma and allergy: what have we learned? J Allergy Clin Immunol. 2010;126(3):439–46.

    Article  Google Scholar 

  7. Ducharme FM, et al. Preemptive use of high-dose Fluticasone for virus-induced wheezing in young children. N Engl J Med. 2009;360(4):339–53.

    Article  CAS  PubMed  Google Scholar 

  8. Panickar J, et al. Oral Prednisolone for preschool children with acute virus-induced wheezing. N Engl J Med. 2009;360(4):329–38.

    Article  CAS  PubMed  Google Scholar 

  9. Fitzpatrick AM, et al. Heterogeneity of severe asthma in childhood: confirmation by cluster analysis of children in the National Institutes of Health/National Heart, Lung, and Blood Institute severe asthma research program. J Allergy Clin Immunol. 2011;127(2):382–9. e13

    Article  PubMed  Google Scholar 

  10. Moore WC, et al. Identification of asthma phenotypes using cluster analysis in the severe asthma research program. Am J Respir Crit Care Med. 2010;181(4):315–23.

    Article  PubMed  Google Scholar 

  11. Miller JE, Gaboda D, Davis D. Early childhood chronic illness: comparability of maternal reports and medical records. Vital Health Stat 2. 2001;131:1–10.

    Google Scholar 

  12. Radhakrishnan DK, et al. Trends in the age of diagnosis of childhood asthma. J Allergy Clin Immunol. 2014;134(5):1057–62. e5

    Article  PubMed  Google Scholar 

  13. Kuehni CE, Frey U. Age-related differences in perceived asthma control in childhood: guidelines and reality. Eur Respir J. 2002;20(4):880–9.

    Article  CAS  PubMed  Google Scholar 

  14. Morgan WJ, et al. Outcome of asthma and wheezing in the first 6 years of life: follow-up through adolescence. Am J Respir Crit Care Med. 2005;172(10):1253–8.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Castro-Rodriguez JA, et al. A clinical index to define risk of asthma in young children with recurrent wheezing. Am J Respir Crit Care Med. 2000;162(4 Pt 1):1403–6.

    Article  CAS  PubMed  Google Scholar 

  16. Wu ST, et al. Automated chart review for asthma cohort identification using natural language processing: an exploratory study. Ann Allergy Asthma Immunol. 2013;111(5):364–9.

    Article  PubMed  Google Scholar 

  17. Wi CI, et al. Application of a natural language processing algorithm to asthma ascertainment. An automated chart review. Am J Respir Crit Care Med. 2017;196(4):430–7.

    Article  PubMed  Google Scholar 

  18. Wi, C.I., et al., Natural Language Processing for Asthma Ascertainment in Different Practice Settings. J Allergy Clin Immunol Pract, 2017. In Press; doi https://doi.org/10.1016/j.jaip.2017.04.041.

  19. Yunginger JW, et al. A community-based study of the epidemiology of asthma. Incidence rates, 1964-1983. Am Rev Respir Dis. 1992;146(4):888–94.

    Article  CAS  PubMed  Google Scholar 

  20. Yawn BP, et al. Allergic rhinitis in Rochester, Minnesota residents with asthma: frequency and impact on health care charges. J Allergy Clin Immunol. 1999;103(1 Pt 1):54–9.

    Article  CAS  PubMed  Google Scholar 

  21. Juhn YJ. Risks for infection in patients with asthma (or other atopic conditions): is asthma more than a chronic airway disease? J Allergy Clin Immunol. 2014;134(2):247.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Wi CI, et al. Risk of herpes zoster in children with asthma. Allergy Asthma Proc. 2015;36(5):372–8.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Wi CI, Park MA, Juhn YJ. Development and initial testing of asthma predictive index for a retrospective study: an exploratory study. Journal Asthma. 2015;52(2):183–90.

    Article  Google Scholar 

  24. National Asthma Education and Prevention Program. Expert Panel Report 3 (EPR-3): Guidelines for the Diagnosis and Management of Asthma-Summary Report 2007. J Allergy Clin Immunol. 2007;120(5 Suppl):S94–138.

  25. Yawn BP, et al. The impact of requiring patient authorization for use of data in medical records research. J Fam Pract. 1998;47(5):361–5.

    CAS  PubMed  Google Scholar 

  26. Rocca WA, et al. History of the Rochester epidemiology project: half a century of medical records linkage in a US population. Mayo Clinic Proc. 2012;87(12):1202–13.

    Article  Google Scholar 

  27. Voge GA, et al. What accounts for the association between late preterm births and risk of asthma? Allergy Asthma Proc. 2017;38(2):152–6.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Wi CI, et al. Application of a natural language processing algorithm to asthma ascertainment: an automated chart review. Am J Respir Crit Care Med. 2017;196(4):430–7.

    Article  PubMed  Google Scholar 

  29. Klaassen EM, et al. Exhaled biomarkers and gene expression at preschool age improve asthma prediction at 6 years of age. Am J Respir Crit Care Med. 2015;191(2):201–7.

    Article  PubMed  Google Scholar 

  30. Castro-Rodriguez, J.A., et al., Risk and Protective Factors for Childhood Asthma: What Is the Evidence? J Allergy Clin Immunol Pract. 2016. 4(6): p. 1111-1122.

  31. Weed LL. Medical records that guide and teach. N Engl J Med. 1968;278(11):593–600.

    Article  CAS  PubMed  Google Scholar 

  32. Jha AK. Meaningful use of electronic health records: the road ahead. JAMA. 2010;304(15):1709–10.

    Article  CAS  PubMed  Google Scholar 

  33. Dustin Charles, M.M.G., PhD; Talisha Searcy, MPA, MA Adoption of Electronic Health Record Systems among U.S. Non Federal Acute Care Hospitals: 2008–2014, in ONC Data Brief. 2015, Office of the National Coordinator for Health Information Technology (ONC).

  34. Kirby JC, et al. PheKB: a catalog and workflow for creating electronic phenotype algorithms for transportability. Journal of the American Medical Informatics Association: JAMIA. 2016;23(6):1046–52.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Heinze, D.T. and M.L. Morsch, Automatically assigning medical codes using natural language processing. 2005, Google Patents.

    Google Scholar 

  36. Friedman C, et al. GENIES: a natural-language processing system for the extraction of molecular pathways from journal articles. Bioinformatics. 2001;17(suppl 1):S74–82.

    Article  PubMed  Google Scholar 

  37. Hripcsak G, et al. Use of natural language processing to translate clinical information from a database of 889,921 chest radiographic reports 1. Radiology. 2002;224(1):157–63.

    Article  PubMed  Google Scholar 

  38. Murff HJ, et al. Automated identification of postoperative complications within an electronic medical record using natural language processing. JAMA. 2011;306(8):848–55.

    Article  CAS  PubMed  Google Scholar 

  39. Zeng QT, et al. Extracting principal diagnosis, co-morbidity and smoking status for asthma research: evaluation of a natural language processing system. BMC Med Inform Decis Mak. 2006;6:30.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Pacheco JA, et al. A highly specific algorithm for identifying asthma cases and controls for genome-wide association studies. AMIA Annu Symp Proc. 2009;2009:497–501. AMIA Symposium

    PubMed  PubMed Central  Google Scholar 

  41. Ertle, A.R., E.M. Campbell, and W.R. Hersh, Automated application of clinical practice guidelines for asthma management. Proceedings : a conference of the American Medical Informatics Association / ... AMIA Annual Fall Symposium. AMIA Fall Symposium, 1996: p. 552–6.

  42. Huffaker MF, Phipatanakul W. Utility of the asthma predictive index in predicting childhood asthma and identifying disease-modifying interventions. Ann Allergy Asthma Immunol. 2014;112(3):188–90.

    Article  PubMed  Google Scholar 

  43. Sohn, S., et al., Clinical documentation variations and NLP system portability: a case study in asthma birth cohorts across institutions. J Am Med Inform Assoc 2017 (Epub ahead of print).

  44. Juhn YJ, et al. The potential biases in studying the relationship between asthma and microbial infection. J Asthma. 2007;44(10):827–32.

    Article  PubMed  Google Scholar 

  45. Voigt RG, et al. Why parents seek medical evaluations for their children with mild acute illnesses. Clin Pediatr (Phila). 2008;47(3):244–51.

    Article  Google Scholar 

Download references

Acknowledgements

We thank Ms. Kelly Okeson for her administrative assistance.

Funding

This was supported by National Institute of Health (NIH)-funded R01 grant (R01 HL126667). This study also utilized the resources of the Rochester Epidemiology Project, which is supported by the National Institute on Aging of the National Institutes of Health under Award Number R01 AG034676.

Availability of data and materials

No additional data are available. Data will not be shared following the institutional IRB policy under the current IRB approval for the study protocol.

Author information

Author notes

    Authors and Affiliations

    1. Department of Pediatric and Adolescent Medicine, Mayo Clinic, 200 1st Street SW, Rochester, MN, 55905, USA

      Harsheen Kaur, Chung-Il Wi, Gretchen A. Voge & Young J. Juhn

    2. Asthma Epidemiology Research Unit, Mayo Clinic, Rochester, MN, USA

      Harsheen Kaur, Chung-Il Wi, Euijung Ryu, Gretchen A. Voge & Young J. Juhn

    3. Departement of Pediatrics, University of New Mexico, Albuquerque, NM, USA

      Harsheen Kaur

    4. Division of Biomedical Statistics and Informatics, Mayo Clinic, 200 1st Street SW, Rochester, MN, 55905, USA

      Sunghwan Sohn, Euijung Ryu & Hongfang Liu

    5. Division of Allergic Disease, Mayo Clinic, Rochester, MN, USA

      Miguel A. Park, Kay Bachman & Hirohito Kita

    6. Department of Medicine Research, Mayo Clinic, Rochester, MN, USA

      Ivana Croghan

    7. Division of Pediatrics, School of Medicine, Pontificia Universidad Catolica de Chile, Santiago, Chile

      Jose A. Castro-Rodriguez

    8. Division of Neonatology, Children’s Hospitals and Clinics of Minnesota, Minneapolis, MN, USA

      Gretchen A. Voge

    Authors
    1. Harsheen Kaur
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Sunghwan Sohn
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Chung-Il Wi
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Euijung Ryu
      View author publications

      You can also search for this author in PubMed Google Scholar

    5. Miguel A. Park
      View author publications

      You can also search for this author in PubMed Google Scholar

    6. Kay Bachman
      View author publications

      You can also search for this author in PubMed Google Scholar

    7. Hirohito Kita
      View author publications

      You can also search for this author in PubMed Google Scholar

    8. Ivana Croghan
      View author publications

      You can also search for this author in PubMed Google Scholar

    9. Jose A. Castro-Rodriguez
      View author publications

      You can also search for this author in PubMed Google Scholar

    10. Gretchen A. Voge
      View author publications

      You can also search for this author in PubMed Google Scholar

    11. Hongfang Liu
      View author publications

      You can also search for this author in PubMed Google Scholar

    12. Young J. Juhn
      View author publications

      You can also search for this author in PubMed Google Scholar

    Contributions

    YJ had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. HK: contributed to the acquisition, analysis, and interpretation of the data; drafting the manuscript and revising it for important intellectual content; and approving the final manuscript. SS: contributed to the study concept and design; acquisition, analysis, and interpretation of the data; drafting the manuscript and revising it for important intellectual content; and approving the final manuscript. CW: contributed to the study concept and design; acquisition, analysis, and interpretation of the data, revising the manuscript for important intellectual content, and approving the final version. ER: contributed to the study concept and design; acquisition, analysis, and interpretation of the data, revising the manuscript for important intellectual content, and approving the final version. MP: contributed to the study concept and design; revising the manuscript for important intellectual content, and approving the final version. KB: contributed to the study concept and design; revising the manuscript for important intellectual content, and approving the final version. HK: contributed to the study concept and design; revising the manuscript for important intellectual content, and approving the final version. IC: contributed to the study concept and design; revising the manuscript for important intellectual content, and approving the final version. JC: contributed to the study concept and design; revising the manuscript for important intellectual content, and approving the final version. GV: contributed to the acquisition of data, revising the manuscript for important intellectual content, and approving the final version. HL: contributed to the study concept and design; analysis and interpretation of the data; revising the manuscript for important intellectual content, and approving the final version. All authors read and approved the final manuscript.

    Corresponding authors

    Correspondence to Hongfang Liu or Young J. Juhn.

    Ethics declarations

    Ethics approval and consent to participate

    This study was approved by the institutional review boards at the Mayo Clinic (14–009934) and Olmsted Medical Center (008-OMC-15). General authorization to review medical records for research in accordance with Minnesota Statute was checked, and no medical records were reviewed of any child for whom the general research authorization has been refused. As some of the subjects have left the community, it is practically impossible to locate all subjects who are eligible to the study and obtain consent for this proposed study. Therefore, the need for consent was waived by the institutional review boards at two institutions mentioned above.

    Consent for publication

    Not applicable

    Competing interests

    Dr. Young Juhn is the Principal Investigator (PI) of the Innovative Asthma Research Methods Award from Genentech and the PI of Real World Evidence Pediatric Asthma Study supported by Roche/Genentech. Otherwise, the authors have nothing to disclose that pose a conflict of interest.

    Publisher’s Note

    Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

    Rights and permissions

    Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

    Reprints and permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Kaur, H., Sohn, S., Wi, CI. et al. Automated chart review utilizing natural language processing algorithm for asthma predictive index. BMC Pulm Med 18, 34 (2018). https://doi.org/10.1186/s12890-018-0593-9

    Download citation

    • Received:

    • Accepted:

    • Published:

    • DOI: https://doi.org/10.1186/s12890-018-0593-9

    Keywords

    BMC Pulmonary Medicine

    ISSN: 1471-2466

    Contact us