Differences in classification of COPD group using COPD assessment test (CAT) or modified Medical Research Council (mMRC) dyspnea scores: a cross-sectional analyses
BMC Pulmonary Medicine volume 13, Article number: 35 (2013)
The GOLD 2011 document proposed a new classification system for COPD combining symptom assessment by COPD assessment test (CAT) or modified Medical Research Council (mMRC) dyspnea scores, and exacerbation risk. We postulated that classification of COPD would be different by the symptom scale; CAT vs mMRC.
Outpatients with COPD were enrolled from January to June in 2012. The patients were categorized into A, B, C, and D according to the GOLD 2011; patients were categorized twice with mMRC and CAT score for symptom assessment, respectively. Additionally, correlations between mMRC scores and each item of CAT scores were analyzed.
Classification of 257 patients using the CAT score vs mMRC scale was as follows. By using CAT score, 60 (23.3%) patients were assigned to group A, 55 (21.4%) to group B, 21 (8.2%) to group C, and 121 (47.1%) to group D. On the basis of the mMRC scale, 97 (37.7%) patients were assigned to group A, 18 (7.0%) to group B, 62 (24.1%) to group C, and 80 (31.1%) to group D. The kappa of agreement for the GOLD groups classified by CAT and mMRC was 0.510. The mMRC score displayed a wide range of correlation with each CAT item (r = 0.290 for sputum item to r = 0.731 for dyspnea item, p < 0.001).
The classification of COPD produced by the mMRC or CAT score was not identical. Care should be taken when stratifying COPD patients with one symptom scale versus another according to the GOLD 2011 document.
Chronic obstructive pulmonary disease (COPD) is characterized by persistent airflow limitation . The degree of airflow limitation is associated with many disease outcomes but was poorly predictive of dyspnea and quality of life [2–4]. Lung function alone does not explain the heterogeneous features of COPD [5, 6]. Therefore, the Global Initiative for Chronic Obstructive Lung Disease (GOLD) 2011 document proposed a new classification system for COPD, combining symptom assessment and exacerbation risk including spirometry to identify disease severity .
For assessing symptoms, GOLD 2011 primarily recommends the use of the Modified.
British Medical Research Council (mMRC) questionnaire or the COPD Assessment Test (CAT). The mMRC scale is a 5-point (0–4) scale based on the severity of dyspnea . The CAT comprises eight items relating to the severity of cough, sputum, dyspnea, chest tightness, capacity for exercise and activities, confidence, sleep quality and energy levels  while mMRC scale is a quantitative assessment tool only for breathlessness. These questionnaires are used to distinguish patients with less severe symptoms from patients with more severe symptoms; low vs high symptoms in the new GOLD 2011. However, a recent report indicated that group assignment of COPD patients could be different by the symptom scale that is used ; Han ML et al. used mMRC and SGRQ scores (as a surrogate of CAT scores) for assessing symptoms of COPD. The group assignment of COPD patients by mMRC vs SGRQ was not identical .
Hence, this study was performed to see whether the classification of COPD group according to GOLD 2011 would be identical irrespective of symptom scales (mMRC vs CAT score), and to evaluate the associations between two symptom scales.
Patients were recruited at outpatient clinics from the department of pulmonology, Chonnam National University hospital in South Korea. The flow chart for selecting patients is shown in Figure 1. All consecutive patients of the clinic were screened for eligibility from Jan to June, 2012 if they were aged 45–85 years. Patients must also have had the ability to undertake spirometry and answer to the questionnaire; CAT and mMRC. Those with active respiratory disorder such as pneumonia, diffuse bronchiectasis and interstitial lung disease were excluded. COPD was defined according to the GOLD criteria : a postbronchodilator FEV1/FVC (forced expiratory volume in 1s/forced vital capacity) ratio below 0.70. Among 378 patients who responded the questionnaires and met the eligibility requirements, 121 subjects did not have airflow obstruction as defined by FEV1/FVC <0.70 and therefore they were excluded in this study. We analyzed the data from 257 patients with COPD. This study was approved by the ethics and review boards of Chonnam National University Hospital. All subjects gave informed consent to the work.
Symptoms were quantified with both the mMRC  and the CAT  (http://www.catestonline.org). The mMRC scale 0–4 was developed by the American Thoracic Society as a modification of the originally proposed British Medical Research Council dyspnea index (scale 1–5) . The CAT consists of 8 items. Each item is scored from 0 to 5. An overall score is calculated by adding the score from each item; a total score ranging from 0 to 40. We determined the distribution of COPD patients with the mMRC and with the CAT. According to the GOLD 2011 classification , patients were stratified with either mMRC score (0–1 vs ≥2) or CAT score (<10 or ≥10) resulting in two low-symptom categories (A and C) and two high-symptom categories (B and D). Exacerbation risk was assessed with either FEV1% predicted (<50% or ≥50%), or COPD exacerbation history (0–1 vs ≥2) in the previous year to stratify patients into low-risk groups (A and B) versus high-risk groups(C and D). An exacerbation was defined as an acute event characterized by a worsening of the patient’s respiratory symptoms that is beyond normal day to day variations and leads to a change in medication [1, 11]. The number of exacerbations in the previous year was taken from patients’ history at the same time when mMRC and CAT score were measured. Patients underwent standardized spirometry before and after the inhalation of 10 mg of salbutamol by nebulizer . Finally, the patients with COPD were categorized into A, B, C, and D combining symptom assessment by COPD assessment test (CAT) or modified Medical Research Council (mMRC) dyspnea scores, and exacerbation risk according to the 2011 GOLD report.
All statistical analyses were done with IBM SPSS Windows version 20.0. All data are presented as mean (SD) where appropriate. Kappa coefficient is used to interpret the extent of agreement between two symptom scales (mMRC vs CAT). The discussion of agreement in this study is based on kappa value as described previously in the literature in which k < 0.00 is “poor,” 0 < k < 0.02 is “slight,” 0.21 < k < 0.40 is “fair,” 0.41 < k < 0.60 is “moderate,” 0.61 < k < 0.80 is “substantial,” 0.81 < k < 1.00 is “almost perfect”, and k = 1 is “perfect” agreement . The correlation between mMRC dyspnea score and CAT score was examined using the Spearman rank correlation coefficient (rho), because the MRC dyspnea score is an ordinal categorical variable. Differences were considered statistically significant when p < 0.05.
From January to June in 2012, 257 patients with COPD completed the questionnaire; CAT and mMRC dyspnea scale. Characteristics of subjects (mean age 67.4 ± 9.4 years; 203 men, 54 women) are summarized in Table 1. The mean body mass index (BMI) was 22.7 kg/m2. The majority of subjects were cigarette smokers (n = 182, 70.8%). Fifty subjects (19.5%) were high risks based on GOLD’s spirometric criteria (FEV1 < 50%), and 132 (51.4%) subjects were high risk according to the number of exacerbations of COPD (≥2 exacerbations in the previous year). Mean mMRC and CAT scores were 1.5 and 15.7, respectively.
Group assignments using the mMRC scale and CAT score were shown in Table 2 and 3. Among 257 COPD patients, using mMRC scale (Table 2), 97 (37.7%) patients were assigned to group A, 18 (7.0%) to group B, 62 (24.1%) to group C, and 80 (31.1%) to group D; on the basis of the CAT score (Table 3), 60 (23.3%) patients were assigned to group A, 55 (21.4%) to group B, 21 (8.2%) to group C, and 121 (47.1%) to group D. When the stratification of symptom group was done by CAT scores, the proportion of high symptom groups was increased. The kappa of agreement for the GOLD groups by CAT and mMRC was 0.510, suggesting moderate not substantial agreement. To investigate why symptoms groups were not identical between CAT and mMRC, we displayed the distributions of total CAT scores that were stratified into four groups at every mMRC level (Table 4). Within each mMRC level, there was a wide heterogeneous distribution of CAT scores. The mMRC score of 2 corresponded with a mean CAT score of 21 (SD 8), whereas the mMRC score of 1 corresponded to a mean CAT score of 13 (SD 6).
The correlations between mMRC scores and each CAT item were shown in Table 5. The mMRC scores displayed a wide range of correlation with each CAT item (r = 0.290 ~ 0.731; p < 0.0001). Of the CAT items, the dyspnea item had the strongest correlation with the mMRC scores (r = 0.731, p < 0.001). However, the correlation between mMRC and the item of sputum in CAT was not strong (r = 0.290, p < 0.001).
A main finding of this study was that the group classification of COPD produced by each symptom scale was not identical because the distributions of CAT scores were heterogeneous at every mMRC level. The group classification is important because treatment is recommended according to the groups of COPD in the 2011 GOLD.
The mMRC scale is widely used to measure breathlessness because of brevity and simplicity . However, it is a unidimensional measurement to quantify only dyspnea. The CAT score is a multidimensional method, which assess 8 items; not only dyspnea but also other symptoms and health status [8, 14]. It has proposed as a new tool for assessment of COPD health status in daily practice since it has the advantage of being easy to perform and it can be associated with clinically important variables (FEV1%, exacerbation as well as MRC dyspnea scale) [15, 16]. And, the CAT has good repeatability  and is responsive to exacerbation onset and recovery .
GOLD 2011 recommends the CAT or mMRC scores to distinguish the symptom groups (high vs low symptoms). And, GOLD mentioned that it is unnecessary to use more than one symptom scale. However, a wide range of CAT scores was seen at each mMRC score in our study. The group assignment of COPD patients by each symptom scale was different. As the symptomatic cutpoint to differentiate the symptom groups, GOLD proposed either CAT score of 10 or mMRC score of 2. But, this study showed that an mMRC of 2 did not correspond with a CAT of 10. An mMRC of 1 was comparable to a CAT of 10. These results support a recent report  Han et al. used St George’s Respiratory Questionnaire (SGRQ) score as a surrogate for the CAT score to assess symptoms. The choice of symptom measure influenced category assignment of COPD. And, the mMRC score of 1 corresponded with an SGRQ of 25 that is similar with a CAT score of 10 .
The above findings suggest that refinement for differentiating symptom groups would be needed. The one refinement method is the change of cutpoint for mMRC from 2 to 1 because an mMRC of 1 corresponds to a CAT of 10. When the patients of our study were stratified using mMRC ≥1 as the symptomatic cutpoint, the kappa agreement between the groups by mMRC and CAT was more improved 0.510 into 0.649 (Table 6). However, the agreement between them was not perfect. This suggests that patients classified by the two symptom metrics will not be identical irrespective of changes of symptom’s cutpoint. This can be also supported by Han et al.’s report . Another potential refinement method is as follows: To stratify symptom groups in COPD, both CAT and mMRC should be measured routinely. Then, symptom group would be determined by symptom scales showing the higher score like assessment of exacerbation risk using FEV1 and previous exacerbation history. This method can be considered in the future revision of COPD stratification. However, the different categories for both symptom and exacerbation assessment could be more demanding without treatment consequences. This issue also should be further studied in the future to improve the assessment and management of COPD.
Secondary finding of this study is that all of each CAT item was found to have significant correlations with mMRC scores. However, it had a wide range of correlation coefficients. The mMRC score is the most strongly correlated with dyspnea item of CAT while the correlations of mMRC with other items of CAT were less strong. This is not a surprising result since mMRC is an indicator of breathlessness. Also, this could suggest that mMRC scale only for breathlessness cannot be identical with CAT score and it cannot be used as a surrogate of CAT score.
We acknowledge a major limitation of this study. The subjects were the patients who referred from primary clinics and were recruited from a single center. Our results, however, are comparable with a recent, multicenter study. An advantage of this study is that the mMRC and CAT were compared directly regarding to the recent GOLD report. The other weakness of this study is that the prospective analysis of exacerbation was not included. A prospective study will be needed to explore the clinical impacts of stratification of COPD on future exacerbations and treatments in patients with COPD.
In conclusion, the GOLD 2011 recommends the use of mMRC or CAT scores for assessing symptoms. However, we showed that choice of symptom scale can alter group assignment of COPD because mMRC and CAT do not behave identically in distinguishing symptom groups. A refinement of the GOLD classification should be considered in the future.
Chronic obstructive pulmonary disease
COPD assessment test
- mMRC scores:
modified Medical Research Council (mMRC) dyspnea scores.
Vestbo J, Hurd SS, Agusti AG, Jones PW, Vogelmeier C, Anzueto A, Barnes PJ, Fabbri LM, Martinez FJ, Nishimura M, et al: Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease: GOLD executive summary. Am J Respir Crit Care Med. 2013, 187 (4): 347-365. 10.1164/rccm.201204-0596PP.
Garcia-Aymerich J, Serra Pons I, Mannino DM, Maas AK, Miller DP, Davis KJ: Lung function impairment, COPD hospitalisations and subsequent mortality. Thorax. 2011, 66 (7): 585-590. 10.1136/thx.2010.152876.
Hurst JR, Vestbo J, Anzueto A, Locantore N, Mullerova H, Tal-Singer R, Miller B, Lomas DA, Agusti A, Macnee W, et al: Susceptibility to exacerbation in chronic obstructive pulmonary disease. N Engl J Med. 2010, 363 (12): 1128-1138. 10.1056/NEJMoa0909883.
Weatherall M, Marsh S, Shirtcliffe P, Williams M, Travers J, Beasley R: Quality of life measured by the St George’s Respiratory Questionnaire and spirometry. Eur Respir J. 2009, 33 (5): 1025-1030. 10.1183/09031936.00116808.
Agusti A, Calverley PM, Celli B, Coxson HO, Edwards LD, Lomas DA, MacNee W, Miller BE, Rennard S, Silverman EK, et al: Characterisation of COPD heterogeneity in the ECLIPSE cohort. Respir Res. 2010, 11: 122-
Papaioannou AI, Loukides S, Gourgoulianis KI, Kostikas K: Global assessment of the COPD patient: time to look beyond FEV1?. Respir Med. 2009, 103 (5): 650-660. 10.1016/j.rmed.2009.01.001.
Bestall JC, Paul EA, Garrod R, Garnham R, Jones PW, Wedzicha JA: Usefulness of the Medical Research Council (MRC) dyspnoea scale as a measure of disability in patients with chronic obstructive pulmonary disease. Thorax. 1999, 54 (7): 581-586. 10.1136/thx.54.7.581.
Jones PW, Harding G, Berry P, Wiklund I, Chen WH, Kline Leidy N: Development and first validation of the COPD Assessment Test. Eur Respir J. 2009, 34 (3): 648-654. 10.1183/09031936.00102509.
Han MK, Muellerova H, Curran-Everett D, Dransfield MT, Washko GR, Regan EA, Bowler RP, Beaty TH, Hokanson JE, Lynch DA, et al: GOLD 2011 disease severity classification in COPDGene: a prospective cohort study. Lancet Respir Med. 2013, 1 (1): 43-50. 10.1016/S2213-2600(12)70044-9.
Fletcher CM, Elmes PC, Fairbairn AS, Wood CH: The significance of respiratory symptoms and the diagnosis of chronic bronchitis in a working population. Br Med J. 1959, 2 (5147): 257-266. 10.1136/bmj.2.5147.257.
Celli BR, Barnes PJ: Exacerbations of chronic obstructive pulmonary disease. Eur Respir J. 2007, 29 (6): 1224-1238. 10.1183/09031936.00109906.
American Thoracic Society: Standardization of Spirometry, 1994 Update. Am J Respir Crit Care Med. 1995, 152 (3): 1107-1136.
Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33 (1): 159-174. 10.2307/2529310.
Tsiligianni IG, van der Molen T, Moraitaki D, Lopez I, Kocks JW, Karagiannis K, Siafakas N, Tzanakis N: Assessing health status in COPD. A head-to-head comparison between the COPD assessment test (CAT) and the clinical COPD questionnaire (CCQ). BMC Pulm Med. 2012, 12: 20-10.1186/1471-2466-12-20.
Kelly JL, Bamsey O, Smith C, Lord VM, Shrikrishna D, Jones PW, Polkey MI, Hopkinson NS: Health status assessment in routine clinical practice: the chronic obstructive pulmonary disease assessment test score in outpatients. Respiration. 2012, 84 (3): 193-199. 10.1159/000336549.
Scichilone N, Chetta A: It’s Time to Let the ‘CAT’ out…Patient!. Respiration. 2012, 84 (3): 189-190. 10.1159/000337272.
Jones PW, Brusselle G, Dal Negro RW, Ferrer M, Kardos P, Levy ML, Perez T, Soler Cataluna JJ, van der Molen T, Adamek L, et al: Properties of the COPD assessment test in a cross-sectional European study. Eur Respir J. 2011, 38 (1): 29-35. 10.1183/09031936.00177210.
Mackay AJ, Donaldson GC, Patel AR, Jones PW, Hurst JR, Wedzicha JA: Usefulness of the Chronic Obstructive Pulmonary Disease Assessment Test to evaluate severity of COPD exacerbations. Am J Respir Crit Care Med. 2012, 185 (11): 1218-1224. 10.1164/rccm.201110-1843OC.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2466/13/35/prepub
This study was supported by a grant (CRI11008-1) of the Chonnam National University Hospital Research Institute of Clinical Medicine.
The authors declare that they have no competing interests.
All of the authors participated in the conception and design of the study; the data collection; revising and approval of the manuscript. SK contributed to writing of the manuscript. YK was responsible for all phases of funding, study design, analysis and manuscript preparation. All authors have read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Kim, S., Oh, J., Kim, YI. et al. Differences in classification of COPD group using COPD assessment test (CAT) or modified Medical Research Council (mMRC) dyspnea scores: a cross-sectional analyses. BMC Pulm Med 13, 35 (2013). https://doi.org/10.1186/1471-2466-13-35