Validation of the new COPD assessment test translated into Thai in patients with chronic obstructive pulmonary disease
BMC Pulmonary Medicine volume 14, Article number: 193 (2014)
The COPD Assessment Test (CAT™) is a new questionnaire that has been developed recently for measuring the COPD patient’s health status. It is known to have a good correlation with disease specific health status measured by St. George’s Respiratory Questionnaire (SGRQ). For the wider application in clinical practice, it has been validated in many countries. We evaluated the reliability and validity of the translated CAT questionnaire for Thai COPD patients.
The study was designed as a cross-sectional validation study enrolling stable Thai COPD patients from three academic centers in Thailand at a single visit. The original CAT questionnaire was translated to Thai through linguistic validation process. The official Thai CAT and SGRQ questionnaires were filled by Thai patients after orientation by the out-patient nurse. The reliability of all items was assessed by Cronbach’s formula for coefficient using pooled data from all patients. The validity of the questionnaire was tested using Pearson’s correlation with SGRQ.
A total of 98 Thai COPD patients completed the official Thai CAT questionnaire; 83% were male, mean age 71 years (SD 8.2), and % predicted of FEV1 56.6% (SD 20.9). The official Thai CAT questionnaire was shown to have a high internal consistency (Cronbach's α coefficient = 0.853). The assessment of validity of official Thai CAT questionnaire was moderately correlated with that of SGRQ (r = 0.652).
The official Thai CAT questionnaire has an acceptable reliability and validity. It can be expected to serve as a short and simple tool for assessment of the health status of Thai COPD patients.
Chronic obstructive pulmonary disease (COPD) is defined as a preventable and treatable disease with significant extra pulmonary effects that may contribute to the severity of the condition in many patients. COPD is a major health concern worldwide, and it has a substantial impact on a patient’s life. According to the treatment guidelines, the general approach to managing COPD should address improvement in quality of life (QoL)  which is defined as an individual’s perception of his life in the context of culture and values . Many patients with COPD have impaired health related QoL  and low QoL is strongly associated with poor prognosis of COPD . Lung function tests alone does not provide a measurement of the overall impact of COPD health status, even though they are used for classification of disease severity . Effective dialogue between physicians and patients during consultation sessions can address the impact of COPD on a patient’s QoL. St. George’s respiratory questionnaire (SGRQ), the standard tool for assessment of QoL in COPD, is lengthy and time consuming . The COPD Assessment Test (CAT) questionnaire developed recently in the English language, is a short and simple, self-administered questionnaire to assess the overall impact of COPD on patients, as well as to improve patient–physician communication . It is known that the validation of the questionnaire might be influenced by languages, cultures, and ethnicities [7, 8]. Most of the validation findings so far have been based on data from English speaking countries, mainly in the United States and European countries. Our study may provide a better understanding of the CAT in the Thai language, ethnicity, and cultural group. The primary objective is to evaluate the reliability and validity of the official Thai CAT questionnaire. The secondary objectives are to examine relationships of CAT with forced expiratory volume in first second (FEV1) and Medical Research Council (MRC) dyspnea score.
The study was conducted as a cross-sectional validation design with a single visit. All subjects were recruited from chest clinics of three academic hospitals in Thailand between April-August 2012. This study was approved by the Research Ethics Committee, Faculty of Medicine, Chiang Mai University; the Committee of Human Rights Related to Research Involving Human Subjects, Faculty of Medicine, Mahidol University; and the Ethical Review Committee for Research in Human Subjects, Ministry of Public Health of Thailand. Written informed consent was obtained from each patient prior to the study. The criteria of recruitment were patients aged over 40 years with a diagnosis of COPD based on post-bronchodilator ratio of FEV1/FVC < 0.7 in the past 6 months, smokers or ex-smokers with a smoking history of more than 10 pack-years, and no history of acute exacerbation for at least three months prior to the enrollment. Patients with a prior history of asthma were eligible if they were currently diagnosed with COPD. Subjects meeting any of the following criteria were not enrolled in the study: current diagnosis of asthma, current active respiratory disorders other than COPD, e.g. lung cancer, tuberculosis or other significant chest x-rays findings not associated with COPD (documented within 1 year). Those who were unable to complete questionnaires were also excluded.
Study assessments and procedures
In order to assess the reliability and validity of the CAT questionnaires, the official Thai CAT questionnaire and St. George Respiratory Questionnaire (SGRQ) were administered at a single clinic visit. Demographic data and medical history were recorded. All subjects were assessed per routine practice: post-bronchodilator FEV1, FVC, % predicted of FEV1, and ratio of FEV1/FVC unless there were documented results of spirometry from the past 6 months. Values were calculated using NHANES (National Health and Nutrition Examination Survey) III reference equations . However, for Asians, a correction factor of 0.88 was applied to the FVC and FEV1 predicted . Body mass index (BMI) and MRC  were also assessed.
Health status questionnaires
The Thai version of SGRQ and the official Thai CAT were administered to all subjects. The SGRQ is a 50-item questionnaire designed to measure the impact of COPD on the subject’s health-related quality of life (HRQoL). The questionnaire was self-completed by patients over an average of 20 minutes . The original CAT designed to assess current health status has 8 items covering cough, phlegm, chest tightness, breathlessness, activity limitation, confidence, sleep, and energy. Each item is scored from 0 to 5 giving a total score ranging from 0 to 40, corresponding to the best and worst health status in patients with COPD, respectively . The original CAT was translated to the official Thai through linguistic validation process undertaken by TransPerfect Translations, Inc. in 2009 in accordance with the International Society for Pharmacoeconomics and Outcome Research translation and cultural adaptation process for patient-reported outcomes . The linguistic validation process involved both translation of the original English CAT to Thai (forward translation) and retranslation of the Thai CAT to English (backward translation). The process also included a reviewer to verify medical terms of the translation as well as a pilot test performed in 5 COPD patients. The final Thai CAT version was used for validation in this study.
Data were expressed as mean ± SD unless otherwise stated. Comparisons of baseline characteristics between the COPD staging groups were performed using Fisher’s exact test for categorical variables. Continuous variables were analyzed using a one way ANOVA or Kruskal Wallis as appropriate. The internal consistency of the set of 8 items of Thai CAT questionnaire was estimated by applying Cronbach’s alpha coefficient and values > 0.70 were generally considered acceptable for aggregate data . The correlation between CAT with SGRQ, FEV1, and MRC dyspnea scores were assessed using Pearson’s correlation. Statistical significance was accepted at p < 0.05 and summary results were presented as mean ± SD or N (%). All analyses were carried out with the SPSS statistical package, version 16 for Windows (SPSS Inc. IL, USA).
A total of 98 subjects from three hospitals were recruited in this study, comprising Maharaj Nakorn Chiang Mai Hospital (n = 40), Ramathibodi Hospital (n = 30), and Central Chest Institute of Thailand (n = 28). The mean age of the group was 71 years (52–89), 83% were male with 56.6 ± 20.9 % predicted of FEV1. Results of baseline characteristics between COPD severity stages were comparable. We found statistically significant differences among Global initiative for Chronic Obstructive Lung Disease (GOLD) in terms of age, smoking status, dyspnea score, lung function, and history of acute exacerbations. There were no significant differences among GOLD in terms of gender, BMI, pack-years smoking, and duration of disease and symptoms (Table 1).
Both Thai versions of SGRQ and CAT questionnaire were obtained from the same patients. The internal consistency of the CAT was high with Cronbach’s alpha = 0.853. Correlation between the CAT and the SGRQ was significant (r = 0.652, p < 0.001) for total scores (Figure 1). Correlations between the CAT and domains of SGRQ were also significant (r = 0.576, 0.566, and 0.591, p < 0.001 for symptoms, activity, and impact domains, respectively) whereas the total score showed the best correlation. The correlation between MRC dyspnea score and CAT score was also significant (r = 0.550, p < 0.001) but not for the % predicted of FEV1 (r = − 0.193, p = 0.109) (Table 2).
The CAT questionnaires-GOLD stage
The comparison of mean CAT score and COPD severity stages (GOLD stages) revealed insignificantly different scores (11.3 ± 6.7, 11.2 ± 6.9, 12.5 ± 7.3 and 16.3 ± 8.2 for GOLD I, II, III, and IV, respectively, p = 0.142). However, patients with very severe COPD (GOLD IV) showed significantly higher CAT scores compared to the patients with moderate COPD (GOLD II) (p = 0.024) (Figure 2).
The CAT was designed to measure health status of COPD patients in clinical practice. It could be instantly calculated and was much shorter and easier to understand than the SGRQ, the standard assessment for COPD. Indeed, patients in a previous study reported that CAT was fairly easy, reflected well with their status, the response options, and rank systems . Our study revealed that the official Thai CAT questionnaire had an internal consistency with a Cronbach’s alpha of 0.853 and was comparable to that of the original version of CAT (Cronbach’s a coefficient of 0.88) . The validated Thai version of the SGRQ was used as an instrument to measure the validity of the official Thai CAT questionnaire. The result was significant, albeit moderate correlation supporting the validity of the official Thai CAT questionnaire (r = 0.652). This result was similar to other findings in previous studies which varied from moderate to high correlations with assessments using the COPD-specific St. George's Respiratory Questionnaire (SGRQ-C) (r = 0.64 to 0.82) [6, 15–17]. The CAT is not a diagnostic tool but could aid in the identification of the health impairment of COPD patients. Contrary to previous reports, our study found no significant difference of mean CAT scores across different GOLD stages (except GOLD II and IV) [15, 18] which might be due to the reason that FEV1 classified by GOLD stages in this study had poorest correlation with CAT (r = −0.193). The multiple consequences of COPD have no relationship with airflow limitation and as a result, FEV1 may not reflect the total impairment caused by the disease. This was expected as the pulmonary function measured by FEV1, on which the GOLD classification of COPD stage is based, is not a good predictor of health status . MRC functional dyspnea is now proven to be useful in predicting outcomes in patients with COPD and is recommended in the routine handling and evaluation of these patients . In the present study, we had the opportunity of testing the correlation between CAT and MRC dyspnea score. It was statistically significant with moderate correlation (r = 0.550) which is similar to other studies (0.50 to 0.579) [18, 20, 21]. Currently the most widely used questionnaire for measuring health status in COPD in a research setting is the SGRQ . The main disadvantages for clinical practice are its extent as it comprises 50 questions which are viewed by the patients as rather complicated and time consuming and because scores can only be calculated using a computer-based system. On the other hand, CAT could be used as an easy and reliable tool to assess health status in COPD patients in clinical studies and might become a useful tool in routine clinical practice. Unlike the physician’s judgment of clinical severity, the CAT provides a standardized assessment and a numerical estimate of disease impact which is reported to be reliable across languages and countries [6, 16–18]. However, it is only one part of the clinician’s toolkit, to be used alongside spirometry, exacerbation history, and an assessment of co-morbidity. Its role is to supplement information obtained from lung function measurements and assessment of exacerbation risks. Like other clinical assessment techniques, its utility will only become fully apparent with time. This study provides the evidence that the official Thai CAT questionnaire is a reliable tool and is valid for providing practicing physicians a measurement of the impact of COPD on health status of their groups of patients. We need further studies to demonstrate its ability to reliably measure intra-individual change, detect interpretable differences to norms, and trigger or support useful discussion between patients and physicians which would contribute to better and more efficient care. Our study has a limitation in that it was a cross-sectional study based on a single visit; as a result repeatability estimated by calculating the intraclass correlation coefficient (ICC) was not analyzed. In addition, the validation findings were based on three sites of academic medical centers chosen on the basis of representing large referral centers for COPD patients: one site from northern part and two sites from central part of Thailand. Thus, the data might not be reliably extrapolated to all COPD populations in Thailand. Although the official Thai CAT questionnaire showed very similar properties to the much more complex Thai version of SGRQ, with a reliability of 0.853, it could not be recommended to be used in making important decisions about individuals . However, it can be considered to use together with other clinical parameters to accurately measure the impact of COPD on patients’ health status.
The official Thai CAT questionnaire is a reliable tool and has a good validity. It can be expected to serve as a short and simple questionnaire for assessment of the health status of Thai COPD patients.
Chronic obstructive pulmonary disease
COPD assessment test
Quality of life
St. George respiratory questionnaire
Medical Research Council Dyspnea Scale
Global initiative for chronic obstructive lung disease
Body mass index
Forced expiratory volume in first second
Forced vital capacity.
GOLD Global Initiative for Chronic Obstructive Lung Disease: Executive summary: global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease. Update 2010: http://www.goldcopd.org
Group WHOQOL: Study protocol for the World Health Organization project to develop Quality of Life assessment instruments (WHOQOL). Qual Life Res. 1993, 2: 153-159.
Jones PW, Brusselle G, Dal Negro RW, Ferrer M, Kardos P, Levy ML, Perez T, Soler-Cataluna JJ, van der Molen T, Adamek L, Banik N: Health-related quality of life in patients by COPD severity within primary care in Europe. Respir Med. 2011, 105: 57-66. 10.1016/j.rmed.2010.09.004.
Osman IM, Godden DJ, Friend JA, Legge JS, Douglas JG: Quality of life and hospital re admission in patients with chronic obstructive pulmonary disease. Thorax. 1997, 52: 67-71. 10.1136/thx.52.1.67.
Jones PW, Harding G, Wiklund I, Berry P, Leidy N: Improving the process and outcome of care in COPD: development of a standardized assessment tool. Prim Care Respir J. 2009, 18: 208-215. 10.4104/pcrj.2009.00053.
Jones PW, Harding G, Berry P, Wiklund I, Chen WH, Leidy NK: Development and first validation of the COPD Assessment Test. Eur Respir J. 2009, 34: 648-654. 10.1183/09031936.00102509.
McGee H, O’Boyle CA, Hickey A, P’Malley K, Joyce CRB: Assessing the quality of life of the individual: the SEIQol with a healthy and a gastroenterology unit population. Psychol Med. 1991, 21: 749-759. 10.1017/S0033291700022388.
O’Boyle CA, McGee H, Hickey A, O’Malley K, Joyce CRB: Individual quality of life in patients undergoing hip replacement. Lancet. 1992, 339: 1088-1091. 10.1016/0140-6736(92)90673-Q.
Hankinson JL, Odencrantz JR, Fedan KB: Spirometric reference values from a sample of the general US population. Am J RespirCrit Care Med. 1999, 159: 179-187. 10.1164/ajrccm.159.1.9712108.
Hankinson JL, Kawut SM, Shahar E, Smith LJ, Stukovsky KH, Barr RG: Performance of American Thoracic Society-recommended spirometry reference values in a multiethnic sample of adults: the multi-ethnic study of atherosclerosis (MESA) lung study. Chest. 2010, 137: 138-145. 10.1378/chest.09-0919.
Bestall JC, Paul EA, Garrod R, Garnham R, Jones PW, Wedzicha JA: Usefulness of the Medical Research Council (MRC) dyspnoea scale as a measure of disability in patients with chronic obstructive pulmonary disease. Thorax. 1999, 54: 581-586. 10.1136/thx.54.7.581.
Meguro M, Elizabeth AB, Spencer S, Jones PW: Development and validation of an improved, COPD-specific version of the St George Respiratory Questionnaire. Chest. 2007, 132: 456-463. 10.1378/chest.06-0702.
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P: Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005, 8: 94-104. 10.1111/j.1524-4733.2005.04054.x.
Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika. 1951, 16: 297-334. 10.1007/BF02310555.
TsiligianniI , Van der Molen T, Moraitaki D, Lopez L, Kocks , Karagiannis K, Siafakas N, Tzanakis N: Assessing health status in COPD, a head-to-head comparison between the COPD assessment test (CAT) and the clinical COPD questionnaire (CCQ). BMC Pulm Med. 2012, 12: 20-10.1186/1471-2466-12-20.
Wiklund I, Berry P, Lu KX, Fang J, Fu C: The Chinese translation of COPD assessment test (CAT) provides a valid and reliable measurement of COPD health status in Chinese COPD patients. Am J Respir Crit Care Med. 2010, 181: S3575-
Tsuda T, Suematsu R, Kamohara K, Kurose M, Arakawa I, Tomioka R, Kawayama T, Hoshino T, Aizawa H: Development of the Japanese version of the COPD Assessment Test. Respir Investig. 2012, 50: 34-39. 10.1016/j.resinv.2012.05.003.
Kwon N, Amin M, Hui DS, Jung K-S, Lim SG, Ta HD, Thai TTL, Yunus F, Jones PW: Validity of the COPD assessment test translated into local languages for Asian Patients. Chest. 2013, 143: 703-710.
Celli BR, MacNee W: ATS/ERS Task Force. Standards for the diagnosis and treatment of patients with COPD: a summary of the ATS/ERS position paper. Eur Respir J. 2004, 23: 932-946. 10.1183/09031936.04.00014304.
Zhou QT, Mei JJ, He B, Huang SG, Shi Y, Wen FQ, Zhao MW: Chronic obstructive pulmonary disease assessment test score correlated with dyspnea score in a large sample of Chinese patients. Chin Med J. 2013, 126: 11-15.
Dandurand RJ, Bourbeau J, Eidelman DH: Impact of time and symptom scale choice on GOLD grade and correlation of COPD assessment test with FEV1, diffusing capacity and acute exacerbation rate in COPD subjects from community practice. Am J Respir Crit Care Med. 2014, 189: A5958-
Jones PW, Anderson JA, Calverley P, Celli BR, Ferguson GT, Jenkins C, Yates JC, Vestbo J, Spencer MD and for the TORCH investigators: Health status in the TORCH study of COPD: treatment efficacy and other determinants of changes. Respir Res. 2011, 12: 71-10.1186/1465-9921-12-71.
Nunnally JC, Bernstein IH: Psychometric Theory. 1994, New York: McGraw-Hill, 3
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2466/14/193/prepub
GlaxoSmithKline is funding this manuscript production including article-processing charge, the translation process, and statistical analysis.
The first author received speaker fees from GlaxoSmithKline, Novartis, MSD, Pfizer, AstraZeneca, Boehringer Ingelheim, Sanofi-Aventis, Takeda, Janssen-Cilag, Bayer, and also research funding from GlaxoSmithKline, Novartis, MSD, Pfizer, AstraZeneca. The second author received speaker fees from GlaxoSmithKline, AstraZeneca, Boehringer Ingelheim, Takeda and also research funding from GlaxoSmithKline, AstraZeneca and Boehringer Ingelheim. The third authors received speaker fees from GlaxoSmithKline, Novartis, Pfizer, AstraZeneca, Sanofi-Aventis, Takeda, Janssen-Cilag, Daiichi-Sankyo, and Thai Otsuka and research funding from GlaxoSmithKline, Novartis, Janssen-Cilag, and Daiichi-Sankyo.
The first author: Acquisition of data, statistical analysis, interpretation of data, drafting the manuscript, edit and revise manuscript, read and approved the final manuscript to be published. The second and third authors: Acquisition of data, interpretation, edit and revise manuscript, read and approved the final manuscript to be published. All authors read and approved the final manuscript.
About this article
Cite this article
Pothirat, C., Kiatboonsri, S. & Chuchottaworn, C. Validation of the new COPD assessment test translated into Thai in patients with chronic obstructive pulmonary disease. BMC Pulm Med 14, 193 (2014). https://doi.org/10.1186/1471-2466-14-193