Self-administration and interviewer-administration of the German Chronic Respiratory Questionnaire: instrument development and assessment of validity and reliability in two randomised studies
© Puhan et al; licensee BioMed Central Ltd. 2004
Received: 18 November 2003
Accepted: 08 January 2004
Published: 08 January 2004
Assessment of health-related quality of life (HRQL) is important in patients with chronic obstructive pulmonary disease (COPD). Despite the high prevalence of COPD in Germany, Switzerland and Austria there is no validated disease-specific instrument available. The objective of this study was to translate the Chronic Respiratory Questionnaire (CRQ), one of the most widely used respiratory HRQL questionnaires, into German, develop an interviewer- and self-administered version including both standardised and individualised dyspnoea questions, and validate these versions in two randomised studies.
We recruited three groups of patients with COPD in Switzerland, Germany and Austria. The 44 patients of the first group completed the CRQ during pilot testing to adapt the CRQ to German-speaking patients. We then recruited 80 patients participating in pulmonary rehabilitation programs to assess internal consistency reliability and cross-sectional validity of the CRQ. The third group consisted of 38 patients with stable COPD without an intervention to assess test-retest reliability. To compare the interviewer- and self-administered versions, we randomised patients in groups 2 and 3 to the interviewer- or self-administered CRQ. Patients completed both the standardised and individualised dyspnoea questions.
For both administration formats and all domains, we found good internal consistency reliability (Crohnbach's alpha between 0.73 and 0.89). Cross-sectional validity tended to be better for the standardised compared to the individualised dyspnoea questions and cross-sectional validity was slightly better for the self-administered format. Test-retest reliability was good for both the interviewer-administered CRQ (intraclass correlation coefficients for different domains between 0.81 and 0.95) and the self-administered format (intraclass correlation coefficients between 0.78 and 0.86). Lower within-person variability was responsible for the higher test-retest reliability of the interviewer-administered format while between person variability was similar for both formats.
Investigators in German-speaking countries can choose between valid and reliable self-and interviewer-administered CRQ formats.
KeywordsCOPD Health Related Quality of Life Chronic Respiratory Questionnaire Standardisation Self-Administration
Clinicians and investigators are showing increasing agreement that measurement of health-related quality of life (HRQL) is important for patient management. For patients with chronic diseases such as COPD, the aim of treatments is to reduce symptoms and to improve quality of life. However, only translated[3, 4] but no clinically validated German versions of COPD-specific quality of life instrument exist.
The interviewer-administered "Chronic Respiratory Questionnaire" (CRQ) is a valid, reliable and responsive instrument.[7, 8] that has seen extensive use. [9–11] The CRQ is simple to use and there is a significant body of literature guiding their interpretation. [12–15] However, the requirement for an interviewer may be inefficient and some investigators suggested that the individualised dyspnoea questions increases the time needed for administration.[8, 16] A self-administered version of the CRQ as well as a standardised dyspnoea domain are both available. These administration formats need evaluation before investigators can confidently use them in clinical trials.
In addition, there is a need for a validated COPD-specific instrument in German-speaking countries. Ideally there should be one culturally adapted version for all German-speaking countries to ensure comparability of CRQ scores across these countries in future clinical trials. Therefore, the aim of this study was to translate the English versions of the interviewer- and self-administered CRQ as well as the individualised and standardised dyspnoea domains into German and to validate these formats concurrently in Switzerland, Germany and Austria. We focus in this report on the instrument development, cross-sectional validity and reliability. We report the evaluative properties of the German CRQ including responsiveness and longitudinal validity elsewhere.
Groups of COPD patients recruited for the adaptation and validation of the German CRQ
Number of patients
4 pulmonary rehabilitation centres and one University hospital in Switzerland, Germany and Austria
Pilot testing of CRQ formats during translation and adaptation process
4 pulmonary rehabilitation centres in Switzerland, Germany and Austria
Internal consistency reliability and cross-sectional validity of CRQ formats
One outpatient service of a University hospital and three private practices in Switzerland and Germany
Test-retest reliability of CRQ formats
The first group of patients consisted of 44 patients from four rehabilitation clinics and a University hospital in Switzerland (Zuercher Hoehenklinik Wald, Klinik Barmelweid and University Hospital of Zurich), Germany (Pulmoresearch Institute Hamburg) and Austria (Rehabilitationsklinik Weyer/Enns). In these patients we pilot tested the CRQ formats during the translation and adaptation process (table 1). These patients did not participate in the subsequent validation study.
We recruited an additional 80 patients (group 2) from the same four rehabilitation centres. These patients followed an intense multidisciplinary pulmonary rehabilitation program that consisted mainly of physical exercise but also offered patient education, relaxation therapies and psychosocial support. In these patients we assessed the internal consistency reliability and the cross-sectional validity of the German CRQ.
Finally, we recruited a third group of patients (group 3, n = 38) who did not undergo any changes in the therapeutic management for at least six weeks and were in a stable pulmonary condition to assess test-retest reliability of the German CRQ. We recruited these patients from one University hospital (Zurich, Switzerland) and private offices of pulmonologists in Switzerland and Germany.
Chronic Respiratory Questionnaire
The CRQ is divided into the four domains of fatigue, emotional function, mastery and dyspnoea. Patients answer to each of the 20 questions on a seven points scale expressing the degree of disability from 1 (maximum impairment) to 7 (no impairment). The standardised dyspnoea domain comprises five items concerning activities that cause shortness of breath in some patients with COPD as previously described.[18, 19] When applicable we trained all interviewers in the use of this instrument in identical fashion to ensure consistent application following the recommendations of the developer of the original CRQ (GHG).
Translation and instrument development
After administration of the CRQ to an additional 23 patients in group 1, the translation team discussed the comments from these patients and decided in consensus on modifications. Finally, we recruited another 11 patients (belonging to group 1) to investigate whether these changes were appropriate.
To allow comparisons between the different administration formats of the German CRQ, we validated them concurrently in two randomised studies. In the first study we randomly assigned 80 patients to either the CRQ-IA group (n = 40) or CRQ-SA group (n = 40). All patients completed the individualised and standardised dyspnoea items. To eliminate order effects we also randomised the order of administration (first individualised, then standardised or vice versa). We assessed all patients within 3 days after enrolment in any of the four rehabilitation programs.
In the second randomised study, we used the same randomisation procedure and included 38 stable patients (group 3). These patients completed the CRQ twice, ten days apart. These patients were blinded to their previous scores at the follow-up interview and did not undergo any therapy changes.
We generated two separate randomisation lists by computer (one for group 2 and one for group 3) in blocks of four per centre. Allocation of patients to either the CRQ-IA or CRQ-SA was concealed using a central telephone system. The site investigators, who were unaware of details on block randomisation, contacted the study coordinator (MP) by telephone for each patient who had given informed consent to receive the group assignment. The study coordinator registered the patient's initials, gender and date of birth to verify if all patients were allocated correctly. All local ethics committees approved the study protocol and patients provided informed consent prior to participation in the study.
Validation instruments to assess cross-sectional validity of the CRQ
Patients performed a six-minute walking test to assess functional exercise capacity at the beginning and end of the rehabilitation. In addition, we used a modified Borg scale in German to assess the intensity of perceived dyspnoea at the end of the six-minute walking test. The Borg scale consisted of a scale labelled from 0 to 10 and with verbal descriptors. Zero represented "no dyspnoea at all" and 10 "very, very severe dyspnoea". We used two additional instruments to assess HRQL: The German self-administered SF-36 Health Survey and the Feeling Thermometer (FT). The SF-36 is a generic instrument for assessment of HRQL and assesses 8 subscales of HRQL. Other investigators used the SF-36 in trials with COPD patients participating in respiratory rehabilitation. The FT is an anchor based visual analogue scale from 0 to 100 where 0 (dead) represents the worst and 100 (full health) the best health state. Accumulating evidence suggests that the FT works well as a HRQL instrument in various groups of patients, including patients with COPD [24–26]. All these outcome measures were taken at the same time as the CRQ administration, i.e. at the beginning and end of the rehabilitation.
We calculated CRQ domain scores by summing the scores of the single items and then dividing the sum by the number of items in the respective domain. We used parametric tests because scores on the seven points Likert-type scale did not differ significantly from a normal distribution (Shapiro-Wilk test and analysis of normal quantile-quantile plots).
We assessed internal consistency for each domain by calculating Crohnbach's alpha for CRQ baseline scores. In addition, we calculated for each standardised item its corrected item-total correlation, which should exceed 0.2 and calculated Crohnbach's alpha again excluding the item under study. We did not include the individualised dyspnoea domain in this analysis because patients select different items so that the domain cannot be assessed across patients for internal consistency.
To assess cross-sectional validity (in patient group 2) we used Pearson correlation coefficients between the CRQ baseline scores and those of the validation measures.
Finally, we assessed test-retest reliability using intraclass correlation coefficients for the baseline and follow-up CRQ domain scores of the stable COPD patients (group 3) by taking the between person variance at baseline and follow-up as the signal and within person variance as well as between person variance at baseline and follow-up as the noise. All statistical analyses were performed with SPSS for Windows version 10.0 (SPSS Inc, Chicago, Ill).
Translation and instrument development (group 1)
The wording of the questions and answer choices correspond to the original version. We did not add or remove items nor change the answer scales apart from adaptation to German. Modifications became necessary for the instructions of the individualised dyspnoea items of the CRQ-SA. The original translation of the instructions was too extensive and too complicated and patients were unable to complete this domain by themselves without difficulties. Therefore, we simplified the instructions omitting some of the instructions that added text without contributing substantially to the understanding. In addition, we listed each item of the individualised and standardised dyspnoea domain separately. This means that there are five separate questions for the dyspnoea domain.
Patients at times were surprised that the list of activities of the individualised dyspnoea domain did not begin with a physical activity ("being angry or upset"). Therefore we placed this item at position 5 of the list of 26 items. Accordingly, the standardised dyspnoea question 1 of the English CRQ ("Shortness of breath when being angry or upset") was unchanged but placed as question 3 in the German CRQ. We pilot tested the changes and patients were able to complete the German CRQ-SA without major difficulties and understood all items and answer choices.
Internal consistency and cross-sectional validity (group 2)
Nine patients did not complete the study for the following reasons: five withdrew for non-specified reasons (one patient in CRQ-IA group and four in CRQ-SA group) and two patients did not meet the a priori inclusion criteria upon review of their baseline data (one patient in each group with FEV1/FVC > 70%). In addition, two patients of the CRQ-SA group discontinued the rehabilitation program shortly after admission (one patient had an acute exacerbation requiring inpatient care and the other went home shortly after beginning of the rehabilitation). We excluded these two patients because we had decided a priori to include only patients with complete validation data in the analysis. The baseline characteristics of these two patients did not differ from the included patients. Thus, we analysed data from 38 patients of the CRQ-IA group and 33 patients of the CRQ-SA group. The patients of the two groups (CRQ-IA and CRQ-SA) were similar at baseline: Mean age was 67.4 years (SD 8.7) in the CRQ-IA and 67.7 (SD 8.3) in CRQ-SA group, FEV1/FVC predicted was 48.5% (SD 13.3) in the CRQ-IA and 49.9% (SD 10.5) in the CRQ-SA group and the average smoking history was 44.9 pack years (26.1) in the CRQ-IA and 46.8 (27.6) in the CRQ-SA group.
Inter-item correlations† (internal consistency reliability) of the interviewer and self-administered format for baseline scores
GERMAN CRQ-IA (n = 33)
GERMAN CRQ-SA (n = 38)
Standardised Dyspnoea items
Emotional Function items
Corrected item-total correlations and internal consistency reliability if item was deleted for baseline scores of the interviewer and self-administered CRQ format
Corrected item-total correlation
Crohnbach alpha if item deleted
Corrected item-total correlation
Crohnbach alpha if item deleted
Standardised dyspnoea domain
Standardised dyspnoea domain
Emotional function domain
Emotional function domain
Cross-sectional validity for the individualised and standardised dyspnoea domains: Correlations for baseline scores.
Instrument and domain
CRQ-IA Dyspnoea Domains
CRQ-SA Dyspnoea Domains
0.58* § (0.44;0.72)
SF-36-General Health Perception Index
SF-36-Physical Functioning Index
Mental Health Index
0.17* § (0.00;0.34)
Six minutes walk test
Cross-sectional validity for the fatigue, emotion and mastery domains. Correlations for baseline scores.†
Instrument and domain
SF-36-General Health Perception Index
SF-36-Physical Functioning Index
SF-36-Mental Health Index
Six minutes walk test
Test-retest reliability (group 3)
Test-retest reliability# of the German CRQ
We developed different administration formats of the German CRQ and validated them in two randomised studies. We found good internal consistency reliability for the interviewer- and self-administered CRQ. Cross-sectional validity was higher for the standardised compared to individual dyspnoea questions. Test-retest reliability exceeded our preset threshold (intraclass correlation coefficient > 0.7) for both the CRQ-IA and the CRQ-SA.
The strengths of our study included the stepwise development of the German CRQ formats, which allowed us to reconsider and to test the different versions in three stages of pilot testing. The aim of this approach was to add quality with every step in terms of conceptual equivalence between the source and target version as well as in terms of comprehensibility for the patients. While the CRQ-IA was easy comprehensible for patients, we noticed through pilot testing that patients had difficulties completing the individualised dyspnoea items of the initial German translation of the CRQ-SA independently. However by modifying and pilot testing the instructions of this individualised dyspnoea domain we were able to develop an improved version.
The standardised dyspnoea domains produced higher cross-sectional correlations than the individualised dyspnoea domains. This finding is important because it indicates that the standardised CRQ dyspnoea domain allows for better discrimination between different degrees of COPD severity. These results are consistent with those of a recent study in which discriminative properties of the standardised dyspnoea questions of the English CRQ also proved superior
We found for item 9 ("How often during the last two weeks have you felt embarrassed by your coughing or heavy breathing?") a very low item-total correlation of -0.03. Because there is no apparent explanation for this finding, we used the data set of patient group 3 (test-retest) and analysed the item-total correlations of the emotional function domain. We found item-total correlations of 0.51 for the CRQ-IA and 0.50 for the CRQ-SA for item 9. For all items of the emotional function domain the item-total correlation was between 0.44 and 0.85. Thus we assume that the low item-total correlation in patient group 2 was due to chance.
The careful development of the German CRQ has led to reliable and valid self- and interviewer administered CRQ formats and individualised and standardised dyspnoea questions. The need of an interviewer and the time-consuming selection process of the individualised dyspnoea questions are no longer a hindrance for the use of the CRQ: Investigators can choose between self-and interviewer administered formats and individualised and standardised dyspnoea questions based on efficiency considerations. The brevity of the standardised CRQ-SA with good validity, reliability and responsiveness makes the CRQ-SA an attractive choice for trials as well as for clinical practice.
GlaxoSmithKline Switzerland and the Swiss Lung League funded this study with grants to the Horten Centre (MP). The sponsors were not involved in the study design, conduction of the trial, analysis of data and manuscript writing.
MP, MB, MF, OB, HS and GG designed and organised the study; MB, MF, TG, OB and AL collected the data and supervised the study at their study sites, MP and HS analysed the data and wrote the first draft of the manuscript, MB, MF, TG, OB, AL and GG critically reviewed the manuscript and MP and HS prepared the final version of the manuscript.
Chronic Obstructive Pulmonary Disease
Chronic Respiratory Questionnaire
Chronic Respiratory Questionnaire Interviewer-Administered
Chronic Respiratory Questionnaire Self-Administered
Health Related Quality of Life
The CRQ-IA and CRQ-SA are copyrighted by McMaster University; Principal Authors Dr. Gordon Guyatt and Dr. Holger Schünemann. Use of the instrument requires licensing.
We would like to thank Cornelia Flamann (Zuercher Hoehenklinik Wald) and Dr. Marco Laschke (Klinik Barmelweid) for data collection in their centres.
- Guyatt GH, Feeny DH, Patrick DL: Measuring health-related quality of life. Ann Intern Med 1993, 118: 622–629.PubMedView Article
- Pauwels RA, Buist AS, Calverley PM, Jenkins CR, Hurd SS: Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease. NHLBI/WHO Global Initiative for Chronic Obstructive Lung Disease (GOLD) Workshop summary. Am J Respir Crit Care Med 2001, 163: 1256–1276.PubMedView Article
- Calverley P, Pauwels R, Vestbo J, Jones P, Pride N, Gulsvik A, Anderson J, Maden C: Combined salmeterol and fluticasone in the treatment of chronic obstructive pulmonary disease: a randomised controlled trial. Lancet 2003, 361: 449–456. 10.1016/S0140-6736(03)12459-2PubMedView Article
- Behnke M, Taube C, Kirsten D, Lehnigk B, Jorres RA, Magnussen H: Home-based exercise is capable of preserving hospital-based improvements in severe chronic obstructive pulmonary disease. Respir Med 2000, 94: 1184–1191. 10.1053/rmed.2000.0949PubMedView Article
- Puhan MA, Koller M, Brandli O, Steurer J: [Pulmonary rehabilitation of COPD in Switzerland--an assessment of current status]. Schweiz Rundsch Med Prax 2003, 92: 111–116.
- Guyatt GH, Berman LB, Townsend M, Pugsley SO, Chambers LW: A measure of quality of life for clinical trials in chronic lung disease. Thorax 1987, 42: 773–778.PubMed CentralPubMedView Article
- Harper R, Brazier JE, Waterhouse JC, Walters SJ, Jones NM, Howard P: Comparison of outcome measures for patients with chronic obstructive pulmonary disease (COPD) in an outpatient setting. Thorax 1997, 52: 879–887.PubMed CentralPubMedView Article
- Wijkstra PJ, TenVergert EM, van Altena R, Otten V, Postma DS, Kraan J, Koeter GH: Reliability and validity of the chronic respiratory questionnaire (CRQ). Thorax 1994, 49: 465–467.PubMed CentralPubMedView Article
- Goldstein RS, Todd TR, Guyatt G, Keshavjee S, Dolmage TE, van Rooy S, Krip B, Maltais F, LeBlanc P, Pakhale S, Waddell TK: Influence of lung volume reduction surgery (LVRS) on health related quality of life in patients with chronic obstructive pulmonary disease. Thorax 2003, 58: 405–410. 10.1136/thorax.58.5.405PubMed CentralPubMedView Article
- Tsukino M, Nishimura K, McKenna SP, Ikeda A, Hajiro T, Zhang M, Izumi T: Change in generic and disease-specific health-related quality of life during a one-year period in patients with newly detected chronic obstructive pulmonary disease. Respiration 2002, 69: 513–520. 10.1159/000066456PubMedView Article
- Lacasse Y, Brosseau L, Milne S, Martin S, Wong E, Guyatt GH, Goldstein RS: Pulmonary rehabilitation for chronic obstructive pulmonary disease. Cochrane Database Syst Rev 2002, CD003793.
- Redelmeier DA, Guyatt GH, Goldstein RS: Assessing the minimal important difference in symptoms: a comparison of two techniques. J Clin Epidemiol 1996, 49: 1215–1219. 10.1016/S0895-4356(96)00206-5PubMedView Article
- Wyrwich KW, Tierney WM, Wolinsky FD: Further evidence supporting an SEM-based criterion for identifying meaningful intra-individual changes in health-related quality of life. J Clin Epidemiol 1999, 52: 861–873. 10.1016/S0895-4356(99)00071-2PubMedView Article
- Jaeschke R, Singer J, Guyatt GH: Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials 1989, 10: 407–415. 10.1016/0197-2456(89)90005-6PubMedView Article
- Wyrwich KW, Fihn SD, Tierney WM, Kroenke K, Babu AN, Wolinsky FD: Clinically important changes in health-related quality of life for patients with chronic obstructive pulmonary disease: an expert consensus panel report. J Gen Intern Med 2003, 18: 196–202.PubMed CentralPubMedView Article
- Jones PW: Issues concerning health-related quality of life in COPD. Chest 1995, 107: 187S-193S.PubMedView Article
- Williams JE, Singh SJ, Sewell L, Guyatt GH, Morgan MD: Development of a self-reported Chronic Respiratory Questionnaire (CRQ-SR). Thorax 2001, 56: 954–959. 10.1136/thorax.56.12.954PubMed CentralPubMedView Article
- Schunemann Holger J., Griffith Lauren, Jaeschke Roman, Goldstein Roger, Stubbing David, Austin Peggy, Guyatt Gordon H.: A Comparison of the Original Chronic Respiratory Questionnaire With a Standardized Version. Chest 2003, 124: 1421–1429. 10.1378/chest.124.4.1421PubMedView Article
- M.A. Puhan, M. Behnke, M. Laschke, A. Lichtenschopf, O. Brandli, G.H. Guyatt, Schunemann HJ: Self-administration and standardisation of the chronic respiratory questionnaire: A randomised trial in three German-speaking countries. Respiratory Medicine 2004, in press.
- Bullinger M: Creating and Evaluation Cross-Cultural Instruments. Quality of Life and Pharmacoeconomics in Clinical Trials Second Edition (Edited by: SpilkerB). Philadelphia, Lippincott 1996, 69: 659–668.
- Kirsten DK, Taube C, Lehnigk B, Jorres RA, Magnussen H: Exercise training improves recovery in patients with COPD after an acute exacerbation 1. Respir Med 1998, 92: 1191–1198.PubMedView Article
- Bullinger M: German translation and psychometric testing of the SF-36 Health Survey: preliminary results from the IQOLA Project. International Quality of Life Assessment. Soc Sci Med 1995, 41: 1359–1366. 10.1016/0277-9536(95)00115-NPubMedView Article
- Griffiths TL, Burr ML, Campbell IA, Lewis-Jenkins V, Mullins J, Shiels K, Turner-Lawlor PJ, Payne N, Newcombe RG, Ionescu AA, Thomas J, Tunbridge J, Lonescu AA: Results at 1 year of outpatient multidisciplinary pulmonary rehabilitation: a randomised controlled trial. Lancet 2000, 355: 362–368. 10.1016/S0140-6736(99)07042-7PubMedView Article
- Fries JF, Ramey DR: "Arthritis specific" global health analog scales assess "generic" health related quality-of-life in patients with rheumatoid arthritis. J Rheumatol 1997, 24: 1697–1702.PubMed
- Mathias SD, Colwell HH, Miller DP, Moreland LW, Buatti M, Wanke L: Health-related quality of life and functional status of patients with rheumatoid arthritis randomly assigned to receive etanercept or placebo. Clin Ther 2000, 22: 128–139. 10.1016/S0149-2918(00)87984-9PubMedView Article
- Schunemann HJ, Griffith L, Stubbing D, Goldstein R, Guyatt GH: A clinical trial to evaluate the measurement properties of 2 direct preference instruments administered with and without hypothetical marker states. Med Decis Making 2003, 23: 140–149. 10.1177/0272989X03251243PubMedView Article
- Streiner D, Norman G Oxford Medical Publications. Health measurement scales Second Edition Oxford, Oxford University Press 1998, 60–65.
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.