- Open Access
Psychometric validation of the Dutch translation of the quality of life in reflux and dyspepsia (QOLRAD) questionnaire in patients with gastroesophageal reflux disease
Health and Quality of Life Outcomes volume 8, Article number: 85 (2010)
The Quality of Life in Reflux and Dyspepsia (QOLRAD) questionnaire is one of the best-characterized disease-specific instruments that captures health-related problems and symptom-patterns in patients with gastroesophageal reflux disease (GERD). This paper reports the psychometric validation of a Dutch translation of the QOLRAD questionnaire in gastroenterology outpatients with GERD.
Patients completed the QOLRAD questionnaire at visit 1 (baseline), visit 2 (after 2, 4 or 8 weeks of acute treatment with esomeprazole 40 mg once daily), and visit 4 (after 6 months with on-demand esomeprazole 40 mg once daily or continuous esomeprazole 20 mg once daily). Symptoms were assessed at each visit, and patient satisfaction was assessed at visits 2 and 4.
Of the 1166 patients entered in the study, 97.3% had moderate or severe heartburn and 55.5% had moderate or severe regurgitation at baseline. At visit 2, symptoms of heartburn and regurgitation were mild or absent in 96.7% and 97.7%, respectively, and 95.3% of patients reported being satisfied with the treatment. The internal consistency and reliability of the QOLRAD questionnaire (range: 0.83-0.92) supported construct validity. Convergent validity was moderate to low. Known-groups validity was confirmed by a negative correlation between the QOLRAD score and clinician-assessed severity of GERD symptoms. Effect sizes (1.15-1.93) and standardized response means (1.17-1.86) showed good responsiveness to change. GERD symptoms had a negative impact on patients' lives.
The psychometric characteristics of the Dutch translation of the QOLRAD questionnaire were found to be satisfactory, with good reliability and responsiveness to change, although convergent validity was at best moderate.
Gastroesophageal reflux disease (GERD) is a condition that develops when the reflux of stomach contents causes troublesome symptoms and/or complications . The characteristic symptoms of GERD are heartburn and regurgitation, which have a prevalence of 75-98% and 48-91%, respectively, in patients with reflux disease . Dysphagia is also common, especially in individuals with reflux esophagitis . GERD affects many aspects of day-to-day functioning, including sleep, productivity at work and at home, and enjoyment of meals and social occasions [3–5]. Symptoms can also cause emotional distress.
Assessing the impact of reflux symptoms on patients' lives can provide important information on health status and perceived treatment efficacy. Such assessment should be carried out using validated patient-reported outcome instruments. In its draft guidance, the US Food and Drug Administration (FDA) encourages the development of instruments that are able to translate a change in symptoms into specific endpoints such as improvements in the ability to perform daily activities or improvements in psychological state . The FDA evaluates such instruments by their ability to measure specific concepts in a reliable and valid way. It also stipulates that each instrument needs to be specific to the intended population and to the characteristics of the condition or disease treated.
Generic instruments capture a wide range of health-related problems and allow for comparisons across different diseases. In contrast, disease-specific instruments capture health-related problems and symptom patterns that are of particular relevance to a specific condition [7, 8]. Disease-specific instruments are generally more responsive than generic instruments in detecting small changes over time, and are thus better suited as outcome measures in interventional studies [7, 8].
One of the best-characterized disease-specific instruments for patients with GERD is the Quality of Life in Reflux and Dyspepsia (QOLRAD) questionnaire . The QOLRAD questionnaire measures the impact of reflux symptoms on patients' emotional health, sleep, vitality, eating and drinking, and physical and social functioning. The QOLRAD questionnaire was originally developed in US English, and has subsequently been translated and culturally adapted for use in international studies [10–12]. This paper reports the psychometric validation of a Dutch translation of the QOLRAD questionnaire in patients with GERD.
Patients with GERD were selected in gastroenterology outpatient clinics. Inclusion criteria required a history of heartburn of at least 3 months, and episodes of heartburn of at least moderate severity for 3 days or more during the 7 days prior to the study. Heartburn was defined as a burning feeling, rising from the stomach or lower part of the chest up towards the neck. The following exclusion criteria were applied: the presence of reflux esophagitis grade C or D, presence or history of other gastrointestinal diseases and conditions, and presence or history of other non-gastrointestinal serious diseases and conditions. Patients treated with proton pump inhibitors or prokinetic drugs during the 14 days preceding endoscopy or who had been treated with non-steroidal anti-inflammatory drugs or Helicobacter pylori eradication therapy were also excluded.
Patients received acute treatment for their symptoms with esomeprazole 40 mg once daily for 2, 4 or 8 weeks. The length of acute treatment was dependent on the length of time taken to achieve sufficient symptom relief and patient satisfaction. Patients satisfied with the treatment and with sufficient symptom relief entered the maintenance phase and were randomized to receive on-demand esomeprazole 40 mg once a day or continuous esomeprazole 20 mg once daily for 6 months. Data are presented from visit 1 (baseline), visit 2 (after 2, 4 or 8 weeks of acute treatment with esomeprazole 40 mg), and visit 4 (after 6 months of maintenance treatment) .
The study was performed in accordance with the ethical principles of the Declaration of Helsinki, the Good Clinical Practice and the Wet Medisch-Wetenschappelijk Onderzoek met mensen (WMO). The final study protocol, including the final version of the Patient Information and Consent Forms, were approved in accordance with the WMO by an Independent Ethics Committee belonging to the Maasland Hospital, Sittard, the Netherlands.
Investigators recorded patient demographics (including sex, age, height and weight), medical history (including history of reflux symptoms), and drugs used during the month before enrolment. Patients completed the QOLRAD questionnaire at each visit. All patients who prematurely discontinued the study were encouraged to complete the QOLRAD questionnaire at their last visit to the clinic.
At each visit, investigators assessed the severity of patients' heartburn, regurgitation and dysphagia in the 7 days prior to the visit. Symptoms were scored as follows: none (no complaints), mild (aware of symptom, but easily tolerated), moderate (discomforting symptom, sufficient to cause interference with normal daily activities and/or sleep), severe (incapacitating symptom, with inability to perform normal daily activities and/or sleep). Patients completed a daily paper diary during the study treatment period, in which they recorded heartburn severity during the past 24 hours. Patient satisfaction was evaluated at visit 2 and visit 4, using a 4-point Likert scale (completely satisfied, quite satisfied, quite dissatisfied, completely dissatisfied).
The heartburn version of the QOLRAD questionnaire is a disease-specific quality of life instrument that includes 25 items combined into five domains: Emotional distress, Sleep disturbance, Food/drink problems, Physical/social functioning and Vitality. Questions are rated on a 7-point Likert scale; the lower the value the more severe the impact on daily functioning . Previous studies have shown that a difference of approximately 0.5 points represents a clinically relevant change [4, 10]. The QOLRAD questionnaire has been validated in Australia, Canada (French- and English-speaking regions), USA, UK, Germany, Italy, Spain, Hungary, Poland and South Africa [9–12, 14, 15]. The Dutch version of the QOLRAD questionnaire was developed from the English version by forward-back translation.
Internal consistency refers to the extent to which the items within each domain are interrelated. Cronbach's α coefficient is the most widely used method of assessing internal consistency; a high α coefficient (≥ 0.70) suggests good internal consistency and reliability .
Ceiling effects (the proportion of patients having the maximum score) were also assessed. The presence of ceiling effects, in which a high proportion of the patients grade themselves as having the maximum score, indicates that the scales will have poor discrimination. Thus sensitivity and responsiveness is reduced.
Construct validity assesses whether an indicator actually measures its underlying attribute. The construct validity was examined by convergent and known-groups validity.
Convergent validity demonstrates whether a postulated instrument domain correlates appreciably with all other domains that should be related to it. Pearson's product moment correlation was used to compare the results of the QOLRAD questionnaire with clinician assessments of reflux symptoms. Similar domains in these instruments were expected to have high correlations with each other. A strong correlation was considered to be over 0.60, a moderate correlation between 0.30 and 0.60, and a low correlation below 0.30 . Low correlations were expected between those dimensions that are theoretically unrelated constructs, thereby testing the discriminant validity.
Known-groups validity consists of showing that an instrument can differentiate between groups of patients whose health status differs according to the characteristics of the patients' disease, in this case clinician-rated severity of GERD symptoms.
Responsiveness to change
Responsiveness to change was assessed using effect size and standardized response mean. The effect size anchors the changes against the variability in the sample, and is calculated by dividing the mean change by the standard deviation at baseline. The standardized response mean preserves the relation to a statistical test, and is calculated by dividing the mean change by the standard deviation of the change. According to Cohen's definition, an effect size ≥ 0.8 indicates a large responsiveness to change .
Data entry took place in an Oracle-based clinical database. Statistical analyses and computerized data checks were performed using Statistical Analysis System (SAS, version 8.02; Cary, 2001). The QOLRAD questionnaire was analysed as mean score per domain. If data were missing from one or more item, the mean of the completed items in the same domain was used, provided that more than half of the items in that domain had been completed.
Demographic and clinical characteristics
A total of 1166 patients were entered in the study (visit 1). Of these, 1033 (88.6%) took part in visit 2 and 957 (82.1%) took part in visit 4. The reasons for drop-out were withdrawal, loss to follow up and failure to fulfil eligibility criteria. The mean age was 49.1 years (standard deviation [SD]: 13.5) at visit 1, 49.3 years (SD: 13.4) at visit 2, and 49.3 years (SD: 13.3) at visit 4. Patient demographics and clinical data are summarized in Table 1.
All patients had a history of heartburn of at least 3 months, and the majority had episodes of heartburn of at least moderate severity on at least 3 days in the week prior to the study (Table 1). As rated by the investigator at baseline, 97.3% of patients had moderate or severe heartburn, 55.5% had moderate or severe regurgitation, and 13.7% had moderate or severe dysphagia. At visit 2, symptoms of heartburn, regurgitation and dysphagia were mild or absent in 96.7%, 97.7% and 99.1% of patients, respectively. Furthermore, 78.1% of patients reported having symptoms on at most one day a week. At visit 2, 95.3% of patients reported being satisfied with the way their reflux symptoms were treated.
Cronbach's α scores ranged from 0.83 (Vitality) to 0.92 (Emotional distress) at baseline, thus demonstrating internal consistency (Table 2). High ceiling effects (defined as > 30% of patients having the maximum score, i.e. 'none of the time' or 'none at all') were observed in 5 of the 25 items of the QOLRAD questionnaire. Four of these were in the Physical/social functioning domain. They were 'kept you from doing things with your family' (40.1%), 'difficulty socializing with family' (39.1%), 'unable to carry out daily activities' (38.4%) and 'unable to carry out normal physical activities' (34.8%). The fifth item with a high ceiling effect was in the Emotional distress domain: 'discouraged or distressed' (32.7%). No ceiling effects were observed in the remaining 20 items of the QOLRAD questionnaire.
Pearson correlation coefficients were used to assess the convergent validity. There was a negative correlation between the QOLRAD questionnaire and the clinician-assessed GERD symptom variables across all domains (Table 3). The QOLRAD domains of Sleep disturbance, Food/drink problems, Physical/social functioning and Vitality yielded the strongest correlation with clinician-assessed severity of heartburn. The QOLRAD Sleep disturbance domain also correlated with clinician-assessed severity of regurgitation.
Known-groups validity was used to compare the QOLRAD domain scores with clinician-rated severity of reflux symptoms (Figure 1). All domains of the QOLRAD questionnaire were able to differentiate between groups of patients whose health status differed according to clinician-rated severity of reflux symptoms. Increasing symptom severity was associated with a worsening impact on daily functioning (i.e. a lower QOLRAD score). QOLRAD domain scores negatively correlated with increasing clinician-rated severity of heartburn (Figure 1a) and regurgitation (Figure 1b).
Responsiveness to change
Responsiveness to change from visit 1 to visit 2 was evaluated using effect sizes and standardized response means (Table 4). Effect sizes and standardized response means were high (ranging from 1.15 to 1.93 and from 1.17 to 1.86, respectively) indicating a large responsiveness to change .
Mean QOLRAD domain scores
Mean QOLRAD domain scores at baseline (visit 1), at visit 2 and at visit 4 are shown in Figure 2. Items were rated on a 7-point Likert scale, with lower values indicating a more severe impact on daily functioning. At baseline, GERD symptoms impacted most strongly on Vitality (mean QOLRAD domain score: 3.9), followed by Food/drink problems (4.1), Sleep disturbance (4.5), Emotional distress (4.7) and Physical/social functioning (5.2). With treatment, mean QOLRAD domain scores increased by between 1.5 points (Physical/Social functioning) and 2.5 points (Vitality), indicating a clinically relevant improvement in patients' daily functioning.
The primary aim of this paper was to establish the psychometric characteristics of the Dutch translation of the QOLRAD questionnaire. The reliability of the translated questionnaire was assessed using internal consistency. All domains of the QOLRAD questionnaire demonstrated internal consistency, with Cronbach's α scores ranging from 0.83 to 0.92. Scores were thus well above the 0.60 required to support construct validity . These results are similar to those obtained for the Italian , German , Spanish , Polish  and Afrikaans  translations of the QOLRAD questionnaire, for which the overall Cronbach's α scores ranged from 0.77 to 0.95. In the present study, high ceiling effects were observed in five of the 25 QOLRAD domains - four in the Physical/social functioning domain and one in the Emotional distress domain. Sensitivity and responsiveness to change is thus likely to be reduced in these domains.
To assess construct validity, we used convergent validity and known-groups validity. Moderate correlations were found between QOLRAD domains and clinician-assessed severity of heartburn symptoms. Overall, convergent validity was moderate to low, and the highest values were obtained for the heartburn and regurgitation variables, these being the cardinal symptoms of GERD. The higher correlation with heartburn and regurgitation than with dysphagia may reflect that almost all patients had heartburn and regurgitation at study entry, but fewer than one-third had dysphagia. All domains of the QOLRAD questionnaire were able to differentiate between groups of patients whose health status differed according to clinician-rated severity of reflux symptoms, thereby confirming the known-groups validity of the instrument. Known-groups validity was similarly confirmed in the Italian , German , Spanish , Polish  and Afrikaans  translations of the QOLRAD questionnaire. Furthermore, QOLRAD domain scores negatively correlated with increasing clinician-rated severity of heartburn and regurgitation.
The responsiveness to change of the Dutch QOLRAD questionnaire was tested using effect sizes and standardized response means. According to Cohen's definition, an effect size ≥ 0.8 indicates a large responsiveness to change . Both the effect sizes and the standardized response means of the QOLRAD questionnaire were very high, ranging from 1.15 to 1.93, and from 1.17 to 1.86, respectively. The Dutch translation of the QOLRAD questionnaire thus displayed excellent responsiveness to change.
Reflux symptoms were seen to have a clear and consistently negative impact on patients' lives. QOLRAD scores were lowest in the Vitality domain (mean QOLRAD score: 3.9), indicating that patients were feeling tired or worn out, were generally unwell and had a lack of energy. Scores were also lowest in the Vitality domain in the Italian  and Polish  translations of the QOLRAD questionnaire (mean scores: 4.8 and 3.8, respectively). Scores were also impaired in the Vitality domain in the German , Spanish  and Afrikaans  translations of the QOLRAD questionnaire (mean scores: 4.4, 4.5 and 3.5, respectively), but were lowest in the Food/drink problems domain in these populations (mean scores: 4.4, 4.5 and 3.5, respectively), indicating that, because of their symptoms, patients were restricted in when or what they could eat and drink.
Virtually all patients reported moderate or severe heartburn in the week prior to the study, and more than half reported moderate or severe regurgitation. At visit 2, symptoms of heartburn and regurgitation were mild or absent in almost all patients. Furthermore, mean QOLRAD domain scores increased by between 1.5 points (Physical/social functioning) and 2.5 points (Vitality). Previous studies have shown that a difference in QOLRAD score of approximately 0.5 points represents a clinically relevant change [4, 10]. The improvements in QOLRAD scores observed in the current study thus suggest a clinically relevant improvement in patients' daily functioning with acid-suppressive treatment.
The study has two important limitations. Firstly, test-retest reliability was not reported. Secondly, the study was conducted in gastroenterology centres, and the results are thus particular to patients referred for gastroenterological investigation. Thus, no conclusions can be made as to whether the Dutch translation of the QOLRAD is consistent when measuring a stable variable on two separate occasions, or whether its psychometric characteristics would be equally good in different patient populations with GERD.
The psychometric characteristics of the Dutch translation of the QOLRAD questionnaire were found to be good, with satisfactory reliability and validity, and excellent responsiveness to change. In addition to the original English-language version, several different language versions of the QOLRAD questionnaire have also been validated [9–12, 19]. These, together with the Dutch translation of the QOLRAD questionnaire, provide an excellent basis for collaborative research between different parts of the world, and make international trials more applicable, comparable and generalizable despite differences in language and culture.
Vakil N, Veldhuyzen van Zanten S, Kahrilas P, Dent J, Jones R: The Montreal definition and classification of gastro-esophageal reflux disease (GERD) - a global evidence-based consensus. Am J Gastroenterol 2006, 101: 1900–1920. 10.1111/j.1572-0241.2006.00630.x
Vakil NB, Traxler B, Levine D: Dysphagia in patients with erosive esophagitis: prevalence, severity, and response to proton pump inhibitor treatment. Clin Gastroenterol Hepatol 2004, 2: 665–668. 10.1016/S1542-3565(04)00289-7
Wiklund I: Review of the quality of life and burden of illness in gastroesophageal reflux disease. Dig Dis 2004, 22: 108–114. 10.1159/000080308
Talley NJ, Fullerton S, Junghard O, Wiklund I: Quality of life in patients with endoscopy-negative heartburn: reliability and sensitivity of disease-specific instruments. Am J Gastroenterol 2001, 96: 1998–2004. 10.1111/j.1572-0241.2001.03932.x
Wahlqvist P, Karlsson M, Johnson D, Carlsson J, Bolge SC, Wallander MA: Relationship between symptom load of gastroesophageal reflux disease and health-related quality of life, work productivity, resource utilization and concomitant diseases: survey of a US cohort. Aliment Pharmacol Ther 2008, 27: 960–970. 10.1111/j.1365-2036.2008.03671.x
Food and Drug Administration: Guidance for industry. Patient-reported outcome measures: use in medical product development to support labeling claims (draft guidance). [http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM071975.pdf]
Talley NJ, Wiklund I: Patient reported outcomes in gastroesophageal reflux disease: an overview of available measures. Qual Life Res 2005, 14: 21–33. 10.1007/s11136-004-0613-5
Wiklund I: Patient-reported outcomes. In GI Epidemiology. 3rd edition. Edited by: Talley N, Locke GR, Saito YA. Oxford: Blackwells; 2007:24–29. full_text
Wiklund IK, Junghard O, Grace E, Talley NJ, Kamm M, Veldhuyzen van Zanten S, Paré P, Chiba N, Leddin DS, Bigard MA, Colin R, Schoenfeld P: Quality of life in reflux and dyspepsia patients. psychometric documentation of a new disease-specific questionnaire (QOLRAD). Eur J Surg Suppl 1998, 583: 41–49.
Kulich KR, Malfertheiner P, Madisch A, Labenz J, Bayerdörffer E, Miehlke S, Carlsson J, Wiklund IK: Psychometric validation of the German translation of the gastrointestinal symptom rating scale (GSRS) and quality of life in reflux and dyspepsia (QOLRAD) questionnaire in patients with reflux disease. Health Qual Life Outcomes 2003, 1: 62. 10.1186/1477-7525-1-62
Kulich KR, Wiklund I, Junghard O: Factor structure of the quality of life in reflux and dyspepsia (QOLRAD) questionnaire evaluated in patients with heartburn predominant reflux disease. Qual Life Res 2003, 12: 699–708. 10.1023/A:1025192100450
Kulich KR, Calabrese C, Pacini F, Vigneri S, Carlsson J, Wiklund IK: Psychometric validation of the Italian translation of the gastrointestinal symptom-rating scale and quality of life in reflux and dyspepsia questionnaire in patients with gastro-oesophageal reflux disease. Clin Drug Invest 2004, 24: 205–215. 10.2165/00044011-200424040-00002
Engels L, Klinkenberg-Knol EC, Dekkers C, Beker JA, Tan TG, Timmerman RJ, Haeck PWE: Esomeprazole continuous versus on demand maintenance therapy in 1052 gastro-oesophageal reflux patients: similar satisfaction but superior quality of life for once daily treatment. Gut 2003,52(Suppl VI):A130.
Kulich KR, Piqué JM, Vegazo O, Jiménez J, Zapardiel J, Carlsson J, Wiklund I: [Psychometric validation of translation to Spanish of the gastrointestinal symptoms rating scale (GSRS) and quality of life in reflux and dyspepsia (QOLRAD) in patients with gastroesophageal reflux disease]. Revista Clinica Espanola 2005, 205: 588–595. 10.1016/S0014-2565(05)72651-5
Kulich KR, Regula J, Stasiewicz J, Jasinski B, Carlsson J, Wiklund I: [Psychometric validation of the Polish translation of the gastrointestinal symptom rating scale (GSRS) and quality of life in reflux and dyspepsia (QOLRAD) questionnaire in patients with reflux disease]. Pol Arch Med Wewn 2005, 113: 241–249.
Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16: 297–334. 10.1007/BF02310555
Hinkle DE, Jurs SG, Wiersma W: Applied statistics for the behavioural sciences. 2nd edition. Boston: Houghton Mifflin; 1988.
Cohen J: Statistical power analysis for the behavioural sciences. New York: Academy Press; 1977.
van Rensburg CJ, Kulich KR, Carlsson J, Wiklund IK: Psychometric validation of the Afrikaans translation of two patient-reported outcomes instruments for reflux disease. S Afr Rev Gastroenterol 2006, 4: 5–9.
We would like to thank Dr Anja Becher and Dr Christopher Winchester, from Oxford PharmaGenesis™ Limited, who provided editorial assistance on behalf of AstraZeneca. The study was funded by AstraZeneca, the Netherlands.
Jonas Carlsson is an employee of AstraZeneca R&D Mölndal. Katarina Halling was employed by AstraZeneca R&D Mölndal at the time the study was conducted.
All authors contributed to the concept and design of the study, to the interpretation of the data and to drafting the manuscript. JC performed the statistical analysis. All authors read and approved the final manuscript.
About this article
Cite this article
Engels, L.G., Klinkenberg-Knol, E.C., Carlsson, J. et al. Psychometric validation of the Dutch translation of the quality of life in reflux and dyspepsia (QOLRAD) questionnaire in patients with gastroesophageal reflux disease. Health Qual Life Outcomes 8, 85 (2010). https://doi.org/10.1186/1477-7525-8-85
- Gastroesophageal Reflux Disease
- Reflux Symptom
- GERD Symptom
- Standardize Response Means