Validation of an Estonian version of the Parkinson's Disease Questionnaire (PDQ-39)
Health and Quality of Life Outcomes volume 6, Article number: 23 (2008)
Diagnosis and management of Parkinson's disease (PD) rely heavily on evaluation of clinical symptoms and patients' subjective perception of their condition. The purpose of this study was to evaluate the validity, acceptability, and reliability of the Estonian version of the 39-question Parkinson 's disease Questionnaire (PDQ-39).
Study subjects were approached during their regular clinic follow-up visits. 104 patients consented to the study and 81 completed questionnaires were used for subsequent testing of psychometric characteristics, validity and reliability.
The content validity was assessed through qualitative content analysis during the pilot study. The patients indicated that the questions were relevant to measure the quality of life of people with PD.
The analysis of means showed that the ceiling and floor effects of domain results were within the limits of 15% of Summary Index and of all domains except Stigma, Social Support and Communication where the ceiling effect was 16% to 24% of the responses. Convergent validity was interpreted through correlation between disease severity and PDQ-39 domains. There was a statistically significant difference between the domain scores in patients with mild versus moderate PD in domains of Mobility, ADL, and Communication but not for Stigma, Social Support and Cognition. The reliability was good, Cronbach alpha for all domains and summary index was over 0.8 and item-test correlations between domains and summary index ranged from 0.56 to 0.83.
The psychometric characteristics of an Estonian version of the PDQ-39 were satisfactory. The results of this study were comparable to the results of previous validation studies in other cultural settings in UK, USA, Canada, Spain and Italy.
The Estonian version of the PDQ-39 is an acceptable, valid and reliable instrument for quality of life measurement in PD patients.
Parkinson's disease (PD) is a progressive neurodegenerative disorder, characterised by bradykinesia, tremor, disturbances of postural reflexes and of the autonomic nervous system, and which is most prevalent in old age [1–3].
Diagnosis and management of PD is based on clinical assessment of symptoms and signs using disease specific rating scales [4, 5]. Evaluation of disease severity, effect of treatment procedures and interventions are all influenced by the patient's perception of their disease and assessment instruments have to take this aspect into account [4–6]. Such instruments measuring different factors affecting patient's perception of well-being in relation to disease and health are referred to as health related quality of life (HRQOL) questionnaires. Measures of general HRQOL, like the SF-36 [7, 8] are used widely but are less suited to assessment and management of a specific health condition compared to their disease specific counterparts, like the 39-question Parkinson's Disease Questionnaire (PDQ-39) .
The PDQ-39 has been translated into many languages all over the world and extensively used for PD research by many authors [10–13]. Translation and validation of an instrument is a prerequisite for its use in a new cultural context and only after validation is it possible to compare the research data in a cross-cultural context [14, 15].
The authors hypothesized the Estonian version PDQ-39 to be an acceptable, valid and reliable measure for use in PD patients in Estonia and the aim of current study was to test these hypotheses.
The PDQ-39 consists of 39 questions, distributed between eight multi-item domains: Mobility – ten questions; Activities of Daily Living – six questions; Emotional Well-being – six questions; Stigma – four questions; Social Support – three questions; Cognition – four questions; Communication – three questions; Bodily Discomfort – three questions. Responses to all questions are coded and mapped to a percentage scale where 0 denotes "no problem" and 100 "maximum level of problem". Finally domain scores are generated by calculating a simple average over all domain item scores [6, 9].
The translation procedure in our study took into account different guidelines, recommendations and examples previously published on translation and cultural adaptation of quality of life measures [11–16]. The procedure comprised forward translation, assessment of item comprehension, back translation to English and development of a consensual version based on the results of previous translations and comprehension assessments. First, forward translation of the original PDQ-39 was independently carried out by two native Estonian speakers with excellent knowledge of English. Reconciliation of these two translations was then performed, followed by back translation into English by a third translator without access to the original version of PDQ-39. Comparison of the back-translation and original versions of the questionnaire was performed and the results were used for the development of the final consensual translation of the Estonian language PDQ-39. Distance conversion into the metric system was performed as a part of the translation process when questionnaire items involved such measurements.
The study included pilot-testing of the final Estonian version of the PDQ-39 using a group of 15 PD patients from the Tartu Parkinson's Disease Society . All the patients had first-hand knowledge of PD and agreed to comment on the understandability and relevance of the questionnaire items during a group interview based on focus group methodology. Descriptive figures on the group composition are given in the Table 1.
The main study involved 108 patients with a previous diagnosis of idiopathic PD who were approached during their regular follow-up visits to the neurological out-patient clinic of the Department of Neurology and Neurosurgery of the University of Tartu which is one of the two tertiary healthcare providers in Estonia. Patient recruitment was also carried out in 5 regional secondary level out-patient centres (out of 8) during 1999–2001 for a random mix of complex and regular cases. All patients consented to initial medical examination by the first author. Patients satisfying the criteria of the UK PD Society Brain Bank  and scoring over 25 points (out of 30) on cognitive function testing using the Mini Mental State Examination (MMSE)  were proposed to take part in the study. One hundred and four patients satisfied the inclusion criteria, completed informed consent forms and were enrolled into the study.
Disease severity assessment was performed during the recruitment visit, using the Unified Parkinson's Disease Rating Scale (UPDRS version 3.1) and Hoehn and Yahr (HY) staging system [4, 5]. All assessments of cognitive ability and disease severity were conducted when the patient's health status was stable and PD was in the 'on' period. Patients were grouped by severity of disease as follows: mild (HY stages I–II), moderate (HY III) and severe disease (HY IV–V). Disease grouping was used in order to estimate the correlation between clinical stages and PDQ-39 domains for assessment of convergent validity.
Co-morbidities were ascertained using medical records (e.g. depression was recorded as a co-morbid condition in case medical records included indications of depression, sleep disorder or antidepressant prescription). In addition, current medications for both PD and other diseases along with treatment side effects were recorded during the first examination.
PDQ-39 questionnaires were handed to study subjects at the end of their recruitment visit for self-reporting in their usual environment. The collection period for returned questionnaires was 4 weeks. Second copies of PDQ-39 (responses of which were not used for other psychometric tests) were mailed to all patients two weeks after the reception of the first questionnaire. The PDQ-39 was accompanied by a checklist on health status change during these two weeks. This test-retest was carried out to assess the reproducibility of the PDQ-39 results.
Acceptability, validity and reliability
The psychometric analysis of the Estonian version of the PDQ-39 was performed by evaluation of acceptability, validity, and reliability of the questionnaire using qualitative content analysis and a variety of statistical procedures.
All PDQ-39 domains and general health status data were checked for floor and ceiling effects and less than 15% of minimum or maximum values per domain were considered acceptable . Skewness and kurtosis were calculated to ascertain normal distribution of the data. Background data were analysed using univariate methods and ANOVA. The Kruskal-Wallis test was applied to compare the distribution of mean scores of the domains of PDQ-39.
Content validity of the questionnaire was tested during the pilot-testing of the PDQ-39 translation. Group discussion and interviews followed completion of the questionnaire regarding how easy it was to understand, whether it measured quality of life and how relevant it was.
Construct validity was assessed by comparing PDQ-39 domain scores by the HY stages using ANOVA statistics.
Cronbach alpha greater than 0.7 was considered a strong indication of questionnaire reliability. Item-total correlations over 0,4 were considered to show acceptable correlation between the questionnaire items. Spearman rank correlation was used to show item-item correlations.
Reproducibility was tested using test-retest analysis and a correlation of 0.7 or more determined an adequate result. All test results with an error level of 5% or less (p ≤ 0.05) were considered statistically significant.
Psychometric analysis was conducted in two groups of patients: 15 patients in the pilot study for processing the qualitative assessment of the questionnaire and 104 patients in the main study group, for which 81 self-reported questionnaires were completed and used in the statistical analysis, a response rate of 79%. The PD patients who entered the final analysis group were categorised by severity of disease as follows: 48 patients (59%) in mild stage (HY stage I–II), 29 patients (36%) in moderate stage (HY III) and 4 patients (5%) in severe stage (HY IV–V). Non-responders belonged to mild (16 patients) and moderate (5 patients) disease groups while two disease severity assessment questionnaires were unusable. Descriptive characteristics of the responders and non-responders are shown in Table 1.
The most frequently reported concomitant diseases were high blood pressure (24%), coronary heart disease (24%), and joint disease (14%). There were two cases of stroke and one of malignancy among the patients in the severe disease group. The majority (60%) of patients lived in an urban area. The most common medication was levodopa and all patients with severe PD suffered from adverse effects of their medications.
Validity interpretation was carried out using the ability of the PDQ-39 to distinguish high and low symptom burden and correlation of questionnaire responses to clinically assessed severity of PD. The patients in mild stages of PD had an average summary index score 35.8, for patients in a moderate stage of disease it was 46.1 and for patients in an advanced stage of the disease it was 59.1 (Figure 1). There was a statistically significant difference between the domain scores in patients with mild versus moderate PD for the domains of Mobility, ADL, and Communication. The difference in scores for Stigma, Social support and Cognition was not significant.
Content validity was assessed through the qualitative content analysis during the pilot study. All the questions and domains were essential to PD patients for measurement of quality of life.
Internal consistency for all domains was good as the Cronbach alpha measure was above 0.7 in all cases (ranging from 0.81 to 0.86) indicating good reliability of the questionnaire (see details in Table 2). Item-test correlations for all questions and domains ranged from 0.56 to 0.83 again confirming the consistency of the questionnaire (only domain figures are given in Table 2 for the sake of brevity). The item-item correlations of mean domain scores were moderate ranging from 0.67 between Mobility and Activities of Daily Living to 0.2 between Communication and Bodily Discomfort (Table 3) as expected.
Reproducibility of the results and test-retest reliability of the questionnaire were assessed by correlation between results of test and retest questionnaires from a selection of patients. These results ranged from 0.72 to 0.92 indicating good reproducibility. The retest number of responders was 78.
The whole range of possible scores (0–100) of the PDQ-39 domains were covered. The mean and median were very similar in the domains of Mobility, Activity of Daily Living (ADL), Emotional Well-Being and Stigma, with a difference of less than 10%. For Cognition, the difference was 16%. The difference between the mean and median for the summary index was approximately 1% (see Table 4 for details).
The floor effect ranged from 1.2% to 2.5% in the domains of Mobility, ADL, Emotional Well-being, Cognition and Bodily Discomfort, while for the domains of Stigma, Social Support and Communication it ranged from 16% to 24%, which was more than hypothesized. It is also noteworthy that among patients with moderate or severe PD patients the response distribution was more central and the only floor effect was recorded for the Social Support domain (21% compared to the 25% in the mild PD group). The lowest ceiling effects (1.2%) were observed in Mobility, ADL, Emotional Well-Being, Social Support and Communication domains. In other domains the ceiling effect was between 2.4% to 3.7%. The criterion of ceiling effects below 15% was achieved in all domains. Both ceiling and floor effects of the Summary index (SI) were at the 1.2% level. The analyses showed that the distribution of the results in the domains and summary index was within the limits of the preset criteria in most cases.
This paper presented the evidence on acceptability, validity and reliability of the Estonian version of the PDQ-39 which were good as originally hypothesised. The descriptive statistics for the acceptability assessment of the questionnaire showed a good distribution of the response choices on the scale level, ceiling and floor effects were low and within hypothesized limits with only few exceptions. Content and face validity tests unambiguously showed that the covered topics and items in the translated PDQ-39 questionnaire are relevant to the Estonian PD patients. Validity assessment of the Estonian version of the PDQ-39 was guided by experience from previous similar studies [6, 21–25] and as expected the localised version of PDQ-39 was able to differentiate between disease groups with the lowest and highest PD burden. Most of the previous validation studies in other cultural settings [9–16] have used a variety of rating scales and classifications like Hoehn and Yahr stages, UPDRS scores and main symptoms for assessment of construct validity. All these studies found statistically significant differences between disease severity and PDQ-39 domains as an example for the domains of Mobility and Activities of Daily Living (mean scores ranging from 22.34 (HY I) to 75.25 (HY IV–V) [6, 22, 24, 25] which ranged from 36.5 (HY I–II) to 90.5 (HY IV–V) in our study. The differences of the domains of Stigma, Social support, Emotional Well-Being and Bodily discomfort were not so clearly related to the severity of PD stages. The summary index scores were the lowest in the patient group with mild PD and highest in the severe disease group as expected to once more indicating close psychometric values to other language versions of PDQ-39 [11, 12, 22]. The somewhat worse domain scores especially in the case of Mobility and Activities of Daily living could be related to the still developing social care system in Estonia but verification of this assumption would recuire a direct comparison of country situations and respective social care systems.
Regarding the reliability and other internal consistency measures the strongest correlations between domain and total questionnaire score have been found for the domains of mobility and Activities of Daily Living [9–16]. These two domains showed strong item-test correlations in our study as well. The reliability figures of Estonian version of PDQ-39 surpassed the results from cross-cultural studies from USA, Canada, Spain, Italy and Japan  as witnessed by Cronbach alpha above 0.80  for all domains compared to a wider range (from 0.13 to 0.96) in those studies. The lowest Cronbach alpha coefficients in those studies were found in Japan and seemed to be connected to that particular cultural background . Test-retest analysis showed no differences of score distributions between the two assessments as no changes were recorded in previous reports of the original version of PDQ-39 [15, 22, 24]. The localisation of PDQ-39 to Estonian context was successful since all preset criteria were met and the results of this study were comparable to the results of previous validation studies in other cultural settings in UK, USA, Canada, Spain and Italy.
One of the possible drawbacks of the current study is associated with the relatively small sample size. However, during the study planning a relative size of the study group was set at 5% of the total PD population in Estonia and that target was reached with the current sample. Also, the mean age of the patients in the sample corresponded well to the mean age of the overall PD population in Estonia . Especially good representativeness of the Estonian PD population was achieved for the patient groups with mild and moderate disease. However, the patient group with severe PD had better response rate than the group with mild PD as 4 out of 5 patients did return a filled questionnaire. The PDQ-39 is a self-administered written questionnaire and the study inclusion criteria therefore were set to include only patients having the ability to perform that particular task. The small number of patients with severe PD available for validation of written PDQ-39 highlighted the need for a HRQL measure in Estonia that could be administered in an interview form to the severe patients of PD.
The analysis of sample variation and statistical significance testing showed that albeit the possible drawbacks related to the sample size and composition the Estonian language version of PDQ-39 performed well in the psychometric testing. Therefore, the use of PDQ-39 is highly warranted for disease assessment and treatment management among the PD patients able to administer the questionnaire as the localised version of the PDQ-39 is a valid and reliable tool in this setting.
The Estonian version of the PDQ-39 demonstrated similar validity and reliability to the original English language version.
It is an acceptable, valid and reliable instrument to measure quality of life of PD patients in future studies in Estonia.
Parkinson's disease Questionnaire
health related quality of life
Activities of Daily Living
Mini Mental State Examination
Hoehn and Yahr staging system
Unified Parkinson's Disease Rating Scale version 3.1.
Shrag A, Ben-Shlomo Y, Quinn NP: Cross-sectional prevalence survey of idiopathic Parkinson's disease and parkinsonism in London. BMJ 2000, 321: 21–22. 10.1136/bmj.321.7252.21
Marttila RJ, Rinne UK: Epidemiology of Parkinson's disease in Finland. Acta Neurol Scand 1976, 53: 81–102.
Taba P, Asser T: Epidemiology of Parkinson's disease. Reviews in Clinical Gerontology 2005, 14: 211–218. 10.1017/S0959259805001541
Fahn S, Elton RL: Members of the UPDRS Development Committee: Unified Parkinson's Disease Rating Scale. In Recent Developments in Parkinson's Disease. Edited by: Fahn S, Mardsen CD, Calne DB, Lieberman A. Florham Park, Macmillan Health Care Information; 1987:153–163.
Hoehn MM, Yahr MD: Parkinsonism: onset, progression and mortality. Neurology 1967, 17: 427–442. [http://www.neurology.org/cgi/content/citation/17/5/427]
Peto V, Jenkinson C, Fitzpatrick R, Greenhall R: The development and validation of short measure of functioning and well being for individuals with Parkinson's disease. Qual Life Res 1995, 4: 241–248. 10.1007/BF02260863
Bowling A: Measuring Disease: a review of disease – specific quality of life measurement scales. Philadelphia. Open University Press Buckingham; 1995.
Hays RD, Sherbourne CD, Mazel RM: The Rand 36-item health survey 1.0. Health Econ 1993, 2: 217–227. 10.1002/hec.4730020305
Jenkinson C, Peto V, Fitzpatrick R, Greenhall R, Hyman N: Self-reported functioning and well-being in patients with Parkinson's disease: a comparison of the short-form health survey (SF-36) and the Parkinson's Disease questionnaire (PDQ-39). Age Ageing 1995, 24: 505–509. 8588541
Jenkinson Cr, Fitzpatrick R, Norquist J, Findley L, Hughes K: Cross-cultural evaluation of the Parkinson's Disease Questionnaire: tests of data quality, score reliability, response rate, and scaling assumptions in the United States, Canada, Japan, Italy, and Spain. Journal of Clinical Epidemiology 2003, 56: 843–847. 10.1016/S0895-4356(03)00148-3
Katsarou Z, Bostantjopoulou S, Peto V, Alevriadou A, Kiosseoglou G: Quality of Life in Parkinson's Disease: Greek translation and validation of the Parkinson's disease questionnaire (PDQ-39). Qual Life Res 2001, 10: 159–163. 10.1023/A:1016720400862
Ma H-I, Hwang W-J, Chen-Sea M-J: Reliability and validity testing of a Chinese-translated version of the 39-item Parkinson's Disease questionnaire (PDQ-39). Qual Life Res 2005, 14: 565–569. 10.1007/s11136-004-0687-0
Martinez-Martin P, Frades Payo B: Quality of life in Parkinson's disease: validation study of the PDQ-39 Spanish version. J Neurol 1998, 245: S34-S38. 10.1007/PL00007737
Mathias SD, Fifer SK, Patrick DL: Rapid translation of quality of life measures for international clinical trials: avoiding errors in the minimalist approach. Qual Life Res 1994, 3: 403–412. 10.1007/BF00435392
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P: Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health 2005, 8: 94–104. 10.1111/j.1524-4733.2005.04054.x
Bushnell DM, Martin ML: Quality of life and Parkinson's disease: Translation and validation of the US Parkinson's Disease Questionnaire (PDQ-39). Qual Life Res 1999, 8: 345–350. 10.1023/A:1008979705027
Tartu Parkinson's Disease Society[http://www.parkinson.ee]
Gibb WRG, Lees AJ: The relevance of the Lewy body to the pathogenesis of idiopathic Parkinson's disease. J Neurol Neurosurg Psychiatry 1988, 51: 745–752.
Folstein MF, Folstein SE, McHugh PR: "Mini-mental State" A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 1975, 12: 189–198. 10.1016/0022-3956(75)90026-6
Bowling A: Research methods in health: investigating health and health services. 2nd edition. Philadelphia, Open University Press, Guildford and King's Lynn; 2002:147–155.
Scientific Advisory Committee of the Medical Outcomes Trust: Assessing health status and quality of life instruments: attributes and review criteria. Qual Life Res 2002, 11: 193–205. 10.1023/A:1015291021312
Martinez-Martin P, Serrano-Dueòas M, Vaca-Baquero V: Psychometric characteristic of the Parkinson's disease questionnaire (PDQ-39) – Ecuadorian version. Parkinsonism Relat Disord 2005, 11: 297–304. 10.1016/j.parkreldis.2005.02.003
Herodes M, Õun A, Haldre S, Kaasik A-E: Epilepsy in Estonia: A quality of life study. Epilepsia 2001, 42(8):1061–1073. 10.1046/j.1528-1157.2001.0420081061.x
Jenkinson C, Fitzpatrick R, Peto V: Health-related quality of life measurement in patients with Parkinson's disease. Pharmacoeconomics 1999, 15: 157–165. 10.2165/00019053-199915020-00004
Fitzpatrick R, Jenkinson C, Peto V, Hyman N, Greenhall R: Desirable properties for instruments assessing quality of life: evidence from the PDQ-39. J Neurol Neurosurg Psychiatry 1997, 62(1):104.
Cronbach LJ, Meehl PE: Construct validity in psychological tests. Psychol Bull 1955, 52: 281–302. 10.1037/h0040957
Taba P, Asser T: Prevalence of Parkinson's disease in Estonia. Acta Neurol Scand 2002, 106: 276–281. 10.1034/j.1600-0404.2002.01286.x
The study was supported by grant No. 1869 from the Estonian Science Foundation and by grant VARMC-TIPP from the Centre of Molecular and Clinical Medicine, University of Tartu. Work of TL was supported by Ministry of Education targeted research funding grant No. 2648 to the Department of Public Health, University of Tartu. We are indebted to Health services Research Unit from University of Oxford for making available the Parkinson's disease Questionnaire.
We thank prof Margus Lember, for careful review of the manuscript and for his comments during the preparation of the paper. We are indebted to members of the Tartu Parkinson's Disease Society and to all the patients with PD who were involved in this study.
The author(s) declare that they have no competing interests.
ÜK collected data and drafted the whole manuscript. TA was involved in conception and design the study. PT contributed in interpretation of data and in selection of patients, TL performed statistical analysis and contributed in interpretation of data. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Krikmann, Ü., Taba, P., Lai, T. et al. Validation of an Estonian version of the Parkinson's Disease Questionnaire (PDQ-39). Health Qual Life Outcomes 6, 23 (2008). https://doi.org/10.1186/1477-7525-6-23
- Bodily Discomfort
- Severe Disease Group
- Summary Index Score
- Estonian Language
- Estonian Version