Validity and reliability of the Korean version of the pediatric quality of life ESRD module
Health and Quality of Life Outcomes volume 10, Article number: 59 (2012)
Health-related quality of life is a very important issue in children with end-stage renal disease and their family. Moreover, this can be a lifelong problem. In this study, we performed a cross-sectional investigation of the health-related quality of life in Korean children, undergoing renal replacement therapies, such as dialysis and renal transplantation.
We validated the Korean version of the PedsQL 3.0 End-Stage Renal Disease Module by comparing with the PedsQL 4.0 Generic Core Scales. A total of 92 pediatric patients with end-stage renal disease, aged 2–18 year old, were enrolled in four teaching hospitals in Korea. The module was acceptable for both parent proxy-report and child self-report. The response rate was acceptable, since no reminders were delivered. A large proportion of the responders answered >90% of the items, which suggests a good face validity. The PedsQL 4.0 Generic Core Scales and the PedsQL 3.0 End-Stage Renal Disease Module showed minimal missing values in the current study, which supported feasibility. The validation analyses revealed acceptable floor and ceiling effects and an acceptable construct validity.
The PedsQL 3.0 End-stage Renal Disease Module may be useful as an end-stage renal disease -specific instrument in the evaluation of the health-related quality of life in Korean children; however, a larger, longitudinal prospective study is needed.
Recent medical advances have resulted in remarkable improvements in the treatment of patients with chronic diseases, especially, in children [1–3]. However, end-stage renal disease (ESRD) practically affects every organ system, and thus, has a major impact, not only on mortality, but also on the quality of life (QOL) of the children suffering from the disease . Systemic assessment of the health-related quality of life (HRQOL) in these children must be another essential process that may help promote a pediatric patient’s successful transition into adulthood .
Recently, researchers have used pediatric HRQOL measures as a tool to evaluate healthcare services in an effort to improve the patient health and their well-being [6, 7]. For pediatric patients with ESRD, there has been an increasing clinical interest in their QOL, and their psychosocial adaptation [3, 5, 8–16].
To measure HRQOL, among the children with ESRD, we used several instruments, including the Pediatric Quality of Life Inventory™ (PedsQL™) Generic Core Scales , which contain general domains, but no ESRD-specific domains. Because of the need for a more appropriate measurement, the PedsQL™ End Stage Renal Disease Module  was developed as a PedsQL™ disease-specific module. The PedsQL™ was designed under a modular-approach  to cover both the generic and disease-specific domains. The PedsQL™ End Stage Renal Disease Module was developed through the focus groups, involving the healthcare providers, children, and parents; cognitive interviews; pre-testing; and field-testing .
The goal of this study is to assess the psychometric properties of the Korean translation of the PedsQL™ End Stage Renal Disease.
Participants and settings
We performed a cross-sectional study of the Korean translations of the PedsQL End Stage Renal Disease Module, comparing the child self-reported and parent-proxy–reported HRQOL of the children with ESRD. The PedsQL 3.0 End Stage Renal Disease Module was administered from January 2011 through June 2011, one time each to the child and parent at four pediatric ESRD centers. Participants included children aged 2 to 18 years that received maintenance dialysis treatment or renal transplant care for at least 6 months and their parents. Child self-report includes ages 5–7, 8–12, and 13–18. Parent proxy-report includes ages 2–4 (toddler), 5–7 (young child), 8–12 (child), 13–18 (adolescent), and assesses the parent’s perception of their child's HRQOL.
The human subject institutional review boards, at each institution, approved the study. Written parental informed consent and child assent were obtained before the enrollment of the subjects.
Translation - The Korean translations of the Pediatric Quality of Life Inventory™ (PedsQL™ 3.0) Version 3.0 End Stage Renal Disease Module
After we acquired permission from the original developer (Mapi Research Trust, on behalf of Dr. James W. Varni, copyright owner in the PedsQL™ ) for the original PedsQL 3.0 End Stage Renal Disease Module, the original English version of the PedsQL 3.0 End Stage Renal Disease Module was first translated into Korean, by a native Korean professional translator, who majored in English literature. Another bilingual translator backward-translated this revised Korean version of the PedsQL 3.0 End Stage Renal Disease Module into English. The correspondence between this back-translated version and the original English version was reviewed by the panel again. After considering the original, translated, and back-translated versions all together, we produced a pilot Korean version of the PedsQL 3.0 End Stage Renal Disease Module. Five children, from each age group participated in the pilot testing along with their parents. A researcher (MH or KS) measured the time taken to complete the questionnaire. Upon completing the questionnaire, the researcher interviewed each child and his or her parent, and the thought processes used in answering the questionnaire were deduced by cognitive interviewing . A final version of the Korean version of the PedsQL™ 3.0 End Stage Renal Disease Module was produced after revising the pilot version using data obtained during pilot testing.
Parents completed a modified PedsQL 4.0 Generic Core Scales, PedsQL 3.0 End Stage Renal Disease Module that contained demographic information, including the child's date of birth, sex, parental age and education level, and patient's diagnosis age and duration.
PedsQL 3.0 end stage renal disease module
The 34-item PedsQL 3.0 End Stage Renal Disease Module includes 7 scales. The scales are composed of both the child self-report and parent-proxy report formats for children aged 5 to 18 years, and a parent-proxy report format for children aged 2 to 4 years. The format, instructions, Likert response scale, and scoring method were identical to the PedsQL 4.0 Generic Core Scales, with higher scores indicating better HRQOL .
The psychometric elements of the PedsQL 3.0 End Stage Renal Disease Module were examined in two parts: First, we assessed the data quality and internal consistency. Second, we compared PedsQL 3.0 End Stage Renal Disease Module and PedsQL 4.0 Generic Core Scales. Analyses were performed with SPSS 15.0 (SPSS, Chicago, IL).
Data quality was assessed by the mean, extent of ceiling and floor effects. Floor and ceiling effects between 1% and 15% were defined as optimal . Internal consistency has been assessed with the use of Cronbach’s alpha. While tests for construct validity usually compared PedsQL 4.0 Generic Core Scales, a spearman rank correlation test was used as a nonparametric approach , which is also used in most validation studies. Agreement between the child self-report and parent proxy-report was determined, through a two-way mixed effect model (absolute agreement, single measure) intraclass Correlation Coefficients (ICC) . The ICC offers an index of absolute agreement, given that it takes into account the ratio between the subject variability and total variability [3, 21, 22]. ICCs are designated as ≤ 0.40 poor to fair agreement, 0.41–0.60 moderate agreement, 0.61–0.80 good agreement, and 0.81–1.00 excellent agreement .
A total of 92 children and adolescents (aged 2 to 18 years) with ESRD and their parents were enrolled in our study. Both the child self-report and parent-proxy report were available for the eighty six children aged 5 to 18 years. Most of the parent proxy reports in our study were completed by the mothers except one. The sample consisted of children receiving hemodialysis (n = 11; 12.0%), peritoneal dialysis (n = 44; 47.8%) and a renal transplant (n = 37; 40.2%) (Table 1).
The percentage of missing item responses was less than 1.1% for the child self-report and parent proxy report. The average scores of the parent proxy report were 45.4-72.3 and the child self-report were 57.5-71.4. Ceiling effects occurred between 1.1% and 14.1% and floor effects occurred between 4.3% and 14.1%; thus, these effects did not represent a limitation of the PedsQL End Stage Renal Disease Module.
Internal consistency reliability coefficients for the PedsQL 3.0 End Stage Renal Disease Module are listed in Table 2. All parent-proxy report scales, except for one, exceeded the minimum reliability standard of 0.70, and four child self-report scales exceeded the minimum reliability standard.
Intercorrelations, between the Generic Core Scales and summary scores with the PedsQL 3.0 End Stage Renal Disease Module, are listed in Table 3. The majority of intercorrelations were in the medium to large range, supporting the construct validity.
Table 4 lists ICCs between the children self-report and parent proxy report. ICCs are in the moderate or good agreement range for 11 of 12 PedsQL Scales and in the poor agreement range for 1 of 12 PedsQL Scales. The greatest overall agreement is found on the School function (0.73) and the lowest agreement is found on the Worry (0.35).
We have translated and adapted the original 34-items of PedsQL 3.0 End Stage Renal Disease Module into a Korean version. The Korean, as well as the English version of the PedsQL 3.0 End Stage Renal Disease Module, represents a comprehensive, brief and low time consuming instrument to assess the quality of care of pediatric ESRD patients.
According to the recent Consensus-based Standards (COSMIN) of assessing the methodological quality of patient reported measures , reliability, validity and responsiveness must be evaluated before these instruments can be used for research and development. Thus, we needed to first look at the content, criteria and construct validity of the PedsQL 3.0 End Stage Renal Disease Module, since this study may point out critical issues.
The response rate was acceptable since no reminders were delivered. A large proportion of the responders answered >90% of theitems, suggesting good face validity. In addition, the PedsQL 4.0 Generic Core Scales and the PedsQL 3.0 End Stage Renal Disease Module showed minimal missing values in the current study, supporting feasibility . The validation analyses revealed acceptable floor and ceiling effects, and an acceptable internal consistency for the seven proposed subscales and a reasonable good model fit of the proposed factorial structures.
Our findings showed that the instrument had reasonably good internal’s reliability, among the ESRD patients; the results of the assessment of internal consistency showed that the PedsQL 3.0 End Stage Renal Disease Module appeared to measure what it is supposed to. For the PedsQL 3.0 End Stage Renal Disease Module, six of seven parent-proxy report scales, and five of seven child self-report scales exceeded the minimum coefficient standard of 0.70. Scales that met the minimum coefficient standard of 0.70 may be used to examine the specific domains of HRQOL, as well as subgroup differences. In the current study, only the Cronbach’s alpha for the Treatment Problems Scale for child self-report was problematic, which is similar to the original US study . As noted by Goldstein et al. , the Treatment Problems Scale is not conceptually an HRQOL scale as such, but rather a treatment barriers scale, and in the adult patients, higher perceived barrier scores were significantly associated with lower self-reported adherence and poorer prescription refill rates. However, parents provided more prompts to their children to take medication if their children had a greater number of problems . That is, a remembrance to take medications that is an item of Treatment Problems Scale is affected by their parents in Korea, the other three treatments barrier items are affected by their self. The other child self-report scales are over or near 0.70. These items were shown to be selective and non-redundant, which resulted in very satisfactory results for Cronbach’s alpha .
In this study, children with ESRD and their parents were shown to have poor to good agreement at most. These results indicate that the information provided by proxy respondents is not always equivalent to that reported by the patient. Child age and parental distress can affect the children’s and parents’ perceptions of the health and well-being of the child .
The present study has several limitations. Although our recruitment strategy enabled us to generalize beyond a clinical sample, and was comparable to the other samples, in terms of age and sex, the sample was a purposive one. Further, information for nonparticipants was not available, and in addition, the sample size for young children with ESRD was small and the sample size of older children was large, which may limit generalizability. Although the number of patients used in this study was lower (92 patients), these enrolled patients consisted of about 31% of the total pediatric ESRD patients in our country, the so called ‘The Korea Pediatric CKD registry’, which has been operated from 2007 to 2010. A total of 294 patients (hemodialysis: 27 patients, peritoneal dialysis: 99 patients, renal transplantation: 168) were registered to that registry. At present, the most common causes of ESRD in adults are diabetes mellitus (DM) and hypertension, but, in children, glomerulonephritis and chronic pyelonephritis are most common causes, similar to that of the previous reports. Although the prevalence rate of DM and hypertension in children are markedly increasing, these causes cannot develop ESRD within the childhood period because of long duration for progression to ESRD. Therefore, the incident rate of ESRD in children is extremely rare (only 4 children/million), and adolescent patients tend to be relatively more than young children during childhood period.
This study demonstrated that the PedsQL 3.0 End Stage Renal Disease Module was a feasible, reliable, and a valid instrument to assess the specific HRQOL in children with ESRD, and the PedsQL 3.0 End Stage Renal Disease Module represented a realistic and relevant landscape of the components relevant for the future evaluation of Korean chronic care.
Comparative Fit Index
End-Stage Renal Disease
Family and Peer Interaction
About my kidney disease
Health-related Quality of Life
Perceived Physical Appearance
Pediatric Quality of Life Inventory™
Root Mean Square Error of Approximation
Weighted Least-Squares Method.
Newacheck PW, Taylor WR: Childhood chronic illness: prevalence, severity, and impact. Am J Public Health 1992, 82: 364–371. 10.2105/AJPH.82.3.364
Varni JW, Limbers CA, Burwinkle TM: Impaired health-related quality of life in children and adolescents with chronic conditions: a comparative analysis of 10 disease clusters and 33 disease categories/severities utilizing the PedsQL 4.0 Generic Core Scales. Health Qual Life Outcomes 2007, 5: 43. 10.1186/1477-7525-5-43
Goldstein SL, Graham N, Warady BA, Seikaly M, McDonald R, Burwinkle TM, Limbers CA, Varni JW: Measuring health-related quality of life in children with ESRD: performance of the generic and ESRD-specific instrument of the Pediatric Quality of Life Inventory (PedsQL). Am J Kidney Dis 2008, 51: 285–297. 10.1053/j.ajkd.2007.09.021
Baum M: Overview of chronic kidney disease in children. Curr Opin Pediatr 2010, 22: 158–160. 10.1097/MOP.0b013e32833695cb
Goldstein SL, Rosburg NM, Warady BA, Seikaly M, McDonald R, Limbers C, Varni JW: Pediatric end stage renal disease health-related quality of life differs by modality: a PedsQL ESRD analysis. Pediatr Nephrol 2009, 24: 1553–1560. 10.1007/s00467-009-1174-1
Matza LS, Swensen AR, Flood EM, Secnik K, Leidy NK: Assessment of health-related quality of life in children: a review of conceptual, methodological, and regulatory issues. Value Health 2004, 7: 79–92. 10.1111/j.1524-4733.2004.71273.x
Reinfjell T, Diseth TH, Veenstra M, Vikan A: Measuring health-related quality of life in young adolescents: reliability and validity in the Norwegian version of the Pediatric Quality of Life Inventory 4.0 (PedsQL) generic core scales. Health Qual Life Outcomes 2006, 4: 61. 10.1186/1477-7525-4-61
Gerson A, Hwang W, Fiorenza J, Barth K, Kaskel F, Weiss L, Zelikovsky N, Fivush B, Furth S: Anemia and health-related quality of life in adolescents with chronic kidney disease. Am J Kidney Dis 2004, 44: 1017–1023. 10.1053/j.ajkd.2004.08.024
Fadrowski J, Cole SR, Hwang W, Fiorenza J, Weiss RA, Gerson A, Furth SL: Changes in physical and psychosocial functioning among adolescents with chronic kidney disease. Pediatr Nephrol 2006, 21: 394–399. 10.1007/s00467-005-2122-3
Goldstein SL, Graham N, Burwinkle T, Warady B, Farrah R, Varni JW: Health-related quality of life in pediatric patients with ESRD. Pediatr Nephrol 2006, 21: 846–850. 10.1007/s00467-006-0081-y
Grootenhuis MA, Stam H, Last BF, Groothoff JW: The impact of delayed development on the quality of life of adults with end-stage renal disease since childhood. Pediatr Nephrol 2006, 21: 538–544. 10.1007/s00467-006-0030-9
McKenna AM, Keating LE, Vigneux A, Stevens S, Williams A, Geary DF: Quality of life in children with chronic kidney disease-patient and caregiver assessments. Nephrol Dial Transplant 2006, 21: 1899–1905. 10.1093/ndt/gfl091
Falger J, Landolt MA, Latal B, Ruth EM, Neuhaus TJ, Laube GF: Outcome after renal transplantation. Part II: quality of life and psychosocial adjustment. Pediatr Nephrol 2008, 23: 1347–1354. 10.1007/s00467-008-0798-x
Buyan N, Turkmen MA, Bilge I, Baskin E, Haberal M, Bilginer Y, Mir S, Emre S, Akman S, Ozkaya O, Fidan K, Alpay H, Kavukcu S, Sever L, Ozcakar ZB, Dogrucan N: Quality of life in children with chronic kidney disease (with child and parent assessments). Pediatr Nephrol 2010, 25: 1487–1496. 10.1007/s00467-010-1486-1
Wiedebusch S, Konrad M, Foppe H, Reichwald-Klugger E, Schaefer F, Schreiber V, Muthny FA: Health-related quality of life, psychosocial strains, and coping in parents of children with chronic renal failure. Pediatr Nephrol 2010, 25: 1477–1485. 10.1007/s00467-010-1540-z
Marciano RC, Soares CM, Diniz JS, Lima EM, Silva JM, Canhestro MR, Gazzinelli A, Melo CC, Dias CS, Simoes e Silva AC, Correa H, Oliveira EA: Behavioral disorders and low quality of life in children and adolescents with chronic kidney disease. Pediatr Nephrol 2011, 26: 281–290. 10.1007/s00467-010-1683-y
Varni JW, Seid M, Kurtin PS: PedsQL 4.0: reliability and validity of the Pediatric Quality of Life Inventory version 4.0 generic core scales in healthy and patient populations. Med Care 2001, 39: 800–812. 10.1097/00005650-200108000-00006
Aaronson NK, Bullinger M, Ahmedzai S: A modular approach to quality-of-life assessment in cancer clinical trials. Recent Results Cancer Res 1988, 111: 231–249. 10.1007/978-3-642-83419-6_27
Harris-Kojetin LD, Fowler FJ, Brown JA, Schnaier JA, Sweeny SF: The use of cognitive testing to develop and evaluate CAHPS 1.0 core survey items. Consumer Assessment of Health Plans Study. Med Care 1999, 37: MS10-MS21.
McHorney CA, Tarlov AR: Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual Life Res 1995, 4: 293–307. 10.1007/BF01593882
McGraw KO, Wong SP: Forming inferences about some Intraclass Correlation Coefficients. Psychol Methods 1996, 1: 30–46.
Cremeens J, Eiser C, Blades M: Factors influencing agreement between child self-report and parent proxy-reports on the Pediatric Quality of Life Inventory™ 4.0 (PedsQL™ 4.0) Generic Core Scales. Health Qual Life Outcomes 2006, 4: 1–8. 10.1186/1477-7525-4-1
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC: The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol 2010, 63: 737–745. 10.1016/j.jclinepi.2010.02.006
Simons LE, Blount RL: Identifying barriers to medication adherence in adolescent transplant recipients. J Pediatr Psychol 2007, 32: 831–844. 10.1093/jpepsy/jsm030
Guillemin F, Bombardier C, Beaton D: Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol 1993, 46: 1417–1432. 10.1016/0895-4356(93)90142-N
The authors declare that they have no competing interests.
KS, MH were the main investigator, participated in the collection of data, design of the study, analysis and drafted the manuscript. IS, HG, HI, YS, YJ, KH and HY have collected data and made interpretation of data, have been revising it critically for intellectual content. All authors read and approved the final manuscript collected the data.
About this article
Cite this article
Park, KS., Cho, M.H., Ha, I.S. et al. Validity and reliability of the Korean version of the pediatric quality of life ESRD module. Health Qual Life Outcomes 10, 59 (2012). https://doi.org/10.1186/1477-7525-10-59