Skip to main content

The construct validity of the Child Health Utility 9D-DK instrument

Abstract

Background

Relative to their application with adults there is currently little information about the application of preference-based health-related quality of life (HRQL) instruments among populations of young people. The Child Health Utility 9D (CHU9D) is a paediatric-specific generic preference-based HRQL instrument, recently translated and linguistically validated into Danish (CHU9D-DK). The purpose of this study was to investigate the construct validity of the CHU9D-DK in a sample of Danish high school students.

Methods

All students attending a Danish High School were invited to participate in a web-based survey in January 2018 (N = 272). The survey included the CHU9D-DK, the young adult version of the Pediatric Quality of Life Inventory™ 4.0 Generic Core Scales (PedsQL), self-reported health status, presence/absence of disability/chronic diseases, life satisfaction, and socio-economic questions. CHU9D-DK utility scores were generated by employing the two scoring algorithms developed from adults in the UK and adolescents in Australia, respectively. Internal consistency, reliability and construct validity of the CHU9D-DK instrument were investigated.

Results

Two hundred and twenty-eight (84%) students consented to participate and completed the survey. The mean ± (standard deviation) values of the CHU9D-DK utilities were 0.84 (0.11) when the UK adult algorithm was applied and 0.70 (0.22), when the Australian adolescent algorithm was applied. The mean PedsQL score was 82.32 (13.14). The CHU9D-DK showed good internal consistency reliability (Cronbach’s alpha = 0.803). Higher levels of health status and life satisfaction were significantly associated with higher CHU9D-DK utility scores regardless of which scoring algorithm was applied (p-values < 0.001). Students living with a disability/chronic disease exhibited significantly lower utility scores relative to their healthy peers (p-values < 0.05). Higher socio-economic status (approximated by financial situation and frequency of family vacations) was also associated with higher utility scores (p-values < 0.005).

Conclusion

The CHU9D-DK demonstrated good psychometric performance overall and shows potential as a valid and reliable instrument for assessing the HRQL of Danish young people.

Trial registration

ClinicalTrials.gov identifier: NCT03391999, Registered 15 October 2017.

Background

The adolescent phase is a transitional stage of physical and psychological development that occurs during the period from puberty to legal adulthood (age of majority), which in Denmark is 18 years. Whilst adolescence is usually associated with the teenage years, its physical, psychological or cultural expressions may begin earlier and end later. For example, puberty now typically begins during preadolescence, particularly in females. Physical growth (particularly in males), and cognitive development can extend into the early twenties. Thus biological age provides only a rough marker of adolescence and young adulthood and scholars have found it difficult to agree upon a precise definition of adolescence [1].

Adolescence and young adulthood is also a period of multiple transitions involving education, training, and first employment, as well as changes from one living circumstance to another [2, 3]. This phase of life is critical for the individual’s future lifestyle and behaviour and may play an important role in the development and persistence of lifestyle diseases [4, 5]. In general, in contrast to adult populations, there is sparse information available about younger age groups’ health-related quality of life (HRQL) in Denmark, in particular in relation to individuals’ subjective assessment of their own HRQL through the use of validated instruments.

HRQL instruments can be divided into non-preference-based and preference-based instruments [6]. The unique feature of preference-based instruments is their scoring algorithms, which are typically generated from large general population samples and are based on the relative weights or utilities attached to HRQL states defined by the instrument on a cardinal scale, where 0.0 represent dead and 1.0 represents full health [6, 7]. Preference-based HRQL instruments can be applied to generate quality-adjusted life-years (QALYs). QALYs combines length of life and quality of life into a single composite measure of outcome, which is preferable for health economic evaluation [8].

The Child Health Utility 9D (CHU9D) is a relatively new preference-based instrument for the measurement and valuation of HRQL in children and adolescents developed in the United Kingdom (UK) in 2009 [9]. Relative to other preference based HRQL instruments, the CHU9D has the advantage that it was developed specifically for application in pediatric populations and young people were involved in its original development. The CHU9D was developed from its inception with young people using qualitative research methods about what quality of life means to them. The identified dimensions of HRQL within the CHU9D instrument emanate from young people’s descriptions of what HRQL means to them and how they would define it [10, 11].

Since its original development the CHU9D has shown good psychometric performance in samples of young people in other countries beyond the UK including translation and validation into China (CHU9D-CHN) and validation in Australia [12,13,14]. CHU9D has recently been translated and linguistically validated into Danish (CHU9D-DK). The translation and linguistic validation were performed by the professional language service company ICON Language services (certificate number 2920-TX-0002), which is an ISO 17100-certified translation provider, specializing in the translation of documentation related to global clinical research and in the translation and linguistic validation of patient-reported outcomes including utility instruments [15].

In Denmark, there is currently a dearth of validated instruments available for assessing HRQL in child and adolescent populations. This is particularly the case for preference-based instruments suitable for application in health economic evaluation [16, 17]. The main purpose of this study was therefore to investigate the construct validity of the newly translated and validated CHU9D-DK instrument in a young community-based sample of adult/adolescent high school students.

Methods

Sample

The school in which this study was undertaken was a randomly selected Danish high school among the 27 geographically accessible high schools to the University of Aalborg (the employment location of the lead researcher) in the Northern part of Jutland. The study was undertaken during the academic school year 2017/2018. In January 2018 following agreement from the school principal to participate in the research, all 272 students in the high school were invited via email to participate in a web-based survey of approximately 15 min duration. The survey was developed specifically for this study via the Scandinavian tool SurveyXact, a software package for creating and conducting customised questionnaire-based surveys [18]. By clicking on a person-unique link provided in the email, students completed the survey online. According to Danish and international laws, the students were informed about the purpose of the study and that it was voluntarily to participate. The voluntary completion of the survey by the students constituted their implied consent to participate in the study.

Survey

The online survey contained three components. The main component comprised the Danish versions of the two generic HRQL instruments (CHU9D-DK and PedsQL - introduced in more detail below). The other components included students’ self-assessed general self-reported health status, whether they had a disability or chronic disease, their life satisfaction and two items about their family’s socioeconomic situation. General health was reported on an ordinal scale (Excellent, Very good, Moderate, Not so good or Bad). The presence or absence of disability or chronic diseases was reported as Yes or No. The student’s overall life satisfaction was reported on an ordinal scale ranging from 1 to 10, Not satisfied (1–3), Medium satisfied (4–7), Very satisfied (8–10) or Don’t know, which was coded as missing.

Finally, family socio-economic status was approximated using two questions that have previously been applied in this context in the literature [19,20,21]. The first question was about financial situation. The students were asked, “Compared to other families where you live, do you think your family has (a lot of money, a reasonable amount of money, neither a lot or a little amount of money, little money or very little money)”. This item has been used in other Danish national investigations of children and adolescents welfare and well-being [19]. The item has shown that those who themselves experience having ‘little’ or ‘very little’ money, to a high degree are also those, who in more objective calculations of poverty, had relatively few financial resources.

The second question was about vacation/holiday experience in the last year. Students were asked, “Have you been on vacation in the last year? (Holiday stay with a minimum of four nights outside your usual place of residence – disregard for weekend trips) (Yes, several times, Yes, one time, No)”. This item is similar to an item used in the widely validated Family Affluence Scale (FAS), designed for self-report by adolescents aged 11–17 years [20]. This item has also been used in Danish contexts before, where it has been showed to exhibit strong positive associations with family financial situation [21]. Background information relating to the students’ age, gender, school programme and year of study was also collected for each consenting respondent by extracting this information from the high school register.

Child Health Utility 9D (CHU9D)

The CHU9D has been validated for self-completion by young people aged 7–17 years [16], and it has also been adapted for use and successfully applied in young adult populations aged 18–29 years [22, 23]. The CHU9D contains nine main dimensions (worried, sad, pain, tired, annoyed, schoolwork/homework, sleep, daily routine, and activities), each with five increasing levels of severity/impairment see Appendix. The individual responses to the CHU9D were converted to utilities by application of the existing UK adult general population scoring algorithm based on the standard gamble method [24]. For comparative purposes the responses were also converted to utilities using the recently developed Australian (AUS) adolescent-specific scoring algorithm based upon the best-worst scaling method [25, 26]. Application of the UK/AUS adult/adolescent scoring algorithms results in CHU9D utility scores ranging from 0.3261/− 0.1059 (reflecting the respective utilities attached to the most severe CHU9D health state: “PITS”) to 1.000 (reflecting full health for both scoring algorithms).

Pediatric quality of life inventory (PedsQL) 4.0 generic Core scales

The PedsQL is a generic, non-preference-based 23-item instrument assessing four main health dimensions: ‘Physical Functioning’ (8 items), ‘Emotional Functioning’ (5 items), ‘Social Functioning’ (5 items) and ‘School Functioning’ (5 items). The last three dimensions can also form a ‘Psychosocial health’ dimension, whilst the first dimension can also be called the ‘Physical health’ dimension. Respondents rate their answers on a 5-point Likert scale with one of the following preferences: 0 ‘never a problem’, 1 ‘almost never a problem’, 2 ‘sometimes a problem’, 3 ‘often a problem’, 4 ‘almost always a problem’. Items are then reverse-scored and linearly transformed into a total score ranging from 0 to 100 (where 0 = 100, l = 75, 2 = 50, 3 = 25, 4 = 0). Higher total scores represent better HRQL. The mean total score is a summation of all the items over the number of items answered, thereby accounting for missing data if present. This total scale score measures overall generic HRQL [27, 28]. The PedsQL is available and linguistically validated into Danish and it has been applied previously in several Danish contexts [29,30,31]. The PedsQL young adult’s version (age 18–25) was applied in this study as a key component to assess construct validity through relevant empirical comparisons with the CHU9D-DK [32].

Statistical analysis

Statistical analyses were performed using Stata version 14.2 (StataCorp LP, College Stadion, Texas, USA). Continuous variables were described as mean ± standard deviation (SD). Categorical variables were described as frequencies. Chi-squared tests were used to test differences in categorical variables, whereas Students t-test/ANOVA was used for continuous variables whenever appropriate. The distribution of utility scores was tested for normality using the Shapiro-Francia test. When the normality assumption was not met, a non-parametric test was used. A 5% significance level was used in all tests.

Validation

Internal consistency reliability

Cronbach’s alpha (α) was used for describing the internal consistency reliability of the CHU9D-DK instrument. The α coefficient was calculated based on the inter-item correlation [33]. The general accepted rule for using Cronbach’s alpha to assess internal consistency is: 0.9 ≤ α excellent; 0.8 ≤ α < 0.9 good; 0.7 ≤ α < 0.8 acceptable; 0.6 ≤ α < 0.7 questionable; 0.5 ≤ α < 0.6 poor; α < 0.5 unacceptable [34]. It was anticipated that the CHU9D-DK would demonstrate acceptable to excellent internal consistency indicating that the items are tapping into the same general construct, i.e. HRQL.

Construct validity (known-groups validation)

Known-groups validation was used to examine the extent to which the CHU9D-DK discriminates between groups with known differences. Other studies have demonstrated differences in utility scores by gender, age, clinical conditions and socio-demographic factors [32, 35,36,37].

General health, disability and chronic disease

It was expected a priori that respondents who rated their general health as high with no chronic disease and no disabilities would exhibit higher utility scores according on the CHU9D-DK relative to those who rated themselves in poorer general health overall and with chronic diseases and disabilities [36,37,38].

Life satisfaction

It was expected a priori, that respondents who rated their overall satisfaction with life high would exhibit higher utility scores according to the CHU9D relative to those who rated their overall satisfaction with life low [39].

Socio-economic status

Finally, it was expected a priori that students from higher income families, as accessed by the “Money” and “Holiday” variables, would exhibit higher utility scores according to the CHU9D relative to those from lower income backgrounds [19,20,21, 35, 40].

Convergent validity

As both generic instruments, the PedsQL and CHU9D, are designed to measure the same concept, HRQL in young adults/adolescents [32], we hypothesised that there would be conceptual overlap between them and that their related dimensions and overall scores would have a moderate to high correlation. The level of association between the CHU9D and the PedsQL was investigated using Spearman’s correlation coefficient (r). Correlations less than 0.3 were considered weak, 0.3–0.6 moderate, and > 0.6 strong [41]. A dimension level correlation matrix was generated of the CHU9D-DK and the PedsQL instruments combined to assess correlations between like-dimensions, particularly those that were conceptually related.

Ethics

This study was registered at ClinicalTrials.gov with the identifier: NCT03391999, and can be found at clinicaltrials.gov. The study was also recorded at the Danish Data Protection Agency (study number: 2015-57-0001).

Results

A total of 228 high school’s students consented to respond and fully completed the questionnaire (participation rate 83.8%). Table 1 presents the characteristics of the study sample, the CHU9D utilities, and the PedsQL scores. The mean age of all 272 students at the high school was 18.45 ± 1.07, and the mean age of the 228 responding/participating students was the same. Among students, there were significantly more boys (62.8%) than girls (37.2%), who fully completed the survey, corresponding to the fact that more boys were attending the high school. The group mean gender differences in HRQL utilities/scores were found to be highly statistically significant (p < 0.0001).

Table 1 Mean (SD) CHU9D-utilities and PedsQL-scores by student’s characteristics

For the participating sample, the mean ± SD values of the CHU9D utilities were 0.84 ± 0.11 when the UK adult scoring algorithm was applied and 0.70 ± 0.22, when the AUS adolescent scoring algorithm was applied. For comparison, the mean PedsQL score was 82.32 ± 13.14. CHU9D utilities (both algorithms) and PedsQL scores were not normally distributed (all  p < 0.01).

Table 1 shows, that students who self-reported themselves to have a better general health status, no disability or chronic disease, high life satisfaction, more money and had been on several holidays in the last year, exhibited higher HRQL scores on average for all three instruments relative to other students. Overall, Table 1 also shows that although the direction of the relationships between each instrument and sociodemographic variables was very similar, the mean CHU9D utilities (UK adult scoring algorithm) were on average, higher and exhibited lower SDs than the corresponding PedsQL scores (when PedsQL scores were re-scaled by dividing through by 100). Divergent to this, the corresponding mean utilities (AUS adolescent scoring algorithm) were all lower than the mean PedsQL scores and exhibited higher SDs.

Internal consistency reliability

Cronbach’s alpha was 0.797 (the standardised Cronbach’s alpha was 0.803), indicating a good level of internal consistency for the CHU9D-DK.

Known-groups validation

Hypothesis a. General health, disability, and chronic disease; there were significant differences in CHU9D utilities (both adult and adolescent scoring algorithms) and PedsQL scores between the levels of self-reported general health, living with or without disability or chronic disease in the expected directions, demonstrating that the two instruments were able to distinguish between groups with self-reported health differences.

Hypothesis b. Life satisfaction; Students who indicated that they were very satisfied with their lives had significant higher HRQL utilities (both adult and adolescent scoring algorithms) and PedsQL-scores compared to those who indicated that they were not satisfied with their lives (p-values < 0.001).

Hypothesis c. Socio-economic status; it was found that students who came from families with higher levels of socio-economic status (as approximated by the “Money” and “Holiday” variables) generally exhibited higher HRQL scores, and these differences were statistically significant for both the PedsQL scores and the CHU9D utilities (p-values < 0.01). One minor exception was in relation to the money variable and the PedsQL instrument where students scored slightly higher on average if they felt they had “a reasonable amount of money” (mean-score 86.21) compared to “a lot of money” (mean-score 85.22). The corresponding CHU9D-scores were however more consistent in this regard.

Convergent validity

Table 2 summarises the relationship between the dimensions of the CHU9D and the PedsQL regarding Spearman’s correlation coefficients. Overall, as hypothesised, a strong degree of correlation was observed between the two measures (overall r = 0.69;  p < 0.001), when the adult scoring algorithm was applied and (overall r = 0.68;  p < 0.001), when the adolescent scoring algorithm was applied. At the dimension level, the strongest degree of correlation was found between the ‘Emotional function’ dimension in the PedsQL and the ‘Worried’, ‘Sad’ and ‘Annoyed’ dimensions on the CHU9D (r = 0.47, 0.53 and 0.50, respectively; p < 0.001), corresponding to moderate agreement. A moderate degree of correlation was also found between similar dimensions for both instruments, ‘Schoolwork/homework’ in the CHU9D and ‘School functioning’ in the PedsQL (r = 0.38; p < 0.001). Finally, a moderate degree of correlation was found between ‘Psychosocial Health’ in the PedsQL and the dimensions ‘Worried’, ‘Sad’ and ‘Annoyed’ in the CHU9D (r = 0.46, 0.43, 0.48, respectively; p < 0.001). The weakest degree of correlation was found between the ‘Social function’ in the PedsQL and ‘Pain’, ‘Tired’ and ‘Sleep’ dimensions in the CHU9D (r = 0.21, 0.22 and 0.21, respectively; p < 0.001).

Table 2 Correlations between CHU9D1 dimensions and PedsQL2 dimensions

Figure 1 presents the scatter plot comparison of the two instruments with the best-fitted line (line fitted by ordinary least squares). For the CHU9D-DK, 17 (7.5%) respondents reported themselves in full health (utility value =1.0, reflecting the best level for all nine dimensions). No participants reported themselves at the worst level of impairment for the CHU9D-DK instrument. For the PedsQL instrument, 17 (7.5%) respondents reported themselves to be in full health (PedsQL = 100), but only five (2.2%) of these were respondents who also reported themselves at full health for the CHU9D-DK instrument.

Fig. 1
figure 1

Scatter plot of the CHU9D-DK utilities and the PedsQL-scores, lines showing the corresponding fitted values

In general, both scatterplots show moderate agreement between the instruments with the utilities and the scores converging towards the highest end of the scale, where the maximum utility of 1.0 on the CHU9D-DK scale corresponds to the maximum score of 100 on the PedsQL.

Two Bland-Altman scatter plots of the differences between the CHU9D-DK-utilities and the PedsQL-scores (re-scaled by dividing through by 100) are presented in Fig. 2. These two plots also illustrate moderate levels of agreements.

Fig. 2
figure 2

Bland-Altman plot of the CHU9D-utilities and the PedsQL-scores including 95% limits of agreements

The paired comparison of CHU9D-DK and PedsQL again shows, that the mean CHU9D-DK utilities were on average slightly higher (mean 0.013) than the rescaled PedsQL scores when the adult scoring algorithm was applied) (p-value paired t-test =0.025), and lower (mean − 0.123) when the adolescent scoring algorithm was applied (p-value paired t-test < 0.001). As the Bland-Altman plots also show, there were few outliers from the 95% limits of agreement with 13 (5.7%) outliers for the plot based on the adult scoring algorithm for the CHU9D-DK, and ten (4.4%) outliers for the plot based on the adolescent scoring algorithm for the CHU9D-DK.

Table 3 summarises the distribution of mean PedsQL-scores across the dimension levels of the CHU9D-DK. It shows that as expected in a community-based sample of students attending high school, the vast majority of students reported themselves in good health according to the CHU9D-DK.

Table 3 Distributions of PedsQL-scores across dimension levels of the CHU9D-DK

The largest proportion of students reported themselves at the highest dimension level for all dimensions, except for the “Tired” dimension where the highest proportion reported themselves at the second level “I feel a bit tired today”. In general, mean PedsQL-scores corresponded with the CHU9D-DK, with increasing levels of severity on each dimension being associated with lower mean PedsQL-scores. One minor exception was in the School Work/Homework dimension, where seven students reported, “I have many problems with my schoolwork/ homework today” and two students reported, “I can’t do my schoolwork/homework today,” respectively. The seven who reported having many problems on the CHU9D-DK scored lower mean PedsQL (66.15) than the two, who reported, “I can’t do my schoolwork/homework mean PedsQL (76.09). However, only a very small proportion of the total responses exhibited this inconsistency. It is also noticeable that the dimension “Worried” has a more diverse PedsQL range of score, than all other CHU9D-DK dimensions (from 86.87 to 44.02).

Discussion

To the best of our knowledge, this is the first study in Denmark and Scandinavia to assess the construct validity of the Danish CHU9D-DK instrument. This study compared the measurement properties of the CHU9D-DK with the PedsQL, which is one of the few available generic HRQL instruments linguistically translated into Danish and validated for Danish young people. Both instruments were able to discriminate between students according to their self-reported general health status, living with or without a disability or chronic disease, satisfaction with life and socio-economic status.

Overall, the results of this study indicate that the CHU9D-DK exhibits good construct validity in relation to assessment of the HRQL of high school students in Denmark. Hence, the practical implications are that the CHU9D-DK could potentially be more widely applied with young people in Denmark, especially in the context of health economic evaluations since the CHU9D is a preference-based instrument. However, a limitation in this regard is that no Danish population specific scoring algorithm exists yet. As such, we applied both the existing Australian adolescent scoring algorithm based on the best worst scaling method and the UK adult scoring algorithm based on the standard gamble method. The study shows, as is seen in many other studies, that the utility scores, heavily depend on the measure/algorithm that is used to elicit them [42]. In this study, as has been found elsewhere, systematic differences in utility scores were evident according to the scoring algorithm applied. In general, when the UK adult scoring algorithm was applied, the mean CHU9D-DK utilities were higher and exhibited lower SD than the mean PedsQL scores (the PedsQL rescaled by dividing it by 100). Divergent to this, the mean utilities were lower than the mean PedsQL scores and exhibited higher SD, when the Australian adolescent specific scoring algorithm was applied.

Best practice guidance in the literature indicates that it is preferable to apply country-specific scoring algorithms if available because they better reflect cultural differences and are therefore more likely to represent societal preferences more accurately than scoring algorithms originating from other countries [43,44,45]. In the future therefore, it will be desirable to develop a Danish valuation set for CHU9D-DK.

The results of this study support the consistency and construct validity of the CHU9D-DK. The level of internal consistency for the CHU9D-DK was good as measured by the Cronbach’s alpha (0.803), and is similar to that found in two other studies, one in Australia [46] and one in China [12], where Chronbach’s alpha was (0.781) and (0.771), respectively. CHU9D-DK utility scores discriminated well in relation to general self-reported health status and life satisfaction. Better general health status and higher life satisfaction were significantly associated with higher utility scores regardless of which scoring algorithm was applied [39]. Further students living with a disability or chronic disease had significantly lower utility scores [36,37,38]. The same discrimination was seen concerning the two socio-economic questions. The wealthier the family and the more holidays experienced in the preceding year, the higher the utility scores, which is also in line with other studies [19,20,21, 35, 40].

The findings for this Danish student sample were similar to those reported in another recent Australian study conducted in a similar population of community-based adolescents aged 15–17 years [37]. For example, the CHU9D utility scores were moderately correlated with PedsQL total scores in both studies; although, the overall correlation coefficients found in this study (r = 0.68 (adolescent scoring algorithm) and 0.69 (adult scoring algorithm)) were slightly higher than the Australian study (r = 0.63). The main reason for the moderate correlations between the overall scores generated from the two instruments is that they measure similar concepts [32]. At the dimensional level, however, more discrepancies in correlations are evident between the two instruments. There are various reasons that may explain these discrepancies. Firstly, similar dimensions are not perfectly overlapping in phraseology and descriptions between the two instruments. Secondly, it is severity that is measured in the CHU9D, as compared to frequency in the PedsQL. Thirdly, the recall time is ‘today’ in the CHU9D versus ‘in the past month’ in the PedsQL. Finally, the PedsQL has more items and theoretically covers a broader range of health states than the CHU9D. In contrast whilst the CHU9D has fewer items it includes some unique dimensions not covered by the PedsQL e.g. ‘pain’, which exhibits weak correlations with the PedsQL ‘social’ dimension. Overall, therefore whilst these two instruments are complementary in capturing HRQL, they are also different in terms of how HRQL is described and the time frame applied in HRQL assessment.

Limitations

There are some limitations to this study. Firstly, the survey was performed in a single high school with a relative small sample size of 228 respondents. This means that all included respondents resided in the same locality and therefore the study sample may not be entirely representative of the Danish high school population in this age group. However, we achieved a high participation rate of 83.8% and this represents a strength of this study.

A second limitation is that the majority of the survey participants were healthy. It is crucial, therefore, to investigate if these findings can be replicated in specific clinical patient samples. Thirdly, the composition of our study sample was such that it fell between two versions of the PedsQL instrument according to age categories, the version for teens (13–18 years) and the version for young adults (18–25 years). We chose not to use two PedsQL versions since the mean age of our sample was very close to 18 years, and opted for the most applicable version for the majority of our sample, the version for young adults.

Whilst the CHU9D is validated for young people aged 7–17 years, it has also been found to perform well in other similar samples of young adults internationally, especially for those in school settings, where the mean age is even higher than in this Danish sample, implying that CHU9D is also valid for application with young adults [22, 23]. The validation results from this study further enrich the evidence base for the applicability of the CHU9D in populations of young adults.

A potential further limitation of our study relates to the measurement of socio-economic status whereby only one of the four items from the Family Affluence Scale, the holiday item was applied. The main reason for not applying the Family Affluence Scale in its entirety was that some of the other items were not so relevant in a Danish setting, e.g., the item “Do you have your own computer?”, since all schoolchildren and young school adults have their own computer in DK. The money item is also a simple way of self-reporting family income and may not represent an accurate reflection of family income in all circumstances. However, this item has been used previously and has been found to perform well in a Danish context [19].

Conclusions

The findings from this study show that the newly translated and linguistically validated CHU9D-DK demonstrated good psychometric performance overall and shows potential as a valid and reliable instrument for assessing the HRQL of Danish young people. As a preference based instrument, the CHU9D-DK may also be usefully applied in economic evaluations targeted to interventions designed to improve the quality of life of young adults and adolescents in Denmark. Development of a Danish population specific scoring algorithm/s would further facilitate its applicability in this regard.

Availability of data and materials

The dataset and materials used in this study are available from the corresponding author upon request.

Abbreviations

AUS:

Australian

CHU9D:

Child Health Utility 9 Dimension

CHU9D-DK:

Child Health Utility 9 Dimension Danish version

HRQL:

Health Related Quality of Life

PedsQL™:

Pediatric Quality of Life Inventory™ 4.0 Generic Core Scales

QALY:

Quality Adjusted Life Years

SD:

Standard deviation

UK:

United Kingdom

References

  1. Biro F, Dorn L. Puberty and its measurement. A decade in review [review]. J Res Adolesc. 2011;21:180–95.

    Article  Google Scholar 

  2. Williams PG, Holmbeck GN, Greenley RN. Adolescent health psychology. J Consult Clin Psychol. 2002;70:828–42.

    Article  Google Scholar 

  3. Larson R, Wilson S. Adolescence across place and time: globalization and the changing pathways to adulthood. In R. Lerner and L. Steinberg. Handbook of adolescent psychology. New York: Wiley; 2004.

    Book  Google Scholar 

  4. Kleinert S. Adolescent health: an opportunity not to be missed. Lancet. 2007;369:1788–9.

    Google Scholar 

  5. Alberga AS, Sigal RJ, Goldfield G, et al. Overweight and obese teenagers: why is adolescence a critical period? Pediatr Obes. 2012;7:261–73.

    Article  CAS  Google Scholar 

  6. Brazier J, Ratcliffe J, Saloman J, et al. Measuring and valuing health benefits for economic evaluation. 2nd ed. Oxford: Oxford University Press; 2016.

    Book  Google Scholar 

  7. Drummond MF, Sculpher MJ, Claxton K, et al. Methods for the economic evaluation of health care Programmes. Fourth. York: Oxford University Press; 2015.

    Google Scholar 

  8. Robinson R. Cost-Utility Analysis. Br Med J. 1993;307:859–62.

    Article  CAS  Google Scholar 

  9. Stevens K. Developing a descriptive system for a new preference-based measure of health-related quality of life for children. Qual Life Res. 2009;18:1105–13.

    Article  Google Scholar 

  10. Stevens KJ. Working with children to develop dimensions for a preference-based, generic, pediatric, health-related quality-of-life measure. Qual Health Res. 2010;20:340–51.

    Article  Google Scholar 

  11. Stevens K. Assessing the performance of a new generic measure of health-related quality of life for children and refining it for use in health state valuation. Appl Health Econ Health Policy. 2011;9:157–69.

    Article  Google Scholar 

  12. Yang P, Chen G, Wang P, et al. Psychometric evaluation of the Chinese version of the child health utility 9D (CHU9D-CHN): a school-based study in China. Qual Life Res. 2018;27:1921–31.

    Article  Google Scholar 

  13. Stevens K, Ratcliffe J. Measuring and valuing health benefits for economic evaluation in adolescence: an assessment of the practicality and validity of the child health utility 9d in the australian adolescent population. Value Health. 2012;15:1092–9.

    Article  Google Scholar 

  14. Chen G, Flynn T, Stevens K, et al. Assessing the health-related quality of life of Australian adolescents: an empirical comparison of the Child Health Utility 9D and EQ-5D-Y instruments. Value Health. 2015;18:432–8.

    Article  Google Scholar 

  15. ICON, by Anderson H, Vasile C. The translation and linguistic validation of the Child Health Utility 9D (CHU9D) from English into Danish. Dublin: 2016.

  16. Chen G, Ratcliffe J. A review of the development and application of generic multi-attribute utility instruments for Paediatric populations. Pharmacoeconomics. 2015;33:1013–28.

    Article  Google Scholar 

  17. Griebsch I, Coast J, Brown J. Quality-adjusted life-years lack quality in pediatric care: a critical review of published cost-utility studies in child health. Pediatrics. 2005;115:e600–14.

    Article  Google Scholar 

  18. Ramböll Management. SurveyExact. Available at: https://www.surveyxact.dk/. .

  19. Ottosen MH, Andersen D, Dahl KM, et al. BØRN OG UNGE I DANMARK: VELFÆRD OG TRIVSEL. Eng. translation: CHILDREN AND ADOLESCENTS IN DENMARK; WELFARE AND WELL-BEING. Copenhagen: The Danish Center for Social Science Research, Danish Translation: VIDEN Til VELFÆRD (VIVE): 2018.

  20. Boyce W, Torsheim T, Currie C, et al. Family affluence scale as a measure of national wealth: validation of an adolescent self-report measure. Soc Indic Res. 2006;78:473–87.

    Article  Google Scholar 

  21. Benjaminsen L, Birkelund JF, Enemark MH, et al. Fattigdom og afsavn: om materielle og sociale afsavn blandt økonomisk fattige og ikke-fattige. Eng. translation: Poverty and deprivation: on material and social deprivation among economically poor and non-poor. Copenhagen: The Danish Center for Social Science Research, Danish Translation: VIDEN Til VELFÆRD (VIVE): 2016.

  22. Ratcliffe J, Stevens K, Flynn T, et al. Whose values in health? An empirical comparison of the application of adolescent and adult values for the CHU-9D and AQOL-6D in the Australian adolescent general population. Value Health. 2012;15:730–6.

    Article  Google Scholar 

  23. Ratcliffe R, Chen G, Stevens K, et al. Valuing Child Health Utility 9D health states with young adults: insights from a time trade off study. Appl Health Econ Health Policy. 2015;13:485–92.

    Article  Google Scholar 

  24. Stevens K. Valuation of the Child Health Utility 9D index. Pharmacoeconomics. 2012;30:729–47.

    Article  Google Scholar 

  25. Ratcliffe J, Huynh E, Chen G, et al. Valuing the Child Health Utility 9D: using profile case best worst scaling methods to develop a new adolescent specific scoring algorithm. Soc Sci Med. 2016;157:48–59.

    Article  Google Scholar 

  26. Ratcliffe J, Couzner L, Flynn T, et al. Valuing Child Health Utility 9D health states with a young adolescent sample: a feasibility study to compare best-worst scaling discrete-choice experiment, standard gamble and time trade-off methods. Appl Health Econ Health Policy. 2011;9:15–27.

    Article  Google Scholar 

  27. Varni JW, Seid M, Kurtin PS. PedsQL™ 4.0: reliability and validity of the pediatric quality of life inventory™ version 4.0 generic Core scales in healthy and patient populations. Med Care. 2001;39:800–12.

    Article  CAS  Google Scholar 

  28. Varni JW, Burwinkle TM, Seid M, et al. The PedsQLTM 4.0 as a pediatric population health measure: feasibility, reliability, and validity. Ambul Pediatr. 2003;3:329–41.

    Article  Google Scholar 

  29. Soee ABL, Skov L, Skovgaard LT, et al. Headache in children: effectiveness of multidisciplinary treatment in a tertiary paediatric headache clinic. Cephalalgia. 2013;33:1218–28.

    Article  Google Scholar 

  30. Mollerup PM, Nielsen TRH, Bøjsøe C, et al. Quality of life improves in children and adolescents during a community-based overweight and obesity treatment. Qual Life Res. 2017;26:1597–608.

    Article  Google Scholar 

  31. Brandhøj M, Højgaard B. Indsatser til børn og unge med overvægt. En afdækning af effektmål, erfaringer med tværsektorielt samarbejde samt beskrivelse af lovende indsatser. Copenhagen, The Danish Center for Social Science Research, Danish Translation: VIDEN Til VELFÆRD (VIVE): 2016.

  32. Walters SJ. Quality of life outcomes in clinical trials and health­care evaluation: a practical guide to analysis and interpretation. Chichester: Wiley; 2009.

    Book  Google Scholar 

  33. Chronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.

    Article  Google Scholar 

  34. Fleiss JL, Cohen J. The equivalence of weighted kappa and the Intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973;33:613–9.

    Article  Google Scholar 

  35. Von Rueden U, Gosch A, Rajmil L, et al. Socioeconomic determinants of health related quality of life in childhood and adolescence: results from a European study. J Epidemiol Community Health. 2006;60:130–5.

    Article  Google Scholar 

  36. Varni JW, Limbers CA, Burwinkle TM. Impaired health-related quality of life in children and adolescents with chronic conditions: A comparative analysis of 10 disease clusters and 33 disease categories/severities utilizing the PedsQL™ 4.0 Generic Core Scales. Health Qual Life Outcomes. 2007;5:43.

  37. Petersen K, Chen G, Mpundu-Kaambwa C, et al. Measuring health-related quality of life in adolescent populations. Patient. 2018;11:29–37.

    Article  Google Scholar 

  38. Kind P, Dolan P, Gudex C, et al. Variations in population health status: results from a United Kingdom National Questionnaire Survey. BMJ 1998;316:736-741. Linked references are available on JSTOR for this article: Variations in population health status: results from a United Kingdom national questionnaire 2017;316:736–41.

    Article  CAS  Google Scholar 

  39. Johansen H, Dammann B, Andresen IL, et al. Health-related quality of life for children with rare diagnoses, their parents’ satisfaction with life and the association between the two. Health Qual Life Outcomes. 2013;11:1–7.

    Article  Google Scholar 

  40. Petersen KD, Kronborg C, Gyrd-Hansen D, et al. Characteristics of patients receiving allergy vaccination: to which extent do socio-economic factors play a role? Eur J Pub Health. 2011;21:323–8.

    Article  Google Scholar 

  41. Anderson TW, Finn JB. The new statistical analysis of data. New York: Springer, 1996.

    Book  Google Scholar 

  42. Zhao Y, Li SP, Liu L, et al. Does the choice of tariff matter?: a comparison of EQ-5D-5L utility scores using Chinese, UK, and Japanese tariffs on patients with psoriasis vulgaris in central South China. Medicine. 2017;96:1–7.

    Article  Google Scholar 

  43. Norman R, Cronin P, Viney R, et al. International comparisons in valuing EQ-5D health states: a review and analysis. Value Health. 2009;12:1194–200.

    Article  Google Scholar 

  44. Viney R, Norman R, King MT, et al. Time trade-off derived EQ-5D weights for Australia. Value Health. 2011;14:928–36.

    Article  Google Scholar 

  45. Oddershede L, Petersen KD. Adjustment of foreign EQ-5D-3L utilities can increase their transferability. Clin Outcomes Res. 2015;7:629–36.

    Article  Google Scholar 

  46. Furber G, Segal L. The validity of the Child Health Utility instrument (CHU9D) as a routine outcome measure for use in child and adolescent mental health services. Health Qual Life Outcomes. 2015;13:22.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank all the high school students who kindly gave up their time to participate in this study.

Funding

The study was not funded directly by any grants, but indirectly by the authors’ employment at the three Universities and the Vocational Colleges.

Author information

Authors and Affiliations

Authors

Contributions

KDP conceived the original concept, designed the study, performed the analyses and drafted the initial manuscript. AVO, GC and JR contributed to the study design and assisted with the analyses. DS and CSF contributed to the study design. All authors critically reviewed the manuscript and approved the final version.

Corresponding author

Correspondence to Karin Dam Petersen.

Ethics declarations

Ethics approval and consent to participate

Aalborg University, Faculty of Social Sciences approved this study under the Danish Data Protection Agency (study number: 2015-57-0001). Informed consent was obtained from all participants.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

CHU9D

Thinking about today….

A1. Worried

O I don’t feel worried today

O I feel a little bit worried today

O I feel a bit worried today

O I feel quite worried today

O I feel very worried today

A2. Sad

O I don’t feel sad today

O I feel a little bit sad today

O I feel a bit sad today

O I feel quite sad today

O I feel very sad today

A3. Pain

O I don’t have any pain today

O I have a little bit of pain today

O I have a bit of pain today

O I have quite a lot of pain today

O I have a lot of pain today

A4. Tired

O I don’t feel tired today

O I feel a little bit tired today

O I feel a bit tired today

O I feel quite tired today

O I feel very tired today

A5. Annoyed

O I don’t feel annoyed today

O I feel a little bit annoyed today

O I feel a bit annoyed today

O I feel quite annoyed today

O I feel very annoyed today

A6. Schoolwork/Homework (Such as reading, writing, doing lessons)

O I have no problems with my schoolwork/homework today

O I have a few problems with my schoolwork/homework today

O I have some problems with my schoolwork/homework today

O I have many problems with my schoolwork/homework today

O I can’t do my schoolwork/homework today

A7. Sleep

O Last night I had no problems sleeping

O Last night I had a few problems sleeping

O Last night I had some problems sleeping

O Last night I had many problems sleeping

O Last night I couldn’t sleep at all

A8. Daily routine (Things like eating, having a bath./shower, getting dressed)

O I have no problems with my daily routine today

O I have a few problems with my daily routine today

O I have some problems with my daily routine today

O I have many problems with my daily routine today

O I can’t do my daily routine today

A9. Able to join in activities (Things like playing out with your friends, doing sports, joining in things)

O I can join in with any activities today

O I can join in with most activities today

O I can join in with some activities today

O I can join in with a few activities today

O I can join in with no activities today

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Petersen, K., Ratcliffe, J., Chen, G. et al. The construct validity of the Child Health Utility 9D-DK instrument. Health Qual Life Outcomes 17, 187 (2019). https://doi.org/10.1186/s12955-019-1256-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-019-1256-0

Keywords