Skip to main content
Download PDF
Download ePub

Item generation for a proxy health related quality of life measure in very young children

Health and Quality of Life Outcomes volume 18, Article number: 11 (2020) Cite this article

Abstract

Background and aims

Very young children have a relatively high prevalence of morbidity and mortality. Health care and supportive technology has improved but may require difficult choices and decisions regarding the allocation of these resources in this age group. Cost-effective analysis (CEA) can inform these decisions and thus measurement of Health-Related Quality of Life (HRQoL) is becoming increasingly important. However, the components of HRQoL are likely to be specific to infants and young children. This study aimed to develop a bank of items to inform the possible development of a new proxy report instrument.

Methods

A review of the literature was done to define the concepts, generate items and identify measures that might be an appropriate starting point of reference. The items generated from the cognitive interviews and systematic review were subsequently pruned by experts in the field of HRQoL and paediatrics over two rounds of a Delphi study.

Results

Based on the input from the different sources, the greatest need for a new HRQoL measure was in the 0–3-year age group. The item pool identified from the literature consisted of 36 items which was increased to 53 items after the cognitive interviews. The ranking of items from the first round of the Delphi study pruned this pool to 28 items for consideration. The experts further reduced this pool to 15 items for consideration in the second round. The experts also recommended that items could be merged due to their similar nature or construct. This process allowed for further reduction of items to 11 items which showed content validity and no redundancy.

Conclusion

The need for an instrument to measure appropriate aspects of HRQoL in infants and young children became apparent as items included in existing measures did not cover the required spectrum. The identification of the final items was based on a sound conceptual model, acceptability to stakeholders and consideration of the observability of the item selected. The pruned item bank of 11 items needs to be subject to further testing with the target population to ensure validity and reliability before a new measure can be developed.

Background

Young children are more susceptible to illness with mortality in children under five years of age accounting for nearly 20% of the overall mortality rate globally [1, 2]. Technologies which decrease mortality and morbidity are now more widely available, albeit at a large cost (e.g. neonatal intensive care support, management of terminal diseases). Difficult decisions regarding resource allocation care thus often need to be made at both a health authority and individual patient level and cost-effectiveness analysis (CEA) can guide these decisions [3]. To assist decision makers, a common metric has been developed for CEA, the Quality Adjusted Life Year or QALY, which incorporates time spent in a health condition and Health-Related Quality of Life (HRQoL) [3]. There is a plethora of HRQoL measures in use, but most target adult and older children and it is unclear how appropriate the included dimensions and items are for younger children.

HRQoL is based on a multidimensional measurement approach [4]. This multidimensionality is subsequent to the World Health Organisation’s (WHO) definition of health which includes three dimensions of health: physical, mental and social [5]. The three dimensions of health and an additional dimension of functional status have been combined to form the four, generally accepted, dimensions of HRQoL: disease and symptoms thereof, health status, psychological and social functioning [4]. These dimensions are universal across the lifespan. Most definitions of HRQoL place importance on the perceived effects of health on physical, social/role, psychological/emotional, and cognitive functioning. Disease symptoms, perceptions of health, and overall Quality of Life are often included within the dimensions of a HRQoL measure [6]. HRQoL can be regarded as the perceived effect which a medical condition or its management has on a person which can be either general or specific to the health condition.

HRQoL measures can be divided into two main categories: disease-specific and generic measures. Disease-specific measures are typically developed to measure the effects of a specific disease or condition on HRQoL [7].Disease-specific measures are argued to be more responsive in that they detect disease-specific clinical changes [8]. Disease-specific measures are however limited to evaluating HRQoL in the disease that they were developed for and are thus unable to provide comparative data across disease groups or between disease groups and the general population [8]. Generic health measures can be used to collect data from both healthy and ill individuals. Generic measures thus have a wider application and can be used in population health surveys, burden of disease studies, epidemiological studies, screening, describing health status, developing management plans for individual patients, informing clinical policy and resource allocation decisions [8,9,10,11,12,13,14].

Measurement of HRQoL in very young children (defined here as under five years of age) is challenging as motor and cognitive development is rapid and measurement of HRQoL needs to take into account the changes which emerge with this development [15]. A further constraint is that young children are unlikely to self-report reliably and measures for very young children need to rely on proxy-report [16]. This has the disadvantage that several items in existing HRQoL measures require the proxy to report on the subjective experience, of the child which may reduce the reliability of the measure [16]. Thus the Food and Drug Administration (FDA) and International Society for Pharmacoeconomics and Outcomes Research (ISPOR) guidelines suggest that proxy-measures for HRQoL be based on observable measures to minimise bias [16, 17]. A measure based on observable behaviour requires that each item is assessed according to observable behaviour of the child without the respondent having to draw conclusions regarding the child’s experienced HRQoL based on their own subjective assessment [16].

Systematic literature review of generic HRQoL measures for children had concluded that no existing measures were based solely on observable behaviour and most of the measures had not been developed based on a conceptual model [6, 18, 19]. There was thus a need to develop a new HRQoL measure, for young children, to be completed by proxy. To ensure that a new measure would add value to the existing measures, it was necessary to identify which items were of importance in this rapidly developing age group and how to ensure that reporting on items would be based on observable behaviour.

We reviewed a wide range of theories and models to identify the most appropriate guiding framework for the development of the new measure. The Wilson and Cleary Model is the oldest and most cited model of generic HRQoL [20] and suggests that the values and preferences of an individual will affect their overall HRQoL [21]. The Wilson and Cleary Model [22], the disease specific Taylor Model [23], and the International Classification of Functioning, Disability and Health (ICF) which includes a model of functioning [24, 25] all recognise the impact of personal factors and the environment in an individual’s perception of their HRQoL [20, 21, 23, 25, 26]. These models are similar in that they take into account the importance that personal factors and the environment make in the relationship between these key areas [20, 21, 23, 25, 26], they all take into account the presence or absence of disease or a health condition [21, 23, 25, 26] and they all include aspects of physical functioning [21, 23, 25, 26]. However, none of them account for the unique aspect of development which is a key aspect in the very young child.

The rapid development and acquisition of skills during the first years [27,28,29] of life also needs to be considered when developing a new measure. The theories of child development foreground the importance of the first years of life in shaping future adults and these early stages are commonly disrupted by negative experiences related to poor health [30,31,32,33,34,35,36]. Both the Taylor and ICF models take development and change in functioning over time into account, an element that is clearly essential when dealing with infants that are rapidly developing social, motor and other skills. Bakas et al. [20], however, suggest that the ICF may be more applicable across age and cultural groups as it was designed to describe the health of individuals, families, communities and populations across cultures. The ICF model with consideration of child development across the age range was thus used to inform the choice of items in this study.

The aim of this study was to establish a bank of items which would cover all the components of HRQoL relevant to the age group. This was to be done by interrogating items in existing HRQoL measures for young children and by generating further items through engagement with stakeholders. The selection of items would take into account the ISPOR [16] and the FDA [17] guidelines for HRQoL instrument development for very young children. The process of generation of the item bank and descriptors included a systematic review of the literature of existing HRQoL for young children; cognitive interviews with stakeholders including the target group (caregivers of young children) and a Delphi study [37, 38] with experts in the field of child health and HRQoL to prune and finalise the item bank for further psychometric testing. The process and results of the literature review and cognitive interviews with carers are summarised below. This paper describes the Delphi study component in detail.

Generation of comprehensive item bank

Systematic review

A systematic review of HRQoL measures for children under seven years of age was undertaken both to identify suitable items and to identify an instrument which could be used as a departure point of discussion on HRQoL with caregivers.

Methodology

Search strategy

A search strategy for use on electronic databases was developed based on previously published literature as well as expert knowledge from the task group. The only limit to the searches was the exclusion of non-English articles or abstracts. Articles were searched in each database from the beginning of each database until April 2017. Pearling, which entails using the literature at hand to identify additional relevant studies, was done by hand searching the references of sourced papers. The websites of identified measures were also consulted for additional manuals or reference papers. The following electronic databases were searched: PubMed, EMBASE, Web of Science, PEDro, EBSCOHost, Africa-wide, NiPAD, CINAHL, ERIC, Health Source- Nursing/academic edition, MEDLINE, PsycARTICLES and PsycINFO, Scopus, Academic Search Premier. Conference proceedings from ISPOR and ISOQoL for the years 2012, 2013 and 2014 were searched for relevant literature. The terms in the title (“Health-Related Quality of Life”, OR “Quality of Life” OR “well-being” OR “health status”) AND (“children” OR “paediatric” OR “pediatric” OR “infant*” OR “child*”) AND (“questionnaire” OR “instrument” OR “measur*”) AND “generic” AND (“validation” OR “develop*”) were used to identify articles. Self-report and proxy report generic measures of HRQoL, health status and wellbeing were included. Measures were excluded if: they were disease specific, their dimensions were restricted to demographic or environmental indicators, and they only measured a single dimension or were used exclusively in children over the age of seven years.

Data analysis

A data abstraction form was used to record the literature reviewed. The researchers referred to the COSMIN checklist and all the criteria were recorded as well as information pertaining to bibliographic details, description of instrument development, completion by self/proxy, descriptive dimensions, number of items, response options, reference of the question to the child’s normal behaviour or the behaviour of others, recall period and scoring of the instrument. Attention was paid as to whether the items related to observable behaviour, if this was defined and whether developmental changes were factored into the measures. A second reviewer corroborated on the analysis and conclusions.

Criteria for selection of HRQoL measure on which to model a new measure

  • The dimensions (broad concept such as physical health or mobility) or items (specific concept such as walking, running, jumping) included on the measure should be observable as per ISPOR) [16] and FDA guidelines [17].

  • The recall period should be short to eliminate recall bias [39, 40] as young children have increased lability due to their rapid development [41].

  • Content validity needs to be sound and based on a transparent development process with a variety of stakeholders most especially including parents or children [37,38,39].

  • The measure needs to have a scoring system [4, 7] preferably derived from IRT or Rasch Analysis [42,43,44] or preference based scoring [3, 12, 45].

  • Sound psychometric properties in term of validity and reliability [46,47,48,49,50,51,52,53].

  • Practicality in terms of cost of the instrument as well as personnel costs in terms of length of time to administer or complete the instrument which would be directly related to the number of items on the measure [4, 7, 8, 39, 46, 54].

  • As the new measure will be developed in South Africa evidence of cultural validity of the instrument would be preferred.

Results

The 57 papers identified from the search (Fig. 1) resulted in 15 generic HRQoL measures to be reviewed. The measures included: Health Utilities Index (HUI); Health Status Classification for Pre-school children (HSCS-PS); Paediatric Quality of Life Inventory (PedsQL); The Warwick Child Health and Morbidity Profile (WCHMP), DISABKIDS Chronic Generic Module (DCGM); DISABKIDS Smiley Questionnaire (DSQ); The TZO-AZL Pre-school Children Quality of Life (TAPQoL); The Child Health Questionnaire (CHQ); The Infant and Toddler Quality of Life Questionnaire (ITQoL); The Kiddy-KINDLR; The Quality of Life Measure for Children (C-QoL); Patient Reported Outcome Measurement Information System – Paediatric Global Health (PROMIS- PGH-7); TEDQoL; Functional Status II R (FS II R) and the EQ-5D-Y Proxy.

Fig. 1
figure 1

Search outcome for generic HRQoL measures

Full size image

Summary/discussion

Item generation

The items included in the existing measures were determined during the development stages mostly from the literature and from expert opinion. Parents were most often invited to comment on an item bank which subsequently guided inclusion of items. Items from each measure were determined from the literature or from a copy of the measure itself. Most of the measures have multiple items describing each respective dimension (HUI; PedsQL; DCGM; DSQ; TAPQoL; CHQ; ITQoL; Kiddy-KINDLR; C-QoL; TEDQoL; FS II(R)). Dimension inclusion was quite similar across measures with 15 measures including mobility/function, social dimension, cognition/learning, emotion and self-care included in eight measures. These dimensions were also generally the most observable dimensions on the measures. This was in keeping with the World Health Organisation’s (WHO) definition of health and components of the HRQoL namely: physical; emotional; social and cognitive function [4, 5]. The less observable dimensions of pain, behaviour, self-esteem and general health were not as well represented. Due to the similarity in items reported across measures all the dimensions found in the published literature were included in an item bank for further testing.

ISPOR guidelines suggest that to improve the objectivity in proxy reporting items should be based on behaviour that is observable to the proxy-respondent [16]. There is no measure that was based solely on observable behaviour. The DCGM, DSQ, WCHMP and PROMIS PGH-7 did not include any observability in their dimensions. The HSCS-PS, FS IIR, HUI and EQ-5D-Y had the highest number of observable dimensions. The PedsQL, TAPQoL, Kiddy-KINDLR and CHQ all showed observability in at least half of their dimensions. Inclusion of observable dimensions would result in more accurate proxy report of HRQoL as it has been shown that observable dimensions such as physical activity correspond better between proxy and self-report than subjective outcomes such as emotion [55,56,57]. Ensuring observability with dimensions in children under four years of age has been recommended by both ISPOR [16] and the FDA [17]. These recommendations have been made in order to minimise subjectivity of the proxy reporter when completing proxy evaluation for very young children [16, 17]. This would in turn further improve the intra-rater reliability between two different proxy respondents.

Selecting a measure on which to model a new HRQoL measure based on pre-set criteria

The results were similar to those found in previous reviews in that the development of few of the measures had been based on a conceptual/theoretical framework and that HRQoL or the construct of measurement was poorly defined [6, 58]. The HSCS-PS [53], PedsQL [59, 60]; PROMIS PGH-7 [43, 44, 61] and EQ-5D-Y Proxy [48, 62, 63] were identified as the most comprehensive generic HRQoL measures for proxy or self-completion in children under the age of seven years based on the pre-set criteria. However, each was not without its limitations. The observable characteristics of the dimensions were poorly defined in the literature and there was no measure that was based solely on observable behaviour. Most of the measures for children under the age of seven years were generic health profiles and had either dimension scoring and/or a single summary score. The HUI was the only preference based measure which allowed for utility generation, but this was based on the utility index from the adult general population [64, 65]. Most of the measures were developed and tested in High Income Countries such as the United States of America, Canada, Europe or Australia. Although this may be an artefact of inclusion of English articles or abstracts it does emphasis the Anglo-centricity of HRQoL measurement. As such if the measures are to be used in low income countries or ones that don’t have English as their main language, they need to undergo vast adaptations during validation process.

It emerged that there was a need for a new generic HRQoL instrument which would address the deficiencies noted. The need for a new measure was greatest for the very young child under three years of age. The review yielded a list of 36 candidate items from the existing measures. In addition, the EQ-5D-Y Proxy Version 1 for children aged 4–18 years (which elicits responses from the viewpoint of the proxy, rather than from that of the child) was identified as a useful departure point for discussion of HRQoL with the target population. It is short with five dimensions three of which are directly observable. The EQ-5D-Y development process included cognitive interviews with children and collaboration with experts in the field. Of importance it was, to the knowledge of the authors, the only measure to which South Africa researchers had contributed in the development stages. A latent value set has been developed for the EQ-5D-Y and utility weight generation is currently in progress [66, 67]. Although the validity and reliability of the proxy measure has only been reported in a Spanish study, it performed well in younger children [63]. Thus, the EQ-5D-Y was used as a point of departure introducing the concept of HRQoL in the cognitive interviews with caregivers.

Cognitive interviews with caregivers of the target population

Cognitive debriefing with caregivers of the target population was used to further inform the development of the item bank. A descriptive, cross-sectional study design with data collected by means of an interviewer administered questionnaire was carried out. This section of the research explored the opinions of the caregivers regarding their child’s health, HRQoL and age.

Methodology

The participants included caregivers of children aged from birth to seven years who were either acutely-ill, chronically-ill or from the general population. The inclusion of caregivers with children diagnosed with a spectrum of health classifications and across the age bracket was important to ensure that the new measure and included items were representative of the population for future use.

The caregiver of the child was defined as any person over the age of 18, who lived with the child and was wholly or partly responsible for the care of the child’s physical and emotional needs. Caregivers of children under seven years of age who were acutely-ill attending an acute health service (24 h or later post-admission), were chronically-ill attending out-patient clinics or members of the general population attending a day-care centre were included. As an item bank was being generated for an English HRQoL measure only English-speaking caregivers were recruited. There were 12 participants in each of the age categories divided across each of the institutions e.g. four caregivers of children aged 1–2 attending a day-care; four caregivers of children aged 1–2 who were acutely-ill; and four caregivers of children aged 1–2 who were chronically-ill.

Instrumentation

The EQ-5D-Y Proxy version 1, which elicits a description of the child’s HRQoL from the proxy view point, was used to introduce the participants to the measurement of HRQoL. The dimensions included in the EQ-5D-Y include mobility, self-care, usual activities, pain or discomfort and worried, sad or unhappy. There is also a visual analogue scale ranging from 0 (worst health) to 100 (best health) [62]. After the completion of the EQ-5D-Y Proxy caregivers participated in a cognitive debriefing session guided by an interviewer-administered, self-designed questionnaire. The questionnaire comprised of both closed questions as well as open-ended questions which explored the reasoning behind the completion of the EQ-5D-Y Proxy. Participants were further asked to comment on the relevance of the dimension to their child and the use of wording and examples in the EQ-5D-Y Proxy. Caregivers were invited to suggest modification to the existing items as well as suggest any new items which should be added considering the age of their child. The face validity of the questionnaire was supported by two independent researchers.

The questionnaire was designed considering the verbal probing technique which asked the respondent specific questions. The questionnaire was constructed on an electronic mobile data collection platform, Magpi, which was used by the interviewer to guide the interview. The interviewer verbally asked each of the questions (some of which may have had a choice of two to three answers) and their answers to these questions were further ‘probed’ in order to identify the reasoning behind their response to the question [68]. Probing was done using scripted probes and were designed to elicit other items which the caregiver’s thought would be important to their child’s HRQoL and/or descriptions of these items for the child’s age. This method was selected due to the advantage that the interviewer was prepared for the interview and had control of the interview and the respondent did not require any training [68]. The verbal answers given by the respondents were manually recorded, by the interviewer, with the use of a tablet on the electronic Magpi system.

Procedure

Ethical approval for the study was granted by the Human Research Ethics Committee of the University of Cape Town. Caregivers of 84 children were approached to complete cognitive interviews. The first four consecutive caregivers from each age category admitted to the in-patient facility, who attended the out-patient physiotherapy department, and in numerical order from the school list were recruited. Each participant completed the EQ-5D-Y Proxy Version 1 and then responded to the interviewer-administered questionnaire, which specifically probed the content of the existing instrument across age groups and the need for additional dimensions.

Data analysis

The responses to the open ended questions were post-coded and inductive coding, often called ‘grounded’ coding was utilised as the codes were generated from the data [69]. Two researcher analysed the data for recurring themes, which were coded independently. Coding discrepancies were discussed until consensus was reached. In this way the narrative information was transformed into responses the frequency of which could be counted.

Results

The layout, wording and time period for recall of the EQ-5D-Y were acceptable to the caregivers and considered appropriate for proxy completion. Furthermore, the VAS was generally well understood.

The caregivers identified items in addition to the five items included on the EQ-5D-Y. The items that could be added to increase the content validity of the new instrument according to age group presented in Table 1 below, in decreasing order of frequency.

Table 1 Proposed additional items
Full size table

The highest number of suggested additional items was in the younger age groups, most notably the 0–3-year group, with the 0–1-year group having the highest number of suggested additions. Communication and eating were identified as additional items which were of importance across all age groups. Communication was important for many caregivers as they felt that if their child was not physically able to participate or complete a task they were able to do this through communication with their family or peers. Eating was considered a fundamental attribute for health. Sleeping was suggested as a new item for children in the age band 0–3 years as caregivers felt that if children were unable to sleep well it would reduce their ability to play or learn. Toileting emerged as a new item for children over 1 year of age. The other suggestions related to existing dimensions but with change in nomenclature. Movement, as opposed to walking about, was suggested for the age group of 0–1 years. Play as an item on its own, as opposed to a list of descriptors under usual activities, was suggested across age groups as the descriptors of hobbies, sports and going to school were not deemed appropriate for younger children. Walking was suggested as an item due to the poor understanding of the term ‘walking about’. Discomfort and worried were suggested to be added as separate items. The dimension of self-care was suggested to be re-worded as assistance with self-care. All additional items were added for consideration during the Delphi rounds and these were either additions or reformulations of existing items (e.g. splitting up the PD dimension into two, pain and discomfort).

Reduction of the item pool

The candidate item bank includes items identified in the literature review and cognitive interviews with caregivers of the target population. The reduction of items was determined through two rounds of Delphi panel deliberations.

Method

Study design and setting

A quantitative, consensus study was done with data collected by means of a two-part e-mail co-ordinated Delphi technique using the Content Validity Index (CVI) as a decision making tool [70]. The CVI is computed by dividing the number of experts giving a pre-determined high score by the total number of experts, this process ensures content validity for the items selected [70].

Participants

Purposive sampling was used, and experts were selected based on their knowledge of either or both HRQoL and child health. Caregivers were not included in the exercise as their views had been explored cognitive interviews. The selected participants included international experts in HRQoL, child health and child advocacy. Professionals who practiced within a multi-disciplinary team and who had a vested interest in HRQoL and/or Health Economics and/or child development or who were active advocates for child health were included in the study (Table 2). Twelve of the 15 participants who were invited to participate in the study via e-mail invitation completed the first round. Subsequently seven experts participated in the second round. Due to anonymity in the completion of the Delphi study it is not known which of the experts participated at which stages.

Table 2 Details of participants invited to participate in the Delphi study
Full size table

Instrumentation

The design of the Delphi Questionnaire was based on templates which were available in the Survey Monkey survey management programme [71]. Participants were asked to rate the list of items generated through the literature review and the interviews with the care-givers using the CVI from 1 to 4 for each of the age groups. The CVI ratings scale were characterised as: 1- not relevant, 2- somewhat relevant, 3- quite relevant, and 4- highly relevant. The results from the cognitive interviews and cognitive interviews indicated a need for an instrument to measure HRQoL in children aged 0–3 years, thus items were pruned for this age group by the experts. The age groups included for the rating exercise included: 0–12 months (including children before their first birthday); 12–24 months (including children from the day of their first birthday to before their second birthday) and 24–36 months (including children from the day of their second birthday to before their third birthday). The sub-analysis by age band was decided due to developmental cut-off points of motor and language acquisition. Where most children start walking between their first and second birthdays from a gross motor perspective. Furthermore, from the age of two years children start to use simple phrases, start to follow simple commands and understand simple questions. Thus, it was important to assess whether items would be equivalent across the three age bands or if more than one questionnaire was needed to measure HRQoL in children between 0 and three years. The questionnaire was pre-tested by two independent researchers to approve the content, structure and comprehension of questions. Necessary changes were made according to their input.

Procedure

After ethical approval was obtained participants were invited to participate in the item pool generation via e-mail. As HRQoL is a contested concept, the e-mail included an operational definition of HRQoL. The objectives and methods of the study were described and a link to the online survey management system of Survey Monkey [71] was included. Anonymity was insured as survey monkey allows for anonymous completion of their surveys. All information was gathered from participants using Survey Monkey software [71]. Willing participants were asked to give informed consent and to participate in the process within a three-week time period. Participants were then asked to rate each item on a CVI from 1 to 4 for each of the three age groups. The participants were given an opportunity to suggest new items to be added to the item pool. Participants were also asked to give their opinion on number of items to include in the questionnaire.

The participants who completed the first round of the study were invited to participate in the second round of the study and to complete the second round within a three-week period. The second round of the survey included the items with a CVI ≥ 0.78, from the first round of the study, for each age group. Participants were asked to rank the top seven items for each age group (a value of one reflecting the most important item) and to give the reasoning behind their answers. They were further asked to identify items which could be combined under a different title. The second round of the Delphi study took approximately 25 min. Participants were blinded to each other in both rounds of the study. The participants were allocated a number for summary reports as well as data analysis to ensure confidentiality.

Statistical analysis

The CVI which has been used successfully by other instrument developers was chosen as a basis for final item selection [70]. The CVI from round one for each item was computed as the number of experts giving a rating of either three or four divided by the total number of experts, a method suggested by Polit and Beck [70]. The CVI was computed for each item per age band. The cut-off point of inclusion of an item was taken from Polit and Beck [70] with a recommendation of a CVI of ≥0.75 for 6–10 participants.

Additional participants were not recruited to take part in the second round of the Delphi study as the aim was to reach consensus amongst the same group of participants. Literature indicates that a minimum of three experts is needed to draw conclusions regarding content validity [70]. This may however have limited the interpretation of the results as the sampling of the experts in the final round was not known. The items used in the second round of the Delphi study were identified through the rating exercises of the participants in the first round. The items top scoring items for each age group were incorporated into the final item bank for further testing.

Results

Local and international experts in the field were invited to participate in the Delphi Study. Out of the 15 experts who were invited to participate 12 gave informed consent and completed the first round of the online survey. Eight of the original 12 participants participated in the second round of the study. All eight participants completed the questions regarding the age group 0–12 months. Seven participants completed the questions regarding the age group 12–24 months. Six participants completed the questions regarding the age group 24–36 months.

A summary of the results from the two rounds for each category are depicted in Table 3. In the 0–12-month category, eating was ranked as the most important item, followed by pain. Apart from mood, the nine top ranked items received a CVI ≥0.63. In the 12–24-month category, play had the highest CVI, followed by eating and achievement of milestones. The top ranked 11 items received a CVI ≥0.43. Additional items to the younger age group identified for the 12–24-month age group include: behaviour, growth, communication, achievement of milestones and socializing. In the 24–36-month category, play, pain usual activities and mood were ranked the most highly. Sleeping, mood, behaviour and socializing were ranked in the top ten with majority of experts ranking them important.

Table 3 Top Ranked Items per age group after both Delphi rounds
Full size table

The respondents had been requested to provide item descriptors based on observable behaviour as well as which items had similar constructs and could be grouped together for measurement. The results are summarised in Table 4 below.

Table 4 Top ranked items with expert opinion on item grouping and descriptors
Full size table

All of these items will be considered for inclusion on the new HRQoL instrument and include: Eating, Play, Relationships, Behaviour, Communication, Independence, Mood, Movement, Pain, Sleeping and Sickness (general health). These candidate items were further mapped to International Classification of Functioning and Disability – Child and Youth (ICF-CY) categories to examine whether the proposed instrument would reflect the conceptual framework identified [72]. The item mapping showed that all the ICF Categories were represented except for the categories of Environment and Personal Factors. This finding was similar to results from mapping other HRQoL instruments to the ICF [25, 73, 74] .

The items generated from each of the stages is summarised in Table 5 below with the final items for inclusion indicated in the fourth column. The items were operationalised based on expert feedback on the suggested descriptors for each item and review of the literature.

Table 5 Summary of item generation
Full size table

Discussion

The two rounds of the Delphi study pruned the item bank from 53 items after the literature review and cognitive interviews to 11 after the two rounds of the Delphi study. The four broad domains of HRQoL namely: Physical, Social and Mental and functional status were all covered in the items selected. The systematic review revealed considerable overlap in the items included. Furthermore, the items identified in the literature review were not all based on observable behaviour as recommended by the FDA [17] and ISPOR [16]. The recommended age range for completion of the measures is quite varied with the PedsQL [75] and HSCS-PS [53] having the closest age of administration to that of the items in the bank (0–3 years). The items of eating and sleeping could be included in broad definition of Physical Health and General Health on the PROMIS PGH-7 although not specified [43, 44, 61]. Play is listed as one of the examples in the Usual Activities dimension on the EQ-5D-Y Proxy [48, 62, 76] and may fall under the expansive question on the PedsQL “playing with other children”. Play in early childhood is associated with cognitive, linguistic, socio-emotional, problem-solving and identity development [77, 78]. Furthermore it is thought to assist in acquisition of skill (fine motor and gross motor), the development of social relationships as well as a form of recreation [24]. Thus, play would overlap with many items on the other instruments such as PedsQL items of sport, friends and school activities. The items on the HSCS-PS of dexterity, learning and remembering; thinking and problem solving and PROMIS item of fun with friends would also overlap with the construct of play.

Psychological development is intertwined with the development of communication, behaviour and relationships. In the infant and with some toddlers these items could act as an indicator for progress of psychological development [31, 79, 80]. The items of communication, behaviour, mood and relationships are interlinked with each other as well as dimensions on the other measures which include mental health, mood or feelings (afraid/scared, sad, angry, worry, emotion, worried, unhappy), behaviour, speech and cognition (school activities, learning and remembering and thinking and problem solving). Independence in young children could portray itself in many ways. However, the results of the cognitive interviews and Delphi study likened this to taking responsibility for tasks such as self-care and this item is thus likened to that of “looking after myself” on the EQ-5D-Y and self-care on the HSCS-PS. Pain is explicitly expressed in on the EQ-5D-Y and HSCS-PS but may be inferred or the cause of many of the problems experienced in the items of the other measures. Sickness was considered, by the experts, to be any form of illness or other contributing factor leading to poor health that would negatively impact on the HRQoL of the child. This item of sickness could thus be likened to general health question on the EQ-5D-Y and PROMIS and is included in the HSCS-PS in utilisation of health care and the PedsQL in the question related to missing school. Movement is included in all of the instruments as the ability to walk except for the PROMIS which asks only of Physical Health. The PedsQL additionally asks about the ability to run and participate in sport or activity.

The items are representative of the conceptual framework of the ICF-CY categories of Body, Structure and Function, Activities and Participation [81]. As the instrument aims to be a HRQoL rather than a general QoL instrument, it is may not be surprising that environmental factors are not represented. The inclusion of external factors, such as building accessibility and policy regarding health and wellness related issues may very likely influence HRQoL, much as the health condition might. However, it is rather the perceived impact of these components of the ICF on the HRQoL of the respondents, rather than the factors themselves that needs to be included. As personal factors are not codified in the ICF and generally include demographic details such as age and gender, these are also not represented here.

The limitations of this study include the selection of participants was limited to experts who were known to the research group which introduced a selection bias and further limited the results as experts from sectors such as social work and education were not invited to participate. This limitation was diminished by the fact that all the experts who participated work within a multidisciplinary team. Of note the developmental paediatrician works together with the education department in determining school readiness and placement of children.

Conclusion

In conclusion, a bank of items was selected based on the findings from the literature reviews, cognitive interviews and Delphi study. This process ensured that the items for inclusion were developmentally appropriate for the age range of inclusion. The final items included: behaviour, communication, eating, independence, play, mood, movement, pain, relationships, sickness (general health) and sleep. These items were representative of the definition of HRQoL and encompassed broader dimensions of physical (eating, play, movement, pain, sickness and sleep), emotional (behaviour, communication, mood) and social (behaviour, communication, independence, relationships). These items are also representative of the dimensions of the ICF: body structure and function, activities and participation. The eleven items and their descriptors will need to undergo further testing with the target population for their feasibility and utility before the final measure is developed.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

CEA:

Cost Effective Analysis

CHQ:

The Child Health Questionnaire

C-QoL:

The Quality of Life Measure for Children

DCGM:

DISABKIDS Chronic Generic Module

DSQ:

DISABKIDS Smiley Questionnaire

FDA:

Food and Drug Administration

FS II R:

Functional Status II R

HRQoL:

Health Related Quality of Life

HSCS-PS:

Health Status Classification for Pre-school children

HUI:

Health Utilities Index

ISPOR:

International Society for Pharmaco-economics and Outcomes Research

ITQoL:

The Infant and Toddler Quality of Life Questionnaire

PedsQL:

The Paediatric Quality of Life Inventory

PROMIS-PGH-7:

Patient Reported Outcome Measurement Information System

QALYs:

Quality Adjusted Life Years

QoL:

Quality of Life

TAPQoL:

The TZO-AZL Pre-school Children Quality of Life

VAS:

Visual Analogue Scale

WCHMP:

The Warwick Child Health and Morbidity Profile

References

  1. Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJL. Global and regional burden of disease and risk factors, 2001: systematic analysis of population health data. Lancet. 2006;367:1747–57.

    Article  PubMed  Google Scholar 

  2. World Health Organization. Global Health Estimates 2014: DALYs. 2014.

    Google Scholar 

  3. Neumann PJ, Goldie SJ, Weinstein MC. Preference-based measures in economic evaluation in health care. Annu Rev Public Health. 2000;21:587–611 [cited 2015 Feb 21] Available from: http://www.scopus.com/inward/record.url?eid=2-s2.0-0033928288&partnerID=tZOtx3y1.

    Article  CAS  PubMed  Google Scholar 

  4. Spieth LE, Harris CV. Assessment of health-related quality of life in children and adolescents: an integrative review. J Pediatr Psychol. 1996;21(2):175–93.

    Article  CAS  PubMed  Google Scholar 

  5. World Health Organization. Constitution of the World Health Organization. Am J Public Health. 1946;36(11):1315–23.

    Article  Google Scholar 

  6. Grange A, Bekker H, Noyes J, Langley P. Adequacy of health-related quality of life measures in children under 5 years old: systematic review. J Adv Nurs. 2007;59(197–220):197–220 [cited 2015 Feb 21] Available from: http://www.scopus.com/inward/record.url?eid=2-s2.0-34547279296&partnerID=tZOtx3y1.

    Article  PubMed  Google Scholar 

  7. Pal DK. Quality of life assessment in children: a review of conceptual and methodological issues in multidimensional health status measures. J Epidemiol Community Heal. 1996;50(4):391–6.

    Article  CAS  Google Scholar 

  8. Varni JW, Burwinkle TM, Lane MM. Health-related quality of life measurement in pediatric clinical practice: An appraisal and precept for future research and application. Health Qual Life Outcomes. 2005;3(34):34–43 [cited 2015 Jan 10].Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1156928&tool=pmcentrez&rendertype=abstract.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Solans M, Pane S, Estrada MD, Serra-Sutton V, Berra S, Herdman M, et al. Health-related quality of life measurement in children and adolescents: a systematic review of generic and disease-specific instruments. Value Heal. 2008;11(4):742–764. Available from: https://doi.org/10.1111/j.1524-4733.2007.00293.x

    Article  PubMed  Google Scholar 

  10. Feeny D, Furlong W, Mulhern RK, Barr RD, Hudson M. A framework for assessing health-related quality of life among children with cancer. Int J Cancer Suppl. 1999;12:2–9.

    Article  CAS  PubMed  Google Scholar 

  11. Kaplan RM, Bush JW. Health-related quality of life measurement for evaluation research and policy analysis. Health Psychol. 1982;1(1):61–80.

    Article  Google Scholar 

  12. Torrance GW. Preferences for health outcomes and cost-utility analysis. Am J Manag Care. 1997;3:S8–20 Available from: wos:000074774200002.

    PubMed  Google Scholar 

  13. Garber AM, Phelps CE. Economic foundations of cost-effectiveness analysis. J Health Econ. 1997;16:1–31.

    Article  CAS  PubMed  Google Scholar 

  14. Tengs TO. Cost-effectiveness versus cost-utility analysis of interventions for Cancer: does adjusting for health-related quality of life really matter? Value Heal. 2004;7(1):70–8.

    Article  Google Scholar 

  15. Bradlyn AS, Ritchey AK, Harris CV, Moore IM(K), O’Brien RT, Parsons SK, et al. Quality of life research in pediatric oncology: Research methods and barriers. Cancer. 1996;78(6):1333–9 Available from: 10.1002/%28SICI%291097-0142%2819960915%2978%3A6%3C1333%3A%3AAID-CNCR24%3E3.0.CO%3B2-0.

    Article  CAS  PubMed  Google Scholar 

  16. Matza LS, Patrick DL, Riley A, Alexander J, Rajmil L, Pleil A, et al. Pediatric patient-reported outcome instruments for research to support medical product labeling: report of the ISPOR PRO good research practices for the assessment of children and adolescents task force. Value Heal. 2013;16(4):461–79.

    Article  Google Scholar 

  17. Food and Drug Administration. Guidance for Industry. Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims Guidance for Industry. 2006.

    Google Scholar 

  18. Janssens A, Thompson Coon J, Rogers M, Allen K, Green C, Jenkinson C, et al. A systematic review of generic multidimensional patient-reported outcome measures for children, part I: descriptive characteristics. Value Heal 2015;18(2):315–333. Available from: doi: https://doi.org/10.1016/j.jval.2014.12.006

    Article  PubMed  Google Scholar 

  19. Eiser C, Morse R. Can parents rate their child’s health-related quality of life? Results of a systematic review. Qual Life Res. 2001;10(4):347–57.

    Article  CAS  PubMed  Google Scholar 

  20. Bakas T, McLennon SM, Carpenter JS, Buelow JM, Otte JL, Hanna KM, et al. Systematic review of health-related quality of life models. Health Qual Life Outcomes. 2012;10:134–44 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3548743&tool=pmcentrez&rendertype=abstract.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Ferrans CE, Zerwic JJ, Wilbur JE, Larson JL. Conceptual model of health-related quality of life. J Nurs Scholarsh. 2005;37(4):336–42 Available from: http://doi.wiley.com/10.1111/j.1547-5069.2005.00058.x.

    Article  PubMed  Google Scholar 

  22. Wilson I, Cleary P. Linking clinical variables with health-related quality of life. J Am Med Assoc. 1995;273(1):59–65.

    Article  CAS  Google Scholar 

  23. Taylor RM, Franck LS, Gibson F, Donaldson N, Dhawan A. Study of the factors affecting health-related quality of life in adolescents after liver transplantation. Am J Transpl. 2009;9(5):1179–88.

    Article  CAS  Google Scholar 

  24. World Health Organization. International Classification of Functioning, Disability and Health: Children and Youth Version: ICF-CY. Switzerland: WHO Press, World Health Organization; 2007. p. 1–351.

    Google Scholar 

  25. McDougall J, Wright V, Rosenbaum P. The ICF model of functioning and disability: incorporating quality of life and human development. Dev Neurorehabil. 2010;13(3):204–11 Available from: http://www.ncbi.nlm.nih.gov/pubmed/20450470.

    Article  PubMed  Google Scholar 

  26. Wilson IBI, Cleary PD. Linking clinical variables with health-related quality of life. A conceptual model of patient outcomes. J Am Med Assoc. 1995;273(1):59–65.

    Article  CAS  Google Scholar 

  27. Kakebeeke TH, Caflisch J, Chaouch A, Rousson V, Largo RH, Jenni OG. Neuromotor development in children . Part 3 : motor performance in 3- to 5-year-olds. Dev Med Child Neurol. 2013;55:248–56.

    Article  PubMed  Google Scholar 

  28. Sheldrick RC, Perrin EC. Evidence-Based Milestones for Surveillance of Cognitive , Language , and Motor Development. Acad Pediatr 2013;13(6):577–586. Available from: doi: https://doi.org/10.1016/j.acap.2013.07.001

    Article  PubMed  PubMed Central  Google Scholar 

  29. Hadders-Algra M. The neuronal group selection theory : a framework to explain variation in normal motor development. Dev Med Child Neurol. 2000;42:566–72.

    Article  CAS  PubMed  Google Scholar 

  30. Karkouti IM. Examing Psyhcosocial Identitly Developmeent theories: a guideline for professional practice. Education. 2012;135(2):257–64.

    Google Scholar 

  31. Diamond LM, Aspinwall LG. Emotion regulation across the life span : an integrative perspective emphasizing and dyadic processes. Motiv Emot. 2003;27(2):125–57.

    Article  Google Scholar 

  32. Waters E, Maher E, Salmon L, Reddihough D, Boyd R. Development of a condition-specific measure of quality of life for children with cerebral palsy: empirical thematic data reported by parents and children. Child Care, Heal Dev. 2005;31(2):127–35 Available from: http://search.ebscohost.com/login.aspx?direct=true&db=cmedm&AN=15715691&site=ehost-live.

    Article  CAS  Google Scholar 

  33. Malik SN, Sikander M, Iftikhar N. Role of parents in communication development of their children. J Pak Med Assoc. 2015;65(9):1031 Available from: http://www.ncbi.nlm.nih.gov/pubmed/26338759.

    PubMed  Google Scholar 

  34. Cocquyt M, Mommaerts MY, Dewart H, Zink I. Measuring pragmatic skills: early detection of infants at risk for communication problems. Int J Lang Commun Disord. 2015;50(5):646–58.

    Article  PubMed  Google Scholar 

  35. Beebe B, Messinger D, Bahrick LE, Margolis A, Buck KA, Chen H. A systems view of mother-infant face-to-face communication. Dev Psychol. 2016;52(4):556–71 Available from: http://www.scopus.com/inward/record.url?eid=2-s2.0-84957991251&partnerID=tZOtx3y1.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Neff K. Understanding how universal goals of independence and interdependence are manifested within particular cultural contexts. Hum Dev. 2003;46:312–8.

    Article  Google Scholar 

  37. Brod M, Tesler LE, Christensen TL. Qualitative research and content validity: developing best practices based on science and experience. Qual Life Res. 2009;18(9):1263–78 [cited 2015 Jan 28]; Available from: http://www.scopus.com/inward/record.url?eid=2-s2.0-70349959880&partnerID=tZOtx3y1.

    Article  PubMed  Google Scholar 

  38. Smith SC, Lamping DL, Banerjee S, Harwood R, Foley B, Smith P, et al. Measurement of health-related quality of life for people with dementia: development of a new instrument (DEMQOL) and an evaluation of current methodology. Health Technol Assess. 2005;9(10):1–93.

    Article  CAS  PubMed  Google Scholar 

  39. Stone DH. Design a questionnaire. BMJ 1993;307(6914):1264–12666. Available from: http://www.ncbi.nlm.nih.gov/pubmed/8281062%5Cnhttp://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=PMC1679392

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Mangione-Smith R. Bridging the quality chasm for children: need for valid, comprehensive measurement tools. Arch Pediatr Adolesc Med [Internet]. 2007;161(9):909–10 Available from: http://search.ebscohost.com/login.aspx?direct=true&db=cmedm&AN=17768293&site=ehost-live.

    Article  Google Scholar 

  41. Irwin LG, Siddiqi A, Hertzman C. Early child development : a powerful equalizer; 2007.

    Google Scholar 

  42. Forrest CB, Bevans KB, Tucker C, Riley AW, Ravens-Sieberer U, Gardner W, et al. Commentary: the patient-reported outcome measurement information system (PROMIS®) for children and youth: application to pediatric psychology. J Pediatr Psychol. 2012;37(6):614–21 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3381710&tool=pmcentrez&rendertype=abstract.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Forrest CB, Bevans KB, Pratiwadi R, Moon J, Teneralli RE, Minton JM, et al. Development of the PROMIS ® pediatric global health (PGH-7) measure. Qual Life Res An Int J Qual Life Asp Treat Care Rehabil. 2014;23(4):1221–31 Available from: http://search.ebscohost.com/login.aspx?direct=true&db=cmedm&AN=24264804&site=ehost-live.

    Article  Google Scholar 

  44. Irwin DE, Gross HE, Stucky BD, Thissen D, DeWitt EM, Lai JS, et al. Development of six PROMIS pediatrics proxy-report item banks. Health Qual Life Outcomes. 2012;10(22):1–13 [cited 2014 Jul 12]. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3312870&tool=pmcentrez&rendertype=abstract.

    Google Scholar 

  45. Torrance GW. Utility measurement in healthcare. The things I never got to. Pharma. 2006;24(11):1069–78.

    Google Scholar 

  46. Fitzpatrick R, Fletcher A, Gore S, Jones D, Spiegelhalter D, Cox D. Quality of life measures in health care. I: applications and issues in assessment. Br Med J. 1992;305:1074–7.

    Article  CAS  Google Scholar 

  47. Jenney MEM, Campbell S. Measuring quality of life. Arch Dis Child. 1997;77:347–54 Available from: adc.bmj.com on January, 23,2014.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  48. Ravens-Sieberer U, Wille N, Badia X, Bonsel G, Burström K, Cavrini G, et al. Feasibility, reliability, and validity of the EQ-5D-Y: results from a multinational study. Qual Life Res. 2010;19(6):887–97 [cited 2014 Jan 20] Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2892614&tool=pmcentrez&rendertype=abstract.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Klaassen RJ, Blanchette VS, Barnard D, Wakefield CD, Curtis C, Bradley CS, et al. Validity, reliability, and responsiveness of a new measure of health-related quality of life in children with immune thrombocytopenic purpura: the Kids’ ITP Tools. J Pediatr. 2007;150(5):510 Available from: http://search.ebscohost.com/login.aspx?direct=true&db=cmedm&AN=17452226&site=ehost-live.

    Article  PubMed  Google Scholar 

  50. Seid M, Limbers CA, Driscoll KA, Opipari-Arrigan LA, Gelhard LR, Varni JW. Reliability, Validity, and Responsiveness of the Pediatric Quality of Life Inventory™ (PedsQL™) Generic Core Scales and Asthma Symptoms Scale in Vulnerable Children With Asthma. J Asthma. 2010;47(2):170–177. Available from: https://doi.org/10.3109/02770900903533966.

    Article  Google Scholar 

  51. Bhatia S, Jenney MEM, Bogue MK, Rockwood TH, Feusner JH, Friedman DL, et al. The Minneapolis-Manchester quality of life instrument: reliability and validity of the adolescent form. J Clin Oncol Off J Am Soc Clin Oncol. 2002;20(24):4692–8 Available from: http://search.ebscohost.com/login.aspx?direct=true&db=cmedm&AN=12488415&site=ehost-live.

    Article  Google Scholar 

  52. Varni JW, Seid M, Knight TS, Burwinkle T, Brown J, Szer IS. The PedsQL (TM) in pediatric rheumatology - Reliability, validity, and responsiveness of the Pediatric Quality of Life Inventory (TM) generic core scales and rheumatology module. Arthritis Rheum. 2002;46(3):714–25 Available from: wos:000174409200018.

    Article  PubMed  Google Scholar 

  53. Saigal S, Rosenbaum P, Stoskopf B, Hoult L, Furlong W, Feeny D, et al. Development, reliability and validity of a new measure of overall health for pre-school children. Qual Life Res. 2005;14(1):243–57 [cited 2015 Feb 21]; Available from: http://www.scopus.com/inward/record.url?eid=2-s2.0-13844276752&partnerID=tZOtx3y1.

    Article  CAS  PubMed  Google Scholar 

  54. Sprangers M, Cull A, Bjordal K, Greonvold M, Aaronson NK. The European Organization for Research and Treatment of Cancer approach to quality of life assessment: guidelines for developing questionnaire modules. Qual Life Res. 1993;2(4):287–95 Available from: http://link.springer.com/article/10.1007/BF00434800.

    Article  CAS  PubMed  Google Scholar 

  55. Jelsma J, Ramma L. How do children at special schools and their parents perceive their HRQoL compared to children at open schools ? Health Qual Life Outcomes. 2010;8(1):72–9.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Theunissen NCM, Vogels TGC, Koopman HM, Verrips GHW, Zwinderman KAH, Verloove-Vanhorick SP, et al. The proxy problem: child report versus parent report in health-related quality of life research. Qual Life Res. 1998;7:387–97.

    Article  CAS  PubMed  Google Scholar 

  57. Erhart M, Ellert U, Kurth B, Ravens-sieberer U. Measuring adolescents’ HRQoL via self reports and parent proxy reports : an evaluation of the psychometric properties of both versions of the KINDL-R instrument. Health Qual Life Outcomes. 2009;7(77):1–12.

    Google Scholar 

  58. Matza LS, Swensen AR, Flood EM, Secnik K, Leidy NK. Assessment of Health-Related Quality of Life in Children : A Review of Conceptual , Methodological , and Regulatory Issues. Value Heal. 2004;7(1):79–92.

    Article  Google Scholar 

  59. Varni JW, Katz ER, Seid M, DJL Q, Friedman-Bender A, Castro CM. The Pediatric Cancer Quality of Life Inventory (PCQL). I. Instrument development, descriptive statistics, and cross-informant variance. J Behav Med. 1998;21(2):179–204 Available from: http://search.ebscohost.com/login.aspx?direct=true&db=psyh&AN=1998-02335-005&site=ehost-live.

    Article  CAS  PubMed  Google Scholar 

  60. Varni JW, Seid M, Kurtin PS. and Validity of the Pediatric Quality of PedsQLTM Version 4 . 0 Generic Core Scales in Healthy Life InventoryTM and Patient Populations. Med Care. 2001;39(8):800–12 Available from: http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=2004031293&site=ehost-live.

    Article  CAS  PubMed  Google Scholar 

  61. Varni JW, Thissen D, Stucky BD, Liu Y, Gorder H, Irwin DE, et al. PROMIS® Parent Proxy Report Scales: an item response theory analysis of the parent proxy report item banks. Qual Life Res. 2012;21(7):1223–40 [cited 2014 Jul 13]; Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3791923&tool=pmcentrez&rendertype=abstract.

    Article  PubMed  Google Scholar 

  62. Wille N, Badia X, Bonsel G, Burstrom K, Cavrini G, Devlin N, et al. Development of the EQ-5D-Y : a child-friendly version of the EQ-5D. Qual Life Res. 2010;19:875–86.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Gusi N, Perez-Sousa MA, Gozalo-Delgado M, Olivares PR. Validity and reliability of the Spanish EQ-5D-Y proxy version. An Pediatr. 2014;81(4):212–9.

    Article  CAS  Google Scholar 

  64. Torrance GW, Feeny DH, Furlong WJ, Barr RD, Wang Q, Zhang Y. Multiattribute for a function utility health status classification comprehensive system health utilities index mark 2. Med Care. 1996;34(7):702–22.

    Article  CAS  PubMed  Google Scholar 

  65. Boyle MH, Torrance GW. Developing multiattribute health indexes. Med Care. 1984;22(11):1045–57.

    Article  CAS  PubMed  Google Scholar 

  66. Rivero-Arias O, Shah KK, Ramos-Goñi JM, Mott D, Develin N. Estimating latent scale discrete choice utilities to develop an EQ-5D-Y value set in the UK. Barcelona: EuroQoL Plenary; 2017.

    Google Scholar 

  67. EuroQol Research Foundation. EuroQoL. 2016 [cited 2017 Feb 7]. Available from: www.euroqol.org

    Google Scholar 

  68. Willis G. Cognitive interviewing as a tool for improving the informed consent process. J Empir Res Hum Res Ethics. 2006;1(1):9–24.

    Article  PubMed  Google Scholar 

  69. Thematic. Your Guide to Open-End Coding of Customer Surveys. Thematic Ltd. [cited 2018 Jan 8]. Available from: http://www.getthematic.com/coding-open-ended-questions/

  70. Polit DF, Beck CT. The content validity index : are you sure you know what ’ s being reported ? Critique and Recommendations. Res Nurs Heal. 2006;29:489–97.

    Article  Google Scholar 

  71. SurveyMonkey Inc. SurveyMoneky Inc. [internet]. San Mateo, Californai, USA. Available from: www.surveymonkey.com

  72. Stucki G, Cieza A, Ewert T, Kostanjsek N, Chatterji S, Bedirhan T. Application of the International Classification of Functioning, Disability and Health (ICF) in clinical practice. Disabil Rehabil. 2002;24(5):281–2.

    Article  CAS  PubMed  Google Scholar 

  73. Fayed N, De Camargo OK, Kerr E, Rosenbaum P, Dubey A, Bostan C, et al. Generic patient-reported outcomes in child health research: a review of conceptual content using World Health Organization definitions. Dev Med Child Neurol. 2012;54(12):1085–95.

    Article  PubMed  Google Scholar 

  74. Petersson C, Simeonsson RJ, Enskar K, Huus K. Comparing children’s self-report instruments for health-related quality of life using the international classification of functioning, disability and health for children and youth (ICF-CY). Health Qual Life Outcomes. 2013;11(1):75–84 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3648353&tool=pmcentrez&rendertype=abstract.

    Article  PubMed  PubMed Central  Google Scholar 

  75. Varni JW, Seid M, Kurtin PS. PedsQL™ 4.0: Reliability and Validity of the Pediatric Quality of Life Inventory™ Version 4.0 Generic Core Scales in Healthy and Patient Populations. Med Care. 2001;39(8):800–12 [cited 2015 Feb 21] Available from: http://www.scopus.com/inward/record.url?eid=2-s2.0-0035432179&partnerID=tZOtx3y1.

    Article  CAS  PubMed  Google Scholar 

  76. Gusi N, Perez-Sousa M, Gozalo-Delgado M, Oivares P. Gusi 1. An Pediatr. 2014.

  77. Dmytro D, Kubiliene N, Cameron CA. Agentive and communitarian play in early childhood. Early Child Dev Care. 2014;184(12):1920–33 Available from: http://www.tandfonline.com.ezproxy.lancs.ac.uk/doi/full/10.1080/03004430.2014.894033#abstract.

    Article  Google Scholar 

  78. Cameron CA, Pino G, Gamannosi BA, Hancock R, Tapanya S. Domestic play collaborations in diverse family contexts. Australas J Early Child. 2009;36(4):78–85.

    Article  Google Scholar 

  79. Englund MM, Kuo SII-C, Puig J, Collins WA. Early roots of adult competence: the significance of close relationships from infancy to early adulthood. Int J Behav Dev. 2011;35(6):490–6.

    Article  PubMed  PubMed Central  Google Scholar 

  80. Temple E, Emmett S. Promoting the development of children’s emotional and social wellbeing in early childhood settings: how can we enhance the capability of educators to fulfil role expectations? Aust J Early Child. 2013;38(1):66–72 Available from: http://www.scopus.com/inward/record.url?eid=2-s2.0-84878420423&partnerID=40&md5=6bb6f8ee342de2852c79e7347b7a1ea4.

    Article  Google Scholar 

  81. McIntyre A, Tempest S. Disease specific core sets of the international classification of functioning, disability and health (ICF): two steps forward and one step back? Disabil Rehabil. 2007;29(18):1475–9.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

The systematic review was funded by the EuroQoL Research Foundation (a non-profit organisation) and is gratefully acknowledged.

Author information

Authors and Affiliations

  1. Faculty of Health and Rehabilitation Sciences, Division of Physiotherapy, Cape Town, South Africa

    Janine Verstraete & Jennifer Jelsma

  2. Faculty of Health and Rehabilitation Sciences, Division of Communication Sciences and Disorders, Cape Town, South Africa

    Lebogang Ramma

Authors
  1. Janine Verstraete
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lebogang Ramma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jennifer Jelsma
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JV and JJ both contributed towards the proposal development, conception and design of the study, ethical submission, data analysis, discussion and conclusion and final write up. LR contributed to the supervision of the research. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Janine Verstraete.

Ethics declarations

Ethics approval and consent to participate

Ethical approval for the study was granted by the Human Research Ethics Committee of the University of Cape Town (HREC/Ref:336/2014). Informed consent was obtained from all participants.

Consent for publication

No identifying information has been included in this manuscript. All participants consented to the publication of the analysed data.

Competing interests

JV and JJ are members of the EuroQoL Research Foundation. This did not influence the reporting of the research study. The views expressed by the authors in the publication do not necessarily reflect the views of the EuroQol Group.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Verstraete, J., Ramma, L. & Jelsma, J. Item generation for a proxy health related quality of life measure in very young children. Health Qual Life Outcomes 18, 11 (2020). https://doi.org/10.1186/s12955-020-1271-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-020-1271-1

Keywords

Health and Quality of Life Outcomes

ISSN: 1477-7525

Contact us