Psychometric evaluation of a Swedish version of Minneapolis-Manchester quality of life-youth form and adolescent form
Health and Quality of Life Outcomes volume 11, Article number: 79 (2013)
It has become important to measure long-term effects and quality of life in survivors of childhood cancer. The Minneapolis- Manchester Quality of Life (MMQL) instrument has been proven to better capture the quality of life (QoL) perspective of health than other instruments. The instrument has age appropriate versions and is therefore favourable for longitudinal studies of QoL of children surviving from cancer. The aim of this study was to evaluate the psychometric properties of the Swedish version of MMQL-Youth Form and the Adolescent Form focusing on: 1) face and content validity 2) the internal consistency and 3) the test-retest reliability.
The sample consisted of 950 pupils (11–16 years old) from 7 schools in the western Sweden who completed the questionnaire. For the test-retest evaluation 230 respondents completed the questionnaire two weeks later.
Face and content validity was supported and internal consistency was found to be acceptable for the total scale for both the MMQL-Youth Form (8–12 years of age) and the Adolescent Form (13–20 years of age). Test-retest reliability for the MMQL-Youth Form was moderate for 50% of the items and good for the remaining. For the MMQL-Adolescent Form the test-retest showed moderate or good agreement for 80% of the items and fair for 20%.
The result indicated that the Swedish version of the MMQLYouth Form and Adolescent Form was valid and reliable in a sample of healthy children in a Swedish context. It is recommended to test the instrument among diverse samples of children such as survivors of childhood cancer in order to validate its usefulness in research and clinical settings.
Improved treatment programs and care over the past thirty years have substantially increased the proportion of children surviving cancer and today approximately 80% survive long term . However, surviving cancer during childhood imposes a number of physical and psychosocial difficulties later in life. These include school and work-related problems, difficulties related to friendships and intimate relationships, sleep disturbance, infertility and physical and emotional distress. These problems can have an immediate and negative impact on the quality of life (QoL) later in life . It has thus become important to measure long-term effects and quality of life of survivors of childhood cancer .
The concept of QoL is mostly based on literature concerning adults . The World Health Organization defines QoL as “the individuals’ perceptions of their position in life in the context of the culture and value systems in which they live and in relation to their goals, expectations, standards and concerns” . QoL is a broad concept of general well-being, broader than health related quality of life (HRQoL) that is more specific and refers to the impact of health and illness [2, 3, 5]. However, the perceptions of children and young people of their health and QoL differ from those of adults. Important factors in relation to QoL for young people are developmental stage and relationships with friends and family . It is also well known that children and parents rate the child’s health and QoL differently. Measuring children’s QoL by asking parents or another proxy respondent can only supplement but not replace responses from the child him/herself [6–8]. Furthermore, the concept of QoL reflects the views of the individual (WHO, 1998) and thus the individual, in this case a child or a young person, should as far as possible rate his/her own QoL.
Various generic or disease-specific instruments exist for measuring QoL or HRQoL among children and adolescents [9, 10] and in recent years there has been an increase in the number of instruments, particularly disease-specific instruments . Examples of generic instruments are the Child Health Questionnaire (CHQ-87), the PedsQL 4.0 and the KIDSCREEN-52 questionnaire [9, 11]. Examples of instruments developed as disease-specific are the Pediatric Oncology Quality of Life scale (POQOL), PedsQL 3.0 cancer module and the Minneapolis-Manchester Quality of Life instruments (MMQL) , however these instruments have also proved to capture generic aspects of QoL and HRQoL . Generic instruments allow comparison between groups, such as cancer survivors and the general population, and across different conditions or settings. If the objective is to measure the impact of illness on a person’s life, generic instruments lack the sensitivity and may not adequately cover specific concerns for, for example, cancer [2, 10].
When assessing the HRQoL of children, their perception of health and QoL, their developmental changes and their cognitive function, are factors that should be considered [3, 6]. Savage et al.  found three disease-specific measures (MMQL-Youth Form, PedsQL™4.0, Pediatric Cancer Quality of Life-32) with sound psychometric properties in their review of QoL in children with acute lymphoblastic leukemia and only MMQL-Youth Form and PedsQL included age appropriate versions . The MMQL instrument has, in comparison with other health status and QoL instruments developed for children, proved to better capture the QoL perspective of health . Furthermore, the items used have a mainly positive phrasing, which is important for how each item is perceived and for the child’s experience of contributing to the questionnaire .
The MMQL instrument was developed in three versions to meet developmental needs of different age groups and is based on extensive exploratory work with children [12, 13]. The MMQL-Youth Form was created for evaluation of children (8–12 years of age)  and the MMQL-Adolescent Form for evaluation of adolescents (13–20 years of age)  surviving from cancer. There is also a version for adult individuals between 21–45 years of age [12, 14]. The questionnaire consists of 4 subscales in the Youth Form , and of 7 subscales in the Adolescent Form . Internal consistency reliability has been reported for the MMQL-Youth Form (overall alpha = 0.85, range 0.72 - 0.80) , and for the MMQL-Adolescent Form (overall alpha = 0.92, range 0.67 - 0.89) . The test-retest reliability has been reported for MMQL-Youth Form as ranging from 0.56 to 0.79 and for the total scale as 0.72 , and for the MMQL-Adolescent Form ranging from 0.60 to 0.90 and for the total scale as 0.71 .
The MMQL-instrument has been used in surveys in the United States [14, 15], the UK  and in Denmark . In the UK they performed an adaptation of the MMQL instrument with healthy children, children with chronic conditions and children with cancer between 8–18 years of age  and the Danish version of the MMQL-instrument was used in a survey with survivors of childhood brain tumors . Wu et al.  compared adolescents with cancer, off-therapy survivors and patients on therapy, with healthy controls. They selected the MMQL instrument because they found the items generic enough to be administered in its entirety on healthy controls . Thus, as the MMQL instrument has been applied to numerous conditions involving both healthy children and children affected by or with experience from disease [6, 15, 16] it can be used for evaluation of generic aspects of health. According to Streiner and Norman  a questionnaire must be re-evaluated when it is used on a different sample or when it is translated into another language. The aim of this study was thus to evaluate the psychometric properties of the Swedish version of MMQL-Youth Form and the Adolescent Form on school children focusing on: 1) face and content validity 2) the internal consistency and 3) the test-retest reliability.
Design and settings
The present study had a methodological design where the translated version of the MMQL-Youth Form and Adolescent Form was psychometrically tested. The study design was approved by the local ethics board at Halmstad University (Dnr 90-2011-2863) and the principals at the participating schools. Data collection was carried out during autumn 2011 in a sample of primary schools in western Sweden.
The MMQL-Youth Form is a 32-item self-rating questionnaire and consists of four quality of life domains (subscales); physical symptoms, physical functioning, psychological functioning and outlook on life/family dynamics . The MMQL-Adolescent Form is a 45-item self-rating questionnaire and consists of seven quality on life domains (subscales); physical functioning, cognitive functioning, psychological functioning, body image, social functioning, intimate relations and outlook on life . The items in both the MMQL-Youth Form and the Adolescent Form have a 4 or 5 point Likert scale and higher scores indicate greater HRQoL [12, 13].
The original versions of MMQL-Youth Form and Adolescent Form were translated into Swedish, according to forward-backward methodology [19, 20]. Two researchers, both native Swedish speakers and fluent in English, translated the questionnaire to Swedish and then a third researcher, a native English speaker, also fluent in both languages, with no previous knowledge of the original questionnaire, retranslated it into English. The small differences between the original version and the retranslated version, which were of a cultural and linguistic nature, were then discussed in the research group in order to improve the quality of the Swedish translation and to reach consensus. The items in the Swedish version were then discussed in the research group as well as with 20 children between 8–15 years of age, both girls and boys. The phrasing of some of the items was further adjusted based on feedback from the children who had found these to be vague or confusing.
Recruitment and data collection
Children from two age groups, 6th year of primary school and 9th year of primary school, were recruited from seven schools in a municipality of 92 000 inhabitants. In the municipality approximately 14% of the population was foreign-born, the unemployment rate was 7%, while 9% of the inhabitants received sickness benefits or activity compensation and about 1300 individuals received welfare benefits (Statistics Sweden, 2011). There are 42 schools in the municipality. The schools included in the study were located in central and suburban areas of the municipality, had children in both 6th and 9th year age groups and more than 100 children in total. Seven schools met the inclusion criteria and were selected for inclusion in the study. The included schools also represent different socio-demographic area in the municipality; low-and high-income earners, a variety of housing and domestic-and foreign-born inhabitants. A total of 24 classes in 6th year (n = 536 children) and 25 classes in 9th year (n = 576 children) were included. The principals at each school were contacted for approval for the participation and parents were then informed about the purpose and structure of the study. Participation was voluntary and if children or their parents declined to participate, they could decide not to fill in the questionnaire without having to explain why. The questionnaires, including a return envelope, were distributed to the respondents after information was given in the class room. Children who declined to participate returned the questionnaire without providing details. The questionnaire was completed directly and collected by the researcher, except for two schools where the teachers distributed and collected the questionnaires in return envelopes.
The sample consisted of 950 respondents (469 in 6th year and 481 in 9th year), who agreed to participate and completed the questionnaires (response rate 88% and 84% respectively). For demographic characteristics of the sample see Table 1. For test-retest evaluation two weeks later, questionnaires were administrated by teachers to the children in 13 of the 49 classes. A total of 127 children in 6th year and 163 children in 9th year were asked to complete the questionnaire a second time (response rate 87% and 74% respectively).
The MMQL-Youth Form and Adolescent Form were next examined for face and content validity, internal consistency and test-retest reliability. All the respondents who completed the questionnaire were also asked to evaluate the questions for clarity and readability in order to ascertain face and content validity . Cronbach’s alpha coefficient was used to calculate the internal consistency of the two questionnaires and the subscales and was deemed acceptable if alpha ≥ .70 was achieved . Intraclass Correlation Coefficients (ICC) were calculated for each item in the instrument in order to investigate test-retest reliability. The ICC produces a value of 1.0 only when the scores on the first occasion are exactly the same as those on the second occasion. The reference values for the levels of agreement consider < 0.20 as poor agreement, between 0.21-0.40 as fair, 0.41-0.60 as moderate, 0.61-0.80 as good and between 0.81-1.00 as very good agreement . Statistical analyses were performed using the SPSS software 20.0 (SPSS Inc. Chicago, IL, USA).
The results concerning the face and content validity showed that the respondents understood the statements in the questionnaire and assessed that they had sufficient clarity and readability. Furthermore they evaluated the items as being relevant for the focus of the measure, for example one respondent wrote “It’s good that the questions are about how one feels about one’s health”.
The Cronbach’ s alpha coefficient for the total scale was 0.88 for the MMQL-Youth Form (subscales from 0.66 to 0.81) and 0.92 for the MMQL-Adolescent Form (subscales from 0.69 to .91) (Table 2).
The test-retest reliability according to ICC ranged from 0.43 - 0.78 for the original instrument MMQL – Youth Form (Table 3). Sixteen of the items (50%) showed good agreement and the remaining 16 items showed moderate agreement between the two occasions.
The ICC for the MMQL – Adolescent Form ranged from 0.24 - 0.76 (Table 4). Ten of the items (22%) showed good agreement, 26 items (58%) showed moderate agreement and 9 items (20%) showed fair agreement between the two occasions.
This study assessed the psychometric properties of the Swedish version of the MMQL-Youth Form and Adolescent Form in a sample of Swedish children from 6th and 9th years in seven primary schools in a county in western Sweden. The results in the present study indicate that the Swedish versions of the MMQL-Youth Form and Adolescent Form are valid instrument for self-report measurement of Swedish children’s HRQoL. The questionnaires were validated in terms of face and content validity and participating children appraised that the items were relevant and that the questionnaires had sufficient clarity and readability. Children should be involved in instrument development and validation  and an explanation for why respondents felt the questionnaires easy to understand and to fill out could be that 20 children were involved in the translation and interpretation procedure. A strength in the present study is that the sample was large and diverse with regard to socioeconomic background by including children from schools in different neighborhoods and that the response rate was high. A reason for the high response rate could be that researchers stayed in the classroom during the data collection and informed the children about the objectives of the study. Informants gave positive responses on participation like, “it feels good to be able to help in such things”.
The internal consistency of the MMQL-Youth Form in this sample was found to be acceptable for the total scale with an alpha coefficient of 0.88. This Cronbach’s alpha value is quite similar to the first test of Cronbach’s alpha by Bhatia et al. . An exception in the present study is the subscale Physical Functioning with an alpha coefficient of 0.66, not attaining the acceptable alpha of 0.70. In the first test by Bhatia et al.  this subscale reached an alpha coefficient of 0.78. A reason for this discrepancy could be that the respondents in the present study were healthy children and that some of the items are more valid when having an illness. A low internal consistency value on physical functioning has also been found in other studies with children  and future research will be important to investigate if internal consistency differs in samples of children affected by disease. The internal consistency of the MMQL-Youth Form in the present study is comparable with other instruments such as PedsQL™ and the European KIDSCREEN-52 for the measurement of HRQoL for children [11, 24]. The stability of the scale over time with a two-week span that is deemed to be suitable for assessing the stability of a questionnaire  showed that 50% of the items in the MMQL-Youth Form demonstrated good agreement and 50% moderate agreement between the test and retest. The ICC values for the MMQL-Youth Form in the first test by Bhatia et al.  also showed moderate to good agreement between the test and retest (ICC ranged from 0.56- 0.79). The ICC values for the KIDSCREEN-52 ranged from 0.56-0.77  which is quite similar to the ICC values in the test of MMQL-Youth Form by Bhatia et al.  and in the present study.
Both Bhatia et al.  and Shankar et al.  administered the questionnaire MMQL-Youth Form to the children (8 to 12 years old) in the form of face-to-face interviews. In the present study children were in the 6th year of primary school and completed the MMQL-Youth Form by themselves. However, researchers and/or teachers were present in the classroom and when needed could explain the items for the children. Our procedure shows that it is feasible to let the children in this age group answering the questionnaire independently when they have the possibility to have the items explained. This is supported in a review by Riley  who found that children in this age group can successfully self-report age-appropriate health related quality of life questionnaires. Whether also younger children (8 to 10 years old) can complete the MMQL-Youth Form independently and what support is needed for this could be the focus of future studies. Interview-administered questionnaires can be applied when the children are unable to read or write and can have some advantages. The number of items omitted can be reduced and the interviewer has the possibility of rephrasing the question or to probing for a more complete response . However, more time and cost efficient alternatives of administration, like the one described here, increase the usefulness of the instrument.
The internal consistency of the MMQL-Adolescent Form in this sample was found to be acceptable for the total scale as well as for the subscales. The alpha coefficient of 0.92 for the total scale is indicating a high level of reliability and is the same as for the first test by Bhatia et al. . The internal consistency of the Adolescent Form in the present study can be compared with other instruments for measurement of HRQoL for similar age group such as the CHQ-CF instrument with an alpha coefficient between 0.69-0.92 for the subscales . The stability of the scale over time with a two-week span showed that the ICC ranged between 0.248 and 0.763, with 80% of the items having moderate or good agreement and 20% fair agreement between the test and retest. In the test of the MMQL-Adolescent Form by Bhatia et al.  the ICC score ranged between 0.60 – 0.90 for the subscales. ICC values for each item are, to our knowledge, not available . Having only a fair agreement level for some items may be due to a number of issues, for example, changing perceptions of informants between the first and second measurement. Conditions that may change over short intervals are, for example, anxiety, mood or pain [18, 22]. This could thus indicate that the instrument is sensitive to changes and that a low ICC value does not necessarily mean that the instrument is unstable. This explanation is supported by the fact that feelings appear to change quickly among adolescents dependent on what happens in their everyday life . There is thus a need for further research of stability of the Swedish version of MMQL-Adolescent Form.
Some methodological considerations should be discussed. The ICC values were only fair for some subscales in the MMQL-Adolescent Form, it can be seen as a strength that the instrument captures mild changes over time. However, the results would have been strengthened if the children taking part in the retest were asked to respond to whether they felt better, worse or the same. Then the test-retest reliability could have been evaluated based on the children who reported no change in wellbeing. Future studies comparing children reporting change or no change in wellbeing within a short time frame would be important to evaluate the responsiveness of the instrument to mild changes. Evaluating the discriminate validity was beyond the scope of this study. In another study the instruments were able to distinguish between HRQoL in children with different age, gender and socio-economic conditions both for MMQL-Youth Form as well as for MMQL-Adolescent Form (unpublished observation, Hutton et al., submitted April 2013). Additional studies including children with different diagnosis i.e. cancer will be required to establish if the instrument is reliable and valid for subjects with different conditions especially if combined with a construct validity evaluation.
In conclusion, the present study of the psychometric properties of the Swedish versions of the MMQL-Youth Form and the Adolescent Form shows that the Swedish versions are valid and reliable in this age group (11–16 years old) and in the context of healthy school children. The original development of the both instruments is based on extensive exploratory work with the focus of investigating the long term effects on HRQoL of children with experience of cancer. Sound psychometric properties in this study support the use of the MMQL instrument in healthy populations and thus also in studies of children who return to a normal life upon cancer survival. It is recommended that our studies are extended to investigate the instrument among diverse samples of children to evaluate its usefulness in clinical settings to assess health care and to identify children in need of support. It would also be of interest to perform correlation studies to test if QoL correlates with other dimensions of health.
Written informed consent was obtained from the patient for publication of this report and any accompanying images.
Gustavsson G, Heyman M, Vernby Å: Childhood Cancer Incidence and Survival in Sweden 1984–2005. Report 2007 From the Swedish Childhood Cancer Registry. Stockholm: Karolinska Institutet; 2007:2007.
Eiser C: Beyond survival: quality of life and follow-up after childhood cancer. J Pediatr Psychol 2007, 32: 1140–1150. 10.1093/jpepsy/jsm052
Taylor RM, Gibson F, Franck LS: A concept analysis of health-related quality of life in young people with chronic illness. J Clin Nurs 2008, 17: 1823–1833. 10.1111/j.1365-2702.2008.02379.x
Health promotion glossary WHO/HPR/HEP/98.1. http://www.who.int/healthpromotion/about/HPR%20Glossary%201998.pdf
Farquhar M: Definitions of quality of life: a taxonomy. J Adv Nurs 1995, 22: 502–508. 10.1046/j.1365-2648.1995.22030502.x
Savage E, Riordan A, Hughes M: Quality of life in children with acute lymphoblastic leukaemia: a systematic review. Eur J Oncol Nurs 2009, 13: 36–48. 10.1016/j.ejon.2008.09.001
Eiser C, Jenney M: Measuring quality of life. Arch Dis Child 2007, 92: 348–350. 10.1136/adc.2005.086405
Speyer E, Herbinet A, Vuillemin A, Chastagner P, Briancon S: Agreement between children with cancer and their parents in reporting the child’s health-related quality of life during a stay at the hospital and at home. Child Care Health Dev 2009, 35: 489–495. 10.1111/j.1365-2214.2009.00972.x
Fayed N, Schiariti V, Bostan C, Cieza A, Klassen A: Health status and QOL instruments used in childhood cancer research: deciphering conceptual content using world health organization definitions. Quality of Life Research: an international journal of quality of life aspects of treatment, care and rehabilitation 2011, 20: 1247–1258. 10.1007/s11136-011-9851-5
Solans M, Pane S, Estrada MD, Serra-Sutton V, Berra S, Herdman M, Alonso J, Rajmil L: Health-related quality of life measurement in children and adolescents: a systematic review of generic and disease-specific instruments. Value in Health: the journal of the International Society for Pharmacoeconomics and Outcomes Research 2008, 11: 742–764. 10.1111/j.1524-4733.2007.00293.x
Ravens-Sieberer U, Gosch A, Rajmil L, Erhart M, Bruil J, Power M, Duer W, Auquier P, Cloetta B, Czemy L: The KIDSCREEN-52 quality of life measure for children and adolescents: psychometric results from a cross-cultural survey in 13 European countries. Value in Health: the journal of the International Society for Pharmacoeconomics and Outcomes Research 2008, 11: 645–658. 10.1111/j.1524-4733.2007.00291.x
Bhatia S, Jenney MEM, Bogue MK, Rockwood TH, Feusner JH, Friedman DL, Robison LL, Kane RL: The Minneapolis-Manchester quality of life instrument: reliability and validity of the adolescent form. J Clin Oncol 2002, 20: 4692–4698. 10.1200/JCO.2002.05.103
Bhatia S, Jenney MEM, Wu E, Bogue BMK, Rockwood TH, Feusner JH, Friedman DL, Robison LL, Kane RL: The Minneapolis-Manchester quality of life instrument: reliability and validity of the youth form. J Pediatr 2004, 145: 39–46. 10.1016/j.jpeds.2004.02.034
Shankar S, Robison L, Jenney MEM, Rockwood TH, Wu E, Feusner J, Friedman D, Kane RL, Bhatia S: Health-related quality of life in young survivors of childhood cancer using the minneapolis-manchester quality of life-youth form. Pediatrics 2005, 115: 435–442. 10.1542/peds.2004-0649
Wu E, Robison LL, Jenney ME, Rockwood TH, Feusner J, Friedman D, Kane RL, Bhatia S: Assessment of health-related quality of life of adolescent cancer patients using the minneapolis-manchester quality of life adolescent questionnaire. Pediatr Blood Cancer 2007, 48: 678–686. 10.1002/pbc.20874
Hutchings HA, Upton P, Cheung WY, Maddocks A, Eiser C, Williams JG, Russell IT, Jackson S, Jenney ME: Adaptation of the Manchester-Minneapolis quality of life instrument for use in the UK population. Arch Dis Child 2007, 92: 855–860. 10.1136/adc.2006.098947
Reimers TS, Mortensen EL, Nysom K, Schmiegelow K: Health-related quality of life in long-term survivors of childhood brain tumors. Pediatr Blood Cancer 2009, 53: 1086–1091. 10.1002/pbc.22122
Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. 4th edition. Oxford: Oxford University Press; 2008.
Cha ES, Kim KH, Erlen JA: Translation of scales in cross-cultural research: issues and techniques. J Adv Nurs 2007, 58: 386–395. 10.1111/j.1365-2648.2007.04242.x
Brislin RW: Back-translation for cross-cultural research. J Cross-Cultural Psychology 1970, 1: 185–216. 10.1177/135910457000100301
Polit DF, Beck CT: Essentials of nursing research: appraising evidence for nursing practice. 7, [updated] edn. Philadelphia PA: Wolters Kluwer Health/Lippincott Williams & Wilkins; 2010.
Burns N, Grove SK: The practice of nursing research: conduct, critique & utilization. 4th edition. Philadelphia: Saunders; 2001.
Raat H, Landgraf JM, Bonsel GJ, Gemke RJ, Essink-Bot ML: Reliability and validity of the child health questionnaire-child form (CHQ-CF87) in a Dutch adolescent population. Quality of Life Research: an international journal of quality of life aspects of treatment, care and rehabilitation 2002, 11: 575–581. 10.1023/A:1016393311799
Varni JW, Burwinkle TM, Seid M: The PedsQL 4.0 as a school population health measure: feasibility, reliability, and validity. Quality of Life Research: an international journal of quality of life aspects of treatment, care and rehabilitation 2006, 15: 203–215. 10.1007/s11136-005-1388-z
Riley AW: Evidence that school-age children can self-report on their health. Ambul Pediatr 2004, 4: 371–376. 10.1367/A03-178R.1
Raat H, Mangunkusumo RT, Landgraf JM, Kloek G, Brug J: Feasibility, reliability, and validity of adolescent health status measurement by the Child Health Questionnaire Child Form (CHQ-CF): internet administration compared with the standard paper version. Quality of Life Research: an international journal of quality of life aspects of treatment, care and rehabilitation 2007, 16: 675–685. 10.1007/s11136-006-9157-1
Wrangsjö B, Winberg Salomonsson M: Tonårstid: utveckling, problem och psykoterapeutisk behandling. 1. utg. edn. Stockholm: Natur och Kultur; 2006.
We thanks Ljungbergska Stiftelsen for the grants awarded in support of this study.
The authors declare that they have no competing interest.
All of the authors have contributed in this study with design and instrument development, data collection and interpretation of the results as well as contributed in article writing to the final version. The study was originally designed by PS and JN. The manuscript was drafted by E-LE with supervision of PS and JN. Critical revisions for significant intellectual content were made by all authors. All authors read and approved the final manuscript.
About this article
Cite this article
Einberg, EL., Kadrija, I., Brunt, D. et al. Psychometric evaluation of a Swedish version of Minneapolis-Manchester quality of life-youth form and adolescent form. Health Qual Life Outcomes 11, 79 (2013). https://doi.org/10.1186/1477-7525-11-79