The validity of the MacNew Quality of Life in heart disease questionnaire
© Dempster et al; licensee BioMed Central Ltd. 2004
Received: 02 November 2003
Accepted: 22 January 2004
Published: 22 January 2004
A previous review suggested that the MacNew Quality of Life Questionnaire was the most appropriate disease-specific measure of health-related quality of life among people with ischaemic heart disease. However, there is ambiguity about the allocation of items to the three factors underlying the MacNew and the factor structure has not been confirmed previously among the people in the UK.
The MacNew Questionnaire and the SF-36 were administered to 117 newly admitted patients to a tertiary referral centre in Northern Ireland. All patients had been diagnosed with ischaemic heart disease.
A confirmatory factor analysis was conducted on the factor structure of the MacNew and the model was found to be an inadequate fit of the data. A quantitative and qualitative analysis of the items suggested that a five factor solution was more appropriate and this was validated by confirmatory factor analysis. This new structure also displayed strong evidence of concurrent validity when compared to the SF-36.
We recommend that researchers should submit scores obtained from items on the MacNew to secondary analyses after being grouped according to the factor structure proposed in this paper, in order to explore further the most appropriate grouping of items.
The goals of health and social care interventions in the field of ischaemic heart disease are placing increasing emphasis on patients' quality of life as well as quantity of life and an improvement in health-related quality of life (HRQoL) is often a stated goal of many cardiac rehabilitation programmes and secondary prevention strategies. The identification or measurement of change in HRQoL is, therefore, an important aspect of the evaluation of secondary prevention programmes in heart disease. Researchers have used several generic and disease-specific instruments in their attempts to index HRQoL – a review of the instruments used to measure HRQoL among people with ischaemic heart disease identified four generic instruments and nine disease-specific instruments . This review suggested, on the basis of the best available psychometric evidence, that the most appropriate generic and disease-specific measures of HRQoL for use among people with ischaemic heart disease were the Short Form 36 (SF-36)  and version two of the Quality of Life after Myocardial Infarction questionnaire (now referred to as the MacNew Quality of Life Questionnaire) , respectively.
Much has been written about the psychometric properties of the SF-36 and the results concerning the factor structure of this instrument appear to be fairly consistent (see Ware et al. ). Less psychometric information exists on the MacNew.
The MacNew is a revised version of the Quality of Life after Myocardial Infarction Questionnaire (QLMI)  and there is much difference between the two versions in terms of their suggested factor structure, even though the items on the two versions of this questionnaire are similar. The original QLMI questionnaire contained 26 items which were divided into five underlying scales or factors: self-esteem, restriction, fatigue, emotional function and confidence. The MacNew has 27 items reduced to three factors: social functioning, physical functioning and emotional functioning. The assignment of items to the factors underlying the MacNew was done on the basis of a factor analysis conducted by Valenti et al. . They suggested that two items in the original QLMI should be excluded and another item modified and they included three new items in the MacNew. However, the results of the factor analysis presented by Valenti et al. raise a couple of issues. Firstly, the three new items included in the MacNew increased the percentage variance explained by all the items from 65.8% to 66.5%. The benefit of the small increase in explanatory power appears to be outweighed by the lengthening of the questionnaire. Secondly, the attribution of items to factors is ambiguous. Certain items appear to be allocated to factors that do not have the highest factor loading for those items and with which there is a poor conceptual relationship. Furthermore, the factor structure of the MacNew has not been examined within the UK population.
It is essential that HRQoL instruments are valid and so there is a need to examine the content of the MacNew scales, in order to confirm (or not) the construct validity of this questionnaire. Therefore, the aim of the present paper was to test the factor structure of the MacNew among a group of patients from the UK with ischaemic heart disease.
Characteristics of Sample
Length of diagnosis of IHD (median(range))
6 months(2 days to 42 years)
84 males; 33 females
Reason for admission to hospital
37 myocardial infarction; 63 angina; 17 other
Canadian Cardiovascular Society Classification of Angina
43 class 0; 12 class I; 21 class II; 16 class III; 25 class IV
The MacNew questionnaire consists of 27 items, each with a 7 point response scale ranging from "all of the time" to "some of the time". Evidence exists to support the reliability, validity and sensitivity of this instrument and its original version (the QLMI) . The SF-36 consists of 36 items which are divided into eight dimensions: physical functioning, social functioning, general health, role limitations due to physical problems, role limitations due to emotional problems, bodily pain, vitality, and mental health. The psychometric properties of the SF-36 have been investigated in a variety of patient groups  and there is strong evidence for the reliability and validity of this instrument when used among people with ischaemic heart disease .
The patients who participated in the study were similar to patients from the UK with ischaemic heart disease in previous studies in terms of their age , sex  and BMI . The distribution of patients between the different classes of the CCSCA suggested that our group of patients had less severe angina than a group of patients undergoing angioplasty . This conforms to expectations.
Summary statistics for all scales.
SF-36 General health
SF-36 Physical functioning
SF-36 Role physical
SF-36 Role emotional
SF-36 Social functioning
SF-36 Bodily pain
SF-36 Mental health
(((actual raw score-lowest possible raw score)/possible raw score range) * 100).
The MacNew scores were transformed using this formula to facilitate comparisons between questionnaires. Patients had moderate to high scores on all scales except the SF-36 scales of vitality and role physical.
An initial confirmatory factor analysis on the MacNew was conducted, using LISREL 8.3 , in order to test the factor structure proposed by Valenti et al. Confirmatory factor analysis assesses the validity of a pre-specified factor model. In other words, this statistical procedure assesses whether or not (on the basis of the relationships between the items on a questionnaire) the suggested method of combining items into groups (which are supposed to represent underlying factors) is reasonable. The LISREL programme produces several goodness of fit indices, which are designed to provide a summary answer to the assessment just described. In essence these indices inform the researcher whether or not the suggested factor model is a good fit of the existing data. The goodness of fit of this model was assessed using the Root Mean Square Error of Approximation (RMSEA), as an alternative to chi-square. The chi-square statistic has been associated with sample size problems and distributional misspecifications [11, 12], hence the increasing reliance on alternative fit indices. One of the most popular and robust fit statistics used in conjunction with the chi-square is the RMSEA. Unlike the chi-square it is not affected by sample size. An adequately fitting model will have an RMSEA index between 0.00 and 0.06 with confidence intervals between 0.00 and 0.08 .
The factor structure proposed by Valenti et al. had a RMSEA = 0.092 (CI: 0.081 to 0.100). Therefore, this proposed structure did not provide a good fit of the data. Consequently, an exploratory factor analysis was conducted, in order to provide a suggestion about an adequate factor model. The exploratory factor analysis suggested six factors.
A content analysis of these factors was undertaken and the following points were noted. Firstly, factor 6 contained only one item – item 21 ("how often have you felt unsure as to how much exercise or physical activity you should be doing?"). During administration of the questionnaire, it had been recorded by the interviewer that this item did not appear to tap into the way heart disease had impacted on the person's HRQoL. Instead, it seemed to assess knowledge about the restrictions imposed by ischaemic heart disease. The factor analysis confirmed that this question did not relate well to any of the other items. Therefore, it was felt that this item should be excluded.
Secondly, there were several items that loaded heavily on more than one factor and a decision about how to deal with these items was based on the content analysis. It made sense, in terms of content validity, for these items to be grouped under the factor onto which they loaded heaviest. Therefore, to improve the content validity of the factors, it was decided that: item 12 should be grouped under factor 5; item 8 should be grouped under factor 3; item 13 should be grouped under factor 4. Item 23 loaded heavily on two factors and an analysis of its content suggested that it could sensibly be grouped with both of these factors. However, there was a problem with items 6 and 14. These items loaded onto factors that contained items which appeared to be dissimilar in content. In fact, both of these items appeared to be closer to all of the items that loaded onto factor 3.
Exploratory Factor analysis of the MacNew items.
Perception of others
4. Down in the dumps
15. Lack self-confidence
23. Burden on others
6. Worn out
17. Limited in exercise
26. Physically restricted
12. Social activities
16. Aching legs
9. Short of breath
22. Family overprotective
11. More dependent
13. Others' confidence
14. Chest pain
25. Unable to socialise
24. Felt excluded
Total variance explained
Total = 61.84%
Correlations between MacNew factors and SF-36 scales.
Proposed factors of MacNew
Perception of others
Existing factors of MacNew
The structure of the original QLMI questionnaire was altered by Valenti et al. , but this new structure has not been tested or confirmed within the UK population. A confirmatory factor analysis demonstrated that the factor structure proposed by Valenti et al. did not adequately fit our data and so we explored the data in order to determine the "best" factor model for the items on the questionnaire. Through a combination of quantitative and qualitative approaches one item was deleted and the remaining items were grouped into five factors – emotion, restrictions, physical symptoms, perception of others and social functioning. This proposed factor structure was confirmed as an adequate model by means of confirmatory factor analysis. This factor structure bore some similarity to the grouping of items on the original QLMI. For example, our restrictions and symptoms factors are similar to the restrictions and symptoms factors respectively, suggested by Hillers et al. , who developed the original QLMI and our emotion factor contains all the items on their original emotion factor. Hillers et al. did not conduct a factor analysis on their suggested factor structure, but obtained their structure by an extensive programme of item analysis and reduction. The analysis reported in this paper goes some way towards confirming the benefit and usefulness of their approach.
Furthermore, grouping the items into the structure suggested by the analysis reported here increased the correlations between the MacNew scales and relevant scales on the SF-36, when compared to the grouping of items suggested by Valenti et al. Thus, the proposed grouping of items suggested presently has stronger evidence of concurrent validity than that suggested by Valenti et al.
However, these findings need to be confirmed by new data and we would encourage others to re-analyse data obtained from the MacNew, using our proposed factor structure in order to test the model suggested. This is a worthwhile exercise to clarify the validity of this instrument, so that clinicians will be confident that they are accessing relevant and accurate information about how a patient's life is affected by ischaemic heart disease. Patients are likely to benefit if this information is accessible to clinicians as this will ensure that the specific factors which contribute to a person's HRQoL can be monitored and considered when treatment protocols are drafted, thereby enabling comprehensive and holistic treatments.
Improvements in the health-related quality of life of people with heart disease is an important consideration in the assessment of treatment effectiveness . The MacNew questionnaire is a reliable and valid method of assessing changes in health-related quality of life among this population. This exploratory study indicates that the grouping of items on this questionnaire may be modified and improved to provide more useful indicators of health-related quality of life.
- Dempster M, Donnelly M: Measuring health-related quality of life among people with ischaemic heart disease. Heart 2000, 83: 641–644. 10.1136/heart.83.6.641PubMed CentralPubMedView ArticleGoogle Scholar
- Ware JE, Snow KK, Kosinski MK, Gandek B: SF-36 Health Survey Manual and Interpretation Guide Boston: The Health Institute, New England Medical Center 1993.Google Scholar
- Valenti L, Lim L, Heller RF, Knapp J: An improved questionnaire for assessing quality of life after acute myocardial infarction. Qual Life Res 1996, 5: 151–161.PubMedView ArticleGoogle Scholar
- Ware JE, Snow KK, Kosinski MK, Gandek B: SF-36 Health Survey Manual and Interpretation Guide Boston: The Health Institute, New England Medical Center 1997.Google Scholar
- Hillers TK, Guyatt GH, Oldridge N, Crowe J, Willan A, Griffith L, Feeny D: Quality of life after myocardial infarction. J Clin Epidemiol 1994, 47: 1287–1296.PubMedView ArticleGoogle Scholar
- Hofer S, Lim LL, Guyatt GH, Oldridge NB: The MacNew Heart Disease health-related quality of life instrument: A summary. Health Qual Life Outcomes 2004., 2:3: Google Scholar
- Cupples M, McKnight A, O'Neill C, Normand C: The effect of personal health education on the quality of life of patients with angina in general practice. Health Educ J 1996, 55: 75–83.View ArticleGoogle Scholar
- Kee F, McDonald P, Gaffney B: Risks and benefits of coronary angioplasty: the patient's perspective: a preliminary study. Qual Health Care 1997, 6: 131–139.PubMed CentralPubMedView ArticleGoogle Scholar
- OXCHECK study group of the Imperial Cancer Research Fund: Effectiveness of health checks conducted by nurses in primary care: final results of the OXCHECK study. BMJ 1995, 310: 1099–1104.View ArticleGoogle Scholar
- Jöreskog KG, Sörbom D: LISREL 8.3 user's reference guide Mooresville, IN: Scientific Software 1999.Google Scholar
- Hu L, Bentler BM: Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 1999, 6: 1–55.View ArticleGoogle Scholar
- Fan X, Thompson B, Wang L: Effects of sample size, estimation methods, and model specification on structural equation modeling fit indexes. Structural Equation Modeling 1999, 6: 56–83.View ArticleGoogle Scholar
- Cupples ME, Dempster M: Improving quality of life for patients with angina pectoris: a team approach to disease management. Dis Manage Health Outcomes 2001, 9: 473–481.View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.