Testing the performance of the ENRICHD Social Support Instrument in cardiac patients
© Vaglio et al; licensee BioMed Central Ltd. 2004
Received: 09 March 2004
Accepted: 13 May 2004
Published: 13 May 2004
Previous investigations suggest an important role of social support in the outcomes of patients treated for ischemic heart disease. The ENRICHD Social Support Instrument (ESSI) is a 7-item self-report survey that assesses social support. Validity and reliability of the ESSI, however, has not been formally tested in patients undergoing percutaneous coronary intervention (PCI).
The ESSI, along with the Short Form-36 (SF-36), was sequentially administered to a cohort of 271 patients undergoing PCI. The test-retest reliability was examined with an intra-class correlation coefficient by comparing scores among 174 patients who completed both instruments 5 and 6 months after their procedure. Internal reliability was assessed using Cronbach's alpha at the time of patients' baseline procedure. The concurrent validity of the ESSI was assessed by comparing scores between depressed (MHI-5 score < 44) vs. non-depressed patients. The correlation between the ESSI and the SF-36 Social Functioning sub-scale, an accepted measure of social functioning, was also examined.
Test-retest reliability showed no significant differences in mean scores among ESSI questionnaires administered 1 month apart (27.8+/-1.4 vs 27.8+/-1.5, p = 0.98). The intra-class correlation coefficient was 0.94 and Cronbach's alpha was 0.88. Mean ESSI scores were significantly lower among depressed vs. non-depressed patients (24.6+/-1.7 vs 27+/-1.4, p < 0.018) and a positive albeit modest correlation with social functioning was seen (r = 0.19, p = 0.002).
The ESSI appears to be a valid and reliable measure of social support in patients undergoing treatment for coronary artery disease. It may prove to be a valuable method of controlling for patient variability in outcomes studies where the outcomes are related to patients' social support.
Social support is broadly defined as the existence or availability of people on whom one can rely; people who let one know that they are cared about, valued, and loved . Lack of social support is associated with increased morbidity and mortality in patients with ischemic heart disease [2, 3]. Growing awareness of the importance of social support on cardiovascular outcomes has necessitated the development of instruments to measure social support. The ENRICHD Social Support Instrument (ESSI) is one such measure derived from questions on the Medical Outcomes Survey and earlier work examining the influences of social support [3–5]. The ESSI is a seven-item measure, used in recent clinical trials, that assesses the four defining attributes of social support: emotional, instrumental, informational, and appraisal [6, 7].
The ESSI has demonstrated acceptable internal consistency and has shown to correlate positively with other social support instruments and negatively with measures of depression [6, 8, 9]. Despite these scattered findings, the literature lacks a strong validation study of the questionnaire's psychometric properties. Therefore, our objective was to test the validity and reproducibility of the ESSI in patients undergoing percutaneous coronary intervention (PCI). In the absence of a "gold standard" for social support, the construct validity of the instrument was assessed by a series of comparisons of the ESSI with depression, social, mental, and physical functioning, disease-specific symptom severity, and quality of life. These analyses were undertaken to support the use of the ESSI when examining the relationship between social support and outcomes in cardiovascular disease.
Subjects and procedures
Participants in this study were from a consecutive cohort of PCI patients participating in the Post-revascularization REcovery StudieS (PRESS) at the Mid-America Heart Institute. The process of patient recruitment, mechanism, success and potential selection biases of baseline health status data collection have been previously described . In brief, 271 consecutive patients undergoing PCI from February to April 1999 were asked to participate in an observational research study documenting the recovery of their health status after coronary revascularization. Each consenting patient was administered a series of questionnaires at baseline and monthly thereafter for six months. During the 6-month recovery period, patients completed monthly a packet of self-report questionnaires identical to those at baseline, omitting the demographic information. These data were used to supplement an existing procedural database. Approval from the Saint Luke's Hospital Institutional Review Board was obtained prior to the beginning of this study.
ENRICHD Social Support Instrument (ESSI)
As noted previously, the ESSI is a seven-item, self-report measure used in the ENRICHD trial [6, 7]. Individual items are then summed for a total score, with higher scores indicating greater social support. During this study, data on patients' marital status were collected at baseline, but omitted in follow-up questionnaires to eliminate redundant collection. Therefore, baseline marital status was extrapolated to each survey period although actual follow-up data was not collected. The seven ESSI items are presented in the Appendix (see Table 3).
SF-36 Mental Health Index and Social Functioning subscale
The SF-36 is a well-known and widely used generic measure of health status. The 36 items cover eight domains including: physical functioning, social functioning, role-physical, role-emotional, mental health, vitality, bodily pain, and general health . For the purposes of this study, we examined the Mental and Physical Health Component Scores, and Social Functioning subscale, which is a measure of the individual's functioning as a member of society. We also used the Mental Health Index (MHI) subscale, which assesses the individual's level of depression. The MHI subscale has demonstrated validity as a depression screen when compared to the Diagnostic Interview Schedule (area under the receiver operating curve = 0.89) .
Seattle Angina Questionnaire (SAQ) – Angina Frequency and disease-specific Quality of Life
The SAQ is a valid, reliable and responsive disease-specific measure of health status for patients with coronary disease [13–16]. SAQ subscales used in this study were the angina frequency (SAQ-AF) and quality of life (SAQ-QOL) scales. The SAQ-AF measures the frequency of angina during the previous four weeks and the SAQ-QOL measures patients' perceptions of how their coronary disease impacts their quality of life. The SAQ-QOL has been found to be predictive of both 1-year mortality and 1-year hospital admission for acute coronary syndrome in univariate models. In addition, the SAQ-AF was a significant predictor of 1-year admission in adjusted multivariate models .
The internal consistency of the ESSI was calculated using Cronbach's α, which measures the dispersion of different items within a single domain . Reproducibility, or test-retest reliability of the instrument was examined using paired t-tests of the mean ESSI scores at months 5 and 6. The most distant time points after patients procedure were selected to capture a stable and consistent period patients' social support; a period during which transient changes in social support around the time of coronary revascularization should have dissolved. In addition, the intra-class correlation coefficient (ICC) also was used to assess test-retest reliability between months 5 and 6. The ICC ranges from 0 – 1 and describes the proportion of total score variability due to between person differences . Higher ICCs reflect greater reproducibility.
In the absence of a "gold standard" measure of social support, several constructs were examined to support the validity of the ESSI. We expected that ESSI scores among depressed patients would be lower than non-depressed patients. To define depression, we used the SF-36 MHI score where those patients with scores less than 44 were classified as depressed. To quantitatively assess construct validity, independent sample t-tests of baseline mean ESSI scores were compared among depressed versus non-depressed patients.
Concurrent and predictive validity were examined by calculating the correlation coefficient between the ESSI total score and the SF-36 Social Functioning subscale, the SF-36 Physical and Mental Component Scores, and the SAQ-QOL scale at baseline and 6-months post-revascularization. We anticipated positive associations between social support and social functioning, general, and disease-specific QOL at both time points.
The study population consisted of 271 patients ranging in age from 37 to 87 years old who underwent PCI to treat ischemic coronary artery disease. The mean patient age was 64.1 years old (SD = 11.2). The population consisted of 32.5% women and 5.9% minorities. Seventy-four percent (74 %) of the patients reported being married. The mean level of education was 12.4 years (SD = 2.0) with 72% of the cohort reported attending some college or vocational school. On average, patients were able to complete the ESSI in 2–3 minutes. Furthermore, the data collectors reported no complaints from patients about completing the instrument.
ESSI inter-item correlations
Test-retest analysis was used to compare mean scores of ESSIs administered at months 5 and 6 after PCI. These time points were selected because they were thought to represent post-procedural periods of relative medical stability. The mean score at month 5 was 28.5 ± 5.6 (M ± SD) and month 6 was 28.5 ± 5.8 (p = 0.98), indicating no significant differences in ESSI scores. The intra-class correlation coefficient was 0.94, reflecting excellent reproducibility.
Concurrent and predictive validity
At baseline, the mean ESSI score among depressed patients was 22.8 ± 4.6 while the non-depressed group mean score was 26 ± 4.3 (p < 0.001). Similarly, patients living alone had significantly lower scores (16 ± 5.1) vs. patients living with someone (20 ± 3.8; p < 0.001). The SF-36 Social Functioning subscale showed a statistically significant albeit modest correlation with the ESSI (r = 0.19, p = 0.002).
ESSI correlations with the SF-36 scales and the SAQ-QOL
Correlations at Baseline
SF-36 Social Functioning
(p = .001)
(p < .001)
(p = .040)
(p < .001)
(p = .029)
(p = .001)
Correlations 6-Months Post-Revascularization
SF-36 Social Functioning
(p < .001)
(p < .001)
(p = .004)
(p < .001)
(p = .008)
(p = .002)
The present study confirms the concurrent and predictive validity and utility of the ESSI as an index of social support for use with PCI patients. The internal and test-retest reliability exceeds the recommended level of 0.70 for group assessments . The ESSI also demonstrated a positive correlation with social functioning (r = 0.20) and demonstrated the anticipated relationship of significantly lower scores among those who were depressed or living alone. In addition, it correlated with symptom improvement and better general and disease-specific quality of life at both baseline and 6-months post-PCI.
The results also provide conceptual insight into the nature of social support. The majority of questions on the ESSI consider general feelings about being loved and valued rather than instrumental types of support. This supports the theory that social support is not a tally of actual supportive "services" rendered, but rather a patient's belief that others care about them and are available if needed . This trend can be seen when examining the inter-item correlations presented in Table 1. Two items in particular, questions four and seven, have considerably lower correlations with the other questions. Question four has instrumental overtones and asks "Is there someone available to help you with daily chores?" The weaker associations with these items support the contention that instrumental support is a distinct construct when compared with other types of support that impact patients' health and well-being.
This study has several design limitations that should be noted. First, baseline social support was measured using a self-report questionnaire at the time of PCI and patient responses were not substantiated with family members, as would have ideally been the case. Secondly, the size and diversity of the patient sample was limited. With 271 patients and only 6% minorities, drawn from a single region of the United States, the population number and make-up limits the ability to generalize these results to the general population.
ENRICHD Social Support Instrument
Is there someone avaliable to whom you can count on to listen to you when you need to talk?
A little of
Is there someone avaliable to you to give you good advice about a problem?
Is there someone avaliable to you who shows you love and affection?
Is there someone avaliable to help with daily chores?
Can you count on anyone to provide you with emotional support (talking over problems or helping you make a difficult decision)?
Do you have as much contact as you would like with someone you feel close to, someone in whom you can trust and confide in?
Are you currently married or living with a partner?
This project was supported, in part, by an unrestricted grant from Searle Pharmaceuticals and, in part, by R-01 HS11282-01 from the Agency for Healthcare Research and Quality.
- Sarason I., Levine, H., Basham, R., & Sarason, B.: Assessing Social Support: The social support questionnaire. Journal of Personality and Social Psychology 1983, 44: 127–139. 10.1037//0022-35126.96.36.199View ArticleGoogle Scholar
- Ahern DK, Gorkin L, Anderson JL, Tierney C, Hallstrom A, Ewart C, Capone RJ, Schron E, Kornfeld D, Herd JA, et al.: Biobehavioral variables and mortality or cardiac arrest in the Cardiac Arrhythmia Pilot Study (CAPS). Am J Cardiol 1990, 66: 59–62. 10.1016/0002-9149(90)90736-KPubMedView ArticleGoogle Scholar
- Gorkin L, Schron EB, Brooks MM, Wiklund I, Kellen J, Verter J, Schoenberger JA, Pawitan Y, Morris M, Shumaker S: Psychosocial predictors of mortality in the Cardiac Arrhythmia Suppression Trial-1 (CAST-1). Am J Cardiol 1993, 71: 263–267. 10.1016/0002-9149(93)90788-EPubMedView ArticleGoogle Scholar
- Berkman LF, Leo-Summers L, Horwitz RI: Emotional support and survival after myocardial infarction. A prospective, population-based study of the elderly. Ann Intern Med 1992, 117: 1003–1009.PubMedView ArticleGoogle Scholar
- Williams RB, Barefoot JC, Califf RM, Haney TL, Saunders WB, Pryor DB, Hlatky MA, Siegler IC, Mark DB: Prognostic importance of social and economic resources among medically treated patients with angiographically documented coronary artery disease. Jama 1992, 267: 520–524. 10.1001/jama.267.4.520PubMedView ArticleGoogle Scholar
- [No authors listed] Enhancing recovery in coronary heart disease patients (ENRICHD): study design and methods. The ENRICHD investigators Am Heart J 2000, 139: 1–9.Google Scholar
- Enhancing Recovery in Coronary Heart Disease (ENRICHD) study intervention: rationale and design Psychosom Med 2001, 63: 747–755.Google Scholar
- Blumenthal JA, Burg MM, Barefoot J, Williams RB, Haney T, Zimet G: Social support, type A behavior, and coronary artery disease. Psychosom Med 1987, 49: 331–340.PubMedView ArticleGoogle Scholar
- Beck A., Steer, R., & Garbin, M.: Psychometric properties of the depression inventory. Twenty-five years of evaluation. Clinical Psychology Review 1981, 8: 1003–1009.Google Scholar
- Spertus JA, Bliven BD, Farner M, Gillen A, Hewitt T, Jones P, McCallister BD: Integrating baseline health status data collection into the process of care. Jt Comm J Qual Improv 2001, 27: 369–380.PubMedGoogle Scholar
- McHorney CA, Ware J. E., Jr., Raczek AE: The MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Med Care 1993, 31: 247–263.PubMedView ArticleGoogle Scholar
- Berwick DM, Murphy JM, Goldman PA, Ware J. E., Jr., Barsky AJ, Weinstein MC: Performance of a five-item mental health screening test. Med Care 1991, 29: 169–176.PubMedView ArticleGoogle Scholar
- Deyo RA, Diehr P, Patrick DL: Reproducibility and responsiveness of health status measures. Statistics and strategies for evaluation. Control Clin Trials 1991, 12: 142S-158S.PubMedView ArticleGoogle Scholar
- Dougherty CM, Dewhurst T, Nichol WP, Spertus J: Comparison of three quality of life instruments in stable angina pectoris: Seattle Angina Questionnaire, Short Form Health Survey (SF-36), and Quality of Life Index-Cardiac Version III. J Clin Epidemiol 1998, 51: 569–575. 10.1016/S0895-4356(98)00028-6PubMedView ArticleGoogle Scholar
- Spertus JA, Winder JA, Dewhurst TA, Deyo RA, Fihn SD: Monitoring the quality of life in patients with coronary artery disease. Am J Cardiol 1994, 74: 1240–1244. 10.1016/0002-9149(94)90555-XPubMedView ArticleGoogle Scholar
- Spertus JA, Winder JA, Dewhurst TA, Deyo RA, Prodzinski J, McDonell M, Fihn SD: Development and evaluation of the Seattle Angina Questionnaire: a new functional status measure for coronary artery disease. J Am Coll Cardiol 1995, 25: 333–341. 10.1016/0735-1097(94)00397-9PubMedView ArticleGoogle Scholar
- Spertus JA, Jones P, McDonell M, Fan V, Fihn SD: Health status predicts long-term outcome in outpatients with coronary disease. Circulation 2002, 106: 43–49. 10.1161/01.CIR.0000020688.24874.90PubMedView ArticleGoogle Scholar
- Goodger B, Byles J, Higganbotham N, Mishra G: Assessment of a short scale to measure social support among older people. Aust N Z J Public Health 1999, 23: 260–265.PubMedView ArticleGoogle Scholar
- Streiner D. & Norman, G.: Health measurement scales: a practical guide to their development and use. Oxford, Oxford University Press 1991.Google Scholar
- Langford CP, Bowsher J, Maloney JP, Lillis PP: Social support: a conceptual analysis. J Adv Nurs 1997, 25: 95–100. 10.1046/j.1365-2648.1997.1997025095.xPubMedView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.