Testing the performance of the ENRICHD Social Support Instrument in cardiac patients
Health and Quality of Life Outcomes volume 2, Article number: 24 (2004)
Previous investigations suggest an important role of social support in the outcomes of patients treated for ischemic heart disease. The ENRICHD Social Support Instrument (ESSI) is a 7-item self-report survey that assesses social support. Validity and reliability of the ESSI, however, has not been formally tested in patients undergoing percutaneous coronary intervention (PCI).
The ESSI, along with the Short Form-36 (SF-36), was sequentially administered to a cohort of 271 patients undergoing PCI. The test-retest reliability was examined with an intra-class correlation coefficient by comparing scores among 174 patients who completed both instruments 5 and 6 months after their procedure. Internal reliability was assessed using Cronbach's alpha at the time of patients' baseline procedure. The concurrent validity of the ESSI was assessed by comparing scores between depressed (MHI-5 score < 44) vs. non-depressed patients. The correlation between the ESSI and the SF-36 Social Functioning sub-scale, an accepted measure of social functioning, was also examined.
Test-retest reliability showed no significant differences in mean scores among ESSI questionnaires administered 1 month apart (27.8+/-1.4 vs 27.8+/-1.5, p = 0.98). The intra-class correlation coefficient was 0.94 and Cronbach's alpha was 0.88. Mean ESSI scores were significantly lower among depressed vs. non-depressed patients (24.6+/-1.7 vs 27+/-1.4, p < 0.018) and a positive albeit modest correlation with social functioning was seen (r = 0.19, p = 0.002).
The ESSI appears to be a valid and reliable measure of social support in patients undergoing treatment for coronary artery disease. It may prove to be a valuable method of controlling for patient variability in outcomes studies where the outcomes are related to patients' social support.
Social support is broadly defined as the existence or availability of people on whom one can rely; people who let one know that they are cared about, valued, and loved . Lack of social support is associated with increased morbidity and mortality in patients with ischemic heart disease [2, 3]. Growing awareness of the importance of social support on cardiovascular outcomes has necessitated the development of instruments to measure social support. The ENRICHD Social Support Instrument (ESSI) is one such measure derived from questions on the Medical Outcomes Survey and earlier work examining the influences of social support [3–5]. The ESSI is a seven-item measure, used in recent clinical trials, that assesses the four defining attributes of social support: emotional, instrumental, informational, and appraisal [6, 7].
The ESSI has demonstrated acceptable internal consistency and has shown to correlate positively with other social support instruments and negatively with measures of depression [6, 8, 9]. Despite these scattered findings, the literature lacks a strong validation study of the questionnaire's psychometric properties. Therefore, our objective was to test the validity and reproducibility of the ESSI in patients undergoing percutaneous coronary intervention (PCI). In the absence of a "gold standard" for social support, the construct validity of the instrument was assessed by a series of comparisons of the ESSI with depression, social, mental, and physical functioning, disease-specific symptom severity, and quality of life. These analyses were undertaken to support the use of the ESSI when examining the relationship between social support and outcomes in cardiovascular disease.
Subjects and procedures
Participants in this study were from a consecutive cohort of PCI patients participating in the Post-revascularization REcovery StudieS (PRESS) at the Mid-America Heart Institute. The process of patient recruitment, mechanism, success and potential selection biases of baseline health status data collection have been previously described . In brief, 271 consecutive patients undergoing PCI from February to April 1999 were asked to participate in an observational research study documenting the recovery of their health status after coronary revascularization. Each consenting patient was administered a series of questionnaires at baseline and monthly thereafter for six months. During the 6-month recovery period, patients completed monthly a packet of self-report questionnaires identical to those at baseline, omitting the demographic information. These data were used to supplement an existing procedural database. Approval from the Saint Luke's Hospital Institutional Review Board was obtained prior to the beginning of this study.
ENRICHD Social Support Instrument (ESSI)
As noted previously, the ESSI is a seven-item, self-report measure used in the ENRICHD trial [6, 7]. Individual items are then summed for a total score, with higher scores indicating greater social support. During this study, data on patients' marital status were collected at baseline, but omitted in follow-up questionnaires to eliminate redundant collection. Therefore, baseline marital status was extrapolated to each survey period although actual follow-up data was not collected. The seven ESSI items are presented in the Appendix (see Table 3).
SF-36 Mental Health Index and Social Functioning subscale
The SF-36 is a well-known and widely used generic measure of health status. The 36 items cover eight domains including: physical functioning, social functioning, role-physical, role-emotional, mental health, vitality, bodily pain, and general health . For the purposes of this study, we examined the Mental and Physical Health Component Scores, and Social Functioning subscale, which is a measure of the individual's functioning as a member of society. We also used the Mental Health Index (MHI) subscale, which assesses the individual's level of depression. The MHI subscale has demonstrated validity as a depression screen when compared to the Diagnostic Interview Schedule (area under the receiver operating curve = 0.89) .
Seattle Angina Questionnaire (SAQ) – Angina Frequency and disease-specific Quality of Life
The SAQ is a valid, reliable and responsive disease-specific measure of health status for patients with coronary disease [13–16]. SAQ subscales used in this study were the angina frequency (SAQ-AF) and quality of life (SAQ-QOL) scales. The SAQ-AF measures the frequency of angina during the previous four weeks and the SAQ-QOL measures patients' perceptions of how their coronary disease impacts their quality of life. The SAQ-QOL has been found to be predictive of both 1-year mortality and 1-year hospital admission for acute coronary syndrome in univariate models. In addition, the SAQ-AF was a significant predictor of 1-year admission in adjusted multivariate models .
The internal consistency of the ESSI was calculated using Cronbach's α, which measures the dispersion of different items within a single domain . Reproducibility, or test-retest reliability of the instrument was examined using paired t-tests of the mean ESSI scores at months 5 and 6. The most distant time points after patients procedure were selected to capture a stable and consistent period patients' social support; a period during which transient changes in social support around the time of coronary revascularization should have dissolved. In addition, the intra-class correlation coefficient (ICC) also was used to assess test-retest reliability between months 5 and 6. The ICC ranges from 0 – 1 and describes the proportion of total score variability due to between person differences . Higher ICCs reflect greater reproducibility.
In the absence of a "gold standard" measure of social support, several constructs were examined to support the validity of the ESSI. We expected that ESSI scores among depressed patients would be lower than non-depressed patients. To define depression, we used the SF-36 MHI score where those patients with scores less than 44 were classified as depressed. To quantitatively assess construct validity, independent sample t-tests of baseline mean ESSI scores were compared among depressed versus non-depressed patients.
Concurrent and predictive validity were examined by calculating the correlation coefficient between the ESSI total score and the SF-36 Social Functioning subscale, the SF-36 Physical and Mental Component Scores, and the SAQ-QOL scale at baseline and 6-months post-revascularization. We anticipated positive associations between social support and social functioning, general, and disease-specific QOL at both time points.
The study population consisted of 271 patients ranging in age from 37 to 87 years old who underwent PCI to treat ischemic coronary artery disease. The mean patient age was 64.1 years old (SD = 11.2). The population consisted of 32.5% women and 5.9% minorities. Seventy-four percent (74 %) of the patients reported being married. The mean level of education was 12.4 years (SD = 2.0) with 72% of the cohort reported attending some college or vocational school. On average, patients were able to complete the ESSI in 2–3 minutes. Furthermore, the data collectors reported no complaints from patients about completing the instrument.
Internal consistency for the ESSI, using Cronbach's α, was 0.88. The inter-item correlations were examined, with significant associations being found between all items and item-total score (p < 0.001). However, question 7 (patient's marital status) consistently had the lowest correlation with the other ESSI items and total score. These results are presented in Table 1.
Test-retest analysis was used to compare mean scores of ESSIs administered at months 5 and 6 after PCI. These time points were selected because they were thought to represent post-procedural periods of relative medical stability. The mean score at month 5 was 28.5 ± 5.6 (M ± SD) and month 6 was 28.5 ± 5.8 (p = 0.98), indicating no significant differences in ESSI scores. The intra-class correlation coefficient was 0.94, reflecting excellent reproducibility.
Concurrent and predictive validity
At baseline, the mean ESSI score among depressed patients was 22.8 ± 4.6 while the non-depressed group mean score was 26 ± 4.3 (p < 0.001). Similarly, patients living alone had significantly lower scores (16 ± 5.1) vs. patients living with someone (20 ± 3.8; p < 0.001). The SF-36 Social Functioning subscale showed a statistically significant albeit modest correlation with the ESSI (r = 0.19, p = 0.002).
Concurrent and predictive validity also was assessed by examining the correlations between the ESSI total score and the SF-36 Social Functioning, Mental Health Index, Mental Component, and Physical Component scales and the SAQ-QOL scale at both baseline and 6-months post-PCI. As can be seen in Table 2, the ESSI demonstrated modest, but statistically significant correlations with these measures at both time points. This suggests that patients with greater social support also experience better social functioning, improved symptom control, and better general and disease-specific quality of life.
The present study confirms the concurrent and predictive validity and utility of the ESSI as an index of social support for use with PCI patients. The internal and test-retest reliability exceeds the recommended level of 0.70 for group assessments . The ESSI also demonstrated a positive correlation with social functioning (r = 0.20) and demonstrated the anticipated relationship of significantly lower scores among those who were depressed or living alone. In addition, it correlated with symptom improvement and better general and disease-specific quality of life at both baseline and 6-months post-PCI.
The results also provide conceptual insight into the nature of social support. The majority of questions on the ESSI consider general feelings about being loved and valued rather than instrumental types of support. This supports the theory that social support is not a tally of actual supportive "services" rendered, but rather a patient's belief that others care about them and are available if needed . This trend can be seen when examining the inter-item correlations presented in Table 1. Two items in particular, questions four and seven, have considerably lower correlations with the other questions. Question four has instrumental overtones and asks "Is there someone available to help you with daily chores?" The weaker associations with these items support the contention that instrumental support is a distinct construct when compared with other types of support that impact patients' health and well-being.
This study has several design limitations that should be noted. First, baseline social support was measured using a self-report questionnaire at the time of PCI and patient responses were not substantiated with family members, as would have ideally been the case. Secondly, the size and diversity of the patient sample was limited. With 271 patients and only 6% minorities, drawn from a single region of the United States, the population number and make-up limits the ability to generalize these results to the general population.
Despite these limitations, the results confirm the reliability and validity of the ESSI for gathering social support data among PCI patients. This study supports it's use in outcomes research that may help define the role of social support in affecting health outcomes. With psychometrically validated instruments in hand, future researchers should further elucidate the effects of social support on health and recovery in cardiac patients.
Sarason I., Levine, H., Basham, R., & Sarason, B.: Assessing Social Support: The social support questionnaire. Journal of Personality and Social Psychology 1983, 44: 127–139. 10.1037//0022-35188.8.131.52
Ahern DK, Gorkin L, Anderson JL, Tierney C, Hallstrom A, Ewart C, Capone RJ, Schron E, Kornfeld D, Herd JA, et al.: Biobehavioral variables and mortality or cardiac arrest in the Cardiac Arrhythmia Pilot Study (CAPS). Am J Cardiol 1990, 66: 59–62. 10.1016/0002-9149(90)90736-K
Gorkin L, Schron EB, Brooks MM, Wiklund I, Kellen J, Verter J, Schoenberger JA, Pawitan Y, Morris M, Shumaker S: Psychosocial predictors of mortality in the Cardiac Arrhythmia Suppression Trial-1 (CAST-1). Am J Cardiol 1993, 71: 263–267. 10.1016/0002-9149(93)90788-E
Berkman LF, Leo-Summers L, Horwitz RI: Emotional support and survival after myocardial infarction. A prospective, population-based study of the elderly. Ann Intern Med 1992, 117: 1003–1009.
Williams RB, Barefoot JC, Califf RM, Haney TL, Saunders WB, Pryor DB, Hlatky MA, Siegler IC, Mark DB: Prognostic importance of social and economic resources among medically treated patients with angiographically documented coronary artery disease. Jama 1992, 267: 520–524. 10.1001/jama.267.4.520
[No authors listed] Enhancing recovery in coronary heart disease patients (ENRICHD): study design and methods. The ENRICHD investigators Am Heart J 2000, 139: 1–9.
Enhancing Recovery in Coronary Heart Disease (ENRICHD) study intervention: rationale and design Psychosom Med 2001, 63: 747–755.
Blumenthal JA, Burg MM, Barefoot J, Williams RB, Haney T, Zimet G: Social support, type A behavior, and coronary artery disease. Psychosom Med 1987, 49: 331–340.
Beck A., Steer, R., & Garbin, M.: Psychometric properties of the depression inventory. Twenty-five years of evaluation. Clinical Psychology Review 1981, 8: 1003–1009.
Spertus JA, Bliven BD, Farner M, Gillen A, Hewitt T, Jones P, McCallister BD: Integrating baseline health status data collection into the process of care. Jt Comm J Qual Improv 2001, 27: 369–380.
McHorney CA, Ware J. E., Jr., Raczek AE: The MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Med Care 1993, 31: 247–263.
Berwick DM, Murphy JM, Goldman PA, Ware J. E., Jr., Barsky AJ, Weinstein MC: Performance of a five-item mental health screening test. Med Care 1991, 29: 169–176.
Deyo RA, Diehr P, Patrick DL: Reproducibility and responsiveness of health status measures. Statistics and strategies for evaluation. Control Clin Trials 1991, 12: 142S-158S.
Dougherty CM, Dewhurst T, Nichol WP, Spertus J: Comparison of three quality of life instruments in stable angina pectoris: Seattle Angina Questionnaire, Short Form Health Survey (SF-36), and Quality of Life Index-Cardiac Version III. J Clin Epidemiol 1998, 51: 569–575. 10.1016/S0895-4356(98)00028-6
Spertus JA, Winder JA, Dewhurst TA, Deyo RA, Fihn SD: Monitoring the quality of life in patients with coronary artery disease. Am J Cardiol 1994, 74: 1240–1244. 10.1016/0002-9149(94)90555-X
Spertus JA, Winder JA, Dewhurst TA, Deyo RA, Prodzinski J, McDonell M, Fihn SD: Development and evaluation of the Seattle Angina Questionnaire: a new functional status measure for coronary artery disease. J Am Coll Cardiol 1995, 25: 333–341. 10.1016/0735-1097(94)00397-9
Spertus JA, Jones P, McDonell M, Fan V, Fihn SD: Health status predicts long-term outcome in outpatients with coronary disease. Circulation 2002, 106: 43–49. 10.1161/01.CIR.0000020688.24874.90
Goodger B, Byles J, Higganbotham N, Mishra G: Assessment of a short scale to measure social support among older people. Aust N Z J Public Health 1999, 23: 260–265.
Streiner D. & Norman, G.: Health measurement scales: a practical guide to their development and use. Oxford, Oxford University Press 1991.
Langford CP, Bowsher J, Maloney JP, Lillis PP: Social support: a conceptual analysis. J Adv Nurs 1997, 25: 95–100. 10.1046/j.1365-2648.1997.1997025095.x
This project was supported, in part, by an unrestricted grant from Searle Pharmaceuticals and, in part, by R-01 HS11282-01 from the Agency for Healthcare Research and Quality.
JV conceived the study and drafted the manuscript. MC participated in coordination of the study and statistical analyses. CP participated in design and coordination of this project. JO & KH contributed to the conception of the study. JH performed the statistical analysis. JS oversaw the execution of this project and edited the manuscript. All authors have read and approved the final manuscript.
About this article
Cite this article
Vaglio, J., Conard, M., Poston, W.S. et al. Testing the performance of the ENRICHD Social Support Instrument in cardiac patients. Health Qual Life Outcomes 2, 24 (2004). https://doi.org/10.1186/1477-7525-2-24