Psychometric evaluation of the sleep hygiene index: a sample of patients with chronic pain
© Cho et al.; licensee BioMed Central Ltd. 2013
Received: 17 May 2013
Accepted: 17 December 2013
Published: 22 December 2013
Sleep Hygiene Index (SHI) was designed to assess sleep hygiene. Although the SHI has shown adequate psychometric properties in a nonclinical sample, it has not been validated in a sample with chronic pain. Also, its factor structure, measurement error, and incremental validity over and above other factors affecting sleep quality have not been investigated in a nonclinical sample. Thus, this present study aimed to extend prior psychometric investigation of the SHI. Specifically, we evaluated the factor structure, measurement error, and incremental validity as well as the reliabilities and concurrent validity of the SHI in a sample with chronic pain.
A total of 161 patients seeking treatment in a tertiary pain center located in Seoul, Korea participated. To explore the factor structure of the SHI, we performed an exploratory factor analysis using principal component with varimax. Cronbach’s alphas and intraclass correlation coefficients were computed to investigate internal consistency and 2-week test-retest stability of the SHI, respectively. Measurement error was estimated using standard error of measurement and minimum detectable change (MDC) of the SHI. For concurrent validity, Pearson correlations were calculated to examine the relations between the SHI and outcome measures including background variables. Also for incremental validity, a hierarchical multiple regression was performed in relation to sleep quality.
Results indicated that two-factor solution is most appropriate; sleep disturbing behavior and environment (B/E) and irregular sleep-wake schedule. Results also showed that the internal consistencies and test–retest stability estimates of the SHI were deemed acceptable. At the 95% confidence level, the MDCs were 5.75 for ‘sleep disturbing B/E,’ 3.65 for ‘irregular sleep-wake schedule,’ and 7.49 points for total. The SHI was significantly correlated with age, depression, pain-related anxiety, and sleep quality. Also, sleep quality was significantly predicted by the irregular sleep-wake schedule subscale of the SHI, over and above background variables, pain intensity, depression, pain-related anxiety.
The SHI has the reliability, measurement error, and concurrent and incremental validity support for assessing sleep hygiene in a sample with chronic pain.
Poor sleep quality has been known as one of the most common complaints in patients with chronic pain (PCP) [1, 2]. According to the National Sleep Foundation , approximately two-thirds of PCP suffer from poor sleep quality and their relative prevalence of poor sleep quality is four times that of the general population. Findings from earlier studies have indicated that poor sleep quality is linked to a wide range of deleterious outcomes, such as greater pain, emotional distress, and physical and psychosocial disability [4–6]. In particular, persistent pain can impair sleep quality and impaired sleep quality can also lower pain tolerance, which can result in amplified sensations of pain. These reciprocal causal relations often lead PCP to fall into a vicious cycle [7–9]. Given these, it is reasonable to assume that effective pain management should enhance sleep quality to break the vicious cycle before it produces even worse problems.
Poor sleep quality in PCP has been reported to correlate with pain  and emotional distress [10, 11]. Other than these factors, poor sleep quality in PCP may be also associated with behavioral and environmental factors such as poor sleep habits (referred to as sleep hygiene) . Sleep hygiene refers to the daily practices, habits, and environmental factors that are necessary for improving the quality of a night-time sleep . As pain becomes prolonged and persistent, PCP is more likely to develop poor sleep hygiene. For example, it is not uncommon that PCP stay inactive and rest in bed most of the day and exhibit irregular sleep-wake schedules . Although the role of sleep hygiene on sleep quality has not been established in PCP, sleep hygiene is one of the first things to check when they complain about poor sleep quality .
There are, to our knowledge, three primary instruments designed to assess sleep hygiene: the Sleep Hygiene Awareness and Practice Scale (SHAPS) , the Sleep Hygiene Self-Test (SHST) , and the Sleep Hygiene Index (SHI) . The first two instruments have been found to have relatively low internal consistency (Chronbach’s alphas = .47 for the SHAPS and .54 for the SHST), compared to the SHI (Chronbach’s alpha = .66). Moreover, these two instruments appeared to be developed with absence of clear rationale for item selection , while the SHI was developed from the diagnostic criteria for inadequate sleep hygiene as defined in the International Classification of Sleep Disorders . The SHI has shown moderate internal consistency and good 2-week test-retest stability (r = .71, p < .001) and been associated with sleep quality and daytime sleepiness in a nonclinical sample . Although the SHI has shown adequate psychometric properties in a nonclinical sample, it has not been validated in a sample with chronic pain. Also, its factor structure, measurement error, and incremental validity over and above other factors affecting sleep quality have not been investigated in a nonclinical sample. Thus, this study aimed to 1) determine the factor structure of the SHI and 2) examine reliability, measurement error, and concurrent and incremental validity of the SHI over and above background variables, pain, and emotional distress (i.e., depression and pain-related anxiety) in PCP. As evidence for concurrent validity, poorer sleep hygiene is expected to significantly correlate with greater pain intensity, greater depression, greater pain-related anxiety, and lower sleep quality.
Demographic characteristics of the sample
Marital status (%)
Education level (%)
≥ High school
Pain duration (months)
Taking pain-related medication (%)
Most significant pain site(s) (%)
≥ 2 sites
The two Korean speaking clinical psychologists (one who specialized in chronic pain and was aware of the objective of the SHI; the other was not) separately translated the SHI into Korean. Any inconsistencies were adjusted based on the agreement between them. Then, a Korean-English bilingual graduate student who had no knowledge of the SHI back-translated it into English. The back-translation version was reviewed by one of the original authors of the SHI and revised accordingly. The pre-final version of the SHI was tested by 5 patients with chronic pain. Each patient was asked to complete the SHI and to provide feedback regarding the wording and meaning of the each item of the SHI. Thus, the pre-final version of the SHI was finally revised based on their feedback.
Demographic information was first obtained from a questionnaire. Items included age, sex, marital status, education level, and pain-related questions such as pain duration, pain-related medication, most significant pain site(s), and pain intensity. Pain intensity was measured by averaging present, usual, lowest, and highest pain during the past week, on a 0 (no pain) to 10 (worst possible pain) numeric rating scale (NRS). Total scores range from 0 to 10, with higher score representing worse pain. The NRS has been shown to have adequate reliability and validity in pain research .
The Sleep Hygiene Index (SHI)  is a 13-item self-report measure designed to assess the practice of sleep hygiene behaviors. Each item is rated on a five-point scale ranging from 0 (never) to 4 (always). Total scores range from 0 to 52, with a higher score representing poorer sleep hygiene. SHI has shown adequate reliability and validity .
The Center for Epidemiologic Studies Depressed Mood Scale (CES-D)  is a 20-item self-report measure designed to assess depressive symptoms. Each item is rated on a four-point scale ranging from 0 (rarely or none of the time) to 3 (most or all of the time). Total scores range from 0 to 60, with a higher score representing greater depression. This study used a Korean language version of the CES-D which has been shown to have adequate reliability and validity .
The Pain Anxiety Symptoms Scale-20 (PASS-20)  is a 20-item self-report measure designed to assess pain-related anxiety. Each item is rated on a six-point scale ranging from 0 (never) to 5 (always). Total scores range from 0 to 100, with a higher score representing greater pain-related anxiety. This study used a Korean version of the PASS-20 which has been shown to have adequate reliability and validity .
The Sleep Quality Scale (SQS)  is a 28-item self-report measure designed to assess sleep quality. Each item is rated on a four-point scale ranging from 0 (rarely) to 3 (almost always). Total scores range from 0 to 84, with a higher score representing lower sleep quality. This study used a Korean version of the SQS which has been shown to have adequate reliability and validity .
The SPSS 18.0 for Windows software was used for the analyses. In order to explore the factor structure of the SHI, we performed an exploratory factor analysis (EFA) using principal component with varimax. Although rules of thumb regarding sample size for EFA have not yet been established, one common rule of thumb is a sample size of at least 100  and another is a subject-to-item ratio of 10:1 . Given this, the sample size (N = 161) of the present study appeared to be minimally acceptable. The number of factors was retained based on eigenvalues, scree test, and parallel analysis using the mean eigenvalues and 95th percentile eigenvalues. Using eigenvalues greater than 1 has been considered to be the least accurate method for factor retention and thus, this study also employed alternative methods such as scree test and parallel analysis . Also, only items with a factor loading of .32 or greater were retained. Tabachnick and Fidell  recommended .32 for a minimum factor loading, indicating that there is approximately 10% overlap in variance with the other items in that factor. An item loaded less than .32 or a cross-loading item was not retained. The final derived factor solution was then used for subsequent reliability and validity analyses. Cronbach’s alphas and intraclass correlation coefficients (ICC (2, 1)) were computed to investigate internal consistency and 2-week test-retest stability of the SHI subscale and total scores, respectively. Measurement error was estimated using standard error of measurement (SEM) and minimum detectable change (MDC) of the SHI total and subscale scores. These were calculated by the following formulas: SEM = SD√(1-r), where SD is the baseline standard deviation of the measurement and r is the 2-week test-retest stability coefficient and MDC = 1.96*√2*SEM. For concurrent validity, Pearson correlations were calculated between the SHI and outcome measures including background variables. Dummy coding was used to represent a categorical variable (i.e., sex; male coded 0, female coded 1). Given the number of correlations, a p value was adjusted (i.e., p < .006) for more conservative prediction . Also for the incremental validity of the SHI over and above background variables, pain intensity, depression, and pain-related anxiety, a hierarchical multiple regression was performed in relation to sleep quality (dependent variable). In each equation, participants’ age, sex, education, and pain duration were controlled first, and pain intensity, depression, and pain-related anxiety were controlled next, followed by the two subscales of the SHI entered in the final step.
Forced two-factor solution by principal component with varimax rotation of items from the SHI
Extraction sums of squared loadings
Rotation sums of squared loadings
% of variance
% of variance
Two-factor solution: Factor loadings and communalities by principal components from the SHI
10. I sleep on an uncomfortable bed (for example: poor mattress or pillow, too much or not enough blankets).
11. I sleep in an uncomfortable bedroom (for example: too bright, too stuffy, too hot, too cold, or too noisy).
12. I do important work before bedtime (for example: pay bills, schedule, or study).
7. I do something that may wake me up before bedtime (for example: play video games, use the internet, or clean).
6. I use alcohol, tobacco, or caffeine within 4 hours of going to bed or after going to bed.
13. I think, plan, or worry when I am in bed.
9. I use my bed for things other than sleeping or sex (for example, watch television, read, eat, or study).
4. I exercise to the point of sweating within 1 hour of going to bed.
3. I get out of bed at different times from day to day.
2. I go to bed at different times from day to day.
5. I stay in bed longer than I should two or three times a week.
1. I take daytime naps lasting two or more hours.
8. I go to bed feeling stressed, angry, upset, or nervous.
Descriptive statistics for subscale and total scores of the SHI
1. Sleep disturbing B/E
2. Irregular sleep-wake schedule
Internal consistency, 2-week test-retest reliability, and measurement error of the SHI
ICC (2, 1) (95% CI)
Sleep disturbing B/E
Irregular sleep-wake schedule
Descriptive statistics for the NRS, CES-D, PASS-20, and SQS
NRS (pain intensity)
Correlations between the SHI subscale and total scores and background and outcome variables
Sleep disturbing B/E
Irregular sleep-wake schedule
Results of hierarchical regression analyses predicting sleep quality from the two subscales of the SHI
Total R 2
Sleep disturbing B/E
Irregular sleep-wake schedule
This present study aimed to extend a prior psychometric investigation of the SHI which assessed the reliabilities and concurrent validity in a nonclinical sample . Specifically, we evaluated the factor structure, measurement error, and incremental validity as well as the reliabilities and concurrent validity of the SHI in a sample with chronic pain. Results from the present study indicated that two-factor solution is most appropriate, accounting for 43.23% of the variance. We interpreted the two factors as indicative of sleep disturbing B/E (7 items) and irregular sleep-wake schedule (4 items). Results also showed that the internal consistencies and test–retest stability estimates of the SHI subscale and total scores were deemed acceptable and relatively high compared to the prior study . At the 95% confidence level, the MDCs were 5.75 for ‘sleep disturbing B/E’, 3.65 for ‘irregular sleep-wake schedule’, and 7.49 points for total. Changes over and above these points after intervention would likely not be measurement error.
Correlation analyses showed that age is negatively correlated with both subscales and total scores of the SHI. Overall, these findings suggest that younger people tend to show worse sleep hygiene. Depression and pain-related anxiety were positively correlated with the irregular sleep-wake schedule subscale and total scores of the SHI, suggesting that greater depression and pain-related anxiety are associated with worse sleep hygiene (especially regarding the aspect of irregular sleep-wake schedule). Both subscales and total scores of the SHI were positively correlated with sleep quality, suggesting that poorer sleep hygiene is associated with poorer sleep quality, which is consistent with prior studies . Neither the subscale nor total scores of the SHI were significantly correlated with pain intensity. These findings suggest that pain may not be directly related to sleep hygiene. Instead, given that pain has been often considered to produce depression and pain-related anxiety , pain may be indirectly related to sleep hygiene. Further studies may benefit from examining possible interactions between pain intensity and depression and/or pain-related anxiety, in their relations with sleep hygiene.
In terms of incremental validity in relation to sleep quality, two subscales of the SHI added a significant increment in explained variance in the equation. Also, sleep quality was significantly predicted by the irregular sleep-wake schedule subscale only, over and above background variables and some primary factors affecting sleep quality (i.e., pain intensity, depression, pain-related anxiety) in PCP. This finding suggests the unique contribution of sleep hygiene to sleep quality and provides evidence for relative importance of sleep-wake schedule over sleep disturbing B/E in sleep quality of PCP. In fact, many PCP develop an irregular sleep-wake pattern through pharmacological and/or behavioral factors . For example, PCP often take multiple medications and some of these (e.g., opioid and benzodiazepines) change their sleep-wake schedule. Also, many PCP fail to maintain a consistent daily activity pattern and spend considerable time in bed or inactive. More specifically, they may be in bed or inactive during episodes of severe pain. On the other hand, in response to some pain relief, they may overdo things that they were unable to do during the episodes of severe pain. This often leads to increases in pain followed by a few days of bed rest or inactivity for recovery. As a result, their sleep-wake schedule can be impaired, leading to poor sleep quality .
This present study has at least four limitations. First, although the process of translation/backtranslation was performed, it did not fully meet the guidelines for the process of cross-cultural adaptation of self-report measures . Thus, items of the translated SHI may not be identical in meaning with those of the original SHI. Insufficient equivalence in meaning is more likely to limit the comparability of responses across different languages or cultures . Second, although the sample size of this present study appeared to be minimally acceptable for EFA, a larger sample can help obtain a more stable solution  and increase generalizability to the population . Third, this present study did not evaluate responsiveness of the SHI and cannot provide the criterion for clinically relevant change. Thus, responsiveness of the SHI scores to interventions should be evaluated in further research for the use of the SHI as a sign of changes in PCP. Finally, this present study employed a cross-sectional design and was composed of patients with diverse pain complaints, attending a tertiary pain center. Thus, causal relations among variables cannot be inferred and the findings may not generalize to other pain population (e.g., fibromyalgia, complex regional pain syndrome) or other settings (e.g., primary or secondary care clinic).
The findings of this present study suggest that the SHI can be a useful research or clinical assessment tool for evaluating sleep hygiene to guide case formulation, treatment planning, or process analysis of intervention in pain centers. This present study provided evidence for the factor structure, reliability, measurement error, and concurrent and incremental validity of the SHI in PCP. However, given that this present study was the first attempt to validate the SHI in a sample with chronic pain, its application in clinical settings should come after further studies, including its utility in clinical decision support and aid in developing further treatment.
This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (2012R1A1A2008624).
- Hurley DA, Eadie J, O’Donoghue G, Kelly C, Lonsdale C: Physiotherapy for sleep disturbance in chronic low back pain: a feasibility randomised controlled trial. BMC Musculoskel Dis 2010, 11: 70. 10.1186/1471-2474-11-70View ArticleGoogle Scholar
- Menefee LA, Cohen MJ, Anderson WR, Doghramiji K, Frank ED, Lee H: Sleep disturbance and nonmalignant chronic pain: a comprehensive review of literature. Pain Med 2000, 1: 156–172. 10.1046/j.1526-4637.2000.00022.xPubMedView ArticleGoogle Scholar
- National Sleep Foundation: Ask the sleep expert: pain and sleep. http://www.sleepfoundation.org/article/ask-the-expert/pain-and-sleep
- McCracken LM, Iverson GL: Disrupted sleep patterns and daily functioning in patients with chronic pain. Pain Res Manag 2002, 7: 75–79.PubMedGoogle Scholar
- Moldofsky H: Sleep and pain. Sleep Med Rev 2001, 5: 385–396. 10.1053/smrv.2001.0179PubMedView ArticleGoogle Scholar
- Smith MT, Haythornthwaite JA: How do sleep disturbance and chronic pain inter-relate? Insights from the longitudinal and cognitive behavioral clinical trials literature. Sleep Med Rev 2004, 8: 119–132. 10.1016/S1087-0792(03)00044-3PubMedView ArticleGoogle Scholar
- Drewes AM: Pain and sleep disturbances with special references to fibromyalgia and rheumatoid arthritis. Rheumatology 1999, 38: 1035–1038. 10.1093/rheumatology/38.11.1035PubMedView ArticleGoogle Scholar
- Drewes AM, Arendt-Nielsen L: Pain and sleep in medical diseases: interactions and treatment possibilities. Sleep Res Online 2001, 4: 67–76.Google Scholar
- Kundermann B, Krieg JC, Schreiber W, Lautenbacher S: The effect of sleep deprivation on pain. Pain Res Manag 2004, 9: 25–32.PubMedGoogle Scholar
- Pilowsky I, Crettenden I, Townley M: Sleep disturbance in pain clinic patients. Pain 1985, 23: 27–33. 10.1016/0304-3959(85)90227-1PubMedView ArticleGoogle Scholar
- Wilson KG, Watson ST, Currie SR: Daily and ambulatory activity monitoring of sleep in patients with insomnia associated with chronic musculoskeletal pain. Pain 1998, 75: 75–84. 10.1016/S0304-3959(97)00207-8PubMedView ArticleGoogle Scholar
- Currie SR, Wilson KG, Pontefract AJ, deLaplante L: Cognitive–behavioral treatment of insomnia secondary to chronic pain. J Consult Clin Psychol 2000, 68: 407–416.PubMedView ArticleGoogle Scholar
- Riedel BW: Sleep hygiene. In Treatment of of late-life insomnia. Edited by: Lichstein KL, Morin CM. Thousand Oaks, CA: Sage; 2000.Google Scholar
- Deardorff WW: Practicing good sleep hygiene. http://www.spine-health.com/wellness/sleep/practicing-good-sleep-hygiene
- Perlis LM: Cognitive behavioral treatment of insomnia. New York, NY: Springer; 2005.Google Scholar
- Lacks P, Rotert M: Knowledge and practice of sleep hygiene techniques in insomniacs and good sleepers. Behav Res Ther 1986, 24: 365–368. 10.1016/0005-7967(86)90197-XPubMedView ArticleGoogle Scholar
- Blake DD, Gomez MH: A scale for assessing sleep hygiene: Preliminary data. Psychol Rep 1998, 83: 1175–1178.PubMedView ArticleGoogle Scholar
- Mastin DF, Bryson J, Corwyn R: Assessment of sleep hygiene using the sleep hygiene index. J Behav Med 2006, 29: 223–227. 10.1007/s10865-006-9047-6PubMedView ArticleGoogle Scholar
- American Sleep Disorders Association: International Classification of Sleep Disorders: Diagnostic and Coding Manual. Rochester: MN: American Sleep Disorders Association; 1990.Google Scholar
- Jensen MP, Karoly P: Self-report scales and procedures for assessing pain in adults. In Handbook of pain assessment. Edited by: Turk DC, Melzack R. New York, NY: Guilford; 2001.Google Scholar
- Radloff LS, The CES-D scale: A self-report depression scale for research in the general population. Appl Psych Meas 1977, 1: 385–401. 10.1177/014662167700100306View ArticleGoogle Scholar
- Chon KK, Rhee MK: Preliminary development of Korean version of CES-D. Kor J Clin Psychol 1992, 11: 65–76.Google Scholar
- McCracken LM, Dhingra L: A short version of the Pain Anxiety Symptoms Scale (PASS-20): Preliminary development and validity. Pain Res Manag 2002, 7: 45–50.PubMedGoogle Scholar
- Cho S, Lee SM, McCracken LM, Moon DE, Heiby EM: Psychometric properties of a Korean Version of the Pain Anxiety Symptoms Scale-20 in chronic pain patients. Int J Behav Med 2010, 17: 108–117. 10.1007/s12529-010-9080-2PubMedView ArticleGoogle Scholar
- Yi H, Shin K, Kim J, Kim J, Lee JB, Shin C: Validity and reliability of Sleep Quality Scale in subjects with obstructive sleep apnea syndrome. J Psychosom Res 2009, 66: 85–88. 10.1016/j.jpsychores.2008.07.008PubMedView ArticleGoogle Scholar
- Hair J, Anderson RE, Tatham RL, Black WC: Multivariate data analysis. 4th edition. New Jersey: Prentice-Hall Inc; 1995.Google Scholar
- Cabrera-Nguyen P: Author guidelines for reporting scale development and validation results in the Journal of the Society for Social Work and Research. J Soc Work Res 2010, 1: 99–103. 10.5243/jsswr.2010.8View ArticleGoogle Scholar
- Velicer WF, Fava JL: Effects of variable and subject sampling on factor pattern recovery. Psychol Methods 1998, 3: 231–251.View ArticleGoogle Scholar
- Tabachnick BG, Fidell LS: Using Multivariate Statistics. Boston: Allyn and Bacon; 2001.Google Scholar
- Cano A: Pain catastrophizing and social support in married individuals with chronic pain: the moderating role of pain duration. Pain 2004, 110: 656–664. 10.1016/j.pain.2004.05.004PubMed CentralPubMedView ArticleGoogle Scholar
- Rodgers JL, Nicewander WA: Thirteen ways to look at the correlation coefficient. Am Stat 1988, 42: 59–66.View ArticleGoogle Scholar
- Stevens JP: Applied multivariate statistics for the social sciences. 5th edition. New York, NY: Routledge; 2009.Google Scholar
- Keith T: Multiple regression and beyond. Boston, MA: Allyn & Bacon; 2006.Google Scholar
- Fisher BJ, Cutler R, Rosomoff HL, Rosomoff RS: Chronic pain associated with depression: Antecedent or consequence of chronic pain? A review. Clin J Pain 1997, 13: 116–137. 10.1097/00002508-199706000-00006View ArticleGoogle Scholar
- Cohen MJM, Menefee LA, Doghramji K, Anderson WR, Frank ED: Sleep in chronic pain: problems and treatments. Int Rev Psychiat 2000, 12: 115–126. 10.1080/09540260050007435View ArticleGoogle Scholar
- Beaton D, Bombardier C, Guillemin F, Ferraz M: Guidelines for the process of cross-cultural adaptation of self-report measures. Spine 2000, 25: 3186–3191. 10.1097/00007632-200012150-00014PubMedView ArticleGoogle Scholar
- Cliff N: The relation between sample and population characteristic vectors. Psychometrika 1970, 35: 163–178. 10.1007/BF02291261View ArticleGoogle Scholar
- MacCallum RC, Widaman KF, Zhang S, Hong S: Sample size in factor analysis. Psychol Methods 1999, 4: 84–99.View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.