The supportive supervisory scale: psychometric properties in Chinese health care aides samples

Abstract

Objective

To sinicize the Supportive Supervisory Scale (SSS) and analyze the psychometric properties of the Chinese version of SSS (SSS-C).

Methods

The SSS (the original English version) was firstly sinicized and adjusted, then its psychometric properties were examined in 300 health care aides from four long-term care (LTC) facilities. SPSS 22.0 was used to process the data and calculate the reliability and validity.

Results

The 15-item SSS-C had satisfactory internal consistency (Cronbach’s α coefficient = 0.852), split half reliability (Spearman-Brown coefficient = 0.834) and test–retest reliability (Pearson correlation coefficient = 0.784), and three factors were extracted. If the four items with their communality < 0.4 were deleted, the remaining 11 items could explain 55.654% of the total variance. The discriminant validity of the SSS-C varied significantly between sites.

Conclusions

The Chinese version of SSS can be used to effectively measure the supervisory support of the nurses within the LTC settings.

Introduction

With the aging of global population, the needs for long-term care (LTC) have increased significantly. However, most of long-term care facilities (LTCFs) have been faced with the staffing challenges, resulting in poor capacity to provide competent and high-quality long-term care to the elderly [1,2,3]. Health care aides (HCAs, equivalent to nursing assistants) provided 80–90% of the direct care to LTCF residents [4]. Thus, it can be seen that the stability and quality of HCAs affect the nursing care of LTCFs to a considerable extent. In LTCFs, HCAs are often supervised by registered nurses, and evidence is accumulating that these supervisory relationships prominently affect HCA turnover, job satisfaction, and the quality of the care provided [3, 5, 6]. In addition, supportive supervisory practices have been proven to be associated with patient outcomes, for example, less adverse events and complications [7]. Therefore, it is urgent to measure and improve the supervisory support of HCA supervisors in the LTCFs.

Supportive Supervisory Scale (SSS) has been originally developed in English for this purpose and has been proven to be a reliable, valid, and useful tool to assess the supervisory support of supervisors in LTCFs, which may influence the retention of HCAs and quality of resident care [8]. To date, such instruments to evaluate the supervisory support of the supervisors within LTCFs are still lacking in China. Given the above needs, the authors obtained the authorization from the author of the original SSS scale, Prof. McGilton, and sinicized and adapted it, and then examined the psychometric properties of the Chinese version of SSS for use in China.

Methods

This study was approved by the Ethics Committee of Soochow University (No. SUDA 20200515H03). All participants were given both verbal and written information about the study; those who agreed to participate in this study signed an informed consent.

Instrument and sinicization

The SSS has 15 items and includes two parts. The first part is labeled “Respect Uniqueness” and the second part “Being Reliable” [9]. Answer options are “never”, “seldom”, “occasionally”, “often”, “always”, which successively represent the score of “1, 2, 3, 4, 5”.

The SSS was translated from English into Chinese using Brislin’s translation model [10]. The steps for sinicization of SSS are shown in Fig. 1. Firstly, two bilingual researchers separately translated the original SSS into Chinese. The discrepancies between these two translations were reviewed and discussed comprehensively, and formed a single version, which was then translated back into English by another bilingual researcher. The retroversion was repeatedly compared with the original SSS scale and the Chinese expressions were adjusted accordingly. Throughout the Chinese version, “supervisor” was replaced by “nurse supervisor” to make the items more understandable since HCAs report directly to registered nurses in LTCFs in China. During this procedure, the translation validity index (TVI) was used to assess the translation equivalence of versions. It used a 4-point Likert scale (1 = uncorrected, 2 = needs major modification on equivalent item, 3 = equivalent but needs minor modification, and 4 = equivalent). In this study, three language experts were recruited to compare the SSS in English and Chinese. The items were revised until a TVI score of 4 was achieved. The revised version of SSS was pilot tested with a convenience sample of 30 HCAs in a LTCF in Suzhou to evaluate whether the Chinese version of SSS was easy to understand. Language expression was adjusted if HCAs felt it was difficult to understand. After the pilot test, the Chinese version of SSS (SSS-C) was finalized for the test of its psychometric properties.

Fig.1

Sinicization steps of SSS

Sample and setting

The study was conducted in 4 LTCFs in Suzhou, China. Health care aides meeting the following criteria were enrolled in the study: (i) working in the LTCFs for more than 3 months; (ii) able to give written consent. A total of 300 participants completed the scale. 41.4% of the HCAs were less than 50 years old and 54% were 51–60 years old; 85.3% were female; 100% of the respondents were employed full-time. The mean number of years that the respondents have worked in the LTCF was less than 5 years (n = 241, 80.3%).

Procedures

After giving written consent, HCAs were asked to fill out the survey questionnaire independently and anonymously in the nursing station or staff lounge, without their supervisor being present. It was guaranteed that the supervisors had no access to the responses. The researchers remained in the room and were available to answer questions when necessary. Neither compensation nor remuneration was offered to the participants.

Statistical analyses

Analyses were performed by IBM SPSS Statistics 21. Participant characteristics and major variables were summarized by descriptive statistics (Table 1). Reliability was tested by internal consistency (Cronbach’s alpha), split-half reliability (Spearman-Brown coefficient) and test–retest reliability (Pearson correlation coefficient) (reliability coefficient ≥ 0.7 was acceptable) [11]. Construct validity was examined by exploratory factor analysis (EFA) (principal component analysis with varimax rotation). Scree plot, Kaiser criterion (eigenvalue ≥ 1.0), and clinical interpretability were considered in determination of factor solution (When the factor loading ≥ 0.40, the item can be considered in the factor) [12]. Discriminative validity was assessed by examining if supervisory support varied between the different facilities by one-way analysis of variance. Multiple comparisons, using Bonferroni’s procedure, were completed to compare every pair of facilities. The significant level was 0.05[13].

Table 1 Participant characteristics (N = 300)

Results

A total of 300 HCAs were surveyed on-site and all of them completed the scale, with the response rate being 100%. No data were missing and no corrections were made. Scores of the SSS-C ranged from 25 to 75, and the mean score was 59.56 (SD = 7.29) for the supervisors.

Reliability

The 15-item SSS-C had satisfactory internal consistency (Cronbach’s α coefficient = 0.852), split half reliability (Spearman-Brown coefficient = 0.834) and test–retest reliability (Pearson correlation coefficient = 0.784) (see Table 2). Corrected item–total correlation and Cronbach’s α coefficient if item deleted for SSS-C are demonstrated in Table 3. The item-to-item correlations were positive, in the 0.083–0.541 range (Table 4).

Table 2 The results of reliability analysis

Table 3 Corrected item–total correlation and Cronbach’s α coefficient if item deleted for SSS-C

Table 4 Item-to-item correlations for 15-item SSS-C

Construct validity

Construct validity was examined by EFA, and the Kaiser–Meyer–Olkin (KMO) measure of sampling adequacy for this analysis was satisfactory (= 0.887), indicating that the sample size for the EFA was adequate. The result of the Bartlett’s test of sphericity was significant (χ² = 1125.922, P < 0.001), demonstrating a sufficient correlation to perform factor analysis. Using the Kaiser criterion, three factors were initially identified, and total variance explained was 48.128%. However, since the communality of item1(My supervisor recognizes my ability to deliver quality care), 4(My supervisor tries to understand my point of view when I speak to them), 5(My supervisor tries to meet my needs in such ways as informing me of what is expected of me when working with my residents) and 7(My supervisor keeps me informed of any major changes in the work environment or organization) was less than 0.4, they should be deleted in theory [14]. After deletion of these four items and a second exploratory factor analysis, three factors could still be extracted, accounting for 55.654% of the total variance (KMO = 0.843, χ² = 806.668, P < 0.001) (Table 5).

Table 5 Results of exploratory factor analysis

Mean item scores of the 15-item SSS ranged from 3.79 to 4.26 (SD = 0.715 to 1.033; Table 3). The four items under Factor I represented “the supervisors’ need to build connections with staff that involved respecting them as individuals” [9], therefore, this factor was labeled “building connections with staff”. Factor II including three items represented “the supervisors were available to staff to listen and respond to their concerns, and that they kept staff informed of what was new on the unit” [9], therefore, this factor was labeled “being dependable”. Factor III was labeled “being empathic” because the items loaded on this factor represented “the supervisors try to understand their point of view, recognize and accommodate expressed needs, recognize their abilities, and help them develop” [9]. Coefficient alpha reliabilities on the items comprising the three factors were: Factor I = 0.723, Factor II = 0.588 and Factor III = 0.663. The coefficient alpha for the 11-item SSS was 0.816.

Discriminant validity

The discriminant validity of the SSS-C varied significantly between sites. For example, within Facility D, scores of the SSS were significantly higher than those for Facility C (F = 4.791, p < 0.005; see Table 6).

Table 6 Divergent construct validity across the long-term care facilities

Discussion

This was the first study to sinicize and validate a Chinese version of the SSS. The psychometrics results supported the utility of the SSS-C. It can be used as a reliable and valid instrument to determine the supervisory support of the team leader within LTC settings. It can be used in LTCFs across China, so that cross-cultural comparisons of influencing factors for registered nurses’ supportive supervision can be made possible, of which results can be popularized internationally to improve the quality of resident care. The EFA procedures carried out on the 15-item SSS-C in the present study were performed on an adequate sample of HCAs [15], and accepted criteria were used to determine the best factor solution. After consultation with experts on long-term care, it has been suggested that these four items need to be further modified in future research due to poor communality or new items could be added for a more complete measure of supervisory support in the Chinese context.

The results of the three-factor rotated solution were compatible with the three dimensions upon which the original SSS was initially based [9], however, they were discrepant with the original SSS which only has two dimensions. The three factors (building connections with staff, being dependable, and being empathic) were consistent with the theoretical underpinning of the SSS. At the core of effective supervision is a supervisor’s ability to develop and maintain positive working relationships with each HCA (what the dimension “building connections with staff” represents) [8], which can enhance the connection, cooperation and team work among the nurse supervisors and HCAs, and may significantly influence the HCA turnover and patient outcomes [16, 17]. Supportive supervision was defined as the extent to which the leader demonstrated empathy and reliability (also referred to as dependability) with staff [8]. The other two dimensions “being dependable” and “being empathic” were consistent with the above concepts. When HCAs can depend on their supervisors to achieve, relate to and enjoy their work, it will be easier for them to be committed to their work and become devoted caregivers [18]. Nurse supervisors in the LTCFs can help the staff counteract the negative effects of work-related pressure, perform their best over the long-term using Mindfulness, Hope and Compassion [19]. Therefore, “being dependable” and “being empathic” were also very important qualities of the supervisors in the LTCFs.

The discriminant validity of the SSS-C was also examined relative to construct validity, which showed that the SSS-C was able to differentiate supportive behaviors of supervisors between different LTCFs. No concurrent measure was conducted because there were no appropriate instruments.

The study has a few limitations. First, this study used a convenience sample of HCAs from the LTCFs in Suzhou. Second, no concurrent measure was conducted to analyze the construct validity. Third, in future research, new items could be added through expert consultation to form a more comprehensive measure of supervisory support in the Chinese context.

Conclusions

The reliability and validity of the Chinese version of the SSS were acceptable. A strong three-factor solution was obtained, which was consistent with the three dimensions upon which the original SSS was initially based. At the core of supportive supervision is the supervisor’s ability to develop and maintain relationships with the HCAs. Through their dependability and empathy, these relationships can prosper. The SSS-C can be used as a reliable and valid tool to measure the level of supportive supervision in the LTCFs, which may influence retention of HCAs and quality of resident care.