Skip to main content
Download PDF
Download ePub

The Latin American version of the internalized stigma of mental illness scale (LA-ISMI): a multicentric validation study from three Latin American countries

Health and Quality of Life Outcomes volume 17, Article number: 175 (2019) Cite this article

Abstract

Background

To date, no data have been available concerning the psychometric characteristics of the Internalized Stigma of Mental Illness scale (ISMI-29) in Latin American countries. The aim of this study was to validate a Latin American version of the ISMI in people with schizophrenia.

Methods

The study included 253 stabilized outpatients with schizophrenia from 3 Mental Health Services in three Latin American countries: Bolivia (N = 83), Chile (N = 85) and Peru (N = 85). We analyzed the psychometric properties using item response and classical test theories. An item reduction was then performed to improve the psychometric properties of the ISMI-29. The final version of the ISMI was tested for construct validity, reliability, external validity and differential item functioning (DIF).

Results

The five-factor structure of the ISMI-29 was not confirmed using confirmatory factor analysis (RMSEA = 0.12, CFI = 0.77, and WRMR = 2.20). Seventeen items were discarded to obtain a satisfactory psychometric version. The ISMI-12 evaluates 3 dimensions: social stigma (4 items), stigma experience (4), and self-stigma (3). The factor structure accounted for 68% of the total variance. Internal consistency was satisfactory. The scalability was satisfactory, with INFIT statistics within an acceptable range. In addition, the results confirmed the absence of DIF and supported the invariance of the item calibrations between countries.

Conclusion

The ISMI-29 is not valid in our sample and should not be used in Latin American countries. The ISMI-12 is the first internalized stigma questionnaire with satisfactory psychometric properties available in Latin American countries. Its brevity could facilitate its dissemination and use in clinical settings.

Background

People with mental illness are exposed to the negative stereotypes of the general population about people with mental illness and may internalize them, which yields the so-called internalized stigmas [1, 2]. The findings of a systematic review by Gerlinger and colleagues [3] indicate that from one-third to one-half of patients with schizophrenia (SZ) feels shame, embarrassed, guilty, and inferior to those without mental illness [4,5,6,7]. Also, as a consequence of the disorder, patients with internalized stigma are more likely to experience depression, reduced self-esteem, reduced recovery orientation, reduced empowerment, and increased perceived devaluation and discrimination [8,9,10,11,12]. Self-stigma is a barrier for early antipsychotic treatment onset and appropriate treatment in general, because the patients tend to lose their motivation to receive medical health care [13,14,15,16]. Another consequence is the increased duration of untreated psychosis has been associated with worse prognosis and also with higher hospitalization, involuntary admission and suicidal behaviour [17]. These last elements impact on the therapeutic effect, because, as Chang and colleagues [18] pointed out is expected to have better outcomes when health care professionals take into not only the symptomatology but also self-stigma in persons with mental illness [16, 18, 19].

However, the consequences of self-stigma do not only affect the patient, but also the caregiver. This type of stigma is called “courtesy stigma”, being stigmatized because of one’s relationship to a person with a stigmatizing mark [18, 20, 21] and “affiliate stigma”, internalizing the stigma because of the relationship that affects the caregiver’s self-esteem and burden [7, 20, 22, 23].

Accurate and appropriate assessment of internalized stigma is thus critical to reduce duration of untreated psychosis to improve medical-social programs and to guide public health policies for SZ people. The Internalized Stigma of Mental Illness scale (ISMI-29) is one of the most widely used measurements of internalized stigma in mental health research [11, 24,25,26]. There is only one validation in Spanish, but it was carried out in Spain, whose version obtained good values of internal consistency and test-retest reliability, for the total score of the scale (0.91 and 0.95 respectively), as well as for the five subscales, except for the Stigma Resistance subscale (Cronbach’s alpha 0.42) [27]. To date, the psychometric characteristics of the ISMI-29 have not been explored in Latin American countries [9]. Even though, the language is similar, we cannot exclude substantial socio-cultural and economic differences between Spain and Latin American countries, influencing the phenomenon of stigmatization. In addition, the previous study did not report how the factorial structure described in their samples fit the initial structure of the tested instrument, which remains a key point when considering validity. Restricted data regarding validity and reliability were also provided. For these reasons, the extent to which SZ patients in Latin American countries can validly self-report their internalized stigma using the ISMI-29 is a crucial issue that has not been sufficiently explored. Furthermore, shortening the ISMI-29 could make the assessment on internalized stigma efficiently.

The aims of this study were thus to validate a Latin American version of the ISMI in people with schizophrenia and to shorten the ISMI-29 into a brief measure to efficiently measure internalized stigma.

Methods

Study participants

Overall, 253 stabilized SZ outpatients were consecutively recruited between May 2012 and February 2013 in the three public ambulatory psychiatric care centers of three areas: Arica, northern Chile (N = 85, 33.6%), Tacna, southern of Peru (N = 85, 33.6%), and La Paz, Central-Western of Bolivia (N = 83, 32.8%). The three centers shared similar characteristics in terms of size, type of treatment delivered to patients, professionals and free access of care.

Inclusion criteria

All stabilized community-dwelling patients diagnosed with schizophrenia according to the criteria of International Classification of Diseases (ICD), 10th version [28] were included in this study.

Exclusion criteria

Patients with history of neurological disorders (including stroke, epilepsy and head injury) or all illnesses affecting central nervous system were not included in the present study.

Procedures

The study was approved by the Ethics Committee of the University of Tarapacá and the National Health Service of Chile. Two psychologists, who were part of the research team, trained for scale evaluation, and supervised by the principal researcher (AC-U), conducted the evaluations of the participants under the auspices of the mental health services of each country. The length of time of the evaluation was between 20 and 30 min.

Before the start of the survey, written informed consent was requested and received from the patient. The objectives of the study were explained as well as the voluntary nature of participation. No compensation was offered for participating in the study.

Data collection

Recruitment process

At each center, during a three- month window, all patients were invited to participate as they came for their monthly follow-up visits. The overwhelming majority of the patients agreed to participate.

Demographic and illness characteristics variables

Age, gender, ethnicity (Aymara and non-Aymara), educational level (≥ 12 years or <  12), employment status (unemployed or employed), family income (measure of the total salary per month for all members of the family, expressed in US dollars), age at onset the disorder, the number of hospitalizations in the last 3 years were reported. All patients were administered antipsychotics. The presence or absence of add-on integrated treatment (defined by psychotherapy, family psychoeducation, and/or day care hospital in addition to pharmacological treatment) was also reported.

Concerning ethnicity, the Aymara is the largest ethnic group in the region, with a population of 2 million people, and has lived in the Andes Mountains for centuries. Recent generations of Aymara have undertaken a massive migration from rural towns to large cities and, thus, receive healthcare services from the same clinics as non-Aymara individuals [29,30,31]. This ethnic group share a particular worldview were the concept of mental health disorder is understood according to this worldview. Therefore, although there are differences in socioeconomic terms between countries, there are a number of cultural traditions that unify them.

Instruments

Internalized stigma [11].

The ISMI scale is a self-rated assessment of the subjective experience of stigma for people with mental illnesses that comprises 29 items across five subscales: alienation (6 items), stereotype endorsement (7 items), discrimination experience (5 items), social withdrawal (6 items), and stigma resistance (5 items). The alienation measures the subjective experience of being less than a full member of society or having a ‘spoiled identity’. The stereotype endorsement measures the degree to which respondents agree with common stereotypes about people with mental illness, such as ‘mentally ill people tend to be violent’ and ‘I can’t contribute anything to society because I have a mental illness.’ The discrimination experience subscale intends to capture respondents’ perception of the way that they currently tend to be treated by others, such as ‘People ignore me or take me less seriously just because I have a mental illness’ and ‘People discriminate against me because I have a mental illness.’ The social withdrawal contains items, such as ‘I don’t talk about myself much because I don’t want to burden others with my mental illness’ and ‘I avoid getting close to people who don’t have mental illness to avoid rejection.’ The Stigma Resistance intends to portray the experience of resisting or being unaffected by internalized stigma [11].

Each item is rated on a 4-point Likert scale ranging from 1 = strongly disagree to 4 = strongly agree with higher scores indicating higher internalized stigma. Each score is calculated by adding the item scores together and then dividing by the total number of answered items. A high total score on the ISMI scale indicates more severe internalized stigmatization. The Spanish version of the ISMI-29 was used in this work [27]. Following the method used by Lysaker and colleagues [25], 4 categories can be created for each score: 1.00–2.00 (minimal to no internalized stigma), 2.01–2.50 (mild internalized stigma), 2.51–3.00 (moderate internalized stigma), and 3.01–4.00 (severe internalized stigma). Following the method used by Ritsher & Phelan [7], 2 categories can also be created for each score: 1.00–2.50 (does not report high internalized stigma), and 2.51–4.00 (reports high internalized stigma).

Positive and Negative Syndrome scale for Schizophrenia (PANSS) [32].

This 30-item, 7-point (1–7) rating scale has been specifically developed to assess psychotic symptoms in SZ individuals with five factors (positive, negative, cognitive, depressive and excitement subscores). The PANSS has been translated and validated in Spain by Peralta and Cuesta [33] and in Mexico by Fresán, et al. [34]. The psychometric properties were satisfactory with principal component analysis explaining 53.4% of the total variance and Cronbach’s alpha > 0.8 for each dimension [34]. This scale was administered by the treating health professionals.

Schizophrenia Quality of Life Questionnaire (SQoL18) [35].

Quality of life (QoL) was assessed using the SQoL18, a self-administered QoL questionnaire designed for people with schizophrenia [35] and validated in Latin America [36]. QoL score ranges from 0, indicating the lowest QoL, to 100, the highest QoL. Factor analysis performed in the 3 countries (Bolivia, Chile and Peru) showed that the questionnaire’s structure adequately matched the initial French structure of the SQoL18. The unidimensionality of the dimensions was preserved, and the internal/external validity indices were close to those of the reference population [36].

Statistical analysis

Socio-demographic and clinical characteristic descriptions were done with frequencies and percentages for categorical variables and with means and standard deviations for continuous variables.

The 5-factor structure of the ISMI-29 was verified using confirmatory factor analysis (construct validity). In this confirmatory factor analysis, we used the diagonally weighted least squares (DWLS) method to estimate the coefficients and fit indices. The following indicators were required to confirm that this structure match with our data. The Root Mean Square Error of Approximation (RMSEA) is acceptable if < 0.08, the Comparative Fit Index (CFI) is higher than 0.9, and the Weighted Root Mean Square Residual (WRMR) (a fit index generated from the use of DWLS) is lower than 0.9. Considering previous validation studies in different countries [9], we hypothesized that the 5-factor structure initially developed would not fit with our data. In this case, the following reduction procedure will be applied.

The construct validity was assessed using principal component factor analyses with varimax rotation [37], in order to determine a new structure and the number of independent dimensions of internalized stigma. Eigenvalues greater than or equal to 1 were retained [38]. Descriptive statistics were performed to examine the response distribution to each item and dimension. The items with the following characteristics were removed: low response rate (< 20%), low index discrimination (< 0.70), decrease of cronbach’s alpha coefficients, and multiple loading (> 0.4) of an item on several factors [39]. Once the structure and the number of items are fixed, this final version was tested for construct validity, reliability, external validity and acceptability.

Item-internal consistency (IIC) was assessed by correlating each item with its scale (corrected for overlap) using Pearson’s coefficient (correlation of 0.4 recommended for supporting item-internal consistency) [40]; item discriminant validity was assessed by determining the extent to which items correlate more highly with the dimensions they are hypothesized to represent than with the other ones [41]. For each dimension scale, internal consistency reliability was assessed by Cronbach’s alpha coefficient (coefficient of at least 0.7 expected for each scale [40].

The uni-dimensionality of each dimension was assessed using Rasch analysis. The goodness-of-fit statistics inlier-sensitive mean square (infit MnSq), ranging between 0.7 and 1.3 ensured that all items of the scale measured the same concept. Floor and ceiling effects were reported assessing the homogeneous repartition of the response distribution. Differential item functioning (DIF) analyses were performed, which compared the item differences between groups of individuals according to socio-demographic parameters (gender, ethnicity, and country) to check whether all items behave the same way [42]. The DIF means that an item performs and measures differently for one subgroup of a population than for the other.

The external validity was assessed by studying relations between dimensions of ISMI scores and demographic, illness and QoL characteristics. The underlying assumption was that stigma was associated with being a man and Aymara, lower family income, higher psychologic symptoms and lower quality of life [43]. We also explored the relations between the new version of ISMI and ISMI-29 scores. The underlying assumption was that total and dimension scores of the new ISMI would be highly correlated with ISMI-29 and also more correlated with scores of similar dimensions.

All the tests were two-sided. Statistical significance was defined as p < 0.05. The statistical analyses were performed using the SPSS version 20.0 software package (SPSS Inc., Chicago, IL, USA) and Mplus Software.

Results

Sample characteristics

Two hundred and fifty-three SZ patients were enrolled in this study. The sociodemographic and clinical features are listed in Table 1.

Table 1 Socio-demographic and clinical characteristics of the study sample (N = 253)
Full size table

Construct validity of the ISMI-29

The five-factor structure of the ISMI-29 was not confirmed using confirmatory factor analysis: RMSEA = 0.12, CFI = 0.77, and DWLS = 2.20. Cronbach’s alpha coefficients were not satisfactory (discrimination experience = 0.47, social withdrawal = 0.68, and stigma resistance = 0.67), except for two dimensions (alienation = 0.73, and stereotype endorsement = 0.72).

Item reduction of the ISMI-29

Seventeen items were discarded for the following reasons: 5 items for low index discrimination, 12 items were deleted after examination of items’ structure using the principal component analyses (4) and Cronbach’s alpha coefficients (8). The final version contained 12 items (ISMI-12).

Construct validity, internal structural validity and reliability of the ISMI-12

The results are summarized in Table 2. The structure of the ISMI-12 was confirmed by principal component factor analysis, identifying a 3-factor structure accounting for 68% of the total variance. The dimensions were named according to their constitutive items: social stigma (4 items), stigma experience (4 items), and self-stigma (3 items). The 12 items are detailed in the Appendix. Internal consistency was satisfactory for all dimensions: each item achieved the 0.40 standard for item-internal consistency. The correlation of each item with its contributive dimension was higher than with the others (item discriminant validity). Floor effect ranged from 16.6 to 27.9% and ceiling effect from 19.5 to 29.2%. Cronbach’s alpha coefficients ranged from 0.77 to 0.88, indicating satisfactory internal consistency. The overall scalability was globally satisfactory: no items showed an infit MnSq outside the acceptable range except for 2 items and country. Dimension and index scores was then calculated. The results also confirmed the absence of DIF according to gender, ethnicity, and country and supported the invariance of the item calibrations.

Table 2 Dimension characteristics of the ISMI
Full size table

According Lysaker, et al., (2007) [25], 23.4% (57) of individuals had minimal to no internalized stigma, 27.0% (66) had mild internalized stigma, 25.0% (61) had moderate internalized stigma, and 24.6 (60) had severe internalized stigma. Following the method used by Ritsher & Phelan, 2004 [24], 50.4% (123) did not report high internalized stigma, and 49.6% (121) reported high internalized stigma.

External validity of the ISMI-12

The results are summarized in Table 3. Higher psychotic symptomatology, lower quality of life, and lower family income were associated with internalized stigma. Men had higher social withdrawal than women, Aymara had higher alienation than non-Aymara, and employment was associated with lower internalized stigma.

Table 3 External validity of the ISMI dimension scores and index
Full size table

The correlations between the scores of ISMI-12 and ISMI-29 are presented in Table 4. All the dimensions were significantly correlated (r ranged from 0.18 to 0.97). The total scores of ISMI-12 and ISMI-29 were highly correlated (r = 0.93). The 3 dimensions of the ISMI-12 (i.e., social stigma, stigma experience, and self-stigma) were highly correlated with three similar dimensions of the ISMI-29 (social withdrawal r = 0.98, discrimination experience r = 0.97, and alienation r = 0.92).

Table 4 Correlations between the scores of ISMI-12 and ISMI-29
Full size table

Acceptability

The proportion of missing values per dimension never exceeded 1.0%.

Discussion

In this study, we have demonstrated the validity and reliability of ISMI-12 in a large multicenter sample of Latin American community-dwelling SZ patients from three countries. The ISMI-12 presents interesting characteristics for a widespread use in SZ patients in Latin America.

Although the literature shows several instruments of self-stigma measurement, within which some shorter scales are observed such as the ISMI-10 [12], the ISMI-9 [44, 45] and the Self-Stigma Scale-Short (SSS-S, 9 items) [46, 47] and others more extensive scales including the Self-stigma of Mental Illness Scale (SSMIS, 40 item) [48], the Self-stigma of mental Illness scale short form (SSMIS-SF, 20 items) [49]; the Consumer Experiences of Stigma Questionnaire (CESQ, 20 items) [50], the Depression Self-stigma Scale (DSSS, 32 items) [51], the Stigma Scale (SS, 28 items) [52], the Discrimination and Stigma Scale (DISC, 36 items) [53, 54], the ISMI-12 is the only short scale that has been valid in a Latin American context. According to several authors, a short form of a scale is frequently associated with better acceptability [55]. The average completion time is expected to be less than 5 min and this will facilitate its use in routine clinical practice.

The internal structure retrieved several important dimensions of stigma for patients. The classification of the items is different from that of the ISMI-29 and may add a complementary approach to this scale. This new classification appears transversal to the different dimensions (i.e., alienation, stereotype endorsement, discrimination experience, social withdrawal and stigma resistance) of the ISMI-29 (trans-dimensional), with a grouping more centred on the patient’s experience rather than on a theoretical and conceptual approach of the stigma. The first dimension addresses the social aspect of stigma while the ISMI-29 focused on social withdrawal. In this dimension (i.e., social stigma), items explored social dependency (item 1), social withdrawal (item 2 and 3), and social exclusion (items 4 and 5). Previous studies reported the importance of the social issue in the phenomenon of stigmatization: social anxiety, social withdrawal, and lower social functioning [3]. The second dimension is about experience of stigma including items discrimination (items 6, 7 and 9) and negative belief about the self (item 8). Previous studies reported the closely link between discrimination and the impact on self-esteem and stereotype [1]. The third dimension is related to self-stigma in accordance with the definition proposed by Corrigan and Watson (2002) [1]: an “internalisation of public stigma” or as “the product of internalization of shame, blame, hopelessness, guilt and fear of discrimination associated with mental illness”. Lastly, we can also note that the majority of items on stigma resistance were discarded, confirming that stigma resistance do not function like a subdimension of internalized stigma of mental illness construct [56].

Concerning the psychometric properties, our proposal meets standards. The internal structure was supported by a high internal consistency. Internal consistency reliabilities for the three dimensions were shown to be high (Cronbach’s alpha> 0.77). External validity, explored by the use of demographic, illness and QoL characteristics confirmed results of previous works on stigma. As expected, patients with higher psychotic symptoms had higher scores of stigmatization. Like other studies, a number of reasons are raised in relation to this point: thus, the greater the number of symptoms, the more likely it is to be the target of stigma from others, which would increase the probability of greater self-stigma, being more difficult for the patient to formulate positive beliefs about them. Conversely, if the patient has a lower internalized stigma, he / she is likely to be able to manage the symptoms more effectively, reducing its severity [25]. Higher scores of stigmatization were associated with lower quality of life. This result is consistent with previous studies showing reduced subjective quality of life mediated by perceived stigma and low self-esteem in SZ subjects [4, 57,58,59,60].

There are several limitations of this study. The sample may not be representative of the entire population of SZ patients (only public sector in medium–large cities) and more globally of the entire population in Latin America. Moreover, the patients in the study sample were mostly middle-aged males with mild disease severity and long illness duration. Confirmation is required for more miscellaneous and larger groups of patients. In particular, further work is needed to test the ISMI-12 in other important South American countries like, Colombia and Venezuela. Future studies should incorporate patients from the private sector given the marked social differences especially in Latin America. The “responsiveness” or “sensitivity to change” defined as the ability to detect a meaningful change, is a core psychometric property of a measuring instrument that we did not explore in this study. Its examination is required in future studies using longitudinal data collection.

Conclusion

The ISMI-12 is the first internalized stigma questionnaire with satisfactory psychometric properties available for SZ individuals in Latin American countries. Its brevity may be appropriate and useful for research and clinical practices.

Availability of data and materials

The datasets generated and/or analysed during the current study are not publicly available due Government policy but are available from the corresponding author on reasonable request.

Abbreviations

CESQ:

Consumer Experiences of Stigma Questionnaire

CFI:

Comparative Fit Index

DIF:

Differential item functioning

DISC:

Discrimination and Stigma Scale

DSSS:

Depression Self-stigma Scale

DWLS:

Diagonally Weighted Least Squares

ICD:

International Classification of Diseases

IQR:

Inter Quartile Ranget

ISMI:

Internalized Stigma of Mental Illness scale

PANSS:

Positive and Negative Syndrome scale for Schizophrenia

QoL:

Quality of Life

RMSEA:

Root Mean Square Error of Approximation

SQoL18:

Schizophrenia Quality of Life Questionnaire

SS:

Stigma Scale

SSMIS-SF:

Self-stigma of mental Illness scale short

SZ:

Schizophrenia

WRMR:

Weighted Root Mean Square Residual

References

  1. Corrigan PW, Watson A. Understanding the impact of stigma on people with mental illness. World Psychiatry. 2002;1(1):16–20.

    PubMed  PubMed Central  Google Scholar 

  2. Ben-Zeev D, Frounfelker R, Morris SB, Corrigan PW. Predictors of self-stigma in schizophrenia: new insights using mobile technologies. J Dual Diagn. 2012;8:305–14.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Gerlinger G, Hauser M, De Hert M, Lacluyse K, Wampers M, Correll CU. Personal stigma in schizophrenia spectrum disorders: a systematic review of prevalence rates, correlates, impact and interventions. World Psychiatry. 2013;12(2):155–64.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Vrbova K, Prasko J, Ociskova M, Kamaradova D, Marackova M, Holubova M, Latalova K. Quality of life, self-stigma, and hope in schizophrenia spectrum disorders: a cross-sectional study. Neuropsychiatr Dis Treat. 2007;13:567–76.

    Article  Google Scholar 

  5. Dinos S, Stevens S, Serfaty M, Weich S, King M. Stigma: the feelings and experiences of 46 people with mental illness: qualitative study. Br J Psychiatry. 2004;184:176–81.

    Article  PubMed  Google Scholar 

  6. Stevelink SA, Wu IC, Voorend CG, van Brakel WH. The psychometric assessment of internalized stigma instruments: a systematic review. Stigma Research and Action. 2012;2:100–18.

    Google Scholar 

  7. Chang C-C, Lin C-Y, Gronholm PC, Wu T-H. Cross-validation of two commonly used self-stigma measures, Taiwan versions of the internalized stigma mental illness scale and self-stigma scale-short, for people with mental illness. Assessment. 2018;25:777–92.

    Article  PubMed  Google Scholar 

  8. Drapalski AL, Lucksted A, Perrin PB, Aakre JM, Brown CH, DeForge BR, Boyd JE. A model of internalized stigma and its effects on people with mental illness. Psychiatr Serv. 2013;64:264–9.

    Article  PubMed  Google Scholar 

  9. Livingston JD, Boyd JE. Correlates and consequences of internalized stigma for people living with mental illness: a systematic review and meta-analysis. Soc Sci Med. 2010;71:2150–61.

    Article  PubMed  Google Scholar 

  10. Lucksted A, Drapalski A, Calmes C, Forbes C, DeForge B, Boyd J. Ending self-stigma: pilot evaluation of a new intervention to reduce internalized stigma among people with mental illnesses. Psychiatr Rehabil J. 2011;35:51–4.

    Article  PubMed  Google Scholar 

  11. Ritsher JB, Otilingam PO, Grajales M. Internalized stigma of mental illness: psychometric properties of a new measure. Psychiatry Res. 2003;121:31–49.

    Article  PubMed  Google Scholar 

  12. Boyd JE, Otilingam PG, Deforge BR. Brief version of the internalized stigma of mental illness (ISMI) scale: psychometric properties and relationship to depression, self esteem, recovery orientation, empowerment, and perceived devaluation and discrimination. Psychiatr Rehabil J. 2014;37:17–23.

    Article  PubMed  Google Scholar 

  13. Corrigan PW, Larson JE, Rüsch N. Self-stigma and the “why try” effect: impact on life goals and evidencebased practices. World Psychiatry. 2009;8:75–81.

    Article  PubMed Central  PubMed  Google Scholar 

  14. Cavelti M, Rüsch N, Vauth R. Is living with psychosis demoralizing? Insight, self-stigma, and clinical outcome among people with schizophrenia across 1 year. J Nerv Ment Dis. 2014;202(7):521–9.

    Article  PubMed  Google Scholar 

  15. Fung KMT, Tsang HWH, Corrigan PW. Self-stigma of people with schizophrenia as predictor of their adherence to psychosocial treatment. Psychiatric Psychiatr Rehabil J. 2008;32(2):95–104.

    Article  PubMed  Google Scholar 

  16. Tsang HWH, Fung KMT, Chung RCK. Self-stigma and stages of change as predictors of treatment adherence of individuals with schizophrenia. Psychiatry Res. 2010;180(1):10–5.

    Article  PubMed  Google Scholar 

  17. Fond G, Boyer L, Andrianarisoa M, Godin O, Brunel L, Bulzacka E, Coulon N, Llorca PM, Berna F, Aouizerate B, Capdevielle D, D’Amato T, Dubertret C, Dubreucq J, Faget C, Gabayet F, Mallet J, Misdrahi D, Rey R, Richieri R, Roux P, Passerieux C, Schandrin A, Tronche AM, Vidailhet P, Leboyer M, Schürhoff F. FACE-SZ (FondaMental Academic Centers of Expertise for Schizophrenia) group. Risk factors for increased duration of untreated psychosis. Results from the FACE-SZ dataset. Schizophr Res. 2018;195:529–33.

    Article  CAS  PubMed  Google Scholar 

  18. Chang CC, Wu TH, Chen CY, Lin CY. Comparing self-stigma between people with different mental disorders in Taiwan. J Nerv Ment Dis. 2016;204:547–53.

    Article  PubMed  Google Scholar 

  19. Yanos PT, Roe D, Lysaker PH. The impact of illness identity on recovery from severe mental illness. Am J Psychiatr Rehabil. 2010;13(2):73–93.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Chang C-C, Su J-A, Tsai C-S, Yen C-F, Liu J-H, Lin C-Y. Rasch analysis suggested three unidimensional domains for affiliate stigma scale: additional psychometric evaluation. J Clin Epidemiol. 2015;68:674–83.

    Article  PubMed  Google Scholar 

  21. Goffman E. Stigma: notes on the management of spoiled identity. Englewood Cliffs, NJ: Prentice Hall; 1963.

    Google Scholar 

  22. Mak WW, Cheung RY. Affiliate stigma among caregivers of people with intellectual disability or mental illness. Appl Res Intellect Disabil. 2008;21:532–45.

    Article  Google Scholar 

  23. Chang CC, Su JA, Chang KC, et al. Development of the family stigma stress scale (FSSS) for detecting stigma stress in caregivers of people with mental illness. Eval Health Prof. 2017;42(2):148–68.

    Article  PubMed  Google Scholar 

  24. Ritsher JB, Phelan J. Internalized stigma predicts erosion of morale among psychiatric outpatients. Psychiatry Res. 2004;129:257–65.

    Article  PubMed  Google Scholar 

  25. Lysaker PH, Roe D, Yanos PT. Toward understanding the insight paradox: internalized stigma moderates the association between insight and social functioning, hope, and self-esteem among people with schizophrenia spectrum disorders. Schizophr Bull. 2007;33:192–9.

    Article  PubMed  Google Scholar 

  26. Boyd JE, Adler EP, Otilingam PG, Peters T. Internalized stigma of mental illness (ISMI) scale: a multinational review. Compr Psychiatry. 2014;55(1):221–31.

    Article  PubMed  Google Scholar 

  27. Bengochea-Seco R, Arrieta-Rodríguez M, Fernández-Modamio M, Santacoloma-Cabero I, Gómez de Tojeiro-Roce J, García-Polavieja B, Santos-Zorrozúa B, Gil-Sanz D. Adaptation into Spanish of the Internalised Stigma of Mental Illness scale to assess personal stigma. Rev Psiquiatr Salud Ment. 2016;9(16):00036–7 pii:S1888–9891.

    Google Scholar 

  28. World Health Organization. ICD-10 Classifications of Mental and Behavioural Disorder: Clinical Descriptions and Diagnostic Guidelines. Geneva: World Health Organization; 1992.

    Google Scholar 

  29. Köster G. In: Van den Berg H, Schiffers N, editors. Los Aymaras: Características demográficas de un grupo étnico indígena antiguo en los Andes centrales [The Aymara: Demographic characteristics of an ancient indigenous ethnic group in the Central Andes]. La Paz, Bolivia. UCB/Hisbol: La cosmovisión Aymara; 1992. p. 81–111.

    Google Scholar 

  30. Van Kessel J. La cosmovisión Aymara. In: Hidalgo J, Schiappacasse F, Niemeyer F, Aldunate C, Mege P, editors. Etnografía: Sociedades indígenas contemporáneas y su ideología [ethnography: contemporary indigenous societies and their ideology]. Santiago, Chile: Editorial Andrés Bello; 1996. p. 169–87.

    Google Scholar 

  31. Gundermann H, González H, Vergara J. Vigencia y desplazamiento de la Lengua aymara en Chile [force and displacement of the aymara’s language in Chile]. Estud Filol. 2007;42:123–40.

    Google Scholar 

  32. Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull. 1987;13(2):261–76.

    Article  CAS  PubMed  Google Scholar 

  33. Peralta V, Cuesta MJ. Validación de la Escala de los Síndromes Positivo y Negativo (PANSS) en una muestra de esquizofrénicos españoles. [Validation of the positive and negative syndrome scale (PANSS) in a sample of Spanish schizophrenic]. Actas Luso Esp Neurol Psiquiatr. 1994;22(4):171–7.

    Google Scholar 

  34. Fresán A, De la Fuente-Sandoval C, Loyzaga C, García-Anaya M, Meyenberg N, Nicolini H, Apiquian R. A forced five-dimensional factor analysis and concurrent validity of the positive and negative syndrome scale in Mexican schizophrenic patients. Schizophr Res. 2005;2:123–9.

    Article  Google Scholar 

  35. Boyer L, Simeoni MC, Loundou A, D'Amato T, Reine G, Lancon C, Auquier P. The development of the S-QoL 18: a shortened quality of life questionnaire for patients with schizophrenia. Schizophr Res. 2010;121(1–3):241–50.

    Article  PubMed  Google Scholar 

  36. Caqueo-Urízar A, Boyer L, Boucekine M, Auquier P. Spanish cross-cultural adaptation and psychometric properties of the schizophrenia quality of life short-version questionnaire (SQoL18) in 3 middle-income countries: Bolivia. Chile and Peru Schizophr Res. 2014;159(1):136–43.

    Article  PubMed  Google Scholar 

  37. Juniper EF, Guyatt GH, Mesbah M, et al. Quality of life and Pharmacoeconomics in clinical trials. Philadelphia: Lippincott-Raven; 1996.

    Google Scholar 

  38. Kaiser HF, Caffrey J. Alpha factor analysis. Psychometrika. 1965;30:1–14.

    Article  CAS  PubMed  Google Scholar 

  39. Antoniotti S, Baumstarck-Barrau K, Siméoni MC, Sapin C, Labarère J, Gerbaud L, Boyer L, Colin C, François P, Auquier P. Validation of a French hospitalized patients' satisfaction questionnaire: the QSH-45. Int J Qual Health Care. 2009;21(4):243–52.

    Article  PubMed  Google Scholar 

  40. Carey RG, Seibert JH. A patient survey system to measure quality improvement: questionnaire reliability and validity. Med Care. 1993;31:834–45.

    Article  CAS  PubMed  Google Scholar 

  41. Campbell DT, Fiske DW. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull. 1959;56:81–105.

    Article  CAS  PubMed  Google Scholar 

  42. Stone WB, M. Best test design: Rasch measurement. Chicago: MESA Press; 1979.

    Google Scholar 

  43. Caqueo-Urízar A, Boyer L, Urzúa A, Williams DR. Self-stigma in patients with schizophrenia: a multicentric study from three Latin-America countries. Soc Psychiatry Psychiatr Epidemiol. 2019;54(8):905–9.

    Article  PubMed  Google Scholar 

  44. Chang C, Wu T, Chen C, Wang J, Lin C. Psychometric evaluation of the internalized stigma of mental illness scale for patients with mental illnesses: measurement invariance across time. PLoS One. 2014;9(6):e98767.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  45. Hammer JH, Toland MD. Internal structure and reliability of the internalized stigma of mental illness scale (ISMI-29) and brief versions (ISMI-10, ISMI-9) among Americans with depression. Stigma Heal. 2016;2(3):159–74.

    Article  Google Scholar 

  46. Mak WW, Cheung RY. Self-stigma among concealable minorities in Hong Kong: conceptualization and unified measurement. Am J Orthop. 2010;80:267–81.

    Article  Google Scholar 

  47. Huang W-Y, Chen S-P, Pakpour AH, Lin C-Y. The mediation role of self-esteem for self-stigma on quality of life for people with schizophrenia: a retrospectively longitudinal study. J Pac Rim Psychol. 2018;12(e10):1–7.

    CAS  Google Scholar 

  48. Corrigan PW, Watson AC, Barr L. The self-stigma of mental illness: implications for self-esteem and self-efficacy. J Soc Clin Psychol. 2006;25:875–84.

    Article  Google Scholar 

  49. Corrigan PW, Michaels PJ, Vega E, Gause M, Watson AC, Rusch N. Self-stigma of mental illness scale-short form: reliability and validity. Psychiatry Res. 2012;199:65–9.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Wahl OF. Mental health consumers experience of stigma. Schizophr Bull. 1999;25:467–78.

    Article  PubMed  Google Scholar 

  51. Kanter JWP, Rusch LCM, Brondino MJP. Depression self-stigma: a new measure and preliminary findings. J Nerv Ment Dis. 2008;196:663–70.

    Article  PubMed  Google Scholar 

  52. King M, Dinos S, Shaw J, Watson R, Stevens S, Passetti F, et al. The stigma scale: development of a standardised measure of the stigma of mental illness. Br J Psychiatry. 2007;190:248–54.

    Article  PubMed  Google Scholar 

  53. Thornicroft G, Brohan E, Rose D, Sartorius N, Leese M, for The INDIGO Study Group. Global pattern of anticipated and experienced discrimination against people with schizophrenia. Lancet. 2009;73:408–15.

    Article  Google Scholar 

  54. Brohan E, Slade M, Clement S, Thornicroft G. Experiences of mental illness stigma, prejudice and discrimination: a review of measures. BMC Health Serv Res. 2010;25:10–80.

    Google Scholar 

  55. Boyer L, Baumstarck K, Boucekine M, Blanc J, Lançon C, Auquier P. Measuring quality of life in patients with schizophrenia:an overview. Expert Rev Pharmacoecon Outcomes Res. 2013;3(3):343–9.

    Article  Google Scholar 

  56. Sibitz I, Unger A, Woppmann A, Zidek T, Amering M. Stigma resistance in patients with schizophrenia. Schizophr Bull. 2011;37(2):316–23.

    Article  PubMed  Google Scholar 

  57. Kunikata H, Mino Y, Nakajima K. Quality of life of schizophrenic patients living in the community: the relationships with personal characteristics, objective indicators and self-esteem. Psychiatry Clin Neurosci. 2005;59:163–9.

    Article  PubMed  Google Scholar 

  58. Mosanya TJ, Adelufosi AO, Adebowale OT, Ogunwale A, Adebayo OK. Self-stigma, quality of life and schizophrenia: an outpatient clinic survey in Nigeria. Int J Soc Psychiatry. 2013;60(4):377–86.

    Article  PubMed  Google Scholar 

  59. Tang IC, Wu HC. Quality of life and self-stigma in individuals with schizophrenia. Psychiatr Q. 2012;83(4):497–507.

    Article  PubMed  Google Scholar 

  60. Wang XQ, Petrini MA, Morisky DE. Predictors of quality of life among Chinese people with schizophrenia. Nurs Health Sci. 2007;19(2):142–8.

    Article  Google Scholar 

Download references

Acknowledgements

This research was funded in part by the Universidad de Tarapacá through Proyecto Mayor de Investigación Científica y Tecnológica UTA n°3732-16.

Funding

This research was funded by Proyecto UTA-Mayor 3732–16.

Author information

Authors and Affiliations

  1. Instituto de Alta Investigación, Universidad de Tarapacá, 1520, Antofagasta, Arica, Chile

    Alejandra Caqueo-Urízar

  2. Universidad Católica del Norte, Avda. Angamos, 0610, Antofagasta, Chile

    Alfonso Urzúa

  3. Aix-Marseille Univ, EA 3279 – Public Health, Chronic Diseases and Quality of Life - Research Unit, 13005, Marseille, France

    Anderson Loundon, Mohamed Boucekine, Guillaume Fond & Laurent Boyer

Authors
  1. Alejandra Caqueo-Urízar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alfonso Urzúa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anderson Loundon
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mohamed Boucekine
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Guillaume Fond
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Laurent Boyer
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Conception and design: AC-U, LB, GF and AU. Data collection and analysis of data: AC-U, AU, AL, MB, GF and LB. Interpretation of data: AC-U, AL, MB, LB, GF and AU. Drafting and writing the manuscript: AC-U, AL, MB, LB, GF and AU. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Alejandra Caqueo-Urízar.

Ethics declarations

Ethics approval and consent to participate

Before the start of the study, written informed consent was requested and received from the patient and her/his primary caregiver. The objectives of the study were explained as well as the voluntary nature of participation. No compensation was offered for participating in the study. The study was approved by the Ethics Committee of the University of Tarapacá and the National Health Service of Chile.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

Table 5 Latin American version of the ISMI: ISMI-12
Full size table

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Caqueo-Urízar, A., Urzúa, A., Loundon, A. et al. The Latin American version of the internalized stigma of mental illness scale (LA-ISMI): a multicentric validation study from three Latin American countries. Health Qual Life Outcomes 17, 175 (2019). https://doi.org/10.1186/s12955-019-1238-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-019-1238-2

Keywords

  • Internalized stigma
  • Schizophrenia
  • Psychometric properties
  • Validity

Health and Quality of Life Outcomes

ISSN: 1477-7525

Contact us