Evaluation of a skin self examination attitude scale using an item response theory model approach
© Djaja et al.; licensee BioMed Central. 2014
Received: 20 June 2014
Accepted: 10 December 2014
Published: 24 December 2014
The Skin Self-Examination Attitude Scale (SSEAS) is a brief measure that allows for the assessment of attitudes in relation to skin self-examination. This study evaluated the psychometric properties of the SSEAS using Item Response Theory (IRT) methods in a large sample of men ≥ 50 years in Queensland, Australia.
A sample of 831 men (420 intervention and 411 control) completed a telephone assessment at the 13-month follow-up of a randomized-controlled trial of a video-based intervention to improve skin self-examination (SSE) behaviour. Descriptive statistics (mean, standard deviation, item–total correlations, and Cronbach’s alpha) were compiled and difficulty parameters were computed with Winsteps using the polytomous Rasch Rating Scale Model (RRSM). An item person (Wright) map of the SSEAS was examined for content coverage and item targeting.
The SSEAS have good psychometric properties including good internal consistency (Cronbach’s alpha = 0.80), fit with the model and no evidence for differential item functioning (DIF) due to experimental trial grouping was detected.
The present study confirms the SSEA scale as a brief, useful and reliable tool for assessing attitudes towards skin self-examination in a population of men 50 years or older in Queensland, Australia. The 8-item scale shows unidimensionality, allowing levels of SSE attitude, and the item difficulties, to be ranked on a single continuous scale. In terms of clinical practice, it is very important to assess skin cancer self-examination attitude to identify people who may need a more extensive intervention to allow early detection of skin cancer.
Melanoma is the fourth most common cancer among men and women in Australia. Men aged 50 years or older are more likely than other groups to be diagnosed with thick melanomas and have the highest mortality . Skin self-examination (SSE) has been shown to increase the detection of thin melanoma -. A case-control study in the United States found a 60% reduced risk of melanoma mortality (OR 0.37; 95% CI = 0.16-0.84) in people who examined their own skin . While the US Preventive Services Task Force currently does not recommend population-based screening for skin cancer due to the absence of randomised trials investigating the mortality benefit of screening , the American Cancer Society does recommend that adults perform SSE monthly  and Australian Cancer Councils suggest SSE at three-monthly intervals .
SSE may be one method of identifying suspicious skin lesions early, particularly given that patients are more likely to detect their own melanomas . A large case-control study conducted in Queensland, Australia found that melanomas detected during deliberate SSE compared to those found incidentally, were thinner . As about half of all melanomas occur on parts of the body that are difficult to see (especially the back) , it has been suggested that whole-body SSE is necessary to optimise melanoma detection rate .
While melanoma incidence and mortality is highest in men 50 years or older, this group is less likely to detect their own melanomas and were less likely to undergo whole-body clinical skin examination compared to other population groups ,. Both of which could contribute to their higher melanoma mortality rates. The increased risk of thick melanoma in this group may be due, at least in part, to low awareness and uptake of early detection behaviours, including SSE.
Several aspects of SSE are under-researched, and few studies have measured factors which may contribute to whether or not people conduct SSE. One study by Manne and Lessin , who developed a 17-item SSE benefits and barriers scale, found only barriers (but no benefits) were associated with SSE performance in melanoma survivors. The authors suggested that melanoma survivors rely strongly on their doctors’ recommendation, minimising the impact of their personal attitudes, and that further assessment among the general population is needed. Swetter et al.  found that SSE awareness (defined as having heard about the ABCD rule, reading about skin cancer detection, and requesting information about skin cancer detection from doctor) of female spouses of men with melanoma was significantly higher than that of the men themselves.
We previously used several attitude or outcome expectation items within a large study of melanoma screening, and found that positive attitudes was strongly associated with intention to conduct SSE in the future . However the psychometric qualities of the measure as a whole have not been assessed.
Measurement of subjective and latent constructs like SSE attitudes requires rigorously developed and tested instruments in order to obtain data of the highest possible quality. While in the past questionnaire quality including reliability and validity was often assessed using classical psychometric approaches, increasingly the advantages of item response theory (IRT) methods, including allowing more precise estimates, assessment of unidimensionality, adaptive testing and assessment of differential item functioning have been recognised. IRT methods are now applied to measurement tools across a wide variety of health outcomes -. It was the aim of this study to evaluate the measurement properties and unidimensionality of the SSE attitude scale using a Rasch modelling approach.
To examine measurement properties of the SSE attitudes scale we used data collected from the Skin Awareness study . The primary aim of that study was to examine the impact of a video-delivered intervention with two mailed reminder postcards compared to a written-materials- only control group on the prevalence of SSE in men aged 50 years or older. The primary hypothesis was that the prevalence of SSE in the video intervention group would increase by at least 10% more than in the control. A 10% increase was determined as the minimal change deemed to be clinically significant. Approval for this study was obtained from the Queensland University of Technology ethics committee, and the trial was registered with the Australian New Zealand Clinical Trials Registry (ANZCTR N12608000384358). Trial methods and baseline participant characteristics as well as primary and secondary outcomes have previously been reported in detail -.
In total, 5000 potential participants (men aged 50 or older) were randomly selected from the Australian electoral roll (enrolling to vote is compulsory in Australia), of which 2899 potential participants with a valid telephone number were contacted by mail. The study pack included a letter of invitation and a colored brochure featuring a well-known sports and TV personality, with follow-up of non-respondents via one postal reminder and up to two follow-up phone calls. Men who were too ill, could not speak English, or had a previous history of melanoma were excluded. The overall consent rate was 37% (969 of 2610 eligible); however 39 men withdrew before the study began, leaving a final sample of 930 men who were randomised to the control or intervention condition. Men completed telephone interviews at baseline, at 7 and 13 months after receiving either the video intervention or written brochures only control package.
For the present analysis, we used data from 831 men who completed the 13-month assessment time point. Similar to factor analysis, where a minimal sample size of 10 is required per item by convention, a minimum sample size of 250 is generally requested for analyses such as those conducted here .
Skin self-examination attitude scale
Item total correlation, fit statistics and item difficulty for the 10-item skin self-examination attitude scale
Item total correlation
Item difficulty (SE)
It is important to check my skin for skin cancer even if I have no symptoms
- 0.58 (0.07)
I think checking my skin would make me anxious*
Checking my skin regularly is a priority for me
I think I could find something suspicious on my skin if it was there
If I saw something suspicious on my skin, I’d go to the doctor straight away
I am confident in a doctor’s ability to diagnose skin cancer
I have made plans on when to examine my own skin*
I am confident that I can take up examining my own skin again even if I have not looked at my skin in the past few months
I am able to keep examining my own skin regularly, even if I have no one to help me
If I regularly examine my skin, then I am helping to look after my own health
To test the measurement quality of the SSEAS beyond classical test theory, item response theory (IRT) modelling was applied. In brief, IRT model measures the relationship between an individual’s ability and an item difficulty, and models this as a probabilistic function. Specifically, raw data from a rating scale are converted to an “equal interval scale” in logits (log odd units), reflecting the item difficulty and individual’s ability ,. Data were analysed using the Winsteps Rasch Measurement . To analyse the SSEAS, with 5 answer options per item, the polytomous Rasch Rating Scale Model (RRSM) was used.
The following data quality parameters were assessed:
We assessed whether the data derived from the men’s answers fitted the Rasch model in order to assess unidimensionality of the underlying trait. To assess the fit of the data to the Rasch model, item difficulty and fit statistics were calculated for each item.
The difficulty of each SSEA item is its point on SSEA logits – when SSEA is expressed as a unidimensional continuum. For polytomous scales including the SSEAS, this is the point at which each answer category has a 50% probability of being endorsed. Winsteps ranks the items in a hierarchical order based on their item difficulty. The item at the top has high item difficulty and thus is difficult for people to endorse; the item at the bottom of the rank is an easy-to-endorse item. Item difficulty is calculated in logits and placed on a linear interval continuum. The higher the logit is, the more the item measures at a high SSEA difficulty level.
Item fit statistics
To determine item fit statistics, infit and outfit mean square (MNSQ) statistics were calculated, which specify how well each item fits the Rasch model. Infit and outfit MNSQ values should range from 0.6 to 1.4 . These fit statistics represent the difference between expected responses and observed responses. An item perfectly fits with the model if they have MNSQ of 1. Values less than 1.0 (overfit) show the model predicts the data too well - causing summary statistics (e.g: reliability), to report inflated statistics. Meanwhile values greater than 1.0 (underfit) show unmodeled noise (there is other source of variance in the data) - these will degrade measurement.
The infit and outfit MNSQ represents the unstandarised degree of fit of data observation to the Rasch model expected responses. While the infit MNSQ is sensitive to unexpected patterns, the outfit MNSQ statistic is more sensitive to outliers.
Differential item functioning (DIF)
DIF was assessed to examine if the intervention condition had an effect on the hierarchy of item difficulties. Rasch assumes the hierarchy of the items to be the same across groups: it should work uniformly, irrespective of groups, in our case, for men in the intervention and control groups. For example, if an item is invariant across groups, the item with the lowest difficulty on the SSEA continuum for the intervention group has also the lowest difficulty for the control group. Instead of calculating the item difficulties for the whole group, in DIF analysis they are now calculated separately (per group). The current study used a multi-step method of initially flagging items for potential DIF using the Mantel chi-square statistic, followed by confirmation of DIF with two other tests (Standardized Liu-Agresti Cummulative Common Log-Odds Ratio (LOR Z) and Standardized Cox’s Noncentrality Parameter (COX Z)). All MH-based statistics were computed using DIFAS 5.0 .
SSEAS data was available from 831 participants, 411 (49.5%) control group participants with a mean SSEAS score of 4.1 (SD 0.49) and 420 (50.5%) intervention group participants (mean SSEAS score of 4.1 (SD 0.50).
The Rasch analysis showed good reliability. Item reliability (replicability of item placements along the scale) was 0.98 and person reliability was 0.68. Individual item difficulty level ranged from – .58 to .54 logits, with a mean ± standard deviation (SD) of 0 ± 0.41. Whereas person measures had a mean ± SD of 1.71 ± 1.40, indicating that the items did not adequately target the SSEA levels of this sample. Results of the unidimensionality analysis are shown in Table 1.
Item difficulty estimates found that the easiest item to endorse for the participants was item SSE_1 (- 0.58): “It is important to check my skin for skin cancer even if I have no symptoms” while the most difficult item to endorse was item SSE_3 (0.54): “Checking my skin regularly is a priority for me”.
Items SSE_3 and SSE_9 both had about the same item difficulty of 0.54 logits and 0.53 logits, with evidence for overlap between the items and thus redundancy of items. In addition, items SSE_4 (0.23) and SSE_8 (0.18) measure a similar level of SSEA evidenced by a separation distance of only 0.05 logits.
M is the mean value (the default value of participants mean is set to 0), while S labels one standard deviation and T labels two standard deviations of the item and person distribution. The map shows that the participants’ average SSEA mean was 1.71 logit above the items’ mean, implying that participants have a high level of SSEA.
Content coverage and item targeting
A ceiling effect was evident in the results displayed in Figure 1, with many participants located in the upper part of the map, and few items located in the corresponding level. The SSEA of this sample was higher than that reflected in the items. The mean of item measures was more than 1 standard deviation lower than the mean of person measures, which indicates that all items were easily endorsed by this sample, and additional items with greater difficulty are needed to complement the scale.
Item fit statistics
After an iterative process of calibration, all items of the SSEAS except SSE_2: “I think checking my skin would make me anxious” and SSE_7: “I have made plans on when to examine my own skin” were found to have inadequate MNSQ infit and outfit outside the recommended values 0.6 and 1.4  (Table 1) and overall did not met the fit criteria. SSE_2 also did not contribute to the measurement of a unidimensional construct.
Differential item functioning (DIF) assessment
DIF statistics for the 8-item skin self-examination attitude scale
Regular monthly or 3-monthly SSEis currently recommended by a number of cancer control agencies, particularly for those at high risk such as older men who carry the greatest skin cancer burden of skin cancer. SSE could improve skin awareness and rapid clinical skin examination. In combination this has potential to reduce the physical burden, including mortality, caused by late diagnosis of melanoma ,. Studies have shown that melanomas detected during a deliberate SSE rather than found accidentally are thinner ,. Attitudes towards SSE form an important component in explaining the likelihood of conducting an SSE .
IRT has been used widely in evaluation education and health measures ,,. The current study used IRT analysis to further assess the psychometric properties of the SSEAS. Data were analysed using the Rasch Rating Scale Model , which has ideal metric properties for ranking an individual’s ability (the level of the attribute measured) along with the item difficulty on a common scale. This Rasch model allows for the comparison of individuals regardless of items used in the measurement . It also enables the generation of a joint measurement (common scale) of items and people, provided that the data is fitted to the model’s requirements.
In this study, the overall fit statistics and reliabilities of the SSEAS were satisfactory. However, the spread of item difficulty was not satisfactory, with most items located on the lower end of the scale. This means the SSEAS will give more accurate information for individuals who have low skin-self-examination attitude. Two items (item SSE_2 and item SSE_7) did not perform as expected and were removed to achieve better fit to the Rasch model expectations. This suggested that those two items may be measuring a different domain of SSE. Item SSE_2: “I think checking my skin would make me anxious” was suspected to measure anxiety rather than attitude. Item SSE_7: “I have made plans on when to examine my own skin” probably measures the planning aspect of SSE. This item could form a separate scale with additional planning items that address the specific aspects of optimal SSE performance (such as having a partner to help, or having available a full size and hand held mirror, or good lighting) have been added.
The distribution of the SSEAS items reflects a wide range of individual differences, with the average level of this trait in the current sample being higher than the average difficulty level of the items. The difficulty level of the 8 items reflected a narrow range of levels of skin self-examination attitude among men ≥ 50 years, thus not allowing for the optimal discrimination of more positive attitude in this sample.
The DIF analysis according to study group showed that the functioning of the 8 items on the SSEAS was consistent, and was considered equally difficult, for both intervention and control groups. The items were sufficiently robust to allow for the assessment of SSE attitudes regardless of the participant’s group. Thus, the answers only quantified the individual’s level of SSE attitude, which was measured according to the difficulty of the items and not because of other constructs explained by the participant’s subgroup.
The present study has some limitations. People with a high risk of skin cancer may feel social pressure to report higher SSEA than others, and this may have resulted in a positive reporting bias to our SSEA score. Although there is no objective measure of SSE, adding a social desirability scale such as the Marlowe-Crowne social desirability scale  in future studies could allow assessment of the SSEA scale against this criterion. The addition of more high SSEA items to extend the difficulty range of the measure may also help to improve the scale. Finally, our sample consisted entirely of men aged 50 years or older. Future research should examine whether these results also hold for the broader population including sample from other states in Australia, women and younger age groups.
Overall, the present study confirms the SSEA scale as a brief, useful and reliable tool for assessing attitudes towards skin self-examination in a population of men 50 years or older in Queensland, Australia. The 8-item scale shows unidimensionality, allowing levels of SSE attitude, and the item difficulties, to be ranked on a single continuous scale. In terms of clinical utility, the skin awareness scale can identify people who may need a more extensive intervention. Clinician can encourage these people to start skin self examination regularly looking for any abnormal growth or unusual changes, so they can have a better chance for a cure.
- Geller AC, Swetter SM, Brooks K, Demierre M-F, Yaroch AL: Screening, early detection, and trends for melanoma: current status (2000–2006) and future directions. J Am Acad Dermatol 2007, 57: 555–572. 10.1016/j.jaad.2007.06.032View ArticlePubMedGoogle Scholar
- Berwick M, Begg CB, Fine JA, Roush GC, Barnhill RL: Screening for cutaneous melanoma by skin self-examination. J Natl Cancer Inst 1996, 88: 17–23. 10.1093/jnci/88.1.17View ArticlePubMedGoogle Scholar
- Carli P, De Giorgi V, Palli D, Maurichi A, Mulas P, Orlandi C, Imberti GL, Stanganelli I, Soma P, Dioguardi D, Catricala' C, Betti R, Cecchi R, Bottoni U, Bonci A, Scalvenzi M, Giannotti B: Dermatologist detection and skin self-examination are associated with thinner melanomas: results from a survey of the Italian Multidisciplinary Group on Melanoma. Arch Dermatol 2003, 139(5):607–612. 10.1001/archderm.139.5.607View ArticlePubMedGoogle Scholar
- Berwick M, Armstrong BK, Ben-Porat L, Fine J, Kricker A, Eberle C, Barnhill R: Sun exposure and mortality from melanoma. J Natl Cancer Inst 2005, 97: 195–199. 10.1093/jnci/dji019View ArticlePubMedGoogle Scholar
- United States Preventive Services Task Force: Screening for skin cancer: recommendations and rationale Am J Prev Med 2001, 20(3 Suppl):44–46.Google Scholar
- Skin Cancer Prevention and Early Detection. [http://www.cancer.org/cancer/cancercauses/sunanduvexposure/skincancerpreventionandearlydetection/skin-cancer-prevention-and-early-detection-toc]
- National Cancer Prevention Policy: Ultraviolet radiation. [http://wiki.cancer.org.au/policy/UV/Effective_interventions/Melanoma_screening]
- Baade PD, Balanda KP, Lowe JB: Changes in skin protection behaviors, attitudes, and sunburn: in a population with the highest incidence of skin cancer in the world. Cancer Detect Prev 1995, 20: 566–575.Google Scholar
- Baade PD, Youl PH, English DR, Mark Elwood J, Aitken JF: Clinical pathways to diagnose melanoma: a population-based study. Melanoma Res 2007, 17: 243–249. 10.1097/CMR.0b013e328194f265View ArticlePubMedGoogle Scholar
- Youl PH, Janda M, Aitken JF, Del Mar CB, Whiteman DC, Baade PD: Body-site distribution of skin cancer, pre-malignant and common benign pigmented lesions excised in general practice. Br J Dermatol 2011, 165: 35–43. 10.1111/j.1365-2133.2011.10337.xView ArticlePubMedGoogle Scholar
- Weinstock MA, Martin RA, Risica PM, Berwick M, Lasater T, Rakowski W, Goldstein MG, Dube CE: Thorough skin examination for the early detection of melanoma. Am J Prev Med 1999, 17: 169–175. 10.1016/S0749-3797(99)00077-XView ArticlePubMedGoogle Scholar
- Janda M, Youl PH, Lowe JB, Baade PD, Elwood M, Ring IT, Aitken JF: What motivates men age > or =50 years to participate in a screening program for melanoma? Cancer 2006, 107: 815–823. 10.1002/cncr.22051View ArticlePubMedGoogle Scholar
- Kasparian NA, McLoone JK, Meiser B: Skin cancer-related prevention and screening behaviors: a review of the literature. J Behav Med 2009, 32: 406–428. 10.1007/s10865-009-9219-2View ArticlePubMedGoogle Scholar
- Manne S, Lessin S: Prevalence and correlates of sun protection and skin self-examination practices among cutaneous malignant melanoma survivors. J Behav Med 2006, 29: 419–434. 10.1007/s10865-006-9064-5View ArticlePubMedGoogle Scholar
- Swetter SM, Layton CJ, Johnson TM, Brooks KR, Miller DR, Geller AC: Gender differences in melanoma awareness and detection practices between middle-aged and older men with melanoma and their female spouses. Arch Dermatol 2009, 145: 488–490.PubMedGoogle Scholar
- Janda M, Youl PH, Lowe JB, Elwood M, Ring IT, Aitken JF: Attitudes and intentions in relation to skin checks for early signs of skin cancer. Prev Med 2004, 39: 11–18. 10.1016/j.ypmed.2004.02.019View ArticlePubMedGoogle Scholar
- Velozo CA, Lai JS, Mallinson T, Hauselman E: Maintaining instrument quality while reducing items: application of Rasch analysis to a self-report of visual function. J Outcome Meas 2000, 4: 667–680.PubMedGoogle Scholar
- Hawthorne G, Densley K, Pallant JF, Mortimer D, Segal L: Deriving utility scores from the SF-36 health instrument using Rasch analysis. Qual Life Res 2008, 17: 1183–1193. 10.1007/s11136-008-9395-5View ArticlePubMedGoogle Scholar
- Belvedere SL, de Morton NA: Application of Rasch analysis in health care is increasing and is applied for variable reasons in mobility instruments. J Clin Epidemiol 2010, 63: 1287–1297. 10.1016/j.jclinepi.2010.02.012View ArticlePubMedGoogle Scholar
- Franchignoni F, Salaffi F, Giordano A, Carotti M, Ciapetti A, Ottonello M: Rasch analysis of the 22 knee injury and osteoarthritis outcome score–physical function items in Italian patients with knee osteoarthritis. Arch Phys Med Rehabil 2013, 94: 480–487. 10.1016/j.apmr.2012.09.028View ArticlePubMedGoogle Scholar
- Cook CE, Richardson JK, Pietrobon R, Braga L, Silva HM, Turner D: Acta Ethnographica Academiae Scientiarum Hungaricae: Validation of the NHANES ADL scale in a sample of patients with report of cervical pain: factor analysis, item response theory analysis, and line item validity. Disabil Rehabil 2006, 28: 929–935. 10.1080/09638280500404263View ArticlePubMedGoogle Scholar
- Janda M, Baade PD, Youl PH, Aitken JF, Whiteman DC, Gordon L, Neale RE: The skin awareness study: promoting thorough skin self-examination for skin cancer among men 50 years or older. Contemp Clin Trials 2010, 31: 119–130. 10.1016/j.cct.2009.11.003View ArticlePubMedGoogle Scholar
- Auster J, Neale R, Youl P, Baade P, Gordon L, Aitken J, Whiteman D, Janda M: Characteristics of men aged 50 years or older who do not take up skin self-examination following an educational intervention. Journal of the American Academy of Dermatology 2012, 67: e57-e58. 10.1016/j.jaad.2011.10.019View ArticlePubMedGoogle Scholar
- Janda M, Neale RE, Youl P, Whiteman DC, Gordon L, Baade PD: Impact of a video-based intervention to improve the prevalence of skin self-examination in men 50 years or older: the randomized skin awareness trial. Arch Dermatol 2011, 147: 799–806. 10.1001/archdermatol.2011.48View ArticlePubMedGoogle Scholar
- Linacre JM: Sample size and item calibration stability. Rasch Meas Trans 1994, 7: 328.Google Scholar
- Bond TG, Fox CM: Applying the Rasch Model: Fundamental Measurement in the Human Sciences. New York: Routledge; 2012.Google Scholar
- Fox CM, Jones JA: Uses of Rasch modeling in counseling psychology research. J Couns Psychol 1998, 45: 30. 10.1037/0022-022.214.171.124View ArticleGoogle Scholar
- Linacre J: Winstep-Rasch Model Computer Program. Version 3.69. 1.16. 2010.Google Scholar
- Wright BD, Linacre JM, Gustafson J, Martin-Lof P: Reasonable mean-square fit values. Rasch Meas Trans 1994, 8: 370.Google Scholar
- Penfield RD: DIFAS 5.0 - Differential Item Functioning Analysis System 2012.Google Scholar
- Kelly JW: Melanoma in the elderly–a neglected public health challenge. Med J Aust 1998, 169: 403.PubMedGoogle Scholar
- Pollitt RA, Geller AC, Brooks DR, Johnson TM, Park ER, Swetter SM: Efficacy of skin self-examination practices for early melanoma detection. Cancer Epidemiol Biomarkers Prev 2009, 18: 3018–3023. 10.1158/1055-9965.EPI-09-0310View ArticlePubMedGoogle Scholar
- McPherson M, Elwood M, English DR, Baade PD, Youl PH, Aitken JF: Presentation and detection of invasive melanoma in a high-risk population. Journal of the American Academy of Dermatology 2006, 54: 783–792. 10.1016/j.jaad.2005.08.065View ArticlePubMedGoogle Scholar
- Auster J, Hurst C, Neale RE, Youl P, Whiteman DC, Baade P, Janda M: Determinants of uptake of whole-body skin self-examination in older men. Behav Med 2013, 39: 36–43. 10.1080/08964289.2013.782851View ArticlePubMedGoogle Scholar
- Lim SM, Rodger S, Brown T: Using Rasch analysis to establish the construct validity of rehabilitation assessment tools. Int J Ther Rehabil 2009, 16: 251–260. 10.12968/ijtr.2009.16.5.42102View ArticleGoogle Scholar
- H-f C, Lin K-c W, C-y CC-l: Rasch validation and predictive validity of the action research arm test in patients receiving stroke rehabilitation. Arch Phys Med Rehabil 2012, 93: 1039–1045. 10.1016/j.apmr.2011.11.033View ArticleGoogle Scholar
- Andrich D: A rating formulation for ordered response categories. Psychometrika 1978, 43: 561–573. 10.1007/BF02293814View ArticleGoogle Scholar
- Andrich D: Rasch Models for Measurement. Thousand Oaks: Sage; 1988Google Scholar
- Fischer DG, Fick C: Measuring social desirability: short forms of the Marlowe-Crowne social desirability scale. Educ Psychol Meas 1993, 53: 417–424. 10.1177/0013164493053002011View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.