Cross-cultural adaptation, reliability and validity of the Spanish version of the upper limb functional index
© Cuesta-Vargas and Gabel; licensee BioMed Central Ltd. 2013
Received: 19 April 2013
Accepted: 25 July 2013
Published: 26 July 2013
The Upper Limb Functional Index (ULFI) is an internationally widely used outcome measure with robust, valid psychometric properties. The purpose of study is to develop and validate a ULFI Spanish-version (ULFI-Sp).
A two stage observational study was conducted. The ULFI was cross-culturally adapted to Spanish through double forward and backward translations, the psychometric properties were then validated. Participants (n = 126) with various upper limb conditions of >12 weeks duration completed the ULFI-Sp, QuickDASH and the Euroqol Health Questionnaire 5 Dimensions (EQ-5D-3 L). The full sample determined internal consistency, concurrent criterion validity, construct validity and factor structure; a subgroup (n = 35) determined reliability at seven days.
The ULFI-Sp demonstrated high internal consistency (α = 0.94) and reliability (r = 0.93). Factor structure was one-dimensional and supported construct validity. Criterion validity with the EQ-5D-3 L was fair and inversely correlated (r = −0.59). The QuickDASH data was unavailable for analysis due to excessive missing responses.
The ULFI-Sp is a valid upper limb outcome measure with similar psychometric properties to the English language version.
KeywordsUpper limb Psychometrics Outcome measure Spanish
Health outcome assessment is an important component of patient care. Patient reported outcome (PRO) measures [1, 2] are primarily used to objectively reflect a patient’s health or functional status at any given time and to detect changes in this status as a response to an intervention . This assists the clinicians’ understanding of the effects of a condition or disease on a patient’s capabilities, functioning and symptoms . Traditionally, clinical signs and symptoms were used as outcomes and studies that wished to reflect patient health status employed generic quality of life measures. However, over the last two decades region specific PROs that represent the three key body regions, of the upper limb, lower limb and spine have been used more frequently in the assessment of a musculoskeletal patient’s functional status . The Upper Limb Functional Index (ULFI) is a recent example of this. It was initially published in a dichotomous format  then updated and modified to a three-point scale . These regional PRO measures are argued to provide greater sensitivity and improved representation of the individual’s functional status than joint or condition specific measures [7–9]. Though various region specific PROs have been used to assess upper-limb functional status, it is accepted that ‘there is no gold standard [8, 10–12]. These tools also guide treatment decisions and assess the effectiveness of interventions, including direct comparisons between pre- and post-operative status, and subsequently during rehabilitation .
There are several regional upper limb PROs that are advocated and recommended by national associations or organizations around the world for Physical, Occupational and Hand Therapy, Orthopedics and Surgery. This is through their respective institutional websites and subject related Journals. The Disability of Arm, Shoulder and Hand (DASH) [14–16] and the shortened QuickDASH  version are two prominent examples. However the DASH has  excessive internal consistency, with a documented Cronbach Alpha value >0.95 [6, 8, 12, 19], the recognized upper limit for ‘item redundancy’ or the presence of too many items being too similar to enable a valid change to be detected . The factor structure has also been challenged [21–23] which further questions validity. A questionnaire must provide a single-factor structure so that it can be summated to provide a single or summary score. It cannot be influenced by other constructs such as psychological or emotional status [24, 25]. The QuickDASH, as derived from 11extracted DASH items, has also been challenged. The factor structure has not been consistently shown as one-dimensional [7, 26–28], which raises concerns on its validity; and it has been found to underestimate symptoms and overestimate disability . Several other regional PROs are also advocated. The Upper Extremity Functional Scale (UEFS)  which has been shown to lack reliability and methodological criteria [5, 31]. The Upper Extremity Functional Index (UEFI)  which is criticized due to it development methodology using a specific workers population in a small data set with a high average age [6, 8]. It has been subsequently independently validated  but uses a matrix response format which has a high error tendency for completion and scoring . It is also reported to have no advantage over the DASH for measuring clinical change . The Neck and Upper Limb Index (NULI)  which has been demonstrated as having item-redundancy from excessive internal consistency  and development concerns . There are also a significant number of joint and condition specific scales but these cannot be used regionally as they do not consider the upper limb as a single kinetic chain [8, 18].
The ULFI with a three-point option improved both the responsiveness and practicality . It was shown to have strong psychometric properties for reliability, validity, responsiveness, error measurement, and internal consistency that approximated or exceeded those of the DASH and UEFS . The ULFI was shown to have strong psychometric properties for reliability, validity, responsiveness, error measurement, and internal consistency that approximated or exceeded those of the DASH and UEFS . The ULFI’s practical characteristics of brevity, ready transferability to a 100-point scale, ease and rapidity of completion and scoring reinforced the methodological consistency [7, 26, 38]. This comparative analysis in separate studies has provided scope to suggest the ULFI was preferred to the criterion tools of the DASH [6, 17, 38], UEFS  and QuickDASH [7, 26] due to a combination of enhanced psychometric and practical characteristics. A further consideration was that the ULFI has a single factor structure  and an acceptable level of internal consistency in all studies.
The ULFI has also been accepted by the international PRO database  ‘PROQUOLID’. A Spanish version of the ULFI had not been developed or validated to date. This is significant given that Spanish is one of the five most spoken languages and the second widest geographically . Consequently, a Spanish version of the ULFI (ULFI-Sp) was developed to meet this need. The four published studies to date investigating the ULFI suggest the practical characteristics along with the responsiveness and error range [4, 8], are consistently defined [6, 7, 26, 38]. Therefore the aims of this paper were: to describe the process of translation and cross-cultural adaptation of the original ULFI to Spanish; and to subsequently assess the four critical psychometric properties of reliability, factor structure, internal consistency, and concurrent criterion validity for clinical use with Spanish speakers.
Materials and methods
A two stage observational study was conducted involving: initial translation and cross-cultural adaptation of the ULFI  to Spanish; then subsequent prospective concurrent completion with a general health questionnaire, the Euroqol Health Questionnaire 5 Dimensions (EQ-5D-3 L)  and an upper limb regional criterion, the QuickDASH-Sp . A physical therapy outpatients’ population was used for evaluation of the ULFI-Sp’s four critical psychometric properties. TheEQ-5D-3 L was used to clarify the participants’ health status and provide a criterion standard for health comparison. The QuickDASH-Sp was also completed by all participants but there were excessive levels of missing responses that unfortunately rendered the data not useable for analysis and reporting in this study. This may have been partially attributed to the QuickDASH being the final questionnaire in the completion sequence and subsequent patient burden due to the number of questionnaires. All questionnaires were completed and two assessors performed the initial and any subsequent assessments, but were blinded to baseline scores in order to ensure independent collection of outcome data.
Translation of the ULFI to the “ULFI-Sp”
Participants, setting and procedure
Demographic characteristics and frequency of diagnosis of the study population
49 ± 21
48 ± 23.2
51 ± 24.1
49 ± 15.5
50 ± 17.8
Injured at work
45 ± 15.5
56 ± 19.5
50 ± 21.5
Distribution of upper-limb conditions
Carpal Tunnel Syndrome
The ULFI is a 25-item 3-point response option PRO that is scored by simple addition of the responses then converted to a 100 point percentage scale. Up to two missing responses are permitted . The EQ-5D-3 L is a widely used six item non-disease-specific questionnaire. It has five 3-point response options for different quality-of-life dimensions and a sixth question on overall perceived health-related status. The EQ-5D-3 L-Visual Analogue Scale (VAS) is used to reflect the respondent’s self-rated health status on a 100 mm scale and ranked from ‘Best Imaginable’ (100) to Worst Imaginable’ (0). The EQ-5D-3 L has been demonstrated as valid and reliable in the Spanish population . Reliability was performed using the Intraclass Correlation Coefficients Type 2,1 (ICC2.1) test-retest methodology in a randomly selected subgroup of the full sample (n = 35, 46 ± 62 years, 61.1% female). Their presenting conditions were representative of the five categories of the full sample and expressed with a 95% CI using scores on the ULFI-Sp from the participants at baseline and on repetition at day seven.
Descriptive analyses were applied to calculate means and standard deviations of demographic variables (Table 1). Distribution and normality were determined by one-sample Kolmogorov-Smirnov tests (significance >0.05). Construct validity and factor structure were determined through the use of questionnaire principal component analysis (PCA) with the a-priori requirements for extraction being the satisfaction of all three points: screeplot inflection point, Eigenvalue > 1.0 and accounting for >10% of variance. We satisfied the recommended minimum ratio of five participants-per-item . Internal consistency of the scale items was determined from Cronbach's α coefficients as calculated at an anticipated value range of 0.80-0.95 [20, 45]. Student's t-test will be developed to check the items behave the same way for men and women.
An external validation scale of the EQ-5D-3 L and EQ-5D-3 L-VAS was used with bilateral correlations to establish if status had changed and an error range of 0 ± 10% was allowed in determining the test-retest reliability.
The MDC 90 analysis was performed as described by Stratford . The standard error of the measurement (SEM) was calculated using the formula: SEM = s√(1–r), where s = the mean and standard deviation (SD) of time 1 and time 2, r = the reliability coefficient for the test and Pearson’s correlation coefficient between test and retest values. Thereafter the MDC90 was calculated using the formula: MDC90 = SEM × √2 × 1.96.
Criterion validity was determined through the concurrent use of the EQ-5D-3 L total score and EQ-5D-3 L-VAS scores with the ULFI-Sp measures. The QuickDASH was unavailable due to excessive completion errors. The Pearson’s r correlation coefficient used the criteria of poor (r < 0.49), fair (r = 0.50-0.74) and strong (r > 0.75) .
Sample size was determined from the previous ULFI studies [7, 8, 26] indicating a minimum of 106 patients were required to ensure an 80% chance of achieving the required statiscal power for concurrent validity, internal consistency and factor structure allowing for 15% attrition (p < 0.05) . For reliability a minimum of n = 29 was required.
All statistical analyses were conducted using the Statistical Package for Social Science version 17.0 (SPSS 17.0) for Windows and LISREL 8.80 .
Ethical clearance was approved by the Tribunal of Review of Human Subjects at the University of Malaga.
Characteristic descriptive of the participants
The demographic and frequency of diagnosis of the study sample are detailed in Table 1. The ULFI was translated and back translated with consideration of the Spanish cultural linguistic adaptation to provide the new ULFI-Sp questionnaire without language difficulties or other conceptual misunderstanding. (Additional file 1). The normative values from ULFI-Sp score were mean and standard deviation of 5.88 ± 5.6 points. The ULFI-Sp showed no missing responses and showed a high degree of internal consistency, as illustrated by the high Cronbach value (α = 0.94) with an individual item range of 0.92 to 0.96. The test-retest reliability was high at (r = 0.93) with an individual range of 0.92 to 0.95. The total score was accounted for, not the individual questionnaire response items. Measurement error was determined from SEM and MDC90 being respectively at 3.52% and 8.03%. No significance differences were found between gender in the item responses.
Factor loading items for the one-factor solution, average score and discrimination indices of items
Item average score
Item discr indices
Stay at home most of time
Change positions frequently
Avoid heavy jobs
Rest more often
Get others to do things
Pain almost all the time
Lifting and carrying
Home/family duties and chores
Sleep less well
Assistance with personal care, hygiene
Regular daily activity work/social
More irritable/bad tempered
Feel weaker or stiffer
Arm in shirt sleeve/dressing
Writing/using keyboard or mouse
Do things at/above shoulder
Eating: using utensils
Hold or moving dense objects
Drop things-minor accidents
Use other arm more often
Difficult button key coins taps
Open, hold, press, or push
Criterion validity determined from the relationship between the ULFI-Sp and EQ-5D-3 L (r = −0.59) and EQ-5D-3 L-VAS (r = −0.51) indicated a fair and inverse correlation. The QuickDASH-Sp had greater than >30% of missing responses affecting 41 of the 126 respondent questionnaires. This rendered invalid any reporting of criterion validity or factor structure with this tool.
The ULFI was translated to provide a cross-cultural adaptation to the Spanish language. The translation process ensured the conceptual equivalence of the used terms. This provided accessibility to the ULFI for the second largest geographically used language. The psychometric properties, specifically construct and criterion validity, reliability and internal consistency were determined independently and found to be strong and the single factor structure indicated that a single summated score could be used .
The cross-cultural adaptation of the ULFI into Spanish enables clinicians in Spanish speaking settings to compare outcomes following their treatments and interventions affecting the upper limb. The procedure of cross-cultural adaptation of a scale has been used in previous studies for different scales to be applied in the Spanish context [43, 44]. The ULFI was translated into Spanish with no difficulty and the process complied with these standardized procedures. It is critical to employ research measures that are valid and reliable but they must also be both culturally and linguistically appropriate.
The one-factor solution that emerged in the factor analysis accounted for a significant proportion of variance and showed evidence that supports the presence of construct validity. A one-factor solution is critical if a PRO is to be used with a single summated score and subsequently reflect the construct for which it is primary used – that of representation of the functional status of the upper limb as a single kinetic chain [25, 48]. Any study using confirmatory factor analysis would be advantageous.
Two of the three other critical psychometric properties of the ULFI-Sp were both shown to be high and well supported. Internal consistency analysis showed a level of 0.94 that sits below the accepted 0.95 thresholds for item reducndancy . This notably high level, when taken in context with the presence of the factor structure item loading Eigenvalues above 1.0, would indicate the potential for a shortened version of this tool. This supports the findings of the previous research where redundancy was not present but potential shortening was recommended, perhaps to as low as 10 items . The test-retest reliability or reproducibility was also high with the values (0.92 to 0.95) in-line with those found for the original instrument (0.90 to 0.96) .
The criterion validity demonstrated only a fair degree of differential association with the EQ-5D-3 L and EQ-5D-3 L-VAS. This is considered to support the criterion validity of the ULFI-Sp however as it is not as strong as findings in the previous research that used a region specific criterion standard that was advocated as representative of the upper limb kinetic chain. The QuickDASH criterion was not available for criterion comparison due to the excessive number of missing responses. This may have been partially attributed to patient burden as the QuickDASH was the final questionnaire completed. Consequently, this study shows that the ULFI-Sp will be of value in the assessments of patients with upper limb disorders in clinical and research settings.
Study strengths and weaknesses
The strengths of the study include the prospective nature adequate number of subjects, the inclusion of consecutive patients and the limited selection bias [24, 32]. The results for the psychometric properties support the findings of the previous research on the original English version of the ULFI indicating broad cross-cultural adaptions would be appropriate to other diverse cultural and linguistic groups. The ULFI-Sp also provides a means of comparing upper limb health state in Spanish-speaking patients with their English-speaking counterparts in countries with a high Spanish population such as the United States.
The study limitations include the lack of longitudinal data regarding other psychometric properties including responsiveness or sensitivity to change and error scores as a representation of a minimal clinically important difference. The determination of construct validity through the use of factor analysis represents only one possible statistical method of testing. A construct is not restricted to one set of observable indicators or attributes and additional indicators will need to be considered in future research. Similarly, the practical characteristics were not determined. The inability to use the QuickDASH-Sp data collected in the clinical setting due to excessive missing responses, potentially from patient burden due to being the final questionnaire, resulted in no direct comparison with a regional upper limb criterion, a requirement for future studies. Patient burden from completing numerous questionnaires is an area for future consideration. A potential source of bias was that the scales were provided always in the same order. Finally, the inclusion of Hispanic/Latino/ South American participants in future studies could potentially provide confirming or conflicting linguistic information due to the cultural and ethnic difference with respect to the Spanish participants.
The psychometric properties of the Spanish version of the ULFI are reported here for the first time. The determined values were satisfactory and supportive of the findings of the ULFI as a 3-point scale, particularly in the areas of internal consistency, factor structure and reliability. Consequently, the ULFI-Sp may be useful in Spanish-speaking populations and for making cross-ethnic and cross-cultural comparisons in other English speaking countries with a high Spanish-speaking population.
The authors are grateful to the volunteers for their participation and the PMDT, Malaga. This study received a grant from the Research Office of the University of Malaga.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.