- Open Access
Validation of the Indonesian version of multiple sclerosis quality of life-54 (MSQOL-54 INA) questionnaire
Health and Quality of Life Outcomesvolume 17, Article number: 120 (2019)
Quality of life assessment of patients with multiple sclerosis (MS) is not routinely performed in Indonesia due to the unavailability of the validated Indonesian version of a specific instrument. The objective of this study was to transculturally adapt and validate the Indonesian version of the MSQOL-54 (MSQOL-54 INA) questionnaire.
The transcultural adaptation was conducted by performing a standardized forward-backward method. Psychometric analysis was performed by assessing the reliability (Cronbach α), internal validation (item internal consistency and item discriminant validity), and external validation by measuring the correlation with a clinical factor such as EDSS and other demographic factors.
Reliability test with Cronbach α showed good internal consistency (> 0.7) at each component, except for health perception (0.665) and social function (0.433). Construct validity using computation of correlation coefficient showed internal consistency in accordance with the original MSQOL-54 standard dimension, except for energy and role limitation due to emotional problems components. External validation with EDSS showed negative correlation on almost all components, except for sexual function, but both composite scores were statistically significant.
MSQOL-54 INA questionnaire has good internal reliability and is proven to be valid and well-accepted by Indonesian MS patients. Therefore, it can be used by Indonesian clinicians for more comprehensive MS management.
Multiple sclerosis (MS) is a progressive neurodegenerative autoimmune disorder affecting the myelin sheath of the central nervous system . In 2013, The Multiple Sclerosis International Federation (MSIF) reported that its prevalence had increased from 2.1 million in 2008 to 2.3 million in 2013 . In Indonesia, while this disease is still considered rare, its number begins to rise gradually in these recent years.
MS is predominantly diagnosed in women of productive age, in which various long-term physical and psychosocial disabilities are inevitable and have potential to impact the productivity as well as the abilities in performing activities of daily living (ADL) [3, 4]. Previous studies have proved that MS patients had a lower quality of life compared with others due to their limitation and disabilities in performing ADL [5, 6].
Quality of life (QOL) is an individual perception on their position in life following the cultural system and moral values in their living environment, which is associated with each’s vision, standards, expectations, and attention . The role of health-related QOL (HRQOL) assessment is to plan the next clinical management, to measure the outcome in the clinical study, to assess the health needs in a population, and as a source for budget allocation for health problems [8, 9]. Quality of life is a relevant outcome to be evaluated in patients with chronic diseases, such as multiple sclerosis .
In the previous years, various instruments have been developed for measuring QOL in MS patients, such as Multiple Sclerosis Quality of Life-54 (MSQOL-54), Hamburg Quality of Life Questionnaire in Multiple Sclerosis (HAQUAMS), Functional Assessment of Multiple Sclerosis (FAMS), Multiple Sclerosis Quality of Life Inventory (MSQLI),the Multiple Sclerosis International Quality of Life (MUSIQOL) and the Multiple Sclerosis Impact Scale (MSIS) [9, 11]. Only MSQOL-54 and MSQLI consists of generic HRQOL instruments and several specific questions in accordance with the clinical manifestations and targets of MS management.
One of the most commonly used instruments worldwide is the MSQOL-54 questionnaire [12, 13]. This instrument was initially developed in the United States by Vickrey et al.  and has been transcultural adapted ever since. Up to date, this instrument has been available in numerous languages, such as Italian, Turkish, French Canadian, Bosnian, Serbian, and Slovenian, in the effort to overcome the language barrier in implementing the instrument [15,16,17,18,19,20]. The MSQOL-54 is a structured, self-reported questionnaire which can generally be filled by the patient with little or no assistance. Overall, this instrument has good internal consistency and test-retest reliability. The outcome of this questionnaire reflects the physical and mental health condition in the form of physical and mental health composite score, respectively [13,14,15,16, 18].
In Indonesia, the assessment for QOL in MS has not routinely been performed due to the unavailability of Indonesian version questionnaire. This study aimed to produce the Indonesian version of MSQOL-54 (MSQOL-54 INA) that was valid and reliable to be implemented in Indonesian scientific community for clinical practice and research. Besides, this questionnaire was also expected to be used for the evaluation of MS progression in areas with inadequate diagnostic facilities. The objectives of this study were to translate the MSQOL-54 into Indonesian and assess its validity and reliability in Indonesian MS patients.
This was a cross-sectional study with the study population of all MS patients visiting dr. Cipto Mangunkusumo General Hospital, Jakarta. All MS patients attending the hospital during June–September 2018 and fulfilling the study criteria were included using consecutive non-random sampling method.
Inclusion and exclusion criteria
Inclusion criteria were (1) MS patients fulfilling the 2010 McDonalds diagnosis criteria, (2) age > 18 years old, able to read and write in Indonesian; (3) providing written consent to be recruited into the study. Exclusion criteria were subjects undergoing relapse in the previous month or having psychiatric disorders or other chronic diseases (diabetes mellitus, hypertension, etc.).
The QOL in this study was assessed using MSQOL-54 questionnaire consisting of fifty-four questions. This questionnaire comprised SF-36, the instrument for general QOL assessment, and the additional eighteen specific questions for MS patients. The examination result contained two domains of composite scores, reflecting the physical health (PH) and mental health (MH), independent to each other. The separation of domains and components were adapted from the original MSQOL-54 version proposed by Vickrey et al. .
Translation and cultural adaptation process of MSQOL-54 INA
Due to the availability of the validated Indonesian version of the SF-36 questionnaire, translation and transcultural adaptation processes were only performed on eighteen specific questions for MS patients [7, 21]. Standardized forward-backward translation method was performed for the production of the MSQOL-54 INA. The steps of the translation process were (1) forward translation of the original MSQOL-54 questionnaire to Indonesian by two groups of professional translators blinded to each other; (2) reconciliation of the translated questionnaire by a panel team, consisting of an Indonesian neurologist and psychiatrist expert in their field, to compose conceptually and semantically similar questionnaire with the original version; (3) back-translation of reconciled questionnaire to English by two different translators blinded to each other; (4) reconciliation of the translated result to produce the targeted version. The panel team then created agreement regarding the culture of the source and targeted instrument following four aspects, which is semantic, idiomatic, daily experience, and conceptual. This step produced a questionnaire which was then tested to MS patients (expert committee); (5) the reconciled questionnaire was then tested to 10 MS subjects consecutively to gain inputs from the subjects’ perception regarding the grammatical clarity, easiness to be understood, and any suggested alternate words during the test. (6) composing the last version of the questionnaire [17, 22, 23].
Collection of the data
The samples meeting the inclusion criteria were asked to fill the MSQOL-54 INA questionnaire directly attended by medical staff as necessary. During the process, the time needed to complete the questionnaire was documented as well as whether the patient needed help in reading and writing the answers were documented. Simultaneously, Expanded Disability Status Scale (EDSS) score was measured to assess the patient’s disability level.
Psychometric analysis for MSQOL-54 INA questionnaire was performed, consisting of reliability, internal validity, and external validity tests. Reliability of internal consistency was measured by using the Cronbach alpha coefficient (α) with a range of 0–1. The higher the result, the better the reliability. An instrument was defined to have consistent internal reliability if α was ≥0.7 [7, 24]. The Cronbach alpha value from the original research by Vickrey et al. was also used as a comparison.
Internal validity was assessed with content validity and construct validity. Content validity had been performed during the transcultural adaptation process by the neurologist and the psychiatrist. Construct validity was performed by executing computation of correlation coefficients, which was by measuring the correlation coefficients of each domain and its original domain (item internal consistency (IIC)) compared with the opposing domain (item discriminant validity (IDV). The IIC of > 0,4 and higher than the IDV proved the construct validity. In addition, the principal component analysis using direct Oblimin method was performed to assess whether the separation of domains in the original study by Vickrey et al. suited the condition in Indonesia.
Kaiser-Meyer-Olkin (KMO) and Bartlett sphericity test were performed beforehand. The principal component analysis was analyzed if the KMO score 0.6 and higher and the Bartlett sphericity test showed p < 0.05.
External validity was assessed by measuring the association of each component and the composite scores with EDSS score. The score of each dimension and domain of MSQOL-54 was expected to be negatively correlated with EDSS. Pearson (r) and Spearman (p) correlation coefficients were used for measuring the association of composite scores with the clinical and demographic variables .
This study involved 43 MS patients in which female subjects (79,1%) were predominant. All other characteristics of the subjects are displayed in Table 1.
Before administering the MSQOL-54 INA questionnaire, the questionnaire had already passed the content validity phase (Table 2). All subjects could comprehend the questions and do not meet any significant language barrier in general during the testing. The average time to complete the questionnaire was 14.4 ± 6.34 min. Of all subjects, 76.7% could fill the questionnaire independently. Assistance was mainly necessary for subjects with visual and upper extremities impairment. Missing data were found only on the questions regarding sexual function and satisfaction with sexual function since these questions were only filled by married subjects (n = 17).
The mean and Cronbach alpha values are shown in Table 3. The lowest mean value was found in the role limitation due to physical problems component (37.21 ± 22.82) while the highest mean value was found in the sexual function component (67.65 ± 39.52). The mean of PH composite score was 51.84 ± 15.05 whereas the mean of the MH composite score was 53.36 ± 15.57. In general, the Cronbach alpha value from this study was above 0.70 except for health perception (0.66) and social function component (0.43).
The results of internal validity assessment showed that all components have item internal consistency of > 0.40. Calculation of item discriminant validity showed that energy component, which was a part of PH composite, also showed high values at MH domain whereas role limitation due to emotional problems component showed higher values at PH composite (Additional file 1: Table S1).
In addition, principal component analysis using direct Oblimin rotations was conducted twice. The first analysis was performed with the exclusion of change in health and satisfactory with sexual function components (N = 17), which was in conjunction with the original study by Vickrey, et al.  The second analysis was performed with the additional exclusion of sexual function due to the less response from the subjects compared with the other components (Additional file 2: Table S2). The first analysis had KMO value of 0.47 whereas second analysis produced KMO value of 0.81. From the second factor analysis, there were discrepancies compared with the original domain proposed by Vickrey, et al. in which role limitation due to emotional problem was moved to the PH domain whereas health perception, energy, and social function were more suitable to the MH domain.
Correlation with EDSS score (Table 4) showed statistically significant results only at physical functioning, pain, role limitation due to physical problems, role limitation due to emotional problems, PH composite score, and MH composite score components.
Correlation between composite scores and other clinical and demographic factors, such as age, duration of disease, and number of relapses in the recent year showed no significant correlation (Table 5).
Main findings of the study
Almost all patients could complete the questionnaire within the recommended range of 11–18 min , which described that the questions were easy to understand and manageable. The missing data in this study could be minimized as little as possible with the presence of clinicians who could help the subjects as needed during the test. However, missing data were found in sexual function and satisfaction with sexual function components since only those who were married were willing to answer those components. This condition was closely related to local cultural perception which believed that sexual matters were taboo, especially for unmarried individuals. For the married individuals, the questions regarding sexual were distressing, too private or sensitive to be answered. This statement was in conjunction with the good result of sexual function and satisfaction with sexual function components in this study.
In general, this study found high reliability value, which showed that this questionnaire was internally consistent. The low Cronbach α scores on health perception and social function components could result from the less number of questions assessing those components; for example, the social function component consists of only three questions.
From the internal validity assessment, satisfactory results were obtained. Observing the internal validity using principal component analysis, there were several discrepancies between the domain analysis and the proposed domain by Vickrey, et al. These findings could still not be explained in this study, but a larger sample was still needed to observe the consistencies of these findings as these two components were those having the least reliability score.
Assessing the external validation using EDSS scores, the negative correlation was found at almost all components, except for sexual function and satisfaction with sexual function components. This might be due to the perception of MS patients’ population in Indonesia who perceived questions regarding sexual problems as taboo, leading to potentially unreported issues. Physical health-related questions were more statistically significant in correlation with EDSS since EDSS was the most common clinical assessment used for the physical disability assessment of MS patients [5, 25]. Similar results were also shown by the previous study by Brunet et al. which found that the disability assessed with EDSS only had the correlation with physical function domain at RAND-36 questionnaire .
Comparison with other similar studies
In accordance with the studies by Idiman E et al. in Turkish , Catic T et al. in Bosnia and Herzegovina , Pekmezovic T et al. in Serbian , Stern B et al. in Slovenian , and Solari A et al. in Italian , the questions regarding sexual function and satisfaction with sexual function were the most potential missing data. This problem arose due to the feeling of embarrassment in admitting the issues regarding sexual, which is in accordance with the respective culture. However, different from the other studies, this study could not collect many subjects to fill this part due to the small MS population in Indonesia, most of which were still unmarried.
Compared to the original study conducted by Vickrey et al. in the United States, there were similarities that health perception and social function domain had the lowest Cronbach α . However, the value in this study was less than 0.7, which was similar with the studies conducted in Serbia, Slovenian, Israel, and Iran [5, 19, 20, 27]. Stern et al. explained that the low Cronbach α value at health perception component might be caused by the nature of the questions which included wide and unspecific health evaluation aspects which led to relatively lower consistency .
Regarding the analysis of IIC and IDV, this study found that energy and role limitation due to emotional problems component were more suitable to show MH domain rather than the PH domain. These results were also reported by previous psychometric studies [5, 20, 27]. This described that in those population, as well as in Indonesian MS population, low energy score was more perceived as mental problems whereas role limitation due to emotional problems was more perceived as physical problems in conjunction with role limitation due to physical problems.
In view of the analysis of principal component analysis, there was only a study focusing on this analysis. In this study by Stern B, et al. in Slovenian , the discrepancies between domains and components were only observed in energy and role limitation due to emotional problems. In contrast, besides those two components, the component of health perception and social function was also assigned into different domain compared with the original domain proposed by Vickrey et al. . This result was not found on a similar study by Stern B et al. The small sample size and the lower reliability number may explain this discrepancy, but further research was needed.
The study of Solari A et al. in Italia, Idiman E, et al. in Turkish, and Catic C, et al. in Bosnia supported the correlation of EDSS and PH composite score in this study [15, 16, 18]. These studies also found that EDSS was negatively correlated with the PH composite score, which supported the fact that EDSS described the health in physical aspects.
In this study, the correlation between composite scores and other clinical and demographic factors, such as age, duration of disease, and the number of relapses in the past one year did not show significant correlation. Similar results were found in a study in Turkey in which there was no significant correlation between composite scores and age, gender, education level, marital status, and health insurance .
Limitations and strengths of the study
This study provided a readily-used of MSQOL-54 INA which can be implemented for the Indonesian population. The study results also proved that this instrument was valid and reliable, which can be trusted by potential users. In addition, this study also provided psychometric properties of MSQOL-54 INA questionnaire in Indonesia MS population. However, this study had a small sample size, which may impact on the reliability score for some components. This limitation was inevitable because this disease was still rare even though the study was conducted in the national referral hospital in Indonesia. Additionally, confirmatory factor analysis was not applied in this study. Similar studies with more subjects in the future were needed to prove the consistency of this study result.
Another limitation of this study was associated with the content validity process, in which an independent third party did not supervise the translation process as proposed by Acquardro C et al. .
Implications of the study results for clinical management of MS patients
This is the first study focusing on the specific QOL instrument for MS patients. This instrument can generally be used for Indonesian MS patients with good validity and reliability. Besides, this validated questionnaire may become one of the tools to evaluate the success of the therapy as well as the baseline for the clinician to focus not only on the patients’ clinical aspects but also on the medical rehabilitation, cognition, and psychiatric issues.
Suggestions on future research in the field
This study had produced an adapted MSQOL-54 INA questionnaire with well-considered content validity and high reliability in the aspect of internal consistency on most components. Further studies with larger sample size are needed to prove the internal consistency of some components, particularly health perception and social function that had lower Cronbach alpha value and sexual function that had a smaller sample size. In addition, this instrument can also be used as a measure for assessing the success of therapy, which has not been analyzed in this study. Further additional analysis with confirmatory analysis method was also recommended to be performed with larger sample size.
The Indonesian version of the MSQOL-54 questionnaire is easy to be completed and well-accepted by Indonesian MS patients. Psychometric analysis showed entirely satisfactory results. Those support the use of this questionnaire for quality of life assessment in relation with MS patients’ health in Indonesia. This questionnaire is expected to be able to help clinicians to manage MS patients comprehensively.
Availability of data and materials
The datasets used and/or analysed during the current study are available.
from the corresponding author on reasonable request.
Activities of daily living
Expanded Disability Status Scale
Hamburg Quality of Life Questionnaire in Multiple Sclerosis
Health-related Quality of Life
Item discriminant validity
Item internal consistency
Multiple Sclerosis Impact Scale
Multiple Sclerosis Quality of Life-54
Multiple Sclerosis International Quality of Life
Quality of life
Popescu BFG, Lucchinetti CF. Pathology of demyelinating diseases. Annu Rev Pathol: Mechanisms Dis. 2012;7(1):185–217.
Browne P, Chandraratna D, Angood C, Tremlett H, Baker C, Taylor BV, et al. Atlas of multiple sclerosis 2013: a growing global problem with widespread inequity. Neurology. 2014;83(11):1022–4.
Göksel Karatepe A, Kaya T, Günaydn R, Demirhan A, Çe P, Gedizlioğlu M. Quality of life in patients with multiple sclerosis: the impact of depression, fatigue, and disability. Int J Rehabil Res. 2011;34(4):290–8.
Rezapour A, Almasian Kia A, Goodarzi S, Hasoumi M, Nouraei Motlagh S, Vahedi S. The impact of disease characteristics on multiple sclerosis patients’ quality of life. Epidemiol Health [Internet]. 2017;39 Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5434226/.
Miller A, Dishon S. Health-related quality of life in multiple sclerosis: the impact of disability, gender and employment status. Qual Life Res. 2006;15(2):259–71.
Klevan G, Jacobsen CO, Aarseth JH, Myhr K-M, Nyland H, Glad S, et al. Health related quality of life in patients recently diagnosed with multiple sclerosis. Acta Neurol Scand. 2014;129(1):21–6.
Baumstarck K, Boyer L, Boucekine M, Michel P, Pelletier J, Auquier P. Measuring the Quality of Life in Patients with Multiple Sclerosis in Clinical Practice: A Necessary Challenge. Mult Scler Int [Internet]. 2013 [cited 2019 Mar 24];2013. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3603557/.
Whoqol Group. Development of the World Health Organization WHOQOL-BREF Quality of Life Assessment. Psychological Medicine. 1998;28(3):551–8.
Benito-León J, Manuel Morales J, Rivera-Navarro J, Mitchell AJ. A review about the impact of multiple sclerosis on health-related quality of life. Disabil Rehabil. 2003;25(23):1291–303.
Hopman WM, Harrison MB, Coo H, Friedberg E, Buchanan M, VanDenKerkhof EG. Associations between chronic disease, age and physical and mental health status. Chronic Dis Can. 2009;29(2):10.
Hancinova V, Simor L. Analyses of measuring tools comparing the quality of life in patients with multiple sclerosis. Clin Soc Work Health Interv. 2016;7(1):64–72.
Hadgkiss EJ, Jelinek GA, Weiland TJ, Rumbold G, Mackinlay CA, Gutbrod S, et al. Health-related quality of life outcomes at 1 and 5 years after a residential retreat promoting lifestyle modification for people with multiple sclerosis. Neurol Sci. 2013;34(2):187–95.
Drulovic J, Bursac LO, Milojkovic D, Tepavcevic DK, Gazibara T, Pekmezovic T. MSQoL-54 predicts change in fatigue after inpatient rehabilitation for people with multiple sclerosis. Disabil Rehabil. 2013;35(5):362–6.
Vickrey BG, Hays RD, Harooni R, Myers LW, Ellison GW. A health-related quality of life measure for multiple sclerosis. Qual Life Res. 1995;4(3):187–206.
Solari A, Filippini G, Mendozzi L, Ghezzi A, Cifani S, Barbieri E, et al. Validation of Italian multiple sclerosis quality of life 54 questionnaire. J Neurol Neurosurg Psychiatry. 1999;67(2):158–62.
Idiman E, Uzunel F, Ozakbas S, Yozbatiran N, Oguz M, Callioglu B, et al. Cross-cultural adaptation and validation of multiple sclerosis quality of life questionnaire (MSQOL-54) in a Turkish multiple sclerosis sample. J Neurol Sci. 2006;240(1–2):77–80.
Acquadro C, Lafortune L, Mear I. Quality of life in multiple sclerosis: translation in French Canadian of the MSQoL-54. Health Qual Life Outcomes. 2003;1:70.
Catic T, Culig J, Suljic E, Masic A, Gojak R. Validation of the disease-specific questionnaire MSQoL-54 in Bosnia and Herzegovina multiple sclerosis patients sample. Med Arch. 2017;71(2):103–6.
Pekmezovic T, Kisic Tepavcevic D, Kostic J, Drulovic J. Validation and cross-cultural adaptation of the disease-specific questionnaire MSQOL-54 in Serbian multiple sclerosis patients sample. Qual Life Res. 2007;16(8):1383–7.
Stern B, Hojs Fabjan T, Rener-Sitar K, Zaletel-Kragelj L. Validation of the Slovenian version of multiple sclerosis quality of life (MSQOL-54) instrument. Zdr Varst. 2017;56(4):260–7.
Novitasari L, Perwitasari DA, Khoirunisa S. Validity of short form 36 (SF-36) Indonesian version on rheumatoid arthritis patients. Jurnal Kedokteran dan Kesehatan Indonesia. 2016 Jan 20;7(3):80–6.
Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the Process of Cross-Cultural Adaptation of Self-Report Measures. Spine. 2000;25(24):3186–91.
Acquadro C, Conway K, Hareendran A, Aaronson N. Literature review of methods to translate health-related quality of life questionnaires for use in multinational clinical trials. Value Health. 2008;11(3):509–21.
Schmitt TA. Current methodological considerations in exploratory and confirmatory factor analysis. J Psychoeduc Assess. 2011;29(4):304–21.
Kurtzke JF. Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology. 1983;33(11):1444–1444.
Rudick RA, Miller DM. Health-related quality of life in multiple sclerosis: current evidence, measurement and effects of disease severity and treatment. CNS Drugs. 2008;22(10):827–39.
Ghaem H, Haghighi AB, Jafari P, Nikseresht AR. Validity and reliability of the Persian version of the multiple sclerosis quality of life questionnaire. Neurol India. 2007;55(4):369.
The authors were grateful to members of Yayasan Multiple Sclerosis Indonesia (Indonesia Multiple Sclerosis Foundation) for participating in this study. Thank you to Sarah Shafa Marwadhani, MD and Ausi Mutiara, MD for managing the research schedule. We also thank Prof. Barbara Vickrey, PhD who has given permission for us to translate and validate MSQOL-54 into Indonesian version.
This study was funded by a grant for indexed international publication for Universitas Indonesia student’s dissertation/thesis (PITTA/694/FK/2018).
Ethics approval and consent to participate
This study has been approved by Health Research Ethics Committee of Faculty of Medicine, Universitas Indonesia. The subjects were free to not participate in the study or drop out of the study without affecting their current treatment. All data and examination results were confidential.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.