Validation of the Turkish version of the quality of recovery-40 questionnaire
Health and Quality of Life Outcomes volume 12, Article number: 8 (2014)
The Quality of Recovery-40 questionnaire (QoR-40) is a self-rated questionnaire used to assess the postoperative recovery quality and health status of patients in the early stages following surgery; however, there is no Turkish version of the QoR-40. The aim of this study was to assess the reliability, validity, and responsiveness of the Turkish version of the QoR-40 (QoR-40 T).
After the approval of the ethics committee, a total of 137 patients completed the questionnaire during the preoperative period, on the third day, and one month after surgery. The quality of life was evaluated by using a health-related quality of life questionnaire (Short-Form Health Survey-36; SF-36) on the third day and one month after surgery. Reliability, feasibility, and validity were assessed to validate the QoR-40 T.
The Cronbach’s alpha of the global QoR-40 T on the third day after surgery was 0.936. A positive moderate correlation was obtained between the physical comfort, emotional state, physical independence, and pain dimensions of the QoR-40 T and the physical component summary, mental health, physical functioning, and bodily pain subscales of the SF-36 on the third day after surgery, respectively (physical comfort - physical component summary, ρ = 0.292, p = 0.001; emotional state - mental health, ρ = 0.252, p = 0.003; physical independence - physical functioning, ρ = 0.340, p < 0.01; pain - bodily pain, ρ = 0.381, p < 0.01). The standardized responsive mean of the total QoR-40 T was 0.62.
The QoR-40 T showed satisfactory reliability and validity in evaluating the quality of recovery after surgery in the Turkish population.
Currently, quality is a concept of growing interest in anesthesia, and recovery quality after anesthesia has been assessed as an important measure for evaluating the early postoperative health status of patients [1, 2]. The quality of recovery score (QoR-40), which was defined by Myles et al. in 2000, is a self-rated questionnaire consisting of 40 items. It comprises five subscales: comfort, emotion, patient support, physical independence, and pain .
The QoR-40 score has been applied in anesthesia and in general, neurological, cardiac, and knee surgery [3–7]. Furthermore, the 36-Item Short Form Health Survey (SF-36), which is a general, health-related questionnaire, has a multidimensional structure that represents most physical and mental aspects of the patient [8–10]. Various studies have revealed that the QoR-40 score showed a substantial correlation with the SF-36 score in patients after cardiac surgery [3, 4]. Moreover, Bost et al. demonstrated that the 8-Item Short-Form Health Survey (SF-8), used with a QoR-40 questionnaire to assess the postoperative health status in patients after knee surgery, yielded a satisfactory psychometric evaluation .
The QoR-40 can be accepted as an adequate tool to elucidate the impacts of anesthesia and surgery on postoperative recovery and quality of life . However, a systematic search of the literature revealed the absence of a Turkish version of the QoR-40 questionnaire (QoR-40 T) in clinical use. The current study was conducted to evaluate the reliability, validity, and responsiveness of the Turkish adapted version of the QoR-40.
After the approval of the Gaziosmanpasa University Medical School Ethics Committee (13 − KAEK − 093), patients were informed about the study and written consents for participation were obtained. Patients who were admitted to the outpatient anesthesia unit for preoperative examinations associated with a scheduled elective surgery in general, orthopedic, and otorhinolaryngological surgery under general anesthesia, from April 2013 to July 2013, were included in the study. Those under 18 or over 80 years of age, as well as those who had an alcohol or substance addiction problem, refused to participate in the study, had an American Society of Anesthesiologists (ASA) score of III or IV, or were non-cooperative were excluded from the study.
The quality of recovery score
The QoR-40 is a self-rated questionnaire that consists of 40 items to evaluate the pain levels and physical and emotional state of patients, comprising five subscales: emotional state (n = 9), physical comfort (n = 12), patient support (n = 7), physical independence (n = 5), and pain (n = 7). Each item is scored on a five-point Likert scale ranging from 1 to 5. The scores for the subscales are given by the sum of the corresponding items, and the total score is computed by a summation of all items. The total score ranges from 40 to 200. In order to design the QoR-40 T, we first obtained development authorization from the original author.
The original version of the QoR-40 was translated from English to Turkish by three individuals, including a native English speaker (university graduate, living in Turkey for 3 years) and two academics from the Department of English Language. The Turkish version of the QoR-40 was back-translated into English by two different English linguistic academicians from the Department of English Language. Thereafter, each question was rendered in its most comprehensible form by a committee of three people which consisted of one health professional fluent in English, a Turkish linguist, and an English linguist.
After obtaining the approval of the original author for the backward translation, a pilot test was conducted on 10 randomly selected patients. The pilot testing revealed that all items in the questionnaire were understandable to Turkish patients. With this result, the Turkish version of the QoR-40 was finalized.
Patient characteristics, including age, gender, marital status, and education, were recorded. To evaluate the health status, the QoR-40 T was used during the preoperative period, on the third day after surgery, and one month after surgery. The post-discharge quality of life from the third day and one month after surgery were assessed using the Turkish version of the SF-36 questionnaire. The SF-36 consists of 36 items and standardized response choices, organized into eight multi-item scales, including physical functioning (PF), role limitations due to physical health problems (RP), bodily pain (BP), general health perceptions (GH), vitality (VT), social functioning (SF), role limitations due to emotional problems (RE), and general mental health (MH). It is summarized in two component summary scores, the Physical Component Summary (PCS) and the Mental Component Summary (MCS). All subscale scores range from 0 to 100, with higher scores indicating higher levels of functioning or well-being.
The Kaiser-Meyer-Olkin measure of sampling adequacy and Bartlett’s test of sphericity were used to confirm the assessment of the factor analysis for these items. A principal components analysis was conducted for the construct validity of the QoR-40 T. For the basis of this analysis, the components were extracted with an eigen value of greater than 1. Varimax rotation with Kaiser normalization was selected, and the rotation converged in 7 iterations, with values below 0.40 being suppressed. Additionally, the correlation between the QoR-40 T score on the third-day and the duration of hospitalization, and the QoR-40 T score on the third-day between men and women, were compared to support the construct validity. The internal consistency of the QoR-40 T was also evaluated by using Cronbach’s alpha (α) for the global QoR-40 T and subscale scores. A Cronbach’s alpha coefficient of 0.70 to 0.95 was considered to be acceptable . Item-total correlation coefficients were used to assess the association between the scores. To measure the test-retest reliability, the QoR-40 T was performed in the same patients on the third day and one month after their operations. The postoperative third-day total QoR-40 T score was compared with the recovery visual analog scale (VAS) to assess the concurrent validity (Additional file 1). In addition, predictive validity was determined by assessing the association between the related dimensions of the questionnaires: physical comfort, emotional state, physical independence, pain dimensions of the QoR-40 T and the physical component summary, mental health, physical functioning, and the bodily pain subscales of the SF-36, respectively. This was evaluated by using the Spearman correlation coefficients for each measurement period.
Responsiveness, or sensitivity to clinical change, was measured by evaluating the standardized response mean (SRM). The SRM is calculated by dividing the mean change in the score by the standard deviation (SD) of the change [13, 14].
Normality and variance were tested using the One-Sample Kolmogorov-Smirnov, skewness and kurtosis, histograms, and Q-Q plots for each variable. Quantitative data were presented as the means and standard deviation, and qualitative data as the frequency and percentage. Associations were performed by using the Spearman rho correlation coefficient (ρ). Analyses were completed by using the Statistical Package for Social Sciences (SPSS Inc., Chicago, IL) version 20.0 program. The statistical significance for all analyses was set at p < 0.05.
Patient characteristics are presented in Table 1. Of the 180 patients approached in the present study, there were 16 refusals (recruitment rate = 0.91); another 27 patients which had been discharged from the hospital could not be reached to complete their questionnaires (completion and return rate = 85%). Thereafter, a total of 137 patients were accepted to participate in the study and completed the questionnaires. The SF-36 was administered to all patients one month after surgery, and all of them completed it. Most of the patients were able to complete the QoR-40 T questionnaire form without any assistance. The mean duration of hospitalization was 3.93 ± 1.29 (IQR 3–5 days).
Reliability and validity
The Cronbach’s alpha (α) values and the Spearman rho (ρ) correlation coefficients of physical comfort, emotion, physical independence, patient support, and pain, with the global QoR-40 score on the third day after surgery, were 0.902, 0.858; 0.878, 0.769; 0.858, 0.603; 0.926, 0.607; and 0.825, 0.680; respectively (Table 2). In addition, the Cronbach’s alpha of the global QoR-40 T on the third day after surgery was 0.936. The item-total correlation coefficients on the third day after surgery ranged from 0.299 to 0.687. Test-retest reliability (Spearman’s correlation coefficient) of the QoR-40 T three days after surgery was 0.658 (p < 0.01). A positive moderate correlation was obtained between the related subscales of the QoR-40 T and SF-36 on the third day and one month after surgery. The physical comfort, emotional state, physical independence, and pain dimensions of the QoR-40 T appeared to be related to the physical component summary, mental health, physical functioning, and bodily pain subscales of the SF-36, respectively (Table 3). Moreover, a positive significant correlation was observed between the total QoR-40 T score and that on the third day after surgery, and the recovery VAS (ρ = 0.468, p < 0.01).
The mean preoperative QoR-40 T was 182 (with an SD of 10.4), and after surgery it was 171 (with an SD of 20). Changes in the QoR-40 T and the subscales before and three days after surgery are presented in Table 4. The mean total QoR-40 T score before surgery was 182 ± 10.4, 171 ± 20 on the third day after surgery, and 186 ± 14 one month after surgery. An SRM of 0.62 was conducted between the preoperative and third day QoR-40 T mean scores. An SRM of 0.2 indicated a small effect of intervention, 0.5 a moderate effect, and 0.8 or greater a large effect [12, 13].
The findings of the principal components analysis revealed a five-factor structure in the QoR-40 T of physical comfort, emotion, physical independence, patient support, and pain, as in Myles et al. . Additionally, the ratio of the explanatory importance of the factors by one factor (R2) was 0.268. The item loadings in the physical comfort component ranged from 0.532 to 0.804, the emotion component from 0.474 to 0.789, physical independence from 0.561 to 0.871, patient support from 0.620 to 0.845, and pain from 0.541 to 0.776 (Table 5). In addition, the construct validity was supported by a negative correlation with the duration of hospitalization (ρ = 0.265, p = 0.002), and a lower mean postoperative QoR-40 T score was seen in women (167.73 with an SD of 19.90) compared to men (175.03 with an SD of 19.72) (p = 0.015), as indicated by Myles et al. .
This study was conducted to evaluate the QoR-40 T, an adapted version of the QoR-40. The QoR-40 T revealed acceptable levels of validity, reliability, and clinical feasibility in the Turkish population.
The principal components analysis showed that the QoR-40 T has the same dimensions indicated by Myles et al. . The results of the factor analysis revealed that our validation study fulfills the requirements of construct validity. In addition, it is known that women usually have a poorer quality of recovery on the basis of previous studies, which was also found in the present study, and supported its construct validity . The current study was able to demonstrate a negative correlation between the QoR-40 T and duration of hospitalization, and psychometric tests have supported the validity and reliability of the QoR-40 T. The predictive validity evaluation revealed a positive correlation between the total QoR-40 T and the subscales of the SF-36. Furthermore, the QoR-40 T showed a satisfactory correlation with the recovery VAS, which was associated with the concurrent validity.
The SRM value of the total QoR-40 T was 0.62, which was previously mentioned as moderate, and indicated a moderate capability for assessing the alterations in the postoperative recovery period . The reliability was confirmed by detecting a Cronbach’s α value of 0.936, which surpassed the recommended level . These findings suggested that the QoR-40 T may, to a reliable degree, be able to evaluate patient recovery.
This study has several limitations. First, there have been few Turkish-validated quality of life assessment questionnaires; therefore, the SF-36 questionnaire had to be used to validate the QoR-40 T. However, patient support, the subscale of the QoR-40, does not have an equivalent or similar scale in the SF-36 or any cross-culturally validated questionnaire, and could not be assessed and validated. Second, associated with the variability of the discharge periods in the surgical clinics and limited sources with which to contact the patients, the time between test and re-test for the QoR-40 T had to be long. Third, patients who underwent elective general surgery, orthopedic surgery, and otorhinolaryngological surgery were included in this study. Therefore, the feasibility of the questionnaire in the general population was potentially restricted. However, this limitation can be overcome by assessing the questionnaire with a larger number of patients in various surgical departments.
This study showed that the cross-cultural adaptation of the QoR-40 was successfully achieved. The Turkish version of the QoR-40 is a satisfactory, valid, and reliable instrument for clinicians to assess the recovery quality in Turkish patients after surgery.
Quality of recovery-40 questionnaire
- QoR-40 T:
Turkish version of the QoR-40
36-Item short form health survey
Role limitations due to physical health problems
General health perceptions
Role limitations due to emotional problems
General mental health
Recovery visual analog scale
Standardized response mean
Spearman rho correlation coefficient
Myles PS, Weitkamp B, Jones K, Melick J, Hensen S: Validity and relibility of a postoperative quality of recovery score: the QoR-40. Br J Anaesth 2000, 84: 11–15. 10.1093/oxfordjournals.bja.a013366
Gornall B, Myles PS, Smith C, Burke JA, Leslie K, Pereira MJ, Bost JE, Kluivers KB, Idvall E, Tanaka Y, Forbes A: The measurement of quality of recovery using the QoR-40: a quantitative systematic review. Br J Anaesth 2013, 111: 161–169. 10.1093/bja/aet014
Myles PS, Viira D, Hunt JO: Quality of life at three years after cardiac surgery: relationship with preoperative status and qaulity of recovery. Anaesth Intensive Care 2006, 34: 176–183.
Myles PS, Hunt JO, Fletcher H, Solly R, Woodward D, Kelly S: Relation between quality of recovery in hospital and quality of life at 3 months after cardiac surgery. Anesthesiology 2001, 95: 862–867. 10.1097/00000542-200110000-00013
Leslie K, Troedel S, Irwin K, Pearce F, Ugoni A, Gillies R, Pemberton E, Dharmage S: Quality of recovery from anesthesia in neurosurgical patients. Anesthesiology 2003, 99: 1158–1165. 10.1097/00000542-200311000-00024
Buchanan FF, Myles PS, Cicuttini F: Effect of patient on general anaesthesia and recovery. Br J Anaesth 2011, 106: 832–839. 10.1093/bja/aer094
Bost JE, Williams BA, Bottegal MT, Dang Q, Rubio DM: The 8-item short-form health survey and the physical comfort composite score of the quality of recovery 40-item scale provide the most responsive assessments of pain, physical function, and mental function during the first 4 days after ambulatory knee surgery with regional anesthesia. Anesth Analg 2007, 105: 1693–1700. 10.1213/01.ane.0000287659.14893.65
Ridley SA, Chrispin PS, Scotton H, Rogers J, Lloyd D: Changes in quality of life after intensive care: comparison with normal data. Anaesthesia 1997, 52: 195–202. 10.1111/j.1365-2044.1997.073-az0068.x
Hoffman SN, TenBrook JA, Wolf MP, Pauker SG, Salem DN, Wong JB: A meta-analysis of randomized controlled trials comparing coronary artery bypass graft with percutaneous transluminal coronary angioplasty: one- to eight-year outcomes. J Am Coll Cardiol 2003, 41: 1293–1304. 10.1016/S0735-1097(03)00157-8
Rumsfeld JS, Magid DJ, Plomondon ME, Sacks J, Henderson W, Hlatky M, Sethi G, Morrison DA: Veterans affairs angina with extremely serious operative mortality (AWESOME) ınvestigators: health-related quality of life after percutaneous coronary intervention versus coronary bypass surgery in high-risk patients with medically refractory ischemia. J Am Coll Cardiol 2003, 41: 1732–1738. 10.1016/S0735-1097(03)00330-9
Bullinger M, Alonso J, Apolone G, Leplege A, Sullivan M, Wood-Dauphinee S, Gandek B, Wagner A, Aaronson N, Bech P: Translating health status questionnaires and evaluating their quality: the IQOLA project approach: ınternational quality of life assessment. J Clin Epidemiol 1998, 51: 913–923. 10.1016/S0895-4356(98)00082-1
Peterson RA: A meta-analysis of Cronbach’s coefficient alpha. J Consum Res 1994, 21: 381–391. 10.1086/209405
Katz JN, Larson MG, Philips CB, Fossel AH, Liang MH: Comparative measurement sensitivity of short and longer health status instruments. Med Care 1992, 30: 917–925. 10.1097/00005650-199210000-00004
Tanaka Y, Wakita T, Fukuhara S, Nishiwada M, Inoue S, Kawaguchi M, Furuya H: Validation of the Japanese version of the quality of racovery score QoR-40. J Anesth 2011, 25: 509–515. 10.1007/s00540-011-1151-2
We would like to thank to Professor Paul Myles for granting the permission to translate the QoR-40 into Turkish.
The authors have no competing interests.
SK designed and collected the study population of the study, SA carried out the data collection, SD paticipated in the design, helped to draft the manuscript and performed the statistical anlysis, TK helped data collection, HT participated in its design, ZK participated in the design, MS helped in the design, and MGB helped data collection. All authors read and approve the final manuscript.
Electronic supplementary material
About this article
Cite this article
Karaman, S., Arici, S., Dogru, S. et al. Validation of the Turkish version of the quality of recovery-40 questionnaire. Health Qual Life Outcomes 12, 8 (2014). https://doi.org/10.1186/1477-7525-12-8