Skip to main content

Towards patient-centred cancer care: cross-cultural validity and responsiveness of the Turkish Integrated Palliative care Outcome Scale



A valid measure to describe the most important needs and concerns of people with life-threatening illnesses is missing in Cyprus. Our aim was to adapt and test the cross-cultural validity and responsiveness of the Integrated Palliative care Outcome Scale (IPOS) in a cohort of Turkish speaking cancer patients.


The IPOS (English) patient-reported measure was translated into Turkish following published guidelines including, 2 independent forward, 2 independent blind backward translations, expert panel review by 7 members and field testing with 11 cognitive interviews (5 patients and 6 specialists) and final approval of the copyright holder. Consecutive cancer patients (n = 234) seen by the community palliative care services were recruited from Help Those with Cancer Society (KHYD); of those 82 were followed-up. The instrument was administered by personal interview. Confirmatory Factor Analysis was used to validate the factor structure of Turkish IPOS. Internal consistency reliability of the subscales was evaluated by Cronbach’s alpha and Intraclass Correlation Coefficient respectively. Validity was assessed by calculating Pearson’s correlation coefficient (r) between Turkish IPOS scores and Turkish version of EQ-5D-3L - a validated generic measure of health status developed by the EuroQol Group.


Turkish IPOS is conceptually and semantically equivalent to the English version and linguistically valid. The CFA was inconclusive for the three factor structure due to low sample size, as the SRMR and CFI tests only approached the defined minimums warranting further investigation. There were low levels of missing values, and no ceiling or floor effects. The Physical (α = 0.91) and the Social and Quality of Care Issues (α = 0.75) sub-scales showed good internal consistencies, however Emotional sub-scale showed poor internal consistency (α = 0.64). The reliability of the Physical (ICC = 0.51, 0.45–0.56 95% CI) and Social Quality of Care Issues (ICC = 0.50, 0.42–0.57 95% CI) were moderate. Poor internal consistency (α =0.64) and reliability (ICC = 0.31, 0.24–0.39, 95% CI) was obtained for Emotional Subscale. Construct validity was evidenced through significant correlations in the predicted directions and strength with EQ-5D. Turkish IPOS showed higher needs and concerns in participants at more advanced stages than those at earlier stages of cancer. The standardized response mean (SRM) of − 0.94 suggested large internal responsiveness to clinical change.


Turkish IPOS is a clear, relevant, acceptable measure and responsive to the needs and concerns of cancer patients, observing regional differences, it may have implications for use in other Turkish speaking communities. Future studies are needed to clarify the factor structure, assess its external responsiveness and to improve the properties of its Emotional subscale.


A comparative review of palliative care development in the Middle Eastern Cancer Consortium (MECC) member countries identified ‘lack of awareness and understanding of palliative care needs at public, government and professional levels’ as barriers to provision of palliative care to cancer patients in this region [1]. These observations maintain their relevance today for cancer patients living in MECC member countries including the setting for this study, Cyprus. Palliative care as ‘ … an approach that improves the quality of life of patients and their families … through the prevention and relief of suffering by means of early identification and impeccable assessment and treatment of pain and other problems, physical, psychosocial and spiritual’ [2] is rarely recognized [3]. As a concept, palliative care is only equated with management of pain in cancer and available only in oncology inpatient and intensive care units [4].

Within Cyprus, resources for health services including community home-based services are scarce and receive no or little government support. The health expenditure is the lowest compared to other European Union member countries and 25% of the population has no access to public health services [5]. Early palliative care as cost-effective intervention in cancer patients has already been demonstrated [6]. Evidence of the effectiveness and cost-effectiveness of palliative care services may promote their integration for persons living with all serious illnesses in Cyprus. After years of lobbying, local cancer charities have been formally authorized to deliver community home-based palliative care services in Cyprus [4, 7]. This recognition may serve as a ‘catalytic action’ [8] that may increase the coverage of the palliative care services beyond inpatient and intensive care unit settings to the community. The charities must support home services through fundraising and ensure their resources address the most important concerns early. This has necessitated availability of a brief and valid patient-reported outcome measure (PROM) to describe the most important concerns of people with living with cancer.

Routine use of PROMs can improve the quality and relevance of services [9] and also can help build awareness in healthcare providers about the most important needs of patients and families [10]. The Integrated Palliative care Outcome Scale (IPOS) is a valid brief PROM that addresses the most important concerns such as symptoms, information needs, practical concerns, anxiety and low mood, family anxieties and overall feelings of being at peace of persons living with serious illnesses, such as cancer [11, 12]. IPOS has been used with cancer patients [13, 14] and adapted to many cultures [15,16,17].

In this study, we first translated and culturally adapted IPOS into Turkish, and evaluated the cross-cultural validity and responsiveness of IPOS in Turkish speaking community of cancer patients in Cyprus. The findings of the study could have implications for millions of patients living with serious illnesses around the world who have Turkish as their native language [18].


The study commenced after attaining permissions from the POS Development Team as the copyright holder of IPOS, the EuroQol Group for use of Turkish version of EQ-5D-3L. Ethical approval was obtained from the Eastern Mediterranean University Publication and Research Ethics Committee (ETK00–2017-103). Written informed consent was obtained from all participants included in the study.

Participants and procedures

Patients seen by the community palliative care team including new or old referrals, of Help Those with Cancer Society in Cyprus (KHYD), aged 18 and above were eligible to participate in the study. Patients who were not referred to the community palliative care services, or were younger than 18, were excluded from the study. Invitation and recruitment was consecutive and stopped once the target size of at least 10 cases per item [19] were reached. Two hundred and thirty-four consenting patients were asked to complete the Turkish IPOS alongside the EQ-5D-3L. For follow-up, 82 participants were asked to complete the Turkish IPOS a second time during their next routine visit. Due to unavailability of resources, the follow-up visit and assessment could only carried out in the next scheduled routine visit by the community palliative care team rather a specified time period. Data were collected by the 4 community nurses during routine home visits.

Patients were also asked to complete questions about their age, gender, education, marital status, occupation, number of children, how they were meeting treatment and care expenditures, their sources of support and co-morbidities. Clinical information on the primary tumour site including stage was extracted by the Community Palliative Care Team (CPCT) from their membership registration files. The testing and reporting of the measurement properties of the Turkish IPOS followed the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) recommendations [20].


Integrated Palliative care Outcome Scale (IPOS)

IPOS is a 10 question, 17-item brief PROM addressing symptoms, information needs, practical concerns, anxiety, low mood, family anxieties and overall feeling of being at peace of persons living with life-threatening illnesses. It is scored on a 5-point Likert scale (0–4) with higher scores indicating an overwhelming presence of symptoms and needs not addressed. Patients may also list their main problems and concerns and any additional symptoms. The 7 day patient version recommended for use in community-based services was used in this study [21]. An earlier study identified Physical Symptoms, Emotional Issues and Support (Social issues and Quality of Care) as three sub-scales of IPOS [11].

EuroQol Group’s Generic Health Status Preference based Measure - EQ-5D-3L

EQ-5D-3L evaluates a person’s health status based on 5 dimensions: mobility; self-care; usual activities; pain/discomfort; and anxiety/depression. It is scored on a scale from 1 to 3 where 1 represents ‘no problems’, 2 denotes ‘some problems’, and 3 ‘extreme problems.’ It is accompanied by a Visual Analogue Scale (EQ VAS) which records the patient’s self-rated health on a vertical VAS with the endpoints ‘Best imaginable health state’ and ‘Worst imaginable health state’. Turkish version of EQ-5D-3L has been validated in cancer patients [22] and therefore was chosen as comparative measure.

Translation and cross-cultural adaptation

The ‘Manual for cross-cultural adaptation and psychometric validation of the IPOS development group’ [23] was rigorously followed for the translation and cross-cultural adaptation. Literature review and consultations with patient, their families and clinicians was used to establishing IPOS’ face and content validity. Face and content validity were reconfirmed in the validation phase of the study by the free text entries of respondents.

Four translators and two mediators followed the independent forward- blind backward translation method to translate IPOS (English) to Turkish. Two translators who carried out the two independent forward translations, were native in Turkish and fluent in English. One of the translators were an English teacher, the second one was a general practitioner. Two translators, who carried out the blinded backward translations were native English speakers, who have moved to Cyprus from the UK, and were fluent in Turkish. Both were English teachers. The mediators were two cancer patients. The expert review panel included all four translators and two mediators, and the first author. The expert review panel reviewed and synthesized the translations, and prepared the pre-final Turkish IPOS for piloting (cognitive testing).

A total of 5 cancer patients and 6 clinicians including nursing staff and counsellors, completed the pre-final Turkish IPOS in order to test the alternative wording and to check understandability, interpretation, and cultural relevance of the translation [24]. Probes such as ‘What does the term practical problems mean to you?’, ‘In your own words can you repeat what this question is asking?’, ‘Was that question easy or hard to answer?’ and ‘I can see that you have chosen moderately or 2 as your response or score, why is that?‘were used [24]. Participants found the questionnaire easy to understand. Completed reports on the general information on participants, translators and expert review panel members, summary of all phases of the process and on the synthesis of the two forward translations and the two backward translations together was collated in a final report. These documents with the Turkish IPOS Pre-Approval Version as agreed by the research team and the copyright holder, were sent to POS Development Team at King’s College London for review and final approval before proceeding to validation phase.

Statistical analysis

Descriptive and multivariate analyses were carried out to present participant characteristics and to assess data completeness, distribution, internal consistency, reliability, validity and internal responsiveness of Turkish IPOS using IBM SPSS Statistics 25.0 and Amos 25.0 [25]. Pairwise deletion was used in multivariate statistical analyses [26]. Participant characteristics were summarized as percentages of the total participants. Mean or median with standard deviation or range of values were presented where relevant. Data completeness was assessed by Missing Value Analysis (MVA). For acceptability, means, standard deviation, range of values, skewness, kurtosis as well as the ceiling and floor effects were assessed for the total scores as well as for the three sub-scales of IPOS. Content validity were re-confirmed through patient responses to two free-text parts of the Turkish IPOS, one about main problems and concerns, and the second on any other symptoms not listed.

A first order Confirmatory Factor Analysis (CFA) was used to assess how well the hypothesized 3-factor model fits the observed data. The model parameters were estimated using Full Information Maximum Likelihood (FIML) method to make maximal use of all data [26]. Post-hoc modifications were undertaken to improve model fit. As the chi-square statistic has been shown to fail to discriminate between good fitting models and poor fitting models in small sample sizes (n ≤ 250) [27], combinational rules and cut-off criterion for fit statistics that minimize Type I and Type II errors in small samples were considered [28]. Comparative Fit Index (CFI) and Standardized Root Mean Square Residual (SRMR) were used to evaluate the model fit with CFI ≥ 0.95 and SRMR< 0.09 suggested good fit.

Internal consistency of each sub-scale was evaluated with Cronbach’s α coefficient [29] where α values in the range of 0.70–0.90 is indicative of good internal consistency [30]. In order to estimate the reliability, Interclass Correlation Coefficients (ICCs) using two-way mixed effect model was obtained and ICCs for single measurement are reported. The choice of the model was informed by the fact that multiple administrators from a selected pool carried out the assessments and consistency of measurement was critical [31]. ICCs less than 0.5 are indicate poor, between 0.5 and 0.75 indicate moderate, 0.75 and 0.9 are indicate of good, and above 0.90 indicate excellent reliability [31].

Construct validity where conceptual convergence and divergence between Turkish IPOS and EQ-5D-3L items were evaluated with bivariate correlation analysis, where Pearson’s correlation coefficient (r) between 0 and 0.2 indicated weak, 0.2–0.4 low, 0.4–0.6 moderate and 0.6–0.8 strong relationship given statistical significance. Known groups (discriminant) validity was assessed by independent samples t-test comparing total and sub-scale scores in participants with early (Stages I-II) versus advanced cancer (Stages III-IV).

Standardized Response Mean (SRM) was calculated to estimate change in scores standardized relative to variability between the participants to assess internal responsiveness [32]. Baseline and follow-up scores were compared using paired t-test. Bonferroni corrected p ≤ 0.01 was used for significance to account for multiple comparisons.


Literature and consultations confirmed that IPOS covered all of the relevant concepts in relation needs and concerns and had face and content validity. Pain and emotional difficulties emerged as the most prevalent issues. In the 2 forward translations there were differences in the grammatical tense used; translators used present continuous tense, but the mediators used past tense. The item on practical problems resulting from illness was particularly challenging, therefore the word ‘practical’ was removed and the question revised to ask about ‘personal and financial problems’ caused by illness. The 2 blind backward translations produced from final reconciled forward translation of Turkish IPOS were both similar with no significant differences in meaning. The expert panel reviewed all versions to improve clarity and produced the pre-final Turkish IPOS.

Following cognitive testing, instructions were reworded and further shortened. The response options were generally clear and well understood; the only difficulty was with ‘occasionally’ which was suggested to be changed to ‘zaman zaman’ rather than ‘ara sıra’. Patients struggled with the information item which was revised to emphasize that the question was not about the knowledge the patients possessed but the information given to them. Turkish IPOS Pre-approval Version was sent to the Cicely Saunders Institute POS Team for independent review. Following this and minor amendments, Turkish IPOS was produced and validation study was initiated.

For the validation study, data collection took place between July 2017 and October 2018. Participants were mostly women (73.5%), almost all were struggling with treatment expenses (91.5%) and most received support from family members (83.3%). Of the 43.6% who reported having comorbidities, 50% had hypertension and 28.4% had diabetes (Table 1). Fifty three percent of the participants had advanced cancer and breast cancer was the most prevalent (48.3%).

Table 1 Participant clinical and socio-demographic characteristics (n = 234)

MVA identified four items with higher number of missing responses in baseline assessment (9.4–7.7%) (Table 2). As the data were not missing completely at random (Little’s MCAR test χ2 = 291.512, DF = 184, p < 0.0001), listwise deletion or imputation of missing values was not undertaken. Patients at moderate stages of their illness (Stage II and III) had more than 5% of responses missing for these items. Only two items were missing 1 response each in the follow-up assessment.

Table 2 Data Completeness: Numbers and percentages of complete responses and non-responses in baseline and follow-up assessments

CFA fit indices were CFI = 0.756 and SRMR = 0.0002 indicated poor fit of the model to the data (χ2 = 496.369, df = 87, χ2/df = 5.705, p < 0.0001) and post-hoc modifications were made. Post-hoc modification involved adding in covariances of error terms based on theoretical and relevant associations of items measured. The model fit improved where CFI = 0.855 and SMRM = 0.0002 (χ2 = 321.874, df = 78, χ2/df = 4.127, p < 0.0001). Even though the CFI and SMRM parameters approached the minimums, they were not within the required defined parameters recommended for small samples. For this reason, the CFA was inconclusive and cross-cultural validity could not be confirmed or negated. The standardized parameter estimates of the modified model are shown in Fig. 1. Physical factor accounted for 73–21% of variance, Emotional factor for 25–11% and Social Impact and Quality of Care (Support) for 50–32% of the relevant IPOS items. Emotional subscale, had poorly loading items where Anxiety and Anxiety of Friend and Family had factor loadings of 0.32 and 0.35 respectively (see Table 3 and Fig. 2 for distribution of scores).

Fig. 1
figure 1

Cross-cultural validity: Standardized measurement model following post-hoc modification for Confirmatory Factor Analysis (n = 234)

Table 3 Acceptability: Distribution of Turkish IPOS scores
Fig. 2
figure 2

Distribution of Turkish IPOS total scores (n = 204) where 0 = No needs, concerns and/or symptoms, 68 = Highest needs, concerns and/symptoms

The Emotional sub-scale showed poor internal consistency (α = 0.64), three of the items were worthy of retention but deletion the item on anxiety of family and friends would increase α to 0.75. The reliability of this subscale was also poor (ICC = 0.31, 0.24–0.39, 95% CI). The Physical subscale showed good internal consistency (α = 0.91) but moderate reliability (ICC = 0.51, 0.45–0.56 95% CI). Social and Quality of Care Issues subscale showed good internal consistency (α = 0.75) and marginally moderate reliability (ICC = 0.50, 0.42–0.57 95% CI).

The participants listed feeling worried, financial difficulties, lack of support, impact of cancer on the family on activities of everyday life as their main concerns in response to the open-ended first question in IPOS. As these topics were all covered by IPOS, its content validity was reconfirmed.

Correlations with EQ-5D-3L domains were significant and, mostly in the directions and strength predicted (Table 4). For example, IPOS Emotional subscale, had low correlations with EQ-5D Mobility, Self-care, Usual Activity, slightly higher but still low correlations with Pain/Discomfort and Anxiety/Depression and moderate negative correlation with self-rated health.

Table 4 Construct Validity: Bivariate Correlational Analysis (Pearson’s rho) of IPOS and EQ-5D

Known-group validity was indicated as there was a significant difference in the total scores for early (M = 22.03, SD = 10.39) and advanced (M = 25.51, SD = 9.27) stages; t (128.526) = − 2.274, p = 0.025. Similarly, participants at earlier disease stage had significantly lower Social and Quality of Care sub-scores (M = 4.87, SD = 2.75) than participants at advanced stages of cancer (M = 6.41, SD = 2.25), t (123.635) = − 3.955, p < 0.0001. The Physical and Emotional sub-scale scores for participants at early and advanced stages were not significantly different.

The mean time between the two administrations were 4.6 weeks (Range = 2–7, SD = 1.5). SRM of − 0.94 suggests large responsiveness [33]. Total scores at follow-up were significantly lower compared to baseline with a mean difference of 9.87 (7.18–12.58, 95% CI), t (57) = 7.33, p < 0.0001. A similar trend was observed for the physical (x1-x2 = 7.02, t (72) =10.3, p < 0.0001) and quality of care/social support subscales (x1-x2 = 2.11, t (61) =6.35, p < 0.0001). However, emotional concerns significantly worsened compared to baseline (x1-x2 = − 1.74, t (61) = − 4.2, p < 0.0001). Figure 3 maps change scores for 58 cancer patients with complete data across all four scales and assessments (Fig. 3).

Fig. 3
figure 3

Internal responsiveness: Change scores from baseline for IPOS total and subscale scores (negative difference suggests improvement) (n = 58)


In this study we adapted IPOS to Turkish and evaluated its cross-cultural validity and responsiveness in cancer patients. Most of the items were translated easily and perceived to be culturally relevant. Contrary to experiences of teams working on other language translations [16, 34], “at peace” item was particularly easy to adapt to Turkish as this is a very culturally relevant concept. Items on “practical problems addressed” and “information” were the most challenging to translate and adapt because the word “practical” is commonly used interchangeably to refer to “application”, and “information” can translate to “knowledge possessed”. Both items were clarified during cognitive testing.

Studies with cancer patients may be missing data [35] and higher rates of responses may be missing in palliative care studies compared to other studies [36]. Data for the baseline and follow-up assessment were impressively complete for most of the items. The baseline assessment of items on depression, information, anxiety of friends and family, and sharing feelings with friends and family generated the most non-responses. It is possible that patients may be struggling to come to terms with their cancer diagnosis or struggling to express the emotional impact of cancer on themselves, friends and family [37, 38]. Also, participants may have felt uncomfortable expressing their true responses to the item on “information” as not to offend the community palliative care staff caring for them, as was observed in the Japanese IPOS validation study [14].

Evaluation of SRMR and CFI values of the final CFA model could not confirm or negate that the three-domain structure proposed in the original IPOS was an acceptable fit to our data [39], in the original validation study 2-factor solution was implicated to be better fitting [11]. Even though CFI and SMRM parameters approached the minimums, they were not within the required defined parameters recommended for small samples. Future larger studies may be needed to confirm the three-domain structure. Emotional subscale, specifically had poorly loading items. Lack of consensus on cut off criteria for factor loadings in studies with small samples [40], necessities future larger studies before further actions are taken in relation to removal of items.

Turkish IPOS is acceptable, with no floor or ceiling effects. The mean and standard distribution of scores are consistent with findings from a recent validation study in cancer patients [14]. Turkish IPOS illustrated moderate to marginally moderate internal consistency and good to moderate reliability with its Physical and Social and Quality of Care subscales. However, the Emotional sub-scale showed poor internal consistency and reliability. These results agree with the findings in the original validation study [11], which reported low internal consistencies for Emotional and Social and Quality of Care subscales. In line with observations from the CFA, the removal of the item ‘Have any of your family or friends been anxious or worried about you?’ is indicated for improving internal consistency.

Content and face validity, ascertained through the translation and cross-cultural adaptation phase as well as at the validation phase, was also good as all of the main concerns such as feeling worried about treatment, the future, loss of independence and dying, the impact of the illness on the family, financial impact of illness, issues with getting support and pain were the main concerns brought up in the open-ended questions were covered in IPOS.

Construct validity was demonstrated with significant but moderate to low correlations with EQ-5D-3L items and VAS scale in the predicted direction. These findings were consistent with the findings of the Japanese IPOS [14]. Turkish IPOS also demonstrated known-groups validity as cancer patients at advanced stages had significantly higher total IPOS scores.

Turkish IPOS was able to detect statistically significant changes in concerns and symptoms between baseline and follow-up assessments. The effect size statistics were large. These findings supported internal responsiveness of the Turkish IPOS. The improvement in the total score was mostly due to significant improvement in the physical and quality of care/social support aspects. However, small but significant deterioration was reported with the emotional subscale. The general improvement or deterioration in the scores could be the effect of home palliative care services, but further studies are required to understand these changes in the context of clinical and subjective meaning [41].

There are further limitations of this study which need to be acknowledged. Patients were recruited through convenience sampling and may not be representative of all cancer patients. Additionally, patients receiving community palliative care services from the cancer charity may be more financially disadvantaged compared to the overall population of cancer patients. Patients with breast cancer were over-represented in the study as the charity was established by a breast cancer survivor and attracts more memberships among women living with breast cancer. Also, more women participated in the study as men may be less willing to share their experiences of having cancer [42]. These limitations may affect the generalizability of the findings.

The potential regional differences in Turkish language must also be taken into consideration. For this reason, minor amendments might be needed before Turkish IPOS is used in other Turkish speaking communities.

A team of researchers in Turkey have recently completed the cognitive testing of Turkish IPOS and have confirmed initiation of validation work with no revisions or modifications. Further research is needed to establish the range of Turkish IPOS scores that indicate clinical change meaningful to the patient and to establish its reliability and validity in non-cancer patient populations.


Turkish IPOS is simple to complete and clearly understood. It measures the important aspects of needs and concerns that are relevant to Turkish speaking cancer patients and it is acceptable. Physical and Social and Quality of Care subscales are internally consistent and reliable, can be used to evaluate needs and concerns in these areas. There is good evidence that Turkish IPOS is a valid measure of concerns and needs, and responds to the severity of illness and is able to measure change over a specified time frame. Future studies are necessary to investigate the performance of the Emotional subscale, to clarify the factor structure and to evaluate the extent to which change in a IPOS relates to corresponding change in a reference measure of clinical or health status. Observing regional differences, Turkish IPOS may have implications for use in other Turkish speaking communities.

Availability of data and materials

The authors would like to declare that they have full control of all primary data and that we agree to allow the journal to review their data if requested.



Confirmatory Factor Analysis


Comparative Fit Index


Consensus-based Standards for the selection of health Measurement Instruments


Integrated Palliative care Outcome Scale


Help Those with Cancer Society in Cyprus


Middle Eastern Cancer Consortium


Missing Value Analysis


Community Palliative Care Team


Palliative care Outcome Scale


Patient-Reported Outcome Measure


Standardized Root Mean Square Residual


Visual Analogue Scale


  1. Bingley A, Clark D. A comparative review of palliative care development in six countries represented by the Middle East cancer consortium (MECC). J Pain Symptom Manag. 2009;37(3):287–96.

    Article  Google Scholar 

  2. World Health Organization. WHO Definition of Palliative Care [Available from:

  3. Lynch T, Clark D, Centeno C, Rocafort J, de Lima L, Filbet M, et al. Barriers to the development of palliative care in Western Europe. Palliat Med. 2010;24(8):812–9.

    Article  CAS  PubMed  Google Scholar 

  4. Costello J, Christoforou C. Palliative care in a Mediterranean culture: a review of services in the Republic of Cyprus. Int J Palliat Nurs. 2001;7(6):286–9.

    Article  CAS  PubMed  Google Scholar 

  5. European Commission. State of health in the EU: Cyprus country health profile 2017; 2017.

    Google Scholar 

  6. Temel JS, Greer JA, Muzikansky A, Gallagher ER, Admane S, Jackson VA, et al. Early palliative care for patients with metastatic non-small-cell lung cancer. N Engl J Med. 2010;363(8):733–42.

    Article  CAS  PubMed  Google Scholar 

  7. Kıbrıs Postası. Sağlık Bakanlığı ile KHYD arasında palyatif bakım konusunda işbirliği protokolü imzalandı: Kibris Postasi; 2017. Accessed Oct 2019.

  8. Gómez-Batiste X, Connor S. Building integrated palliative care programs and services; 2017.

    Google Scholar 

  9. Black N. Patient reported outcome measures could help transform healthcare. Bmj. 2013;346:f167.

    Article  PubMed  Google Scholar 

  10. Bausewein C, Daveson BA, Currow DC, Downing J, Deliens L, Radbruch L, et al. EAPC white paper on outcome measurement in palliative care: improving practice, attaining outcomes and delivering quality services - recommendations from the European Association for Palliative Care (EAPC) task force on outcome measurement. Palliat Med. 2016;30(1):6–22.

    Article  PubMed  Google Scholar 

  11. Murtagh FE, Ramsenthaler C, Firth A, Groeneveld EI, Lovell N, Simon ST, et al. A brief, patient- and proxy-reported outcome measure in advanced illness: validity, reliability and responsiveness of the integrated palliative care outcome scale (IPOS). Palliat Med. 2019;33(8):1045.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Sandham MH, Medvedev ON, Hedgecock E, Higginson IJ, Siegert RJ. A Rasch analysis of the integrated palliative care outcome scale. J Pain Symptom Manag. 2019;57(2):290–6.

    Article  Google Scholar 

  13. Monnery D, Benson S, Griffiths A, Cadwallader C, Hampton-Matthews J, Coackley A, et al. Multi-professional-delivered enhanced supportive care improves quality of life for patients with incurable cancer. Int J Palliat Nurs. 2018;24(10):510–4.

    Article  PubMed  Google Scholar 

  14. Sakurai H, Miyashita M, Imai K, Miyamoto S, Otani H, Oishi A, et al. Validation of the integrated palliative care outcome scale (IPOS) - Japanese version. Jpn J Clin Oncol. 2019;49(3):257.

    Article  PubMed  Google Scholar 

  15. Veronese S, Rabitti E, Costantini M, Valle A, Higginson I. Translation and cognitive testing of the Italian integrated palliative outcome scale (IPOS) among patients and healthcare professionals. PLoS One. 2019;14(1):e0208536.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Sterie AC, Bernard M. Challenges in a six-phase process of questionnaire adaptation: findings from the French translation of the integrated palliative care outcome scale. BMC Palliat Care. 2019;18(1):38.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Murtagh F, Ramsenthaler C, Firth A, Groeneveld EI, Lovell N, Simon S, et al. A brief, patient- and proxy-reported outcome measure for the adult palliative care population: validity and reliability of the integrated palliative outcome scale (IPOS). Palliat Med. 2016;30(6):NP11.

    Google Scholar 

  18. OECD. International migration outlook 2018; 2018.

    Book  Google Scholar 

  19. Schreiber JB. Core reporting practices in structural equation modeling. Res Soc Adm Pharm. 2008;4(2):83–97.

    Article  Google Scholar 

  20. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49.

    Article  PubMed  PubMed Central  Google Scholar 

  21. POS Development Team. [Available from:

  22. Polat U, Arpacı A, Demir S, Erdal S, Yalcin S. Evaluation of quality of life and anxiety and depression levels in patients receiving chemotherapy for colorectal cancer: impact of patient education before treatment initiation. J Gastrointest Oncol. 2014;5(4):270–5.

    PubMed  PubMed Central  Google Scholar 

  23. Antunes B, Daveson B, Ramsenthaler C, Benalia H, Lopes Ferreira P, Higginson I. The palliative care outcome scale manual for cross-cultural adaptation and psychometric validation. London: Cicely Saunders Institute; 2012.

    Google Scholar 

  24. Willis G. In: Leavy P, editor. Analysis of the cognitive interview in questionnaire design : understanding qualitative research. Oxford: Oxford University Press; 2015.

    Google Scholar 

  25. IBM SPSS. Version 25.0. Chicago: IBM SPSS; 2017.

    Google Scholar 

  26. Albright JJ, Park HM. Confirmatory Factor Analysis Using Amos, LISREL, Mplus, and SAS/STAT CALIS. Working Paper. The University Information Technology Services (UITS) Center for Statistical and Mathematical Computing, Indiana University; 2009.

  27. Kenny DA, McCoach DB. Effect of the number of variables on measures of fit in structural equation modeling. Struct Equ Model Multidiscip J. 2003;10(3):333–51.

    Article  Google Scholar 

  28. Hu L, Bentler P. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.

    Article  Google Scholar 

  29. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297–334.

    Article  Google Scholar 

  30. Nunnally J, Bernstein I. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.

    Google Scholar 

  31. Koo TK, Li MY. A guideline of selecting and reporting Intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Husted JA, Cook RJ, Farewell VT, Gladman DD. Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol. 2000;53(5):459–68.

    Article  CAS  PubMed  Google Scholar 

  33. Kazis LE, Anderson JJ, Meenan RF. Effect sizes for interpreting changes in health status. Med Care. 1989;27(3 Suppl):S178–89.

    Article  CAS  PubMed  Google Scholar 

  34. Beck I, Olsson Möller U, Malmström M, Klarare A, Samuelsson H, Lundh Hagelin C, et al. Translation and cultural adaptation of the integrated palliative care outcome scale including cognitive interviewing with patients and staff. BMC Palliat Care. 2017;16(1):49.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Burton A, Altman DG. Missing covariate data within cancer prognostic studies: a review of current reporting and proposed guidelines. Br J Cancer. 2004;91(1):4–8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Palmer JL. Analysis of missing data in palliative care studies. J Pain Symptom Manag. 2004;28(6):612–8.

    Article  Google Scholar 

  37. de Graaff FM, Francke AL, van den Muijsenbergh ME, van der Geest S. ‘Palliative care’: a contradiction in terms? A qualitative study of cancer patients with a Turkish or Moroccan background, their relatives and care providers. BMC Palliat Care. 2010;9(1):19.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Goldstein D, Thewes B, Butow P. Communicating in a multicultural society II: Greek community attitudes towards cancer in Australia. Intern Med J. 2002;32(7):289–96.

    Article  CAS  PubMed  Google Scholar 

  39. Hooper D, Coughlan J, Mullen M. Structural equation modelling: guidelines for determining model fit. Electron J Bus Res Methods. 2008;6(1):53–60.

    Google Scholar 

  40. Shevlin M, Miles JNV. Effects of sample size, model specification and factor loadings on the GFI in confirmatory factor analysis. Personal Individ Differ. 1998;25(1):85–90.

    Article  Google Scholar 

  41. Stratford PW, Binkley JM, Riddle DL. Health status measures: strategies and analytic methods for assessing change scores. Phys Ther. 1996;76(10):1109–23.

    Article  CAS  PubMed  Google Scholar 

  42. Cecil R, Mc Caughan E, Parahoo K. ‘It’s hard to take because I am a man’s man’: an ethnographic exploration of cancer and masculinity. Eur J Cancer Care. 2010;19(4):501–9.

    Article  CAS  Google Scholar 

Download references


Prof. Irene J Higginson is an NIHR senior investigator emeritus and is supported by the NIHR Applied Research Collaboration South London at King's College Hospital National Health Service Foundation Trust. IJH leads the Palliative and End of Life Care theme of the NIHR Applied Research Collaboration South London and co-leads the national theme in this. Professor Irene J Higginson (King’s College London), Dr. Mevhibe B Hocaoglu (King’s College London) and Dr. Nilay Hepgul (King’s College London) are supported by the National Institute for Health Research (NIHR) Applied Research Collaboration South London (NIHR ARC South London) at King’s College Hospital NHS Foundation Trust. The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care.

Our sincere thanks to all participants. Firstly, we would like to thank the president of KHYD Raziye Kocaismail for making this study possible through her support and vision. Our special thanks to Help Those with Cancer Society (KHYD) coordinator Bozdag Engin Savim and palliative care community team members Nuran Tanca, Azime Ademova and Marina Karali as who have devoted their time assisting us with data collection. We would also like to thank the POS Development Team and specifically Alice Firth for encouraging this work and providing guidance. We would like to also thank Berk Baran, Namik Kavas, Beste Guven and Isilsu Taskin who have helped with data entry. We also would like to thank our reviewers for their invaluable contribution to improvement of the presentation of this paper.


This research was funded by the National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care South London, now recommissioned as NIHR Applied Research Collaboration South London. The views expressed in this publication are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care. The research was funded by Palliative care Outcome Scale (POS).

Author information

Authors and Affiliations



All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by Mevhibe B Hocaoglu, Emine Meltem, Hande Efe, Buse Ataoglu, Yeliz Lerzan Baybar, Merve Kinacigil and Husam Elsharairi. The first draft of the manuscript was written by Mevhibe B Hocaoglu and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Mevhibe B. Hocaoglu.

Ethics declarations

Ethics approval and consent to participate

The study commenced after attaining permissions from the POS Development Team, EuroQol Group and ethical approval from the Eastern Mediterranean University Publication and Research Ethics Committee (ETK00–2017-103). Informed consent was obtained from all individual participants included in the study.

Consent for publication

Not applicable.

Competing interests

The author(s) declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: IJH developed and validated the original POS. Otherwise, the authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hocaoglu, M.B., Hepgul, N., Tunnard, I. et al. Towards patient-centred cancer care: cross-cultural validity and responsiveness of the Turkish Integrated Palliative care Outcome Scale. Health Qual Life Outcomes 18, 312 (2020).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: