- Open Access
Detection of response shift in health-related quality of life studies: a systematic review
Health and Quality of Life Outcomes volume 20, Article number: 20 (2022)
Response Shift (RS) refers to the idea that an individual may undergo changes in its health-related quality of life (HRQOL). If internal standard, values, or reconceptualization of HRQOL change over time, then answer to the same items by the same individuals may not be comparable over time. Traditional measures to evaluate RS is prone to bias and strong methodologies to study the existence of this phenomenon is required. The objective is to systematically identify, analyze, and synthesize the existing and recent evidence of statistical methods used for RS detection in HRQOL studies.
The analysis of selected studies between January 2010 and July 2020 was performed through a systematic review in MEDLINE/PubMed, Scopus, Web of Science, PsycINFO and Google Scholar databases. The search strategy used the terms “Health-Related Quality of Life” and “Response Shift” using the filters “Humans”, “Journal Article”, “English” and “2010/01/01–2020/07/31”. The search was made in August 2020.
After considering the inclusion and exclusion criteria, from the total selected articles (675), 107 (15.9%) of the publications were included in the analysis. From these, 79 (71.0%) detected the existence of RS and 86 (80.4%) only used one detection method. The most used methods were Then Test (n = 41) and Oort’s Structural Equation Models (SEM) (n = 35). Other method used were Multiple Lineal Regression (n = 7), Mixed-Effect Regression (n = 6), Latent Trajectory Analysis (n = 6), Item Response Theory (n = 6), Logistics Regression (n = 5), Regression and Classification Trees (n = 4) and Relative Importance Method (n = 4). Most of these detected recalibration, including Then Test (n = 27), followed by Oort’s SEM that detected the higher combination of RS types: recalibration (n = 24), reprioritization (n = 13) and reconceptualization (n = 7).
There is a continuous interest of studying RS detection. Oort’s SEM becomes the most versatile method in its capability for detecting RS in all different types. Despite results from previous systematic reviews, same methods have been used during the last years. We observed the need to explore other alternative methods allowing same detection capacity with robust and highly precise methodology. The investigation on RS detection and types requires more study, therefore new opportunity grows to continue attending this phenomenon through a multidisciplinary perspective.
Health-related quality of life (HRQOL) is the affectation of a patient’s physical and mental health, and their correlates, including health risk and conditions, independence level, social support, and socioeconomic status over time [1, 2].
This concept is established as a facet of an individual’s state of life while measuring its well-being as a medical patient. HRQOL is analyzed as a functional health state and identifies effective strategies to improve patient´s conditions as a result of medical interventions [3, 4].
After a medical treatment, patients may perceive and demonstrate different conditions over time, from the procedure’s initial stages up to many years after treatment has finished. The changes in the measurement of individual’s perception or internal standard is known as Response Shift (RS) [5, 6]. From a clinical perspective, RS is generated as the change in the meaning of a subject self-administrated assessment  as a valid and sensitive mechanism to evaluate the change in different moments in time .
Spranger and Schwartz  theoretical model explains how RS may affect HRQOL as a result of health state changes. As a baseline model, it presents five components: (1) a catalysts, corresponding to an individual health states or its changes as a result or not of a treatment; (2) antecedents, referring to individual’s characteristics influencing catalysts or appraisals mechanisms; (3) mechanism, explained by behavioral, cognitive, or affective processes accommodating changes in catalysts; (4) response shift, representing changes in the meaning of an individual self-evaluation of QOL resulting from changes in internal standards, values, or conceptualization; and (5) perceived QOL. Rapkin and Schwartz  propose that QOL appraisal processes must consider how individuals perceive their health status and respond questionnaires about their QOL. The model follows these processes: (1) induction of a frame of reference; (2) sampling based on the frame of reference; (3) judge against standards of comparison; and (4) combine algorithms to formulate a response. The proposal allows dynamic feedback to explain how QOL scores can be stabilized accounting inter-individual and temporary differences despite changes in health status .
An individual’s self-assessment may demonstrate changes in three contexts: in the internal standards of the measurement scale (recalibration) indicating that the patient has a new scale for measuring its own state of HRQOL; in the scale of values (reprioritization) representing a change in the priority of elements that influence the context of life; and in the definition of the objective construct (reconceptualization) when a patient raises a redefinition of its own concept .
The change processes of a patient must be appropriately measured when the effects of a disease or medical treatments is evaluated [11, 12]. The interpretation of HRQOL data represents a challenge because patients self-report their health conditions at a specific time, which can also be influenced by psychological phenomena . This suggests that HRQOL measurements must consider that the individual reports on its status, at least in two or more moments to detect significant changes over time.
Two main approaches are proposed for the detection of change: methods based on specific study designs and secondary data analysis that includes statistical methods developed to test hypotheses that do not require specific designs .
The most commonly used methodology is the retrospective Then Test design  that allows evaluating the change of patient´s internal standard by comparing the scores with two other moments: pre-test and post-test [5, 7]. However, this method is sensitive to bias and difficult to be used in longitudinal secondary data analysis .
Structural Equation Models (SEM) of Schmidt  and Oort , Item Response Theory (IRT) of Anota et al. , and Guilleaux et al. , Relative Importance Method of Lix et al. , Latent Trajectory Modelling of Ahmed et al. , and Classification and Regression Trees of Li & Schwartz  are among the most widely used and proven methods for RS detection in both primary and secondary data.
This bibliographic review has permitted to identify the methods traditionally applied in specific clinical studies related to HRQOL or to the analysis of previously elaborated databases, mainly by medical, academic or research institutions. Although other recent publications have carried out exhaustive systematic reviews to address this issue [15, 23], it is necessary to continue exploring if other alternative statistical methods are used as emerging mechanisms in the RS detection. Consequently, the purpose of this investigation is to systematically identify, analyze, and synthesize the existing evidence of new statistical methods used for RS detection in HRQOL studies.
The systematic review is a structured methodology allowing the identification and integration of different specific studies based on inclusion and exclusion criteria and facilitates the eligibility of relevant or interesting publications . Some critical and determining elements to capture the largest number of eligible publications are the number and orientation of search repositories, and the established inclusion and exclusion criteria.
The PRISMA methodology  was applied to develop this systematic review. Through pre-specified eligibility criteria, it allows reducing bias in the identification, selection, synthesis, and summary of results from previously published studies . The precision and reliability of this tool provides important benefits in health-related research .
The acceptance of this methodology has been used in recent studies on RS applied to different clinical areas: oncology [23, 28], orthopedic rehabilitation , pre-injury , as well as patient-reported outcomes (PRO) .
The selected studies were carried out through an organized review of MEDLINE/PubMed, Scopus, Web of Science Core Collection (SSCI) PsycINFO and Google Scholar databases. The terms considered in MEDLINE/PubMed search are “Quality of Life”, “Health-Related Quality of Life”, “Response Shift” in descriptors or keywords in the title and/or abstract. The search equation was “Quality of Life”[Mesh] OR “Quality of Life”[Title/Abstract] OR “Life Quality”[Title/Abstract] OR “Health-Related Quality of Life”[Title/Abstract] OR “Health Related Quality of Life”[Title/Abstract] OR “QoL” [Title/Abstract] OR “HRQoL”[Title/Abstract]) AND "Response Shift"[Title/Abstract].
The following filters were used: “Humans”, “Journal Articles”, “English”, “2010/01/01–2020/07/31". This search strategy was adopted for each of the databases consulted. The search was made in August 2020 and completed with an analysis of the selected literature between January 2010 and July 2020.
Articles that qualified for the eligibility review were those in English language that met the following criteria: adapt to the objectives of the search to identify and synthesis of statistical methods used in RS detection in HRQOL studies; be published in peer-reviewed journals and be able to retrieve the full text of the work; and the term “Response Shift” was included in the title, abstract and/or keyword; those studies in a language other than English that did not include the use of statistical methods for the RS detection, as well as studies whose main objective was not the detection of SR and its classification. Conferences, editorial notes, systematic reviews, and conceptual evaluations were excluded from the study.
Article selection was independently made by two authors (EOJ and PVG) who initially review titles, then abstracts, and read the full texts. For article inclusion, a concordance assessment between authors was established to be greater than 80% (Kappa index). In case of discrepancies, the process was repeated until they were resolved by consensus among all the authors. Figure 1 illustrates the literature search and publication selected through the PRISMA flow diagram.
Descriptive characteristics of the study
The search strategy identified a total of 675 articles in the databases of MEDLINE/PubMed (141), Scopus (46), Web of Science Core Collection (114), PsycINFO (69) y Google Scholar (305). After eliminating 363 duplicated records, 167 publications without the term “response shift” in the fields title, abstract and/or keyword, and other 38 articles excluded for not meeting the inclusion criteria, a total n = 107 (15.9%) were included in the analysis (See Additional file 1).
Based in the year of publication, 15 studies were recorded in 2017, followed by 2016 (13) and 2014 (12). An active interest in this research topic was continued during the rest of the years studied (see Fig. 2). A total of 56 journals were identified in this systematic review, where 31.8% of the articles were published in Quality of Life Research (34), followed by Health and Quality of Life Outcomes (10), Journal of Clinical Epidemiology (4) and European Journal of Cancer Care (4).
The analysis of the included articles determined that 69.2% of the studies were based on primary data, 29.0% on secondary data, and 1.8% did not specify. Different questionnaires were used to capture patient´s information. Some studies concentrated in the use of one instrument, while other indicated diverse mechanisms to collect data (see Table 1). The medical orientations of the publications were mainly in Oncology (27), Neurology (11), Psychology/Psychiatrics (10), Orthopedics (9), Oral health (7) and Cardiology (6).
About the methods for Response Shift detection
Of the 107 articles analyzed, 76 (71.0%) detected the existence of RS, 30 (28.0%) did not identify it, while one article did not indicate it (see Fig. 3). The review described the methods for RS detection, types of RS, and if studies detected or not its existence. A group of 86 (80.4%) articles used one method for RS detection, 19 (17.8%) articles used two or more methods, and two articles did not specify the method used.
Table 2 describes the frequency of methods used in these publications. 41 (31.8%) articles used the Then-Test method, 35 (27.1%) adopted the Oort’s SEM and 2 (1.6%) articles indicated the use of Schmidt’s SEM. Other models were Multiple Linear Regression (7), Mixed-Effects Regression (6), Latent Trajectory Analysis (6), Item Response Theory (6), Logistic Regression (5), Classification and Regression Tree (4) and Relative Importance Method (4). Other were used but in a smaller number of studies.
According to the detection methods used in all articles, 91 (70.5%) detected RS, while 36 (27.9%) indicated its absence. In the review, 2 (1.6%) articles did not identify the presence or absence of this phenomenon. Of the studies that detected RS through different methods, 73 indicated the presence of recalibration, 34 indicated the existence of reprioritization, 16 highlighted reconceptualization, and 7 articles detected the existence of RS, but did not specify the type (see Table 3). From these, 41 articles detected one type of RS, 20 articles registered two types of RS, only 7 studies identified the three types simultaneously. Seven articles did not indicate it.
Of the articles included (n = 107), the traditional method for RS detection Then Test registered the highest number of RS recalibration type (27), while Oort’s SEM registered a lesser number of studies detecting recalibration (24), but the highest record of reprioritization (13) and reconceptualization (7) of the entire systematic review (see Table 3). Schmidt’s SEM detected changes in internal standards only in two (2) articles. The rest of the methods also proved to be used for the detection of the three types of RS, except for the Relative Importance Methods, Mixed-Effects Regression, Random Forest Regression, and Latent Trajectory Analysis, which did not identify the presence of reconceptualization.
Despite the effectiveness for detecting RS, this review evidences the growing interest for exploring different statistical methods for RS studies (see Fig. 4). The most frequently used methods were Then Test and Oort’s SEM between 2010 and 2020. However, during the last years, the figure shows that other alternative techniques are being considered for the assessment of this phenomenon.
After the systematic review, the study examined the advances on HRQOL research through different methods for the detection of RS. It describes how the detection of this phenomenon is being evaluated in recent years, which methods are used the most, and the most identified type of RS. For physicians and researchers, systematic reviews are useful sources of evidence and scientific advances , they provide elements so clinical policy-makers can evaluate risks, benefits and effects on health care, as well as new research initiatives [26, 27].
The majority of HRQOL studies and RS detection methods were published during 2016 and 2017. One third of the articles included in the review were studying cancer disease [33,34,35,36,37,38,39,40,41]. Then Test was the most used method mainly for primary data measuring recalibration [42,43,44,45,46,47,48]. Several studies remarked that Then Test may also identify other RS types: reprioritization y reconceptualization [33, 49, 50]. Similar results were presented in Sajobi et al.  study corresponding to a systematic review about RS detecting methods were 54.5% of the articles used Then Test for this purpose. As same, in Ilie et al.  a 60.0% of the cancer studies remarked using this methodology, but authors indicate that interpretation must be cautious as it is bias prone.
Then Test has the advantage for easy handling and analysis, but its disadvantage relies in random errors and/or confound and difficult for interpretation. Therefore, this appraisal suggests the utilization of individualized methods with strong statistical rigor .
Oort’s SEM  differs from Then Test, since it is used for studies based on primary and secondary data. This multivariate method evidences the capability for detecting changes in all type of RS: recalibration, reprioritization, and reconceptualization. Several studies reiterate Oort’s SEM as an effective method to detect changes in patients, despite the different type of RS or data used [52,53,54]. This detection capacity might be the reason for a larger interest for researchers of using this method.
Schmidt’s model was used in two studies detecting only recalibration. In comparative studies with Oort’s method [55, 56], only this type of RS is identified, but conclusions indicated that both approaches use different parameters to identify recalibration: Schmidt defines recalibration as the change in factor variances or factor loadings over time, while Oort by the change in intercepts.
Other methods obtained more records for RS detection: Mixed-Effects and Multiple Linear Regression [57,58,59,60], Classification and Regression Trees [22, 61], Item Response Theory [18, 62] and Relative Importance Methods [63,64,65].
Despite a major frequency of methods to detect recalibration, it calls the attention that all three studies using Relative Importance Method detected reprioritization [63,64,65]. Mixed-Effect Regression method [57, 58], Classification and Regression Trees [22, 61] and Latent Trajectory Analysis  neither provided information on reconceptualization.
During this study we observed that the sample size is related to the type of method used for RS detection. Then Test is more flexible and functional in small samples or in specific studies, while methods based on stronger statistic techniques require larger samples. According to Schwartz et al. , for using advanced multivariate methods capable to detect RS, data analysis must include sufficient individuals participating in the study, as well as considering certain number of parameters such a clear the model, loading factor, relationship between the items, data distribution, and processes for estimating these parameters.
The need of exploring new multivariate methodologies for analyzing this phenomenon brings an alternative proposal for studying HRQOL and RS detection through three-way data: dual STATIS Method [68, 69]. The proposal presented by Vicente Galindo  centers in a procedure integrating the dual STATIS methods and the comparison of Krzanowski  subspaces, and examinates factorial structures from multiple data sets focused to identify the existence of change.
The systematic reviews evaluated in this study [15, 23, 28,29,30,31] confirm the continuous use of the same methods for detecting RS and its different types, their advantages, and limitations. The previous proposal is an example of existing opportunities to continue examining other strong statistic methodologies allowing to deepen this line of investigation and reducing bias and analysis ambiguities.
The systematic review has demonstrated to become an adequate and convenient methodology to identify and synthetize advances of specific topics. Results have evidenced a generalized interest for studying HRQOL and RS for different diagnostic groups. RS detection continue attracting researcher’s attention that have consolidated a set of methods for its analysis: Then Test, Oort’s SEM, Multiple Linear and Mixed-Effects Regressions, Item Response Theory and Latent Trajectory Analysis. Oort’s SEM becomes the most versatile method in its capability for detecting RS in all different types.
Results demonstrated that not all the methods achieve RS detection in similar proportions, mostly capable to identify recalibration, in some cases reprioritization, and in few studies reconceptualization. At the same time, previous systematic reviews and the result from this updating research conclude that same methods have been used during the last years and there is no evidence found of alternative statistical techniques proposed for detecting RS. Perhaps, our study states a need for exploring other methods with similar detection capacity, with robust and highly precise methodology either graphical oriented or with simpler methodologies.
Previous systematic reviews and the need to continue investigating about this phenomenon have motivated the update of this search within the last decade (2010–2020). Although these reviews have used a larger number of search terms including different RS types as well as data measurement characteristics, this systematic review has intentionally generalized the terms using RS and HRQOL to focus the results on those studies centered on this topic.
Since RS can be evaluated from different perspectives, and other disciplines such as statistics, psychology, humanities, and other related social sciences can provide significant contributions, it is recommended to continue studying the RS phenomenon, its detection, and types from a multidisciplinary approach.
Availability of data and materials
All data generated or analyzed during this study are included in this published article and its supplementary information files.
Health-Related Quality of Life
Structural Equation Model
World Health Organization [WHO]. WHOQOL: measuring quality of life. https://apps.who.int/iris/handle/10665/63482 (1997). Accessed 20 Aug 2020.
Centers for Disease Control and Prevention [CDC]. Measuring healthy days: population assessment of health-related quality of life. https://www.cdc.gov/hrqol/pdfs/mhd.pdf (2000). Accessed 20 Aug 2020.
Kang K, Gholizadeh L, Inglis SC, Han HR. Interventions that improve health-related quality of life in patients with myocardial infarction. Qual Life Res. 2016;25(11):2725–37. https://doi.org/10.1007/s11136-016-1401-8.
Shiroiwa T, Fukuda T, Shimozuma K, et al. Long-term health status as measured by EQ-5D among patients with metastatic breast cancer: comparison of first-line oral S-1 and taxane therapies in the randomized phase III SELECT BC trial. Qual Life Res. 2017;26(2):445–53. https://doi.org/10.1007/s11136-016-1388-1.
Howard G, Dailey P. Response shift bias: a source of contamination of self-reporting measures. J Appl Psychol. 1979;64(2):144–50. https://doi.org/10.1037/0021-9010.64.2.144.
Golembiewski RT, Billingsley K, Yeager S. Measuring change and persistence in human affairs: types of changes generated by OD design. J Appl Behav Sci. 1976;12(2):133–57. https://doi.org/10.1177/002188637601200201.
Schwartz CE, Sprangers MA. Methodological approaches for assessing response shift in longitudinal quality of life research. Soc Sci Med. 1999;48(11):1531–48. https://doi.org/10.1016/s0277-9536(99)00047-7.
Hamidou Z, Dabakuyo-Yonio T, Bonnetain F. Impact of response shift on longitudinal quality of life assessment in cancer clinical trials. Expert Rev Pharmacoecon Outcomes Res. 2011;11(5):549–59. https://doi.org/10.1586/erp.11.57.
Sprangers MA, Schwartz CE. Integrating response shift into health-related quality of life research: a theoretical model. Soc Sci Med. 1999;48(11):1507–15. https://doi.org/10.1016/s0277-9536(99)00045-3.
Rapkin BD, Schwartz CE. Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health Qual Life Outcomes. 2004;2(14):66. https://doi.org/10.1186/1477-7525-2-14.
McPhail S, Haines T. Response shift, recall bias and their effect on measuring change in health-related quality of life amongst older hospital patients. Health Qual Life Outcomes. 2010;8:65. https://doi.org/10.1186/1477-7525-8-65.
Crosby RD, Kolotkin RL, Williams GR. Defining clinically meaningful change in health-related quality of life. J Clin Epidemiol. 2003;56(5):395–407. https://doi.org/10.1016/S0895-4356(03)00044-1.
Kvam AK, Wisløff F, Fayers PM. Minimal important differences and response shift in health-related quality of life; a longitudinal study in patients with multiple myeloma. Health Qual Life Outcomes. 2010;8:79. https://doi.org/10.1186/1477-7525-8-79.
Bulteau S, Sauvaget A, Vanier A, et al. Depression reappraisal and treatment effect: will response shift help improve the estimation of treatment efficacy in trials for mood disorders? Front Psychiatry. 2019;10(420):1–3. https://doi.org/10.3389/fpsyt.2019.00420.
Sajobi TT, Brahmbatt R, Lix L, Zumbo B, Sawatzki R. Scoping review of response shift methods: current reporting practices and recommendations. Qual Life Res. 2018;27(5):1133–46. https://doi.org/10.1007/s11136-017-1751-x.
Schmidt N. The use of analysis of covariance structures to assess beta and gamma change. Multivar Behav Res. 1982;17(3):343–58. https://doi.org/10.1207/s15327906mbr1703_3.
Oort FJ. Using structural equation modeling to detect response shifts and true change. Qual Life Res. 2005;14(3):587–98. https://doi.org/10.1007/s11136-004-0830-y.
Anota A, Bascoul-Mollevi C, Conroy T, et al. Item response theory and factor analysis as a mean to characterize occurrence of response shift in a longitudinal quality of life study in breast cancer patients. Health Life Outcomes. 2014;12(32):2–18. https://doi.org/10.1186/1477-7525-12-32.
Guilleux A, Blanchin M, Vanier A, et al. RespOnse Shift ALgorithm in Item response theory (ROSALI) for response shift detection with missing data in longitudinal patient-reported outcome studies. Qual Life Res. 2015;24(3):553–64. https://doi.org/10.1007/s11136-014-0876-4.
Lix LM, Sajobi TT, Sawatzky R, et al. Relative importance measures for reprioritization response shift. Qual Life Res. 2013;22(4):695–703. https://doi.org/10.1007/s11136-012-0198-3.
Ahmed S, Mayo N, Scott S, Kuspinar A, Schwartz C. Using latent trajectory analysis of residuals to detect response shift in general health among patients with multiple sclerosis article. Qual Life Res. 2011;20:1555–60. https://doi.org/10.1007/s11136-011-0005-6.
Li Y, Schwartz C. Data mining for response shift patterns in multiple sclerosis patients using recursive partitioning tree analysis. Qual Life Res. 2011;20:1543–53. https://doi.org/10.1007/s11136-011-0004-7.
Ilie G, Bradfield J, Moodie L, et al. The role of response-shift in studies assessing quality of life outcomes among cancer patients: a systematic review. Front Oncol. 2019;9:783. https://doi.org/10.3389/fonc.2019.00783.
Montori VM, Swiontkowski MF, Cook DJ. Methodologic issues in systematic reviews and meta-analyses. Clin Orthop Relat Res. 2003;413:43–54. https://doi.org/10.1097/01.blo.0000079322.41006.5b.
Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1. https://doi.org/10.1186/2046-4053-4-1.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7): e1000097. https://doi.org/10.1371/journal.pmed.1000097.
Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009;339:b2700. https://doi.org/10.1136/bmj.b2700.
Nielsen LK, Jarden M, Andersen CL, Frederiksen H, Abildgaard NA. Systematic review of health-related quality of life in longitudinal studies of myeloma patients. Eur J Haematol. 2017;99:3–17. https://doi.org/10.1111/ejh.12882.
Powden C, Hoch M, Hoch J. Examination of response shift after rehabilitation for orthopedic conditions: a systematic review. J Sport Rehabil. 2018;27:469–79. https://doi.org/10.1123/jsr.2017-0104.
Scholten AC, Haagsma JA, Steyerberg EW, vanBeeck EF, Polinder S. Assessment of pre-injury health-related quality of life: a systematic review. Popul Health Metr. 2017;15:10. https://doi.org/10.1186/s12963-017-0127-3.
Hinds AM, Sajobi TT, Sebille V, Sawatzky R, Lix LM. A systematic review of the quality of reporting of simulation studies about methods for the analysis of complex longitudinal patient-reported outcomes data. Qual Life Res. 2018;27(10):2507–16. https://doi.org/10.1007/s11136-018-1861-0.
Manchikanti L, Datta S, Smith HS, Hirsch JA. Evidence-based medicine, systematic reviews, and guidelines in interventional pain management: part 6. Systematic reviews and meta-analyses of observational studies. Pain Phys. 2009;12(5):819–50.
Taminiau-Bloem E, van Zeuuren F, Koeneman M, et al. A ‘short walk’ is longer before radiotherapy than afterwards: a qualitative study questioning the baseline and follow-up design. Health Qual Life Outcomes. 2010;8:69. https://doi.org/10.1186/1477-7525-8-69.
Neuman H, Park J, Fuzesi S, Temple L. Rectal cancer patients’ quality of life with a temporary stoma: shifting perspectives. Dis Colon Rectum. 2010;55(11):1117–24. https://doi.org/10.1097/DCR.0b013e3182686213.
Dabakuyo TS, Guillemin T, Conroy T, et al. Response shift effects on measuring post-operative quality of life among breast cancer patients: a multicenter cohort study. Qual Life Res. 2013;22:1–11. https://doi.org/10.1007/s11136-012-0135-5.
Brinksma A, Tissing WJ, Sulkers E, Kamps WA, Roodbol PF, Sanderman R. Exploring the response shift phenomenon in childhood patients with cancer and its effect on health-related quality of life. Oncol Nurs Forum. 2014;41(1):48–56. https://doi.org/10.1188/14.ONF.41-01AP.
Gerlich C, Schuler M, Jelitte M, et al. Prostate cancer patients’ quality of life assessments across the primary treatment trajectory: ‘True’ change or response shift? Acta Oncol. 2016;55(7):814–20. https://doi.org/10.3109/0284186X.2015.1136749.
Tessier P, Blanchin M, Sébile V. Does the relationship between health-related quality of life and subjective well-being change over time? An exploratory study among breast cancer patients. Soc Sci Med. 2017;174:96–103. https://doi.org/10.1016/j.socscimed.2016.12.021.
Aburub A, Gagnon B, Ahmed S, Rodríguez AM, Mayo N. Impact of reconceptualization response shift on rating of quality of life over time among people with advanced cancer. Support Care Cancer. 2018;26(9):3063–71. https://doi.org/10.1007/s00520-018-4156-7.
Preiß M, Friedrich M, Stolzenburg JU, Zenger M, Hinz A. Response shift effects in the assessment of urologic cancer patients’ quality of life. Eur J Cancer Care. 2019;28(4):1–8. https://doi.org/10.1111/ecc.13027.
Murata T, Suzukamo Y, Shiroiwa T, et al. Response Shift-adjusted treatment effect on health-related quality of life in a randomized controlled trial of Taxane versus S-1 for metastatic breast cancer: structural equation modeling. Value Health. 2020;23(6):768–74. https://doi.org/10.1016/j.jval.2020.02.003.
Dempster M, Carney R, McClements R. Response shift in the assessment of quality of life among people attending cardiac rehabilitation. Br J Health Psychol. 2010;15:307–19. https://doi.org/10.1348/135910709X464443.
Shi HY, Lee KT, Lee HH. Response shift effect on gastrointestinal quality of life index after laparoscopic cholecystectomy. Qual Life Res. 2011;20:335–41. https://doi.org/10.1007/s11136-010-9760-z.
Galenkamp H, Huisman M, Braam A, Deeg D. Estimates of prospective change in self-rated health in older people were biased owing to potential recalibration response shift. J Clin Epidemiol. 2012;65:978–88. https://doi.org/10.1016/j.jclinepi.2012.03.010.
Rutgers M, Creemers L, Yang KG, Raijmakers N, Dhert W, Saris D. Osteoarthritis treatment using autologous conditioned serum after placebo. Patient considerations and clinical response in a non-randomized case series. Acta Orthop. 2015;86(1):114–8. https://doi.org/10.3109/17453674.2014.950467.
Arthur J, Watts T, Davies R, Manchaiah V, Slater J. An exploratory study identifying a possible response shift phenomenon of the Glasgow hearing aid benefit profile. Audiol Res. 2016;6(152):44–8. https://doi.org/10.4081/audiores.2016.152.
Reissmann D, Erler A, Hirsch C, Sierwald I, Machuca C, Schierz O. Bias in retrospective assessment of perceived dental treatment effects when using the Oral Health Impact Profile. Qual Life Res. 2018;27:775–82. https://doi.org/10.1007/s11136-017-1725-z.
Haagsma J, Spronk I, de Jongh M, Bonsel G, Polinder S. Conventional and retrospective change in health-related quality of life of trauma patients: an explorative observational follow-up study. Health Qual Life Outcomes. 2020;18:157. https://doi.org/10.1186/s12955-020-01404-1.
Höfer S, Pfaffenberger N, Renn D, Platter M, Ring L. Coronary intervention improves disease specific health-related quality of life but not individualised quality of life: a potential response shift effect? Applied Res Qual Life. 2011;6:81–90. https://doi.org/10.1007/s11482-010-9117-3.
Machuca C, Vettore M, Krasuska M, Baker S, Robinson P. Using classification and regression tree modelling to investigate response shift patterns in dentine hypersensitivity. BMC Med Res Methodol. 2017;17:120. https://doi.org/10.1186/s12874-017-0396-3.
Schwartz CE. Applications of response shift theory and methods to participation measurement: a brief history of a young field. Arch Phys Med Rehabil. 2010;91(9):S38–43. https://doi.org/10.1016/j.apmr.2009.11.029.
DeConde A, Bodner T, Mace J, Smith T. Response shift in quality of life after endoscopic sinus surgery for chronic rhinosinusitis. JAMA Otolaryngol Head Neck Surg. 2014;140(8):712–9. https://doi.org/10.1001/jamaoto.2014.1045.
Verdam MG, Oort FJ, Sprangers MAG. Structural equation modeling-based effect-size indices were used to evaluate and interpret the impact of response shift effect. J Clin Epidemiol. 2017;66:8537–44. https://doi.org/10.1016/j.jclinepi.2017.02.012.
Wang X, Xu X, Han H, et al. Using structural equation modeling to detect response shift in quality of life in patients with Alzheimer’s disease. Int Psychogeriatr. 2018;31(1):123–32. https://doi.org/10.1017/S1041610218000595.
Gandhi PK, Ried LD, Huang IC, Kimberlin C, Kauf T, Suh DC. Identification of Response Shift among hypertensive patients with coronary artery disease using two structural equation modeling techniques. Value Health. 2011;14(3):A52–3. https://doi.org/10.1016/j.jval.2011.02.298.
Gandhi PK, Ried LD, Huang IC, Kimberlin C, Kauf T. Assessment of response shift using two structural equation modeling techniques. Qual Life Res. 2013;22:461–71. https://doi.org/10.1007/s11136-012-0171-1.
Lacey H, Loewenstein G, Ubel P. Compared to what? A joint evaluation method for assessing quality of life. Qual Life Res. 2011;20:1169–77. https://doi.org/10.1007/s11136-011-9856-0.
Schwartz C, Quaranto B, Rankin B, Healy B, Vollmer T, Sprangers M. Fluctuations in appraisal over time in the context of stable versus non-stable health. Qual Life Res. 2014;23:9–19. https://doi.org/10.1007/s11136-013-0471-0.
Nichols G, Antoun J, Fowler P, Al-Ani A, Farella M. Long-term changes in oral health-related quality of life of standard, cleft, and surgery patients after orthodontic treatment: a longitudinal study. Am J Orthod Dentofac Orthop. 2018;153(2):224–31. https://doi.org/10.1016/j.ajodo.2017.06.018.
Felix J, Becker C, Vogl M, Buschner P, Plötz W, Leidi R. Patient characteristics and valuation changes impact quality of life and satisfaction in total knee arthroplasty – results from a German prospective cohort study. Health Qual Life Outcomes. 2019;17:180. https://doi.org/10.1186/s12955-019-1237-3.
Machuca C, Vettore M, Robinson P. How peoples’ ratings of dental implant treatment change over time? Qual Life Res. 2020;29:1322–34. https://doi.org/10.1007/s11136-019-02408-1.
Blanchin M, Sébille V, Guilleux A, Hardouin J. The Guttman errors as a tool for response shift detection at subgroup and item levels. Qual Life Res. 2016;25:1385–93. https://doi.org/10.1007/s11136-016-1268-8.
Schwartz C, Sajobi T, Lix L, Quaranto B, Finkelstein J. Changing values, changing outcomes: the influence of reprioritization response shift on outcome assessment after spine surgery. Qual Life Res. 2013;22:2255–64. https://doi.org/10.1007/s11136-013-0377-x.
Sajobi TT, Fiest KM, Wiebe S. Changes in quality of life after epilepsy surgery: The role of reprioritization response shift. Epilepsia. 2014;55(9):1331–8. https://doi.org/10.1111/epi.12697.
Sajobi TT, Lix L, Singh G, Lowerison M, Engbers J, Mayo N. Identifying reprioritization response shift in a stroke caregiver population: a comparison of missing data methods. Qual Life Res. 2015;24:529–40. https://doi.org/10.1007/s11136-014-0824-3.
Salmon M, Blanchin M, Rotonda C, Guillemin F, Sebille V. Identifying patterns of adaptation in breast cancer patients with cancer-related fatigue using response shift analyses at subgroup level. Cancer Med. 2017;6(11):2562–75. https://doi.org/10.1002/cam4.1219.
Schwartz C, Ahmed S, Sawatzky R, et al. Guidelines for secondary analysis in search of response shift. Qual Life Res. 2013;22:2663–73. https://doi.org/10.1007/s11136-013-0402-0.
L’Hermier des Plantes H. Structuration des tableaux á trois indices de la statistique. Théorie et applications d’une méthode d’analyse conjointe. 1976. Thése 3° cycle, USTL, Montpellier.
Escoufier Y. Opérateur associé á un tableau de données. Annales de L’Insee. 1976;22–23:165–79. https://doi.org/10.2307/20075217.
Vicente-Galindo P. Contribuciones al análisis de datos de calidad de vida relacionada con la salud. 2003. Doctoral tesis, University of Salamaca, Spain.
Krzanowski WJ. Between-groups comparison of principal components. J Am Stat Assoc. 1979;74(367):703–7. https://doi.org/10.1080/01621459.1979.10481674.
The authors declare that they have not received special funds, grants or financial support for this research nor publication.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Ortega-Gómez, E., Vicente-Galindo, P., Martín-Rodero, H. et al. Detection of response shift in health-related quality of life studies: a systematic review. Health Qual Life Outcomes 20, 20 (2022). https://doi.org/10.1186/s12955-022-01926-w
- Systematic review
- Response shift
- Multivariate analysis
- Statistical methods