“When I saw walking I just kind of took it as wheeling”: interpretations of mobility-related items in generic, preference-based health state instruments in the context of spinal cord injury
Health and Quality of Life Outcomes volume 14, Article number: 164 (2016)
In health economic analyses, health states are typically valued using instruments with few items per dimension. Due to the generic (and often reductionist) nature of such instruments, certain groups of respondents may experience challenges in describing their health state. This study is concerned with generic, preference-based health state instruments that provide information for decisions about the allocation of resources in health care. Unlike physical measurement instruments, preference-based health state instruments provide health state values that are dependent on how respondents interpret the items. This study investigates how individuals with spinal cord injury (SCI) interpret mobility-related items contained within six preference-based health state instruments.
Secondary analysis of focus group transcripts originally collected in Vancouver, Canada, explored individuals’ perceptions and interpretations of mobility-related items contained within the 15D, Assessment of Quality of Life 8-dimension (AQoL-8D), EQ-5D-5L, Health Utilities Index (HUI), Quality of Well-Being Scale Self-Administered (QWB-SA), and the 36-item Short Form health survey version 2 (SF-36v2). Ritchie and Spencer’s ‘Framework Approach’ was used to perform thematic analysis that focused on participants’ comments concerning the mobility-related items only.
Fifteen individuals participated in three focus groups (five per focus group). Four themes emerged: wording of mobility (e.g., ‘getting around’ vs ‘walking’), reference to aids and appliances, lack of suitable response options, and reframing of items (e.g., replacing ‘walking’ with ‘wheeling’). These themes reflected item features that respondents perceived as relevant in enabling them to describe their mobility, and response strategies that respondents could use when faced with inaccessible items.
Investigating perceptions to mobility-related items within the context of SCI highlights substantial variation in item interpretation across six preference-based health state instruments. Studying respondents’ interpretations of items can help to understand discrepancies in the health state descriptions and values obtained from different instruments. This line of research warrants closer attention in the health economics and quality of life literature.
Generic, preference-based health state instruments play an important role in informing priorities regarding available treatment options . Preference-based health state instruments consist of two components: a ‘descriptive system’ that asks respondents to describe their health by responding to questions in a standardized questionnaire (resulting in health state descriptions) and a ‘valuation system’ that provides preference weights (also known as index scores) that represent the values that respondents, usually from the general population, attach to living in each health state (health state values).
Instruments used to measure health-related quality of life (HRQoL) can be classified as either generic or specific to a particular disease, condition, or population otherwise defined (e.g., older adults). Disease-specific instruments are more sensitive to small changes in HRQoL for the target group because they focus on aspects that are known to be relevant to that group. In contrast, generic instruments are intended to be applicable to a wide range of conditions . Information gained by using generic and disease-specific instruments is valuable when conducting economic evaluation to inform decision processes concerning competing demands for scarce health care resources [1, 3–6]. However, only generic instruments allow for comparisons of interventions across different diseases and patient groups.
Instruments used to measure preference-based HRQoL are often referred to as utility instruments, health state utility instruments, preference-based HRQoL instruments or health state instruments. The variety of terms used suggests an underlying lack of conceptual clarity of the definition and theory of ‘quality of life’ . In this study, generic preference-based health state instruments are referred to as ‘health state instruments’. The items and dimensions contained within health state instruments differ in their conceptual coverage of physical, social and mental health. Throughout this paper, ‘item’ is referred to as “a linguistic statement generally consisting of a stem plus a number of ordered response levels” , whereas ‘dimension’ is used to describe the conceptual idea that is represented by one or several items, e.g., ‘mobility’ or ‘usual activities’ .
What most health state instruments have in common is that a small number of items (often only one) represent each dimension. This is in contrast to classic measurement theory in psychometrics, which recommends measuring each dimension by several items in order to improve reliability and validity . Asking respondents to describe their health by choosing response options in a questionnaire is considerably different from measuring physical parameters like a person’s body temperature. While a clinical thermometer directly transforms body temperature to a displayed number, the application of a questionnaire includes at least two phases of interpretation. Firstly, the respondent needs to interpret the questions in the questionnaire in order to choose a response option. Secondly, the recipient of the data needs to interpret the results. Knowing how respondents interpret items is crucial to ensure that an instrument measures what it is supposed to measure . Diverging interpretations can occur if (i) respondents interpret items in a way that diverges from the interpretation originally intended by the instrument developer, or (ii) if the item interpretation by a subgroup of respondents (e.g., wheelchair users) diverges systematically from interpretations made by the individuals outside of that subgroup. Either situation is problematic for any questionnaire that is used to capture health status (or, more broadly, quality of life) because the validity of the data is compromised. There is a sizeable literature on variation of health state values between different groups (e.g., age groups, educational groups, countries, and patients vs. general population) [11, 12], and variation in health state values observed when the same individuals describe their health using different health state instruments [8, 13–16]. Systematic differences in item interpretation across subgroups may well be a factor in explaining observed variation in health state descriptions and values.
Although the instruments used to measure HRQoL are intended for quantitative use, qualitative research is a highly appropriate means of exploring what is driving the differences in health state descriptions and values [17, 18]. As health state instruments are often used to capture impairments, it is problematic if groups that have significant levels of impairment cannot adequately describe their health state. A focus group study by Whitehurst and colleagues found that individuals living with spinal cord injury (SCI) is a subgroup that faces challenges in describing their health state . These findings supported other studies–outside the context of preference-based instruments–that suggest mobility-related items in standardized, generic HRQoL questionnaires pose challenges for individuals living with SCI [20–22]. Item interpretation has been widely studied in the field of psychometrics and the need for respondents to interpret an item before they can choose an appropriate response option is a well-established phase within theoretical models that describe the response process [11, 23–25]. However, there have been relatively few studies focusing on health state instruments [10, 26]. The presence of diverging item interpretations and its impact on the validity of health state descriptions and values is an under-researched empirical question in health economics. The aim of this study is to further explore and describe difficulties faced by respondents living with SCI when answering mobility-related items included in health state instruments.
Data, Participants and Instruments
This study comprises secondary analysis of focus group transcript data collected in Vancouver, Canada in 2012. The aim of the original data collection was to explore the perceptions of individuals living with SCI towards all items included in health state instruments and to identify ‘preferred’ instruments from the participants’ perspective . Participants were recruited from the Vancouver General Hospital Spine Program. Purposive sampling was used to include a range of participants with regard to gender, type and severity of injury, and time since injury. Consenting participants received copies of the descriptive systems of six health state instruments (further details provided below) via mail in advance of the focus group session. Participants were asked to review the descriptive systems at home, prior to attending the focus group. Based on their availability, participants were allocated into three focus groups sessions led by an experienced focus group facilitator. During the two-hour focus group sessions, participants discussed their general perceptions of the descriptive systems in line with a structured template including the following questions: (i) What are your immediate thoughts about questionnaire X? (ii) Do you feel that questionnaire X (or particular items within questionnaire X) applies to you? (iii) Do you have any further thoughts regarding questionnaire X? (iv) Given the objective of these questionnaires, is questionnaire X acceptable to you as a whole? . At the beginning of each focus group, participants were informed about the objectives of the session and the role of generic health state instruments (i.e., that the instruments were designed to be applicable for all individuals rather than a specific clinical context). Full details of the sample characteristics, exclusion criteria, recruitment procedure, and conduct of the focus groups are described elsewhere .
Mobility-related items feature in all of the health state instruments included in this study, namely 15D , Assessment of Quality of Life 8-dimension (AQoL-8D) , EQ-5D-5L , Health Utilities Index (HUI) , Quality of Well-Being Scale Self-Administered (QWB-SA) , and the SF-6D (participants were asked to consider and discuss the full 36-item Short Form health survey version 2 (SF-36v2) rather than the 11 items that comprise the SF-6D ). However, the way the descriptive systems require respondents to describe aspects of their mobility differs markedly. This study focused on perceptions of items related to issues of mobility, physical functioning, or ambulation. Table 1 provides an overview of the mobility-related items included in the descriptive systems of the instruments, while Appendix 1 includes the exact wording of the mobility-related items.
Thematic analysis of focus group data
Thematic analysis of the transcript data had the explorative objective to describe how individuals living with SCI perceive and interpret mobility-related items of the six health state instruments. The analysis was guided by Ritchie and Spencer’s ‘Framework Approach’ . The approach consists of several phases: researchers (a) familiarize themselves with the data, (b) identify an initial thematic framework, (c) index and sort the data, (d) review and redefine extracted data, build categories that comprise themes and, (e) interpret identified categories. Two authors (YAM, LE) independently familiarized themselves with the focus group transcripts and agreed on an initial thematic framework covering mobility-related content (phases a-c). Indexing and sorting resulted in a matrix table that summarized the data along the themes (rows) and the respective instruments (columns). Transcripts were re-read and the initial coding framework was adjusted to ensure that all relevant aspects mentioned in the focus groups were covered by the themes (phase d). To ease interpretation, themes were assigned to higher-order categories (phase e). The same two authors (YAM, LE) conducted the analysis; all members of the study team discussed the results and interpretation of each phase.
Fifteen individuals participated in three focus groups (five per focus group). Four themes emerged from the analysis (see Table 2): (i) wording of mobility, (ii) reference to aids and appliances, (iii) lack of suitable response options, and (iv) reframing of items. The first three themes describe item features that cause difficulties when respondents attempt to describe their health state; the fourth theme summarizes comments about a response strategy respondents proposed when facing inaccessible items.
Results are presented by theme rather than by instrument because the primary interest of this study is to describe and highlight participants’ general perceptions to mobility-related items (rather than draw comparisons across instruments). Additional information is reported in Appendix 2, which provides a systematized overview of the mobility-related content from the focus group transcripts (i.e., the themes of the final coding framework and the respective mobility-related quotes). Focus group abbreviations (i.e., FG1, FG2 and FG3) and instrument names indicate the respective instrument and focus group transcript for each quote. For example, ‘(FG2, 15D)’ indicates that the quote is in reference to the 15D, made during the second focus group.
Wording of mobility
Participants in the focus groups commented on items that related mobility solely to walking: “I didn’t like the choice of words…, I don’t think walking is your only parameter for mobility” (FG1, 15D). Furthermore, participants highlighted that individuals with SCI can be mobile despite not being able to walk: “You can still get around but you just can’t do it by walking” (FG2, EQ-5D-5L). Most participants preferred ‘getting around’, as used in the AQoL-8D. Such wording was considered to be more inclusive: “I liked the wording…, it doesn't exclude anybody getting around" (FG3, AQoL-8D); "It doesn't say anything about walking…, it just says mobility” (FG2, AQoL-8D).
Reference to aids and appliances
The way aids and appliances are incorporated in the items was often discussed by participants. “They’re beating around the bush about equipment but they’re not mentioning you’re unable to walk but are you able to get around. It’s a mobility thing,…[It needs to be] defined a little bit more, if you’re trying to find wheelchair people” (FG2, HUI). Participants regarded the manner in which equipment was mentioned in the AQoL-8D positively: "I liked number fifteen when it talks [about] mobility, it also included aids or equipment such as wheelchairs, frames, stations and stuff because if… I have the equipment I feel comfortable with my mobility" (FG1, AQol-8D). Participants also felt that instruments were more inclusive if the use of a wheelchair was mentioned explicitly: “… if the wheelchair is in there…, I’d feel more part of it” (FG1, general remark). Regarding the HUI, the combination of aids and human assistance was perceived as confusing: “If I’m in a standing frame or a walker I can walk, but I can't walk unassisted…, none of them really helped me answer that one" (FG1, HUI).
Lack of suitable response options
Participants expressed difficulties in finding response options that allowed them to describe their level of physical functioning. Often these difficulties were related to narrow wording that equates mobility to walking, or to the omission of mobility aids: “I thought that question was kind of hard to fill out. …Well it didn’t really have an option for me per se because like there again this question is put in front of somebody like they don’t know whether you’re in a wheelchair or you’re a quadriplegic, paraplegic or if you’re bedridden or you can walk with a cane, right?” (FG3, 15D). All participants were wheelchair users and, unsurprisingly, this aid was referred to most often: “I mean they’re not applicable to people who are confined on a wheelchair” (FG1, QWB-SA). Participants had concerns about giving a false idea of their health state as a consequence of the lack of applicable and relevant response options: “By having questions like this that have nothing to do with me, so they’re not going to get any information, or they may even get a false sense of my health status by asking questions like that” (FG3, SF-36v2). The lack of relevant response options led some participants to choose at random: “It is just like just close our eyes and pick one” (FG3, 15D). However, participants did find relevant response options for the AQoL-8D: “The question seems appropriate, people like this question because the options are relevant as opposed to walking” (FG3, AQoL-8D).
Reframing of items
In this paper, the term ‘reframing’ is used to describe scenarios in which participants reinterpret a word or phrase in order to make an item accessible. For example, “When I saw walking I just kind of took it as wheeling. … I’ll just say wheeling instead, I don’t mind crossing that off and putting that” (FG2, SF-36v2); “It didn’t jump out at me right away, so I kind of like, well I’ll just change it to wheel again” (FG2, HUI); “Wheeling is our equivalent to walking” (FG3, HUI). One participant mentioned that wheeling is the natural description for walking when thinking about mobility-related daily activities: “When I take my dog for a walk, I just say I’m going to go take my dog for a wheel” (FG2, HUI). Participants mentioned that wheeling allows them to portray their mobility-related health state in a way that feels closer to their actual experience: “If it said wheeling I can do it no problem, they can gather that my health is pretty good” (FG3, SF-36v2).
This study explored diverging item interpretations in the descriptive systems of health state instruments, using the example of individuals with SCI and mobility-related items. Study participants consistently reported difficulties in finding relevant response options for mobility-related items. Consequently, some participants interpreted items differently from the originally intended meaning. Although this allowed them to describe their level of mobility ‘correctly’, from their own perspective, such diverging item interpretations pose a direct threat to the validity of health state instruments.
Narrow wording was a central topic in the focus group discussions. Previous findings have questioned the suitability of the word ‘walking’ for the SCI population, although not within the context of health state instruments. For example, the word ‘walking’ has been considered unacceptable and even perceived as offensive and inappropriate in an investigation of the SF-36 and the Quality of Well-Being scale in an SCI population . Similarly, respondents in a qualitative study reported problems in interpreting the physical functioning items of the SF-36 due to narrow wording . Dijkers concluded that the wording used to capture physical functioning in the SF-36v2 is suitable only if the aim is to capture impairment – but not if the level of functioning or participation is to be measured . Despite the important role of wording for item interpretation (and, therefore, for the validity of health state instruments), it has so far received little attention in the health economics literature.
A number of study participants proposed reframing as a response strategy to provide a more ‘correct’ description of their level of mobility, i.e., choosing to replace “walking” with “wheeling”. Within the context of health state instruments, this means that the value assigned to a particular reframed health state description is incorrect, because participants in the respective valuation study did not value the reframed health state. This is one example of how reframing can pose a threat to the validity of health state instruments. A related issue is that the recipient of the data is unlikely to know if reframing took place, and for whom it took place . When making use of data from questionnaires, a tacit assumption is that the respondents are relatively homogeneous in their item interpretations, or at least that any variance in item interpretation can be handled as normally distributed measurement error. This assumption allows the recipient of the data to disregard respondent variation in interpretation of the scales since it is assumed that the errors will cancel out, on average, given a large sample size. However, if specific groups of respondents systematically deviate in their interpretation of the scales, the results for these groups will be biased, regardless of the sample size. Examining mobility within the context of SCI has highlighted that reframing is problematic and it is highly likely that reframing occurs in other patient groups, e.g., individuals with motor neurone disease , and for items/dimensions other than mobility.
A second recurring issue in the focus groups was the way aids and appliances are referred to in health state instruments. Some participants wanted the wheelchair to be mentioned explicitly, while others would have liked to have instructions on if and how aids should be taken into account. These reactions are in line with findings from a study involving patients with motor neurone disease responding to the 3-level EQ-5D (EQ-5D-3L) . Individuals using aids and appliances (e.g., hearing aids, eyeglasses and wheelchairs) or medications (e.g., painkillers) that influence the symptoms and/or functionings described in the descriptive systems could face comparable challenges if no explicit instruction to aid interpretation is provided; as shown in Table 1, there is no consensus among current instruments. Asada developed a classification that differentiates between medical technologies (e.g., medication), nonhuman aids (e.g., wheelchair), human assistance (e.g., help of another person when walking) and accommodating environmental factors (e.g., a barrier-free physical environment), and suggests to include medical technologies and nonhuman aids only in the assessment of health . To some extent, this position is reflected in the current state of play because none of the health state instruments included in this study (15D, AQoL-8D, EQ-5D-5L, HUI, QWB-SA or SF-6D) refer to environmental factors, such as accessibility and the availability of rehabilitation.
Modifying items is one approach to try to make items more accessible to a broader range of clinical contexts. There have been several attempts in the literature to modify items of non-preference-based HRQoL instruments, primarily focusing on the physical functioning dimension of the SF-36 [21, 36, 37]. However, modifying health state instruments is problematic for several reasons. Firstly, comparisons across different patient groups are no longer valid if an instrument includes modified items or instructions for a particular subgroup of respondents. Secondly, psychometric evidence for the original instrument cannot be considered valid evidence for the modified version of the instrument. Thirdly, as alluded to above, health state values representing preferences for health states of the original descriptive system should not be applied to health state descriptions from the modified descriptive system.
In recent years there has been a call for more patient involvement in instrument development, as most health state instruments were developed with little input from individuals representative of the intended respondents [10, 38, 39]. The current study contributes to this call by exploring variation in item interpretation from the perspective of individuals living with SCI. An example of the value of such an approach was the participants’ suggestion of a broader conceptualization of mobility, one that is not solely restricted to an individual’s ability to walk. Ideally, exploring item interpretations would have been part of the development process of the respective descriptive systems. The findings of this study have implications beyond the measurement of preference-based health status because mobility-related items are ubiquitous in generic HRQoL instruments. More specifically, the findings are valuable to researchers during the process of selecting a suitable instrument, when reevaluating existing instruments, or when developing new instruments. The findings could also help explain how variations between the descriptive systems of different preference-based instruments may contribute to poor agreement between their derived health state values [19, 40].
Further qualitative research in this area should explore whether similar inferences (accessibility, reframing, etc.) can be drawn for items and contexts beyond mobility and SCI. As a case in point, a number of studies have shown that individuals with mental health conditions have difficulties describing their health [41–45]. Secondly, important conceptual and normative questions should be revisited in order to judge the relative merits of different health state instruments. For example, with the EQ-5D-5L becoming established as a widely-used health state instrument, should it include explicit instruction as to whether respondents should be considering medical technologies, nonhuman aids and/or human assistance when completing the instrument; and what are the implications of maintaining the status quo?
Strengths and limitations
Having a group of individuals with significant physical impairments share their perceptions of mobility-related items provided an excellent opportunity to address an under-researched area in health economics. This study is a starting point–and a rallying call–for further exploration of item interpretations in other populations. A limitation of the study is that it comprises secondary analysis of focus group data (limitations with respect to the original study are reported elsewhere ). Mobility was not the sole focus of the original focus group discussions and, therefore, the structured discussion template was not designed in a way to probe for further clarification or elaboration on mobility-related issues. For example, the questions in the template did not directly encourage participants to discuss ‘item interpretation’ (broadly, questions two and four focused on the applicability and acceptability of the instruments, while questions one and three provided participants with the opportunity to raise any issue related to the instruments). Consequently, it is possible that saturation was not reached with regard to mobility-related issues and, in particular, issues regarding item interpretation. Despite these limitations, the clinical context of the focus group ensured that aspects of mobility were an extensive part of the discussion.
This study identified four themes that provide insight into the issues individuals living with significant mobility impairment may face when responding to mobility-related items in health state instruments. The observed problems–such as the lack of suitable response options and the reframing of items–pose considerable threats to the validity of health state descriptions, health state values and, ultimately, cost-effectiveness estimates in the evaluation of treatments and interventions. The extent to which other respondent groups experience similar difficulties in interpreting items, whether mobility-related or otherwise, remains unknown.
Assessment of Quality of Life
Assessment of Quality of Life 8-dimension questionnaire
health-related quality of life
Health Utilities Index
Health Utilities Index Mark 3
quality-adjusted life year
Quality of Well-Being Scale Self-Administered
spinal cord injury
36-item Short Form health survey version 2
Neumann PJ, Goldie SJ, Weinstein MC. Preference-based measures in economic evaluation in health care. Annu Rev Public Health. 2000;21:587–611.
Patrick D, Deyo R. Generic and disease-specific measures in assessing health status and quality of life. Med Care. 1989;1:217–32.
Canadian Agency for Drugs and Technologies in Health (CADTH). Guidelines for the Economic Evaluation of Health Technologies. Ottawa: CADTH; 2006.
National Institute for Health and Care Excellence. Guide to the Methods of Technology Appraisal 2013. London: National Institute for Health and Care Excellence; 2013.
Dutch National Health Care Institute. Guideline for Conducting Economic Evaluations in Health Care. Diemen: Dutch National Health Care Institute; 2015.
Drummond M, Sculpher M, Claxton K. Methods for the Economic Evaluation of Health Care Programmes. Oxford university press. 2015.
Hunt S. The problem of quality of life. Qual Life Res. 1997;6:205–12.
Richardson J, McKie J, Bariola E. Multiattribute Utility Instruments and Their Use. In: Culyer A, editor. Encyclopedia of Health Economics. San Diego: Elsevier; 2014. p. 341–57.
AER Association. American Psychological Association, National Council on Measurement in Education, Joint Committee on Standards for Educational and Psychological Testing (U.S.): Standards for Educational and Psychological Testing. Washington, DC: American Educational Research Association; 2014.
Mallinson S. Listening to respondents: a qualitative assessment of the Short-Form 36 Health Status Questionnaire. Soc Sci Med. 2002;54:11–21.
Dolan P. Effect of age on health state valuations. J Health Serv Res Policy. 2000;5:17–21.
Kharroubi SA. A Comparison of Japan and U.K. SF-6D health-state valuations using a non-parametric Bayesian method. Appl Health Econ Health Policy. 2015;13:409–20.
Richardson J, Khan MA, Iezzi A, Maxwell A. Comparing and explaining differences in the magnitude, content, and sensitivity of utilities predicted by the EQ-5D, SF-6D, HUI 3, 15D, QWB, and AQoL-8D multiattribute utility instruments. Med Decis Mak. 2015;35:276–91.
Moock J, Kohlmann T. Comparing preference-based quality-of-life measures: results from rehabilitation patients with musculoskeletal, cardiovascular, or psychosomatic disorders. Qual Life Res. 2008;17:485–95.
Fryback DG. Comparison of five health-realted quality of life indexes using item response theory anlysis. Med Decis Mak. 2010;30:5–15.
Whitehurst DGT, Mittmann N, Noonan VK, Dvorak MF, Bryan S. Health state descriptions, valuations and individuals’ capacity to walk : a comparative evaluation of preference-based instruments in the context of spinal cord injury. Qual Life Res. 2016;25(10):2481–96.
Keeley T, Al-Janabi H, Lorgelly P, Coast J. A qualitative assessment of the content validity of the ICECAP-A and EQ-5D-5L and their appropriateness for use in health research. PLoS One. 2013;8:e85287.
Matza LS, Boye KS, Stewart KD, Curtis BH, Reaney M, Landrian AS. A qualitative examination of the content validity of the EQ-5D-5L in patients with type 2 diabetes. Health Qual Life Outcomes. 2015;13:192.
Whitehurst D, Suryaprakash N, Engel L, Mittmann N, Noonan VK, Dvorak MF, Bryan S. Perceptions of individuals living with spinal cord injury toward preference-based quality of life instruments: a qualitative exploration. Health Qual Life Outcomes. 2014;12:1.
Froehlich-Grobe K, Andresen EM, Caburnay C, White GW. Measuring health-related quality of life for persons with mobility impairments: an enabled version of the short-form 36 (SF-36E). Qual Life Res. 2008;17:751–70.
Andresen EM, Fouts BS, Romeis JC, Brownson CA. Performance of health-related quality-of-life instruments in a spinal cord injured population. Arch Phys Med Rehabil. 1999;80:877–84.
Dijkers MPJM. Quality of life of individuals with spinal cord injury: A review of conceptualization, measurement, and research findings. J Rehabil Res Dev. 2005;42:87–110.
Tourangeau R, Rips L, Rasinski K. The Psychology of Survey Response. Cambridge University Press. 2000.
Krosnick JA. Survey research. Annu Rev Psychol. 1999;50:537–67.
Schwartz CE, Andresen EM, Nosek MA, Krahn GL. Response shift theory: important implications for measuring quality of life in people with disability. Arch Phys Med Rehabil. 2007;88:529–36.
Donovan J, Frankel S, Eyles J. Assessing the need for health status measures. J Epidemiol Community Health. 1993;47:158–62.
Sintonen H. The 15D instrument of health-related quality of life: properties and applications. Ann Med. 2001;33:328–36.
Richardson J, Iezzi A, Khan MA, Maxwell A. Validity and reliability of the Assessment of Quality of Life (AQoL)-8D multi-attribute utility instrument. Patient. 2014;7:85–96.
Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, Bonsel G, Badia X. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20:1727–36.
Furlong W, Feeny DH, Torrance GW, Barr RD. The Health Utilities Index (HUI®) system for assessing health-related quality of life in clinical studies. Ann Med. 2001;33:375–84.
Seiber W, Groessl E, David K, Ganiats T, Kaplan R. Quality of Well Being Self-Administered (QWB-SA) Scale User’s Manual. 2008. https://hoap.ucsd.edu/qwb-info/QWB-Manual.pdf. Accessed 23 Nov 2016.
Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21:271–92.
Ritchie J, Lewis J, Nicholls C, Ormston R. Qualitative Research Practice: A Guide for Social Science Students and Researchers. Sage. 2013.
Green C, Kiebert G, Murphy C, Mitchell JD, O’Brien M, Burrell A, Leigh PN. Patients’ health-related quality-of-life and health state values for motor neurone disease/amyotrophic lateral sclerosis. Qual Life Res. 2003;12:565–74.
Asada Y. Medical technologies, nonhuman aids, human assistance, and environmental factors in the assessment of health states. Qual Life Res. 2005;14:867–74.
Lee BB, Simpson JM, King MT, Haran MJ, Marial O. The SF-36 walk-wheel: a simple modification of the SF-36 physical domain improves its responsiveness for measuring health status change in spinal cord injury. Spinal Cord. 2009;47:50–5.
Whitehurst DGT, Engel L, Bryan S. Short Form health surveys and related variants in spinal cord injury research: A systematic review. J Spinal Cord Med. 2014;32:128–38.
Stevens K, Palfreyman S. The use of qualitative methods in developing the descriptive systems of preference-based measures of health-related quality of life for use in economic evaluation. Value Health. 2012;15:991–8.
Stevens KJ. How well do the generic multi-attribute utility instruments incorporate patient and public views into their descriptive systems? Patient. 2016;9:5–13.
Richardson J, Iezzi A, Khan MA. Why do multi-attribute utility instruments produce different utilities: the relative importance of the descriptive systems, scale and ‘micro-utility’ effects. Qual Life Res. 2015;24:2045–53.
Connell J, O’Cathain A, Brazier J. Measuring quality of life in mental health: are we asking the right questions? Soc Sci Med. 2014;120:12–20.
Papaioannou D, Brazier J, Parry G. How valid and responsive are generic health status measures, such as EQ-5D and SF-36, in schizophrenia? A systematic review. Value Health. 2011;14:907–20.
Brazier J, Connell J, Papaioannou D, Mukuria C, Mulhern B, Peasgood T, Jones ML, Paisley S, O’Cathain A, Barkham M, Knapp M, Byford S, Gilbody S, Parry G. A systematic review, psychometric analysis and qualitative assessment of generic preference-based measures of health in mental health populations and the estimation of mapping functions from widely used specific measures. Health Technol Assess. 2014;18:1–188.
Jenkinson C, Peto V, Coulter A. Making sense of ambiguity : evaluation of internal reliability and face validity of the SF 36 questionnaire in women presenting with menorrhagia. Qual Heal Care. 1996;5:9–12.
Kessler RC, Aguilar-gaxiola S, Alonso J, Chatterji S, Lee S, Ormel J, Üstün TB, Wang PS. World Mental Health (WMH) Surveys. Epidemiol Psichiatr Soc. 2009;18:23–33.
We would like to thank the study participants for their time and contributions to the study, and Nitya Suryaprakash for facilitating the focus groups. We acknowledge the funding provided to YAM by the Norwegian Research Council (Project#229101/H10), and Health Utilities Inc (HUInc) for the New Investigator Grant awarded to DGTW. The HUInc grant covered the costs of using HUI proprietary documents in the mixed-methods research program funded by the Rick Hansen Institute.
The original focus group study was funded through the Rick Hansen Institute Translational Research Program (Grant #2012–29: Spinal Cord Injury & Secondary Complications: A Mixed-Methods Evaluation of Preference-Based Instruments).
Availability of data and materials
Individuals interested in accessing the data (i.e., the focus group transcripts) should contact the senior author (email@example.com).
All authors were involved in the conception and design of the study. DGTW was the Project Lead for the original focus group study. DGTW (co-facilitator) and LE (observer) attended all three focus groups. YAM and LE performed data analysis. YAM drafted the original manuscript and was responsible for coordinating the review of the draft. All authors were involved in the review of the draft manuscript, and read and approved the final version prior to submission.
KRH, LAA and DGTW are members of the EuroQol Group. All authors report no further competing interests.
Consent for publication
Ethics approval and consent to participate
The University of British Columbia Behavioral Research Ethics Board (H12-01138) and Vancouver Coastal Health Authority (Research Study #V12-01138) approved the original study; informed consent to participate in the original study was obtained from all participants. The Norwegian Social Science Data Services (NSD) and the Regional Committee for Medical & Health Research Ethics, Section C, South East Norway (#IRB00001870) confirmed that no further ethical approval was required for the secondary data analysis carried out in Norway.
About this article
Cite this article
Michel, Y.A., Engel, L., Rand-Hendriksen, K. et al. “When I saw walking I just kind of took it as wheeling”: interpretations of mobility-related items in generic, preference-based health state instruments in the context of spinal cord injury. Health Qual Life Outcomes 14, 164 (2016). https://doi.org/10.1186/s12955-016-0565-9