- Open Access
Patient-reported outcome measures for systemic lupus erythematosus clinical trials: a review of content validity, face validity and psychometric performance
Health and Quality of Life Outcomesvolume 12, Article number: 116 (2014)
Despite overall progress in treatment of autoimmune diseases, patients with systemic lupus erythematosus (SLE) experience many inflammatory symptoms representing an unmet medical need. This study aimed to create a conceptual model of the humanistic and economic burden of SLE, and review the patient-reported outcomes (PROs) used to measure such concepts in SLE clinical trials.
A conceptual model for SLE was developed from structured review of published articles from 2007 to August 2013 identified from literature databases (MEDLINE, EMBASE, PsycINFO, EconLit) plus other sources (PROLabels, FDA/EMA websites, Clinicaltrials.gov). PROs targeting key symptoms/impacts were identified from the literature. They were reviewed in the context of available guidance and assessed for face and content validity and psychometric properties to determine appropriateness for use in SLE trials.
The conceptual model identified fatigue, pain, cognition, daily activities, emotional well-being, physical/social functioning and work productivity as key SLE concepts. Of the 68 articles reviewed, 38 reported PRO data. From these and the other sources, 15 PROs were selected for review, including SLE-specific health-related quality of life (HRQoL) measures (n = 5), work productivity (n = 1), and generic measures of fatigue (n = 3), pain (n = 2), depression (n = 2) and HRQoL (n = 2). The Functional Assessment of Chronic Illness Therapy - Fatigue Scale (FACIT-Fatigue), Brief Pain Inventory (BPI-SF) and LupusQoL demonstrated the strongest face validity, conceptual coverage and psychometric properties measuring key concepts in the conceptual model. All PROs reviewed, except for three Lupus-specific measures, lacked qualitative SLE patient involvement during development. The Hospital Anxiety and Depression Scale (HADS), Short Form [36 item] Health Survey version 2 (SF-36v2), EuroQoL 5-dimensions (EQ-5D-3L and EQ-5D-5L) and Work Productivity and Activity Impairment Questionnaire: Lupus (WPAI:Lupus) showed suitability for SLE economic models.
Based on the identification of key symptoms and impacts of SLE using a scientifically sound conceptual model, we conclude that SLE is a condition associated with high unmet need and considerable burden to patients. This review highlights the availability and need for disease-specific and generic patient-reported measures of relevant domains of disease signs and symptoms, HRQoL and work productivity, providing useful insight for SLE clinical trial design.
Systemic lupus erythematosus (SLE) is a heterogeneous, inflammatory, multisystem autoimmune disease. Estimates of overall prevalence rates (per 100,000) vary worldwide, ranging from 4–45 in Asia-Pacific countries , to 52–150 in the USA ,. The prevalence of SLE is greater in non-white racial groups  and the disease affects women more frequently than men . SLE is associated with a substantial economic burden, with direct costs per patient-year ranging from $3,735 to $14,410 .
There is a large variation in SLE associated symptoms and the condition is often complicated by flares (exacerbations) of varying severity and subsequent remissions . A recent international consensus working group defined a flare as “a measurable increase in disease activity in one or more organ systems involving new or worse clinical signs and symptoms and/or laboratory measurements” .
Patients with active SLE experience musculoskeletal and mucocutaneous manifestations, including joint pain and swelling, skin rash and fatigue . Frequently affected joints include the fingers, hands, wrists and knees, with some patients developing secondary osteoarthritis . In addition to joint inflammation, internal organ involvement can be of greater concern when considering patients’ prognosis, with SLE often affecting the heart, lungs, blood vessels, liver, kidneys and nervous system ,. Overall these symptoms and manifestations can contribute to a substantially reduced health-related quality of life (HRQoL) .
It is not possible to assess many of the symptoms and treatment effects associated with SLE using objective clinical measures alone. Regulatory bodies and healthcare decision makers recognise the importance of also capturing the patient perspective in clinical trials by using validated and reliable patient-reported outcome (PRO) measures –. The U.S. Food and Drug Administration (FDA) and the European Medicines Agency (EMA) have released guidance which highlights the importance of measuring fatigue in clinical trials in SLE , (although the FDA does not necessarily consider existing measures of fatigue to be adequate), and the EMA also strongly recommends the consideration of the impact of SLE on patients’ HRQoL . In 1999 an Outcome Measures in Rheumatology group (OMERACT) performed a review of outcome measures that have been used in SLE trials and made recommendations regarding the most important domains to assess, and the most appropriate instruments to do so ,. However, as it has been a number of years since that review, there is value in a more up to date review of the literature which identifies relevant concepts for measurement and the adequacy of existing measures to assess those concepts. In particular, no disease-specific measures of health status or disability were identified at that time. An understanding of the symptoms and their impact on patients’ daily lives, the economic burden and the PRO measures available, will help researchers and clinicians evaluate the efficacy and impact of interventions.
The objectives of this research were twofold. The objective of the first stage of this research was to review and describe the symptoms and impact concepts of SLE from the patient’s perspective by means of a conceptual model. This included an overview of the economic burden of SLE. Based on development of the conceptual model, the objective was then to review existing PRO measures for suitability in clinical trials of SLE, in terms of their content validity, face validity and psychometric properties.
A structured literature review was conducted to establish the humanistic and economic burden with respect to the key symptoms and their impact, and the PROs available to measure these. Methods were in line with recognised international guidelines for the conduct and reporting of literature reviews ,. The findings from the literature review informed the development of a conceptual model that was used to assess whether the selected PRO measures target the key symptoms and impacts of SLE in accordance with the EMA and FDA PRO guidance ,.
Data sources and searches
Literature searches were conducted in MEDLINE, EMBASE, PsycINFO and EconLit, limited to humans, English language and articles published between 2007 and 2013. The search was conducted on 1st August 2013.
Inclusion and exclusion criteria
Journal articles (excluding conference abstracts, dissertations and book chapters) containing the keywords in the title and/or abstract were included. Articles with an SLE-related clinical search term and at least one of the humanistic or economic search terms were selected.
Search terms included SLE clinical terms (systemic lupus erythematosus, SLE, lupus nephritis, LN) plus outcomes research terms (health-related quality of life, quality of life, patient burden, patient impact, burden of illness, symptom, activities of daily living, patient reported outcome, patient related outcome, PRO, questionnaire, fatigue, physical function, emotion, mood) or economic terms (cost OR cost utility, cost of illness, healthcare cost, economic burden, economic impact, resource use, hospitalisation, productivity, expenditure, direct costs, indirect costs, economic, cost minimisation, burden of illness, cost effectiveness).
Screening process and data extraction
Two researchers screened and checked all the abstracts for eligibility and suitability in line with the Centre for Reviews and Dissemination guidance . Articles selected for review were based on consensus opinion. Any disagreement in the selection of articles was resolved by the lead researcher who performed a final, independent review of titles and abstracts. The selected articles were categorised into qualitative studies reporting burden from the patient perspective and articles reporting humanistic and economic burden data. Literature documenting quantitative methods was also reviewed to further understand the symptoms of SLE, the impact on patients’ HRQoL and to support the conceptual model. Study characteristics from the selected articles were extracted.
Development of the conceptual model of systemic lupus erythematosus
A conceptual model of the humanistic and economic burden of SLE was developed on the basis of the review of qualitative studies . A conceptual model can help identify themes, describe the patient burden concepts and their interrelationships and provide the rationale for PRO measures of interest ,. For the purposes of this study, a conceptual model for SLE provided the theoretical basis for the review and evaluation of the content validity of the selected PRO measures. The model was then compared with an existing SLE conceptual model developed by Gallop et al. in 2012.
Review of the patient-reported outcome measures for systemic lupus erythematosus
A subset of the PRO measures identified in the literature search were selected for in-depth review. Selection of instruments for in-depth review was based on likelihood of meeting the FDA guidance and relevance of conceptual coverage, based on review of the abstract and initial review of the PRO. Searches of PROQOLID, PROLabels, FDA/EMA websites, Clinicaltrials.gov and reimbursement agencies’ websites (e.g. National Institute of Health and Care Excellence (NICE, UK) and the Institute for Quality and Efficiency in Healthcare (IQWIG, Germany)) were conducted when either no relevant PRO that measured a key concept could be identified from the literature, or when expert opinion suggested the use of alternative PROs. Other PRO measures were only included in the review if the PRO was developed or validated in patients with SLE, had been previously used in a SLE population and/or if there was evidence of normative data available for comparison. Articles in the literature search that reported PRO data were categorised according to the type of PRO measure included in each study. The categories were largely based on the key concepts identified in the conceptual model.
Each PRO was reviewed for appropriateness for clinical trials in patients with SLE in terms of content validity, face validity and psychometric properties, in line with regulatory guidance for the evaluation of PRO measures ,. Content validity was assessed by the coverage level of the concepts within the conceptual model ,. The face validity of each PRO measure was determined by the acceptability and appropriateness of item wording, recall period and response options to patients with SLE. The level of qualitative research involved in developing each PRO was also assessed, acknowledging the value of input from the target patient population. The psychometric properties (validity, reliability and ability to detect change) of each PRO for an SLE population were also assessed in line with FDA regulatory guidance for the development and validation of PROs ,.
Findings from the literature search
The literature search identified a total of 1,754 publications. Of these, 687 articles met the inclusion criteria and the full articles were retrieved. A review of these identified 30 articles containing data on the economic burden of SLE. These were used to describe the economic burden in the conceptual model. The remaining 38 articles were related to patient-reported symptoms, impacts and burden in patients with SLE.
Conceptual model of systemic lupus erythematosus
Of the 38 articles that included patient-reported data, six were qualitative articles ,– and 32 were quantitative articles. The resulting conceptual model shows the symptoms and impacts identified as key concepts related to SLE (Figure 1).
Fatigue and pain were identified as two of the most important and frequent symptoms for patients with SLE –,– (Figure 1). Specifically, patients describe mental and physical symptoms of fatigue including impacts on social life , emotional wellbeing ,, physical functioning ,, sleep ,– and the ability to complete daily tasks and leisure activities ,. Important cognitive symptoms include being “unable to think clearly”  and memory loss . Other SLE symptoms include skin rash ,, weight gain , and hair loss ,.
Symptoms impact all areas of HRQoL, with detrimental consequences observed in the physical, emotional and social functioning of SLE patients, as well as in their working life (Figure 1). In terms of the impact on emotional wellbeing, patients with SLE frequently feel sad, depressed, angry and demoralised ,,,,,. In particular, patients feel embarrassed ,, or self-conscious, or they lack self-esteem, primarily because of the change in their appearance (such as hair loss and skin manifestations) ,. Patients fear their disease worsening, and experience anxiety or stress related to the symptoms and the unpredictability of SLE ,,,. Many also experience feelings of frustration and a lack of 1) confidence, 2) independence, 3) control over one’s life and 4) belonging .
SLE has a significant negative impact on patients’ physical functioning, such as walking difficulty and other mobility problems ,,, (Figure 1). This affects various daily activities including opening jars and moving heavy objects , shopping , doing laundry , getting dressed  and caring for their children ,. Wider impacts on social functioning and working life are also reported ,. Specifically, patients have difficulty maintaining family and sexual relationships ,,. SLE also impacts negatively on patients’ career progression , absence from work , difficulty concentrating at work or study ,, and their choice of work ,.
The conceptual model presented in this paper suggests that patients use various coping mechanisms for the unpredictability of flares, including 1) seeking and using information, 2) seeking emotional and practical help via the internet, 3) receiving support from hospital meetings, 4) receiving support from family, 5) attending lupus support groups and 6) religious practice ,, (Figure 1). The conceptual model also includes concepts such as treatment satisfaction, adherence and the impact of flares in a ‘future considerations’ box. There was a lack of evidence pertaining to these concepts in the currently available literature.
The conceptual model also demonstrates the economic burden of disease, in particular the high medical costs associated with SLE compared to other chronic diseases . Substantial levels of inpatient care, medication/prescriptions and visits to healthcare professionals (HCP), which are all increased by ‘flares’, are the main drivers of direct costs in the treatment of SLE . The conceptual model also shows that SLE is associated with high indirect costs due to lost productivity  resulting from unemployment and absenteeism, , with ‘in-flare’ patients with SLE having increased frequency and duration of time off work ,.
A comparison between this conceptual model and the model developed by Gallop et al.  suggests similarities, although our model provides a broader perspective on the impact of SLE. There is alignment between the models on symptoms such as pain, fatigue, skin rash and hair loss. Impact on work/employment, impact on daily life/daily activities, lack of independence and emotional wellbeing are also presented in both models. In terms of differences, Gallop’s model  viewed impacts on social, family and leisure activities as one concept; however, the present literature review and model identified these as separate concepts. The emotional impact is conceptualised as depression or frustration in Gallop’s model , whilst a broader range of emotions associated with SLE (including worry, anger, embarrassment and shame in addition to depression and frustration) were identified in the literature. Unlike the model presented in this paper, impacts on physical functioning, relationships, sleep, worry about the ability to conceive/have children, the impact of others’ perceptions and the personal and broader economic burden are not shown in Gallop’s model. Whilst fatigue is noted as a symptom in both models, the model presented in this paper also conceptualises fatigue as an impact of SLE. Gallop et al.  include appearance and cognition concepts as impacts of SLE but these are captured as symptoms in the present model. Gallop et al.  also recognise the different triggers that may lead to the onset or worsening of symptoms in their conceptual model; however these issues were not identified in the present literature review.
Review of patient-reported outcomes measures
A total of 23 PRO measures were identified from the articles reviewed. Of those, 15 measures targeted key concepts in the conceptual model and were therefore selected for in-depth review (Table 1). SLE-specific and generic PROs were categorised according to the concepts measured.
Content validity – conceptual coverage
An overview of the conceptual coverage of each PRO measure was performed to evaluate content validity (Table 2). Of all 15 PROs reviewed, only the disease-specific LupusQoL, LupusPRO, L-QoL and SLEQOL have documented evidence for involvement of patients with SLE in concept elicitation and development of items ,,,.
In terms of the SLE-specific and generic HRQoL instruments, the SF-36v2, LupusQoL and SLEQOL demonstrated a greater level of conceptual coverage, in terms of the variety and number of relevant SLE concepts measured, compared to the other four HRQoL instruments (Table 2).
All three fatigue PROs demonstrated similar levels of conceptual coverage for SLE, with each measuring fatigue and its impact on daily activities and social functioning (Table 2). The MAF was the only fatigue-related PRO to measure the impact of fatigue on relationships (i.e. sexual activity or socialising with friends) and ability to work. Of the two pain-related PROs, the BPI-SF had superior conceptual coverage compared to the MPQ, measuring both pain symptoms and the impact of pain on a range of aspects of daily life.
As expected, both depression-related PROs were focussed on the emotional/psychological well-being impact, but the BDI also measures fatigue (‘tiredness’), patients’ attitudes towards their appearance and impact on sleep and ability to work – concepts which are also relevant to SLE patients (Table 2). The WPAI:Lupus measures relevant SLE concepts such as ability to work, disability associated with lupus and the impact of lupus on activities of daily living such as housework and childcare.
Of all the PRO measures reviewed, only the LupusQoL, LupusPRO and L-QoL had documented evidence of qualitative involvement of patients with SLE to evaluate the face and content validity through cognitive debriefing techniques (Table 3). The LupusPRO was pilot tested with SLE patients, though the face validity was not qualitatively assessed. Patient insights were used in the development of the SLEQOL, although only by means of ranking items in order of importance; the face validity was not qualitatively assessed. A face validity review suggested that the instructions and item wording, recall period and response options for six PRO measures (L-QoL, SF-36v2, EQ-5D-3L, EQ-5D-5L, FACIT-Fatigue, HADS) appeared acceptable and appropriate for a SLE population and are in line with guidance for the use of PROs in clinical trials  (Table 3). The standard version of the SF-36v2 has a four week recall period, which is unlikely to be acceptable to regulators. However, the acute version, with a seven day recall period, is likely to be more acceptable. The item and instruction wording of each PRO measure was clear, free of clinical terminology and generally written in simple language. The response options of these six PROs are generally clear and appropriate for patients with SLE. Furthermore, the recall periods were appropriate for intended use of the measures with patients with SLE.
In contrast, the other nine PROs included features which may hinder understanding and completion of the items by patients (Table 3). Four PROs used vague and insufficiently defined (e.g. ‘leisure and recreational activities’ and ‘fatigue’ in the MAF) or complex terminology (e.g. ‘lacerating’ and “spatial” in the MPQ) in the items and instructions. The individual instructions provided for the WPAI:Lupus items increase the word count/length, which may be overwhelming for some patients.
The format of the response options for some PROs was inconsistent, which may cause confusion to patients (SLEQOL, MFI, MAF); some used complex terms such as ‘excruciating’ (MPQ) or were lengthy and ambiguous (BDI) (Table 3).
The LupusQoL, EQ-5D and the FACIT-Fatigue demonstrated the strongest psychometric properties in an SLE population ,,– (Table 4). Psychometric validation of the SLAQ, LupusPRO and SF-36v2 has also been conducted in SLE ,,,,. None of the other nine PROs had documented evidence of their measurement properties in patients with SLE. It is important to acknowledge that many recent randomised controlled trials (RCTs) in SLE have not incorporated the use of a patient global assessment of disease activity, thus making it difficult to determine minimal important differences (MIDs) for PRO measures. This may contribute to the lack of evidence pertaining to MIDs in SLE.
Systemic lupus erythematosus specific health-related quality of life measures
All five SLE-specific HRQOL measures reviewed in depth had sufficient evidence of internal consistency (i.e. α > 0.7) ,,,, (Table 4). The LupusQoL, L-QoL and SLEQOL had evidence of strong test–retest reliability (i.e. ICC > 0.7) ,, while the test–retest was shown for LupusPRO for only 7 out of its 11 domains . The SLAQ had no evidence of test–retest reliability. Only the LupusQoL and L-QoL had sufficient evidence of validity for a SLE population . While the SLAQ demonstrated construct validity , it had no evidence that it is capable of differentiating known groups, and the LupusPRO demonstrated high floor effects . The LupusQoL and LupusPRO had no evidence of ability to detect change, while the SLAQ demonstrate a limited sensitivity to a change in health status but no evidence of responsiveness to changes to treatment .
Generic health-related quality of life measures
The SF-36v2 has been validated in many different health conditions and is a widely used and accepted measure of HRQoL ,. More importantly, in an SLE population, the SF-36v2 has demonstrated evidence of internal consistency reliability, concurrent validity and known groups validity . The EQ-5D showed evidence of validity and an ability to detect change in patients with SLE  despite being commonly associated with ceiling and floor effects . Of note, the SF36v2 is able to detect change in many conditions, including rheumatoid arthritis , and more recently, distribution and anchor-based estimates suggest MIDs of approximately 3–6 points in an SLE population .
Of the fatigue measures, the FACIT-Fatigue demonstrated the strongest evidence of internal consistency reliability, known groups validity, concurrent validity, ability to detect change in a SLE population  (Table 4) and test-retest reliability in psoriatic arthritis . Furthermore, the FACIT-Fatigue has shown strong evidence of internal consistency reliability and known groups validity, with an MID of 3–4 points in rheumatoid arthritis . The MFI and MAF had sufficient evidence of internal consistency ,, though Cronbach’s α for one of the MFI domains was below 0.7 , and the MAF had evidence of test–retest reliability (in cancer) . While not validated in a SLE population, the MFI and MAF had sufficient evidence of validity and an ability to detect for Sjögren’s syndrome and rheumatoid arthritis (other autoimmune inflammatory conditions) ,,,, but evidence of the ability of the MAF to detect change was limited to cancer patients .
In terms of the pain items, neither the BPI-SF nor MPQ have been validated in SLE (Table 4). In other conditions, the BPI-SF demonstrated the strongest evidence of both internal consistency (α > 0.7) and test-retest reliability (ICC > 0.7) ,. The MPQ had sufficient evidence of test-retest reliability also , but only provided partial evidence of internal consistency . The BPI-SF had acceptable evidence of validity ,–. In contrast, the MPQ had evidence of concurrent validity only . The MPQ and BPI-SF demonstrated an ability to detect changes, with both providing evidence of responsiveness to treatment in musculoskeletal pain (MPQ) , cancer and rheumatoid arthritis patients (BPI-SF) ,.
Neither the BDI nor HADS have been validated in SLE. However, both measures have evidence of reliability in other conditions ,, (Table 4). Both measures have sufficient evidence of validity in the general population and psychiatric patients ,–, though the construct validity of the BDI varies, with the number of factors ranging from three to seven depending on the disease . Of the two depression measures, only the HADS provides evidence of ability to detect change in response to intervention in different diseases, including depression, neurotic disorder, cancer and heart disease .
Work productivity measure
There is no documented evidence of the psychometric properties of the WPAI:Lupus in SLE, though item content in the general health version (WPAI:GH) is highly consistent with the ‘specific health problem’ version of the measure (WPAI:SHP) . The content and item wording of the WPAI:GH and the WPAI:SHP is the same, with the exception of the term ‘general health’ in the WPAI:GH, which is replaced with the relevant disease. For the WPAI:Lupus, ‘general health’ is replaced with ‘lupus’. Therefore, the validity of the WPAI:Lupus can be partially demonstrated by acceptable concurrent and known groups validity of the general health version of the measure (WPAI:GH) in the general population  and in rheumatoid arthritis . The WPAI:GH also had evidence of test–retest reliability in rheumatoid arthritis  but none of internal consistency. Moreover, the ankylosing spondylitis-specific WPAI:SpA has shown known groups validity and responsiveness to treatment of ankylosing spondylitis .
To understand the value of therapies for SLE from the patient-perspective, PRO measures should be included in clinical trials in conjunction with well-established clinical assessments. The selection of suitable measures to assess SLE-related symptoms and impacts in clinical trials requires careful consideration ,. This study therefore sought to develop a conceptual model of the key symptoms and impacts associated with SLE to help support identification of suitable endpoints for clinical trials in SLE ,. The model also aimed to integrate the economic burden of SLE to patients, health care providers and the wider society.
The key patient-reported concepts identified within the model were fatigue, pain, cognition, daily activities, emotional well-being, physical/social functioning and work productivity. The subjective nature of many SLE symptoms and impacts requires accurate and reliable measurement of these symptoms based on patient self-report. In light of this, our study also sought to review and evaluate the face and content validity and psychometric properties of PROs that may be appropriate for use in a SLE population. To our knowledge, this is the first comprehensive review of PROs for the whole range of key symptoms and impacts experienced specifically by patients with SLE. The American College of Rheumatology conducted a review to recommend measures for inclusion in SLE trials , but this was limited to the evaluation of fatigue. In a review of outcome measures in SLE clinical trials, Strand et al.  included a brief summary of the measurement properties of a small number of selected HRQoL measures used previously in SLE trials, but this review did not include evaluation of face and content validity.
The current review showed that the LupusQoL, SLEQOL, SF-36v2, FACIT-Fatigue and BPI-SF demonstrated face and content validity and were psychometrically strong as measures of the key concepts identified in the conceptual model. The FACIT-Fatigue and BPI-SF appeared to be the strongest instruments. In addition, the generic SF-36v2 and EQ-5D measures are widely used in trials with patients with SLE and are recognised and accepted by clinical, patient, regulatory, reimbursement and academic communities.
A recent qualitative study involving SLE patients concluded that the FACIT-Fatigue is a relevant measure of fatigue in SLE . Furthermore, the psychometric properties of the FACIT-Fatigue in an SLE population are well documented . In contrast, the American College of Rheumatology study from 2007 suggest the Fatigue Severity Scale (FSS) as a measure of fatigue in SLE . However, our review questions the lack of SLE patient involvement in the initial development of the FSS; and the lack of supporting evidence of its face and content validity. Furthermore, the psychometric properties of the FSS have been assessed but in a limited number of patients with SLE ,. Indeed, of all the PRO measures reviewed, only three Lupus-specific measures (LupusQoL, LupusPRO and L-QoL) have documented evidence of qualitative input from patients with SLE.
Important in the measurement of SLE is to acknowledge that patients may experience many symptom-free days, followed by a severe flare. Flares are likely to impact patients’ health-related quality of life ,, as well as having a wider society and economic impact . For example, patients with flares incur higher direct and indirect costs compared with those without flares . Therefore, PRO measurement of the impact of flares may be considered in future clinical trials in patients with SLE in addition to clinical outcome assessments ,. Despite this, no PRO measures were identified which target the impact of flares on humanistic burden. In addition, SLE often involves day-to-day symptom fluctuations due to these flares, thus the recall period of the measurement instrument is also an important consideration. PROs with shorter recall periods may underestimate symptom burden and may place undue demand on patients; however, longer recall period may not allow for reliable symptom and impact reporting.
Whilst the validity of this literature review is strengthened by the inclusion of qualitative and quantitative studies, with the review of PRO measures conducted in accordance with regulatory guidelines ,,, there are inherent limitations. Firstly, an assessment of the quality of the studies identified from the literature search was not conducted, so as not to limit our search. The review was however intended to be as inclusive and wide-ranging as possible to capture all of the key concepts for the development of the conceptual model and to ensure that atypical symptoms were not missed. Secondly, after key SLE symptoms and impacts in the conceptual model were identified, PROs were selected for in-depth review on the basis of measurement of those fundamental symptoms and impacts. PRO measures of other symptoms of SLE not reported in the conceptual model were thus de-prioritised and therefore not included in the in-depth review. Nevertheless, PRO measures for some key concepts identified in the model (for example, skin manifestations of the disease, impact of flares and treatment satisfaction) were either not identified from the literature search, or no PRO has been used to measure these concepts in SLE. This represents a gap in knowledge which may benefit from further research.
PROs are acknowledged as complementary to more objective measures and are being incorporated more frequently into clinical trials and clinical practice . The recognition and measurement of disease experience from the patient’s perspective is an important factor for SLE clinical trial design and health care decision makers. The results of the present study, demonstrating the suitability of PROs for use in clinical trials of SLE within the guidance provided by the FDA and EMA ,,,, can hopefully be of benefit to clinical research within SLE.
SLE is a condition associated with high unmet need and considerable burden to patients, as demonstrated by the conceptual model presented in this paper. This review highlights the existing patient-reported measures of HRQoL, SLE signs and symptoms and work productivity that demonstrate appropriate content and face validity and are psychometrically adequate for a population of patients with SLE, and as a result such measures may be suitable for use in SLE clinical trials.
Beck depression inventory
Brief Pain Inventory – Short Form
European Medicines Agency
Food and Drug Administration
Health-related quality of life
Germany, Institute for Quality and Efficiency in Healthcare
McGill Pain Questionnaire
Multidimensional Assessment of Fatigue
UK, National Institute of Health and Clinical Excellence
Systemic lupus erythematosus
The Functional Assessment of Chronic Illness Therapy - Fatigue Scale
The Hospital Anxiety and Depression Scale
Lupus: Work Productivity and Activity Impairment Questionnaire: Lupus
Jakes RW, Bae SC, Louthrenoo W, Mok CC, Navarra SV, Kwon N: Systematic review of the epidemiology of systemic lupus erythematosus in the Asia-Pacific region: prevalence, incidence, clinical features, and mortality. Arthritis Care Res 2012, 64: 159–168.
Danchenko N, Satia JA, Anthony MS: Epidemiology of systemic lupus erythematosus: a comparison of worldwide disease burden. Lupus 2006, 15: 308–318.
Chakravarty EF, Bush TM, Manzi S, Clarke AE, Ward MM: Prevalence of adult systemic lupus erythematosus in California and Pennsylvania in 2000: estimates obtained using hospitalization data. Arthritis Rheum 2007, 56: 2092–2094.
Borchers AT, Naguwa SM, Shoenfeld Y, Gershwin ME: The geoepidemiology of systemic lupus erythematosus [abstract]. Autoimmun Rev 2010, 9: A277-A287.
Zhu TY, Tam LS, Li EK: Cost-of-illness studies in systemic lupus erythematosus: a systematic review. Arthritis Care Res (Hoboken) 2011, 63: 751–760.
Manson JJ, Rahman A: Systemic lupus erythematosus. Orphanet J Rare Dis 2006, 1: 6.
Ruperto N, Hanrahan LM, Alarcon GS, Belmont HM, Brey RL, Brunetta P, Buyon JP, Costner MI, Cronin ME, Dooley MA, Filocamo G, Fiorentino D, Fortin PR, Franks AG Jr, Gilkeson G, Ginzler E, Gordon C, Grossman J, Hahn B, Isenberg DA, Kalunian KC, Petri M, Sammaritano L, Sánchez-Guerrero J, Sontheimer RD, Strand V, Urowitz M, von Feldt JM, Werth VP, Merrill JT: International consensus for a definition of disease flare in lupus. Lupus 2011, 20: 453–462.
Lahita RG: Systemic Lupus Erythematosus. Elsevier, London; 2004.
Lupus: Statistics on Lupus. Foundation of America. , [http://www.lupus.org/about/statistics-on-lupus]
Jolly M, Pickard AS, Wilke C, Mikolaitis RA, Teh LS, McElhone K, Fogg L, Block J: Lupus-specific health outcome measure for US patients: the LupusQoL-US version. Ann Rheum Dis 2010, 69: 29–33.
Food & Drug Administration: Guidance For Industry: Patient-Reported Outcome Measures: Use In Medical Product Development To Support Labelling Claims. 2009. http://www.fda.gov/downloads/Drugs/Guidances/UCM193282.pdf.
European Medicines Agency: Reflection Paper on the Regulatory Guidance for the use of Health-Related Quality of Life (HRQL) Measures in the Evaluation of Medicinal Products. 2005. http://www.ispor.org/workpaper/emea-hrqlguidance.pdf.
Department of Health: Equity and Excellence: Liberating the NHS. 2010. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/213823/dh_117794.pdf.
Food & Drug Administration: Guidance for Industry: Systemic Lupus Erythematosus - Developing Medical Products for Treatment. 2010. http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/ucm072063.pdf.
European Medicines Agency: Guideline on Clinical Investigation of Medicinal Products for the Treatment of Systemic Lupus Erythematosus, Cutaneous Lupus and Lupus Nephritis (Draft). 2013. http://www.ema.europa.eu/docs/en_GB/document_library/Scientific_guideline/2013/03/WC500139615.pdf.
Strand V, Gladman D, Isenberg D, Petri M, Smolen J, Tugwell P: Outcome measures to be used in clinical trials in systemic lupus erythematosus. J Rheumatol 1999, 26: 490–497.
Smolen JS, Strand V, Cardiel M, Edworthy S, Furst D, Gladman D, Gordon C, Isenberg DA, Klippel JH, Petri M, Simon L, Tugwell P, Wolfe F: Randomized clinical trials and longitudinal observational studies in systemic lupus erythematosus: consensus on a preliminary core set of outcome domains. J Rheumatol 1999, 26: 504–507.
Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement [abstract]. BMJ 2009, 339: b2535.
Systematic Reviews: CRD’s guidance for undertaking systematic reviews in health care.., [http://www.york.ac.uk/inst/crd/pdf/Systematic_Reviews.pdf]
Earp JA, Ennett ST: Conceptual models for health education research and practice. Health Educ Res 1991, 6: 163–171.
Rothman ML, Beltran P, Cappelleri JC, Lipscomb J, Teschendorf B: Patient-reported outcomes: conceptual issues. Value Health 2007, 10: S66-S75.
Gallop K, Nixon A, Swinburn P, Sterling KL, Naegeli AN, Silk ME: Development of a conceptual model of health-related quality of life for systemic lupus erythematosus (SLE) from the patients’ perspective. Lupus 2012, 21: 934–943.
Mokkink L, Terwee C, Patrick D, Alonso J, Stratford P, Knol D, Bouter L, Vet H: The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res 2010, 19: 539–549.
Beckerman NL: Living with lupus: a qualitative report. Soc Work Health Care 2011, 50: 330–343.
McElhone K, Abbott J, Gray J, Williams A, Teh LS: Patient perspective of systemic lupus erythematosus in relation to health-related quality of life concepts: a qualitative study. Lupus 2010, 19: 1640–1647.
Robinson J, Aguilar D, Schoenwetter M, Dubois R, Russak S, Ramsey-Goldman R, Navarra S, Hsu B, Revicki D, Cella D, Rapaport MH, Renahan K, Ress R, Wallace D, Weisman M: Impact of systemic lupus erythematosus on health, family, and work: the patient perspective. Arthritis Care Res 2010, 62: 266–273.
Mattsson M, Moller B, Stamm T, Gard G, Bostrom C: Uncertainty and opportunities in patients with established systemic Lupus Erythematosus: a qualitative study. Musculoskeletal Care 2012, 10: 1–12.
Kosinski M, Gajria K, Fernandes AW, Cella D: Qualitative validation of the FACIT-fatigue scale in systemic lupus erythematosus. Lupus 2013, 22: 422–430.
Schneider M, Schmeding A, Carnarius H, Ager M, McWade V: Systemic lupus erythematosus (SLE): understanding the burden. Value Health 2010, 13: A470.
Yee CS, McElhone K, Teh LS, Gordon C: Assessment of disease activity and quality of life in systemic lupus erythematosus - New aspects. Best Pract Res Clin Rheumatol 2009, 23: 457–467.
Aberer E: Epidemiologic, socioeconomic and psychosocial aspects in lupus erythematosus. Lupus 2010, 19: 1118–1124.
Strand V, Galateanu C, Pushparajah DS, Nikai E, Sayers J, Wood R, van Vollenhoven RF: Limitations of current treatments for systemic lupus erythematosus: a patient and physician survey. Lupus 2013, 22: 819–826.
Pettersson S, Lovgren M, Eriksson LE, Moberg C, Svenungsson E, Gunnarsson I, Henriksson EW: An exploration of patient-reported symptoms in systemic lupus erythematosus and the relationship to health-related quality of life. Scand J Rheumatol 2012, 41: 383–390.
Ad Hoc Committee on Systemic Lupus Erythematosus Response Criteria for Fatigue: Measurement of fatigue in systemic lupus erythematosus: a systematic review Arthritis Care Res 2007, 57: 1348–1357.
Cleanthous S, Tyagi M, Isenberg DA, Newman SP: What do we know about self-reported fatigue in systemic lupus erythematosus? Lupus 2012, 21: 465–476.
Ramsey-Goldman R, Rothrock N: Fatigue in systemic lupus erythematosus and rheumatoid arthritis. PM&R 2010, 2: 384–392.
Danoff-Burg S, Friedberg F: Unmet needs of patients with systemic lupus erythematosus. Behav Med 2009, 35: 5–13.
Yazdany J, Yelin E: Health-related quality of life and employment among persons with systemic Lupus Erythematosus. Rheum Dis Clin North Am 2010, 36: 15–32.
Robinson M, Sheets CS, Currie LM: Systemic lupus erythematosus: a genetic review for advanced practice nurses. J Am Acad Nurse Pract 2011, 23: 629–637.
Doward LC, McKenna SP, Whalley D, Tennant A, Griffiths B, Emery P, Veale DJ: The development of the L-QoL: a quality-of-life instrument specific to systemic lupus erythematosus. Ann Rheum Dis 2009, 68: 196–200.
Johnsson PM, Sandqvist G, Bengtsson A, Nived O: Hand function and performance of daily activities in systemic lupus erythematosus. Arthritis Rheum 2008, 59: 1432–1438.
Carls G, Li T, Panopalis P, Wang S, Mell AG, Gibson TB, Goetzel RZ: Direct and indirect costs to employers of patients with systemic lupus erythematosus with and without nephritis. J Occup Environ Med 2009, 51: 66–79.
Zhu TY, Tam LS, Li EK: The socioeconomic burden of systemic lupus erythematosus: state-of-the-art and prospects. Expert Rev Pharmacoecon Outcomes Res 2012, 12: 53–69.
Yelin E, Katz P: Introduction to special section: cost and social and psychological impact of rheumatic diseases. Arthritis Rheum 2008, 59: 457.
Zhu TY, Tam LS, Lee VWY, Lee KKC, Li EK: The impact of flare on disease costs of patients with systemic lupus erythematosus. Arthritis Rheum 2009, 61: 1159–1167.
Aghdassi E, Zhang W, St. Pierre Y, Clarke AE, Morrison S, Peeva V, Landolt-Marticorena C, Su J, Reich H, Scholey J, Herzenberg A, Pope JE, Peschken C, Lunnet Canios I, Wither JE, Fortin PR: Healthcare cost and loss of productivity in a Canadian population of patients with and without lupus nephritis. J Rheumatol 2011, 38: 658–666.
Yazdany J, Yelin EH, Panopalis P, Trupin L, Julian L, Katz PP: Validation of the systemic lupus erythematosus activity questionnaire in a large observational cohort. Arthritis Rheum 2008, 59: 136–143.
Askanase AD, Castrejon I, Pincus T: Quantitative data for care of patients with systemic lupus erythematosus in usual clinical settings: a patient multidimensional health assessment questionnaire and physician estimate of noninflammatory symptoms. J Rheumatol 2011, 38: 1309–1316.
Moldovan I, Katsaros E, Carr FN, Cooray D, Torralba K, Shinada S, Ishimori ML, Jolly M, Wallace DJ, Weisman MH, Nicassio PM: The Patient Reported Outcomes in Lupus (PATROL) study: role of depression in health-related quality of life in a Southern California lupus cohort. Lupus 2011, 20: 1285–1292.
McElhone K, Abbott J, Shelmerdine J, Bruce IN, Ahmad Y, Gordon C, Peers K, Isenberg D, Ferenkeh-Koroma A, Griffiths B, Akil M, Maddison P, Teh LS: Development and validation of a disease-specific health-related quality of life measure, the LupusQoL, for adults with systemic lupus erythematosus. Arthritis Rheum 2007, 57: 972–979.
Strand V, Chu AD: Generic versus disease-specific measures of health-related quality of life in systemic lupus erythematosus. J Rheumatol 2011, 38: 1821–1823.
Jolly M, Pickard AS, Block JA, Kumar RB, Mikolaitis RA, Wilke CT, Rodby RA, Fogg L, Sequeira W, Utset TO, Cash TF, Moldovan I, Katsaros E, Nicassio P, Ishimori ML, Kosinsky M, Merrill JT, Weisman MH, Wallace DJ: Disease-specific patient reported Outcome tools for systemic lupus erythematosus. Semin Arthritis Rheum 2012, 42: 56–65.
Jolly M, Garris CP, Jhingran PM, Mikolaitis RA, Dennis G, Wallace DJ, Clarke A, Dooley MA, Parke A, Strand V, Alárcon GS, Kosinski M: Development of the lupus impact tracker: a tool for patients and physicians to assess and monitor the impact of systemic lupus erythematosus (SLE). Arthritis Care Res (Hoboken) 2011, 14: A65-A66.
Strand V, Chu AD: Measuring outcomes in systemic lupus erythematosus clinical trials. Expert Rev Pharmacoecon Outcomes Res 2011, 11: 455–468.
Leong KP, Kong KO, Thong BYH, Koh ET, Lian TY, Teh CL, Cheng YK, Chng HH, Badsha H, Law WG, Lau TC, Chew LC, Ho HJ, Pong LY, Hoi LS, Sangeetha N, Chan SP, Howe HS: Development and preliminary validation of a systemic lupus erythematosus-specific quality-of-life instrument (SLEQOL). Rheumatology 2005, 44: 1267–1276.
Ware JE Jr, Sherbourne CD: The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care 1992, 30: 473–483.
Almehed K, Carlsten H, Forsblad-D’Elia H: Health-related quality of life in systemic lupus erythematosus and its association with disease and work disability. Scand J Rheumatol 2010, 39: 58–62.
Benitha R, Tikly M: Functional disability and health-related quality of life in South Africans with rheumatoid arthritis and systemic lupus erythematosus. Clin Rheumatol 2007, 26: 24–29.
Kulczycka L, Sysa-Jedrzejowska A, Robak E: Quality of life and satisfaction with life in SLE patients-the importance of clinical manifestations. Clin Rheumatol 2010, 29: 991–997.
Kuriya B, Gladman DD, Ibañez D, Urowitz MB: Quality of life over time in patients with systemic lupus erythematosus. Arthritis Care Res 2008, 59: 181–185.
Mok CC, Ho LY, Cheung MY, Yu KL, To CH: Effect of disease activity and damage on quality of life in patients with systemic lupus erythematosus: a 2-year prospective study. Scand J Rheumatol 2009, 38: 121–127.
Sliem H, Tawfik G, Khalil KA, Ibrahim N: Pattern of systemic lupus erythematosus in Egyptian patients: the impact of disease activity on the quality of life. Pan Afr Med J 2010, 6: 14.
Zhu TY, Tam LS, Lee VWY, Lee KK, Li EK: Relationship between flare and health-related quality of life in patients with systemic lupus erythematosus. J Rheumatol 2010, 37: 568–573.
The EuroQol Group: EuroQol-a new facility for the measurement of health-related quality of life Health Policy 1990, 16: 199–208.
Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, Bonsel G, Badia X: Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res 2011, 20: 1727–1736.
Yellen SB, Cella DF, Webster K, Blendowski C, Kaplan E: Measuring fatigue and other anemia-related symptoms with the Functional Assessment of Cancer Therapy (FACT) measurement system. J Pain Symptom Manage 1997, 13: 63–74.
Smets EM, Garssen B, Bonke B, De Haes JC: The Multidimensional Fatigue Inventory (MFI) psychometric qualities of an instrument to assess fatigue. J Psychosom Res 1995, 39: 315–325.
Belza BL, Henke CJ, Yelin EH, Epstein WV, Gilliss CL: Correlates of fatigue in older adults with rheumatoid arthritis. Nurs Res 1993, 42: 93–99.
Melzack R: The McGill Pain Questionnaire: major properties and scoring methods. Pain 1975, 1: 277–299.
Ozel F, Argon G: The effects of fatigue and pain on daily life activities in systemic lupus erythematosus. 2011Abstracts from 10th Congress of the European Federation of Internal Medicine [abstract. Eur J Intern Med 2011, 22: S70.
Cleeland CS, Ryan KM: Pain assessment: global use of the Brief Pain Inventory. Ann Acad Med Singapore 1994, 23: 129–138.
Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J: An inventory for measuring depression. Arch Gen Psychiatry 1961, 4: 561–571.
Zigmond AS, Snaith RP: The hospital anxiety and depression scale. Acta Psychiatr Scand 1983, 67: 361–370.
Reilly MC, Zbrozek AS, Dukes EM: The validity and reproducibility of a work productivity and activity impairment instrument. Pharmacoeconomics 1993, 4: 353–365.
Konig HH, Ulshofer A, Gregor M, von Tirpitz C, Reinshagen M, Adler G, Leidl R: Validation of the EuroQol questionnaire in patients with inflammatory bowel disease. Eur J Gastroenterol Hepatol 2002, 14: 1205–1215.
Aggarwal R, Wilke CT, Pickard AS, Vats V, Mikolaitis R, Fogg L, Block JA, Jolly M: Psychometric properties of the EuroQol-5D and short form-6D in patients with systemic lupus erythematosus. J Rheumatol 2009, 36: 1209–1216.
Lai JS, Beaumont JL, Ogale S, Brunetta P, Cella D: Validation of the functional assessment of chronic illness therapy-fatigue scale in patients with moderately to severely active systemic lupus erythematosus, participating in a clinical trial. J Rheumatol 2011, 38: 672–679.
Karlson EW, Daltroy LH, Rivest C, Ramsey-Goldman R, Wright EA, Partridge AJ, Liang MH, Fortin PR: Validation of a Systemic Lupus Activity Questionnaire (SLAQ) for population studies. Lupus 2003, 12: 280–286.
Beaumont JLL J, Cella D, Brunetta P, Ogale S: Validation of the SF-36 in Patients with Systemic Lupus Erythematosus (SLE). Arthritis Rheum 2009, 60: 296.
Busija L, Pausenberger E, Haines TP, Haymes S, Buchbinder R, Osborne RH: Adult measures of general health and health-related quality of life: Medical Outcomes Study Short Form 36-Item (SF-36) and Short Form 12-Item (SF-12) Health Surveys, Nottingham Health Profile (NHP), Sickness Impact Profile (SIP), Medical Outcomes Study Short Form 6D (SF-6D), Health Utilities Index Mark 3 (HUI3), Quality of Well-Being Scale (QWB), and Assessment of Quality of Life (AQOL) [abstract]. Arthritis Care Res 2011, 63: S383-S412.
QualityMetric Inc.: User’s Manual for the SF-36v2 Health Survey. 2011. http://www.qualitymetric.com/WhatWeDo/ManualsUserGuides/UsersManualfortheSF36v2HealthSurvey/tabid/328/Default.aspx.
Gignac MAM, Cao X, McAlpine J, Badley EM: Measures of disability: Arthritis Impact Measurement Scales 2 (AIMS2), Arthritis Impact Measurement Scales 2-Short Form (AIMS2-SF), The Organization for Economic Cooperation and Development (OECD) Long-Term Disability (LTD) Questionnaire, EQ-5D, World Health Organization Disability Assessment Schedule II (WHODASII), Late-Life Function and Disability Instrument (LLFDI), and Late-Life Function and Disability Instrument-Abbreviated Version (LLFDI-Abbreviated) [abstract]. Arthritis Care Res 2011, 63: S308-S324.
Chandran V, Bhella S, Schentag C, Gladman DD: Functional assessment of chronic illness therapy-fatigue scale is valid in patients with psoriatic arthritis. Ann Rheum Dis 2007, 66: 936–939.
Goodchild CE, Treharne GJ, Booth DA, Kitas GD, Bowman SJ: Measuring fatigue among women with Sjogren’s syndrome or rheumatoid arthritis: a comparison of the Profile of Fatigue (ProF) and the Multidimensional Fatigue Inventory (MFI). Musculoskeletal Care 2008, 6: 31–48.
Lin J-M, Brimmer D, Maloney E, Nyarko E, BeLue R, Reeves W: Further validation of the Multidimensional Fatigue Inventory in a US adult population sample. Popul Health Metrics 2009, 7: 18.
Barendregt PJ, Visser MR, Smets EM, Tulen JH, van den Meiracker AH, Boomsma F, Markusse HM: Fatigue in primary Sjogren’s syndrome. Ann Rheum Dis 1998, 57: 291–295.
Smets E, Garssen B, Cull A, De Haes J: Application of the multidimensional fatigue inventory (MFI-20) in cancer patients receiving radiotherapy. Br J Cancer 1996, 73: 241.
Meek PM, Nail LM, Barsevick A, Schwartz AL, Stephen S, Whitmer K, Beck SL, Jones LS, Walker BL: Psychometric Testing of Fatigue Instruments for Use With Cancer Patients. Nurs Res 2000, 49: 181–190.
Wolfe F: Fatigue assessments in rheumatoid arthritis: comparative performance of visual analog scales and longer fatigue questionnaires in 7760 patients. Arthritis Rheumatol 2004, 31: 1896–1902.
Jump RL, Fifield J, Tennen H, Reisine S, Giuliano AJ: History of affective disorder and the experience of fatigue in rheumatoid arthritis. Arthritis Care Res 2004, 51: 239–245.
Cella D, Yount S, Sorensen M, Chartash E, Sengupta N, Grober J: Validation of the Functional Assessment of Chronic Illness Therapy Fatigue Scale relative to other instrumentation in patients with rheumatoid arthritis. J Rheumatol 2005, 32: 811–819.
Roche PA, Klestov AC, Heim HM: Description of stable pain in rheumatoid arthritis: a 6 year study. Arthritis Rheumatol 2003, 30: 1733–1738.
Creamer P, Lethbridge-Cejku M, Hochberg M: Determinants of pain severity in knee osteoarthritis: effect of demographic and psychosocial variables using 3 pain measures. Arthritis Rheumatol 1999, 26: 1785.
Jenkinson C, Carroll D, Egerton M, Frankland T, McQuay H, Nagle C: Comparison of the sensitivity to change of long and short form pain measures. Qual Life Res 1995, 4: 353–357.
Cleeland CS, Gonin R, Hatfield AK, Edmonson JH, Blum RH, Stewart JA, Pandya KJ: Pain and its treatment in outpatients with metastatic cancer. N Engl J Med 1994, 330: 592–596.
Mendoza T, Mayne T, Rublee D, Cleeland C: Reliability and validity of a modified Brief Pain Inventory short form in patients with osteoarthritis. Eur J Pain 2006, 10: 353–361.
Atkinson TM, Rosenfeld BD, Sit L, Mendoza TR, Fruscione M, Lavene D, Shaw M, Li Y, Hay J, Cleeland CS, Scher HI, Breitbart WS, Basch E: Using confirmatory factor analysis to evaluate construct validity of the Brief Pain Inventory (BPI). J Pain Symptom Manage 2011, 41: 558–565.
Williams VSL, Smith MY, Fehnel SE: The validity and utility of the BPI interference measures for evaluating the impact of osteoarthritic pain. J Pain Symptom Manag 2006, 31: 48–57.
Keller S, Bann CM, Dodd SL, Schein J, Mendoza TR, Cleeland CS: Validity of the brief pain inventory for use in documenting the outcomes of patients with noncancer pain. Clin J Pain 2004, 20: 309–318.
Daut RL, Cleeland CS, Flannery RC: Development of the Wisconsin Brief Pain Questionnaire to assess pain in cancer and other diseases. Pain 1983, 17: 197–210.
Mease PJ, Spaeth M, Clauw DJ, Arnold LM, Bradley LA, Russell IJ, Kajdasz DK, Walker DJ, Chappell AS: Estimation of minimum clinically important difference for pain in fibromyalgia. Arthritis Care Res 2011, 63: 821–826.
Beck AT, Steer RA, Carbin MG: Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clin Psychol Rev 1988, 8: 77–100.
Hiroe T, Kojima M, Yamamoto I, Nojima S, Kinoshita Y, Hashimoto N, Watanabe N, Maeda T, Furukawa TA: Gradations of clinical severity and sensitivity to change assessed with the Beck Depression Inventory-II in Japanese patients with depression. Psychiatry Res 2005, 135: 229–235.
Bjelland I, Dahl AA, Haug TT, Neckelmann D: The validity of the Hospital Anxiety and Depression Scale: An updated literature review. J Psychosom Res 2002, 52: 69–77.
Herrmann C: International experiences with the Hospital Anxiety and Depression Scale-A review of validation data and clinical results. J Psychosom Res 1997, 42: 17–41.
Silverstone PH: Poor efficacy of the hospital anxiety and depression scale in the diagnosis of major depressive disorder in both medical and psychiatric patients. J Psychosom Res 1994, 38: 441–450.
Reilly MC, Gooch KL, Wong RL, Kupper H, van der Heijde D: Validity, reliability and responsiveness of the Work Productivity and Activity Impairment Questionnaire in ankylosing spondylitis. Rheumatology (Oxford) 2010, 49: 812–819.
Zhang W, Bansback N, Boonen A, Young A, Singh A, Anis A: Validity of the work productivity and activity impairment questionnaire - general health version in patients with rheumatoid arthritis [abstract]. Arthritis Res Ther 2010, 12: R177.
Tang R, Groshen SG, Piatek CI, Desai BB, Pinski JK, Acosta F, Raghavan D, Dorff TB, Quinn DI: Sequential active chemotherapy schema in castration-resistant prostate cancer [abstract]. J Clin Oncol 2011, 29: e15191.
Krupp L, LaRocca N, Muir-Nash J, Steinberg A: The fatigue severity scale: Application to patients with multiple sclerosis and systemic lupus erythematosus. Arch Neurol 1989, 46: 1121–1123.
Mattsson M, Moller B, Lundberg IE, Gard G, Bostrom C: Reliability and validity of the Fatigue Severity Scale in Swedish for patients with systemic lupus erythematosus. Scand J Rheumatol 2008, 37: 269–277.
Refolo P, Minacori R, Mele V, Sacchini D, Spagnolo AG: Patient-reported outcomes (PROs): the significance of using humanistic measures in clinical trial and clinical practice. Eur Rev Med Pharmacol Sci 2012, 16: 1319–1323.
Ben Rousseau, Steven Blackburn, and Mark Forshaw, all of Adelphi Values, provided medical writing support for this article.
The study was funded by Novo Nordisk A/S, Denmark and conducted by Adelphi Values. LHo, LHu, LHe, CP and HK are employees of Adelphi Values (or were employees at the time the research was conducted). LHø, MS-L, and BBH are employees of Novo Nordisk A/S.
LHo, LHu, LHe, CP and HK participated in the study conception and design, analysis and interpretation of literature, development of the conceptual model, and reviewed and approved the manuscript. LHø, MS-L, and BBH participated in the study conception and design, analysis and interpretation, reviewed and approved the final version of the manuscript. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.