Assessing the patient experience of respiratory syncytial virus infection: development of a patient-reported outcome measure

Abstract

Background

Respiratory syncytial virus (RSV) causes significant morbidity and mortality in older adults. Despite a number of RSV vaccine candidates in clinical trials, there are no existing disease-specific, self-reported measures that assess the symptoms and severity of RSV infection from the perspective of adult patients with acute RSV. The objective of this study was to describe the initial conceptualization and development of the RSV Infection, Intensity and Impact Questionnaire (RSV-iiiQ), a new patient-reported outcome measure.

Methods

A targeted review of the literature identified relevant existing measures, symptoms, and impacts of RSV. A draft version of the RSV-iiiQ was developed based on the Influenza Intensity and Impact Questionnaire (Flu-iiQ) with expert input. Qualitative interviews (N = 20) were conducted with participants to optimize the RSV-iiiQ conceptual model and confirm the content validity of the RSV-iiiQ. Interviews included concept elicitation and a cognitive debriefing assessment. A draft conceptual framework was developed, and the electronic clinical outcome assessment was piloted. All steps of instrument development followed Food and Drug Administration guidance for patient-reported outcomes.

Results

In-depth concept elicitation interviews followed by cognitive debriefings demonstrated that the content of the items was comprehensive, covered the breadth of RSV symptoms and impacts, and was relevant to the experiences of individuals with RSV. Both the paper and electronic versions of the RSV-iiiQ were easily completed. Minor refinements were made to some items based on participant feedback, and the draft conceptual framework was refined.

Conclusions

The RSV-iiiQ was developed for use in clinical trials to measure the symptom intensity and impact of acute RSV infection from the perspective of adult patients. The tool was developed in accordance with current regulatory guidance and is useful to support patient-focused drug development.

Background

Respiratory syncytial virus (RSV) has been recognized as a cause of significant morbidity and mortality in adults. Approximately 3% to 7% of healthy older adults and 4% to 10% of adults with underlying medical conditions experience RSV infection annually in North America [1,2,3]. In addition to causing primary upper and lower respiratory tract infection, RSV infection can exacerbate chronic underlying cardiac and pulmonary conditions, and antecedent RSV infection may trigger hospitalization for these conditions. In a typical RSV season, among adults ≥ 65 years of age or older or adults with underlying cardiopulmonary diseases hospitalized with laboratory-confirmed RSV infection, RSV infection accounts for an estimated 11% of hospitalizations for pneumonia, 11% of hospitalizations for chronic obstructive pulmonary disease, 5% of hospitalizations for congestive heart failure, and 7% of hospitalizations for asthma [2, 4]. The economic effects of RSV infection are substantial, with hospitalization costs estimated to be between $1 billion and $5 billion annually in the United States [2, 5]. Absence from work, outpatient or emergency department visits, declines in functional status, and inability to perform daily activities are additional underrecognized costs associated with adult RSV infection [6, 7].

There are a number of RSV vaccine and therapeutic candidates being investigated in clinical trials, but there are no existing clinical outcome assessment measures for RSV symptom severity for use in clinical trials that meet the standards described in the patient-reported outcome (PRO) guidance for medical product labeling from the Food and Drug Administration (FDA) [8]. Given the highly symptomatic nature of RSV infection, patient report is useful to inform treatment benefit of novel vaccine or drug candidates. The FDA 2009 guidance stipulates that any PRO measure referenced in product labeling must be developed with extensive input from patients and be thoroughly tested in the populations involved in the clinical trials. The 2018 FDA draft discussion documentation suggests novel instrument development should be undertaken if an existing measure cannot be used or appropriately modified [9].

The Influenza Intensity and Impact Questionnaire (Flu-iiQ) is a well-developed and carefully evaluated PRO measure used to assess influenza and influenza-like illness symptom severity and other impacts [10], as identified in a literature review. The Flu-iiQ contains items describing symptoms that commonly overlap with RSV infection. Given the similar pathophysiology of influenza and RSV, their common symptoms, and the solid psychometric development of the Flu-iiQ, it was selected as the foundation for a new measure of RSV, the RSV Infection, Intensity and Impact Questionnaire (RSV-iiiQ). The RSV-iiiQ is a PRO measure designed in full accordance with current regulatory standards and industry-accepted best practices to assess the severity of symptoms and impacts of RSV infection from the perspective of adult patients with acute RSV. The RSV-iiiQ incorporates the majority of domains and items (e.g., influenza symptoms, impact on daily activities, impact on emotions) from the Flu-iiQ. Symptoms considered clinically important to describe RSV infection but not included in the Flu-iiQ PRO have been added to the RSV-iiiQ as candidate items; items deemed specific to influenza were removed.

The objective of this paper is to describe the development of the RSV-iiiQ, including background literature and qualitative interviews to inform its content. The intended purpose of the RSV-iiiQ is for administration in clinical investigations of RSV, including outcomes evaluation of clinical trials of vaccines and other pharmaceuticals.

Methods

Development of the RSV-iiiQ was in accordance with current regulatory guidance and best practices and included a review of the literature and input from experts and patients. A literature review was conducted to determine relevant symptoms and impacts of RSV infection and to identify any existing measures designed to assess the RSV patient experience (see Supplemental Table S1 for the search strategy for the literature review). The first stage included a PubMed database search conducted in December 2017 and restricted to English-language articles that used human participants and were not comments, letters, or editorials and that were published in a 10-year window. Next, desktop research was conducted to identify relevant grey literature, such as conference presentations or government reports focusing on the impact of RSV, including the patient’s ability to perform activities of daily living (ADLs) and psychosocial well-being.

Expert input

Clinical experts in the field of RSV research participated in several phases on the study. They were United States (US) physicians with experience treating patients with RSV; provided input on the design of the literature review; reviewed and provided recommendations on the draft items and content, the conceptual framework, and patient pilot testing; and served as consultants throughout the study.

Patient interviews

Two iterative rounds of in-depth interviews were conducted during two RSV seasons (2017–2018 and 2018–2019) to elicit comprehensive descriptions of symptoms and impacts of RSV infection (concept elicitation) as well as to refine the draft RSV-iiiQ item set (cognitive debriefing). Interviews lasted no more than 60 min. Approximately 20 min were allotted for concept elicitation, and 40 min were allotted for cognitive debriefing. The study protocol was reviewed and approved by the University of Michigan Institutional Review Board (Federalwide Assurance No. 4969) and RTI International Institutional Review Board (Federalwide Assurance No. 3331).

Participants were recruited through the University of Michigan (in Ann Arbor, Michigan) and the Global Market Research Group (headquartered in Carlsbad, California). Prospectively identified participants were invited at the time of the study office visit. Clinical sites also reviewed medical records and, within 45 days of the date of diagnosis, invited patients with a positive RSV polymerase chain reaction (PCR) test. Retrospectively identified participants were invited to participate via telephone call or email. Study sites attempted to recruit participants as soon as possible after confirmation of an RSV diagnosis by PCR and when the patient self-reported feeling well enough to participate in the interview. Individuals were eligible to participate if they had acute RSV infection confirmed by a PCR assay within 45 days of being contacted to participate in the qualitative interview. Individuals were excluded if they presented with a comorbid respiratory condition, received supplemental oxygen therapy for a condition other than RSV, had chemotherapy administered in the previous 12 months, or received an investigational medicinal product in the previous 30 days. Informed consent was obtained from each participant prior to the interview.

Interviews were conducted using standardized qualitative research methods [11, 12] and began with open-ended questions to ascertain participants’ experiences with RSV and its impact on their lives. These general questions were followed by targeted probes intended to evaluate the course of RSV symptoms and what symptoms were considered the most bothersome or concerning. Following this concept elicitation component, the draft RSV-iiiQ items were reviewed with participants for their input and endorsement of symptom and impact concepts included in the instrument. During this cognitive debriefing portion of the interview, participants were asked to “think aloud” by describing their thought processes as they reviewed the draft RSV-iiiQ items. Participants were also asked to provide feedback to confirm the relevance of each item and identify any problems with item wording or response options. Follow-up questions were also asked to help better understand how participants interpreted and responded to each of the draft RSV-iiiQ items.

All interviews were audio recorded, transcribed, and verified for accuracy. Analysis of the qualitative data was conducted using the typed transcripts, and detailed field notes were collected during the interviews. Thematic analysis was conducted through the identification of dominant concepts in each interview, which were compared across other interviews to generate themes or patterns in the ways participants described their experiences [12]. Participants also provided feedback on draft items. Results incorporated representative participant quotes, selected to illustrate participants’ perspectives using their own words. Concept saturation (i.e., the point at which no new information is captured [13]) was documented using a saturation grid.

Results

Literature review and identification of an existing measure

A total of 78 abstracts were identified via a PubMed search and reviewed; 16 full-text articles were selected for further review if the identified abstract noted symptoms or patient impacts of RSV. Six articles provided detailed information on specific symptoms, impacts, and experiences associated with RSV in adult patients [3, 14,15,16,17,18]. Desktop research identified nine additional articles or websites [2, 5, 6, 19,20,21,22,23,24]. Table 1 details all signs, symptoms, and impacts of RSV infection identified in the literature, including impact on daily activities and emotions contained in the Flu-iiQ.

Table 1 Signs, symptoms, and impact of RSV identified in the literature

Early symptoms of RSV are nasal congestion and rhinorrhea, cough, shortness of breath, and wheezing. Healthy adults with RSV reported less fever and dyspnea than healthy adults with influenza, although hospitalized adults with RSV reported more wheezing than patients with influenza [22]. As RSV progresses or becomes more severe, patients may experience severe cough, wheezing, or rapid breathing and progressive outcomes of pneumonia or bronchiolitis [31]. RSV symptoms are similar to those of influenza [27], making the two diseases sometimes difficult to differentiate. RSV diagnostic testing is not widely performed in adults because there is a lack of effective therapies [17, 27]. However, influenza often shows annual variability, whereas RSV tends to be more consistent in terms of attack rates and severity [2]. Falsey et al. [2] identified, over the course of four consecutive seasons, RSV infections in cohorts of community-dwelling elderly, high-risk adults, and persons hospitalized with acute cardiopulmonary conditions in Rochester, New York. High-risk patients reported greater functional impairment than healthy elderly patients, with 45% of high-risk individuals reporting an inability to complete ADLs, compared with 39% of healthy elderly patients. For example, inability to get out of bed was reported by 7% of healthy elderly patients and by 25% of those considered to be at high risk.

No RSV-specific measures for use in adults were found in the literature, although Falsey et al. [2] used a set of ADL scales to evaluate functional status in adults with RSV. The Flu-iiQ, a previously developed and psychometrically tested PRO measure for the assessment of symptom severity in influenza and influenza-like illness, was identified as a measure used in clinical trials for influenza vaccine [10, 32]; it was developed using concept mapping with patients and a validity-driven approach with a strong measurement model. The Flu-iiQ covers concepts related to anxiety and depression, such as irritableness, helplessness, frustration, and worry. A number of ADLs are included in the Flu-iiQ, such as getting out of bed, preparing meals, performing usual activities, leaving home, concentrating on tasks, and taking care of oneself. Content analysis indicated that it contains symptoms, ADLs, and psychosocial consequences that are relevant to RSV infection. Given that the pathophysiology of influenza and RSV are similar, we used the Flu-iiQ [10] as a framework for further development of the RSV-iiiQ. The Flu-iiQ was used with permission of Richard Osbourne and Measured Solutions for Health P/L.

Development of the RSV-iiiQ

RSV symptoms and impacts were mapped on to the content of the Flu-iiQ [9]. Subsequently, clinical experts utilized the results of the literature review and symptoms considered clinically important to describe RSV infection but not included in the Flu-iiQ to construct candidate RSV-iiiQ items. These items were created based on appropriate item-generation principles requiring single-barreled questions, patient-centric language, and ability to change over the course of a clinical study. Specifically, items were added to assess runny nose, wheezing, cough with phlegm, and shortness of breath, as well as two supplementary ADLs: walking up a flight of stairs and dressing oneself. Conversely, the Flu-iiQ items addressing neck pain and impact on others were not retained for the proposed RSV-iiiQ; they were deemed irrelevant to the evaluation of RSV infection based on clinical input and published literature. The initial draft version of the RSV-iiiQ was shared with five RSV clinical experts for their review of the consistency of item content with the clinical syndrome and for preparation and formatting of the tool as a web-based electronic clinical outcome assessment (eCOA).

The initial draft version of the RSV-iiiQ consisted of 29 items evaluating the symptoms, ADLs, and psychosocial impact of RSV infection. For questions related to RSV symptoms (n = 17) and psychosocial consequences (n = 4), participants were asked to recall the past 24 h and select from a 4-point verbal response scale ranging from “none” to “severe”; for questions about ADLs (n = 8), participants were asked to recall the past 24 h and select from a 4-point verbal response scale that ranged from “no difficulty” to “severe difficulty.”

Participant characteristics

A total of 20 adults participated in semistructured interviews, which utilized a split interview technique that involved concept elicitation followed by a thorough cognitive debriefing of the draft RSV-iiiQ. Participants ranged in age from 26 to 78 years (average age, 52 years), and the majority of the study sample was White (n = 15; 75%) and female (n = 14; 70%) (Table 2). More than half of participants (65%) had a college degree; 20% reported a high school education only. The majority of respondents (60%) were employed at least part-time.

Table 2 Characteristics of interview participants

Concept elicitation

The most common symptoms reported were cough (100%) and fatigue (85%). Shortness of breath, stuffy nose, runny nose, body aches and pains, interrupted sleep, sore throat, wheezing, fever, mucous production, and/or headache were all reported by at least 50% of respondents (Table 3). Time from symptom development to seeking care ranged from 2 to 3 days for those experiencing more severe symptoms and from 1 to 2 weeks for those whose symptoms were less severe. Participants with greater symptom severity expressed more concern about their RSV diagnosis than those with less symptom severity. Participants reported that symptoms subsided over time, noting that cough, breathing difficulties, and runny and/or stuffy nose were the last symptoms to resolve. All participants noted that activity exacerbated their symptoms. The most bothersome symptoms reported by participants included cough, fatigue, and shortness of breath. Symptoms that were most concerning to participants included bronchospasm, difficulty breathing, progression to pneumonia, and a reduced activity level that is “difficult to recover from.”

Table 3 Representative participant descriptions of RSV symptoms

Participants also detailed both the functional and the emotional impact of RSV infection (Table 4 and Table 5). The most commonly reported functional impact was an inability to participate in sports, exercise, or do other things for enjoyment (45%). Additionally, 8 of the 12 working participants reported missing work or school due to RSV infection. Other functional and emotional impacts reported by at least 20% of respondents included difficulty with self-care activities (e.g., dressing, bathing, preparing meals), leaving home, concentration, a decrease in productivity, and a negative impact on relationships with others. The predominant emotional impacts reported were worry (50%) and frustration (40%).

Table 4 Representative participant descriptions of functional impacts on daily activity from RSV

Table 5 Representative participant descriptions of emotional impacts from RSV

From the combined evidence gathered to support the development of the RSV-iiiQ, a conceptual framework was created (Fig. 1). A conceptual framework describes the expected relationships of items within a domain and the expected relationships among domains within a PRO concept [33]. Our conceptual framework was developed predominantly from patient input but also in part from analysis of dominant themes discovered in the literature and through consultation with clinicians.

Fig. 1

Conceptual framework of RSV-iiiQ. RSV = Respiratory syncytial virus; RSV-iiiQ = RSV Infection, Intensity and Impact Questionnaire

Cognitive debriefing

Participants fully endorsed inclusion of all symptom and impact concepts included in the RSV-iiiQ. Interpretation of the symptom and impact concepts was consistent with those previously described during concept elicitation. Overall, participants found the instructions clear and easy to understand. Participants noted that the 24-h recall period was an appropriate amount of time to consider and report RSV symptoms and impacts, given the fluctuation in RSV symptoms that can occur over a short period of time. Participants found the 4-point categorical response scale ranging from “none” to “severe” to be appropriate for evaluation of RSV symptom severity. Overall endorsement of the item concepts was consistent across all participants. No further changes were made to the instructions, recall period, or response options of items following the conclusion of the round 2 interviews.

The eCOA version of the RSV-iiiQ was a web-based application that could be accessed from computers, tablets, or smartphones. Overall, participants were receptive (and most noted a preference) to using an electronic format to complete the RSV-iiiQ. All participants understood how to access the eCOA’s web-based questionnaire, navigate through the screens, select and change (if needed) their answer, and advance to subsequent questions. Most found the system to be intuitive and required little to no instruction from the interviewer.

Concept saturation

Concept saturation was assessed throughout the qualitative interview process. All symptoms and consequences contained within the RSV-iiiQ were endorsed by participants during both the initial concept elicitation and again during cognitive debriefing (see Table S2, Supplemental Material). The majority of symptoms were identified following completion of the eighth interview and further endorsed during subsequent interviews. Saturation of emotional consequences occurred following the completion of the tenth interview.

Discussion

The RSV-iiiQ was designed to capture RSV symptom severity and the emotional and psychosocial impact of RSV infection most commonly experienced by adults. To our knowledge, at the time of this publication, this is the only RSV severity and impact measure developed in accordance with the FDA PRO guidance recommendations. Concepts for inclusion in the RSV-iiiQ were based on the scientific literature, endorsed by clinical experts, and consistent in frequency and terminology with RSV patients’ experience. Results of the participant interviews supported the ability of the items to accurately reflect participants’ perceptions of symptom severity and impact.

This self-completed measure was developed in alignment with the FDA’s 2009 PRO guidance [8] and 2018 draft discussion documentation [9] in support of the modification of an existing measure for an expanded context of use. The overlap in the patient experiences of RSV and influenza facilitated the adaptation of the Flu-iiQ. The supplemental work in the field of RSV adds significantly to the weight of evidence supporting this new tool in this specific context of use. Notably, the use of PRO measures in clinical trials aligns with regulatory goals to promote patient-focused drug development [34], a systematic approach to incorporating patient needs into drug development to support novel treatments with outcomes meaningful to patients. Finally, the older adult participants (those aged 60 or older) were receptive to using an electronic format to complete the RSV-iiiQ and were able to access the measure and read and respond to the items presented either on a laptop, a tablet, or a smartphone. Availability of both paper and electronic versions of the tool will contribute to the accessibility of the RSV-iiiQ across this patient population.

Limitations of this study include the potential differences between the qualitative sample and the clinical trial population regarding the time between infection and diagnosis, the use of convenience sampling, and the development of the instrument in a US population only. Cross-cultural adaptation and translation would be required for use in other languages and/or cultures. Rigorous psychometric evaluations should be conducted to support key measurement properties, including the RSV-iiiQ’s reliability, validity, and ability to detect change and the development of preliminary responder definitions.

Conclusions

The patient voice is essential to inform clinical trials and is useful in evaluations of RSV vaccine efficacy. To date, there are no clinical outcome assessment measures to assess RSV-associated symptoms or ADLs that include the patient perspective. The RSV-iiiQ was developed for use in clinical trials to measure RSV symptom intensity and impact in adults with acute RSV. A targeted literature review, expert input, and patient interviews confirmed that the RSV-iiiQ considers the symptoms, ADLs, and psychosocial items that are relevant to patients with RSV infection.