A new measure of patient satisfaction with ocular hypotensive medications: The Treatment Satisfaction Survey for Intraocular Pressure (TSS-IOP)
© Atkinson et al; licensee BioMed Central Ltd. 2003
Received: 02 September 2003
Accepted: 15 November 2003
Published: 15 November 2003
To validate the treatment-specific Treatment Satisfaction Survey for Intraocular Pressure (TSS-IOP).
Item content was developed by 4 heterogeneous patient focus groups (n = 32). Instrument validation involved 250 patients on ocular hypotensive medications recruited from ophthalmology practices in the Southern USA. Participants responded to demographic and test questions during a clinic visit. Standard psychometric analyses were performed on the resulting data.
Of the 412 patients screened, 253 consented to participate, and 250 provided complete datasets. The sample included 44% male (n = 109), 44% Black (n = 109) and 57% brown eyed (n = 142) participants, with a mean age of 64.6 years (SD 13.1) and a history of elevated IOP for an average of 8.4 yrs (SD 7.8). A majority was receiving monotherapy (60%, n = 151).
A PC Factor analysis (w/ varimax rotation) of the 31 items yielded 5 factors (Eigenvalues > 1.0) explaining 70% of the total variance. Weaker and conceptually redundant items were removed and the remaining 15 items reanalyzed. The satisfaction factors were; Eye Irritation (EI; 4 items), Convenience of Use (CofU; 3 items), Ease of Use (EofU; 3 items), Hyperemia (HYP; 3 items), and Medication Effectiveness (EFF; 2 items). Chronbach's Alphas ranged from .80 to .86. Greater distributional skew was found for less common experiences (i.e., HYP & EI with 65% & 48.4% ceilings) than for more common experiences (i.e., EofU, CofU, EFF with 10.8%, 20.8% & 15.9% ceilings). TSS-IOP scales converged with conceptually related scales on a previously validated measure of treatment satisfaction, the TSQM (r = .36 to .77). Evidence of concurrent criterion-related validity was found. Patients' symptomatic ratings of eye irritation, hyperemia and difficulties using the medication correlated with satisfaction on these dimensions (r = .30-.56, all p < .001). Clinicians' ratings of IOP control, severity of side effects and problematic medication use correlated with patients' satisfaction scores on these dimensions (r = .13-.26, all p < .01).
This study provides initial evidence that the TSS-IOP is a reliable and valid measure, assessing patients' satisfaction with ocular hypotensive medications.
Around the world, Patient Reported Outcomes (PRO's) are becoming an increasingly important set of criteria with which to evaluate the adequacy of treatment outcomes [1–6]. The relative success or failure of medical treatments can, at least in part, be judged by inquiring about patients' perceptions of their treatment experiences and changes in the impact of illness on their daily lives. . PRO self-report assessments have been developed to assess patients' perceptions of the type and severity of symptoms, the functional impact of illness, utility and preference measures for treatment options, the impact of illness on health-related quality of life and well-being, and various types of patient/treatment satisfaction.
More specifically, patient satisfaction has been used as a way to include patients' perceptions and preferences when evaluating the success of both medical treatments and systems of healthcare delivery [7–10]. Moreover, an individuals' satisfaction has been shown to affect health-related decisions and treatment-related behaviors, which in turn impact the success of treatment outcomes and the costs associated with treatment failure [11, 12]. Patients' satisfaction with services has been shown to predict treatment success, medical compliance, follow-through with treatment plans, and appropriate use of services [13–15]. In a similar way, satisfaction with medication predicts patients continuance on pharmaceutical treatment, correct medication use and compliance with medication regimens [16–19].
The adverse effect of low treatment satisfaction on medication compliance has been found to be particularly problematic among persons with chronic disease conditions [14, 20]. It has been estimated that up to one half of patients with chronic and/or asymptomatic illness will make medication-related decisions without seeking medical advice, becoming 'non-adherent' to such an extent that they compromise the effectiveness of treatment and eventually place further utilization demand on broader systems of care . In contrast, more acutely ill patients who perceive an immediate threat to their physical well-being may be more willing to tolerate short-term aggressive treatment regimens in hopes of restoring their former health. Primary open angle glaucoma is a disease where patient adherence to therapy is important since the disease is by and large chronic, asymptomatic and can lead to irreversible vision loss. Patient compliance with therapy is necessary for optimal long-term outcomes. The objective of this research is to validate a treatment-specific Treatment Satisfaction Survey for Intraocular Pressure (TSS-IOP).
Due to the central importance of consumer satisfaction to the success of both health care services and pharmaceutical products, conceptual advances in the field have lead to a proliferation of satisfaction measures across many disease states [21, 22]. These measures can be grouped into those addressing patients' satisfaction with discrete aspects of medical treatments (treatment satisfaction) and those focusing on more systemic aspects of programmatic care [15, 23–27]. As discussed in two articles describing the development of a general model of treatment satisfaction, patients' satisfaction with their medication (TS-M) can be thought of as a specific sub-dimension of treatment satisfaction (TS) [28, 29]. In turn, TS is viewed as a subset of patient satisfaction (PS) that covers more general and systemic aspects of both medical treatments and interpersonal aspects of clinical care. Thus one may inquire about patients' satisfaction across different aspects of both interpersonal care and medical treatments or more specifically about satisfaction with medication.
Levels of Generality-Specificity of PRO Items and Scales
Levels of PRO Item and Scale Specificity
Content Specificity & Referential Certainty
Respondents' Inference or Interpretation of Meaning
Normative Index of Personal Relevance
Global: Level 1
General: Level 2
Domain Specific Only
Specific: Level 3
Domain & Event Specific
Level 2 scales are made up of more general items that assess a particular domain of treatment (e.g., effectiveness, side effects or convenience) but are not specific to a certain illness or type of medication. In response to Level 2 items, respondents interpret the meaning of the item from the vantage point of their particular experiences of treatment (e.g., How satisfied or dissatisfied are you with how well your medication has relieved the symptoms associated with your condition?). As a result, such items are appropriate for use with a wider range of patients with different illness and treatment conditions. The quality of these items depends heavily on the face validity of the perceived relevance of the content. The items are interpreted in such a way that they are understood to be personally relevant, and the resulting response is reflective of a salient aspect of ones' experiences. The wording of Level 2 items refers generally to the dimension being evaluated (e.g., Effectiveness, Side Effect, Convenience), not the particular disease-specific treatment experiences within each dimension.
Level 1 scales are the most general or global of all. In addition to being seen as relevant across many different types of patient populations, illness conditions, and treatment approaches within a domain of satisfaction, Level 1 items and scales elicit a global appraisal or judgment across numerous domains of measure (e.g., Taking all things into account, how satisfied or dissatisfied are you with your medication overall?). As one moves from Level 3 to Level 1, greater personal interpretation and judgment is implicitly required from respondents. They make contextual sense out of the more generally worded items using sets of personally relevant experiences which stand out in their mind. Moreover, these experiences have emotional relevance, which may explain the stronger correlations between emotional variables and Level 1 scales than Level 3 scales. In general, responses to more global scales have been shown to exhibit higher correlations with affective constructs than more specifically worded items . An exception to this observation may occur if a specific item is relevant to the majority of a sample. It remains to be seen whether such emotive associations and general appraisals of satisfaction can be shown to predict behavioral variables as they have in other populations .
Conversely, the content specificity of Level 2 and particularly Level 3 items and scales is higher, and it is often easy from reading these items to be fairly certain of what respondents' are referring to when making ratings. As a result, Level 3 items are often viewed more favorably providing evidence to substantiate specific claims regarding particular treatment or aspects of care .
PRO Measurement in Glaucoma
The importance of patients' perceptions of both clinical and non-clinical factors affecting the outcomes of ophthalmology has lead to the development of various PRO measures for use with glaucoma patients. PRO instruments have been used to assess patients' perceptions of visual functioning [33–35], visual disabilities , visual symptoms , patient preference and treatment satisfaction , and Health-Related Quality of Life . As one might expect, an inter-relationship has been shown between various types of PRO outcomes. For example, in addition to patients' reports of their visual function , TS-M (particularly the side effects domain) has been shown to affect patients' health-related quality of life scores .
Patient satisfaction measures have been used to assess glaucoma patients' experiences with surgical procedures [38, 42], pharmaceutical interventions , and various aspects of service delivery . To date, only one valid measure of TS-M for ocular hypotensive treatments exists, the Comparison of Ophthalmic Medication for Tolerability Questionnaire (COMTOL) . However, this earlier questionnaire places a heavy emphasis on vision-related functional outcomes and does not adequately cover the side effects that became apparent with the emergence of prostaglandin treatments in 1996.
Glaucoma Treatments and Patient Experience
The reduction of intraocular pressure (IOP) in patients with glaucoma helps prevent the progression of the disease which may lead to visual loss and potential blindness. In addition, reduction in IOP is used to help prevent the progression of OH to glaucoma [46, 47]. Unfortunately, the topical treatments for OH are often accompanied by significant side effects [48, 49]. Similar to observations in other areas of medicine, the factors of cost, convenience and side effects of pharmacotherapies can influence a patient's lifestyle, quality of life, non-compliance with medication regimens, and ultimately, their clinical effectiveness [11–13, 48, 49].
In addition, multiple medications and multiple daily administrations may be a necessary inconvenience and, for a subset of patients with dexterity problems, present significant difficulties to its use. Easy to use delivery systems that permit accurate dosing of topical agents are important to minimize the wastage associated with missing the eye or instillation of multiple doses. The costs and inconveniences associated with such waste are a substantial concern for some patients.
Several clinical classes of medications are available to treat elevated IOP in patients with POAG and OH. A frequently administered class of medications is the prostaglandin analogs. These medications have the advantage of once daily dosing, are highly efficacious and have a low incidence of systemic side effects. The most common ocular side effects are conjunctival hyperemia and iris pigmentation changes [50–52]. Another commonly prescribed class of medicine is the topical beta-adrenergic blockers. These medicines are generally slightly less effective than prostaglandins and are dosed once or twice daily. The beta-adrenergic blockers may be associated with pronounced systemic side effects in some patients, including worsening of reactive airway disease and aggravation of cardiac conduction disease [46, 53, 54].
Topical carbonic anhydrase inhibitors (CAI) are available as monotherapies or as a fixed combination with timolol maleate, a beta-blocker, and may be dosed two to three times daily. The CAI medicines, although less effective than beta-blockers, provide an excellent systemic safety profile but are commonly associated with mild ocular burning and stinging upon instillation [55–57]. Brimonidine is a centrally acting alpha-agonist that is usually dosed two to three times daily and has similar efficacy to dorzolamide. Brimonidine may occasionally cause systemic side effects, such as blood pressure changes or neurological symptoms and may cause ocular intolerance in approximately 10%-26% of cases [57, 58]. All the above agents are often dosed as un-fixed combinations that increase dosing complexity and the likelihood of adverse events.
Unfortunately, no existing measure of treatment satisfaction adequately assesses the subjective impact of ocular side effects and inconveniences associated with different IOP medications. In order to address this gap, the objective of this study was to design a measure of TS-M specifically to assess patients' satisfaction with various aspects of topical ophthalmic treatments within a sample of patients with glaucoma or ocular hypertension – the Treatment Satisfaction Questionnaire for Medications for Intraocular Pressure (TSS-IOP).
This study occurred in two stages. The first portion was conducted to identify the item content for the new measure, based on information gleaned from a literature review and four focus groups consisting of patients receiving topical ophthalmic treatment to control IOP. This content was used to develop an initial pool of items that would be psychometrically tested in the second stage of the study. This second, larger psychometric study was used to select the final items to be included in the TSS-IOP and to examine the performance of the new scales.
Stage I: Patient Focus Groups Qualitative Research Methodology
The primary objective of the focus groups was to refine and finalize the content pool for the TSS-IOP test items. The methodological approach used to plan and conduct the patient focus groups was consistent with Goldman's group depth interview model , in which information is gathered from a number of interacting individuals who share a community of interests. These groups are facilitated using a trained moderator who employs a combination of probing as well as direct- and non-direct inquiry techniques.
Prior to implementing the focus groups, a discussion guide was developed to direct the collection of data. The guide consisted of nine sections: (1) orient participants to the purpose of the discussion, (2) guide patient introductions, (3) discuss satisfaction with ocular hypotensive medications, (4) identify determinants of medication satisfaction and dissatisfaction, (5) explore three targeted satisfaction domains (effectiveness, side effects, and convenience/ease-of-use/delivery method), (6) discuss compliance, (7) inquire about doctor visits and the continuum of care, (8) review a prototype TSS-IOP mockup, and (9) probe for final thoughts, including what, if any, additional domains could be added that might impact satisfaction/dissatisfaction. The focus group data were collected using the moderator's notes, notes taken by two observers seated behind the one-way mirror in the focus group facility, and via review of the session videotapes.
Focus Group Composition
Thirty-two patients with primary open-angle glaucoma (POAG) or ocular hypertension (OH) participated in one of four, 90-minute focus group sessions. These sessions were composed of a heterogeneous sample that represented a diversity of patient experiences with common ocular hypotensive medications used to treat OH and POAG. Focus group participants included: Those experiencing hyperemia associated with ophthalmic prostaglandin medications (PG) within the last 3–6 months; patients who were newly treated in the past 3–6 months; PG naive patients who received some form of topical therapy other than PG's; patients who had used medications that required multiple daily dosing (e.g., timolol, brimonidine) or used multiple types of ophthalmic medications daily; and patients using novel forms of medication delivery aids.
Twelve individuals reported problems with medication effectiveness and seven admitted that they did not always use their medication as prescribed. Fourteen participants reported specific problems with the side effects of their current medication, while 16 of patients reported having experienced at least one ocular side effect associated with their medication over time. Eight individuals were on two or more medications at the time and of these, two reported problems specifically associated with multiple medication use (primarily side effects). Ten participants indicated having at least some minor problems with respect to the medication they have used in the past.
Thematic Content of Focus Group Discussion
Thematic Content Analysis of Factors Relevant to Patients' Satisfaction With Their Medication Use
Prevailing Themes and Sub-Themes
• The eye pressure readings are the only way one can tell
• Some report improvements in their vision, including:
Ability to read (small print) without glasses
Vision is clearer/not as blurred or cloudy
Distance vision is clearer
Able to see better at night
Unintended Medication Effects
• Burning, Itching, Grittiness/Sandiness, Dryness, Tearing of eyes
• Redness of eye, Darkening of iris of eyes
• Swelling, Crustiness, Stickiness of eyelids
• Visual Changes (e.g., "clear ropes" in eyes, loss of center of vision, sensitivity to light)
• Systemic affects associated with allergenic reaction or use of oral treatments: shortness of breath, restlessness/inability to sleep, excessive perspiration, low energy, migraines
Convenience and Ease of Medication Use
• Discomfort putting things in eyes
• Strong "blink reflex" making it difficult to instill the drops
• Difficulty learning to instill drops
• Miss the eye when administering the medicine
• Unable to feel whether a drop has gone into their eye
• Inadvertently dispense more than one drop, or dispense just one more to be sure
• Require assistance if elderly or physically impaired (e.g., have Parkinson's)
• Trouble remembering to use the medicine, particularly on trips or vacations
• Instillation twice a day, this is less convenient than once
• Frustration with the daily dosing and, as a result, sometimes not taking their medicine
• More inconvenient to administer evening than morning doses, sometimes too tired in evening
• Delay taking medication in evening till returning home
• Difficult to tell when their medicine is about to run out
Stage II: Validation Study
Participants in the validation study consisted of 250 patients who were consecutively recruited from participating Ophthalmology clinics in 5 different clinics in the Southeastern U.S. These patients had either open-angle glaucoma or ocular hypertension and were currently using marketed topical IOP-lowering medication(s) in at least one eye (as defined by AAO diagnostic codes). In order for patients to be included they were also required to meet the following inclusion-exclusion criteria: Be 18 years of age or older; willing to comply with the investigator's and protocol's instructions; consent to participate; be treated with a topical ophthalmic hypotensive drop medication in at least one eye; and possess adequate visual acuity and mental ability to read and understand English. Individuals were excluded if they had any clinically significant medical/psychiatric condition or had participated in any investigational ophthalmic trials within the previous 30 days. Patients who had ocular surgery within the last 60 days were also excluded.
Consenting participants were asked to complete the 31 draft treatment satisfaction items as well as a supplemental questionnaire gathering demographic and treatment-related information. A study staff member reviewed the materials for completeness prior to the end of their visit. Participants' physicians also provided clinical information about the level of side effects, degree of OH control, and difficulties their patients had with compliance and self-administration of their medication. In addition, patients' current treatment information from their medical records was merged with their records in the study dataset. This provided information on the types of topical medications to treat OH. As a follow-up, twenty-five patients were asked to complete the TSS-IOP and supplemental questionnaire twice, with assessments taken one week apart. The resulting information allowed for evaluation of the test-retest reliability of the measure.
The sample size required for the study was based on the requirements of the factor analytic procedure, which (as a rule of thumb) requires 10 subjects per question . All statistical procedures and methods that were used in this study followed the generally accepted guidelines for the psychometric validation of PRO instrumentation [61–63]. This included the examination of construct validity using factor analysis and internal consistency of resulting scales assessed using Chronbach's Alpha coefficients. Computed scale scores allowed for assessment of the clinical-criterion and convergent validity of the instrument. The clinical criterion-related validity coefficients were based on known differences in patient's clinical condition and treatment experiences. The convergent validity of the instrument was assessed using a previously validated measure of treatment satisfaction, the Treatment Satisfaction Questionnaire for Medication (TSQM) . Interclass correlations were used to assess the temporal stability of the scales under no change conditions.
Of the 412 patients approached, 252 patients consented, and 250 provided complete datasets. The majority of those who declined participation cited time constraints as the major reason (n = 91), some (n = 39) were unable to complete the survey without assistance due to current iris dilation procedures, and some declined because they thought the information was too personal (n = 32). Participants had a mean age of 64.6 years (SD 13.1) and a history of elevated IOP for an average of 8.4 yrs (SD 7.8). The sex ratio was about equal, with females representing 56.4% (141) of the sample. A slim majority of the sample was Caucasian (138, 55.2%) with 109 (43.6%) being Black and 3 (1.2%) Hispanic. The iris color of the sample was predominantly brown (142, 56.8%), followed by blue (67, 26.8%), and other light colors (41, 16.4%). Fifty-four percent of the sample (n = 134) were retired, 39.6% were working either full- or part-time and 6.8% were unemployed. A majority were receiving topical monotherapy for OH (60.4%, n = 151). Almost 80% (197) reported to have taken systemic forms of medication to treat other comorbid conditions in addition to their eye drops within the last 30 days.
Construct Validity & Scale Score Distributions
Final Five Factor Solution of the TSS-IOP Items
EI_1: Bothered by prolonged burning or stinging
EI_2: Bothered by grittiness or sandiness in eyes
EI_3: Bothered by dry eyes
EI_4: Bothered by unpleasant feelings in/around eyes
CoU_1: Satisfaction w/ time of day to take medication
CoU_2: Satisfaction w/ times per day require to take med
CoU_3: Ease of remembering to take medication
EoU_1: Ability to accurately deliver drop in eye
EoU_2: Ability to deliver the right amount of medication
EoU_3: Ease of positioning of head
HYP_1: Bothered by others reactions to your red eyes
HYP_2: Self-conscious of eye redness
HYP_3: Concern over cosmetic appearance of eyes
EFF_1: Prevention of future vision problems
EFF_2: Reduction of current visual problems
Score Distribution and Internal Consistency Characteristics of TSS-IOP Scales (n = 250)
Mean (SD) Statistic
Number of Items
Test-Retest Reliability (ICC's)
Convenience of Use
Ease of Use
Inter-scale Spearman Rho Correlations on the TSS-IOP
Convenience of Use
Convenience of Use
Ease of Use
TSS-IOP Item-Scale Spearman Rho Correlations
Convenience of Use
Ease of Use
Convergence of the TSS-IOP Scales and the TSQM (Spearman Rho Correlations)
TSQM Side Effects
Convenience of Use
Ease of Use
Respondents' Dissatisfaction Ratings Correlated with Specific Problematic Treatment Effects (Spearman Rho Correlations)
Hyperemia (Level 3)
Eye Irritation (Level 3)
Side Effects (Level 2)
GLOBAL (Level 1)
Eye Lash Growth
Baggy Eye Lids
Darkened Eye Lids
Criterion-Related Validity: Subgroup Comparisons
The expected correlations were found between patients' frequency ratings of specific problems associated with treatment and their ratings of satisfaction with the side effects of treatment. These associations between the frequency endorsement of undesirable events and satisfaction levels were observed using both instruments (i.e., TSQM Global and Side Effects scales and the TSS-IOP IE and HYP scales), with stronger correlational associations found on Level 3 scales than the more general Level 2 or Level 1 scales. Interestingly, clinical ratings of the severity of unintended medication effects were significantly correlated with relatively few of the patients' frequency ratings, the notable exceptions were, red eyes (r = .21, p < .001), twitching/tight eye lids (r = .16, p < .05), iris pigmentation (r = .14, p < .05) and darkening of the eye lids (r = .17, p < .01).
Convenience Satisfaction Ratings Correlated with Frequency of Specific Difficulties with Administration (Spearman Rho Correlations)
TSS-IOP Ease of Use (Level 3)
TSS-IOP Convenience of Use (Level 3)
TSQM Convenience (Level 2)
TSQM GLOBAL (Level 1)
Frequency missing eye
Anticipatory blink and spillage
Trouble positioning head
Delivering too much medication
Forgetting to use medication
Convergent Validation of Patients' Satisfaction Ratings Using Physicians' Ratings of Patient Case (Spearman Rho Correlations)
Degree of IOP Control
Severity of Side Effects
Compliance w/ Medication Regimen
Problems w/ Self-Administration
Convenience of Use
Ease of Use
Acceptance of Illness and Resistance to Using Medication by Satisfaction Levels (Spearman Rho Correlations)
Acceptance of Illness
Resistance to Using Medication
Forgetting to Take Medication
Ease of Use
Evidence of Known Groups Validity: Satisfaction by Medications Groups
A comparison of persons on single (60%, n = 151) versus multiple topical medications (40%, n = 99) by the dimensions of treatment satisfaction revealed that the monotherapeutic group was more satisfied than the polytherapeutic group on the TSQM Side Effects scale (93.4 (12.7) vs. 88.7 (15.2), F(1, 243) = 6.67, p = .01), and the TSS-IOP EI scale (93.4 (11.1) vs. 87.5 (17.8), F(1, 243) = 10.4, p = .001), CofU scale (82.5 (14.2) vs. 77.1 (16.8), F(1, 243) = 7.47, p = .007) and the EFF scale (79.1 (15.4) vs. 73.7 (18.0), F(1, 243) = 6.19, p = .014). Monotherapeutic respondents on Beta Blockers (n = 34) and Prostagladins (n = 80) reported the highest satisfaction levels with CofU, followed by those on Carbonic Anhydrase (n = 22) and Alpha Agonists (n = 12), (85.3 (14.5), 83.6 (14.0), 79.3 (14.3) and 73.6 (11.1) respectively, F(3,144) = 2.62, p = .05). Respondents on Beta Blockers also reported the highest satisfaction with HYP, followed by Carbonic Anhydrase Inhibitors, Prostagladins and Alpha Agonists (99.3 (3.2), 93.6 (8.1), 90.7 (17.8) and 88.2 (27.2) respectively, F(3,144) = 2.79, p = .04).
Of those on monotherapy, 11% (n = 16) reported administering their medications in the morning, 46% (n = 69) in the evening and 41% (n = 62) administered them in both the morning and evening. A comparison of respondents based on the time of day of medication administration affirmed focus group discussion and revealed that among monotherapeutic patients, the lowest CofU ratings occurred for those using medications both morning and evening, followed by evening administration, with the highest satisfaction among morning users (77.6 (SD15.9), 83.8 (13.4), 89.6 (12.5), F(3) = 7.31, p = .001).
This initial psychometric analysis of the TSS-IOP revealed the instrument possesses a sound conceptual structure (construct validity), all but one TSS-IOP scale possessed reliable assessment characteristics, and, on most dimensions the scales manifested the expected convergent validity using an established measure of TS-M. Some construct divergence was observed from the TSQM Side Effects construct, which was manifested by lower than expected correlations between the HYP and EI scales of the TSS-IOP and Side Effects scale of the TSQM. A supplemental analysis of TSS-IOP EI and HYP scales with TSQM Side Effect items revealed low item to scale correlations on TSQM items pertaining to the impact of side effects on the mental and physical health of patients. Neither the physical and mental impacts of OH/POAG treatments were emphasized as important aspects of topical OH treatments by a significant number of focus group participants and thus were not covered by content of the TSS-IOP side effect scales.
Of note, there was significant debate among researchers over the meaningfulness of including the two EFF items in the TSS-IOP since it is believed that patients cannot reliably detect or report on treatment-related changes in vision associated with reduction in intraocular pressure. It was eventually decided that these items should be included because a significant number of focus group members, particularly those in the earlier stages of disease, emphasized the importance of changes in their visual acuity as a result of treatment. Since the clinical meaningfulness of patient reported changes in visual problems associated with OH treatments has yet to be established or refuted, inclusion of the EFF scale can, at the very least, be considered an attempt to retain the face validity of the TSS-IOP to patients – who recognize this as the most important reason for taking their medication in the first place. The poor test-retest stability of the EFF scale may reflect patients' inability to reliably discern and report on this dimension of IOP treatment. Alternatively, such 'instability' may reflect real fluctuation or changes in clinical measurement of IOP. Supporting this possibility, a significant correlation was observed between patients' EFF satisfaction scores and clinician's ratings of IOP control, suggesting that patients derive at least some of the information with which to make satisfaction judgments directly from results reported during the clinical assessment process. Notably, a significant number of focus group members knew their IOP levels as communicated by their physicians at visits.
The concurrent criterion-related validity of the TSS-IOP two side effect scales and two convenience scales were demonstrated by a clear association with a fundamental set of criterion measures, namely patients' ratings of the frequency and severity of various problems associated with their use of the medication. These criterion-related validity results suggest that patients' satisfaction ratings on the IE and HYP scales were differentially based on somewhat distinct aspects of patient experience, as were the two convenience scales. In addition, the TSS-IOP provides further conceptual distinction to the TSQM Convenience construct, in that the new instrumentation successfully discriminates between patients' satisfaction with a treatment scheduling from satisfaction with the ease of use of delivery technology. Evidence for the 'known groups' validity of the EI, HYP, CofU and EofU scales was found since TSS-IOP scores on these scales differed significantly between classes of medication as well as by the frequency of daily medication administration. These differences were consistent with differences in patient satisfaction that are known to occur within clinical practice.
Compared to the Level 1 scale of the TSQM, the higher correlations of the TSS-IOP (Level 3) scales and patients' reports of specific treatment difficulties support the commonly assumed measurement benefits of using more specific TS-M scales as an means for the differentiation of pharmaceutical products; in this case, the dimensions of EI, HYP, CoU, and EoU associated with topical ophthalmic medications. The greater event/situational specificity of Level 3 scales allows for more focused statements to be made about the associations between problematic effects of treatment and patients' dissatisfaction.
Despite earlier concerns raised about the content validity of the side effects and convenience scales of the TSQM in this population, certain advantages were found to using these more generally worded items and scales of the TSQM. The Level 2 and Level 1 scales of the TSQM seemed to possess greater explanatory power with respect to clinicians' ratings of treatment side effects and difficulties their patients had with medication use. In addition, Level 1 and, to some degree, Level 2 TSQM scales were more strongly correlated with patients' ratings of their own resistance to regular medication use than the Level 3 scales of the TSS-IOP. There is a need for future clinical research to assess the degree to which dimensions and levels of TS-M assessment are able to predict actual medication-related behaviors such as compliance and persistence with medication regimens, as well as a need to more clearly specify how non-compliance affects broader health outcomes among persons with POAG. Such associations could have important ramifications for numerous stakeholders involved in health care delivery, including those in the pharmaceutical industry, regulatory agencies, health management organizations, and professionals providing clinical care.
A final observation was the scarcity of significant correlations between patients' frequency ratings of undesirable treatment experiences and clinicians' ratings of problems with side effects of medication use. This might suggest that the involved practitioners use relatively few specific indicators to assess these dimensions of treatment impact. Also contributing to the low correlations, specific treatment-related events often vary across individuals, thereby reducing the correlations observed between measures of specific events and practitioners' general clinical assessments across a heterogeneous sample of patients. Interestingly, patients' satisfaction ratings were more highly correlated with physicians' ratings of side effect than with patients' frequency ratings of undesirable aspects of treatment. This raises the possibility that patients' expression of satisfaction or dissatisfaction in the clinical setting may influence physicians' clinical impression on certain clinical assessment dimensions, this in turn suggests that treatment satisfaction could play a role in clinical decisions in regards to prescribing, adjusting, and/or switching medication regimens. Further research is required to examine the clinical usefulness of treatment satisfaction assessments and their role in the clinical decision-making process.
Results from this initial validation study of the TSS-IOP indicate that the measure is psychometrically sound and provides a means to assess important aspects of patients' experiences with the two dimensions of side effects and two dimensions of convenience associated with topical eye medications used in the control of OH. Results from the two side effect scales (Hyperemia and Eye Irritation) demonstrate their ability to differentiate between medications clinically known to differ on these dimensions. Results from the Effectiveness scale suggest that this scale reflects patient reported perception of effectiveness, likely a result of professional opinion about a medication's ability to manage OH.
Sponsorship for this project was provided by Pharmaceutical Researcher Network, LLC and Pfizer Incorporated. We would also like to thank Douglas G. Day, M.D. of Atlanta Research Company, LLC and Elizabeth D. Sharpe, M.D. of Charleston Research Company, LLC who participated as clinical investigators in the conduct of this research; as well as Anusha Sinha MPH, Quintiles Late Phase for her review and comments during the final preparation of this manuscript.
The copyright for the Treatment Satisfaction Survey for Intraocular Pressure (TSS-IOP) are held solely by Pfizer Incorporated. Permission to use the instrumentation and official translations should be sought through the Worldwide Outcomes Research division by contacting Sandra Ford at Sandra.L.Ford@Pfizer.com
- Katz JN: Patient preferences and health disparities. JAMA 2001,286(12):1506–1509. 10.1001/jama.286.12.1506PubMedView ArticleGoogle Scholar
- Owens DK: Spine update. Patient preferences and the development of practice guidelines. Spine 1998,23(9):1073–1079. 10.1097/00007632-199805010-00023PubMedView ArticleGoogle Scholar
- Eriksen LR: Patient satisfaction with nursing care: concept clarification. Journal of Nursing Measurement 1995,3(1):59–76.PubMedGoogle Scholar
- The Harmonization Meetings Coordination Committee: Report: A decisive step towards the recognition of patient reported outcomes in clinical trials. Proceedings of a Meeting with the FDA: Feb 16, 2001: Important Issues in Patient Reported Outcomes (PROs) Research. QoL Newsletter 2001, 26: 24–25.Google Scholar
- Morris LA, Burke LB: Outcomes research: An FDA perspective. Journal of Research in Pharmaceutical Economics 1996,8(1):209–213.View ArticleGoogle Scholar
- Burke LB: US regulation of pharmaceutical outcomes research. Value in Health 2001, 4: 5–7. 10.1046/j.1524-4733.2001.004001005.xPubMedView ArticleGoogle Scholar
- Gattellari M, Butow PN, Tattersall MH: Sharing decisions in cancer care. Social Science & Medicine 2001,52(12):1865–1878. 10.1016/S0277-9536(00)00303-8View ArticleGoogle Scholar
- Turnbull JE, Luther KM: Patient satisfaction report paves way to improved care. QRC Advisor 1996,13(1):1–7.PubMedGoogle Scholar
- Wright JG: Evaluating the outcome of treatment. Shouldn't We be asking patients if they are better? Journal of Clinical Epidemiology 2000,53(6):549–553. 10.1016/S0895-4356(99)00225-5PubMedView ArticleGoogle Scholar
- Brody D, Miller S, Lerman C, Smith D, Caputo G: Patient perception of involvement in medical care: Relationship to illness attitudes and outcomes. Journal of General Internal Medicine 1989, 4: 506–511.PubMedView ArticleGoogle Scholar
- Taylor TR: Understanding the choices that patients make. Journal of the American Board of Family Practice 2000,13(2):124–133.PubMedView ArticleGoogle Scholar
- Albrecht G, Hoogstraten J: Satisfaction as determination of compliance. Community Dentistry and Oral Epidemiology 1998, 26: 139–146.PubMedView ArticleGoogle Scholar
- McCracken LM, Klock A, Mingay KA: Assessment of satisfaction with treatment for chronic pain. Journal of Pain and Symptom Management 1997,14(5):292–299. 10.1016/S0885-3924(97)00225-XPubMedView ArticleGoogle Scholar
- Weaver M, Patrick DL, Markson LE, Martin D, Frederic I, Berger M: Issues in the measurement of satisfaction with treatment. American Journal of Managed Care 1997,3(4):579–594.PubMedGoogle Scholar
- Anderson RB, Hollenberg NK, Williams GH: Physical Symptoms Distress Index: a sensitive tool to evaluate the impact of pharmacological agents on quality of life. Archives of Internal Medicine 1999,159(7):693–700. 10.1001/archinte.159.7.693PubMedView ArticleGoogle Scholar
- Awad AG, Voruganti LN: Quality of life and new antipsychotics in schizophrenia. Are patients better off? International Journal of Social Psychiatry 1999,45(4):268–275.PubMedView ArticleGoogle Scholar
- Diamond R: Drugs and the quality of life: the patient's point of view. Journal of Clinical Psychiatry 1985,46(5 Pt 2):29–35.PubMedGoogle Scholar
- Unamed Reference: Adverse effects of the atypical antipsychotics. Collaborative Working Group on Clinical Trial Evaluations. Journal of Clinical Psychiatry 1998,59(Suppl 12):17–22.Google Scholar
- Bukstein DA: Incorporating quality of life data into managed care formulary decisions: a case study with salmeterol. American Journal of Managed Care 1997,3(11):1701–1706.PubMedGoogle Scholar
- Dunbar-Jacob J, Erlen JA, Schlenk EA, Ryan CM, Sereika SM, Doswell WM: Adherence in chronic disease. Annual Review of Nursing Research 2000, 18: 48–90.PubMedGoogle Scholar
- Strasser S, Aharony L, Greenberger D: The patient satisfaction process: moving toward a comprehensive model. Medical Care Review 1993,50(2):219–248.PubMedView ArticleGoogle Scholar
- Bredart A, Razavi D, Delvaux N, Goodman V, Farvacques C, Van Heer C: A comprehensive assessment of satisfaction with care for cancer patients. Supportive Care in Cancer 1998,6(6):518–523. 10.1007/s005200050207PubMedView ArticleGoogle Scholar
- Bredart A, Razavi D, Robertson C, Didier F, Scaffidi E, Fonzo D, Autier P, de Haes J: Assessment of quality of care in an oncology institute using information on patients' satisfaction. Oncology 2001,61(2):120–128. 10.1159/000055362PubMedView ArticleGoogle Scholar
- Hudak PL, Wright JG: The characteristics of patient satisfaction measures. Spine 2000,25(24):3167–3177. 10.1097/00007632-200012150-00012PubMedView ArticleGoogle Scholar
- Lubeck DP, Litwin MS, Henning JM, Mathias SD, Bloor L, Carroll PR: An instrument to measure patient satisfaction with healthcare in an observational database: results of a validation study using data from CaPSURE. American Journal of Managed Care 2000,6(1):70–76.PubMedGoogle Scholar
- Westbrook JI: Patient satisfaction: methodological issues and research findings. Australian Health Review 1993,16(1):75–88.PubMedGoogle Scholar
- Gelber RD, Gelman RS, Goldhirsch A: A quality-of-life-oriented endpoint for comparing therapies. Biometrics 1989,45(3):781–795.PubMedView ArticleGoogle Scholar
- Sinha A, Colman SS, Atkinson MJ, Hass SL, Rowland CR, Miller DP, Brod M: The Development of a Conceptual Model for Treatment Satisfaction. Social Science & Medicine (Under Review) Google Scholar
- Atkinson MJ, Sinha A, Hass Sl, Colman SS, Rowland CR: Validation of General Measure of Treatment Satisfaction, the Treatment Satisfaction Questionnaire for Medications (TSQM), using a National Panel Study of Chronic Disease. Disease Management and Health Outcomes, in press.Google Scholar
- Atkinson MJ, Caldwell L: The differential effects of mood on patients' ratings of life quality and satisfaction with their care: Preliminary findings. The Journal of Affective Disorders 1997, 44: 169–175. 10.1016/S0165-0327(97)00041-4PubMedView ArticleGoogle Scholar
- Atkinson MJ, Violato C: Neuroticism and coping with anger: The trans-situational consistency of coping responses. Personality and Individual Differences 1994, 17: 769–782. 10.1016/0191-8869(94)90046-9View ArticleGoogle Scholar
- Morris LA, Miller DW: The regulation of Patient-Reported Outcome claims: Need for a flexible standard. Value in Health 2002, 5: 372–381. 10.1046/j.1524-4733.2002.54073.xPubMedView ArticleGoogle Scholar
- Linder M, Chang TS, Scott IU, Hay D, Chambers K, Sibley LM, Weis E: Validity of the Visual Function Index (VF-14) in Patients With Retinal Disease. Archives of Ophthalmology 1999,117(12):1611–1616.PubMedView ArticleGoogle Scholar
- Mangione CM, Lee PP, Gutierrez PR, Spritzer K, Berry S, Hays RD: for the National Eye Institute Visual Function Questionnaire Field Test Investigators. Development of the 25-Item National Eye Institute Visual Function Questionnaire. Archives of Ophthalmology 2001,119(7):1050–1058.PubMedView ArticleGoogle Scholar
- Margolis MK, Coyne K, Kennedy-Martin T, Baker T, Schein O, Revicki DA: Vision-Specific Instruments for the Assessment of Health-Related Quality of Life and Visual Functioning: A Literature Review. Pharmacoeconomics 2002,20(12):791–812.PubMedView ArticleGoogle Scholar
- D'Ambrosio FA: Assessing disability in the patient with cataracts. Current Opinion in Ophthalmology 1999,10(1):42–45.PubMedView ArticleGoogle Scholar
- Crabtree HL, Hildreth AJ, O'Connell JE, Phelan PS, Allen D, Gray CS: Measuring visual symptoms in British cataract patients: the cataract symptom scale. British Journal of Ophthalmology 1999,83(5):519–523.PubMed CentralPubMedView ArticleGoogle Scholar
- Uiters E, van den Borne B, van der Horst F, Volker-Dieben HJM: Patient Satisfaction After Corneal Transplantation. Cornea 2001,20(7):687–694. 10.1097/00003226-200110000-00004PubMedView ArticleGoogle Scholar
- Odberg T, Jakobsen JE, Hultgren SJ, Halseide R: The impact of glaucoma on the quality of life of patients in Norway: I. Results from a self-administered questionnaire. Acta Ophthalmologica Scandinavica 2001,79(2):116–120. 10.1034/j.1600-0420.2001.079002116.xPubMedView ArticleGoogle Scholar
- Jampel HD, Schwartz A, Pollack I, Abrams D, Weiss H, Miller R: Glaucoma Patients' Assessment of Their Visual Function and Quality of Life. Journal of Glaucoma 2002,11(2):154–163.PubMedView ArticleGoogle Scholar
- Nordmann J, Touboul C, Auzanneau N, Berdeaux G: Vision Related Quality of Life of French Patients is Affected by Topical Glaucoma Treatment Side Effects. Value in Health 2002,5(6):557–558.View ArticleGoogle Scholar
- Waring George O III: One-year results of European Multicenter Study of Intrastromal Corneal Ring Segments: Part 2: Complications, Visual Symptoms and Patient Satisfaction. Evidence-Based Eye Care 2001,2(4):222–223.View ArticleGoogle Scholar
- Katz L, Jay MD: Twelve-Month Evaluation of Brimonidine-Purite Versus Brimonidine in Patients With Glaucoma or Ocular Hypertension. Journal of Glaucoma 2002,11(2):119–126.PubMedView ArticleGoogle Scholar
- Asch S, Goldzweig CL, Lee P: Do We Understand the Effects of 'Managed Care' in Ophthalmology?: A Review and Analysis. Archives of Ophthalmology 1997,115(4):531–536.PubMedView ArticleGoogle Scholar
- Barber BL, Strahlman ER, Laibovitz R, Guess HA, Reines SA: Validation of a questionnaire for comparing the tolerability of ophthalmic medications. Ophthalmology 1997,104(2):334–42. Erratum in: Ophthalmology 1997, 104(5):736, 890–3PubMedView ArticleGoogle Scholar
- Stewart WC: Clinical Practice of Glaucoma. Thorofare, N.J.SLACK, Inc 1990.Google Scholar
- Sheilds MB: Textbook of Glaucoma. 3 Edition Williams and Wilkins. Baltimore 1992.Google Scholar
- Stewart WC: New and current drug therapy for glaucoma. Ciba Clinical Symposium 1997.Google Scholar
- Stewart WC: Glaucoma Medications and their side effects. Ophthalmic Practice 1999, 17: 2.Google Scholar
- Camras CB, Alm A, Watson P, Stjernschantz J: Latanoprost, a prostaglandin analog, for glaucoma therapy. Efficacy and safety after 1 year of treatment in 198 patients. Latanoprost Study Groups. Ophthalmology 1996,103(11):1916–1924.PubMedView ArticleGoogle Scholar
- Netland PA, Landry T, Sullivan EK, Andrew R, Silver L, Weiner A, Mallick S, Dickerson J, Bergamini MV, Robertson SM, Davis AA: Travoprost Study Group. Travoprost compared with latanoprost and timolol in patients with open-angle glaucoma or ocular hypertension. American Journal of Ophthalmology 2001,132(4):472–484. 10.1016/S0002-9394(01)01177-1PubMedView ArticleGoogle Scholar
- Noecker RS, Dirks MS, Choplin NT, Bernstein P, Batoosingh AL, Whitcup SM, Bimatoprost/Latanoprost Study Group: A six-month randomized clinical trial comparing the intraocular pressure-lowering efficacy of bimatoprost and latanoprost in patients with ocular hypertension or glaucoma. American Journal of Ophthalmology 2003,135(1):55–63. 10.1016/S0002-9394(02)01827-5PubMedView ArticleGoogle Scholar
- Stewart WC, Castelli WP: Systemic side effects of topical beta-adrenergic blockers. Clinical Cardiology 1996, 19: 691–697.PubMedView ArticleGoogle Scholar
- Stewart WC, Garrison PM: β-blocker-induced complications and the glaucoma patient: newer treatments to help reduce systemic side effects. Archives of Internal Medicine 1998, 158: 221–226. 10.1001/archinte.158.3.221PubMedView ArticleGoogle Scholar
- Konstas AGP, Papapanos P, Tersis I, Houliara D, Stewart WC: Twenty-four hour diurnal curve comparison of commercially available latanoprost 0.005% versus timolol/dorzolamide fixed combination. Ophthalmology 2003, in press.Google Scholar
- Stewart WC, Stewart JA, Leech JN: Acute and chronic ocular symptoms of dorzolamide 2% compared with placebo. Journal of Glaucoma 2003,12(2):151–155.PubMedView ArticleGoogle Scholar
- Stewart WC, Sharpe ED, Harbin TS Jr, Pastor SA, Day DG, Holmes KT, Stewart JA: Brimonidine 0.2% versus dorzolamide 2% each given three times daily to reduce intraocular pressure. American Journal of Ophthalmology 2000,129(6):723–727. 10.1016/S0002-9394(00)00381-0PubMedView ArticleGoogle Scholar
- LeBlanc RP: Twelve-month results of an ongoing randomized trial comparing brimonidine tartrate 0.2% and timolol 0.5% given twice daily in patients with glaucoma or ocular hypertension. Brimonidine Study Group 2. Ophthalmology 1998,105(10):1960–1967. 10.1016/S0161-6420(98)91048-XPubMedView ArticleGoogle Scholar
- Goldman AE: The Group Depth Interview. Principles and PracticePrentice-Hall, Inc. A division of Simon & Schuster. Englewood Cliffs, New Jersey 1987.Google Scholar
- Tabachnick BG, Fidell LS: Using Multivariate Statistics 4 Edition Boston: Allyn and Bacon 2001.Google Scholar
- Hays RD, Anderson R, Revicki D: Psychometric considerations in evaluating health-related quality of life measures. Quality of Life Research 1993, 2: 441–449.PubMedView ArticleGoogle Scholar
- Ware J, Hays RD: Methods for measuring patient satisfaction with specific medical encounters. Medical Care 1988, 26: 393–402.PubMedView ArticleGoogle Scholar
- Juniper EF: Intrepreting of Quality of Life data. Quality of Life Newsletter 1999.Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.