Validation of a general measure of treatment satisfaction, the Treatment Satisfaction Questionnaire for Medication (TSQM), using a national panel study of chronic disease
Health and Quality of Life Outcomes volume 2, Article number: 12 (2004)
The objective of this study was to develop and psychometrically evaluate a general measure of patients' satisfaction with medication, the Treatment Satisfaction Questionnaire for Medication (TSQM).
The content and format of 55 initial questions were based on a formal conceptual framework, an extensive literature review, and the input from three patient focus groups. Patient interviews were used to select the most relevant questions for further evaluation (n = 31). The psychometric performance of items and resulting TSQM scales were examined using eight diverse patient groups (arthritis, asthma, major depression, type I diabetes, high cholesterol, hypertension, migraine, and psoriasis) recruited from a national longitudinal panel study of chronic illness (n = 567). Participants were then randomized to complete the test items using one of two alternate scaling methods (Visual Analogue vs. Likert-type).
A factor analysis (principal component extraction with varimax rotation) of specific items revealed three factors (Eigenvalues > 1.7) explaining 75.6% of the total variance; namely Side effects (4 items, 28.4%, Cronbach's Alpha = .87), Effectiveness (3 items, 24.1%, Cronbach's Alpha = .85), and Convenience (3 items, 23.1%, Cronbach's Alpha = .87). A second factor analysis of more generally worded items yielded a Global Satisfaction scale (3 items, Eigenvalue = 2.3, 79.1%, Cronbach's Alpha = .85). The final four scales possessed good psychometric properties, with the Likert-type scaling method performing better than the VAS approach. Significant differences were found on the TSQM by the route of medication administration (oral, injectable, topical, inhalable), level of illness severity, and length of time on medication. Regression analyses using the TSQM scales accounted for 40–60% of variation in patients' ratings of their likelihood to persist with their current medication.
The TSQM is a psychometrically sound and valid measure of the major dimensions of patients' satisfaction with medication. Preliminary evidence suggests that the TSQM may also be a good predictor of patients' medication adherence across different types of medication and patient populations.
This article reports on the development and testing of the Treatment Satisfaction Questionnaire for Medication (TSQM) and builds on the conceptual framework of Treatment Satisfaction (TS) which is featured in a companion article entitled: "The Development of a Conceptual Framework for Treatment Satisfaction." (a manuscript currently under review). Within this paper, we will begin by reviewing current literature that highlights the clinical importance of TS, as well as some of the measurement challenges facing researchers in this field. This is followed by description of a two-stage TSQM item generation process that included both patient focus groups and patient interviews. The results section presents the analyses used for TSQM scale identification and psychometric testing. These results were based on a large sample of patients enrolled in the NFO World Group's Chronic Ailment Panel (NFO-CAP). Finally, in the discussion section we focus on the psychometric characteristics of the TSQM, the comparative performance of two different methods for item scaling, and the potential uses of TS assessment in clinical settings.
Those advocating collaborative (patient-caregiver) models of health care delivery suggest that patient reported outcomes (PROs), and particularly measures of patient preference, ought to play a central role in the planning and delivery of medical care [1–3]. A subclass of PRO measures, patient satisfaction, has been used extensively to include patients' perceptions of care when evaluating the effectiveness of medical treatments and systems of healthcare delivery [4–7]. Patient satisfaction has been shown to affect patients' health-related decisions and treatment-related behaviors, which in turn, substantially impact the success of treatment outcomes [8, 9]. For example, patients' satisfaction with the services they receive has been shown to predict treatment success, medical compliance, follow-through with treatment plans, and appropriate use of services [10–12]. In a similar way, patients' satisfaction with their medication predicts continuance of pharmaceutical treatment, correct medication use and compliance with medication regimens [13–16].
A variety of models have been used to describe how patients' satisfaction with medical treatment impacts their health-related decision-making [17–21]. Common to most models, it is proposed that patients' decisions to continue, alter, or discontinue medical treatments are influenced by a variety of characteristics, including; the desire to participate in treatment related decision-making [9, 22] evaluation of actual and preferred health state [23–25] prior experiences with particular treatment choices  and real or anticipated beliefs regarding the effectiveness or harms of treatment [23, 25, 27]. The adverse decisional consequences of low TS on medication compliance is of particular concern to those treating patients with chronic disease conditions . It has been estimated that up to one half of patients with chronic illness end up making medication-related decisions without seeking medical advice, becoming 'non-adherent' to such an extent that they compromise the effectiveness of treatment and strain broader systems of care . In contrast, more acutely ill patients who perceive an immediate threat to their physical well-being may be more willing to tolerate short-term aggressive treatment regimens in hopes of restoring their former health.
In addition to its impact on treatment outcomes within the clinical setting, TS results have been incorporated into decisions regarding pharmaceutical formularies and cost-effectiveness evaluations of managed care organizations . Some healthcare economists have suggested that in the near future planners within healthcare delivery systems and pharmaceutical industries will view assessment of treatment satisfaction as essential to their continued viability [30, 31]. The interest of multiple stakeholder groups in TS has lead to important conceptual advances in this field and a proliferation of satisfaction measures [32, 33]. Such measures can be roughly divided into those addressing patients' satisfaction with discrete aspects of medical treatments and those focusing on more systemic aspects of programmatic care [12, 34–38]. Similarly, patients' satisfaction with their medication (TS-M) can be thought of as a very specific sub-dimension (or observational context) of TS which is a broader, super-ordinate class that encompasses patients' satisfaction with both medicinal and non-medicinal aspects of treatment. In turn, TS is a subset of patient satisfaction (PS) that broadly covers all aspects of medical treatments, interpersonal aspects of clinical care, and processes of treatment.
Unfortunately, across most illness conditions TS and PS research has been consistently hampered by serious measurement problems, including; distributional skew, ceiling effects, and missing response data [39–47]. Since ceiling effects and data skew reduce the power of statistical methods to detect meaningful group differences, numerous attempts have been made to resolve these problems including; the use of very extreme anchors, the use of non-neutral midpoints, and the expansion of the number of scale response options [48–50]. Nevertheless, systematic comparisons of these approaches have been sporadic and there remains a longstanding debate over the relative merits of such methods. Results from one of the few empirically-based comparisons by Ware and Hays , suggest that Likert-type scales might perform slightly better than Visual Analogue Scale (VAS) methods. Advocates of VAS methods contest this assertion and refer to the ease of use, brevity and condensed layout of VAS rating scales .
None of these scaling solutions, however, have been shown to wholly resolve the distributional problems associated with the cross-sectional measurement of TS and PS. Yet, there remains a persistent and largely unquestioned assumption that normal distributions of satisfaction scores can be obtained if only the construct were measured correctly. As a result, there are quite a few examples in the literature where patients' satisfaction ratings are suspect of social desirability or acquiescence responses bias [49, 53]. There is a risk, however, of over generalizing an assumed respondent bias to all types of TS measures. For example, TS-M ratings may be less susceptible to social desirability bias compared to PS ratings of clinical care, as the latter is more likely to be influenced by patients' relationships with primary caregivers . Moreover, if respondents tend to acquiesce and provide satisfied responses, it is more likely to occur when answering questions about less important or irrelevant aspects of care. Scales composed of large numbers of detailed and treatment-specific content typically contain a large number of items that are irrelevant to the experiences of a specific patient and thus are more susceptible to receiving a satisfied rating from respondents. In contrast, more generally worded questions are composed of items that allow respondents to interpret their meaning based on important aspects of their own experiences. Respondents are less likely to provide an acquiescent response to questions that are considered personally relevant.
An alternate mechanism may help explain the skewed distribution of TS-M ratings. Over time, clinical-selection may affect the composition of patient samples (sample drift) and result in a skewed cross-sectional distribution of satisfaction scores. It is hypothesized that such selection occurs over time as patients for whom a medication is working continue to take the medication, while those for whom it is not working, or for whom unpleasant side effects occur, seek alternative treatments. In general, one might expect sample drift to be greatest during the initiation of a new course of medication and, conversely, least when either a satisfactory medication has been found or when treatment alternatives have been exhausted. In the latter case, access to fewer treatment alternatives may be more likely among those with severe and persistent disease. Currently, it is unknown to what extent these various influences shape the observed distribution of satisfaction results in cross-sectional patient samples.
Rationale for current study
Although numerous disease-specific measures of patients' TS and TS-M have been reported in the literature [55–60] less attention has been paid to developing a more general measure of TS-M; one that would permit comparisons across medication types and patient conditions. Also, as addressed earlier, there is an unresolved controversy over the optimal method for scaling satisfaction items. Therefore, two central objectives have been identified for the current study:
To develop a conceptually and psychometrically sound general measure of TS-M, capable of assessing patients' satisfaction with various medications designed to treat, control, or prevent a wide variety of medical conditions; and
To examine the performance of such an instrument with respect to scaling alternatives so as to maximize the precision and validity of the final measure.
Methods & study design
Background item generation
The design of test items for the new instrument was based on a generalized conceptual framework of treatment satisfaction. The initial formation of the conceptual framework was grounded in a thorough review of the scientific literature that dealt with the core TS-M domains across a diversity of therapeutic areas. Subsequently, the draft conceptual framework was more fully elaborated using qualitative data from patient focus group interviews. Focus group participants (n = 30) were recruited to take part in one of three, two-hour sessions conducted in Los Angeles, Chicago, and Boston. Participants consisted of patients with at least one the following illness conditions: asthma, arthritis, cancer, cardiovascular disease, depression/anxiety, diabetes, infectious disease, migraine, and psoriasis. The focus group discussions were guided by a trained interviewer who, in accordance with established qualitative research procedures , focused on aspects of the treatment satisfaction framework, outlined in a discussion guide [62, 63].
Over the course of the three focus group sessions, the discussion guide and conceptual framework on which it was based, were evolved through integration of the patients' perspectives from each preceding group. In this way the guide was iteratively refined to reflect the participants' perspectives. Once the framework was fully elaborated, the domains of TS-M included; (1) side effects, (2) symptom relief, (3) convenience, (4) effectiveness, (5) impact on daily life, and (6) tolerability/acceptability. Fifty-five draft TS-M items were designed to measure aspects of the conceptual framework and its domains. Further details of the qualitative methods and results can be found in a sister manuscript describing the development of the TS-M conceptual framework.
Initial item reduction and scaling (patient interviews)
In-depth patient interviews were conducted in order to reduce the 55-item pool by approximately half, leaving only those items that were most relevant across respondents. The interview sample consisted of 17 patients taking medication for the same conditions represented by focus group participants. During the 45–60 minute interviews, patients rated the importance or relevance of each item to their satisfaction with their medication using a 5-point scale (where 1 was most important and 5 was not important at all). These ratings were used to select items that were most relevant across all illness groups. When items were ranked equally, the conceptual framework was used to help assure adequate representation of theoretical dimensions in the framework. The final test item pool contained 31 items.
Two scaling methods, visual analogue scaling (VAS) and Likert-type scaling, were considered for use in the final instrument. In order to compare the relative performance of the two methods, two sets of TSQM items were created that differed only in terms of the rating scale used. For both sets, TSQM items were scaled using either a 5-point or 7-point scale. Five-point scales were used for unidimensional continua (e.g. extremely to not at all), while 7-point scales were used for bipolar continua (e.g., extremely positive to extremely negative). This provided roughly equivalent rating intervals across items. Non-neutral midpoints were used for 7-point scales, resulting in a greater range of positive response options than negative options for these items. This approach has been suggested elsewhere as a way of helping to address scale resolution problems associated with the upper end of skewed distributions .
Psychometric testing and refinement (national panel survey)
The remaining sections of this article describe the reliability and validity characteristics of the test items and scaling methods using a large sample of patients participating in the NFO – World Group's CAP. The NFO CAP consists of over 250,000 people suffering from one or more of over 60 chronic ailments and conditions. The panel is a representative sampling of one out of every 191 households in America, prescreened for more than 50 pieces of demographic information so as to represent the demographic characteristics of the population of the citizenry of the USA (for more information see: http://www.nfow.com).
Patients were recruited for this portion of the study that had the same illness conditions as represented within the focus groups and interviews (anxiety/depression, arthritis, asthma, cancer, cardiovascular disease, diabetes, infectious disease, migraine, and psoriasis). They were also required to be at least 18 years of age, able to read English, and able to complete a questionnaire on-line. The broad sampling provided a range of treatment intents (i.e., curative, preventive and symptom management) as well as routes of medication administration (i.e., injection, oral, topical, inhalation).
Invitations were sent electronically to 10,000 NFO panel members across the United States. Participants that accessed the study site via the Internet were assessed for eligibility, equally stratified by illness condition and gender, and then randomly assigned into 1 of the 2 scale conditions (VAS or Likert-type scaling methods). Since many participants had multiple illness conditions, and were on several medications at the same time, respondents were helped to clearly identify which particular medication and illness condition were the subject of study. A total of 6,713 individuals responded (a response rate of 67.2%), from this pool individuals were sequentially offered the opportunity to participate based on the availability of participant slots in each stratum. Five hundred and eighty seven individuals passed screening and were enrolled, of these, 567 provided complete data sets, with 287 respondents in the VAS arm and 280 in the Likert-type arm.
In addition to completing the test items, respondents were asked to provide information about the length of time they had been on their medication, the method of its administration, the frequency and severity of any side effects they might have experienced, and the likelihood that they would continue to take the medication given its current level of effectiveness and side effects. They were also asked about perceptions of their current state of health, the severity of their illness, and some basic socio-demographic information (e.g., age, gender, educational level, and ethnic background).
Respondents' ages ranged from 18 to 88 years, with a mean of 50.5 (SD 13.0), which did not differ significantly from the total NFO representative sampling (mean 48.8, SD 13.4). Thirty nine percent of respondents indicated that they had received four or more years of college education, and 60.1% stated that they were employed full-time. The educational proxy for socioeconomic status was roughly equivalent for the original NFO recruitment sample (31%). Table 1 presents the number of NFO respondents in each of the illness groups, the length of time on the current medication, the route of its administration, their rating of the severity of illness, and their rating of current health status. Approximately 70% of the sample reported on an oral medication, while the remaining 30% reported on medications that were used in a topical, inhalable, or injectable form. As expected given the randomization procedure, no significant differences were found between the scaling condition groups (Likert vs. VAS) by gender, age, educational level, employment status, ethnicity, mode of medication administration or length of time on medication.
Construct dimensionality of the TSQM
Multi-step exploratory factor analyses (EFA) were employed to investigate the construct validity of the TSQM. Two separate EFAs were conducted, one using global TS-M items, and another using items that referred to more specific domains of medication experiences (e.g., Effectiveness, Side effects, Convenience) . Such multi-step EFA procedures have been recommended by Gorsuch [65, 66] and Russell  as a way to evaluate the structure and dimensionality of measures that include both global and specific item content. The global TS-M items are super ordinate conceptually and psychologically, and thus may be redundant and confounding measures of the construct. As the goal is to identify the underlying construct or factor, redundant and confounding variance should be minimized. The confounding of subordinate construct dimensionality by global items shows up as unwanted covariance, manifest as cross-loading of global items across the more specific factors. As a result, separate analyses of global and specific items provide scales with greater cohesion and homogeneity than when such a process is not followed.
A first EFA employed principal components extraction and a subsequent orthogonal varimax rotation of the more specific TS-M items. This resulted in a three-factor solution that accounted for 68.3% of the total variance. Items with the greatest loadings on these factors were then selected for inclusion in the final TSQM scales. The three factors in the final solution converged in five iterations, possessed Eigenvalues greater than 1.7 and explained 75.6% of the overall variance (see Table 2). These were labeled according to their item content: Side effects (SIDEF: 4 items, 28.4% of the variance), Effectiveness (EFFECT: 3 items, 24.1%), and Convenience (CONV: 3 items, 23.1%).
A second EFA (principal component extraction and varimax rotation) was conducted using responses to five global satisfaction items, comprising a conceptually distinct second order factor of TS-M. Three items with the highest loadings were selected for final inclusion. The final solution was unidimensional (Eigenvalue = 2.3), with factor loadings between .86 and .90, which explained 79.1% of the total variance. The three items asked about were; 1) the confidence individuals had in the benefits of the medication, 2) their comparative evaluation of the benefits versus drawbacks of the medication, and 3) their overall satisfaction with the medication. The final instrument (see Table 3) consisted of 13 items that made up three specific scales (EFFECT, SIDEF, CONV) and one global satisfaction scale (GLOBAL). Scale scores were transformed into scores ranging from 0 to 100. The inter-correlations between scales shown in Table 4, suggest that the strongest specific-scale correlate of GLOBAL was EFFECT. It would be surprising if this were not the case, since medication is typically taken for its curative effects. SIDEF and CONV ratings were about equally correlated with results on the GLOBAL satisfaction scale.
Scale characteristics and scaling comparisons
The performance of the two scaling methods was evaluated based on the strength of the factorial solution and the estimates of internal consistency of resulting TSQM scales. The factorial dimensionality and item loading order were the same using either scaling dataset. However, the strength of the factorial solution and Cronbach's Alpha coefficients were greater when using the Likert-type results compared to the VAS results. As expected, the score distributions resulting from both scaling methods were characterized by ceiling effects and skew that plague this class of PRO instrumentation (Table 5) [11, 23, 36, 40]. Of note, the VAS scaling method had more problems with ceiling effects than the Likert-type scaling method, particularly on items making up GLOBAL. The Likert-type method tended to have higher skew statistics on two scales due to a more pronounced taper on the lower (dissatisfied) end of the scales.
Possible reasons for the distributional skew of SIDEF were explored further. The removal of respondents who reported rare or very infrequent side effects from the sample resulted in an essentially normal distribution (skew = -.13, <4% of scores at ceiling value). This suggested that respondents appropriately provided high satisfaction ratings in situations where the side effects of the medication were very infrequent. Thus, the skew and ceiling effects associated with this particular scale do not seem to be simply due to problems associated with an uninterpretable respondent bias.
Medication and illness characteristics associated with treatment satisfaction
No significant differences in mean TSQM scale scores were observed by gender or education level. Significant differences in satisfaction levels were found on all TSQM scales by route of medication administration (Figure 1). As documented elsewhere, individuals using injectables reported low satisfaction with convenience of use . Also, despite low ratings on SIDEF and CONV by the injectable group, the GLOBAL and EFFECT ratings were highest – presumably due to the influence of insulin-dependence in our injectable sample. Also, consistent with other research, high GLOBAL and CONV ratings were associated with orally administered medications [68–70] although satisfaction with the effectiveness of oral medications was a bit lower than with the injectables. The topicals were associated with the highest levels of satisfaction with SIDEF and CONV, but the lowest levels of on the GLOBAL and EFFECT scales – likely due to their safety and ease of use, but relative ineffectiveness at treating the condition, which in this case was psoriasis . Taken together, these observations provide some evidence for the criterion-related validity of the TSQM scales.
Consistent with earlier discussion of clinical drift, individuals on medication for less than two months reported significantly lower satisfaction with both the effectiveness and side effects of their medication than those on medications for a longer period (68.3, sd 18.8 vs. 74.4, sd 17.2, F(df) = 8.57(1), p = .004; 84.6, sd 16.4 vs. 88.4, sd 14.2; F(df) = 4.76(1), p = .03 respectively). This observation provides preliminary evidence that individuals who continue to experience either low effectiveness or troublesome side effects may be more likely to switch or discontinue their medication, and thus contribute to the changing distributional characteristics of cross-sectional satisfaction data over time. Illness conditions also appeared to influence satisfaction levels. Higher illness severity ratings were associated with lower levels of satisfaction on all TSQM scales, particularly SIDEF. Similarly, poorer appraisal of general health was associated with lower satisfaction scores on all scales, particularly EFFECT (Table 6). These findings are likely due to the inability of the current medication to cure or effectively manage the condition without intolerable side effects. The availability of, and access to, alternative treatment options may also have prevented 'clinical drift' and, as a result, influenced the distribution of patients' satisfaction scores.
Determinants of overall satisfaction and medication persistence
A series of regression analyses were used to examine the specific aspects of TS-M that predicted GLOBAL TSQM satisfaction ratings. Table 7 presents the standardized beta coefficients and percent variance explained (Adjusted R2) within these statistical models. The three specific TSQM scales were all entered as independent variables and GLOBAL as the dependent variable for each different illness group. Across all groups, between 40–70% of the variance in GLOBAL ratings were explained by satisfaction ratings on the three specific TSQM scales. Moreover, EFFECT accounted for the most variance in GLOBAL, while the relative influence of the two other specific scales varied across illness groups.
In order to explore the effects of TS-M on patients' choice to either continue or discontinue using a medication, a composite variable was derived – "Likelihood to Discontinue" medication. This variable was computed by taking the respondents' ratings of their 'likelihood to continue on the current medication given its current level of effectiveness' and subtracting it from ratings of their 'likelihood to request a change in medication due to current side effects. The four TSQM scale scores were then entered as independent variables into a stepwise multiple regression analysis. The final model contained 3 of the 4 satisfaction scales; GLOBAL, SIDEF and EFFECT (Adjusted R2 = .50, F(3,563) = 186.2, p < .0001). GLOBAL accounted for more variance than did the more specific TSQM scales and was the most significant independent variable accounting for medication non-persistence (standardized Beta coefficient = -.35, p < .0001). This scale was followed by SIDEF (Beta = -.22, p < .0001) and EFFECT (Beta = -.28, p < .0001). On its own, CONV was not found to be significantly correlated to respondents' ratings of Likelihood to Discontinue medication.
Results in Table 8 hint at the strength of the association between patients' TS-M and their expectations regarding future persistence with their medication regimen. Across six of the eight illness groups between 50 and 60% of the variation patients' expected persistence with medication was predicted by TSQM scores.
The response by two-thirds of the NFO panel invitees was much greater than that usually found for broad and less targeted Internet-based health surveys, which typically range between 20–30% [72–75]. Nevertheless, our samples should not be considered representative of the general US population, and only, at best, an approximate sampling of membership within each of the illness panels. Fortunately, concerns about sampling bias are rarely raised as a serious criticism in this type of psychometric study, since the main objective is to empirically examine the content and measurement dimensions that underpin a theoretical construct. So long as the constructs of measure remain fairly consistent across the illness populations, it is unlikely that a moderate degree of sampling and selection bias alters the item-item covariance structure used to identify the dimensionality of such constructs. Such bias becomes more problematic where determination and comparison of score levels is of interest, as is the case when estimating population parameters or testing group score differences.
A more serious threat to demonstration of the construct validity of the TSQM, however, is the interdependency between illness conditions, illness severity, and medication type. Such interdependencies preclude a clear delineation of their independent effects on TSQM results. This concern became most apparent during our examination of the effects of the route of medication administration on TSQM results. It was not possible to clearly separate the effects of medication route from illness group membership, a fact that we acknowledged when describing these results.
Given the heterogeneity of the sample, the reliability and construct validity characteristics of the TSQM scales were surprisingly strong. The internal consistency estimates of the scales were high given the small number of items and their broad content coverage. The patterns of item loadings within the factor analyses provide clear evidence for the orthogonal dimensionality of the three specific TSQM scales and, by inference, discrete sub-dimensionality of the TS-M construct. In turn, when predicting GLOBAL ratings, the regression weights associated with specific TSQM scales differed across illness groups, reflecting the different importance of TS-M dimensions to overall satisfaction across illness/medication types. This finding provides further evidence that GLOBAL cannot be simplified to a generalizable summation of specific scales across all illness groups since the relative weighting of specific aspects of TS-M on GLOBAL scores appears to be influenced by both medication-specific and disease-specific experience across patient groups. Despite its non-uniform derivation, the importance of GLOBAL was manifest through its correlation with patients' perception of treatment persistence (likelihood to continue/discontinue medication), which was stronger than any specific dimension of TS-M, even the effectiveness dimension.
The results of scaling comparisons (VAS versus Likert-type method) support earlier work by Ware and Hays  that reported better predictive performance of a Likert-type scaling compared to VAS scaling of TS items. Despite our best efforts to assure both metric and sample equivalence between the two scaling conditions, better distributional characteristics and lower measurement error was associated with the Likert approach, particularly on GLOBAL. As a result, this scaling method was associated with a greater proportion of meaningful variance across a variety of parametric analyses. Moreover, a commonly cited advantage of VAS type scales is ease of completion, yet when asked, the patients in the two scaling conditions did not differ on the reported ease of questionnaire completion. As a result, the Likert-type scaling method was selected to scale the final version of the TSQM.
Atypical cross-sectional score distributions
As expected, our scaling efforts did not effectively correct the distributional problems. Indeed, some of the most consistent findings in the PS literature are the persistent distributional skew and ceiling effects associated with this type of data. One of major causes of such skew in the current study was item relevance. This was clearly demonstrated using SIDEF items, where satisfaction ratings were consistently high when problems with side effects were rare or non-existent. Approximately 50% of the sample reported rarely experiencing side effects and, when this was taken into account, the distribution of SIDEF satisfaction scores became essentially normal. A similar pattern of results might have occurred for CONV, however, information on the frequency of inconvenient medication-related events was not collected.
In addition to item relevance, we hypothesized that a portion of the skew and ceiling effects might be due to a continuous self- and clinical-selection process, leading to sample drift as over time, individuals who are less satisfied with either the effectiveness or side effects of their medication seek alternatives. Supporting this idea, respondents' length of time on medication was positively associated with mean differences on both EFFECT and SIDEF. Those on medications for more than two months expressed higher levels of satisfaction on the two dimensions of TS-M. Moreover, the distributions of scores had greater skew towards the more satisfied end of the continuum.
Acting against such a trend may be a lack of effective treatment alternatives for those with more serious conditions. Respondents who rated themselves as either in worse health, or as more ill, were less satisfied across all TSQM scales. One might hypothesize that patients with more severe conditions may have been willing to tolerate higher side effects in order to affect a cure. However, this does not easily explain the lower EFFECT scores also reported by persons with poor health ratings. It is most likely that less satisfaction with the effectiveness of treatment is associated with treatment resistant illness conditions and/or fewer effective treatment alternatives.
Our results suggest that non-normal distribution of cross-sectional satisfaction scores should not be quickly dismissed as an artifact of systematic respondent bias, but rather understood as the result of a complex interaction between clinical-selection, the availability and effectiveness of treatment alternatives, and respondents' health status over time. Unfortunately, the cross-sectional design of our current study does not permit a meaningful characterization of the cumulative effects of such characteristics on TSQM score distributions over time, and is only suggestive of a need for longitudinal research to more fully address this phenomenon.
Treatment satisfaction and the cost of care
From a disease-management perspective, it is likely that assessment of TS-M will become increasingly important in the future; in part due to the increasing prevalence of chronic disease in our aging population and the increasing number of patients being asked to persist with long courses of pharmaceutical treatments. With the exception of certain areas of medicine where patient compliance is particularly problematic, relatively little is known about the influence of patients' satisfaction on medication adherence behavior. It is particularly pressing, given rising costs of health care, to identified and address the causes of non-adherence; since such behavior increases the use of medical resources to manage treatment failure. While the health care costs resulting from non-compliance are fairly well characterized for many conditions, such costing studies less frequently include patient preference data. Longitudinal economic research is required to explore these important causal relationships.
The pharmaceutical industry may also be an interested stakeholder. Evidence of the growing importance of patients' satisfaction can be found at most levels of our health service delivery systems. For example, the Health and Human Services' Agency for Healthcare Research and Quality and the American Hospitals' Association has recently begun to require that patient satisfaction data be published by hospitals to aid patients in their selection of hospital services, and possibly informing financial reimbursement schedules . Such developments may foreshadow the role of TS-M within the pharmaceutical sector, in that TS-M outcomes directly influence the degree of market success enjoyed by new therapeutic technologies and medications. For example, TS-M assessment may play an expanded role in formulary access decisions.
Relevance to the delivery of clinical care
Patients' dissatisfaction with treatment may act as an early warning of threats to the clinical effectiveness and efficiency of medical care. Patients who perceive their medication to be ineffective, laden with side effects, or very inconvenient to use are less likely to either fill prescriptions or take their medication as prescribed. This in turn can impact the effectiveness of treatment and may result in service inefficiencies associated with treatment failure. TSQM provides a unique opportunity to compare various medications used to treat a particular illness on the primary dimensions of treatment satisfaction. Routine assessment of patients' level of TS-M provides a way for clinicians to screen individuals whose current medication experiences may increase the risk of poor medication adherence. If collected from many patients, such information could foster a deeper consideration of patients' perspectives when evaluating the merits and drawbacks of various treatment alternatives.
As partial compensation for the potential drain that individualized assessments can place on already burdened clinical staff, the dimensionality of TSQM offers a set of convenient reference points to quickly focus patient-caregiver discussion on potential problem areas, thereby facilitating a corrective engagement process. For example, a better appreciation of patients' experiences with a particular medication's side effects or inconveniences may lead physicians to optimize dosing or review administration instructions with their patients. Alternately, if patients' dissatisfaction with the effectiveness of their medication does not seem to be clinically warranted, some patient education may be in order. This later point is particularly important when the therapeutic actions of a medication are not physically or mentally discernable by most patients (e.g., preventive treatments of hyperlipidemia or hypertension). In general, clinicians who show an active interest in patients' experiences are more likely to be seen as possessing good clinical skills and a genuine concern for patients' well-being .
Results from this initial validation study suggest that the TSQM is a psychometrically robust instrument, tapping the most important dimensions of patients' experiences with their medication. If carefully applied, the general nature of the instrument provides a way of evaluating and comparing patients' satisfaction with various types and forms of medications. Moreover, the TSQM may contribute to our understanding of patients' medication-related decisions and behaviors, thus proving TS-M to be both an important determinant and outcome of effective clinical care.
Golin CE, DiMatteo MR, Gelberg L: The role of patient participation in the doctor visit. Implications for adherence to diabetes care. Diabetes Care 1996, 19: 1153–1164.
Katz JN: Patient preferences and health disparities. JAMA 2001, 286: 1506–1509. 10.1001/jama.286.12.1506
Owens DK: Spine update. Patient preferences and the development of practice guidelines. Spine 1998, 23: 1073–1079. 10.1097/00007632-199805010-00023
Eriksen LR: Patient satisfaction with nursing care: concept clarification. Journal of Nursing Measurement 1995, 3: 59–76.
Gattellari M, Butow PN, Tattersall MH: Sharing decisions in cancer care. Soc Sci Med 2001, 52: 1865–1878. 10.1016/S0277-9536(00)00303-8
Turnbull JE, Luther KM: Patient satisfaction report paves way to improved care. QRC Advisor 1996, 13: 1–7.
Wright JG: Evaluating the outcome of treatment. Shouldn't We be asking patients if they are better? J Clin Epidemiol 2000, 53: 549–553. 10.1016/S0895-4356(99)00225-5
Brody D, Miller S, Lerman C, Smith D, Caputo G: Patient perception of involvement in medical care: Relationship to illness attitudes and outcomes. Journal of General Internal Medicine 1989, 4: 506–511.
Taylor TR: Understanding the choices that patients make. Journal of the American Board of Family Practice 2000, 13: 124–133.
Albrecht G, Hoogstraten J: Satisfaction as a determinant of compliance. Community Dent Oral Epidemiol 1998, 26: 139–146.
McCracken LM, Klock A, Mingay DJ, Asbury JK, Sinclair DM: Assessment of satisfaction with treatment for chronic pain. Journal of Pain & Symptom Management 1997, 14: 292–299. 10.1016/S0885-3924(97)00225-X
Weaver M, Patrick DL, Markson LE, Martin D, Frederic I, Berger M: Issues in the measurement of satisfaction with treatment. Am J Manag Care 1997, 3: 579–594.
Anderson RB, Hollenberg NK, Williams GH: Physical Symptoms Distress Index: a sensitive tool to evaluate the impact of pharmacological agents on quality of life. Archives of Internal Medicine 1999, 159: 693–700. 10.1001/archinte.159.7.693
Awad AG, Voruganti LN: Quality of life and new antipsychotics in schizophrenia. Are patients better off? Int J Soc Psychiatry 1999, 45: 268–275.
Diamond R: Drugs and the quality of life: the patient's point of view. Journal of Clinical Psychiatry 1985, 46: 29–35.
Adverse effects of the atypical antipsychotics. Collaborative Working Group on Clinical Trial Evaluations J Clin Psychiatry 1998,59(Suppl 12):17–22.
Gelber RD, Gelman RS, Goldhirsch A: A quality-of-life-oriented endpoint for comparing therapies. Biometrics 1989, 45: 781–795.
Gopalakrishna P, Mummalaneni V: Examination of the role of social class as a predictor of choice of health care provider and satisfaction received a model and empirical test. Journal of Ambulatory Care Marketing 1992, 5: 35–48.
Greiner DL, Addy SN: Sumatriptan use in a large group-model health maintenance organization. American Journal of Health-System Pharmacy 1996, 53: 633–638.
Llewellyn-Thomas HA: Investigating patients' preferences for different treatment options. Canadian Journal of Nursing Research 1997, 29: 45–64.
Schommer JC, Kucukarslan SN: Measuring patient satisfaction with pharmaceutical services. American Journal of Health-System Pharmacy 1997, 54: 2721–2732.
Robinson A, Thomson R: Variability in patient preferences for participating in medical decision making: implication for the use of decision support tools. Quality in Health Care 2001,10(Suppl 1):i34-i38.
Fraenkel L, Bodardus S, Wittink DR: Understanding patient preferences for the treatment of lupus nephritis with adaptive conjoint analysis. Med Care 2001, 39: 1203–1216. 10.1097/00005650-200111000-00007
Hakim Z, Pathak DS: Modelling the EuroQol data: a comparison of discrete choice conjoint and conditional preference modelling. Health Economics 1999, 8: 103–116. 10.1002/(SICI)1099-1050(199903)8:2<103::AID-HEC393>3.3.CO;2-5
Lloyd AJ: The extent of patients' understanding of the risk of treatments. Quality in Health Care 2001,10(Suppl 1):i14-i18.
Feighner JP: Impact of anxiety therapy on patients' quality of life. American Journal of Medicine 1987, 82: 14–19.
Bowling A, Ebrahim S: Measuring patients' preferences for treatment and perceptions of risk. Quality in Health Care 2001,10(Suppl 1):i2-i8.
Dunbar-Jacob J, Erlen JA, Schlenk EA, Ryan CM, Sereika SM, Doswell WM: Adherence in chronic disease. Annual Review of Nursing Research 2000, 18: 48–90.
Bukstein DA: Incorporating quality of life data into managed care formulary decisions: a case study with salmeterol. Am J Manag Care 1997, 3: 1701–1706.
Fottler MD, Ford RC, Bach SA: Measuring patient satisfaction in healthcare organizations: qualitative and quantitative approaches. Best Pract Benchmarking Healthc 1997, 2: 227–239.
Ross CK, Steward CA, Sinacore JM: The importance of patient preferences in the measurement of health care satisfaction. Med Care 1993, 31: 1138–1149.
Aharony L, Strasser S: Patient satisfaction: what we know about and what we still need to explore. Medical Care Review 1993, 50: 49–79.
Strasser S, Aharony L, Greenberger D: The patient satisfaction process: moving toward a comprehensive model. Medical Care Review 1993, 50: 219–248.
Bredart A, Razavi D, Delvaux N, Goodman V, Farvacques C, Van Heer C: A comprehensive assessment of satisfaction with care for cancer patients. Supportive Care in Cancer 1998, 6: 518–523. 10.1007/s005200050207
Bredart A, Razavi D, Robertson C, Didier F, Scaffidi E, Fonzo D, Autier P, de Haes JC: Assessment of quality of care in an oncology institute using information on patients' satisfaction. Oncology 2001, 61: 120–128. 10.1159/000055362
Hudak PL, Wright JG: The characteristics of patient satisfaction measures. Spine 2000, 25: 3167–3177. 10.1097/00007632-200012150-00012
Lubeck DP, Litwin MS, Henning JM, Mathias SD, Bloor L, Carroll PR: An instrument to measure patient satisfaction with healthcare in an observational database: results of a validation study using data from CaPSURE. Am J Manag Care 2000, 6: 70–76.
Westbrook JI: Patient satisfaction: methodological issues and research findings. Australian Health Review 1993, 16: 75–88.
Avis M, Bond M, Arthur A: Satisfying solutions? A review of some unresolved issues in the measurement of patient satisfaction. J Adv Nurs 1995, 22: 316–322. 10.1046/j.1365-2648.1995.22020316.x
Bradley C: Diabetes treatment satisfaction questionnaire. Change version for use alongside status version provides appropriate solution where ceiling effects occur. Diabetes Care 1999, 22: 530–532.
Carr-Hill RA: The measurement of patient satisfaction. Journal of Public Health Medicine 1992, 14: 236–249.
Lin B, Kelly E: Methodological issues in patient satisfaction surveys. International Journal of Health Care Quality Assurance 1995, 8: 32–37. 10.1108/09526869510098840
Pouwer F, Snoek FJ, Heine RJ: Ceiling effect reduces the validity of the Diabetes Treatment Satisfaction Questionnaire. Diabetes Care 1998, 21: 2039.
Petterson T, Lee P, Hollis S, Young B, Newton P, Dornan T: Well-being and treatment satisfaction in older people with diabetes. Diabetes Care 1998, 21: 930–935.
Singh J, Wood VR, Goolsby J: Consumers' satisfaction with health care delivery: issues of measurement, issues of research design. Journal of Ambulatory Care Marketing 1990, 4: 105–115.
Sitzia J, Wood N: Response rate in patient satisfaction research: an analysis of 210 published studies. International Journal for Quality in Health Care 1998, 10: 311–317. 10.1093/intqhc/10.4.311
Sitzia J: How valid and reliable are patient satisfaction data? An analysis of 195 studies. International Journal for Quality in Health Care 1999, 11: 319–328. 10.1093/intqhc/11.4.319
Attkisson CC, Greenfield TK: The Consumer Satisfaction Questionnaire (CSQ) Scales and the Service Satisfaction Scale-30 (SSS-30). In Outcomes Assessment in Clinical Practice (Edited by: Sederer L, Dickey B). Baltimore: Williams & Wilkins 1996, 120–127.
Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use 2 Edition Oxford, England: Oxford University Press 1995.
Williams SA, Swanson MS: The effect of reading ability and response formats on patients' abilities to respond to a patient satisfaction scale. Journal of Continuing Education in Nursing 2001, 32: 60–67.
Ware JE Jr, Hays RD: Methods for measuring patient satisfaction with specific medical encounters. Med Care 1988, 26: 393–402.
Torrance GW, Feeny D, Furlong W: Visual analog scales: do they have a role in the measurement of preferences for health states? Medical Decision Making 2001, 21: 329–334. 10.1177/02729890122062622
Hanita M: Self-report measures of patient utility: should we trust them? J Clin Epidemiol 2000, 53: 469–476. 10.1016/S0895-4356(99)00205-X
Gill K: Social psychological artifacts in the measurement of consumer satisfaction with health care. Dissertation Abstracts International: Section B: The Sciences & Engineering 1996,57(2-B):1495.
Chatterton ML, Scott-Lennox J, Wu AW, Scott J: Quality of life and treatment satisfaction after the addition of lamivudine or lamivudine plus loviride to zidovudine-containing regimens in treatment-experienced patients with HIV infection. PharmacoEconomics 1999, 15 Suppl 1: 67–74.
Cohen JA, Beall D, Beck A, Rawlings J, Miller DW, Clements B, Pait DG, Batenhorst A: Sumatriptan treatment for migraine in a health maintenance organization: economic, humanistic, and clinical outcomes. Clinical Therapeutics 1999, 21: 190–204. 10.1016/S0149-2918(00)88278-8
Colman SS, Brod MI, Krishnamurthy A, Rowland CR, Jirgens KJ, Gomez-Mancilla B: Treatment satisfaction, functional status, and health-related quality of life of migraine patients treated with almotriptan or sumatriptan. Clinical Therapeutics 2001, 23: 127–145. 10.1016/S0149-2918(01)80036-9
Lewis R, Bennett CJ, Borkon WD, Boykin WH, Althof SE, Stecher VJ, Siegel RL: Patient and partner satisfaction with Viagra (sildenafil citrate) treatment as determined by the Erectile Dysfunction Inventory of Treatment Satisfaction Questionnaire. Urology 2001, 57: 960–965. 10.1016/S0090-4295(01)00945-1
Mathias SD, Warren EH, Colwell HH, Sung JC: A new treatment satisfaction measure for asthmatics: a validation study. Qual Life Res 2000, 9: 873–882. 10.1023/A:1008913209828
Payne R, Mathias SD, Pasta DJ, Wanke LA, Williams R, Mahmoud R: Quality of life and cancer pain: satisfaction and side effects with transdermal fentanyl versus oral morphine. Journal of Clinical Oncology 1998, 16: 1588–1593.
Glasser BG, Strauss AL: The Discovery of Grounded Theory: Strategies for Qualitative Research New York, Aldine de Gruyter 1967.
Krueger HP, Patton MQ: Focus Groups. A practical guide for applied research Newbury Park, Sage Publications 1988.
Merton RK, Friske M, Kendall PL: The Focused Interview. A Manual of Problems and Procedures 2 Edition New York, The Free Press 1990.
Grogan S, Conner M, Norman P, Willits D, Porter I: Validation of a questionnaire measuring patient satisfaction with general practitioner services. Quality in Health Care 2000, 9: 210–215. 10.1136/qhc.9.4.210
Gorsuch RL: Exploratory factor analysis: Its role in item analysis. Journal of Personality Assessment 1997, 68: 532–560.
Gorsuch RL: New procedures for extension analysis in exploratory factor analysis. Educational and Psychological Measurement 1997, 57: 725–740.
Russell D: In search of underlying dimensions: The use (and abuse) of factor analysis in Personality and Social Psychology Bulletin. Personality and Social Psychology Bulletin 2002, 28: 1629–1646. 10.1177/014616702237645
Borner MM, Schoffski P, de Wit R, Caponigro F, Comella G, Sulkes A, Greim G, Peters GJ, van der BK, Wanders J, et al.: Patient preference and pharmacokinetics of oral modulated UFT versus intravenous fluorouracil and leucovorin: a randomised crossover trial in advanced colorectal cancer. European Journal of Cancer 2002, 38: 349–358. 10.1016/S0959-8049(01)00371-9
Liu G, Franssen E, Fitch MI, Warner E: Patient preferences for oral versus intravenous palliative chemotherapy. Journal of Clinical Oncology 1997, 15: 110–115.
Stier DM, Gause D, Joseph WS, Schein JR, Broering JM, Warolin KL, Doyle JJ: Patient satisfaction with oral versus nonoral therapeutic approaches in onychomycosis. Journal of the American Podiatric Medical Association 2001, 91: 521–527.
Liem WH, McCullough JL, Weinstein GD: Effectiveness of topical therapy for psoriasis: results of a national survey. Cutis 1995, 55: 306–310.
Cronk BC, West JL: Personality research on the Internet: a comparison of Web-based and traditional instruments in take-home and in-class settings. Behavior Research Methods, Instruments, & Computers 2002, 34: 177–180.
Hatcher M: Internet usage and potential impact for acute care hospitals: survey in the United States. Journal of Medical Systems 1998, 22: 371–378. 10.1023/A:1020662124683
Ness TJ, Jones L, Smith H: Use of compounded topical analgesics – results of an Internet survey. Regional Anesthesia & Pain Medicine 2002, 27: 309–312. 10.1053/rapm.2002.31212
Rzymski P: A study of Internet use by doctors and patients in Poland. Journal of Telemedicine & Telecare 2001, 7: 344–347. 10.1258/1357633011936985
Duff S: Paying more for results. CMS tries to enlist Premier to tie hospital reimbursement to quality performance. Modern Healthcare 2002, 32: 9.
Clark PA: Medical practices' sensitivity to patients' needs. Opportunities and practices for improvement. Journal of Ambulatory Care Management 2003, 26: 110–123.
Portions of this work have been presented at the 9th Annual Conference of the International Society of Quality of Life Research, Orlando, 2002. Funding for this project was made possible by a grant from Pharmacia Corporation (now Pfizer Inc).
MJA, Principle Investigator, Project Director, Study Design & Planning, Psychometric Design & Analysis, Primary Authorship
AS, Study Coordinator, Second Authorship, Project Management, Literature Review, Qualitative Analysis, Data Management, Discussion Guide Design
SLH, Study Design & Planning, Contributing Author
SSC, Study Planning & Focus Group Facilitator, Design of Qualitative Methodologies, Discussion Guide Design
RNK, Literature Review, Contributing Author
MB, Initial Conceptual Framework Design, Contributing Author
CRR, Study Design & Planning, Contributing Author
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Atkinson, M.J., Sinha, A., Hass, S.L. et al. Validation of a general measure of treatment satisfaction, the Treatment Satisfaction Questionnaire for Medication (TSQM), using a national panel study of chronic disease. Health Qual Life Outcomes 2, 12 (2004). https://doi.org/10.1186/1477-7525-2-12
- Visual Analogue Scaling
- Satisfaction Score
- Treatment Satisfaction
- Illness Group
- Standardize Beta Coefficient