The Self-Perception and Relationships Tool (S-PRT): A novel approach to the measurement of subjective health-related quality of life
© Atkinson et al; licensee BioMed Central Ltd. 2004
Received: 08 April 2004
Accepted: 16 July 2004
Published: 16 July 2004
The Self-Perception and Relationships Tool (S-PRT) is intended to be a clinically responsive and holistic assessment of patients' experience of illness and subjective Health Related Quality of Life (HRQL).
A diversity of patients were involved in two phases of this study. Patient samples included individuals involved with renal, cardiology, psychiatric, cancer, chronic pelvic pain, and sleep services. In Phase I, five patient focus groups generated 128 perceptual rating scales. These scales described important characteristics of illness-related experience within six life domains (i.e., Physical, Mental-Emotional, Interpersonal Receptiveness, Interpersonal Contribution, Transpersonal Receptiveness and Transpersonal Orientation). Item reduction was accomplished using Importance Q-sort and Importance Checklist methodologies with 150 patients across the participating services. In Phase II, a refined item pool (88 items) was administered along with measures of health status (SF-36) and spiritual beliefs (Spiritual Involvements and Beliefs Scale – SIBS) to 160 patients, of these 136 patients returned complete response sets.
Factor analysis of S-PRT results produced a surprisingly clean five-factor solution (Eigen values> 2.0 explaining 73.5% of the pooled variance). Items with weaker or split loadings were removed leaving 36 items to form the final S-PRT rating scales; Intrapersonal Well-being (physical, mental & emotional items), Interpersonal Receptivity, Interpersonal Contribution, Transpersonal Receptivity and Transpersonal Orientation (Eigen values> 5.4 explaining 83.5% of the pooled variance). The internal consistency (Cronbach's Alpha) of these scales was very high (0.82–0.97). Good convergent correlations (0.40 to 0.67) were observed between the S-PRT scales and the Mental Health scales of the SF-36. Correlations between the S-PRT Intrapersonal Well-being scale and three of SF-36 Physical Health scales were moderate (0.30 to 0.46). The criterion-related validity of the S-PRT spiritual scales was supported by moderate convergence (0.40–0.49) with three SIBS scales.
Evidence supports the validity of the S-PRT as a generally applicable measure of perceived health status and HRQL. The test-retest reliability was found to be adequate for most scales, and there is some preliminary evidence that the S-PRT is responsive to patient-reported changes in determinants of their HRQL. Clinical uses and directions for future research are discussed.
With the emergence of collaborative and participatory models of health service delivery patient reported outcomes (PRO) have become an increasingly important criteria of service effectiveness [1–3]. It is not uncommon to find subjective health related quality of life (HRQL) measures along side more traditional clinical indicators of health outcomes. Nevertheless, subjective measures of disease and treatment impact are still viewed with some skepticism . In part, such concern is due to the weaker and sometimes ambiguous causal associations between subjective PRO's and more objective clinical change [5–7]. To address ambiguous association with health status, there is a tendency for health outcome researchers to opt for disease specific instrumentation with a heavy focus on the assessment of clinical symptoms, functional status, and general health states .
Subjective HRQL is thought to characterize the interaction between the circumstance or experiences associated with illness and patients' personal values and expectations . It is argued that the weaker association between HRQL measures and clinical conditions are acceptable because subjective measures are more responsive to, and congruent with, aspects of patients' evaluation, perception, interpretation, and processes of adaptive coping with illness . While more objective PRO measures may be more predictably responsive to changes in the physiological and psychiatric targets of treatment, patients' subjective perception of well-being is associated with good treatment outcomes – directly or indirectly impacting such things as treatment compliance, program follow-through, and satisfaction with care, and in some circumstances duration of survival [10–15].
The conceptual and methodological underpinnings for the Self-Perception and Relationship Tool (S-PRT) arose out of an attempt to reconcile two apparently incompatible positions regarding the assessment of individuals' experience of illness, the normative or quantitative approach and the ideographic or qualitative approach. While these approaches can be viewed as complementary [16, 17], they are infrequently combined in a manner that is both useful to clinical investigators and feasible for routine support of clinicians' relationships with patients and their support networks.
Normative measurement is advantageous since its' measurement constructs are rooted in generalized conceptual and empirical frameworks. Individuals' scores on such measures can be interpreted by comparison with those of established reference groups and understood in the context of testable theoretical models and hypotheses. Typically, such measures are based on a reduction of unique detail at the level of the individual respondent and emphasize what is relevant to all individuals. Normative methods tend to classify persons, while treating unique variation of individuals, rather unflatteringly, as unexplained error. This results in concise and feasible instrumentation, but often occurs at the expense of well-elaborated description of personal meaning. Consequently, clinicians often find it difficult to use such results to facilitate deep and unique interpersonal understanding with their patients.
On the other hand, advocates of qualitative approaches rightly emphasize the necessity of gaining clinical understanding at the level of the individual patient. Grounded and phenomenological approaches are typically used to explore and elaborate on the richness of individuals' perspectives, experiences, and goals (cf., [18, 19]). Providers of patient-centered care instinctively favor this perspective since both view interpersonal understanding as the cornerstone of the caregiver-patient relationship. While qualitative approaches are expansive and rich, they are usually too unwieldy to be routinely applied to support clinical practice. Moreover, results from qualitative studies cannot easily be used to describe group differences, such as when assessing standards of practice or evaluating the effectiveness of service delivery. Within both practice and educational settings, advocates of the two approaches have attempted to integrate these two very valid, but quite different, approaches to patient assessment [16, 20–22].
Early formulations: characteristics of a measure
Our initial discussion about development of a new HRQL instrument focused on the need to support patient care and health service delivery by providing clinicians with detailed information about the impact of illness on patients' well-being . It was recognized that the psychometric validity of such an instrument would depend on its ability to describe normative group similarities and differences, but that the real value would be determined by its ability to help to strengthen clinician-patient relationships and facilitate three central objectives of good patient care: 1) To foster meaningful patient-centered dialogue and supportive therapeutic relationships ; 2) To identify patients with special needs for adjunctive support; and 3) To characterize patients' experience of the illness-health progression as well as the experiential impact of interventions over time.
Also at issue was the need to assure the general relevance of the measured dimensions across a wide range of patient groups. In this regard it was necessary to break rank with typical approaches to designing disease- and symptom-specific HRQL instrumentation, since they are based on the premise that measures depend on a careful specification of disease-specific contexts and experiences. This method of gaining measurement precision was not seen as feasible across disparate and heterogeneous patient populations. Contributing to this challenge was our desire to cover the most common domains thought relevant to the study of HRQL ; encompassing physical, mental-emotional, social and, the less often considered spiritual experiences related to illness. After much discussion, it was decided that our approach to measurement design could not be specifically tied to a structured set of circumstances, events, or exemplars that would impose observational restrictions; and the 'constructs' associated with patient well-being could not be operationalized in a typical manner.
In order to achieve the normative psychometric performance that we required, measurement dimensions would have to be common across individuals, but would not rely on what was important to specific patient groups but rather how 'it' was important across patient groups, leaving the definition of life events and circumstances up to the patient – the specifics of which could later be explored with the patient in an interview setting. The question remained, whether common dimensions of patient well-being could be found across patients and what psychometric characteristics such dimensions would possess.
The fundamental importance of respondents' definition of what is (subjectively) relevant to their well-being has led to a variety of non-traditional approaches to the quantitative measurement of HRQL and PROs in general. Without exception, these methods allow respondents to individually identify and rate what is most important them. Another common feature is the use of various computational and classification techniques that provide a means to produce group statistics for comparative and summative purposes. Two better known HRQL examples are the Schedule for the Evaluation of Individual Quality of Life (SEIQOL) and the Patient Generated Index (PGI), both of which allow respondents to identify personally relevant groups of related activities/goals and rate them according to their subjective importance as determinants of life quality [26–29]. These measures and approaches have demonstrated that it is possible to design respondent-defined HRQL instrumentation that possesses adequate psychometric properties. These psychometric characteristics hinge on the consistency with which individuals evaluate and value aspects of the life experiences they choose to rate.
Several psychological disciplines address the consistency with which individuals create meaning around dimensions of personal experience. Personal Construct Theory (PCT) describes stable aspects of individuals' cognitive representations by identifying core dimensions of personal meaning. Empirically, PCT assessment of such meaning structures is based on comparative ratings on bipolar continua of perceived opposites. Important or 'deep' personal constructs are thought to comprise individuals' core belief systems, and define the dominant interpretive framework(s) that individuals apply when interpreting life events. To us, the basic principles of PCT seemed quite congruent with the purpose of the current instrumentation project, as stated by Kelly, "how the human process flows, how it strives in new directions as well as in old, and how it may dare for the first time to reach into the depths of newly perceived dimensions." . Among qualitative health care researchers, the idea to use PCT is not a new one; for example, PCT based approaches have been used in the study of personal meanings associated with death and dying .
Scholars of cognitive constructivism, who suggest individuals' progressively elaborate personally relevant meaning through daily interaction with the world, provide another perspective on the creation of personal meaning. An important postulate is that personal relevance or meaning can be assessed by the degree to which emotional experience is generated when the belief system is activated or challenged . Thus emotional states are viewed as inextricably tied to core perceptions of ourselves and our world . Put more simply, if you know how an individual feels about an event, you are on the right path to discover what is most important to them and how they view and understand the emotionally relevant aspects of life situations. Not surprisingly, emotional ratings are often among the strongest covariates of HRQL; typically equal to, or stronger than, objectively defined (normative) indicators [34, 35].
Many theoretical perspectives on human psychology suggest that our experiences and behavior is founded on a fundamental emotional distinction between pleasurable and aversive events. Although there is a growing body of research that suggests that this hedonic polarity is not truly a functional opposite in terms of cognitive information processing , there is longstanding acceptance of the centrality of hedonic balance as a determinate of mental health and subjective well-being [36–41]. Thus, a confluence emerged suggesting that the evaluation of core subjective meaning might be best described on a polar emotionally valanced continuum. Moreover, the intuitive appeal of a valanced emotional heuristic, to both patients and clinicians, could provide inherent face and clinical validity to the measure, as well as facilitate its use to further the interpersonal processes of clinical care.
It was through this process of learning, reasoning and debate that we began to examine a central idea that emotional perception might serve as a basis for the measurement of subjective HRQL; one that might retain its relevance across a wide diversity of patient groups and illness-related experiences.
The semantic differential method (SDM) (cf., [42, 43]) seemed to be an obvious choice as a scaling paradigm for a several reasons. First, the methodology is well established as a reliable and generally applicable way to measure individuals' attitudes, preferences and perceptions that result from various real-life experiences [44–46]. For example: within health care, SDM has been used successfully to describe the experiences of patients and caregivers coping with chronic illness, as well as less tangible perceptions such as 'hope' in palliative care settings [47–49]. Of added benefit, there is convincing evidence that the semantic differential measurement approach is very responsive to changes occurring as a result of psychotherapy [43, 50], educational, medical, and pastoral training [51–53], and interactions between patients/clients and their caregivers . Other research using semantic differential methods has also demonstrated its usefulness as a screening tool (c.f., [27, 55]).
Originally, the SDM was used to explore the connotative meaning of words by asking respondents to rate their understanding of a particular word or idea on a scalar continuum between two opposite or polar adjectives. Such ratings provide a sense of the ways in which respondents understand the meaning of the reference material(s).
In the current study, we chose to substitute attitudinal and sensory scale anchors for pairs of emotionally opposite perceptions of illness-related experiences. It was hoped that these perceptual rating scales would allow respondents to provide meaningful ratings of the impact of personally relevant illness-related experiences. However, unlike earlier applications of SDM, we would leave choice of the specific life events to being rated was left almost completely open to respondents. A fundamental design principle was to characterize the most important emotional perceptions that patients have about the impact of illness on experience that they identified as important across various domains of life.
Item generation and evaluation
Perceptual rating scales for the future instrument were developed through the work of five sequential, and similarly tasked Patient Focus Groups. The work of each focus group was improved upon by the next. Members of these groups included patients (n = 31) and interested clinicians (n = 6) receiving or providing inpatient or outpatient treatment for one of the following conditions: Cancer (n = 12), chronic renal failure (n = 3), psychiatric illness (n = 10), and acute life-threatening cardiac events (n = 6). Participants typically possessed a high degree of interest in, and awareness of, the personal and social impact of illness on their lives.
In order to orient focus group members to the tasks at hand, a package was provided several days before the date a particular group was to be convened. The package included a statement of study purpose, a description of key measurement objectives of the instrument, definitions of the six areas (or life domains) to be assessed by the new instrument, namely; patients' perceptions of their physical well-being, mental-emotional well-being, social connectedness, contribution to others' well-being, feelings of spiritual connectedness, and orientation towards spiritual growth processes. The package also included a list of illness impact statements (to which they could add), and the most recent version of the scales proposed by the previous focus group.
Dr. Robinson, a clinical psychologist and co-author with previous experience leading focus groups, facilitated the groups. Participants were led to view themselves as experts on their experience through a facilitative stance of curiosity and incomplete understanding . The task put to each member of the group was to think about their own experiences of illness ("illness events") and the emotional impact of these events on the six areas/domains of their lives. The groups worked on identifying positive and negative emotional terms that describe these experiences ("emotional descriptors").
The following stems were used to orient participants to each of the six domains:
Physical Well-being: Within my illness experience, I physically feel I am:
Mental Emotional Well-being: Within my illness experience, I feel I am:
Interpersonal Receptiveness: My relationships help me feel I am:
Interpersonal Contribution: Towards those who are emotionally close to me, I feel I am:
Spiritual Receptiveness: Universal beliefs & principles or a divine presence help me feel I am:
Spiritual Orientation: Towards universal beliefs & principles or a divine presence I feel I am:
An example was provided to illustrate the process of developing rating scales (items) within the focus group sessions:
Domain of Life Experience: Interpersonal Contribution
Illness-event: Increased Dependency on Others
Potential Descriptors of Patient Experience: Helpless, Embarrassed, etc.
Opposite Poles: Capable, Confident, etc.
Over the course of the focus group session, participants proposed and discussed new scale anchors as well as the meaning of opposite emotional terms. From this information, a drafts of bi-polar perceptual rating scales were sequentially refined, new scales were added, confusing or unbalanced terms were reworded, and redundancies between items were removed or clarified. The five focus groups generated and refined 128 differential scales across six domains of life experience. Frequency response options provided continua on which respondents could rate their emotional perceptions of relevant illness events across six life domains.
In order to help assure at least a grade six reading level, the pre-pilot version of the 128-item pool was given to two sixth grade language arts teachers for review. Ten patients were also asked to complete the item pool and comment on the completion time, the understandability of instructions, and the clarity of both the task and item layout. Feedback was used to evaluate wording and design of items, as well as respondent burden.
Patients across seven participating service areas (i.e., renal, cancer, cardiology, mental health, chronic pain, diabetes, and alternative medicine) took part in an item Q-sort that was designed to reduce the item pool to contain items that were important to a majority of respondents. Twenty to twenty-five patients from each service area (n = 150) took part in this phase of the study. In some service areas where implementation of the Q-sort method was difficult or impractical (e.g., in waiting rooms with short waits), an Item Importance Checklist was employed. For each of the six HRQL domains, participants either sorted item cards or rated the relative importance of each item based on their illness experiences. A comparison of the distributions of Q-sort and Item Importance Checklist data reveal no difference between the two methods, although the Q-sort allowed for more meaningful interaction between participants and research assistants.
Items were selected for the reduced item pool if they met one of the two criteria – the item was endorsed or sorted as "very important" by at least 45% of the patients across all service areas or endorsed by at least 70% of the patients in any one area. Due to a more heterogeneous endorsement rating of items in the spirituality/transpersonal domain, items that were endorsed by 65% of patients in any two areas were also included (For the sake of brevity, these data have been omitted but are available upon request). The reduced item pool consisted of 88 items covering the six domains of life experience.
Main psychometric study
For the purpose of psychometric evaluation, the reduced 88 S-PRT item pool was administered along with measures of physical and mental health related quality of life (SF-36 v2) and spiritual beliefs (Revised Spiritual Involvements and Beliefs Scale – SIBS-R). Supplemental questions were also added to gather basic demographic and clinical information. Finally, individuals were asked to rate themselves with regards to their degree of spirituality/religiosity, self-esteem, social relationships, existential worry, difficulties coping with illness, and acceptance of illness. These questions were designed for the study in consultation with a psychologist on the project and took the form of self-statements (e.g., "I am a religious person" or "My illness has caused me to worry about life and death issues.").
MOS SF-36 version 2
Together, the SF-36 version 1 and version 2 are the most widely used generic measures of self-perceived health status and HRQL in health care [57–59]. Both versions of the SF-36 consist of 36 items that assess eight dimensions of health status: l) Physical Functioning, 2) Physical Role Limitations due to physical health problems, 3) Bodily Pain, 4) General Health, 5) Vitality (energy/fatigue), 6) Social Functioning, 7) Emotional Role Limitations due to emotional problems, and 8) Mental Health that characterize respondents' current state of psychological distress/well-being [60, 61]. This instrument has been extensively tested and validated across a wide range of illness conditions and patient populations [60, 62] and shown to be responsive to changing clinical conditions over time [62, 63].
The Spiritual Involvement and Beliefs Scale (SIBS)
The SIBS is a relatively new instrument developed by Hatch and colleagues  and subsequently revised (R. B. Hatch, personal communication, July 6, 2001). It is designed to assess both spiritual and religious practices and beliefs across a wide variety of religious/spiritual traditions. The SIBS is self-administered and contains 26 Likert-type items measuring four dimensions: External/Ritual, Internal/Fluid, Existential/Meditative, and Humility/Personal Application. The instrument has been tested in various patient populations, including those using general family practice care. It has been shown to have good test-retest reliability (r = 0.92), internal consistency (Cronbach's alpha = 0.92) and validity when compared to other established instruments (e.g., Spiritual Well Being Scale). The SIBS was chosen because it avoids the cultural-religious biases inherent in many measures of its type and it operationalizes spirituality more broadly than other measures of religiosity.
Self-Perception and Relationships Tool
The test item pool consists of 88 items that measure patients' perceptions of the emotional impact of illness on the physical, mental-emotional, social and spiritual dimensions of illness experience. Six experiential domains of life experience are assessed using on semantic differential rating scales, namely: Physical Well-being, Mental-Emotional Well-being, Interpersonal Receptiveness, Interpersonal Contribution, Transpersonal Receptiveness, and Transpersonal Orientation. The Interpersonal Receptiveness domain assesses respondents' perceptions of what significant relationships contribute to their own sense of social well-being. Rating scales in the Interpersonal Contribution domain describe respondents' perceptions of what they contribute to the well-being of those around them. A similar distinction is made in the spiritual/transpersonal domain, with Transpersonal Receptiveness assessing respondents' perceptions of how they benefit from beliefs or faith in a higher power, and Transpersonal Orientation is thought to assess core attitudes associated with spiritual practice.
Recruitment procedures and sample characteristics
A description of participating services
Sex Ratio (m:f)
Duration of Illness In Years***
Inpatients receiving medical management and diagnostic procedures admitted for cardiac and postoperative thoracic surgery
Outpatients receiving regular hemodialysis
Inpatient psychiatric services and outpatient attendees in a day program providing various forms of individual and group medical and psychosocial therapies
Outpatients attending a genito-urinary follow-up clinic, being seen for counseling, or attending meditation or support groups
Outpatients attending medical and psychosocial treatments for chronic pain of difference etiologies
Outpatients receiving assessment and/or treatment for breathing problems during sleep
In most cases, patients that were deemed medically stable and well enough, were approached by a practitioner or a service area research coordinator who asked if they would like to participate in a research project investigating the psychosocial and spiritual impact of illness on patients' lives. If patients expressed an interest, a pamphlet describing the study was provided. The participation rate varied widely, between 30% on the inpatient cardiology unit to 95% in the outpatient renal dialysis clinic. These patients were contacted by a research assistant who provided additional information on the study and addressed any questions they had about the project. If still interested, participants were given a package containing the questionnaires, a study consent form, and a detailed description of the project. Complete confidentiality of results was assured.
When obtaining patient consent, participants were also asked if they would consider taking part in a follow-up post-test. Forty patients agreed to participate in this follow-up activity. These individuals were mailed the S-PRT four to six weeks later, along with a set of questions asking how much they thought their physical, mental-emotional, social and spiritual experiences had changed since the last time they completed the S-PRT. Twenty-eight individuals returned the post-test, a response rate of 70%.
Study participants were very diverse with respect to the types of illness, illness severity, degree of functional impairment, and length of time that they had been coping with their illness condition. Table 1 presents the sample sizes, the gender composition, age, and reported duration of illness of participants in each service area. Significant differences between services were found on each of these variables.
The majority of participants (49.3%) indicated they were Protestant, 15.9% indicated they were Catholic, 2.9% were Lutheran, 1.4% were Jewish, 1.4% were Hindu. The following religions were mentioned by one respondent each, Pagan, Mormon and Baha'i. No differences were observed across service areas by participants' stated religious affiliation.
S-PRT factor structure
Rotated Final S-PRT Factor Matrix (PCA w/ Normalized Varimax rotation)
sprt1_2: Relaxed – Tense
sprt1_7: Comfortable – Uncomfortable
sprt1_11:At Ease – In Agony
sprt2_4: Composed – Distraught
sprt2_6: Optimistic – Discouraged
sprt2_8: Confident – Unsure
sprt2_9: Capable – Helpless
sprt2_11: Certain – Uncertain
sprt3_1: Valued – Worthless
sprt3_2: Comforted – Distressed
sprt3_3: Close – Distant
sprt3_4: Connected – Isolated
sprt3_5: Included – Excluded
sprt3_6: Supported – Blamed
sprt3_7: Accepted – Criticized
sprt4_6: Forgiving – Resentful
sprt4_7: Welcoming – Unreceptive
sprt4_8: Accepting – Rejecting
sprt4_9: Encouraging – Discouraging
sprt4_10: Trusting – Distrusting
sprt4_12: Understanding – Misunderstanding
sprt4_15:Respectful – Disrespectful
sprt5_5: Inspired – Uninspired
sprt5_6: Comforted – Troubled
sprt5_8: Accepted – Judged
sprt5_9: Guided – Aimless
sprt5_11: Embraced – Rejected
sprt5_12: In Harmony – Out of Step
sprt5_15: Sustained – Adrift
sprt6_6: Listening – Ignoring
sprt6_7: Receptive – Closed
sprt6_8: Thankful – Demanding
sprt6_9: Accepting – Critical
sprt6_11: Approaching – Receding
sprt6_12: Willing – Resisting
sprt6_13: Connecting – Separating
Items with weaker or split loadings across factors were removed and a final factor solution explained a total of 83.5% of the pooled variance. Factor 1 contained three items from the original Physical Well-being domain and five items from the Mental-Emotional domain. Together the Intrapersonal Well-being factor explained 18.8% of the pooled variance. Factor 2 was composed of seven items assessing their receptiveness to spiritual experience. The Transpersonal Receptivity factor explained 16.7% of the total variance. Factor 3 was made up of seven items assessing respondents' perceptions of their contribution to the well-being of others. The Interpersonal Contribution factor explained 16.5% of the variance. Factor 4 was comprised of seven items assessing the domain of interpersonal receptivity (16.2% of the variance). The final Factor 5 contained seven items assessing respondents' perceptions of their orientation towards a higher power or being. Transpersonal Orientation explained 15.3% of the variance.
S-PRT Scale Characteristics
Mean (Standard Deviation)
Cronbach's Alpha (retest sample n = 28)
Pearson Intercorrelation Matrix** (n = 136)
Test/re-test reliability and responsiveness estimates
Test – retest reliability coefficients were computed using data on 28 respondents to the follow-up administration of the S-PRT at 4–6 weeks. Lower than desirable test-retest reliability coefficients were observed on the Intrapersonal Well-being and Interpersonal Receptivity scales (r2 = .68 and .50 respectively). Adequate stability reliabilities were observed for the Interpersonal Contribution, Transpersonal Receptivity and Transpersonal Orientation scales (r2 = .77, .81 and .89). Higher stability coefficients in these domains may be due to the relative stability of intrinsically oriented belief systems over time and across circumstance. Due to the relatively small sample size employed in the factor analytic procedure and possible inflation of internal consistency estimates, the Cronbach's Alpha coefficients are also reported on the test retest sub-sample.
Criterion-related validity coefficients
The validity of the S-PRT was examined using three measures: Two established measures, one assessing physical and mental health-related quality of life (SF-36 v.2) and one measuring constructs associated with spiritual beliefs (i.e., Spiritual Involvement and Beliefs Scale). A third measure consisted of a series of ten self-statements, respondents were asked to rate the statements in terms of how similar each was to their beliefs and experiences with illness, social relationships, religious/spiritual beliefs, and self-esteem.
Criterion 1 – Health and Mental Health Status
Pearson correlations between the SF-36 and the S-PRT Scales
Physical Scales of the SF-36
Mental Scales of the SF-36
In order to evaluate whether correlations between the S-PRT and the SF-36 Mental Health or Emotional Role Function scales might have been due to the strong influence of depression in the mental health and chronic pain samples, these correlations were rerun with these samples removed. These results (not reported here) revealed an increase in the association between the S-PRT Physical-Mental/Emotional subscales and the four SF-36 physical health scales. However, removal of primarily depressed or highly distressed patient samples did not greatly reduce the strength of association of S-PRT scales with the SF-36 Mental Health scale, suggesting that the measure is not solely responsive to the more extreme emotional perceptions of persons with mental illness.
Evidence of criterion related validity of the S-PRT Interpersonal scale can be seen in moderate correlations found with three of the Physical Health scales of the SF-36 (i.e., Physical Role, Pain, and perceptions of General Health). The absence of significant correlations between the S-PRT scales and the Physical Function scale of the SF-36 may reflect the fact that the S-PRT assesses the subjective emotional impact of physical conditions, not the physical condition itself.
Criterion 2 – Spiritual Involvement and Beliefs
Convergent validity coefficients between the spirituality scales of the S-PRT and the Spiritual Involvement and Beliefs Scale
Spiritual Involvement and Beliefs Scale
The areas of strongest association occurred with the SIBS Internal-Fluid and Existential-Meditative scales. This may reflect a shared emphasis on internal perceptive and balanced emotional states by meditative and reflective respondents.
Pearson correlations between patients' evaluation of their current life experiences and the S-PRT scales
I am Religious
I am Spiritual
I have high Self-esteem
I have supportive relationships
My relationships are stressed
My ADL are reduced
My dependence on others has increased
I have difficulties coping w/ illness
I worry about life and death issues
I have come to accept my illness
Across all domains assessed by the S-PRT, patients' perceptions of self-esteem, supportive relationships and acceptance of their illness were positively associated with well-being. In contrast, stressed relationships, difficulties coping with illness, and preoccupation with existential issues were negatively associated with all scales of the S-PRT. The Intrapersonal Well-being scale was also negatively correlated with recent reductions in physical function and increased dependence on the assistance of others. Intriguingly, the Transpersonal Receptiveness scale of the S-PRT is differentially correlated with patients' ratings of their own spirituality versus religiosity (items 1 & 2 in Table 7), and may distinguish such individuals.
ANOVA Comparisons of S-PRT Scale Scores by Service Area
Renal (n = 28)
Cardiology (n = 29)
Mental Health (n = 19)
Cancer (n = 28)
Chronic Pain (n = 14)
Sleep Clinic (n-16)
All Groups (n = 134)
The results presented here build on a history of unique yet psychometrically sound HRQL instrumentation, which do not rely heavily on specific situational or disease-specific content. The S-PRT employs generally worded domain stems on which respondents' provide emotional-perceptual ratings of illness-related experiences that they identify as belonging to each domain. In this way, the instrument does not introduce the contextual restrictions often imposed by many disease-specific measures of HRQL. Such content specificity often results in gains of instrument performance at the expense of unique personal relevance and generalized relevance across patient groups . The S-PRT allows individuals to provide ratings that are based on their own perceptions of the impact of illness on five experiential domains of HRQL. This provides the S-PRT with good face validity since the meaning of its domain stems and rating scales arise from the respondent's interpretation and experience. In addition, the emotional basis of the rating scales serves to strengthen the internal consistency of the scales and personal salience of individuals' responses.
An unexpected, but exciting observation was the distinct distribution of S-PRT items on factors as the original hypothetical domains defined them; the only exception was that the Physical and Mental/Emotional domains merged completely. The clean factorial structure is most likely due to the combined effects of the clear distinctions made by respondents between their experiences within each domain and cognitive coherence associated with emotional ratings. As a result, there is a high degree of item covariation within each domain across respondents, despite the fact that each respondent uniquely defined and rated a unique set of situational experiences.
The current methodology may allow researchers to disentangle the interactions between objective situational determinants of HRQL and patients' subjective response to situational events, such interactions have presented a persistent challenge to developers and users of HRQL instrumentation [29, 56]. By allowing respondents to select and rate personally relevant experiences on a common set of emotional rating scales may elucidate the subjective emotional/evaluative components of HRQL while retaining the personal relevance of the situations being rated.
The normative characteristics of the S-PRT allowed for statistical identification of significant group differences between patient samples. These differences occurred where one might expect them, with the lowest scores on four S-PRT scales found among respondents with chronic pain, depression/psychosis. The highest sense of well-being among patients was reported by the more acute cardiac conditions. The S-PRT also possessed another important characteristics of a normative HRQL instrument, namely a fairly convincing convergence with standard HRQL scales (i.e., SF-36 and SIBS). These normative characteristics suggest the instrument is suitable for use in research applications employing traditional quantitative methodologies, such as examination of group differences between patient groups or treatment conditions.
To some, the absence of specific detail regarding specific circumstances of patients' lives may seem to limit the usefulness of S-PRT results; and results reveal few clues as to the specific reasons for variation in respondents' well-being ratings. Indeed, in the current study supplemental questions were required for the purpose of analysis in order to gain a fuller contextual understanding of the S-PRT ratings. Nevertheless, a central objective for development of the S-PRT was to foster patient-centered dialogue, and indeed the need for contextual clarification of patients' responses fits well with its intended purpose. Another appealing characteristic is that the S-PRT permits assessment and screening of emotionally distressing issues without resorting to use of potentially restrictive or embarrassing questions about illness-specific events. Too many patients perceive such 'testing' as cold and uninviting; to the more vulnerable or private patient, such questions may be (defensively) viewed as invasive or offensive. Using the S-PRT, patients can be allowed to express illness-related distress in different areas of their lives without fears of over disclosure of personal events, yet 'leaving the door open' to define and explore potential issues within a consensually negotiated relationship with their caregiver.
Contributing to its validity as a qualitative interview tool, the S-PRT was developed through a well-grounded process in which patients developed a rich framework with which to express their often-paradoxical experiences and perceptions. The tool may play an important role during the early stages of assessment, history taking, and rapport building; where meaningful dialogue is an essential component of good clinical care. The dialogical characteristics of this instrument are founded on providing caregivers with a non-reductionist description of how their sense of well-being is impacted by illness-related experiences in various domains of life. As indicated, such fore knowledge of life domains impacted by illness could help launch discussion and strengthen the bonds of understanding between caregivers and their patients. Supporting its use as a reliable clinical assessment measure, the internal consistency of S-PRT scales was very strong [67, 68], sufficiently so that most were able to meet the stringent .90 standard advocated by Nunnally when the intended use of an assessment device is at the level of the individual . The strong correlation between S-PRT scale scores and endorsement of difficulties coping with illness lend credence to the hypothesized adaptive and motivational role of emotional experience, suggested by Lazarus .
Limitations and future directions
A major limitation of this study is the relatively small sample size used to conduct the factor analysis and infer construct validity of the items and respective domains. A typical rule of thumb is that 5–10 respondents are required to specify a stable factorial solution. While the explanatory strength of the factor solution (explaining 83.5% of the pooled variance) using our small sample provides some assurances that the dimensionality of the S-PRT is robust, further confirmatory construct validation is required, preferably using larger samples of patients within particular patient populations of interest.
More research is also required to establish the score ranges and clinical cut-points for the S-PRT scales that could be used to evaluate the sensitivity and specificity characteristics of the measure when identifying people in personal, interpersonal, or spiritual distress. Data from the current study provides a preliminary hint that a 'normal' emotional balance point may be between 1.3 and 1.8 on a scale from -3 to +3. It is also likely that ideal balance point ranges differ across individuals by disposition, education, and various demographic characteristics. Of related interest, the utility of the S-PRT as an assessment or screening tool needs to be evaluated in various clinical settings. There are also questions as to the impact of completing such a measure on the quality of the relationships formed between patients and their caregivers .
Another important issue, particularly for instruments of this type, is its stability versus responsiveness over time and across situations. The low test-retest reliability estimates associated with the Intrapersonal Well-being and Interpersonal Receptivity scales suggest they may be more influenced by recent life events than more firmly held, and thus stable, beliefs about ones' social contributions and orientation to divinity. In fact, the stability of such beliefs, particularly those on the Transpersonal dimensions, may serve to buffer individuals' sense of well-being during times of difficulty and uncertainty. Given the importance of the factors associated with changes in subjective perceptions of well-being and the small number of persons involved in the retest portion of this study, the issue of stability versus situational responsiveness requires further exploration.
Further stem refinement may also be required on the wording of the Transpersonal domain stems. The current wording of the stems may have resulted in the alienation felt by the ten percent of respondents who chose not to complete rating scales in this domain. Written comments from these respondents suggest that they considered themselves to be neither spiritual nor religious and thus chose not to rate these domains. Use of the stem, "My basic beliefs about life and being, help me feel I am:" might provide more encompassing wording; more acceptable to those with an aversion to more traditional religious concepts.
Area of future inquiry should focus on the cognitive skills required for respondents to complete the rating task. The cognitive complexity associated with polar emotional rating scales prove difficult for some groups of patients. Within the focus groups, members with more severe forms of mental dysfunction (e.g., acute psychosis, brain damage or dementia) reported difficulties completing portions of the S-PRT. Specifically, these individuals expressed difficulties forming singular evaluative concepts from using the polarities on the S-PRT scales to rate their life experiences. This may suggest that the methodology may not be well suited to those experiencing acute difficulties forming affective mental abstractions.
The S-PRT provides a unique approach to measurement of individuals' subjective perceptions of meaningful physical, mental-emotional, social and spiritual experiences that occur as a result of illness. The tool may help address a need of health care professionals to assess, and relationally address, individuals' subjective experience of the impact of illness. As a support tool during the qualitative and relational aspects of care, the S-PRT shows great promise. As a research tool, certain aspects of the instrument performed beyond our expectations while other aspects require further refinement, particularly within the context of longitudinal study. Overall, the S-PRT provides a unique methodology for assessing HRQL that integrates two apparently irreconcilable approaches to measurement, the normative-quantitative and the ideographic-qualitative perspectives, into a unified patient-centered approach to subjective HRQL.
List of abbreviations
Health Related Quality of Life
Personal Construct Theory
Patient Generated Index
Patient Reported Outcomes
Semantic Differential Method
Schedule for the Evaluation of Individual Quality of Life
Medical Outcome Study Short Form Health Survey
Spiritual Involvements and Beliefs Scale
Self-Perception and Relationships Tool
We would like to thank the following individuals for their contributions supporting this work:
Bushra Wasil MD. PhD (Candidate), Community Health Science, University of Calgary, Calgary, Alberta
Beatrice Breitling BSc, Research Assistant, Calgary Health Region, Calgary, Alberta
Cardiology & Hypertension: M. Carducci, RN; C. Gunderson; R. deJong and J. Robertson
Chronic Pain Clinic: P. Taenzer, PhD.
Mental Health & Psychiatric Services: D. Addington MD, I. Champion, RN, S. Gloster, RN, D. Watson, RPN.
Oncology: L. Carlson PhD, M. Speca, PsyD.
Renal Dialysis Team: K. Ahola, MSW.
Research Centre for Alternative Medicine: S. Moriz, MSc.
Sleep Centre: W. Flemons, MD; J. Robinson; MPA; M K. LeBlanc, MN.
Financial and Material Support
The Adult Research Committee, Centre for Advancement of Health, Calgary Health Region, Calgary, Alberta
Mental Health and Psychiatric Services Information and Evaluation Unit, Calgary Health Region, Calgary, Alberta
Spiritual Directions and the Community Opportunity Foundation of Alberta, Calgary, Alberta.
Private Donors: Mr. and Mrs. Wishart; Dr. and Mrs. Burridge
- Frosch DL, Kaplan RM: Shared decision making in clinical medicine: past research and future directions. Am J Prev Med 1999, 17: 285–294. 10.1016/S0749-3797(99)00097-5PubMedView ArticleGoogle Scholar
- Kaplan Robert M.: Shared medical decision-making: A new paradigm for behavioral medicine--1997 presidential address. Ann Behav Med 1999, 21: 3–11.PubMedView ArticleGoogle Scholar
- Katz JN: Patient preferences and health disparities. JAMA 2001, 286: 1506–1509. 10.1001/jama.286.12.1506PubMedView ArticleGoogle Scholar
- Anderson KL, Burckhardt CS: Conceptualization and measurement of quality of life as an outcome variable for health care intervention and research. J Adv Nurs 1999, 29: 298–306. 10.1046/j.1365-2648.1999.00889.xPubMedView ArticleGoogle Scholar
- McDowell Ian, Newell Claire: Measuring health: A guide to rating scales and questionnaires New York, NY, Oxford University Press 1987, 27–33.Google Scholar
- Bergner M, Walker SR, Rosser RM: Development, testing and use of the Sickness Impact Profile. Boston, MA. Quality of Life: Assessment and Application (Edited by: WalkerStuart R and RosserRachel M). MTP Press 1988, 79–94.Google Scholar
- Spector W: Functional disability scales. Philadelphia, PA. Quality Of Life And Pharmacoeconomics In Clinical Trials 2nd Edition (Edited by: SpilkerBert). Lippincott-Raven Publishers 1996, 133–144.Google Scholar
- Anderson RT, McFarlane M, Naughton MJ, Shumaker SA: Conceptual issues and considerations in cross-cultural validation of generic health-related quality of life instruments. Philadelphia, PA. Quality Of Life And Pharmacoeconomics In Clinical Trials 2nd Edition (Edited by: SpilkerBert). Lippincott-Raven Publishers 1996, 605–612.Google Scholar
- Ben Zur H, Rappaport B, Ammar R, Uretzky G: Coping strategies, life style changes, and pessimism after open-heart surgery. Health Soc Work 2000, 25: 201–209.PubMedView ArticleGoogle Scholar
- Albrecht G, Hoogstraten J: Satisfaction as a determinant of compliance. Community Dent Oral Epidemiol 1998, 26: 139–146.PubMedView ArticleGoogle Scholar
- Awad AG, Voruganti LN, Heslegrave RJ, Hogan TP: Assessment of the patient's subjective experience in acute neuroleptic treatment: implications for compliance and outcome. Int Clin Psychopharmacol 1996, 11 Suppl 2: 55–59.PubMedView ArticleGoogle Scholar
- Awad AG, Voruganti LN: Quality of life and new antipsychotics in schizophrenia. Are patients better off? Int J Soc Psychiatry 1999, 45: 268–275.PubMedView ArticleGoogle Scholar
- Lakusta CM, Atkinson MJ, Robinson JW, Nation J, Taenzer, PA, Campo MG: Quality of life in ovarian cancer patients receiving chemotherapy. Gynecol Oncol 2001, 81: 490–495. 10.1006/gyno.2001.6199PubMedView ArticleGoogle Scholar
- Weaver M, Patrick DL, Markson LE, Martin D, Frederic I, Berger M: Issues in the measurement of satisfaction with treatment. Am J Manag Care 1997, 3: 579–594.PubMedGoogle Scholar
- Kornblith AB, Thaler HT, Wong G, Vlamis V, Lepore JM, Loseth DB, Hakes T, Hoskins WJ, Portenoy RK: Quality of life of women with ovarian cancer. Gynecol Oncol 1995, 59: 231–242. 10.1006/gyno.1995.0014PubMedView ArticleGoogle Scholar
- Brooks SA: Re: Reconcilable differences: the marriage of qualitative and quantitative methods. Can J Psychiatry 1997, 42: 529–530.PubMedGoogle Scholar
- Chan DS: Combining qualitative and quantitative methods in assessing hospital learning environments. Int J Nurs Stud 2001, 38: 447–459. 10.1016/S0020-7489(00)00082-1PubMedView ArticleGoogle Scholar
- Gordon DR, Paci E: Narrative and quality of life. Philadelphia, PA. Quality Of Life And Pharmacoeconomics In Clinical Trials 2nd Edition (Edited by: SpilkerBert). Lippincott-Raven Publishers 1996, 387–395.Google Scholar
- Joos SK, Hickam DH, Gordon GH, Baker LH: Effects of a physician communication intervention on patient care outcomes. J Gen Intern Med 1996, 11: 147–155.PubMedView ArticleGoogle Scholar
- Coyle J, Williams B: An exploration of the epistemological intricacies of using qualitative data to develop a quantitative measure of user views of health care. Journal of Advanced Nursing 2000.Google Scholar
- Fottler MD, Ford RC, Bach SA: Measuring patient satisfaction in healthcare organizations: qualitative and quantitative approaches. Best Practices & Benchmarking in Healthcare 1997, 2: 227–239.Google Scholar
- Onyango-Ouma W, Laisser R, Mbilima M, Araoye M, Pittman P, Agyepong I, Zakari M, Fonn S, Tanner M, Vlassoff C: An evaluation of Health Workers for Change in seven settings: a useful management and health system development tool. Health Policy & Planning 2001.Google Scholar
- Callahan MB: Using quality of life measurement to enhance interdisciplinary collaboration. Advances in Renal Replacement Therapy 2001, 8: 148–151. 10.1053/jarr.2001.24248PubMedView ArticleGoogle Scholar
- Canam C, Acorn S: Quality of life for family caregivers of people with chronic health problems. Rehabil Nurs 1999, 24: 192–196.PubMedView ArticleGoogle Scholar
- Broadhead James K., Robinson John W., Atkinson Mark J.: A new quality-of-life measure for oncology: The SEIQoL. Journal of Psychosocial Oncology 1998, 16: 21–35.View ArticleGoogle Scholar
- Macduff C: Respondent-generated quality of life measures: useful tools for nursing or more fool's gold? Journal of Advanced Nursing 2000.Google Scholar
- McGee HM, O'Boyle CA, Hickey A, O'Malley K, Joyce CR: Assessing the quality of life of the individual: the SEIQoL with a healthy and a gastroenterology unit population. Psychological Medicine 1991, 21: 749–759.PubMedView ArticleGoogle Scholar
- O'Boyle Ciaran: The Schedule for the Evaluation of Individual Quality of Life (SEIQoL). International Journal of Mental Health 1994, 23: 3–23.Google Scholar
- Fransella Fay Key figures in counselling and psychotherapy. George Kelly Thousand Oaks, CA, Sage Publications, Inc 1995.Google Scholar
- Epting Franz R., Neimeyer Robert A.: Personal meanings of death: Applications of personal construct theory to clinical practice 1984.Google Scholar
- Greenberg Leslie S., Safran Jeremy D.: Emotion in Psychotherapy: Affect, Cognition, and the Process of Change New York, NY, Guilford Press 1987.Google Scholar
- Musch Jochen, Klauer Karl Christoph: The psychology of evaluation: Affective processes in cognition and emotion Mahwah, NJ, Lawrence Erlbaum Associates 2003, 411pp.Google Scholar
- Atkinson M, Zibin S, Chuang H: Characterizing quality of life among patients with chronic mental illness: a critical examination of the self-report methodology. Am J Psychiatry 1997, 154: 99–105.PubMedView ArticleGoogle Scholar
- Atkinson Mark J., Caldwell Lyle: The differential effects of mood on patients' ratings of life quality and satisfaction with their care. Journal of Affective Disorders 1997, 44: Netherlands. 10.1016/S0165-0327(97)00041-4View ArticleGoogle Scholar
- Kim Kyung A., Mueller Daniel J.: To balance or not to balance: Confirmatory factor analysis of the affect-balance scale. Journal of Happiness Studies 2001, 2: 289–306. 10.1023/A:1013519931082View ArticleGoogle Scholar
- Schwartz CE, Kaplan RM, Anderson JP, Holbrook T, Genderson MW: Covariation of physical and mental symptoms across illnesses: results of a factor analytic study. Ann Behav Med 1999, 21: 122–127.PubMedView ArticleGoogle Scholar
- Schwartz Robert M.: The idea of balance and integrative psychotherapy. Journal of Psychotherapy Integration 1993, 3: 159–181.View ArticleGoogle Scholar
- Pinquart Martin: Age differences in perceived positive affect, negative affect, and affect balance in middle and old age. Journal of Happiness Studies 2001, 2: 375–405. 10.1023/A:1013938001116View ArticleGoogle Scholar
- Babik Martin: Demanding life situations simulated by virtual reality: Psychometric verification of "Subjective Emotional Balance Questionnaire". Studia Psychologica 1998, 40: 357–360.Google Scholar
- Irwin Harvey J.: Affective predictors of dissociation: III. Affect balance. Journal of Psychology 1995, 129: 463–467.PubMedView ArticleGoogle Scholar
- Harding Stephen D.: Psychological well-being in Great Britain: An evaluation of the Bradburn Affect Balance Scale. Personality & Individual Differences 1982, 3: 167–175. 10.1016/0191-8869(82)90031-9View ArticleGoogle Scholar
- Osgood EC, Suci GJ, & Tannenbaum PH Urbana, IL. The measurement of meaning University of Illinois Press 1957.Google Scholar
- Bovet J, Gillieron E, Ballif JF: [Changes occurring in psychotherapy measured by the Osgood semantic differential--methodologic elaboration]. [French]. Schweiz Arch Neurol Psychiatr 1986, 137: 5–46.PubMedGoogle Scholar
- Kehoe Jerard F., Reynolds Thomas J.: Interactive multidimensional scaling of cognitive structure underlying person perception. Applied Psychological Measurement 1977, 1: 155–169.View ArticleGoogle Scholar
- Dickinson John R.: The bibliography of marketing research methods 3rd Edition Lexington, MA, Lexington Books 1990.Google Scholar
- Thomas RE, Smith Joan M., Spence PA: Wheeling and dealing: A new approach to the collection of attitude and motivational data by the use of semantic differential scales. Journal of the Market Research Society 1968, . 10: 78–86.Google Scholar
- Bell TN: Nurses' attitudes in caring for the comatose head-injured patient. J Neurosci Nurs 1986, 18: 279–289.PubMedView ArticleGoogle Scholar
- Chotai J, Eisemann M: Perception of spouse in relation to perception of self by semantic differentials in depressed patients and their spouses. Acta Psychiatr Scand 1994, 90: 114–119.PubMedView ArticleGoogle Scholar
- Nekolaichuk CL, Jevne RF, Maguire TO: Structuring the meaning of hope in health and illness. Soc Sci Med 1999, 48: 591–605. 10.1016/S0277-9536(98)00348-7PubMedView ArticleGoogle Scholar
- Vora S, Layman WA, Mann ET, Danesino A: The effects of long-term psychotherapy on patients' self-perception. Dis Nerv Syst 1977, 38: 717–721.PubMedGoogle Scholar
- Willson P, McNamara JR: How perceptions of a simulated physician-patient interaction influence intended satisfaction and compliance. Soc Sci Med 1982, 16: 1699–1704. 10.1016/0277-9536(82)90095-8PubMedView ArticleGoogle Scholar
- Derrickson PE: Instruments used to measure change in students preparing for ministry: a summary of research on clinical pastoral education students. J Pastoral Care 1990, 44: 343–356.PubMedGoogle Scholar
- WR. Crawford: Attitudinal and perceptual shifts of nurse practitioners toward their new professional role. Research Memorandum 1976., 18, NTIS Order Number: HRP-0017554: Google Scholar
- Morrison James K., Heeder Robyn: Follow-up study of psychotherapeutically-induced change in clients' constructs of self. Psychological Reports 1986, 59: 537–538.PubMedView ArticleGoogle Scholar
- Mohl PC, Martinez D, Ticknor C, Huang M, Cordell L: Early dropouts from psychotherapy. J Nerv Ment Dis 1991, 179: 478–481.PubMedView ArticleGoogle Scholar
- Speca M, Robinson JW, Goodey E, Frizzell B: Patients evaluate a quality of life scale: whose life is it anyway? Cancer Pract 1994, 2: 365–370.PubMedGoogle Scholar
- McHorney CA, Ware JE, Lu JF, Sherbourne CD: The MOS 36-item short-form health survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups . Med Care 1994, 32: 40–66.PubMedView ArticleGoogle Scholar
- McHorney CA, Ware JE, Raczek AE: The MOS 36-item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs . Med Care 1993, 31: 247–263.PubMedView ArticleGoogle Scholar
- Ware JE, Sherbourne CD: The MOS 36-item short-form health survey (SF-36): I. Conceptual framework and item selection. Med Care 1992, 30: 473–483.PubMedView ArticleGoogle Scholar
- Ware JE, Kosinski M, Dewey JE: How to score Version 2 of the SF-36 Health Survey (Standard and Acute Forms). Lincoln, RI, QualityMetric Incorporated 2000.Google Scholar
- Ware JE, Snow K, Kosinski M, Gandek B: SF-36 Health Survey Manual and Interpretation Guide. Boston, MA, The Health Institute, New England Medical Center Hospitals, Inc 1993.Google Scholar
- Ellwood PM: Shattuck lecture--outcomes management. A technology of patient experience. N Engl J Med 1988, 318: 1549–1556.PubMedView ArticleGoogle Scholar
- Geigle R, Jones SB: Outcomes measurement: a report from the front. Inquiry 1990, 27: 7–13.PubMedGoogle Scholar
- Hatch RL, Burg MA, Naberhaus DS, Hellmich LK: The Spiritual Involvement and Beliefs Scale. Development and testing of a new instrument. J Fam Pract 1998, 46: 476–486.PubMedGoogle Scholar
- Adams Troy, Bezner Janet, Steinhardt Mary: The conceptualization and measurement of perceived wellness: Integrating balance across and within dimensions. American Journal of Health Promotion 1997, 11: 208–218.PubMedView ArticleGoogle Scholar
- Atkinson Mark J., W.C. Stewart, J.M. Fain, J.A. Stewart, Dhawan R, Mozaffari E, Lohs J: A New Measure of Patient Satisfaction with Ocular Hypotensive Medications: The Treatment Satisfaction Survey - Intraocular Pressure (TSS-IOP). Health and Quality of Life Outcomes 2003, 1: Manuscript # 67. 10.1186/1477-7525-1-67View ArticleGoogle Scholar
- Bonomi AE, Patrick DL, Bushnell DM, Martin M: Quality of life measurement: will we ever be satisfied? Journal of Clinical Epidemiology 2000.Google Scholar
- Hays RD, Anderson R, Revicki DA: Psychometric considerations in evaluating health-related quality of life measures. Quality of Life Research 1993, 2: 441–449.PubMedView ArticleGoogle Scholar
- Nunnally JC: Psychometric Theory. Psychosomatic Medicine 2 Edition New York, NY: McGraw-Hill 1978.Google Scholar
- Lazarus Richard S.: Coping theory and research: Past, present, and future. Psychosomatic Medicine 2004, 55: US.Google Scholar
- Price JR: Managing physical symptoms: the clinical assessment as treatment. J Psychosom Res 2000, 48: 1–10. 10.1016/S0022-3999(99)00070-7PubMedView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.