Comparison of the NEI-VFQ and OSDI questionnaires in patients with Sjögren's syndrome-related dry eye

Dry eye is a common disorder of the ocular surface and tear film and is estimated to affect from 2% to over 15% of persons in surveyed populations, depending on the definition used [1–6]. Symptoms of dry eye are a major reason to seek ophthalmic care: a study by Nelson and co-workers found that 1.3% of Medicare patients had a primary diagnosis of keratoconjunctivitis sicca or dry eye [7]. Dry eye can range from mild to severe disease; although the majority of patients with dry eye experience ocular discomfort without serious vision-threatening sequelae, severe dry eye can compromise corneal integrity by causing epithelial defects, stromal infiltration, and ulceration, and can result in visually significant scarring [8]. Moderate to severe dry eye disease can adversely affect performance of visually demanding tasks due to pain and impaired vision [9]. In addition, corneal surface irregularity due to epithelial desiccation, quantified by using corneal topography, can decrease visual acuity [10].

Patient-reported measurements used to evaluate the specific impact of eye disease and vision on symptoms (discomfort), functioning (the ability to carry out activities in daily life), and perceptions (concern about one's health) are referred to as vision-targeted health-related quality of life (VT-HRQ) instruments. Valid and reliable measurements of VT-HRQ have become essential to the assessment of disease status and treatment effectiveness in ocular disease [11]. There are two general categories of VT-HRQ instruments: generic, which are designed to be used for a broad spectrum of visual disorders and ocular disease; and disease-specific, which are tailored toward particular aspects of a specific ocular disorder. In general, disease-specific instruments tend to be more sensitive than generic ones in detecting VT-HRQ impairments [12]; however, generic instruments allow comparisons across more diverse populations and diseases [13]. In addition, generic instruments may be able to capture additional aspects of systemic disease, related to the ocular disorder in question, providing a broader characterization of health-related quality of life [14, 15]. There is therefore no clear-cut basis in a given study or population for choosing a generic versus a disease-specific measure: if possible, both should be utilized to determine whether one or the other is more consistent with clinical indicators, or if one appears to obtain additional, relevant information on patient status [16]. However, it may be the case that weak-to-moderate associations between clinical indicators and quality-of-life measures indicates that the VT-HRQ measure is capturing elements of disease above and beyond those that can be measured clinically (for example, visual acuity may be good but a patient may have problems with functioning related to problems with contrast sensitivity or glare disability). Again, depending on the characterization of the disease desired and the goal of the study, a researcher might choose an instrument that either is or is not strongly correlated with clinical signs.

The measurement of the impact of dry eye on a patient's daily life, particularly symptoms of discomfort, is a critical aspect of characterizing the disease [17]. Despite the fact that most studies have found weak or no correlations between symptoms and signs of dry eye [18–20], symptoms are often the motivation for seeking eye care and are therefore a critical outcome measure when assessing treatment effect [7], and hence are increasingly used as a surrogate for ocular surface disease in many epidemiologic studies. Indeed, recent studies have focused on developing more robust ways of measuring patient-reported symptoms of dry eye [21–23]. The Ocular Surface Disease Index (OSDI)^© [24] was developed to quantify the specific impact of dry eye on VT-HRQ.

Sjögren's Syndrome is an autoimmune systemic disease characterized by dry mouth and dry eye signs and symptoms [25, 26]. Its manifestations include fatigue, arthritis, neuropathy, and pulmonary and renal disease. Histopathologic evidence of salivary gland inflammation and the presence of serum autoantibodies SSA or SSB are important diagnostic features of the disease [27]. Sjögren's Syndrome has been stated to be the second most common autoimmune disease, ranking between rheumatoid arthritis and systemic lupus erythematosus [27]. In the U.S., it is estimated that between 1 and 4 million persons (approximately 1–2 in 200) have Sjögren's Syndrome [28]. Prevalence estimates for other countries range from 0.3 to 4.8% [29]. Female gender and older age are known risk factors for Sjögren's syndrome [30]. A wide range of studies have assessed the ocular manifestations of Sjögren's syndrome [31–33]; however, assessment of symptoms and quality of life have been limited and, in most cases, generic measures of well-being, psychological distress, and fatigue without ocular dimensions have been employed [34–40]. Further, while there are many published studies of VT-HRQ in mild to moderate dry eye, there are few publications on VT-HRQ in Sjögren's syndrome, which is characterized by dry eye causing significant ocular irritation as well as systemic disease factors that could have their own additional significant impact on VT-HRQ.

Our purpose in this study was to examine VT-HRQ in patients with primary Sjögren's syndrome, using a generic and a dry-eye-disease-specific instrument. We examined the associations of ocular surface parameters with the VT-HRQ scores, hypothesizing that the disease-specific instrument would be more closely related than the generic to the clinical markers of disease. We also examined the association of the generic and disease-specific VT-HRQ scores with each other.

The study protocol was approved by the National Eye Institute Internal Review Board. All patients completed an informed consent prior to examination. Consecutive patients with diagnosed primary Sjögren's syndrome were recruited from the NIH Clinical Center, Bethesda, MD. The diagnosis of primary Sjögren's syndrome was based on European-American criteria, which requires at least four of the following six features: signs and symptoms of dry eye and of dry mouth, histopathologic evidence of inflammation on minor salivary gland biopsy, and positive anti-Ro or anti-La antibodies.

Before the clinical examination, a trained interviewer administered two questionnaires (described further below) to measure VT-HRQ to each patient. The subsequent clinical examination included a comprehensive anterior segment evaluation, including slit lamp biomicroscopy, evaluation of lid margin thickness and hyperemia, conjunctival erythema, chemosis, tear film debris and mucus, and extent of meibomian gland plugging. Tests of tear function and ocular surface status were performed as described below.

The OSDI [24] (provided by Allergan, Inc. Irvine, CA) was used to quantify the specific impact of dry eye on VT-HRQ. This disease-specific questionnaire includes three subscales: ocular discomfort (OSDI-symptoms), which includes symptoms such as gritty or painful eyes; functioning (OSDI-function), which measures limitation in performance of common activities such as reading and working on a computer; and environmental triggers (OSDI-triggers), which measures the impact of environmental triggers, such as wind or drafts, on dry eye symptoms. The questions are asked with reference to a one-week recall period. Possible responses refer to the frequency of the disturbance: none of the time, some of the time, half of the time, most of the time, or all of the time. Responses to the OSDI were scored using the methods described by the authors [24]. Subscale scores were computed for OSDI-symptoms, OSDI-function, and OSDI-triggers, as well as an overall averaged score. OSDI subscale scores can range from 0 to 100, with higher scores indicating more problems or symptoms. However, we subtracted the OSDI overall and subscale scores from 100, so that lower scores would indicate more problems or symptoms.

The 25-item NEI Visual Function Questionnaire (NEI-VFQ) [41, 42] is a non-disease-specific (i.e., "generic") instrument designed to measure the impact of ocular disorders on VT-HRQ. Depending on the item, responses to the NEI-VFQ pertain to either frequency or severity of a symptom or functioning problem. A recall period is not specified in the questionnaire. Responses to the NEI-VFQ were scored using the methods described by the authors [43]. Subscale scores for general vision, ocular pain, near vision, distance vision, social functioning, mental functioning, role functioning, dependency, driving, color vision, and peripheral vision, as well as an overall score, were computed. The NEI-VFQ scores can range from 0–100, with lower scores indicating more problems or symptoms.

Schirmer tests of tear production without and with anesthesia were performed by inserting a Schirmer tear test sterile strip (35 mm, Alcon Laboratories, Inc, Fort Worth, TX) into the inferior fornix, at the junction of the middle and lateral third of the lower eyelid margin, for 5 minutes with the eyes closed. The extent of wetting was measured by referring to the ruler provided by the manufacturer on the envelope containing the strips. Possible scores range from 0 to 35 mm, with lower scores indicating greater abnormality in tear production. This test was repeated after instillation of topical anesthetic, 0.5% proparacaine [44]. A Schirmer without anesthesia score of ≤ 5 mm in at least one eye is one required element of dry eye, as defined by the European-American Sjögren's syndrome diagnostic criteria [45].

The assessment of ocular surface damage was performed by a cornea specialist using vital dye staining with 2% unpreserved sodium fluorescein and then 5% lissamine green dye. The corneal, temporal, and nasal regions of the conjunctiva were scored individually from 0–5 (for fluorescein) and 0–5 (for lissamine green) using the Oxford grading scheme [46]. The Oxford score was derived by adding the scores for corneal fluorescein and nasal plus temporal conjunctival lissamine green staining. Total Oxford score could range from 0–15. The van Bijsterveld score [47] (VB) was assessed using lissamine green staining of the cornea (0–3) and conjunctiva (0–3). Total VB score could range from 0–9. For all staining tests, higher scores indicate worse ocular surface damage.

Tear film stability was assessed using fluorescein tear film breakup time (TBUT). Five microliters of 2% sodium fluorescein was instilled into the inferior fornix and the patient was asked to blink several times. Using the cobalt blue filter and slit lamp biomicroscopy, the duration of time required for the first area of tear film breakup after a complete blink was determined. If the TBUT was less than 10 seconds, the test was repeated for a total of 3 values and the average was calculated.

For analysis, for each individual, the maximum (worse) score for the two eyes was used for Oxford score and VB, and the minimum (worse) score for the two eyes was used for Schirmer with and without anesthesia and for TBUT. TBUT values greater than or equal to 10 seconds [48] were coded as 10 (normal) and < 10 seconds was defined as abnormal. Schirmer without anesthesia score result of ≤ 5 mm or VB ≥ 4 were used as objective evidence of dry eye, following the European / American criteria for the diagnosis of dry eye for Sjogren's syndrome [49].

Hypotheses of specific associations were formulated based on the areas and domains assessed by the two VT-HRQ instruments. Scatterplots and Spearman's correlation coefficient (ρ) [50] were used to examine associations between pairs of variables. Multiple linear regression [51] was used to assess the strength of association between pairs of variables while adjusting for confounders (e.g., age).

We compared subscale scores for an ocular surface disease-specific instrument (OSDI) with a generic VT-HRQ instrument (NEI-VFQ-25) in patients with a systemic autoimmune disease associated with moderate to severe dry eye. We found that patients with primary Sjögren's syndrome had OSDI scores (mean, 30, before subtraction from 100) similar to those previously published [24] for moderate to severe dry eye patients (mean score was 36 for severe cases). Despite the fact that all of our patients had Sjögren's syndrome, with moderate to severe dry eye, we found that correlations of ocular surface parameters with VT-HRQ (i.e., patient-reported) parameters tended to be weak or nonexistent, consistent with several other studies demonstrating poor correlations between signs and symptoms of dry eye [18–20]. Indeed, contrary to our expectations, NEI-VFQ correlations with objective ocular surface parameters tended to be higher than those of OSDI, although all were relatively modest (all < 0.35) and none reached statistical significance.

One explanation could be that the nature of the items for each of these instruments is quite different. The OSDI queries the frequency of a symptom or difficulty with an activity, over a one week recall period. The NEI-VFQ incorporates questions both the frequency and intensity of symptoms and their impact on activities, with no specified recall period. Perhaps this added element of capturing both the frequency and intensity of a symptom or impact accounts for some of the differences we found. For subscales that are similar, agreement was higher but still moderate, possibly due to differences in the nature of the questions or response options. The OSDI is targeted to assess how much the symptoms of dry eye affect the patient's current status (i.e., in the past week), whereas the NEI-VFQ may be more suited to capturing the overall impact of a chronic ocular disease on VT-HRQ.

In this group of primary Sjögren's syndrome patients, associations between subscales of the NEI-VFQ and OSDI were moderate to strong (< 0.70) and in hypothesized directions. Significant associations were seen between OSDI and NEI-VFQ overall scales; OSDI-symptoms and NEI-VFQ ocular pain; and OSDI-function and NEI-VFQ general vision and driving. This suggests that both instruments are capturing important aspects of VT-HRQ. It is not surprising that the highest correlations were observed between subscales with similar domains, which serves to validate the use of alternate methodologies. On the other hand, it is counter-intuitive that the generic and disease-specific instruments appeared similar (or that the generic seemed to do a little better) with respect to their association with objectively measured clinical signs of dry eye, as the NEI-VFQ was designed to capture broader aspects of VT-HRQ. For the NEI-VFQ, we found moderate correlations (greater than 0.3) of distance vision with VB and near vision with TBUT. This was surprising, as one may have expected that subscales measuring ocular discomfort or pain (i.e., more disease-specific for dry eye) would have the strongest correlations with clinical measures of dry eye. Clinical signs of dry eye include measures of tear production, ocular surface staining, and tear film break-up; visual acuity and other aspects of visual function are not generally as widely used. However, some investigators have reported that visual acuity in dry eye patients is correlated with decreased spatial contrast sensitivity [52] and is functionally reduced with sustained eye opening due to increased surface irregularity which can be detected with corneal topography [53, 10], which could explain our finding of moderate associations of ocular surface measures with near and distance vision. It has been proposed [10] that "subtle visual disturbance" is an important reason for dry eye patients to seek care. Indeed, improvement in blurred vision symptoms was one of the most frequently reported benefits of topical cyclosporine treatment for dry eye in a large, multicenter clinical trial [54]. The impact of the quality of vision or functional visual acuity on VT-HRQ has not been a focus of studies of the subjective aspects of dry eye. Our data indicate that the impact of dry eye on VT-HRQ is only partially accounted for by ocular pain in patients with severe dry eye, such as in Sjogren's syndrome.

Would we expect the associations to be different in Sjögren's patients? Sjögren's syndrome is an autoimmune exocrinopathy and effects of its systemic nature and chronicity on dry eye may have been more readily captured by the NEI-VFQ's ability to measure both frequency and intensity of problems with VT-HRQ. In contrast, although the OSDI includes items to measure function, responses are limited to the frequency of problems. Because the type of dry eye in Sjögren's syndrome is more likely to be severe, and all patients in our study had Sjögren's-related dry eye, we speculated that somewhat stronger associations between signs and symptoms might be observed. On the other hand, ocular surface inflammation and decreased corneal sensation are features of severe dry eye which might alter a patient's perception of symptoms of ocular irritation and might be the cause of weaker correlations between signs and symptoms [48, 55]. Indeed, reduced corneal sensation could provide inadequate feedback through the ophthalmic nerve to the central nervous system, resulting in less efferent stimulation to the lacrimal gland with reduced tear production and promotion of a vicious cycle. In addition, meibomian gland dysfunction plays a key role in dry eye in Sjögren's syndrome [56]. Therefore, aqueous and evaporative tear deficiency may combine to produce a particularly diseased ocular surface.

In addition to clinical signs, it is important to include assessments of VT-HRQ and visual function to fully characterize the impact of dry eye on health status. The correlation between signs and VT-HRQ are modest at best, indicating that VT-HRQ is capturing an additional component of disease that is not captured by the clinical assessment. This does not necessarily mean that the measures of VT-HRQ or the methods of detecting clinical signs are deficient, but rather that VT-HRQ is an additional element of the overall impact of this disease process on affected individuals. Furthermore, in diseases with systemic manifestations, such as Sjögren's syndrome, that may have an influence on quality of life independent of dry eye symptoms, appropriate tests of VT-HRQ are critical to completely characterize quality of life in these patients. It may also be valuable to explore possible differences in associations of clinical signs with VT-HRQ in patient populations with different manifestations or causes of dry eye.