Validation of a Greek version of the oral health impact profile (OHIP-14) for use among adults

Abstract

Background

To test the validity of the short form of the Oral Health Impact Profile (OHIP-14) for use among adults in Greece.

Methods

The original English version of the OHIP-14 was translated using the forward-backward technique, pilot-tested, and then applied to 211 adults aged 35 years and above. The questionnaire was filled out during face-to-face interviews conducted by one dentist, while individuals were asked to undergo a clinical examination. The internal consistency of the questionnaire was evaluated using Cronbach's alpha (α) coefficient and inter-item and item-total correlations. Discriminant and convergent validities were assessed.

Results

Cronbach's α was estimated to be 0.90. Inter-item correlations coefficients ranged from 0.10 to 0.83, while item-total correlations coefficients from 0.44 to 0.76. Significant associations were found between OHIP-14 and the decayed, missing and filled teeth (DMFT) and oral hygiene, supporting the ability of the questionnaire to discriminate between individuals with and without impacts. The OHIP-14 total score was highly associated with self-perceived oral health status (r_s = 0.57; p = 0.01), as well as with self-assessment of oral satisfaction (r_s = 0.55;p = 0.01). Similar results were observed by investigating the relationship between the latter questions and each domain score as well as in various sub-groups analyses.

Conclusions

The OHIP-14 is a reliable and valid questionnaire for the assessment of OHRQoL among adults in Greece.

Background

Health-Related Quality of Life (HRQoL) is a multi-dimensional concept, which refers to patients' physical, psychological and social well-being, and is widely recognised for the assessment of healthcare outcomes. A factor, however, that can significantly impact on the construct of HRQoL is the oral health of the individual. Oral Health-Related Quality of Life (OHRQoL) measures have been widely used in the evaluation of oral health needs and combined with clinical indicators in order to better identify not only patients' symptoms due to oral diseases but also patients' ability to perform their daily activities [1, 2]. One of the most widely known OHRQoL instruments is the short form of the Oral Health Impact Profile consisting of 14 items (OHIP-14), which is derived from the original 49-item version developed by Slade and Spenser [3], for the measurement of disability and discomfort due to oral conditions. This instrument has been translated and validated in many languages in different regions of the world [4–13]. In Greece, so far and to our knowledge only one OHRQoL measure has been tested for validity in an adult population: the Oral Impacts on Daily Performance (OIDP) [14], while no such attempt regarding the OHIP-14 has been undertaken. The latter shows slightly better correlation with clinical measures of oral health status [15] and appears to be more useful to discriminate between groups with and without impacts in population surveys [16].

The objective of this study was to translate the original English version of the OHIP-14 into Greek, and test its validity and reliability for use among Greek adults.

Methods

A Greek version of the OHIP-14 was developed and its psychometric properties were tested in 2 stages: 1) a linguistic translation of the original OHIP-14 into Greek and 2) completion of a main study to evaluate the construct's validity.

For the OHIP-14 to be translated, four independent translations were conducted: two forward and two backward translations. Following comparison of these two forward translations, to ensure the best interpretation of the original version, the preliminary Greek version of the OHIP-14 was generated. Afterwards, two independent bilingual individuals unfamiliar with the original version, whose first language was English, were asked to conduct the backward translations. The backward translations were then compared to the original English version to check the similarity of their structure. The final version of the Greek OHIP-14 was produced after minor modifications were made according the results of a pilot study. The participants consisted of a convenience sample of 20 adult patients undergoing a dental check-up in the University of Athens Dental School. Those presenting with acute dental problems or oral disease were excluded.

Sample design

The study was conducted in the two metropolitan regions of Athens and Thessaloniki, where according to the latest Population Census (2001) 45% of the Greek population resides. The sample units were the same as for the National Pathfinder Survey [17] and consisted of: i) the examination clinics of the Dental Schools of Athens and Thessaloniki ii) dental clinics of the Social Insurance Fund of Greece (IKA) in Athens and Thessaloniki and iii) a selected professional corporation. These units were selected based on: a) the availability of an appropriate middle-age group of the population in one place, b) the possibility to perform a clinical examination along with completion of a questionnaire and 3) the population found in these units, in terms of their socio-demographic strata and oral health condition, were closer to the characteristics of the General population based on the findings of the National Pathfinder survey [17].

Thus, a consecutive sample of 211 healthy Greek individuals aged 35 yrs and above visiting the aforementioned sampling units for dental check-up or treatment were interviewed and clinically examined.

All subjects were acquainted with the purpose of the study, which was ethically approved by the Research Committee of the School of Dentistry. Out of 250 approached individuals, 211 agreed to participate in the study (a response rate of 84%), all of who provided informed consent.

A self-administrated questionnaire was designed and one dentist trained in OHRQoL terms conducted face-to-face interviews. Participants were asked to evaluate on a 5-point Likert scale (0 = never, 1 = hardly ever, 2 = occasionally, 3 = fairly often and 4 = very often) how frequently during the last year had experienced any of the problems assessed by the 14-item OHIP. Data regarding their socio-demographic profile were also recorded. Besides OHIP-14, the questionnaire also included items for the assessment of the different types of construct validity given the absence of a universally accepted "gold standard"(i.e., self-perceived general and oral health status). After the completion of the questionnaire, all participants underwent a clinical examination. One experienced and calibrated dentist recorded the number of decayed, missing and filled teeth according to the BASCD criteria [18], as well as the Oral Hygiene Index, in accordance with which subjects' hygiene might be categorized into 3 sub-groups representing good (0-1.2), fair (1.3-3.0) or poor (3.0-6.0) oral hygiene respectively [19].

Scoring Method and Data Analysis

The OHIP-14 score was calculated using the additive method. Statistical analysis was performed using the Statistical Package for Social Sciences (SPSS) v.19.

To assess the reliability of the OHIP-14, Cronbach's α coefficient was used. In addition, the impact on the alpha value by the removal of OHIP-14 items (alpha if item deleted) was evaluated, as well as inter-item and item-total correlations.

Two types of construct validity were used. First, discriminant validity was evaluated by examining the association between the OHIP-14 total score and participants' dental status as assessed by the clinical examination. Mann-Whitney or Kruskal-Wallis test was used to assess the significance of differences between groups. Secondly, the convergent validity of the OHIP-14 was assessed by investigating the association (Spearman's correlation coefficient (r_s)) among OHIP-14 total score and each domain score with self-perceived oral health status (good, fair and poor), and self-assessment of oral satisfaction (satisfied, dissatisfied). Participants' perception about their general health status was also associated with the OHIP-14 total score. Furthermore, sub-group analyses was performed in order to evaluate possible differences according to the region, Athens or Thessaloniki or the sampling cluster units - University dental clinics or social insurance dental clinics (selected corporation professionals due to the small participants number (n = 6) were merged with the social insurance sub-group). Finally, in order to further validate these results regression analysis was pursued where the dependent variable was the OHIP-14 total score and the independent variables were the subscales of OHIP-14.

All descriptive and model based results were derived by taking into account the hierarchical nature of the sample (i.e. individuals clustered in dental clinics) while in the multivariate model the adjusting factors for gender, residence, education, and occupational status were taken into account in order to minimize potential confounding effects.

Results

In total, 211 individuals participated in the study with a mean age of 53.3 years (S.D. 15.4), with the majority being females (52.9%), employed (51.1%), with secondary education (57%) and living in the capital of Athens (53.8%). The mean value of the decayed, missing and filled teeth (DMFT) index was 16.8 (S.D. 7.7), with 1.0 (S.D. 1.9) being decayed, 10.8 (S.D. 10.1) missing and 5.0 (S.D. 4.9) filled teeth. Finally, the mean number of present teeth (including abutment teeth) was estimated to be 21.1 (S.D. 10.1), while 48.5% of the sample had good, 36.3% fair, and 15.2% poor oral hygiene.

In order to examine the possible design effect of our study, we stratified our analysis according to the sampling region (Athens or Thessaloniki) and to the sampling cluster units (university or social insurance dental clinics). The number or defined clusters were as follows: from Athens, one University dental clinic with 23 participants, and 4 Social Insurance dental clinics with 84 participants (6 participants came from a professional corporation but due to the small size we merged them with one of the Social Insurance dental clinics). From Thessaloniki, 49 participants came from the University dental clinic and 49 participants came from two Social Insurance dental clinics.

By analyzing participants' OHRQoL data, a high level of oral health impacts was observed. More specifically, the mean total score of the OHIP-14 was 14.9 (S.D. 10.0), with the most affected sub-scales being those of Functional Limitation and Psychological Discomfort both with a mean value of 2.9 (S.D. 2.0). The Physical pain sub-scale was also highly rated (mean 2.6, S.D. 2.0), followed by the Handicap (mean 2.2, S.D. 1.5) and Physical Disability (mean 2.0, S.D. 1.9) sub-scales. Finally, the least affected sub-scales were Psychological and Social Disability with mean values 1.4 (S.D. 1.8) and 1.0 (S.D. 1.4) respectively.

Reliability

The Cronbach's alpha value of the OHIP-14 was estimated to be 0.90, representing an excellent internal consistency. The removal of one item at a time resulted in lower alpha values than the original one, supporting the inclusion of all items. By analyzing the matrix of inter-item correlations (Table 1), a positive correlation between all items was found. Finally, as it is shown in Table 2 the item-total correlations coefficients were above 0.20, which is recommended as the minimum value for including an item in a scale [20]. Sub-group analyses confirmed the stability of the above findings regardless metropolitan region or dental clinic variations (Table 3).

Table 1 Reliability analysis based on the OHIP inter-item correlation.

Table 2 Reliability analysis based on the corrected item-total correlation and Cronbach's alpha coefficient if item deleted.

Table 3 Reliability analysis based on the corrected item-total correlation and Cronbach's alpha coefficient if item deleted according to the sampling region and the sampling cluster units of the study.

Construct Validity

In Table 4 the results of the assessment of discriminant validity are presented. As hypothesised, participants' with a high OHIP-14 score presented a higher number of decayed and missing teeth and a lower number of natural and filled teeth. All differences were statistically significant. The ability of the OHIP-14 to discriminate between groups was also confirmed by evaluating its association with the Oral Hygiene Index. Participants with poor oral hygiene had higher OHIP scores than those with fair or good oral hygiene (p < 0.01).

Table 4 Discriminant validity of the OHIP-14 based on the clinical status of the subjects.

With regard to the convergent validity of the OHIP-14, it was estimated that as the participants' perceived oral health status changed from poor to good both the mean OHIP total score and the subscales scores increased (Table 5). All the Spearman's rank correlation coefficients were positive and statistically significant. No significant differences in our results were noted when the effect of the sampling region of the study (Athens or Thessaloniki) or the sampling cluster units (university or social insurance dental clinics) was accounted for (Table 6). Moreover, similar results were observed by associating the OHIP-14 total score with participants' perception of their general health status. Those who evaluated their general health status being good, had a lower OHIP-14 score than those reporting fair or poor general health status, whilst the Spearman's rank correlation coefficient was 0.22, significant at the 0.01 level.

Table 5 Convergent validity of the OHIP-14: Mean scores and Spearman's rank Correlation coefficients among the OHIP-14 and subscale scores and self-perceived Oral health status.

Table 6 Convergent validity of the OHIP-14: Mean scores and Spearman's rank Correlation coefficients among the OHIP-14 and subscale scores and self-perceived Oral health status according to the sampling region and the sampling cluster units of the study.

The convergent validity of the OHIP-14 was also supported by examining the relationship among the OHIP-14 total score and each domain score with self-assessment of oral satisfaction. According to Table 7 in which the findings of this association are summarized, participants who were not satisfied with their oral health status had statistically significant higher OHIP-14 or sub-scale scores compared to those who were. Similar patterns of results were observed regarding the convergence validity of the OHIP-14 with the participants' perceived oral satisfaction when differences in the sampling region or in the place where the study conducted were assessed by sub-group analyses except for the non-significant association for the Handicap sub-scale in the Athens sample (Table 8).

Table 7 Convergent validity of the OHIP-14: Mean scores and Spearman's rank correlation coefficients among the OHIP-14 and subscale scores and self-assessment of oral satisfaction.

Table 8 Convergent validity of the OHIP-14: Mean scores and Spearman's rank correlation coefficients among the OHIP-14 and subscale scores and self-assessment of oral satisfaction by the sampling region and the sampling cluster units of the study.

When examining the validity of the OHIP-14 scale one should not restrict himself to simple bivariate relationships since some possible confounding factors related to age, sex, place of residence, education and occupation should be taken into consideration. In the present analysis multivariate techniques based on regression analysis were adopted in order to avoid confounding bias. The dependent variable was the OHIP-14 total score and the independent variables were the subscales of OHIP-14 including the control variables for age, sex, place of residence, education and occupational status. From the seven subscales of OHIP-14, the dimension Handicap was selected to be excluded because of having the lowest correlation coefficient (r = 0.545) with OHIP-14 total score. The remaining six dimensions presented much higher correlation coefficients with OHIP-14 total score ranging from (r = 0.672) for Social Disability to (r = 0.867) for Physical Discomfort.

The results of the multivariate analysis with the best possible fit (after examining several models) are shown in Table 9. The value of adjusted R² (coefficient of determination) reveals that the estimated model explains approximately 99% of the variance of the dependent variable (OHIP Total Score). All the remaining dimensions of OHIP-14 (Physical Disability, Social Disability, Physical Discomfort, Physical Pain, Functional Limitation and Psychological Discomfort) are statistically significant at the p < 0.001. In addition the control variables of residence appears to be significant at the p < 0.005 level.

Table 9 Multivariate Regression Analysis between OHIP-14 Total Score (Dependent variable) and the subscales of OHIP-14 (Independent variables) adjusting for Gender, Residence, Education, and Occupational status.

Discussion

This study aimed to generate and evaluate the Greek version of the OHIP-14, in terms of validity and reliability, for use among adult population. To this effect, the original English version of the OHIP-14 was translated using the forward-backward technique, pilot-tested in a convenience group of adults and then applied to a sample of the Greek population having approximately the same socio-demographic and oral health conditions, in order for its validity and reliability to be tested. A mean DMFT of 16.8 (S.D. 7.7) of this population (with a mean age of 53.3 years) is between the value of 14.06 and 20.63 found in the National pathfinder survey for the 34-44 and the 65-74-year-old Greek adults respectively [17]. The findings of our study, which is the first using the OHIP-14 in Greece confirm that the OHIP-14 is a reliable and valid instrument for the measurement of OHRQoL among adults in Greece.

The internal consistency of the Greek OHIP-14 was found to be excellent, with the Cronbach's alpha coefficient greatly exceeding the minimum recommended value of 0.7 [16, 21]. Moreover, the Cronbach's alpha coefficient reported in our study was slightly better than those reported by Slade [21] in the original English version, as well as than those observed by Montero-Martin et al[12] who tested the reliability of the OHIP-14 among adult population in Spain, but the same with that found for Swedish adults [22]. In addition, lower alpha values were observed by the omission of any of the 14 items, which provides further evidence about the internal consistency of the present version of the OHIP-14.

The substantial internal consistency of the instrument was also supported by the findings regarding inter-item and item-total correlations. Specifically, all the inter-item correlations were positive, and none was high enough for any item to be redundant, while the item-total correlations coefficients were above the recommended threshold for including an item in a scale. Similar results have been observed in the Spanish [12] and the Sinhalese version [23] of the OHIP-14, both evaluating the reliability of the instrument among adults. As mentioned, the OHIP-14 proved to be a valid measure for assessing OHRQoL among Greek adults. This was firstly confirmed by its ability to discriminate between groups with different oral health status, which was objectively assessed by clinical measures. It was found that the more frequent the presence of oral conditions such as tooth loss or dental caries the greater the impact on individuals' OHRQoL. Indeed, it was found in the present study that the presence of less than 25 teeth negatively affects the OHRQoL measures (p < 0.01) in adults, confirming a previous study in the UK [24].

Moreover, a statistically significant association was found between questions aiming to subjectively evaluate individuals' oral health status (such as self-perceived oral health status and self-assessment of oral satisfaction) and OHIP-14 scores. This provided further evidence for the instrument's construct validity, since it was shown that the higher the OHIP-14 total and the subscale scores, the more diminished the OHRQoL, and thus the poorer the perceived oral health status and satisfaction. Similar findings were presented for the UK by McGrath and Bedi [24]. Finally, the fact that the Spearman's rank coefficient for the association between the OHIP-14 total score and self-perceived oral health status was higher than those for the association between the OHIP-14 total score and self-perceived general health status (0.57 vs. 0.22), is not only in accordance with previous findings in the literature [12, 25], but also inarguably supports the specificity of the index.

Concerning the calculation of sample size, a confidence interval of +/-3% is considered desirable in high quality surveys. By keeping confidence intervals narrow we increase the expectation of making accurate statistical inferences, but a sample size of more than 1,300 subjects would be necessary to satisfy this principle. However, for validation studies this large number is impractical. In the current study the sample size of 211 individuals gives us a confidence interval of 6.7%. Indeed, in the literature similar studies have used similar sample sizes or ever smaller [4, 7, 9, 11, 12] whereas other fewer studies [5, 8, 23] in larger populations are based on larger sample sizes to validate the Oral Health Impact Profile (OHIP-14).

Strengths and limitations of the study

An important strength of this study is that the selected sample was from the two largest cities of Athens and Thessaloniki, in which the same sample units as for the National Pathfinder survey [17] were utilized. This ensured that the current sample had sociodemographic and oral health conditions similar to those found in the survey for adult Greeks. The second is that the same person who undertook the interview was also a calibrated dentist. Therefore it was possible to combine quality of life subjective data with objective assessment of oral health based on clinical examination.

This study has several limitations. First the generalizability of quality of life findings might be limited to adult population of 35 years and above. Second, due to absence of "gold standards" in Greece, comparisons are not drawn with other quality of life instruments.

Conclusions

The present findings indicate that the OHIP-14 is a reliable and valid measure to be used in studies focusing on the measurement of adults' OHRQoL in Greek adults, where although several HRQoL studies have been conducted for certain disease categories [26, 27] little is known on whether the common oral health problems have an impact on OHRQoL of the individuals of the general population.