Estimation of utility weights for human papilloma virus-related health states according to disease severity

Abstract

Background

A cost-utility study of a human papilloma virus (HPV) vaccine requires that the utility weights for HPV-related health states (i.e., cervical intraepithelial neoplasia (CIN), cervical cancer, and condyloma) be evaluated. The aim of the present study was to determine the utility weights for HPV-related health states.

Methods

Hypothetical standardised health states related to HPV were developed based on patient education material and previous publications. To fully reflect disease progression from diagnosis to prognosis, each health state comprised four parts (diagnosis, symptoms, treatment, and progression and prognosis). Nine-hundred members from the Korean general population evaluated the HPV-related health states using a visual analogue scale (VAS) and a standard gamble (SG) approach, which were administered face-to-face via computer-assisted interview. The mean utility values were calculated for each HPV-related health state.

Results

According to the VAS, the highest utility (0.73) was HPV-positive status, followed by condyloma (0.66), and CIN grade I (0.61). The lowest utility (0.18) was cervical cancer requiring chemotherapy without surgery, followed by cervical cancer requiring chemoradiation therapy (0.42). SG revealed that the highest utility (0.83) was HPV-positive status, followed by condyloma (0.78), and CIN grade I (0.77). The lowest utility (0.43) was cervical cancer requiring chemotherapy without surgery, followed by cervical cancer requiring chemoradiation therapy (0.60).

Conclusions

This study was based on a large sample derived from the general Korean population; therefore, the calculated utility weights might be useful for evaluating the economic benefit of cancer screening and HPV vaccination programs.

Background

Cervical cancer is the fourth most common cancer among women world-wide; indeed, there were an estimated 266,000 deaths due to cervical cancer in 2012, accounting for 7.5% of all female cancer deaths [1]. Persistent infection with human papillomavirus (HPV), especially HPV types 16 and 18, is a risk factor of cervical cancer. Furthermore, HPV causes cervical intraepithelial neoplasia (CIN), anal, penile, vaginal, vulvar, and head/neck cancers, anogenital warts, and recurrent respiratory papillomatoses, leading to deaths in both genders [2].

The HPV vaccine was developed to prevent HPV. Many clinical trials show the efficacy of the HPV vaccine in this regard; it also prevents precancerous lesions and genital warts [3–8]. From an economic perspective, cost-effectiveness analyses continuously show that HPV vaccination of preadolescent girls and boys is good value for money [9]. Thus, many countries are implementing HPV vaccine programs at the national level; it is suggested that the HPV vaccination should be encouraged to reduce the overall burden of HPV-related disease [10].

When evaluating the efficacy of treatments for HPV-related diseases, both the clinical outcome and the health-related quality of life (HRQOL) should be taken into account. Several indicators of disease burden have been used, including quality adjusted life years (QALYs), which combines the number of years lived by an individual with their HRQOL. QALYs are used primarily to correct a patient’s life expectancy based on the HRQOL they are predicted to experience throughout their life-time (or part of it) [11]. QALYs are calculated by multiplying the length of time spent in a particular health state by the utility weight associated with that health state [12]. Thus, utility weights (or health utilities) are needed to calculate QALYs.

In particular, the HRQOL associated with HPV-related diseases such as cervical cancer needs to be assessed in light of increasing survival rates. For this reason, both cost-effectiveness and cost-utility studies are needed. To carry out cost-utility studies of HPV-related diseases, their utility weights must be calculated according to disease severity. Although some studies determined the utility weight for cervical cancer according to health state reflecting patient preferences [13–16], few studies have examined how members of the general population evaluate their own preferences in terms of cervical cancer or precancerous lesions [17, 18]. The utility weight for HPV-related diseases reflecting preferences of the general population is much more in need in various countries, because the perspectives of the general population provide more relevant information for comparative assessments of health interventions [19]. In addition, guidelines for economic evaluation of pharmaceuticals in Korea placed more emphasis on societal perspective than provider’s perspective or patients’ perspective [20]. Therefore, the aim of the present study was to determine the utility weights for HPV-related health states based on data derived from a sample of the general Korean population. These results will be used to perform a cost-utility study and to establish a national immunisation program for HPV-related diseases.

Methods

Participant selection

The target population comprised adults (≥19 years) living in Korea. A total of 900 representative individuals were randomly selected from this target population using a multistage stratified quota method. A sample quota was assigned to each of the 15 regions of Korea according to population and socio-demographic factors, including gender, age, and education level (as defined by the resident registration data (June 2013), available from the Ministry of Administration and Security, South Korea). The participants were recruited in the street along with quotas.

HPV-related health states

A draft of the standardised HPV-related health states was created by two investigators (M Ock and MW Jo) based on patient education materials provided by Asan Medical Center (AMC), and on data from previous studies [13, 17]. One gynaecologic oncologist from AMC (Park JY) reviewed and modified the draft. Each HPV-related health state was designed to reflect a hypothetical scenario: HPV-positive status; CIN grade I; CIN grade II/III; cervical cancer requiring simple or radical hysterectomy; cervical cancer requiring radical hysterectomy and subsequent radiotherapy (and chemotherapy); cervical cancer requiring chemoradiation therapy; cervical cancer requiring chemotherapy without surgery; and condyloma (genital warts [condyloma acuminatum]) (Table 1). Each hypothetical scenario comprised four parts: diagnosis, symptoms, treatment, and disease progression and prognosis. The scenarios included diagnostic procedures, common physical side effects of treatment, emotional aspects of treatment, and information related to the possibility of complete recovery and 5-year survival rates. All eight hypothetical scenarios for the HPV-related health states are described in detail in Additional file 1.

Table 1 Eight hypothetical human papilloma virus-related health states

Interviews

This study was approved by the institutional review board of AMC (S2014-1396-000) and all respondents consented to participating in the study. The survey was conducted using face-to-face computer-assisted interviews at respondents’ home. The interviewers were fully trained with respect to HPV-related health states and undertook both evaluation methods: a visual analogue scale (VAS) and a standard gamble (SG) approach. All interviewers practiced in pairs before conducting the field survey. In total, the interviewers received about 2.5 h of training.

Participants were initially asked about their gender, age, and educational level. Next, we elicited participants’ preference using two valuation methods: VAS and SG. We asked participants to imagine themselves in the HPV-related health states. In the case of female-specific health states, such as cervical cancer and CIN, we made male participants imagine a woman they were close to, such as mother or wife, suffering from these health states. Participants evaluated each of five health states, one of which was being dead, on a VAS scale. The other four health states were randomly selected from the eight hypothetical health states. Being dead state was the last scenario to be rated on the VAS scale. Each participant consecutively evaluated health states using the SG approach. Again five health states were randomly selected from the eight hypothetical states. The health states for the SG might or might not overlap with those of the VAS. After the two rounds of valuation, the participants were asked about other socio-demographic factors, such as employment and income. They were also asked whether they had undertaken an ambulatory care visit within the past 2 weeks, been hospitalised during the last 12 months, or had any morbidities. We defined morbidity as the presence of any disease in the participants and a list of diseases was not specifically provided. Visual aids were used to help respondents understand the questions. The procedure of computer-assisted personal interviewing is available in the Additional file 2.

Valuation methods

We used VAS and SG as valuation methods. For the VAS, the respondents were asked to rate health states on a scale from 0 to 100, with 0 representing the worst imaginable health and 100 indicating the best imaginable health.

For the SG, respondents were asked to make a choice between two health states (one state was a selected hypothetical scenario and the other was death). The respondents were then asked to choose between the following: they could remain in the hypothetical health state, ‘i’, for the rest of their life-time or they could receive treatment that may either restore them to full health (probability ‘p’) or immediately kill them (probability ‘1-p’). The subject continues to make choices until the preference for the two choices becomes equal. The minimum probability interval was 5%. The chances of achieving the best outcome started at 50%, and increased or decreased by 5% according to the individual’s response.

Data analysis

First, descriptive analyses of the socio-demographic factors were performed. Next, the utility weights for each of the health states were calculated. To ensure that data from respondents who understood the valuation methods were included, 42 respondents with outlier VAS values for being dead (≥21) were excluded from the analysis, in which the methodology of exclusion was adapted from previous studies [13, 17]. The median of VAS value for being dead was 3 and its interquartile range was 8. One respondent even rated 99 for being dead.

For the VAS, the utility weight for each health state was calculated as follows: VAS value for the health state/100, where the VAS value for being dead was 0. However, if the VAS value for being dead was not 0, the following formula was used: (VAS value for the health state – the VAS value for being dead)/(100 – VAS value for being dead).

For the SG, the utility weights for each health state differed depending on the answer to the question that compared a particular health state with being dead. That is, the utility weight for each health state was calculated as the possibility of restoring full health (if the health state was regarded as a better option than being dead). The utility weight for each health state was calculated as follows: - possibility of restoring full health/(1- possibility of restoring full health), if the health state was regarded as worse than being dead. However, the utility weight for any health state that was considered worse than being dead was censored at zero.

The mean values for the utility weights according to socio-demographic factors and clinical information were compared using Student’s t-test and analysis of variance. Furthermore, we applied a linear regression regarding the utility weights from the VAS and SG as the dependent variable. We treated the socio-demographic factors and clinical information as independent variable. We also regarded the HPV-related health states as independent variable and created them as dummy variables with ‘HPV-positive status’ as the reference.

All statistical analyses were conducted using SPSS software (v21.0) and Stata 13.1 software (StataCorp, College Station, TX). A P-value < 0.05 was considered statistically significant.

Results

Demographic characteristics of the study subjects

Nine-hundred respondents were interviewed. The mean age of the respondents was 45.3 (standard deviation: 14.1) years, and 49.4% were male. The clinical and demographic characteristics of the respondents are shown in Table 2.

Table 2 Socio-demographic characteristics and clinical information for the study participants

VAS and SG data

VAS: the highest utility weight (0.73) was assigned to HPV-positive status, followed by condyloma (0.66), and CIN grade I (0.61). The lowest utility weight (0.18) was assigned to cervical cancer requiring chemotherapy without surgery, followed by cervical cancer requiring chemoradiation therapy (0.42), and cervical cancer requiring radical hysterectomy and subsequent radiotherapy (and chemotherapy) (0.50). The difference between the utility weights for the two CIN states was only 0.01 (Table 3).

Table 3 Utility weights derived from the VAS and SG

SG: The highest utility weight (0.83) was assigned to HPV-positive status, followed by condyloma (0.78), and CIN I (0.774). The lowest utility weight (0.43) was assigned to cervical cancer requiring chemotherapy without surgery, followed by cervical cancer requiring chemoradiation therapy (0.60), and cervical cancer requiring radical hysterectomy and subsequent radiotherapy (and chemotherapy) (0.65). The difference between the utility weights for the two CIN states was only 0.001 (Table 3).

For each health state, the mean utility weight calculated from the SG was greater than that calculated from the VAS. The difference in the utility weight calculated from the two methods was the smallest for HPV-positive status (0.10) and greatest for cervical cancer requiring chemotherapy without surgery (0.25). The mean utility weights calculated from the VAS and SG did not differ significantly according to gender, age, or educational level (Table 4). However, the respondents with a low income tended to score lower than those with a high income in both the VAS and SG, in general. For the clinical information, the particular trends could not be noticed in the utility weights from VAS and SG.

Table 4 Utility weights derived from the VAS and SG according to socio-demographic factors and clinical information

Table 5 shows results from the multivariable linear regression method. The health states were main relevant factors associated with the utility weights from the VAS and SG. After adjusting the respondents’ socio-demographic factors and clinical information, the utility weight for cervical cancer requiring chemotherapy without surgery were 0.554 lower than HPV-positive status in the VAS and 0.400 lower in the SG. In addition, the utility weights from respondents with a high income (>5.0 million won) were significantly higher than those with a low income (less than 2.5 million won) in both VAS and SG.

Table 5 Multivariable regression model for factors influencing the utility weights

Discussion

Here, we calculated the societal utility weights for eight hypothetical HPV-related health states based on the responses of 900 individuals selected from the general South Korean population. The main strength of this study is the fact that we evaluated the preferences of a relatively large sample (n = 900). A major question arises with respect to economic evaluation of healthcare programs: whose judgments should be used to define preferences? The general consensus is that the preferences of the general population should carry more weight than those of patients or healthcare professionals [21]. Other studies have examined the preferences of individuals with an abnormal Pap test [13], or the preferences of women alone [14, 15, 17]. Therefore, the results of the present study might be more appropriate for economic evaluation of cancer screening and HPV vaccination programs, for which the target population will be the general tax-paying public.

To examine the preferences of the general population, the sample group was presented with several different scenarios regarding HPV-related health states, which were designed to encompass diagnosis, treatment, and disease progression and prognosis. These scenarios were based on a literature review [13, 17] and also on patient education materials. When evaluating the preferences of the general population, these scenarios need to be explained in a manner than can be understood by all. Thus, the use of patient education material enabled people to better understand the different HPV-related health states. In particular, we included information related to prognosis, including survival rates and the chance of a complete cure. Because prognosis may play an important role in determining the utility weights of different diseases [13], the results of the present study may better reflect the preferences of the general population.

We used a VAS scale and an SG approach to determine the preferences of the study group for different HPV-related health states. The SG is a method of measuring respondents’ preferences under conditions of uncertainty, and is based directly on the von Neumann-Morgenstern utility theory, which is regarded as the gold standard for modelling rational behaviour in the context of uncertainty [22]. Furthermore, we felt that SG was more appropriate than any other evaluation method, in particular time trade-off (TTO), because assumptions based on “the rest of your life-time” are not appropriate in some scenarios; for example, “Cervical cancer requiring chemotherapy without surgery” has a 1 year survival rate of < 10%. The VAS does not allow a trade-off between different health states, and so is commonly regarded as lacking any theoretical basis when compared with choice-based methods such as SG and TTO [23]; however, the VAS is easy to understand. Thus, it is widely used in evaluation studies. Furthermore, there is no single preferred method of evaluation that is appropriate under all circumstances [24]. Therefore, it is meaningful to compare the results obtained from the VAS and SG methods.

The utility weights calculated from the VAS and SG in the present study were very consistent in terms of ordinal rankings. For example, the utility of HPV-positive status was 0.73 in the VAS and 0.83 in SG, and that for cervical cancer requiring chemotherapy without surgery was 0.18 in the VAS and 0.43 in SG. Although not directly comparable, the utility weights for HPV-related health states calculated herein (particularly those for less-serious health states) were lower than those calculated by previous studies. Kuppermann et al. reported a TTO utility of 0.909 for HPV-positive status, and 0.666 for invasive cervical cancer requiring radical hysterectomy or radiation and chemotherapy [13], whereas Melnikow et al. reported an SG utility of 0.92 for a low-grade abnormal Pap smear with cone biopsy [15]. Furthermore, Howard et al. reported an SG utility of 0.935 for HPV-positive requiring colposcopy, biopsy, and treatment [14], and Jewell EL et al. reported a TTO utility of 0.96 for minimally invasive cervical cancer requiring radical hysterectomy [17]. Marcellusi A et al. reported a TTO utility of 0.83, 0.81, and 0.58 for CIN grade I, CIN grade II/III, and cervical cancer, respectively [18]. The reason for these differences may be the detailed health state scenarios described in the present study; we provided respondents with a relatively in-depth description of the less severe HPV-related health states, including information about prognosis. This may have made respondents more fearful of such health states. In addition, there may be cultural differences in the evaluations of HPV-related health states because HPV is a sexually transmitted virus that carries considerable social stigma [25].

Another remarkable issue in this study would be gender differences in the utility weights of HPV-related health states. Utility weights for gender-specific health states, such as cervical cancer, may differ by gender, but there were no significant differences in the estimated utility weights for HPV-related health states by gender in this study. The reason for this finding is unclear, but it may be that male participants evaluated female-specific health states in this study as seriously as female participants did. In another study, utility weight lost due to anogenital warts was more prominent among women than men [18]. Furthermore, it seemed that the way of eliciting male participants’ preference regarding female-specific health states may influence gender differences. In this study, we asked male participants to imagine their mother or wife in the female-specific health states, rather than themselves in the HPV-related health states. However, further research will be needed to verify these assumptions.

The utility weights for HPV-related health states calculated in the present study are lower than those calculated in an indirect evaluation study performed in South Korea [10]. Kim et al. used a generic HRQOL instrument, the EQ-5D, to measure the HRQOL of 452 patients with CIN or cervical cancer [10]. According to that study, the highest utility weight was assigned to CIN grade I (0.937), followed by CIN grade II/III (0.933), cervical cancer (0.874), and recurrent cervical cancer (0.784). However, there are two points of concern with respect to the interpretation of those results. First, although determining the preferences of patients may reflect the actual utility, dropouts due to death or loss to follow-up and/or adaptation to disease can affect HRQOL [26]. Second, the EQ-5D, which comprises five dimensions from the HRQOL, does not fully reflect the health state of patients with CIN or cervical cancer. Thus, Kim et al. may have overestimated the utility weights [10].

There are several limitations in this study. First, we did not determine the total number of people contacted for the survey and thus we could not estimate the survey response rate. This limitation can restrict the representativeness of this study. Second, we did not ask each respondent evaluate all eight HPV-related health states. The reason for this was to minimise cognitive loading. If each respondent had to assess the utility weight for all eight HPV-related health states, the differences between the utility weights for each health state may be more marked. Third, there could have been an interviewer effect in the process of survey, which was conducted using face-to-face computer-assisted interviews. Although we trained interviewers not to have an effect on the response of survey participants, interviewers could have unintentionally affected the preferences of participants in the process of explaining HPV-related health states. Fourth, the generalizability of this study may be limited to other countries due to racial or cultural differences. Further research targeting the general public from other countries is necessary.

Conclusion

We obtained societal utility weights for HPV-related health states from 900 respondents drawn from the general population. These results will be useful for analysing the cost-effectiveness of healthcare interventions, such as cancer screening and vaccination programs for HPV-related diseases.