- Open Access
Impact of hypoglycemic episodes on health-related quality of life of type-2 diabetes mellitus patients: development and validation of a specific QoLHYPO© questionnaire
Health and Quality of Life Outcomes volume 16, Article number: 52 (2018)
Hypoglycemia is a limiting factor to achieving optimal glycemic control in patients with type-2 diabetes mellitus (T2DM), increasing risk of death and complications, reducing health-related quality of life (HRQoL) and work productivity and increasing healthcare costs.
The study’s primary objective was to develop and validate a specific questionnaire to assess the impact of hypoglycemia on the HRQoL of T2DM patients (QoLHYPO© questionnaire).
A two-phase multicenter prospective, longitudinal, observational, epidemiologic study of consecutively enrolled patients, not involving any drug, was conducted: In phase 1 (questionnaire development), patients who had given their written informed consent, who were at least 30 years of age, had been diagnosed with T2DM at least 5 years prior, had an HbA1c test in the previous 3 months, and a hypoglycemic episode in the previous 6 months were included. To validate the questionnaire and assess reliability and responsiveness, phase 2 included two cohorts of patients. Patients in the reliability cohort would likely have stable clinical course during the 3 weeks following inclusion in the study and patients in the responsiveness cohort would likely experience changes in their clinical course in the 3 months after enrollment.
Phase 1 included 168 patients: 10 attended semi-structured interviews, 18 for face validity, and 140 for the pilot test (Rasch analysis). Phase 2 included 227 patients: 142 in the reliability cohort and 85 in the responsiveness cohort.
Of the 37 items initially included in Phase 1, 11 (floor/ceiling effect analysis) and 13 (Rasch analysis) were discarded. The final version of the questionnaire consisted of 13 items.
Phase 2 results showed the questionnaire was unidimensional and able to accurately assess HRQoL. Intra-observer reproducibility (ICC = 0.920) and internal consistency (Cronbach’s alpha: visit 1 = 0.912; visit 2 = 0.901) were high, showing high reliability. Internal responsiveness was moderate (standardized effect size 0.5-0.8) and external responsiveness was lower (AUC > 0.5; not statistically significant). Minimal clinically important difference (MCID) was estimated to be 3.2 points.
The QoLHYPO© questionnaire is a tool that can be used in routine clinical practice to assess the impact of hypoglycemia on the HRQoL of T2DM patients.
Diabetes mellitus (DM), especially type-2 DM (T2DM), is one of the most common chronic diseases, with rising global prevalence. In 2014 the International Diabetes Federation (IDF) estimated that worldwide, 8.8% of adults between the ages of 20 and 79 years (415 million persons) were living with diabetes and that it caused 4.9 million deaths each year . The same authors estimate that by 2040 the number of diabetic persons across the world will rise to 642 million . In Spain, the Di@bet.es study showed 13.8% T2DM prevalence (6% unknown), reaching 20% in people aged 60-75 years .
Despite improvements made towards the achievement of optimal control, there are still large numbers of patients who do not reach this goal and, therefore, are at risk of developing complications . Thus, the estimated life expectancy for a 40-year-old patient with T2DM is shortened by 6 to 7 years .
Since fear of hypoglycemia may contribute to a lack of adherence to treatment, hypoglycemia is one of the main limiting factors for controlling glycaemia in T2DM patients [5, 6]. Hypoglycemia, which is defined as blood glucose concentration ≤ 70 mg/dL , is typically characterized by its sudden onset and by physical and psychological symptoms such as shakiness, sweating, drowsiness, nausea, poor motor coordination, mental confusion, irritability and loss of consciousness . Sometimes it presents with non-specific or atypical symptoms and may even be asymptomatic, making it even more difficult to detect, assess and treat.
The prevalence of hypoglycemic episodes in patients with T2DM varies according to the treatment received, with patients who are treated with insulin at highest risk of experiencing them . Moreover, it is important to note that nearly half of T2DM patients rarely or never informed their doctor about non-severe hypoglycemia [9, 10].
Hypoglycemia is also associated with the development of long-term complications and diminished work productivity  and ability to perform daily activities [9, 12]. In comparison with patients who have never experienced hypoglycemia, patients who experienced hypoglycemia tend to have a higher rate of absenteeism (7.6% vs. 4.4; p < 0.05), greater shortcomings while at work or presentism (21.3% vs. 15.1%; p < 0.05) and report greater interference with the performance of daily activities (19% vs. 9.3%; p < 0.05) . The economic impact of hypoglycemia on the use of healthcare resources is significant, as it leads to higher healthcare costs for these patients, primarily due to an increase in hospitalizations, emergency room visits or specialized healthcare [10, 13,14,15,16]. In Spain, the cost per episode of severe hypoglycemia is estimated at €3500, without taking into account the impact of hypoglycemia on patients’ work productivity .
Several studies have highlighted the negative impact of hypoglycemia on patients’ health-related quality of life (HRQoL) [9, 11, 17,18,19]. Assessment of the HRQoL of patients with hypoglycemia using generic health questionnaires such as Short Form (SF)-36, SF-12 or EuroQoL-5D (EQ-5D) has shown the impairment of both physical and mental components of HRQoL [9, 11, 16]. Phase III clinical trials have also demonstrated the association between hypoglycemia and HRQoL, with worse HRQoL reported for patients who experience hypoglycemic episodes more frequently . The use of diabetes-specific HRQoL questionnaires such as the Audit of Diabetes-Dependent Quality of Life (ADDQoL) in patients with and without hypoglycemia revealed the negative impact on the HRQoL of patients who experience hypoglycemia, however no significant differences in the general items were observed between patients with hypoglycemic events and patients without . This could be explained by the fact that this questionnaire is less sensitive than a more specific one  and highlighted the need to developed a specific questionnaire able to assess the impact of hypoglycemia on patients’ HRQoL.
Since hypoglycemia is a major barrier to achieving the glycemic goal in T2DM patients, and the impact on HRQOL and worry they cause can lead to the patient developing self-regulation attitudes towards medication and low adherence to it to avoid them, incorporating the examination of the impact of hypoglycemia on HRQoL can contribute to improve the management of T2DM patients and promote a therapeutic approach directed toward the patients’ needs, contributing to a better perception of HRQoL. Besides some T2DM specifics HRQoL questionnaires have been developed, at the time of study development, a specific questionnaire to assess this impact was not available. For this reason, the main purpose of this study was to develop and validate a HRQoL questionnaire to assess the impact of hypoglycemic episodes on T2DM patients’ HRQoL.
Design and scope of the study
In order to develop and validate the QoLHYPO© questionnaire, a multicenter, longitudinal, observational, epidemiologic study with consecutive enrollment of patients, not involving any drug, was designed. The study was divided into two phases (Fig. 1): Phase 1, development of the questionnaire (between September 2013 and July 2014); and Phase 2, validation of the questionnaire (from October 2014 to July 2015).
The study was conducted at Primary Healthcare centers and Endocrinology Departments within the Spanish healthcare system.
The study was classified as a non-post-authorization observational study by the AEMPS - Agencia Española de Medicamentos y Productos Sanitarios (Spanish Agency for Medicines and Medical Devices) and it was approved by the Ethics Committee of Hospital Clínic of Barcelona (25 July 2013).
All T2DM patients included in the study gave their written consent to participate in the study.
Phase 1: Development of the questionnaire
Generation of the items contained in the questionnaire
First, a review of the literature was conducted to identify the domains and descriptors of HRQoL in T2DM patients who experienced hypoglycemia. Subsequently, a focus group with four clinical experts evaluated the domains and descriptors found in the review and provided any additional information that may not had been identified in the literature .
Based on the conclusions of the focus group, a script was designed for conducting semi-structured interviews with patients. The aim of these interviews was to find out the patients’ perceptions regarding the HRQoL domains and to draw up an initial list of the items for inclusion in the preliminary version of the questionnaire . Patients 30 years of age or older who had been diagnosed with T2DM for at least 5 years, and who had had an HbA1c test in the previous 3 months and a hypoglycemic episode in the 6 months prior to the study were interviewed.
Finally, the preliminary version of the questionnaire was reviewed and validated by the same experts who participated in the first focus group. The first version of the questionnaire resulted from this discussion.
Face validity and feasibility of the questionnaire
In order to determine the ease with which patients answered the first version of QoLHYPO©, face validity and feasibility were assessed. A pilot test with T2DM patients was performed to evaluate the clarity of the wording of the items, their importance and the perceived burden (difficulty and time spent on the questionnaire), using a 5-point Likert scale (0 = not at all satisfactory to 5 = very satisfactory). The face validity and feasibility test population included adult patients ≥30 years old, diagnosed with T2DM for at least 5 years, with an HbA1c test in the previous 3 months and who had a hypoglycemic episode in the 6 months prior to the study.
Following this assessment, items that had scored equal to or greater than 4 by at least 75% of patients were selected for inclusion in the second version of QoLHYPO© questionnaire.
Statistical analysis was performed using SPSS Statistics v.20 software.
Pilot test. Item reduction using Rasch analysis
To reduce the number of items, floor and ceiling effects and Rasch analysis were applied. Floor and ceiling effects were determined if at least 35% of patients had used the lowest (floor) or highest (ceiling) response categories. Items that presented with floor and/or ceiling effects were removed from the questionnaire. It does not exist a cut-off value to define floor and ceiling effects, it usually is an arbitrary value which depends on the study population . Since the study sample is composed by a high proportion of patients (58%) with mild hypoglycaemia episodes, in order to be more sensitive to the severity of hypoglycaemias a cut-off value of 35% was used. Rasch analysis is a mathematical modeling technique that is widely used in the development of questionnaires [23,24,25,26,27]. The main characteristic of the model is that item and person parameters can be estimated independently of the characteristics of the sample and the difficulties of the items, respectively . Rasch analysis estimates the thresholds or degrees of difficulty of the response categories for each item. These thresholds are displayed graphically by means of characteristic curves, which must appear in the same ascending order as the category responses (the higher the score, the better the HRQoL). These graphics allow identifying redundant response categories where the curves of different categories overlap . The presence of redundant categories indicates an excess of response categories, so they were recoded and merged. Items that still displayed overlapping or unordered curves after recoding were removed from the questionnaire.
After assessment of the characteristic curves, the fit of the items to the Rasch model was analyzed through the infit and outfit statistics calculation. Both statistics are derived from the squared standardized residuals, with a goodness of fit range between 0.5 and 1.5 in polytomous responses [30, 31]. Items whose infit and outfit values exceeded the established range were eliminated from the questionnaire so that the final version of the QoLHYPO© was constituted by the remaining ones.
A total of 150 T2DM patients comprise the sample. Sample size estimation was based on the minimum number required for Rasch parameter estimation with a stability of 0.5 logits and 99% confidence . An additional 7% of patients were recruited for possible losses. Patients had to meet the following criteria: be at least 30 years old, have been diagnosed with T2DM for a minimum of 5 years, have had at least one HbA1c test in the 3 months prior to the study, have presented at least one hypoglycemic episode in the 6 months prior to the study, and have given their consent to participate in the study.
The R package eRm was used to perform Rasch analysis [33, 34].
Phase 2: Validation of the questionnaire
During Phase 2 of the study, the questionnaire that had been developed in Phase 1 was validated. Two cohorts of specific patients were included so as to assess reliability and responsiveness, respectively. Patients in both cohorts attended two visits: at baseline and 3 weeks later, in the case of the reliability cohort, or 3 months later, in the case of the responsiveness cohort. In addition to the inclusion criteria established for Phase 1 of the study, a specific additional criterion was defined for each cohort. Patients in the reliability cohort were expected to have a stable clinical course during the 3 weeks following their inclusion in the study. Patients in the responsiveness cohort were expected to have an unstable clinical course during the 3 months following their inclusion in the study, as determined by greater or lesser incidence and/or changes in the severity of hypoglycemic episodes.
The patients completed the QoLHYPO©, ADDQoL-19 and EQ-5D-3 L questionnaires at each visit. To measure reliability, a sample size composed of 154 patients with a 95% confidence level, 95% power and 0.3 effect size was estimated. The same parameters were used in the responsiveness cohort but with an effect size of 0.4 (it was expected to obtain greater differences between visits), so a sample size of 84 patients was estimated. G*Power software was used to calculate sample size .
To analyze the construct validity of the QoLHYPO© questionnaire, the responses to the questionnaire obtained from both cohorts at the baseline visit were used. For the assessment of the number of domains that constitute the QoLHYPO© questionnaire, several exploratory factor analysis techniques were used (optimal coordinate, acceleration factor, Velicer’s minimum average partial test - original and modified, Horn’s parallel analysis) . The basis of all these techniques is that every factor (or domain) is defined by an eigenvalue, so that the greater the eigenvalue, the greater the variance explained by the factor. These analyses were performed with the R package paramap statistical program [33, 37]. In addition, to evaluate whether the QoLHYPO© questionnaire was measuring the same characteristics as specific questionnaire ADDQoL-19 and generic questionnaire EQ-5D-3 L, the multitrait-multimethod matrix was calculated using Spearman’s rho correlations between the scores of the various questionnaires.
The reliability of a questionnaire refers to the degree of consistency and to intra-observer reproducibility, i.e., the equivalence between repeated measurements in the same individual. It was evaluated using test-retest reliability and internal consistency based on the responses given to the QoLHYPO© questionnaire by patients included in the reliability cohort during the baseline and follow-up visits [38,39,40]. Internal consistency was measured using Cronbach’s alpha on the QoLHYPO© total score. Test-retest reliability was assessed using the intra-class correlation coefficient (ICC) for the total score and Cohen’s Kappa coefficient for the responses to each item. Cronbach’s alpha values above 0.70 were regarded as satisfactory internal consistency . ICC and Kappa values above 0.75 and 0.70, respectively, were regarded as indicators of good reliability .
SPSS v.20 software was used to compute Cronbach’s alpha and ICCs, and Cohen’s Kappa coefficient was computed using VassarStats software .
Responsiveness was measured based on the responses to the QoLHYPO© questionnaire given by the patients, who constituted the responsiveness cohort. In the follow-up visit (at 3 months), patients had to report how their health status had changed with respect to the baseline visit. They responded to an anchor question to assess the evolution in their health status from the previous visit in relation with the T2DM, and therefore, with the hypoglycemic episodes. Answers were scored on a 5-point Likert scale: 1 = much worse, 2 = worse, 3 = no change, 4 = better and 5 = much better.
Responsiveness can be internal, referring to the ability of a measure to change over a predefined time period, or external, referring to the degree to which change in a measure relates to a change in a reference measure of clinical or health status . It is important to notice that the objective of the responsiveness assessment was the ability of the questionnaire to detect changes, no the direction of the changes. Internal responsiveness was measured with standardized response mean (SRM) :
assuming that the group that had experienced improvement had responded to the anchor question with “better” or “much better” while those who had remained stable had responded “no change”. Values less than 0.2, between 0.2 and 0.5, between 0.5 and 0.8, and greater than 0.8 indicated slight, low, moderate and high sensitivity, respectively [43, 45]. External responsiveness was based on Receiver Operating Characteristics curves (ROC) [43, 46]. To assess external responsiveness, patients were coded as experiencing improvement (responded with “better” or “much better”) or no improvement (responded with “much worse”, “worse” or “no change”).
Minimal clinically important difference
Minimal clinically important difference (MCID), defined as the smallest change in score in the questionnaire that could be considered significant, was based on the above-mentioned anchor questions, which allowed selecting patients who had experienced an improvement (“better”) . Similarly, the professionals who recruited the patients also responded to an equivalent anchor question to assess their patients’ clinical course. The difference in score in the anchor question of the QoLHYPO© questionnaire between the baseline visit and follow-up visit of patients whose physician and they themselves reported an improvement was used to determine MCID.
Phase 1. Development of the questionnaire
Generation of the items contained in the questionnaire
After reviewing the literature and holding the two focus groups with 4 T2DM management experts and 10 interviews with T2DM patients, the first version of the QoLHYPO© questionnaire was developed. Table 1 shows the items included in the first version of the QoLHYPO© questionnaire.
Face validity and feasibility of the questionnaire
A total of 18 T2DM patients participated in the face validity and feasibility of the questionnaire. Related to questionnaire format, approximately 81 and 94% of participants scored 4 and 5 (from 1 = not at all satisfactory, to 5 = very satisfactory), respectively, indicating that they were satisfied with it. The mean time required to complete the questionnaire was 13 min (SD: 5 min., range 7-25 min).
After questionnaire face validity and feasibility, the second version of the questionnaire was developed. It included four general items about the impact of hypoglycemia on patients’ HRQoL (frequency and severity of hypoglycemia, knowledge to control hypoglycemia and frequency of use of glucometer) and two sets of questions with 16 and 21 items, respectively. First set of questions was related to the patients’ feelings when their blood sugar drops. The second one, explores patients’ perceptions in relation to their drops in blood sugar. Each set of questions had five categories of response (0 = Never, 1 = Rarely, 2 = Sometimes, 3 = Often, 4 = Always).
Pilot test. Item reduction using Rasch analysis
A total of 160 patients with T2DM from 12 Spanish autonomous regions were included in the pilot test. Of these patients, 20 did not meet the inclusion criteria so the final sample consisted of 140 T2DM patients. Table 2 shows the main characteristics of the study population.
Table 3 shows the answers to the 4 general items about the hypoglycemia in each phase of the study. As in Phase 1 a high proportion of patients had mild to very mild hypoglycemia (57.67%), a high cut-off value (35%) was used to assess floor and ceiling effects in order to make the questionnaire more sensitive to the severity of the hypoglycemia. After floor and ceiling effects testing (Table 4), 11 items were discarded. The first Rasch analysis was therefore conducted on the remaining 26 items. To estimate the threshold of HRQoL of the response categories for each item, a graphical representation of characteristic curves for each item was used. It allowed assessing the scale scoring system through a graphic display of the probability of patients answering each response category for each item, according to the individual’s ability (ability = HRQoL). Each item provided five response options, where 0 was the least favorable case (worse HRQoL) and four was the most favorable (better HRQoL).
For most of the items, the probabilities of response overlapped, suggesting that the patients were not using the full range of options allowed by the scoring system, which implied that the categories were redundant (see Additional file 1). These results showed the need to recode the responses by merging the categories: “Never” with “Rarely” and “Often” with “Always”, so that only three response categories remained. Figure 2 shows the characteristic curves for items 5.14 (not overlapping) and 6.5. (overlapping).
After recoding the response categories, a second Rasch analysis was conducted. New characteristic curves continued showing overlapping in 11 items (see Additional file 2). They were therefore removed from the questionnaire. Rasch analysis was again performed on the remaining set of 15 items (26-11 = 15) with three ordered response categories to assess proper fit of the items to the Rasch model. Two items had infit and outfit values that exceeded the 0.5-1.5 range and were therefore discarded. Finally, another Rasch analysis was conducted on the resulting set of 13 items, which determined the goodness of fit of the items for measuring the construct of interest (Table 5). These items constituted the final version of the QoLHYPO© questionnaire (see Additional file 3).
Phase 2. Validation of the questionnaire
A total of 254 patients with T2DM participated in Phase 2 of the study. As 27 of them did not meet the selection criteria, they were excluded. The final sample consisted of a total of 227 T2DM patients residing in 12 autonomous regions, 142 from the reliability cohort and 85 from the responsiveness cohort (Table 2).
The QoLHYPO© questionnaire responses reported by the participants included in Phase 2 (n = 227) were used for the construct validity analysis.
All the techniques used for the exploratory factor analysis showed that the QoLHYPO© questionnaire consisted of a single factor and was therefore unidimensional. The multitrait-multimethod matrix indicated that there was a significant correlation (rho = 0.557; p < 0.001) between the QoLHYPO© and the DM-specific questionnaire ADDQoL-19. A significant correlation was likewise observed between the dimensions of the generic HRQoL questionnaire, EQ-5D-3 L, and the scores obtained in the QoLHYPO© questionnaire [mobility rho = − 0.216 (p = 0.001), self-care rho = − 0.259 (p < 0.01), usual activities rho = − 0.032 (p < 0.01), pain/discomfort rho = 0.265 (p < 0.01), anxiety/depression rho = − 0.346 (p < 0.01), VAS rho = − 0.446 (p < 0.01)].
Reliability analysis was conducted based on the results reported by the reliability cohort (n = 142 patients).
The internal consistency of the QoLHYPO©, which was measured using Cronbach’s alpha, was high at both visits (visit 1 = 0.912; visit 2 = 0.901). The values obtained as a result of test-retest showed that the QoLHYPO© has good reliability [ICC = 0.920 (CI95%: 0.890-0.942); and kappa> 0.60 for all items].
For the analysis of responsiveness we used the results obtained in the responsiveness cohort (n = 85 patients).
Internal responsiveness was determined based on patients’ self-reported health improvement. The results showed a standardized effect size of 0.676, indicating moderate internal responsiveness (between 0.5 and 0.8). External responsiveness assessment using ROC curve analysis did not yield significant results.
Minimal clinically important difference (MCID)
Analysis of MCID showed that the QoLHYPO© questionnaire was able to detect improvement in health when there was a 3.2 point increase between visits.
Impact of hypoglycemia on patients’ HRQoL
Assessment of T2DM patients’ HRQoL using the three questionnaires included in the study (QoLHYPO©, ADDQoL and EQ-5D-3 L), showed that the HRQoL of the T2DM patients included in Phase 2 of the study was compromised (Table 6).
The analysis of the results obtained from the QoLHYPO© questionnaire showed that aspects such as social relationships (talking to people) or mood (becoming irritable) were most affected by hypoglycemia (> 25% of patients indicated that this aspect was always affected by hypoglycemic episodes).
Determining HRQoL using a generic HRQoL questionnaire such as EQ-5D-3 L confirmed this impairment, establishing that 29.2% of patients had difficulty walking, 15.0% had problems with self-care, 26.0% reported having difficulties performing their usual activities, 46.7% suffered pain or discomfort, and 33.0% felt anxiety or depression.
Hypoglycemia and fear of hypoglycemia is a major problem for patients with diabetes, posing a barrier to good glycemic control [48, 49]. The negative consequences of hypoglycemia for both the daily life and well-being of the patient, confirm the importance to include, in the routine clinical practice, strategies of identifying patients with a high impact on HRQoL due to these episodes. However, a recent study conducted in 661 primary and specialized care centers belonging to Spain’s public healthcare system has shown that doctors do not use questionnaires that measure patient HRQoL in routine clinical practice .
Currently, some generic HRQoL questionnaires are available, such as EQ-5D  or SF-36 , that may be useful for determining T2DM patients’ HRQoL . Although the use of these questionnaires allows comparing the HRQoL of T2DM patients with the HRQoL of patients with other diseases or the HRQoL of the general population, they are not sensitive to changes associated with the specific symptoms or characteristics of a disease. On the other hand, specific questionnaires for determining the impact of diabetes on patients’ HRQoL [53, 54], for measuring fear of hypoglycemia , for assessing the attitude that patients with diabetes have with regard to hypoglycemia  or for determining the frequency with which it occurs  are also available. However, none of them has been validated in a Spanish population and none determines the impact of hypoglycemia on HRQoL. Hence, the information obtained by using a questionnaire that allows determining the impact hypoglycemia has on the HRQoL of T2DM patients could contribute to identifying those patients who may be at greatest risk and, consequently, help clinician to promote strategies to a target population and, increase clinicians’ awareness of the risk of hypoglycemia in their T2DM patients. This would contribute to improve the management of these patients and promote a therapeutic approach directed toward the patients’ needs, contributing to a better perception of HRQoL.
Phase 1 of the study resulted in the final version of the QoLHYPO© questionnaire, consisting of a total of 13 items. The face validity and feasibility of the questionnaire showed that it is easy and quick to implement, proving its feasibility of use in routine clinical practice.
The evaluation of the psychometric properties of the questionnaire conducted during Phase 2 showed that the QoLHYPO© questionnaire has a high degree of reproducibility and internal consistency, suggesting that, in identical situations, in which the patient’s clinical situation is the same but at different times, the results of the questionnaire would remain the same. The responsiveness analysis determined moderate internal responsiveness while no significant values were obtained in relation to external responsiveness. Finally, data regarding MCID showed that a 3.2 point difference in score on QoLHYPO© between two administrations of the questionnaire was indicative of a change in patient health status, which was reflected in HRQoL. The use of the QoLHYPO© questionnaire on the study population revealed the decline of T2DM patients’ HRQoL due to hypoglycemia. The aspects of HRQoL most affected by hypoglycemia were social relationships and emotional state. These results are in line with previous studies that highlighted the impact of hypoglycemia on patients socially, emotionally, financially as well as on their HRQoL [9,10,11,12,13,14,15,16,17].
The diabetic population included in the study is representative of the Spanish population with T2DM in that their characteristics are similar to those described in previous studies conducted in the field of healthcare in Spain .
Regarding the study methodology, the use of Rasch analysis to develop the questionnaire is worthy of note. The most common methodologies for the analysis of questionnaires are Item Response Theory (IRT) and Classical Test Theory (CTT) . Rasch analysis, which is a type of IRT, presents a number of advantages over CTT [58,59,60]. These include specific objectivity, that is, the difference between two individuals in the measurement of a construct does not depend on the specific items that have been used for the measurement. Similarly, the difference between two items does not depend on the specific individuals who are used in the measurement. Another advantage of Rasch analysis is the conjoint measurement, which seeks to express parameters for people and items on the same measurement scale, allowing interaction between items and persons. Then there is the interval property, in other words, the interpretation of differences on the scale is the same throughout. This is a fundamental property for the analysis of change. And the last advantage is the use of infit and outfit statistics to identify the items and individuals that do not fit the model.
This study has certain limitations. Most of them are inherent to the methods used for the ICC analysis, the estimation of responsiveness and MCID. The main limitation related to ICC is its dependence on the variability of the sample used. Despite this limitation, none of the alternative methods are as objective as the estimation of ICC [38, 61]. In relation to the analysis of responsiveness, it is important to bear in mind that the literature does not provide a clear definition or a gold standard for its determination [43, 44]. Some authors distinguish between internal and external responsiveness , while others make a distinction between three categories, depending on the type of change that the questionnaire is able to detect . Although this study uses the first classification, the assessment of responsiveness using other definitions and perspectives might provide new information. Lastly, following the recommendations found in the literature, anchor questions were used regarding the perspectives of patients and physicians in order to calculate MCID. Thus, it would be interesting to perform further analyses using multiple independent anchor questions and to analyze responsiveness in different population samples. As the results of responsiveness and MCID depend on the study sample and its inherent characteristics and hence there is no single score change value that can be extrapolated to every patient sample, these additional analyses would allow confirming the responsiveness and MCID obtained in this study .
Use of the QoLHYPO© questionnaire allows assessing the impact of hypoglycemic episodes on the T2DM patients’ HRQoL in routine clinical practice. This would contribute to improve the management of these patients and promote a therapeutic approach directed toward the patients’ needs, contributing to a better perception of HRQoL.
The assessment of the psychometric properties of the QoLHYPO© questionnaire has shown that it is a tool with a high degree of reproducibility and internal consistency. Likewise, it has moderate ability to detect real variations in patient health status that can involve changes in their HRQoL.
Implementing the QoLHYPO© questionnaire may provide useful information to identify patients who are at a higher risk of suffering a greater impact on their HRQoL due to hypoglycemia and to help in designing and adopting strategies that improve the management of these patients.
Audit of diabetes-dependent quality of life
Agencia Española del medicamento y productos Sanitarios (Spanish Agency for Medicines and Medical Devices)
Area under the curve
Classical test theory
Health-related quality of life
Intra-class correlation coefficient
Item response theory
Minimal clinically important difference
Receiver operating characteristic curves
Short form 36
Standardized response mean
Type-2 diabetes mellitus
Visual analog scale
IDF Diabetes Atlas 7th Edition. 2015. Available at https://www.idf.org/e-library/epidemiology-research/diabetes-atlas/13-diabetes-atlas-seventh-edition.html. Accessed 12 Dec 2016.
Soringuer F, Goday A, Bosch-Comas A, Bordiú E, Calle-Pascual A, Carmena R, Casamitjana R, Castaño L, Castell C, Catalá M, Delgado E, Franch J, Gaztambide S, Girbés J, Gomis R, Gutiérrez G, López-Alba A, Martínez-Larrad MT, Menéndez E, Mora-Peces I, Ortega E, Pascual-Manich G, Rojo-Martínez G, Serrano-Rios M, Valdés S, Vázquez JA, Vendrell J. Prevalence of diabetes mellitus and impaired glucose regulation in Spain: the Di@bet.Es study. Diabetologia. 2012;55(1):88–93.
Felton AM, LaSalle J, McGill M, Global Partnership for Effective Diabetes Management. Treatment urgency: the importance of getting people with type 2 diabetes to target promptly. Diabetes Res Clin Pract. 2016;117:100–3.
Emerging Risk Factors Collaboration, Seshasai SR, Kaptoge S, Thompson A, Di Angelantonio E, Gao P, Sarwar N, Whincup PH, Mukamal KJ, Gillum RF, Holme I, Njølstad I, Fletcher A, Nilsson P, Lewington S, Collins R, Gudnason V, Thompson SG, Sattar N, Selvin E, Hu FB, Danesh J. Diabetes mellitus, fasting glucose, and risk of cause-specific death. N Engl J Med. 2011;364:829–41.
Leiter LA, Boras D, Woo VC. Dosing irregularities and self-treated hypoglycemia in type 2 diabetes: results from the Canadian cohort of an international survey of patients and healthcare professionals. Can J Diab. 2014;38(1):38–44.
Wild D, von Maltzahn R, Brohan E, Christensen T, Clauson P, Gonder-Frederick L. A critical review of the literature on fear of hypoglycemia in diabetes: implications for diabetes management and patient education. Patient Educ Couns. 2007;68:10–5.
Seaquist ER, Anderson J, Childs B, Cryer P, Dagogo-Jack S, Fish L, Heller SR, Rodriguez H, Rosenzweig J, Vigersky R. Hipoglycemia and diabetes: a report of a workgroup of the American diabetes association and the endocrine society. Diabetes Care. 2013;36(5):1384–95.
Gehlaut RR, Dogbey GY, Schwartz FL, Marling CR, Shubrook JH. Hypoglycemia in type 2 diabetes--more common than you think: a continuous glucose monitoring study. J Diabetes Sci Technol. 2015;9(5):999–1005.
Östenson CG, Geelhoed-Duijvestijn P, Lahtela J, Weitgasser R, Markert Jensen M, Pedersen-Bjergaard U. Self-reported non-severe hypoglycaemic events in Europe. Diabet Med. 2014;31(1):92–101.
Orozco-Beltrán D, Mezquita-Raya P, Ramírez de Arellano A, Galán M. Self-reported frequency and impact of hypoglycemic events in Spain. Diabetes Ther. 2014;5:155–68.
Lopez JM, Annunziata K, Bailey RA, Rupnow MF, Morisky DE. Impact of hypoglycemia on patients with type 2 diabetes mellitus and their quality of life, work productivity, and medication adherence. Patient Preference Adherence. 2014;8:683–92.
Willis WD, Diago-Cabezudo JI, Madec-Hily A, Aslam A. Medical resource use, disturbance of daily life and burden of hypoglycemia in insulin-treated patients with diabetes: results from a European online survey. Expert Rev Pharmacoecon Outcomes Res. 2013;13(1):123–30.
Williams SA, Shi L, Brenneman SK, Johnson JC, Wegner JC, Fonseca V. The burden of hypoglycemia on healthcare utilization, costs, and quality of life among type 2 diabetes mellitus patients. J Diabetes Complicat. 2012;26(5):399–406.
Brito-Sanfiel M, Diago-Cabezudo J, Calderon A. Economic impact of hypoglycemia on healthcare in Spain. Expert Rev Pharmacoecon Outcomes Res. 2010;10(6):649–60.
Quilliam BJ, Simeone JC, Ozbay AB. Risk factors for hypoglycemia-related hospitalization in patients with type 2 diabetes: a nested case-control study. Clin Ther. 2011;33(11):1781–91.
Liu S, Zhao Y, Hempe JM, Fonseca V, Shi L. Economic burden of hypoglycemia in patients with type 2 diabetes. Expert Rev Pharmacoecon Outcomes Res. 2012;12(1):47–51.
Green AJ, Fox KM, Grandy S, SHIELD Study Group. Self-reported hypoglycemia and impact on quality of life and depression among adults with type 2 diabetes mellitus. Diabetes Res Clin Pract. 2012;96(3):313–8. Green
Jódar-Gimeno E, Álvarez-Guisasola F, Ávila-Lachica L, Palomares-Ortega R, Roldán-Suárez C, Lizán-Tudela L. Quality of life and fear for hypoglycaemia in patients with type 2 diabetes mellitus. Rev Clin Esp. 2015;215(2):91–7.
Gilet H, Gruenberger JB, Bader G, Viala-Danten M. Demonstrating the burden of hypoglycemia on patients’ quality of life in diabetes clinical trials: measurement considerations for hypoglycemia. Value Health. 2012;15(8):1036–41.
Kitzinger J. Qualitative research. Introducing focus group. BMJ. 1995;311:299–302.
Qualitative Research Guidelines Project July 2006. Disponible en http://www.qualres.org/HomeSemi-3629.html. Accessed 12 Dec 2017.
Bot SDM, Terwee CB, van der Windt DAWM, Bouter LM, Deker J, de Vet HCW. Psychometric evaluation of self-report questionnaires: the development of a checklist. In: Proceedings of the second workshop on research methodology; 2003.
Badia X, Webb SM, Prieto L, Lara N. Acromegaly quality of life questionnaire (AcroQoL). Health Qual Life Outcomes. 2004;2:13–8.
Djaja N, Youl P, Aitken J, Janda M. Evaluation of a skin self examination attitude scale using an item response theory model approach. Health Qual Life Outcomes. 2014;12:189–96.
Vincent JI, MacDermid JC, King GJ, Grewal R. Rasch analysis of the patient rated elbow evaluation questionnaire. Health Qual Life Outcomes. 2015;13(1):84.
Lambert MC, Cress CJ, Epstein MH. Psychometrics of the preschool behavioral and emotional rating scale with children from early childhood special education settings. Infant Ment Health J. 2015;36(3):287–97.
Hadzibajramovic E, Ahlborg G Jr, Grimby-Ekman A, Lundgren-Nilsson Å. Internal construct validity of the stress-energy questionnaire in a working population, a cohort study. BMC Public Health. 2015;15:180–9.
Masters GN. A Rasch model for partial credit scoring. Psychometrika. 1982;47(2):149–74.
Rasch G. An individualistic approach to item analysis’. Readings in mathematical social science. Chicago: Science Research Associates; 1966.
Linacre JM. What do Infit and outfit, mean-square and standardized mean? Rasch Meas Trans. 2002;16:878.
Smith AB, Rush R, Fallowfield LF, Velikova G, Sharpe M. Rasch fit statistics and sample size considerations for polytomous data. BMC Med Res Methodol. 2008;8:33.
Linacre JM. Sample size and item calibration stability. Rasch Meas Trans. 1994;7:28.
Mair P, Hatzinger R, Maier MJ. eRm: Extended Rasch Modeling. R package version 2.14.0. 2012. http://CRAN.R-project.org/package=eRm. Accessed 12 Dec 2017.
R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2015. http://www.R-project.org/. Accessed 12 Dec 2017.
Faul F, Erdfelder E, Buchne A, Lang AG. Statistical power analyses using G*power 3.1: tests for correlation and regression analyses. Behav Res Method. 2009;41:1149–60.
Gordon M. Determining the number of factors to retain in EFA: using the SPSS R-menu v2.0 to make more judicious estimations. Pract Assess Res Eval. 2013;18(8):1–14.
O'Connor BP. paramap: paramap. R package version 1.0. 2015.
García de Yébenes MJ, Rodriguez F, Carmona L. Validación de cuestionarios. Reumatol Clin. 2009;5(4):171–7.
Hernández I, Porta M, Miralles M, García F, Bolúmar F. La cuantifiación de la variabilidad en las observaciones clínicas. Med Clin (Barc). 1990;95:424–9.
Prieto L, Lamarca R, Casado A. La evaluación de la fiabilidad en las observaciones clínicas: el coeficiente de correlación intraclase. Med Clin (Barc). 1998;110:142–5.
Bland JM, Altman DG. Cronbach's alpha. BMJ. 1997;314:572.
VassarStats. Website of statistical computation. 2015. http://vassarstats.net. Accessed 12 Dec 2015.
Husted JA, Cook RJ, Farewell VT, Gladman DD. Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol. 2000;53(5):459–68.
Terwee CB, Dekker FW, Wiersinga WM, Prummel MF, Bossuyt PMM. On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual Life Res. 2003;12:349–62.
Hevey D, McGee HM. The effect size statistic. J Health Psychol. 1998;3(2):163–70.
De Vet HCW, Bouter LM, Bezemer PD, Beurskens AJHM. Reproducibility and responsiveness of evaluative outcome measures. Int J Tech Assess Health Care. 2001;17(4):479–87.
Wright A, Hannon J, Hegedus EJ, Emerson A. Clinimetrics corner: a closer lok at the minimally clinically important difference (MCID). J Man Manipulative Ther. 2012;20(3):160–6.
Shi L, Shao H, Zhao Y, Thomas NA. Is hypoglycemia fear independently associated with health-realted quality of life? Health Qual Life Outcomes. 2014;12:167.
Marrett E, Stargardt T, Mavros P, Alexander CM. Patient-reported outcomes in a survey of patients treated with oral antihyperglycaemic medications: associations with hypoglycaemia and weight gain. Diabetes Obes Metab. 2009;11(12):1138–44.
Brooks R. EuroQoL: the current state of play. Health Policy. 1996;37(1):53–72.
Brazier J, Roberts J. Deveril lM. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21(2):271–92.
Mulhern B, Meadows K. The construct validity and responsiveness of the EQ-5D, SF-6D and diabetes health Profile-18 in type 2 diabetes. Health Qual Life Outcomes. 2014;12:42.
Bradley C, Todd C, Gorton T, Symonds E, Martin A, Plowright R. The development of an individualized questionnaire measure of perceived impact of diabetes on quality of life: the ADDQoL. Qual Life Res. 1999;8(1-2):79–91.
Meadows K, Abrams C, Sandaek A. Adaptation of the diabetes health profile (DHP-1) for use with patients with type 2 diabetes mellitus: psychometric evaluation and cross-cultural comparison. Diabet Med. 2000;17:572–80.
Cox DJ, Irvine A, Gonder-Frederick L, Nowacek G, Butterfield J. Fear of hypoglycemia: quanitfiaction, validation and utilization. Diabetes Care. 1987;10(5):617–21.
Kawata AK, Wilson H, Ong SH, Kullich K, Coyne K. Development and psychometric evaluation of the hypoglycemia perspectives questionnaire in patients with type 2 diabetes mellitus. Patient. 2016; [Epub ahead of print]
Gold AE, MacLeod KM, Frier BM. Frequency of severe hypoglycemia in patients with type I diabetes with impaired awareness of hypoglycemia. Diabetes Care. 1994;17:697–703.
McAlpine. A summary of methods of item analysis. Computer assisted assessment Centre; 2002.
Magno C. Demonstrating the difference between classical test theory and item response theory using derived test data. Int J Educ Psychol Ass. 2009;1(1):1–11.
Prieto G, Delgado AR. Análisis de un test mediante el modelo de Rasch. Psicotherma. 2003;15(1):94–100.
Bland JM, Altman D. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;327(8476):307–10.
Revicki D, Hays RD, Cella D, Sloan J. Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. J Clin Epidemiol. 2008;61(2):102–9.
The authors are very grateful to all study participants for their cooperation and assistance. We thank Outcomes’10 for providing medical writing assistance with this manuscript.
This study was funded by Novartis.
Availability of data and materials
Please contact author for data requests.
Ethics approval and consent to participate
The study was conducted according to the principles of the Declaration of Helsinki and developed in compliance with Good Clinical Practice guidelines (International Conference on Harmonization, ICH, 1996). The study protocol was classified by the Agencia Española de Medicamentos y Productos Sanitarios (Spanish Agency for Medicines and Medical Devices) and was approved by the Ethics Committee of Hospital Clínic, Barcelona.
All of the study participants gave their informed consent to participate in the study.
Consent for publication
This study was funded by Novartis. Fuster E. works for Novartis. The remaining authors declare no conflicts of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1:
Characteristic curves from first Rasch analysis. (DOCX 350 kb)
Additional file 2:
Characteristic curves from second Rasch analysis (after recoding the response categories). (DOCX 314 kb)
Additional file 3:
CUESTIONARIO QoLHYPO. (DOCX 24 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Orozco-Beltrán, D., Artola, S., Jansà, M. et al. Impact of hypoglycemic episodes on health-related quality of life of type-2 diabetes mellitus patients: development and validation of a specific QoLHYPO© questionnaire. Health Qual Life Outcomes 16, 52 (2018). https://doi.org/10.1186/s12955-018-0875-1
- Health-related quality of life
- Type-2 diabetes mellitus
- Questionnaire development
- Questionnaire validation