Skip to main content
Download PDF

Adaptation and psychometric validation of Diabetes Health Profile (DHP-18) in patients with type 2 diabetes in Quito, Ecuador: a cross-sectional study

Health and Quality of Life Outcomes volume 19, Article number: 189 (2021) Cite this article

Abstract

Introduction

The Diabetes Health Profile (DHP‐18), structured in three dimensions (psychological distress (PD), barriers to activity (BA) and disinhibited eating (DE)), assesses the psychological and behavioural burden of living with type 2 diabetes. The objectives were to adapt the DHP‐18 linguistically and culturally for use with patients with type 2 DM in Ecuador, and to evaluate its psychometric properties.

Methods

Participants were recruited using purposive sampling through patient clubs at primary health centres in Quito, Ecuador. The DHP-18 validation consisted in the linguistic validation made by two Ecuadorian doctors and eight patient interviews. And in the psychometric validation, where participants provided clinical and sociodemographic data and responded to the SF-12v2 health survey and the linguistically and culturally adapted version of the DHP-18. The original measurement model was evaluated with confirmatory factor analysis (CFA). Reliability was assessed through internal consistency using Cronbach’s alpha and test–retest reproducibility by administering DHP-18 in a random subgroup of the participants two weeks after (n = 75) using intraclass correlation coefficient (ICC). Convergent validity was assessed by establishing previous hypotheses of the expected correlations with the SF12v2 using Spearman’s coefficient.

Results

Firstly, the DHP-18 was linguistically and culturally adapted. Secondly, in the psychometric validation, we included 146 participants, 58.2% female, the mean age was 56.8 and 31% had diabetes complications. The CFA indicated a good fit to the original three factor model (χ2 (132) = 162.738, p < 0.001; CFI = 0.990; TLI = 0.989; SRMR = 0.086 and RMSEA = 0.040. The BA dimension showed the lowest standardized factorial loads (λ) (ranging from 0.21 to 0.77), while λ ranged from 0.57 to 0.89 and from 0.46 to 0.73, for the PD and DE dimensions respectively. Cronbach’s alphas were 0.81, 0.63 and 0.74 and ICCs 0.70, 0.57 and 0.62 for PD, BA and DE, respectively. Regarding convergent validity, we observed weaker correlations than expected between DHP-18 dimensions and SF-12v2 dimensions (r > −0.40 in two of three hypotheses).

Conclusions

The original three factor model showed good fit to the data. Although reliability parameters were adequate for PD and DE dimensions, the BA presented lower internal consistency and future analysis should verify the applicability and cultural equivalence of some of the items of this dimension to Ecuador.

Background

Diabetes mellitus (DM) is a high priority public health problem. It is the most frequent chronic disease in the world and, in 2014, affected 422 million people. According to the World Health Organization, people with type 2 Diabetes mellitus (T2DM) represent 90% of all diabetics. The prevalence of T2DM has increased more rapidly in low- and middle-income countries than in high-income countries, as is the case in Latin America and Ecuador [1]. In 2016, the prevalence of T2DM in Ecuador was estimated at 7.3% and has been rising significantly in all age groups [2,3,4,5]. According to data from the STEPS Survey of Ecuador in 2018, the prevalence of diabetes was 6.6% in both sexes (6.6% in men and 6.5% in women) of the Ecuadorian population between 18 and 69 years of age, and increased to 10.7% in the age group between 45 and 69 years in both sexes [6].

T2DM is the most common metabolic cause of mortality, due to its complications and associated pathologies [7]. It negatively affects quality of life [8], defined as a person's individual perception of the physical, emotional and social state [9], as a result of associated physical disabilities and mental health problems [10]. Clinical measures can provide a good estimate of disease control, but the ultimate goal of DM care is to maintain or improve the patient's quality of life [11].

There are generic instruments to measure quality of life that can be used both in the general population and in all disease groups [12, 13]. However, specific instruments have been developed to measure specific effects of diseases and are more responsive to changes. Disease-specific instruments can help determine which conditions best explain a patient's limitations in physical and / or mental function, and, therefore, are more useful in outcome research, health care cost studies, and clinical practice [14].

In Ecuador, advanced age, longer disease duration, hypertension and kidney disease are associated with a lower health related quality of life in patients with T2DM [15, 16]. In addition, a direct relationship was found between low socioeconomic status and the development of the disease [17].

Despite the rapid growth in the prevalence of T2DM and the existence of different instruments to measure quality of life in diabetic patients, none of them have been linguistically or psychometrically validated in Ecuador. Although there is a wide description of different questionnaires to assess quality of life in diabetic patients [18], such as the Diabetes Care Profile, which aims at assessment of factors important in a patient's adjustment to diabetes and its treatment in daily life and which consists of 234 items, the Appraisal of Diabetes Scale, which aims at Assessment of diabetes-related distress and which consists of 7 items, the Diabetes Distress Scale, which aims to Measure of diabetes-related emotional distress for use in research and clinical practice and which consists of 17 items, among others [19]. We chose the Diabetes Health Profile (DHP) because of its advantages over other diabetes-specific patient reported outcome measures. It is a specific instrument to evaluate psychological and behavioural impact of living with diabetes [20]. It generates a health profile that measures psychological distress, barriers to activity, and uninhibited eating. Each answer is rated on a scale, and the scores by dimension are presented on a scale in which a higher DHP value is associated with a worse perception of quality of life. The short version of DHP with 18 items has been used in different countries, demonstrating adequate metric properties [21,22,23].

The objectives of this study are to adapt the Diabetes Health Profile-18 (DHP‐18) both linguistically and culturally for use with patients with T2DM in Ecuador, and to evaluate its psychometric properties.

Methods

Participants

We included type 2 diabetic patients, who were at least 18 years of age, had been diagnosed for at least 12 months, resided in Quito with no intention of moving in the near future and were native Spanish speakers. Recruitment to the study used purposive sampling through a patient club for people with diabetes at the Chimbacalle Health Center and contacts from health promoters from several health centres in Quito (Número 1, Jardín del Valle, Cotocollao, Jaime Roldos Aguilera, Corazón de Jesus, Comité del Pueblo, San Antonio de Pichincha, Colinas del Norte, Pomasqui, Carcelén Bajo, El Condado, Mena del Hierro, La Bota, Pisulí, Puellaro, Chavezpamba, Cotocollao Alto and Calacalí).

In this setting, diabetic patient’s clubs are sometimes established in primary health care centres, either by initiative of the health staff or the patient’s themselves. The role of patient clubs is to motivate patients through the exchange of experiences among its members, in addition to the orientation, advice and guidance offered by health professionals on behaviour modification (physical activity/diets) [24, 25].

Our selection sought to include a group of patients that was heterogeneous in terms of sex, age and level of education. All participants gave their consent to participate in the study.

Procedure

The interviews were carried out between February and July 2020. The DHP-18 validation process consisted of 2 phases.

Linguistical and cultural adaptation

Two Ecuadorian medical researchers reviewed the original version of the DHP-18 (English) and the existing translation (Spanish for the United States) to assess the cultural and linguistic relevance for its use in Ecuador. They suggested some changes in text, as well as the reasons for these changes and provided a new recommended translation. Changes were discussed with the other members of the team and a new adapted version of the questionnaire was proposed. Subsequently, 2 different researchers carried out interviews to assess the linguistic and cultural understanding of the adapted questionnaire with 8 people with T2DM of Ecuadorian nationality in the Chimbacalle Health Centre. Participants were asked to answer the questions and then, the necessary time was recorded, the answer options were discussed, the wording that was difficult to understand was commented, and alternative wording was suggested based on the participants’ own words. A second adapted version was proposed. The interviews were recorded and transcribed verbatim for analysis. Finally, participants' responses were summarized in a pilot test report including recommended changes and suggestions. The report was then sent to the original authors of the questionnaire for verification and approval.

Psychometric validation

Firstly, we recruited 146 participants for the baseline test where they responded to the questions posed in the tool previously linguistically validated DHP-18 instrument in Ecuador and in another tool (SF-12v2 in its version for use in Ecuador) [26] in order to assess the correlation with generic quality of life as a construct validity test. Two weeks later, we assessed the intra-observer reliability of the new tool in a random sample of 75 of the previously interviewed patients, where only DHP-18 was retested, along with the following question: “Compared to the last time you completed the questionnaire, how do you assess your condition today? (1) unchanged, (2) improved, (3) greatly improved, (4) impaired or (5) highly impaired”.

Data collection

The 8 interviews carried out during the linguistic and cultural adaptation were held face to face but given the situation generated by the COVID19 pandemic [27], the data for the psychometric validation was collected through individual telephone interviews. Responses were digitally recorded by the interviewer using the Kobo toolbox (http://www.kobotoolbox.org/) free open-source software on electronic tablets. Informed consents were provided orally and were audio recorded.

DHP-18 questionnaire

Participants responded to the adapted version of DHP-18. We used the Diabetic Health Profile (DHP) -18 because it is a shortened version of DHP-1, a specific instrument for measuring the psychological and behavioural impact of type 1 diabetes. We decided to use the short version of the DHP because it can be used in people with both type 1 and type 2 diabetes aged 11 and older. And because the instrument has demonstrated adequate metric properties and its completion time is approximately 5–6 min. Items are scored using a 4-point Likert-type scale ranging from 0 to 3. Items are provided with one of four sets of responses (1) never, sometimes, generally, always; (2) never, sometimes, often, very often; (3) not at all, a little, a lot, very much; and (4) very likely, quite likely, unlikely, not at all likely. The raw subscale scores are transformed into a common score range from 0 to 100, with 0 representing no dysfunction.

The DHP-18 consists of three dimensions: psychological distress (includes questions like depressed from diabetes; more arguments or upsets at home than there would be if you did not have diabetes; losing your temper over unimportant things; etc.), barriers to activity (includes questions like food controls life; difficult staying out late; avoid going out when sugar is low; etc.) and disinhibited eating (includes questions hard to say no to food you like; ease of stopping when you eat; wish there were not so many nice things to eat; etc.).

SF-12 v2

The SF-12 v2 is an instrument for measuring health-related quality of life [26], based on SF-36. It includes twelve items, has an application time of approximately two minutes, and is used to evaluate the degree of well-being and functional capacity of people over 14 years of age. The response options form Likert-type scales (where the number of options varies from three to six points, depending on the item), which assess intensity and / or frequency of people's health status. The score ranges from 0 to 100, where the higher score implies a better health-related quality of life. The SF-12v2 has demonstrated adequate validity and reliability in the United States and internationally, and the Spanish version has been used successfully in Latin America and with Spanish-speaking populations in the United States. Investigations that use these twelve items of the SF have verified that the instrument is a valid and reliable measure in Latin American countries such as Colombia and Chile in adult population, and a translated version is available for Ecuador.

The SF12v2 includes questions related to health status and limitations in doing activities, problems with work or other regular daily activities due to physical health, due to emotional problems, pain, feelings, etc.

Sociodemographic and clinical variables

We collected sociodemographic and clinical variables (all self-reported by the participants): age, sex, marital status, ethnicity (mestizo or other minorities. The mestizos are an ethnicity composed of Spanish and indigenous heritages), educational level, monthly income, employment status, smoking status, alcohol intake, weight, height, duration of illness, use of medications, diabetes complications and comorbidities.

Statistical analysis

We included descriptive statistics through frequencies, the mean (standard deviation) or the median (interquartile range), as appropriate. The psychometric characteristics of the DHP-18 were assessed according to consensus-based standards for the selection of health status measurement instruments (COSMIN) guidelines [28]. Missing values for the DHP-18 and SF-12 v2 were substituted with the mean of the completed questions for those dimensions in which ≥ 50% of questions had been completed [29, 30].

We evaluated floor and ceiling effects by calculating the percentage of patients scoring either the lowest or highest possible dimensional scores. If more than 15% of respondents achieve the lowest or highest possible score, then floor or ceiling effects are present [31].

Statistical analyses were performed using Stata Version 15 (StataCorp LP; College Station, TX) and R software, version R 4.0.0 (R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria; http://www.R-project.org) was used to perform the confirmatory factor analysis. The level of statistical significance was set at p < 0.05.

Structural validity

We performed a confirmatory factor analysis (CFA) because the factor structure had already been determined [32] and confirmed for other language translations [23]. In this case, we used CFA using Diagonally Weighted Least Squares (DWLS) [33,34,35] to test the hypothesis that the general construct of DHP is composed of three individual and correlated factors: psychological distress (6 items), activity barriers (7 items) and disinhibited eating (5 items). To estimate the model fit, we used the following criteria: Values > 0.95 for the Tucker-Lewis index (TLI) or for the comparative fit index (CFI) and the root mean square error of approximation (RMSEA) < 0.06 or the standardized root mean square residual (SRMR) < 0.08 are considered as a good model fit [36, 37]. The magnitudes of factor loadings of 0.3 or greater were considered suitable.

Reliability

To measure internal consistency reliability, we used Cronbach’s alpha coefficient, where values > 0.7 are considered as acceptable [36]. The homogeneity of items was verified by the analysis of item-rest and inter-item correlations for the items constituting each dimension of the scale. The usual rule of thumb is that an item should correlate between 0.3 and 0.7 with the total score of the factor (excluding that item), using Pearson’s coefficient. Additionally, average inter-item correlations for items in the same factor should correlate moderately, between 0.15 and 0.5, to ensure that they measure the same construct but not so closely as to be too redundant [38].

We measured test–retest reliability in patients reporting no-change in the global assessment of change question. To measure test–retest reliability we considered that the individual’s health was significantly better if they responded, “much better” or “somewhat better” in the global assessment, or significantly worse if they responded “somewhat worse” or “much worse” [39]. We used the intraclass correlation coefficient (ICC) under a 2-way random effects model with absolute agreement [40], and its associated 95% confidence interval. We considered that a questionnaire exhibits substantial reliability when ICC is between 0.40 and 0.75, and greater than 0.90 represents excellent reliability [36].

Measurement errors were determined by calculating the standard error of measurement (SEM) and the smallest detectable change (SDC). We calculated SEM by the square root of the error variance derived from analysis of variance (ANOVA), two-way ANOVA with repeated measures [41]. The SDCindividual and SDCgroup was calculated with the following formulas (41):

$${\text{SDC}}_{{{\text{individual}}}} = { 1}.{96 }* \, \surd {2 }*{\text{ SEM}}$$

SDCgroup = (SDCindividual /√n); n: number of subjects in the sample.

We estimated the minimally important difference (MID) for each DHP-18 dimension using three distribution-based methods to estimate MID: 0.2 and 0.5 standard deviation (SD) and SEM estimations. Formulas:

$$\begin{aligned} & 0.{\text{2SD}} = \, 0.{2}*{\text{ SD}}_{{{\text{basaline}}}} \\ & 0.{\text{5SD}} = \, 0.{5}*{\text{ SD}}_{{{\text{basaline}}}} \\ & {\text{1SEM}} = {\text{SEM}} \\ \end{aligned}$$

We also estimated Cohen’s d effect size (ES) of the change in DHP-18 dimensions for those reporting a small but important change and those reporting no changes in global assessment rating. Cohen’s d was calculated with the following formula (42):

$${\text{ES }} = \, \left( {{\text{Score}}_{{{\text{baseline}}}} - {\text{Score}}_{{{\text{retest}}}} } \right)/{\text{SD}}_{{{\text{basaline}}}}$$

SDbasaline: Standard deviation of baseline score.

An effect size of 0.2 was considered small, 0.5 moderate and 0.8 large [43].

Construct validity

We assessed construct validity of the DHP questionnaire using three approaches. Firstly, we assessed convergent validity using binary correlation analysis (Spearman’s r- due to non-normal value distributions) of the DHP-18 and SF-12v2. Before starting the analysis, we set up the following a priori hypothesis: (1) Scores of “psychological distress” dimension in DHP-18 correlate negatively with scores of “mental health” dimension in SF-12v2. (2) Scores of “activity barriers” dimension in DHP-18 correlates negatively with “physical dimension” in SF-12v2. (3) Scores of “disinhibited eating” dimension in DHP-18 correlates negatively with “physical dimension” in SF-12v2.

Secondly, we explored discriminant validity by comparing the correlation among the three dimensions of the DHP-18 scale.

Thirdly, we evaluated known-group validity by comparing DHP-18 scores in patients according to sex, education level, obesity, and clinical characteristics such as duration of diabetes, presence of comorbidities and/or diabetes-related complications using a Student’s t-test or ANOVA. We tested the following pre-defined hypotheses:

H1: Individuals with longer duration of illness would have higher DHP-18 scores (poorer quality of life) than those with shorter illness duration [44].

H2: Obese individuals would have higher DHP-18 values (poorer quality of life) than non-obese individuals [45].

H3: Women would report higher DHP-18 values (poorer quality of life) than men [46].

H4: Individuals with comorbidities would have higher DHP-18 values (poorer quality of life) [44].

H5: Individuals with a higher education level would have lower DHP-18 values (better quality of life) than those with a lower education level [47, 48].

H6: Individuals with diabetes-related complications would have higher DHP-18 values (poorer quality of life) than patients without complications [44].

Results

Linguistic and cultural adaptation

Two Ecuadorian medical researchers modified some linguistic expressions in the Spanish version for the United States in items 2, 3, 4, 5, 6, 10, 11, 12, 13, 14, 15 and 18 and in some answer options. In the linguistic and cultural review, six women and two men participated: a 28-year-old person, a 49-year-old person and a 52-year-old person, and the rest of the participants were over 70 years old. They made further changes to items 5, 6, 10 and 12 and proposed reformulation of some expressions. Most modifications were minor linguistical issues to use terms more commonly used in Ecuador, for example the expression “staying out” was changed by “going out of the house”, the term “edgy” was changed by “nervous”, and the term "lose your temper" was changed by "get angry easily". Other changes were made to improve comprehension by simplifying technical terms, for example “influenza” was changed to “flu”, “depressed” was changed to “sad”. One of the items was flagged as having potential difficulties because participants would be asked to reflect on their sugar levels, and there was a very low availability of glucometers in homes. The expression "on the low side" was changed to "having low or very low sugar levels". Similarly, in item 6, the word "monitor" was replaced by the expression "take the sugar test" to improve its understanding. The original author approved the new tool, linguistically and culturally adapted to the context of Quito, Ecuador.

Psychometric validation

We recruited 146 patients diagnosed with T2DM. Table 1 describes the characteristics of the study population. The mean age of the participants was 56.8 years, 58.2% were women and 80.1% were mestizo. The population studied had relatively low educational qualifications, with 56.8% having primary or no education, 27.6% were not working and 61.4% had incomes of less than $375 per month.

Table 1 Description of study population
Full size table

Regarding diabetes medication, the majority were on oral antidiabetic therapy (66.2%), 11.7% of patients were treated with insulin, 2.1% with only diet and the rest (20%) were on combined therapy (oral + insulin). We found that 37.5% were overweight and 29.5% were obese.

Of the 146 respondents, 135 (92.5%) answered the 18 items of DHP-18; 9 (6.2%) omitted one item and 2 (1.3%) omitted two or more items. The missing values were in items 4, 5, 7,12, 13 and 14. One item (question 14) of the DHP-18 version showed unbalanced responses with 75% of respondents reporting never.

Seventy-five (51.4%) participants were retested for DHP-18. There were no differences in socio-demographic or clinical characteristics between participants who were retested and those who were not (Table 1). In the DHP-18 retest, there were two missing values in item 4 and two in item 14, the distribution of the missing were 2 participants who did not answer one item and 1 participant did not answer two items.

Structural validity

CFA with values of χ2 (132) = 162.738, p < 0.001; CFI = 0.990; TLI = 0.989; SRMR = 0.086 and RMSEA = 0.040 indicated a good fit to the data, except for SRMR. The standardized factorial loads (λ) from each item on their respective factors were all statistically significant (p < 0.001) and ranged from 0.57 to 0.89, from 0.21 to 0.77 and from 0.46 to 0.73 for psychological distress, barriers to activity and disinhibited eating, respectively. The covariance between the three latent variables ranged from 0.54 to 0.90, with psychological distress and disinhibited eating presenting the highest covariance. And two items (questions 1 and 3) showed a λ value below 0.3, using a one-factor model (Fig. 1). When we repeated the analysis excluding these 2 items, we observed a significant improvement in all the indicators, including the SRMR, which was the only one that showed a value slightly higher than recommended (CFI = 0.997; TLI = 0.996; RMSEA = 0.027 (90% confidence interval: 0.000–0.052); SRMR = 0.078).

Fig. 1
figure 1

Confirmatory Factor Analysis performed based on the polychoric correlation matrix, using diagonally weighted least squares (DWLS). CFI = 0.990. TLI = 0.989. RMSEA = 0.040 (90% confidence interval: 0.011–0.059). SRMR = 0.086

Full size image

Reliability

Overall Cronbach’s alpha was 0.77 and dimensional alphas were 0.81, 0.63 and 0.74 for psychological distress, barriers to activity and disinhibited eating, respectively. The three dimensions were in a suitable range (0.15–0.50) for average interitem correlation values which ranged from 0.38 to 0.47, from 0.17 to 0.26 and from 0.32 to 0.41 for psychological distress, barriers to activity and disinhibited eating, respectively. Item-rest correlation values ranged from 0.39 to 0.61 for disinhibited eating while values ranged from 0.43 to 0.72 for psychological distress dimension, where item 17 showed the highest value (0.72) and ranged from 0.07 to 0.47 for barriers to activity, where item 1 showed the lowest value (0.07).

When we repeated the analysis excluding question 1 which had an item-rest correlation value below 0.30 (value: 0.07) and a λ value < 0.3 in the barriers to activity dimension, the dimensional and overall Cronbach’s alpha changed to 0.67 and 0.76, respectively. When question 17 (item-rest correlation value slightly higher than 0.7) was excluded from psychological distress dimension, the dimensional and overall Cronbach’s alpha changed to 0.75 and 0.76, respectively.

ICC values for a total of 75 retested participants (Table 2) were 0.70 (95%CI: 0.57, 0.80), 0.67 (95%CI 0.56–0.77), 0.73 (95%CI 0.64–0.81) for psychological distress, barriers to activity and disinhibited eating, respectively.

Table 2 Test–retest reliability of the Diabetes Health Profile-18 subdimensions overall, and considering a reported change in global assessment of health
Full size table

Among the retest participants, thirty-nine (52%) reported that their condition was unchanged from baseline to retest (ICC values in Table 2) and 36 (48%) reported that their condition had changed from baseline to retest. Fifteen (20%) participants reported that their condition had improved and 21 (28%) reported that their condition had deteriorated. ICC values for participants reporting that their condition stayed the same were 0.69 (95%CI 0.48–0.83), 0.66 (95%CI 0.50–0.79), 0.66 (95%CI 0.50–0.80) for psychological distress, barriers to activity and disinhibited eating, respectively.

Construct validity

Our assessment of convergent validity showed an inverse relationship between DHP-18 dimensions and SF12v2 dimensions and the results verified two of three a priori hypotheses with correlation values between 0.4 and 0.7 (Table 3).

Table 3 Convergent validity: correlation (Spearman’s r) between the Diabetes Health Profile-18 dimensions and the SF12v2 dimensions
Full size table

For discriminant validity, correlations between the DHP-18 dimensions were 0.4 or more, ranging from 0.40 to 0.74. The highest correlation was between psychological distress and disinhibited eating (r = 0.74), followed by the correlation between psychological distress and barriers to activity (r = 0.45) and the lowest was the correlation between barriers to activity and disinhibited eating (r = 0.40).

With regard to known-group validity, our results showed the expected tendency in three (H2, H3 and H6) of the 6 initial hypotheses. Compared to individuals with BMI < 30 kg/m2, those with BMI ≥ 30 kg/m2 (H2) showed higher values for each dimension, although only those associated to disinhibited eating were statistically significant. For H3 and H6, the expected tendency of scores for each dimension was obtained with higher scores in women than men and in patients with diabetes-related complications than those without, but there were no statistically significant differences (Table 4).

Table 4 Known group validity of the DHP-18
Full size table

Regarding hypotheses H1, H4 and H5, score patterns were different from those expected. Individuals with longer duration of illness (H1) had lower scores reflecting improved quality of life, although the differences were not statistically significant. Similarly, regarding educational level (H5), scores did not show a clear tendency, with the exception of lower scores for barriers to activity dimension with increasing educational level. Finally, there were no differences by presence of comorbidities (H4) but we found differences between patients with or without specific comorbidities such as hypertension and depression. Having hypertension was associated with better evaluation of two dimensions (psychological distress and disinhibited eating), while depression was associated with worse evaluation of two dimensions (barriers to activity and disinhibited eating) (Table 4).

Discussion

In the present study, we linguistically and culturally adapted the DHP-18 and investigated its psychometric properties in people resident in Quito, Ecuador. Satisfactory psychometric properties were observed in a substantial number of aspects. The factor structure was adequate but with 2 items, belonging to the dimension of barriers to activity, which were loaded below the recommended value. Although reliability parameters were adequate for psychological distress and disinhibited eating dimensions, the barriers to activity presented lower internal consistency and future analysis should verify the applicability and cultural equivalence of some of the items of this dimension to Ecuador.

Except for the dimension of barriers to activity, a good internal consistency was found. The internal consistency of the dimension of barriers to activity contrasts with another study [21] and may be related to the different populations of patients investigated [21, 22, 32], since in some studies of people with both type 1 or 2 diabetes were included. Based on a more detailed analysis of the total item statistics, we observed that the elimination of items 1 and 17, with the lowest and highest item-rest correlation values, did not produce significant increases in overall and dimensional consistency, as observed in another study [23].

The test–retest reliability showed substantial reliability values in accordance with the recommendations of the literature [36]. And the sample size used is within the recommended ranges in psychometric validation studies, which could be considered a strength of our study [49].

Regarding convergent validity, a strong correlation was shown between the dimension of psychological distress of the DHP-18 and the mental health dimension of the SF-12v2 and between the dimension of barriers to activity of the DHP-18 and the role physical dimension of the SF-12v2, corroborating two of the predefined hypotheses. Similar results have been observed in previous studies [21, 23]. However, the uninhibited eating dimension was related to the emotional role dimension and not to the physical role dimension as was hypothesized based on other studies [21].

Discriminant validity showed adequate correlations between the 3 dimensions, higher than those indicated in the literature. These results differ from other studies that showed an overall low correlation between the dimensions of DHP-18 [20, 23].

Regarding the known group validity, our results showed the expected trend in three of the 6 initial hypotheses. Regarding the hypothesis related to educational level, lower scores were given for the dimension barriers to activity with the increase in educational level. Regarding comorbidities there were also significant differences for specific comorbidities such as hypertension and depression. These results are corroborated with other studies where it was seen that the presence of hypertension resulted in a significantly lower score in the disinhibited eating dimension [50]. In the case of the duration of the disease, and despite the fact that the differences were not significant, we did see that people with a disease of longer duration reported a better quality of life. One possible explanation is that the longer the disease lasts, the more likely the patient is able to adapt to the care requirements including behaviour modification [51, 52].

The CFA indicated an adequate fit to the original three-factor model, with the exception of the SRMR indicator. The dimension barriers to activity showed the lowest standardized factorial loads, while for the dimensions psychological distress and uninhibited eating, they were adequate. Using a one-factor model, two of the 18 items, both of the activity barriers dimension, were loaded below the recommended value of 0.3, item 3 loaded with a value of 0.3 and item 1 with a value less than 0.3. Regarding item 1, the problem may be due to a lack of understanding, perhaps not at the linguistic level, but of concepts, since in the linguistic comprehension and cultural adaptation interviews, it was observed that the question was simple, short and easily understood, but sometimes people were unsure whether food “controlling one’s life” referred to the need to observe and take care of one’s diet, or whether it referred to having your life structured and organized around food, such as the timing of meals, the physical exercise depending on the amount of food, etc. Perhaps a clarification with examples could be added to overcome this issue in future uses of the questionnaire in Ecuador. Item 3, about “tied to meal times” was also flagged as potentially problematic in the initial round of reviews by the 2 medical researchers, who evaluated linguistic understanding and cultural adaptation. It should be added that we carried out a new confirmatory factor analysis, eliminating these 2 items and observed a significant improvement in all the indicators, including the SRMR, which was the only one that showed a value slightly higher than recommended.

This study has some limitations in addition to the factors discussed above. Although the DHP-18 can be used with people with either Type 1 or Type 2 diabetes, the psychometric test was not performed in type 1 diabetes, limiting the applicability of the results to those patients with type 2 diabetes. In addition, an important factor to take into account is the context in which the study was carried out, in a pandemic situation it is difficult to assess the possible changes produced and there may be factors external to the disease that can influence the results, especially of repeatability-concordance, due to changes in the context produced quickly and that can affect the quality of life of patients. Another limitation is that SF12v2 summary scores for physical and mental health can be misleading if proprietary scores are used, as a low physical health summary score tends to inflate the mental health summary score and vice versa. So this must be taken into account when interpreting the results [53, 54]. Despite this, the results are significant and similar to those obtained in other studies.

Conclusions

The strength of this study lies in the fact that this is the first adaptation and validation of a questionnaire to assess the quality of life in diabetic patients in Ecuador. Hence, it provides a practical tool to evaluate aspects such as self-control of food intake, limitations, barriers and anxiety related to daily activities, feelings, emotions, mood and irritability in people with diabetes.

The study adds to the evidence for DHP-18, showing that it is a short, acceptable, valid and reliable instrument to measure the impact of living with diabetes from a patient perspective. However, future analysis should verify the applicability and cultural equivalence of some of the items of barriers to activity dimension to Ecuador. Using DHP-18 enables clinicians to conduct an appropriate educational or therapeutic intervention to alleviate or address dysfunctional life outcomes for people living with diabetes.

Availability of data and materials

The datasets analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

PD:

Psychological distress

BA:

Barriers to activity

DE:

Disinhibited eating

DM:

Diabetes mellitus

T2DM:

Type 2 Diabetes mellitus

DHP:

Diabetes Health Profile

DHP‐18:

Diabetes Health Profile-18

CFA:

Confirmatory factor analysis

DWLS:

Diagonally Weighted Least Squares

TLI:

Tucker-Lewis index

CFI:

Comparative fit index

RMSEA:

Root mean square error of approximation

SRMR:

Standardized root mean square residual

ICC:

Intraclass correlation coefficient

SEM:

Standard error of measurement

SDC:

Smallest detectable change

MID:

Minimally important difference

SD:

Standard deviation

ES:

Effect size

References

  1. World Health Organization. Diabetes. [cited 2021 Jan 21]. https://www.who.int/es/news-room/fact-sheets/detail/diabetes

  2. Orces CH, Lorenzo C. Prevalence of prediabetes and diabetes among older adults in Ecuador: analysis of the SABE survey. Diabetes Metab Syndr. 2018;12(2):147–53.

    Article  PubMed  Google Scholar 

  3. Cordero LCA, C MAV, Cordero G, Álvarez R, Añez R, Rojas J, et al. Prevalencia de la diabetes mellitus tipo 2 y sus factores de riesgo en individuos adultos de la ciudad de Cuenca-Ecuador. Av En Biomed. 2017;6(1):10–21.

    Google Scholar 

  4. Pan American Health Organization / World Health Organization. La diabetes, un problema prioritario de salud pública en el Ecuador y la región de las Américas. 2014 [cited 2021 Jan 21]. https://www.paho.org/ecu/index.php?option=com_content&view=article&id=1400:la-diabetes-un-problema-prioritario-de-salud-publica-en-el-ecuador-y-la-regionde-las-americas&Itemid=360

  5. Organización Mundial de la Salud – Perfiles de los países para la diabetes. 2016 [cited 2021 Jan 21]. https://www.who.int/diabetes/countryprofiles/ecu_es.pdf?ua=1

  6. MSP, INEC, OPS/OMS. ENCUESTA STEPS ECUADOR. 2018 [cited 2021 Jan 21]. https://www.salud.gob.ec/wpcontent/uploads/2020/10/INFORMESTEPS.pdf

  7. Glovaci D, Fan W, Wong ND. Epidemiology of diabetes mellitus and cardiovascular disease. Curr Cardiol Rep. 2019;21(4):21.

    Article  PubMed  Google Scholar 

  8. Solli O, Stavem K, Kristiansen IS. Health-related quality of life in diabetes: the associations of complications with EQ-5D scores. Health Qual Life Outcomes. 2010;8:18.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Rubin RR, Peyrot M. Quality of life and diabetes. Diabetes Metab Res Rev. 1999;15(3):205–18.

    Article  CAS  PubMed  Google Scholar 

  10. Cannon A, Handelsman Y, Heile M, Shannon M. Burden of illness in type 2 diabetes mellitus. J Manag Care Spec Pharm. 2018;24(9-a Suppl):S5-13.

    PubMed  Google Scholar 

  11. Saleh F, Ara F, Mumu SJ, Hafez MA. Assessment of health-related quality of life of Bangladeshi patients with type 2 diabetes using the EQ-5D: a cross-sectional study. BMC Res Notes. 2015;8:497.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  12. Zhou T, Guan H, Yao J, Xiong X, Ma A. The quality of life in Chinese population with chronic non-communicable diseases according to EQ-5D-3L: a systematic review. Qual Life Res Int J Qual Life Asp Treat Care Rehabil. 2018;27(11):2799–814.

    Article  Google Scholar 

  13. Pequeno NPF, Cabral NLDA, Marchioni DM, Lima SCVC, Lyra CDO. Quality of life assessment instruments for adults: a systematic review of population-based studies. Health Qual Life Outcomes. 2020;18(1):208.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Ware JE, Gandek B, Guyer R, Deng N. Standardizing disease-specific quality of life measures across multiple chronic conditions: development and initial evaluation of the QOL Disease Impact Scale (QDIS®). Health Qual Life Outcomes. 2016;14:84.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Romero-Naranjo F, Espinosa-Uquillas C, Gordillo-Altamirano F, Barrera-Guarderas F. Which factors may reduce the health-related quality of life of Ecuadorian patients with diabetes? Proc R Health Sci J. 2019;38(2):102–8.

    Google Scholar 

  16. Lara M, José M. Diabetes mellitus y sus factores de riesgo en el Ecuador. agosto de 2016 [cited 2021 Jan 21]. http://repositorio.usfq.edu.ec/handle/23000/5697

  17. Jácome Á, Francisco J. Factores de riesgo socioeconómicos en la prevalencia de diabetes tipo II: evidencia en el Ecuador ENSANUT-ECU 2011–2013. 2018 [cited 2021 Jan 30]. http://repositorio.puce.edu.ec:80/xmlui/handle/22000/15622

  18. Pereira EV, Tonin FS, Carneiro J, Pontarolo R, Wiens A. Evaluation of the application of the Diabetes Quality of Life Questionnaire in patients with diabetes mellitus. Arch Endocrinol Metab. 2020;64(1):59–65.

    Article  PubMed  Google Scholar 

  19. Palamenghi L, Carlucci MM, Graffigna G. Measuring the quality of life in diabetic patients: a scoping review. J Diabetes Res. 2020;2020:5419298.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Meadows K, Steen N, McColl E, Eccles M, Shiels C, Hewison J, et al. The Diabetes Health Profile (DHP): a new instrument for assessing the psychosocial profile of insulin requiring patients–development and psychometric evaluation. Qual Life Res Int J Qual Life Asp Treat Care Rehabil. 1996;5(2):242–54.

    Article  CAS  Google Scholar 

  21. Santos Cruz R, Leitão CE, Lopes FP. Determinantes do estado de saúde dos diabéticos. Rev Port Endocrinol Diabetes E Metab. 2016;11(2):188–96.

    Google Scholar 

  22. Tan ML, Khoo EY, Griva K, Lee YS, Amir M, Zuniga YL, et al. Diabetes health profile-18 is reliable, valid and sensitive in Singapore. Ann Acad Med. 2016;45(9):383–93.

    Google Scholar 

  23. Jelsness-Jørgensen L-P, Jensen Ø, Gibbs C, Bekkhus Moe R, Hofsø D, Bernklev T. Psychometric testing of the Norwegian Diabetes Health Profile (DHP-18) in patients with type 1 diabetes. BMJ Open Diabetes Res Care. 2018;6(1):e000541.

    Article  PubMed  PubMed Central  Google Scholar 

  24. García-Carrera C, Gutierrez-Fuentes E, Borroel-Saligan L, Oramas P, Vidal-López M. Club de diabéticos y su impacto en la disminución de glicemia del diabético tipo 2. Salud en Tabasco. 2002;8(1):16–9.

    Google Scholar 

  25. Olvera JP. La influencia del grupo de autoayuda de pacientes diabéticos en el control de su enfermedad. Horiz Sanit. 2009;8(1):44–58.

    Article  Google Scholar 

  26. Gandek B, Ware JE, Aaronson NK, Apolone G, Bjorner JB, Brazier JE, et al. Cross-validation of item selection and scoring for the SF-12 Health Survey in nine countries: results from the IQOLA Project. International Quality of Life Assessment. J Clin Epidemiol. 1998;51(11):1171–8.

    Article  CAS  PubMed  Google Scholar 

  27. Omary MB, Eswaraka J, Kimball SD, Moghe PV, Panettieri RA, Scotto KW. The COVID-19 pandemic and research shutdown: staying safe and productive. J Clin Investig. 2020;130(6):2745–8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Mokkink LB, Prinsen CAC, Bouter LM, de Vet HCW, Terwee CB. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument. Braz J Phys Ther. 2016;20(2):105–13.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Bell ML, Fairclough DL, Fiero MH, Butow PN. Handling missing items in the Hospital Anxiety and Depression Scale (HADS): a simulation study. BMC Res Notes. 2016;9(1):479.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Meadows K. Diabetes health profile user manual—sample pages. 2015.

  31. McHorney CA, Tarlov AR. Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual Life Res Int J Qual Life Asp Treat Care Rehabil. 1995;4(4):293–307.

    Article  CAS  Google Scholar 

  32. Meadows KA, Abrams C, Sandbaek A. Adaptation of the Diabetes Health Profile (DHP-1) for use with patients with Type 2 diabetes mellitus: psychometric evaluation and cross-cultural comparison. Diabet Med J Br Diabet Assoc. 2000;17(8):572–80.

    Article  CAS  Google Scholar 

  33. Mîndrilă D. Maximum likelihood (ML) and diagonally weighted least squares (DWLS) estimation procedures: a comparison of estimation bias with ordinal and multivariate non-normal data. Int J Digit Soc. 2010;1(1):60–6.

    Article  Google Scholar 

  34. Flora DB, Curran PJ. An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychol Methods. 2004;9(4):466–91.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Forero CG, Maydeu-Olivares A, Gallardo-Pujol D. Factor analysis with ordinal indicators: a Monte Carlo study comparing DWLS and ULS estimation. Struct Equ Model Multidiscip J. 2009;16(4):625–41.

    Article  Google Scholar 

  36. Prinsen CAC, Vohra S, Rose MR, Boers M, Tugwell P, Clarke M, et al. How to select outcome measurement instruments for outcomes included in a “Core Outcome Set”—a practical guideline. Trials. 2016;17(1):449.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6(1):1–55.

    Article  Google Scholar 

  38. Clark LA, Watson D. Constructing validity: basic issues in objective scale development. Psychol Assess. 1995;7(3):309–19.

    Article  Google Scholar 

  39. Mulhern B, Meadows K. Investigating the minimally important difference of the Diabetes Health Profile (DHP-18) and the EQ-5D and SF-6D in a UK diabetes mellitus population. Health (NY). 2013;05(06):1045–54.

    Google Scholar 

  40. Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.

    Article  PubMed  Google Scholar 

  41. Bland JM, Altman DG. Measurement error. BMJ. 1996;312(7047):1654.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Kazis LE, Anderson JJ, Meenan RF. Effect sizes for interpreting changes in health status. Med Care. 1989;27(3 Suppl):S178-189.

    Article  CAS  PubMed  Google Scholar 

  43. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: L. Erlbaum Associates; 1988.

    Google Scholar 

  44. Jing X, Chen J, Dong Y, Han D, Zhao H, Wang X, et al. Related factors of quality of life of type 2 diabetes patients: a systematic review and meta-analysis. Health Qual Life Outcomes. 2018;16(1):189.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Rozjabek H, Fastenau J, LaPrade A, Sternbach N. Adult obesity and health-related quality of life, patient activation, work productivity, and weight loss behaviors in the United States. Diabetes Metab Syndr Obes Targets Ther. 2020;13:2049–55.

    Article  Google Scholar 

  46. Alshayban D, Joseph R. Health-related quality of life among patients with type 2 diabetes mellitus in Eastern Province, Saudi Arabia: a cross-sectional study. PLoS ONE. 2020;15(1):e0227573.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  47. Norris SL. Health-related quality of life among adults with diabetes. Curr Diab Rep. 2005;5(2):124–30.

    Article  PubMed  Google Scholar 

  48. Glasgow RE, Ruggiero L, Eakin EG, Dryfoos J, Chobanian L. Quality of life and associated characteristics in a large national sample of adults with diabetes. Diabetes Care. 1997;20(4):562–7.

    Article  CAS  PubMed  Google Scholar 

  49. Polit DF. Getting serious about test–retest reliability: a critique of retest research and some recommendations. Qual Life Res. 2014;23(6):1713–20.

    Article  PubMed  Google Scholar 

  50. Goddijn P, Bilo H, Meadows K, Groenier K, Feskens E, Meyboom-de JB. The validity and reliability of the Diabetes Health Profile (DHP) in NIDDM patients referred for insulin therapy. Qual Life Res Int J Qual Life Asp Treat Care Rehabil. 1996;5(4):433–42.

    Article  CAS  Google Scholar 

  51. Lambrinou E, Hansen TB, Beulens JW. Lifestyle factors, self-management and patient empowerment in diabetes care. Eur J Prev Cardiol. 2019;26(2_suppl):55–63.

    Article  PubMed  Google Scholar 

  52. Chrvala CA, Sherr D, Lipman RD. Diabetes self-management education for adults with type 2 diabetes mellitus: a systematic review of the effect on glycemic control. Patient Educ Couns. 2016;99(6):926–43.

    Article  PubMed  Google Scholar 

  53. Farivar SS, Cunningham WE, Hays RD. Correlated physical and mental health summary scores for the SF-36 and SF-12 Health Survey, V.I. Health Qual Life Outcomes. 2007;5:54.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Fleishman JA, Selim AJ, Kazis LE. Deriving SF-12v2 physical and mental health summary scores: a comparison of different scoring algorithms. Qual Life Res Int J Qual Life Asp Treat Care Rehabil. 2010;19(2):231–41.

    Article  Google Scholar 

Download references

Acknowledgements

The authors wish to thank María Hernández, Blanca Chamorro, Sofía Mosquera, and Cristian Cuhunay for interviewing the participants. To Jimmy Martin Delgado for his help with the translation of the questionnaire. To Amparito Carrera, the president of the Chimbacalle diabetic patients club. To the health promoters of the participating health centers. And a special thanks to all the study participants.

Funding

This research was funded by a H2020 European Research Council 2018 Starting Grant, Grant Number 804761—CEAD.

Author information

Authors and Affiliations

  1. Department of Public Health, Universidad Miguel Hernández, Sant Joan d’Alacant, Alicante, Spain

    Ikram Benazizi,  Mari Carmen Bernal-Soriano , Andrés Peralta-Chiriboga, Blanca Lumbreras  & Lucy Anne Parker

  2. CIBER de Epidemiología y Salud Pública (CIBERESP), Madrid, Spain

    Mari Carmen Bernal-Soriano , Yolanda Pardo , Aida Ribera, Montserrat Ferrer, Jordi Alonso, Blanca Lumbreras  & Lucy Anne Parker

  3. Health Services Research Group, IMIM (Hospital del Mar Medical Research Institute), Barcelona, Spain

    Yolanda Pardo , Montserrat Ferrer & Jordi Alonso

  4. Universitat Autònoma de Barcelona, Barcelona, Spain

    Yolanda Pardo  & Montserrat Ferrer

  5. Cardiovascular Epidemiology and Research Unit, University Hospital and Research Institute Vall d’Hebron (VHIR), Barcelona, Spain

    Aida Ribera

  6. Instituto de Salud Pública, Pontificia Universidad Católica del Ecuador, Quito, Ecuador

    Andrés Peralta-Chiriboga

  7. Unidad Docente de Medicina Preventiva y Salud Pública de Cantabria, Consejería de Sanidad de Cantabria, Santander, Spain

    Alfonso Alonso-Jaquete

  8. Department of Experimental and Health Sciences, Pompeu Fabra University, Barcelona, Spain

    Jordi Alonso

Authors
  1. Ikram Benazizi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mari Carmen Bernal-Soriano
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yolanda Pardo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Aida Ribera
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Andrés Peralta-Chiriboga
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Montserrat Ferrer
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Alfonso Alonso-Jaquete
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Jordi Alonso
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Blanca Lumbreras
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Lucy Anne Parker
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

LAP and IB designed the study and all authors reviewed and approved the proposed methodology. IB, AP-C, AA-J and MCB-S carried out linguistical and cultural adaptation of the questionnaire. IB was responsible for data acquisition in the psychometric validation. IB, MCB-S, YP and AR analysed and interpreted the data. IB, MCB-S and LAP drafted the manuscript, which was critically reviewed and discussed with all co-authors. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Ikram Benazizi.

Ethics declarations

Ethics approval and consent to participate

All participants provided informed consent. The study protocol was approved by the ethical board at the Universidad Central del Ecuador (UCE, reference 00022-UMHE-E-2019).

Consent for publication

All authors fulfil the criteria for authorship and have read and approved the final version of this manuscript.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Benazizi, I., Bernal-Soriano , .C., Pardo , Y. et al. Adaptation and psychometric validation of Diabetes Health Profile (DHP-18) in patients with type 2 diabetes in Quito, Ecuador: a cross-sectional study. Health Qual Life Outcomes 19, 189 (2021). https://doi.org/10.1186/s12955-021-01818-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-021-01818-5

Keywords

  • Diabetes Health Profile-18
  • Diabetes mellitus
  • Quality of life
  • Validity
  • Reliability
  • Ecuador

Health and Quality of Life Outcomes

ISSN: 1477-7525

Contact us