Skip to main content

Discriminative capacity of the Spanish version of the Inventory of Depression and Anxiety Symptoms-II (IDAS-II) for detecting DMS-5 specific disorders and poor quality of life in a clinical sample

Abstract

Background

Emotional problems can be evaluated using categorical approaches to guide treatment choices focused on targeting specific disorders, or dimensional approaches to reduce symptom severity. Moreover, recent evidence points out the need to intervene in patients’ quality of life (QoL), which often remains low even after the remission of emotional problems. Thus, assessment instruments are needed to provide information on diagnosis, symptom severity, and QoL. The present study aimed to provide diagnostic and QoL cutoffs for the Inventory of Depression and Anxiety Symptoms-II (IDAS-II).

Methods

273 patients recruited from mental health services in Huelva (Spain) completed the IDAS-II, Mini International Neuropsychiatric Interview, and Short Form-36 Health Survey. Receiver operating characteristic curve analyses were used to establish cutoff values. Diagnostic, balanced, and screening cutoffs were provided for each IDAS-II scale to detect corresponding diagnoses and poor QoL.

Results

The specific IDAS-II scales Suicidality, Panic, Social Anxiety, Claustrophobia, and Traumatic Intrusions showed adequate discrimination values for their corresponding diagnoses (suicidal behavior disorder, panic disorder, social anxiety disorder, agoraphobia, and post-traumatic stress disorder, respectively). Both the General Depression and Dysphoria scales showed adequate ability to detect major depressive disorder. The IDAS-II scales showed a higher discrimination ability for Mental Health-related QoL, than for General Health-related QoL.

Conclusions

The diagnostic and QoL cutoffs expand the clinical utility of the IDAS-II in clinical practice and research, making it a comprehensive, detailed, and versatile self-report tool. The IDAS-II allows for the assessment of emotional problems consistent with the dimensional, categorical, transdiagnostic, and QoL approaches.

Depression and anxiety are the most prevalent mental disorders worldwide [1], with prevalences of 33.7% and 31.9%, respectively, during the COVID-19 pandemic [2]. These disorders are associated with more years lived with disability [1, 3], poor quality of life (QoL) [4, 5], and high rates of comorbidity with other internalizing disorders [6, 7] (e.g., obsessive-compulsive disorder [OCD], post-traumatic stress disorder [PTSD], and social anxiety disorder [SAD]).

Mood and anxiety disorders are commonly diagnosed using the categorical systems of the DSM [8] and ICD [9], which rely on the presence (versus absence) of certain symptoms. These systems unify diagnostic language, monitor prevalence statistics, and guide treatment choices, where each diagnosis has traditionally been treated with syndrome-specific treatments [10]. For example, Division 12 of the APA [11] provides a list of psychological treatments recommended for specific disorders, such as Behavioral Activation for depression. The DSM and ICD remain the most widely used diagnostic systems worldwide [12, 13].

Complementary dimensional approaches have emerged in recent decades, including Research Domain Criteria [14], Hierarchical Taxonomy of Psychopathology (HiTOP) [15], network theory [16], and Process-Based Therapy [17, 18]. Dimensional approaches conceptualize psychopathological constructs as a continuum of severity, especially focusing on symptoms, and guide treatment planning [10]. For instance, HiTOP describes symptom severity to aid in treatment selection [19, 20]. Additionally, clinicians can intervene in broader (spectra) or narrower (symptoms) levels of HiTOP depending on the patient’s needs. Interventions on spectra allow the treatment of comorbidities by focusing on common aspects of different disorders through transdiagnostic interventions [21]. Alternatively, clinicians can treat specific, clinically relevant symptoms [19]. In parallel, Process-Based Therapy tracks symptom changes [22] and network theory helps visualize the relationship between symptoms [16], guiding the development of personalized interventions [10, 23, 24].

Although dimensional approaches mainly focus on reducing symptom severity, recent evidence highlights the importance of improving patient QoL for several reasons [25,26,27]. First, depression and anxiety affect QoL [4, 25] more than do other chronic diseases [28]. Certain symptoms such as sad mood and lack of concentration are especially disabling, indicating the relevance of assessing the specific symptomatology of each patient [29, 30]. Second, QoL plays a crucial role in establishing a diagnosis, as a person must experience clinically significant distress or functional impairment due to their symptoms [8]. Finally, QoL predicts prolonged remission of depression more effectively than decreases in symptomatology [26, 27], suggesting that good QoL may serve as a protective factor against depressive episodes. Consequently, QoL has been incorporated as an outcome measure [31, 32], and some authors advocate integrating QoL measures into instruments assessing depression.

Given the importance of both categorical, and dimensional models and the growing concern about QoL, measurement instruments should be able to discriminate between disorders, assess symptom severity, and provide information about QoL. Furthermore, in transdiagnostic interventions, the symptoms of different disorders should be evaluated using the same timeframe and response format to avoid variance bias related to the method [33, 34]. One of the instruments that best addresses these requirements is the Inventory of Depression and Anxiety Symptoms-II (IDAS-II) [35]. The IDAS-II is widely used to assess depression [36], and has been recommended as an efficient transdiagnostic measure to assess internalizing symptoms [37]. This instrument has shown adequate psychometric properties in English, Turkish, Spanish, German, Romanian, and Swedish [35, 38,39,40,41,42]. Additionally, the IDAS-II has norms to interpret symptom severity [43, 44] and clinical cutoffs to differentiate between functional and dysfunctional samples, and between moderate and severe impairment [45]. However, diagnostic cutoffs to differentiate among clinical diagnoses are only available for the first version of the instrument (IDAS) [46], and cutoffs to discriminate poor QoL have not yet been provided.

The present study aims to expand the clinical utility of the IDAS-II by examining the accuracy of its scales in discriminating between the presence and absence of internalizing disorders such as major depressive disorder (MDD), generalized anxiety disorder (GAD), suicidal behavior disorder (SBD), panic disorder (PD), SAD, agoraphobia, and PTSD. Further, the explanatory capacity of the IDAS-II to determine poor QoL will be analyzed. Screening, diagnostic, and balance cutoffs to discriminate between the presence and absence of their corresponding mental disorders (e.g., the cutoff of the Panic IDAS-II scale to discriminate the presence of PD and between poor and average/good QoL will be determined. According to previous research, we expect to find: i) adequate values of discrimination (AUC ≥ .70 [47]) for the specific IDAS-II scales and their corresponding diagnosis; ii) broader IDAS-II scales of Dysphoria and General Depression will show greater AUC for MDD and GAD; and iii) General Depression and Dysphoria scores will show better explanatory ability to determine poor QoL [29, 30].

Methods

Participants and procedure

A total of 273 patients were selected from public and private mental health services in Huelva (Spain), between June 2020 and September 2023. Owing to the lack of a recent census of people undergoing treatment at mental healthcare centers, a non-probability systematic sampling procedure was applied. Patients consecutively cited for treatment during the study period were invited to participate, as long as they met the inclusion and exclusion criteria. Inclusion criteria were age 18–80 years and being under treatment at a mental health service during data collection. Exclusion criteria included having a medical or psychological disorder that disqualified them from taking the tests, such as acute psychotic disorders and severe or profound intellectual disabilities, or not signing the informed consent form.

The mean age was 39.96 years (SD = 15.43), and 74% were women. Of the participants, 2.6% had not completed primary education, 9.2% had completed primary education, 21.6% had completed secondary education, 45.5% had completed post-compulsory education, and 21.3% had completed university education. Regarding employment status, 45.5% of the respondents were employed. According to the DSM-5, 78.8% of the participants met the diagnostic criteria for at least one mental disorder, and 59.3% had diagnostic comorbidity. Table 1 shows the prevalence of diagnoses in the sample (Bipolar I Disorder [BID] and Bipolar II Disorder [BIID] were excluded because of their low prevalence rates [0.70% and 0.40%, respectively]). The most frequent diagnoses were GAD (50.18%) and MDD (46.52%). The highest comorbidity rates were found between GAD and MDD (29.67%), and between GAD and OCD (21.98%).

Table 1 Prevalence and comorbidities of the sample (N = 273)

A trained psychologist individually administered the instruments in the centers where the participants were recruited using paper-based methods. All participants were informed of their anonymous and voluntary participation in the study and provided written informed consent. An anonymized code was established for each patient to ensure that no identifying information was recorded anywhere. The custody of the interviews and the anonymized database complied with applicable data protection regulations. Participants received a voucher redeemable for gifts. This study and data management process was approved by the Bioethics Committee of the Province of Huelva (Junta de Andalucía, Spain) (No. 0275-N-21).

Measures

Inventory of Depression and Anxiety Symptoms-II

(IDAS-II; Spanish version; [39]) was used to assess internalizing symptoms. The IDAS-II is composed of 99 items rated on a 5-point scale (from 1 “not at all” to 5 “extremely”). Higher scores indicate higher symptom severity. The items are organized into 18 scales, in addition to General Depression (a scale composed of items from other scales). All scales assess specific symptoms of internalizing disorders except for Dysphoria and General Depression, which have a broad scope. General Depression provides an overall score for depression, whereas Dysphoria assesses the core symptoms of depression and anxiety disorders. The reliability values for the sample used in this study are listed in Table 2. Cronbach’s alpha coefficient ranged between .71 and .92, except for Lassitude scale (α = .69). Reliability values estimated using McDonald’s omega coefficient ranged between .70 and .92, except for Lassitude scale (ω = .68).

Table 2 Descriptive statistics and reliability of the measured scales (n = 273)

Mini-International Neuropsychiatric Interview

(MINI; Spanish version for DSM-5; [48,49,50]) was used to assess the diagnosis of mental disorders according to the DSM-5 criteria. Interviewer asks about a set of presence of symptoms using yes/no questions. According to the number of symptoms detected in each disorder, the scoring rules of the instrument specify which diagnoses are assigned to each patient. In the present study, the modules for MDD, SBD, BID, BIID, PD, agoraphobia, SAD, OCD, PTSD, and GAD were administered.

Short Form-36 Health Survey

(SF-36; Spanish version; [51]) was used to assess QoL. The SF-36 consists of 36 items with multi-item scales that measure health status domains (Physical Functioning, Role-Physical, Bodily Pain, General Health, Vitality, Social Functioning, Role-Emotional, and Mental Health). Higher scores indicate a better health status. The present study used scores from mental and general health domains. The General Health score was calculated by summing recoded items 1, 11a, 11b, 11c, and 11d, and the Mental Health score was computed by summing recoded items 9b, 9c, 9d, 9f, and 9 h [52]. Mental Health assesses general mental health, including depression, anxiety, behavioral and emotional control, and overall positive affect. General Health assesses current health, future health prospects, and resistance to illness. In the present study, Cronbach’s alpha coefficient were .83 (Mental Health) and .70 (General Health), and McDonald’s omega coefficient were .85 (Mental Health) and .77 (General Health) (see Table 2).

Data analysis

Missing values were found in 1.1% of respondents in the MINI and 0.37% of respondents in the SF-36. Cases with missing values were excluded from analyses using the pairwise procedure.

First, we provided descriptive statistics for the IDAS-II scales and the Mental Health and General Health domains of the SF-36. Internal consistency was assessed by estimating Cronbach’s alpha (α) and McDonald’s omega (ω).

Second, we applied receiver operating characteristic (ROC) curve analysis to examine the discrimination of the IDAS-II scales between the presence and absence of each internalizing DSM-5 diagnosis showing a prevalence higher than 4% in the sample, ensuring a minimum sample size of 10 patients for each category. ROC analysis evaluates the performance of the diagnostic classification (presence vs. absence of a disorder) by determining the sensitivity and specificity associated with each possible cutoff point [53]. Sensitivity corresponds to the proportion of people with the disorder correctly classified as having it and specificity corresponds to the proportion of people without the disorder correctly classified as not having it. Next, ROC analysis was applied to examine the discrimination of the IDAS-II scales between poor and average/good QoL. We applied a cutoff point of T-score ≤ 35 to the Mental Health and General Health QoL domain scores to differentiate between poor and average/good QoL. This criterion, indicating levels of the measure in the lower 7% of the population, is widely considered an indicator of clinical significance across commonly used measures [54, 55] in clinical practice and within research contexts to identify clinically significant impairments [56, 57]. To analyze the accuracy of the measure for classifying subjects according to reference standards (DSM-5 diagnosis and QoL level), we estimated the AUC [58], which reflects the ability of the test to discriminate between individuals with and without the diagnosis [59]. AUC values > .70 indicate poor discrimination, .70–.80 acceptable discrimination, .80–.90 excellent discrimination, and > .90 outstanding discrimination [47].

Finally, we estimated the cutoffs for the IDAS-II scales to discriminate their corresponding diagnoses (e.g., cutoff for the Panic scale in detecting PD). Considering the broad scope of the General Depression and Dysphoria, we developed cutoffs for these scales to predict both GAD and MDD. Cutoffs for the IDAS-II to discriminate between poor or average/good Mental Health and General Health-related QoL were also estimated. The cutoff values were estimated only when the AUC values were ≥ .70. Based on a previous study developed for the IDAS [46], we determined three cutoffs for each scale: diagnostic cutoff (more conservative) corresponding to the lowest score with a minimum specificity of .90; screening cutoff (more liberal) corresponding to the highest score with a minimum sensitivity of .90; and balanced cutoff (most useful in research contexts) optimal for discriminating between those who met the diagnostic criteria for a disorder and those who did not, corresponding to the score with the lowest difference between sensitivity and specificity. For each cutoff score, we computed sensitivity, specificity, and Youden’s index [60] (ranging between 0 and 1), with higher values indicating better discriminative capacity of the cutoffs. Finally, for cutoffs to discriminate diagnoses, we estimated the positive predictive value (PPV) (the probability of actually having a diagnosis when the test result is positive), negative predictive value (NPV) (the probability of not actually having the diagnosis when the test result is negative), LR+ (the ratio between the probability of a sick person testing positive and the probability of a healthy person testing positive, indicating how many times a sick person is more likely to test positive than a healthy person to test positive), and LR- (the ratio between the probability of an individual with a disease having a negative test and the probability of an individual without a disease having a negative test). That is, LR- indicates the proportion of healthy subjects who obtained a negative result) [61]. A 95% confidence interval was calculated for each value [62]. The confidence intervals of the likelihood ratios (LR) were calculated using the ‘Log method’ as described on page 109 of the text of Altman et al. [63]. The values for sensitivity, specificity, Youden’s index, PPV, NPV, LR+, and LR- of the MINI diagnoses to predict quality of life were obtained to compare them with the values obtained for the IDAS-II scales. The results of this analysis are presented as supplementary material. Analyses were conducted using SPSS 29.

Results

The AUC values for each IDAS-II scale for predicting the DSM-5 diagnoses are shown in Table 3. Regarding the general IDAS-II scales, both General Depression and Dysphoria showed adequate discrimination for MDD (AUC = .78 and .76, respectively), whereas only General Depression showed adequate discrimination for GAD (AUC = .70). Adequate values of discrimination were also found for General Depression and Dysphoria in explaining SBD (AUC = .77 and.74, respectively) and SAD (AUC = .72 and .73), for Dysphoria in explaining PD (AUC = .70), and for General Depression in explaining PTSD (AUC = .70) and OCD (AUC = .70). Concerning the specific IDAS-II scales, we found adequate AUC values for Suicidality in predicting SBD (AUC = .84), Panic in predicting PD (AUC = .71), Social Anxiety in predicting SAD (AUC = .83), Claustrophobia in predicting Agoraphobia (AUC = .77), and Traumatic Intrusions in predicting PTSD (AUC = .76). In contrast, AUC values < .70 were found for Traumatic Avoidance in predicting PTSD (AUC = .63), and Checking (AUC = .64), Ordering (AUC = .62), and Cleaning (AUC = .56) in predicting OCD.

Table 3 AUC values [lower/upper 95% CI] for DSM-5 MINI diagnoses and SF-36 domains

The AUC values for each IDAS-II scale in predicting Mental Health and General Health are shown in Table 3. Six IDAS-II scales showed adequate discrimination for both Mental Health and General Health (with higher AUC values for Mental Health): General Depression (AUC = .74 and .90, respectively), Dysphoria (AUC = .71 and .87), Lassitude (AUC = .72 and .75), Suicidality (AUC = .71 and .76), Panic (AUC = .72 and .81), and Traumatic Intrusions (AUC = .72 and .74). Other six IDAS-II scales showed adequate AUC values only for predicting Mental Health: Insomnia (AUC = .76), Appetite Loss (AUC = .72), Well-Being (recoded) (AUC = .80), Ill Temper (AUC = .75), Social Anxiety (AUC = .71) and Claustrophobia (AUC = .70).

Table 4 shows the cutoff scores for the IDAS-II scales for predicting their corresponding diagnoses. For instance, the most adequate cutoff for the General Depression scale was for predicting MDD (AUC = .78). The balanced cutoff (≥ 66; percentile 58) showed adequate values of sensitivity (.693 [.61/.77]) and specificity (.767 [.70/.84]), and a high prediction of true diagnosis when the result was positive (PPV = .721; LR + = 2.97) and negative (NPV = .742; LR- = 0.40). The screening cutoff (≥ 53; percentile 34) showed high sensitivity (.913 [.86/.96]) and remarkable values of LR- (0.17) or NPV (only 13% of people with a score below the cutoff could be diagnosed with MDD), and an acceptable PPV (up to 61% of people diagnosed with MDD could truly have the disorder) and small LR+ (1.83). Regarding the diagnostic cutoff (≥ 77; percentile 85), 74% of people with a score equal to or greater than the cutoff will probably meet the criteria for MDD diagnosis. This diagnostic cutoff had a very high specificity (.911 [.87/.96]) and an acceptable NPV (.594). Concerning the specific scales, the higher AUC values corresponded to Suicidality for predicting SBD (AUC = .84) and Social Anxiety for predicting SAD (AUC = .83).

Table 4 Cutoffs of the IDAS-II scales and the utility of predicting DSM-5 MINI diagnoses

The cutoff scores for the IDAS-II scales for predicting poor Mental Health and General Health-related QoL are presented in Table 5. General Depression had the highest discrimination value for Mental Health (AUC = .90). The balanced cutoff (≥ 54; percentile 35) showed high values of sensitivity (.833 [.78/.88]) and specificity (.855 [.77/.94]). The diagnostic cutoff (≥ 61; percentile 48) corresponded to a very high specificity (.942 [.89/1]) and adequate sensitivity (.695 [.63/.76]). In turn, the screening cutoff (≥ 50; percentile 23) showed a higher sensitivity (.916 [.88/.95]). Sensitivity and specificity values computed for each of the IDAS-II scores predicting poor Mental Health (T-score ≤ 35) are higher than the same values computed for equivalent MINI diagnosis (see supplementary Table S1).

Table 5 Cutoffs of the IDAS-II scales and utility of predicting SF-36 domains (General Health and Mental Health)

Regarding the prediction of SF-36 General Health, the highest discrimination value was found for the IDAS-II General Depression (AUC = .74). The balanced cutoff (≥ 64; percentile 53) had comparable specificity (.669 [.59/.75]) and specificity (.678 [.60/.75]). The diagnostic cutoff (≥ 75; percentile 77) corresponded to high specificity (.901 [.85/.95]). The screening cutoff of General Depression for discriminating poor General Health was the same as for discriminating poor Mental Health (≥ 50; percentile 23). While general IDAS-II scales (General Depression and Dysphoria scales) show higher specificity and J index than those computed for MINI diagnoses, all sensitivity values for predicting General Health are higher for MINI diagnoses (see supplementary Table S1).

Discussion

The present study expands the clinical utility of the Spanish version of the IDAS-II [39] by providing cutoffs to discriminate the diagnoses of the main emotional disorders and to identify poor QoL of those symptoms most associated. Consistent with our hypotheses, the specific IDAS-II scales of Suicidality, Panic, Social Anxiety, Claustrophobia, and Traumatic Intrusions adequately discriminated their corresponding diagnoses (SBD, PD, SAD, Agoraphobia, and PTSD), yet Checking, Ordering, and Cleaning showed poor discriminating values for OCD. Regarding the broad IDAS-II scales, both General Depression and Dysphoria showed adequate discrimination values for MDD. However, in contrast to our second hypothesis, only General Depression scores were adequate to explain GAD. The IDAS-II scales showed higher discrimination for Mental Health-related QoL, than for General Health-related QoL, with General Depression and Dysphoria showing best explanatory ability to determine poor QoL. The results of this study and their application in clinical practice are discussed below.

Regarding the accuracy of the specific IDAS-II scales in discriminating the presence of internalizing disorders, the results were partially consistent with our first hypothesis, as the Trauma Avoidance scale did not show adequate discrimination for predicting PTSD, and neither did Checking, Ordering, and Cleaning for predicting OCD. Several studies suggest additional variables mediating avoidant behaviors and PTSD. For instance, Pineles et al. [64] found that individuals who greatly used avoidant coping strategies were more reactive to trauma reminders and, thus, may be at greater risk of increasing their PTSD symptoms. Serrano-Ibáñez [65] suggest a moderated mediation influence of other additional variables such as guilt and dissociation on the relationship between avoidance and PTSD symptoms. These evidences may suggest an indirect relation of traumatic avoidance of PTSD diagnosis, partially explaining the present results. Interestingly, Traumatic Avoidance and Traumatic Intrusions adequately predicted SBD. This is consistent with previous research showing that the suicide rate is 5.36 times higher in individuals diagnosed with PTSD [66], where intrusion and avoidance symptoms are significantly associated with suicide attempts [67]. This suggests the need to explore SBD symptoms when PTSD is diagnosed, and to treat suicidality when necessary. The poor discrimination found for the Checking, Ordering, and Cleaning scales can be partially explained by the measures used, as the MINI assesses global OCD [48], whereas the IDAS-II assesses specific types of OCD (checking, ordering, and cleaning) [35]. Consequently, MINI diagnoses of OCD do not necessarily involve checking, ordering, or cleaning, implying that some positive OCD cases are false positives for OCD subtype checking, ordering, or cleaning. This could have contributed to the poor discrimination observed for the Checking, Ordering, and Cleaning scales in predicting OCD.

Regarding the broad IDAS-II scales, General Depression showed adequate discrimination for predicting MDD and GAD, and Dysphoria for predicting MDD but not GAD. However, Dysphoria showed adequate ability to predict GAD, as assessed by the MINI in a previous study [46]. The mixed results found for Dysphoria could be partially explained by the use of different samples. While Stasik-O’Brien et al. [46] used a mixed sample (community adults and patients), our sample was exclusively composed of patients. The use of control samples (i.e., community) in clinical studies increases the rate of well-predicted non-diseased individuals and, consequently, the AUC scores [68]. This is consistent with the higher AUC values observed for the IDAS and IDAS-II broad scales in previous studies using mixed samples [45, 46]. Concerning the second hypothesis, General Depression and Dysphoria showed greater AUC values for MDD but not for GAD, as the second-highest AUC values for these scales were found for SBD. This is probably because the Dysphoria scale assesses more depressive symptoms commonly associated with SBD than anxiety symptoms of GAD.

Regarding the accuracy of the IDAS-II in discriminating poor QoL, IDAS-II scores showed a greater ability to explain Mental Health than General Health-related QoL, in line with previous studies [69,70,71]. Consistent with the third hypothesis, Dysphoria and General Depression showed a better explanatory ability to determine poor Mental Health and General Health-related QoL. The Panic scale showed a particularly high discriminative ability to predict Mental Health-related QoL, with PD being one of the disorders more associated with poor QoL [72,73,74]. In contrast, other scales (e.g., Euphoria, Mania, Ordering), did not show discriminative ability in predicting QoL. These results are consistent with previous studies that highlighted the importance of evaluating the impact of each symptom separately, as each symptom has a distinct impact on impairment [29, 30].

Concerning clinical utility, the cutoffs provided respond to the demands in clinical practice, allowing adequate discrimination of seven of the eight disorders assessed by IDAS-II scales (MDD, GAD, SBD, PD, SAD, Agoraphobia, and PTSD). Moreover, we provided three cutoffs for screening, research, and diagnostic purposes [46]. Specifically, diagnostic cutoffs can guide the selection of syndrome-specific treatments by accurately identifying internalizing disorders. Unlike traditional diagnostic interviews (e.g., Structured Clinical Interview for DSM [75] and MINI [48]), the IDAS-II evaluates symptom severity in agreement with dimensional approaches. Similarly, QoL cutoffs evaluate QoL as a treatment outcome, in line with recent demands [25, 73]. Assessment of QoL is particularly relevant for internalizing disorders, such as PD, which are significantly associated with poor QoL even after symptom remission [73]. Therefore, treatment should focus on improving the QoL until normal levels are achieved. The IDAS-II may be used to track changes in QoL during treatment, and thus guide evidence-based treatment decisions.

Despite the novel contributions of this study, it has several limitations. First, the use of a non-probability sampling procedure may limit the generalizability of the results, as the cutoffs may not be equally accurate in classifying individuals from other samples with different idiosyncratic characteristics [76]. However, assuming slight differences, we believe that our sample can be representative of those patients targeted by the use of these cutoffs, as it includes patients from public and private centers at different stages of treatment and with different levels of symptom severity. Second, the larger proportion of women in our sample limits the generalizability of our findings to a broader population. Nevertheless, the proportion of women in our sample was similar to that reported in a previous study that developed diagnostic cutoffs for the first version of IDAS [46]. The higher proportion of women is also consistent with the higher prevalence of depression, anxiety, and bipolar disorder in women [1]. Nevertheless, future studies should replicate analyses of samples with similar proportions of men and women. Third, the instrument used to evaluate clinical diagnoses does not assess specific types of OCD covered by the IDAS-II (checking, ordering, and cleaning), which probably interferes with the discrimination values found for the OCD scales of the IDAS-II. Future studies should incorporate measures to specifically assess checking, ordering, and cleaning OCD. Fourth, as our sample included very few individuals diagnosed with BID and BIID, it would be convenient to increase the number of participants with these disorders in future studies to develop diagnostic and QoL cutoffs for bipolar disorders. Similarly, future studies with broader samples, including participants with and without comorbidity, would allow for the analysis of whether the presence of comorbidity influences the discriminative ability of the instrument to detect specific disorders. This approach would provide a deeper understanding of the potential impact of comorbid conditions on the diagnostic accuracy and utility of the instrument.

Conclusions

The present study provides diagnostic and QoL cutoffs for the IDAS-II, thereby expanding the clinical utility of this measure in clinical practice and research. By providing diagnostic cutoffs, the instrument gathers both novel dimensional approaches and traditional categorical approaches that rely on patients’ diagnoses to determine the choice of treatment. Similarly, the IDAS-II can also be employed to meet more recent clinical practices advocating QoL assessment and intervention in the treatment of mental health problems owing to QoL cutoffs. In summary, the present study increased the applicability of the IDAS-II, making it a comprehensive, detailed, and versatile self-report to assess internalizing symptoms.

Data availability

The dataset analyzed during the current study is available in the Open Science Framework repository: https://osf.io/2ez5h/?view_only=c370c1d7f50e457794bc5230fd47ddd8.

Abbreviations

BID:

Bipolar I Disorder

BIID:

Bipolar II Disorder

GAD:

Generalized Anxiety Disorder

HiTOP:

Hierarchical Taxonomy of Psychopathology

IDAS:

Inventory of Depression and Anxiety Symptoms

MDD:

Major Depressive Disorder

MINI:

Mini-International Neuropsychiatric Interview

NPV:

Negative Predictive Value

OCD:

Obsessive-Compulsive Disorder

PD:

Panic Disorder

PPV:

Positive Predictive Value

PTSD:

Post-Traumatic Stress Disorder

QoL:

Quality of Life

ROC:

Receiver Operating Characteristic

SAD:

Social Anxiety Disorder

SF-36:

Short Form-36 Health Survey

References

  1. GBD Mental Disorders Collaborators. Global, regional, and national burden of 12 mental disorders in 204 countries and territories, 1990–2019: a systematic analysis for the global burden of Disease Study 2019. Lancet Psychiatry. 2022;9(2):137–50.

    Article  Google Scholar 

  2. Salari N, Hosseinian-Far A, Jalali R, Vaisi-Raygani A, Rasoulpoor S, Mohammadi M, et al. Prevalence of stress, anxiety, depression among the general population during the COVID-19 pandemic: a systematic review and meta-analysis. Glob Health. 2020;16(1):57.

    Article  Google Scholar 

  3. Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, et al. Global burden of disease attributable to mental and substance use disorders: findings from the global burden of Disease Study 2010. Lancet. 2013;382(9904):1575–86.

    Article  PubMed  Google Scholar 

  4. Gao K, Su M, Sweet J, Calabrese JR. Correlation between depression/anxiety symptom severity and quality of life in patients with major depressive disorder or bipolar disorder. J Affect Disord. 2019;244:9–15.

    Article  PubMed  Google Scholar 

  5. Johnston KM, Powell LC, Anderson IM, Szabo S, Cline S. The burden of treatment-resistant depression: a systematic review of the economic and quality of life literature. J Affect Disord. 2019;242:195–210.

    Article  PubMed  Google Scholar 

  6. McGrath JJ, Lim CCW, Plana-Ripoll O, Holtz Y, Agerbo E, Momen NC, et al. Comorbidity within mental disorders: a comprehensive analysis based on 145 990 survey respondents from 27 countries. Epidemiol Psychiatr Sci. 2020;29:e153.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Saha S, Lim CCW, Cannon DL, Burton L, Bremner M, Cosgrove P, et al. Co-morbidity between mood and anxiety disorders: a systematic review and meta‐analysis. Depress Anxiety. 2021;38(3):286–306.

    Article  PubMed  Google Scholar 

  8. American Psychiatric Association. Diagnostic and statistical manual of mental disorders (5th ed.) [Internet]. 2013. https://doi.org/10.1176/appi.books.9780890425596.

  9. World Health Organization. International statistical classification of diseases and related health problems (11th ed.) [Internet]. 2019. https://icd.who.int/.

  10. Rief W, Hofmann SG, Berg M, Forbes MK, Pizzagalli DA, Zimmermann J, et al. Do we need a novel framework for classifying psychopathology? A discussion paper. Clin Psychol Eur. 2023;5(4):e11699.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Division 12 American Psychological Association. Psychological Treatments [Internet]. 2022. https://div12.org/treatments/.

  12. First MB, Rebello TJ, Keeley JW, Bhargava R, Dai Y, Kulygina M, et al. Do mental health professionals use diagnostic classifications the way we think they do? A global survey. World Psychiatry. 2018;17(2):187–95.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Reed GM, Correia JM, Esparza P, Saxena S, Maj M. The WPA-WHO Global Survey of psychiatrists’ attitudes towards Mental disorders classification. World Psychiatry. 2011;10(2):118–31.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Cuthbert BN. The RDoC framework: facilitating transition from ICD/DSM to dimensional approaches that integrate neuroscience and psychopathology. World Psychiatry. 2014;13(1):28–35.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Kotov R, Waszczuk MA, Krueger RF, Forbes MK, Watson D, Clark LA, et al. The hierarchical taxonomy of psychopathology (HiTOP): a dimensional alternative to traditional nosologies. J Abnorm Psychol. 2017;126(4):454–77.

    Article  PubMed  Google Scholar 

  16. Borsboom D. A network theory of mental disorders. World Psychiatry. 2017;16(1):5–13.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Hofmann SG, Hayes SC. The future of intervention science: process-based therapy. Clin Psychol Sci. 2019;7(1):37–50.

    Article  PubMed  Google Scholar 

  18. Hayes SC, Hofmann SG, Ciarrochi J. A process-based approach to psychological diagnosis and treatment:the conceptual and treatment utility of an extended evolutionary meta model. Clin Psychol Rev. 2020;82:101908.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Kotov R, Cicero DC, Conway CC, DeYoung CG, Dombrovski A, Eaton NR, et al. The hierarchical taxonomy of psychopathology (HiTOP) in psychiatric practice and research. Psychol Med. 2022;52(9):1666–78.

    Article  PubMed  Google Scholar 

  20. Ruggero CJ, Kotov R, Hopwood CJ, First M, Clark LA, Skodol AEE, et al. Integrating the hierarchical taxonomy of psychopathology (HiTOP) into clinical practice. J Consult Clin Psychol. 2019;87(12):1069–84.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Kotov R, Krueger RF, Watson D, Cicero DC, Conway CC, DeYoung CG, et al. The hierarchical taxonomy of psychopathology (HiTOP): a quantitative nosology based on consensus of evidence. Annu Rev Clin Psychol. 2021;17(1):83–108.

    Article  PubMed  Google Scholar 

  22. Moskow DM, Ong CW, Hayes SC, Hofmann SG. Process-based therapy: a personalized approach to treatment. J Exp Psychopathol. 2023;14(1):204380872311528.

    Article  Google Scholar 

  23. Hayes SC, Hofmann SG, Stanton CE, Carpenter JK, Sanford BT, Curtiss JE, et al. The role of the individual in the coming era of process-based therapy. Behav Res Ther. 2019;117:40–53.

    Article  PubMed  Google Scholar 

  24. Hayes SC, Hofmann SG. Third-wave cognitive and behavioral therapies and the emergence of a process‐based approach to intervention in psychiatry. World Psychiatry. 2021;20(3):363–75.

    Article  PubMed  PubMed Central  Google Scholar 

  25. González-Blanch C, Hernández-de-Hita F, Muñoz-Navarro R, Ruíz-Rodríguez P, Medrano LA, Cano-Vindel A. The association between different domains of quality of life and symptoms in primary care patients with emotional disorders. Sci Rep. 2018;8(1):1–10.

    Article  Google Scholar 

  26. Hoertel N, Blanco C, Oquendo MA, Wall MM, Olfson M, Falissard B, et al. A comprehensive model of predictors of persistence and recurrence in adults with major depression: results from a national 3-year prospective study. J Psychiatr Res. 2017;95:19–27.

    Article  PubMed  PubMed Central  Google Scholar 

  27. IsHak WW, Greenberg JM, Balayan K, Kapitanski N, Jeffrey J, Fathy H, et al. Quality of life: the ultimate outcome measure of interventions in major depressive disorder. Harv Rev Psychiatry. 2011;19(5):229–39.

    Article  PubMed  Google Scholar 

  28. Grandes G, Montoya I, Arietaleanizbeaskoa MS, Arce V, Sanchez A. The burden of mental disorders in primary care. Eur Psychiatry. 2011;26(7):428–35.

    Article  CAS  PubMed  Google Scholar 

  29. Fried EI, Nesse RM. The impact of individual depressive symptoms on impairment of psychosocial functioning. PLoS ONE. 2014;9(2):e90311.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Fried EI, Nesse RM. Depression sum-scores don’t add up: why analyzing specific depression symptoms is essential. BMC Med. 2015;13(1):1–11.

    Article  Google Scholar 

  31. Haraldstad K, Wahl A, Andenæs R, Andersen JR, Andersen MH, Beisland E, et al. A systematic review of quality of life research in medicine and health sciences. Qual Life Res. 2019;28(10):2641–50.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. Hohls JK, König HH, Quirke E, Hajek A. Anxiety, depression and quality of life—A systematic review of evidence from longitudinal observational studies. Int J Environ Res Public Health. 2021;18(22):12022.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  33. Johnson RE, Rosen CC, Djurdjevic E. Assessing the impact of common method variance on higher order multidimensional constructs. J Appl Psychol. 2011;96(4):744–61.

    Article  PubMed  Google Scholar 

  34. Reio TG. The threat of common method variance bias to theory building. Hum Resour Dev Rev. 2010;9(4):405–11.

    Article  Google Scholar 

  35. Watson D, O’Hara MW, Naragon-Gainey K, Koffel E, Chmielewski M, Kotov R, et al. Development and validation of new anxiety and bipolar symptom scales for an expanded version of the IDAS (the IDAS-II). Assessment. 2012;19(4):399–420.

    Article  PubMed  Google Scholar 

  36. Klein DN. Assessment of depression in adults and youth. Assessment. 2024;31(1):110–25.

    Article  PubMed  Google Scholar 

  37. Stanton K, McDonnell CG, Hayden EP, Watson D. Transdiagnostic approaches to psychopathology measurement: recommendations for measure selection, data analysis, and participant recruitment. J Abnorm Psychol. 2020;129(1):21–8.

    Article  PubMed  Google Scholar 

  38. Cervin M, Martí Valls C, Möller S, Frick A, Björkstrand J, Watson D. A psychometric evaluation of the expanded version of the inventory of depression and anxiety symptoms (IDAS-II) in children and adolescents. Assessment. 2023;107319112311708.

  39. De la Rosa-Cáceres A, Stasik-O’Brien SM, Rojas AJ, Sanchez-García M, Lozano OM, Díaz-Batanero C. Spanish adaptation of the inventory of depression and anxiety symptoms (IDAS-II) and a study of its psychometric properties. J Affect Disord. 2020;271:81–90.

    Article  PubMed  Google Scholar 

  40. Irak M, Albayrak EO. Psychometric properties of the expanded version of the inventory of depression and anxiety symptoms in a Turkish population. Psychol Rep. 2020;123(2):517–45.

    Article  PubMed  Google Scholar 

  41. Petre LM, Gheorghe DA, Watson D, Mitrofan L. Romanian inventory of depression and anxiety symptoms (IDAS-II). Front Psychol. 2023;14:1159380.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Wester RA, Rubel J, Zimmermann J, Hall M, Kaven L, Watson D. Development and validation of the inventory of depression and anxiety symptoms II – German version. Psychol Assess. 2022;34(12):e88–99.

    Article  PubMed  Google Scholar 

  43. Nelson GH, O’Hara MW, Watson D. National norms for the expanded version of the inventory of depression and anxiety symptoms (IDAS-II). J Clin Psychol. 2018;74(6):953–68.

    Article  PubMed  Google Scholar 

  44. Sanchez-Garcia M, De la Rosa-Cáceres A, Stasik-O’Brien S, Mancheño-Barba JJ, Lozano OM, Díaz-Batanero C. Norms according to age and gender for the Spanish version of the inventory of depression and anxiety symptoms (IDAS-II). Front Psychol. 2021;12:748025.

    Article  PubMed  PubMed Central  Google Scholar 

  45. De la Rosa-Cáceres A, Lozano OM, Sanchez-Garcia M, Fernandez-Calderon F, Rossi G, Diaz-Batanero C. Assessing internalizing symptoms and their relation with levels of impairment: evidence-based cutoffs for interpreting inventory of depression and anxiety symptoms (IDAS-II) scores. J Psychopathol Behav Assess. 2023;45:170–80.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Stasik-O’Brien SM, Brock RL, Chmielewski M, Naragon-Gainey K, Koffel E, McDade-Montez E, et al. Clinical utility of the inventory of depression and anxiety symptoms (IDAS). Assessment. 2019;26(5):944–60.

    Article  PubMed  Google Scholar 

  47. Hosmer DW, Lemeshow S, Sturdivant RX. Applied Logistic Regression. Volume 398. John Wiley & Sons, Inc.; 2013.

  48. Sheehan DV. The MINI International Neuropsychiatric interview (Version 7.0.2) for DSM-5. Harm Research Institute; 2016.

  49. Bobes J. A Spanish validation study of the mini international neuropsychiatric interview. Eur Psychiatry. 1998;13(S4):S198–9.

    Article  Google Scholar 

  50. Ferrando L, Bobes J, Gibert J, Soto M, Soto O. MINI Entrevista Neuropsiquiátrica Internacional [MINI International neuropsychiatric interview]. Madrid, Spain: Instituto IAP; 2000.

    Google Scholar 

  51. Alonso J, Prieto L, Antó JM. The Spanish version of the SF-36 Health Survey (the SF-36 health questionnaire): an instrument for measuring clinical results. Med Clínica. 1995;104(20):771–6.

    CAS  Google Scholar 

  52. Ware JE, Snow KK, Kosinski M, Gandek B. SF-36 Health Survey. Manual and Interpretation Guide. The Health Institute; 1993.

  53. Nahm FS. Receiver operating characteristic curve: overview and practical use for clinicians. Korean J Anesthesiol. 2022;75(1):25–36.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Ben-Porath YS. Interpreting the MMPI-2-RF. Minnesota; 2012.

  55. Achenback TM, McConaughy SH, Ivanova MY, Rescorla LA. Manual for the ASEBA brief problem monitor (BPM). ASEBA; 2011.

  56. Samuel DB, Hopwood CJ, Krueger RF, Thomas KM, Ruggero CJ. Comparing methods for scoring personality disorder types using maladaptive traits in DSM-5. Assessment. 2013;20(3):353–61.

    Article  PubMed  Google Scholar 

  57. Weekers LC, Sellbom M, Hutsebaut J, Simonsen S, Bach B. Normative data for the LPFS-BF 2.0 derived from the Danish general population and relationship with psychosocial impairment. Personal Ment Health. 2023;17(2):157–64.

    Article  PubMed  Google Scholar 

  58. Sharma B, Jain R. Right choice of a method for determination of cut-off values: a statistical tool for a diagnostic test. Asian J Med Sci. 2014;5(3):30–4.

    Article  Google Scholar 

  59. Corbacioglu Ş, Aksel G. Receiver operating characteristic curve analysis in diagnostic accuracy studies: a guide to interpreting the area under the curve value. Turk J Emerg Med. 2023;23(4):195.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3(1):32–5.

    Article  CAS  PubMed  Google Scholar 

  61. Akobeng AK. Understanding diagnostic tests 2: likelihood ratios, pre- and post‐test probabilities and their use in clinical practice. Acta Paediatr. 2007;96(4):487–91.

    Article  PubMed  Google Scholar 

  62. Monaghan TF, Rahman SN, Agudelo CW, Wein AJ, Lazar JM, Everaert K, et al. Foundational statistical principles in medical pesearch: sensitivity, specificity, positive predictive value, and negative predictive value. Med (Mex). 2021;57(5):503.

    Google Scholar 

  63. Altman DG, Machin D, Bryant TN, Gardner MJ. Statistics with confidence. 2nd ed. BMJ Books; 2000.

  64. Pineles SL, Mostoufi SM, Ready CB, Street AE, Griffin MG, Resick PA. Trauma reactivity, avoidant coping, and PTSD symptoms: a moderating relationship? J Abnorm Psychol. 2011;120(1):240–6.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Serrano-Ibáñez ER, Ruiz-Párraga GT, Gómez-Pérez L, Ramírez-Maestre C, Esteve R, López-Martínez AE. The relationship between experiential avoidance and posttraumatic stress symptoms: a Moderated Mediation Model Involving Dissociation, Guilt, and gender. J Trauma Dissociation. 2021;22(3):304–18.

    Article  PubMed  Google Scholar 

  66. Fox V, Dalman C, Dal H, Hollander AC, Kirkbride JB, Pitman A. Suicide risk in people with post-traumatic stress disorder: a cohort study of 3.1 million people in Sweden. J Affect Disord. 2021;279:609–16.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Selaman ZMH, Chartrand HK, Bolton JM, Sareen J. Which symptoms of post-traumatic stress disorder are associated with suicide attempts? J Anxiety Disord. 2014;28(2):246–51.

    Article  PubMed  Google Scholar 

  68. Lobo JM, Jiménez-Valverde A, Real R. AUC: a misleading measure of the performance of predictive distribution models. Glob Ecol Biogeogr. 2008;17(2):145–51.

    Article  Google Scholar 

  69. Fernández-Jiménez E, Panyavin I, Pérez-San-Gregorio MA, Schultheis MT. Quality of life and depressive symptomatology in multiple sclerosis: a cross-sectional study between the USA and Spain. Psicothema. 2021;(33.1):60–9.

  70. Matcham F, Norton S, Steer S, Hotopf M. Usefulness of the SF-36 Health Survey in screening for depressive and anxiety disorders in rheumatoid arthritis. BMC Musculoskelet Disord. 2016;17(1):224.

    Article  PubMed  PubMed Central  Google Scholar 

  71. Yilmaz-Oner S, Oner C, Dogukan FM, Moses TF, Demir K, Tekayev N, et al. Anxiety and depression predict quality of life in Turkish patients with systemic lupus erythematosus. Clin Exp Rheumatol. 2015;33:360–5.

    PubMed  Google Scholar 

  72. Comer JS, Blanco C, Hasin DS, Liu SM, Grant BF, Turner JB, et al. Health-related quality of life across the anxiety disorders: results from the national epidemiologic survey on alcohol and related conditions (NESARC). J Clin Psychiatry. 2011;72(01):43–50.

    Article  PubMed  Google Scholar 

  73. Davidoff J, Christensen S, Khalili DN, Nguyen J, IsHak WW. Quality of life in panic disorder: looking beyond symptom remission. Qual Life Res. 2012;21(6):945–59.

    Article  PubMed  Google Scholar 

  74. Rapaport MH, Clary C, Fayyad R, Endicott J. Quality-of-life impairment in depressive and anxiety disorders. Am J Psychiatry. 2005;162(6):1171–8.

    Article  PubMed  Google Scholar 

  75. First MB. Structured Clinical Interview for the DSM (SCID). In: Cautin RL, Lilienfeld SO, editors. The Encyclopedia of Clinical Psychology [Internet]. 1st ed. Wiley; 2015 [cited 2023 Dec 12]. pp. 1–6. https://onlinelibrary.wiley.com/doi/https://doi.org/10.1002/9781118625392.wbecp351.

  76. Hand DJ. Classifier technology and the illusion of progress. Stat Sci [Internet]. 2006 Feb 1 [cited 2024 Feb 8];21(1). https://projecteuclid.org/journals/statistical-science/volume-21/issue-1/Classifier-Technology-and-the-Illusion-of-Progress/https://doi.org/10.1214/088342306000000060.full.

Download references

Funding

This study is part of the grant I + D + i PID2020-116187RB-I00, funded by the Ministry of Science, Innovation and Universities of the Government of Spain, State Research Agency, MICIU/AEI/ https://doi.org/10.13039/501100011033/, and grant FPU19/00144 funded by MICIU/AEI/ https://doi.org/10.13039/501100011033 and by ESF Investing in your future.

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed to the study’s conception and design. Material preparation, data collection were performed by ADC. Data analysis were performed by MSG, ADC, and CDB. The first draft of the manuscript was written by ADC and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Ana De la Rosa-Cáceres.

Ethics declarations

Ethical approval

This study was approved by the Bioethics Committee of the Province of Huelva (Junta de Andalucía, Spain) (No. 0275-N-21). All participants involved in the study signed an informed consent form to participate and publish their data.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sanchez-Garcia, M., Díaz-Batanero, C. & De la Rosa-Cáceres, A. Discriminative capacity of the Spanish version of the Inventory of Depression and Anxiety Symptoms-II (IDAS-II) for detecting DMS-5 specific disorders and poor quality of life in a clinical sample. Health Qual Life Outcomes 22, 56 (2024). https://doi.org/10.1186/s12955-024-02270-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-024-02270-x

Keywords