Skip to main content

Validation of a computer-adaptive test to evaluate generic health-related quality of life

Abstract

Background

Health Related Quality of Life (HRQoL) is a relevant variable in the evaluation of health outcomes. Questionnaires based on Classical Test Theory typically require a large number of items to evaluate HRQoL. Computer Adaptive Testing (CAT) can be used to reduce tests length while maintaining and, in some cases, improving accuracy. This study aimed at validating a CAT based on Item Response Theory (IRT) for evaluation of generic HRQoL: the CAT-Health instrument.

Methods

Cross-sectional study of subjects aged over 18 attending Primary Care Centres for any reason. CAT-Health was administered along with the SF-12 Health Survey. Age, gender and a checklist of chronic conditions were also collected. CAT-Health was evaluated considering: 1) feasibility: completion time and test length; 2) content range coverage, Item Exposure Rate (IER) and test precision; and 3) construct validity: differences in the CAT-Health scores according to clinical variables and correlations between both questionnaires.

Results

396 subjects answered CAT-Health and SF-12, 67.2% females, mean age (SD) 48.6 (17.7) years. 36.9% did not report any chronic condition. Median completion time for CAT-Health was 81 seconds (IQ range = 59-118) and it increased with age (p < 0.001). The median number of items administered was 8 (IQ range = 6-10). Neither ceiling nor floor effects were found for the score. None of the items in the pool had an IER of 100% and it was over 5% for 27.1% of the items. Test Information Function (TIF) peaked between levels -1 and 0 of HRQoL. Statistically significant differences were observed in the CAT-Health scores according to the number and type of conditions.

Conclusions

Although domain-specific CATs exist for various areas of HRQoL, CAT-Health is one of the first IRT-based CATs designed to evaluate generic HRQoL and it has proven feasible, valid and efficient, when administered to a broad sample of individuals attending primary care settings.

Background

Health-Related Quality of Life (HRQoL) is among the most used variables in Health Outcomes Research (HOR) in the academic field, as well as in clinical trials and post-authorisation studies. It refers to the subjective valuation of the influence of health on the individuals' ability of having a normal functioning which makes it possible to perform all the activities which are important for them and which affect their well-being [1]. Although during the last 35 years HRQoL assessment has had an enormous development worldwide, several barriers limit its use in the clinical practice. These barriers had been described by Deyo and Patrick in 1989 [2] and were revised in Spain in 2005 [3]. Classical Test Theory (CTT) cannot solve certain practical issues, such as the high number of questions needed to complete a multi-dimensional HRQoL questionnaire and the lack of accuracy when dealing with the change of individual scores over time. Item Response Theory (IRT) [4, 5] overcomes some of the limitations that may affect instruments developed under the CTT. CAT instruments based on IRT, clearly increase "measurement efficiency" (the ratio of a measure's psychometric soundness to the response burden the measures imposes). A greater measurement precision can be achieved through the selection of a few items from a calibrated item pool that combines high quality items from multiple instruments into a single data resource [6]. Since each item is independently described by parameters such as difficulty or discrimination [7], they can be combined as necessary, therefore, there is no questionnaire as such but different combinations of items which provide comparable scores. Through IRT, an Item Characteristic Curve (ICC) is constructed for each item; this curve reflects the probability of the answer to each item for each HRQoL level. Using ICC, the HRQoL level of a given subject can be estimated after answering any number of items. Furthermore, IRT allows us to estimate the contribution each item makes to the assessment for each level of the variable: the Information Function. Measurement error is inversely linked to the information used and hence an error estimate is available for each assessment.

Based on this theory, Computer Adaptive Tests (CATs) arise as a psychometric assessment technique administered through a computer. For each respondent, the selection of items is adapted to the prior estimates of the construct being assessed [7]. These tests have been successfully used in Education and Psychology fields [8] and they allow a more practical assessment and a more accurate estimation of the variable being measured, in this case, HRQoL. CATs result in the individual administration of questionnaires, as well as in the collection and computation of responses, providing instant results [9].

Since the 90 s, when some authors recommended CAT applications for health [10], a variety of CATs have been developed in the Health field, as those for migraine [11, 12], rheumatoid arthritis [13], osteoarthritis [14], back pain [15], physical therapy [16, 17], anxiety [18], cancer [19] and paediatrics [20]. All these CATs focus on one specific condition or HRQoL domain, but they cannot measure generic HRQoL in healthy or ill subjects from the general population. As it is well known, HRQoL is essentially a multidimensional concept. This fact could make it difficult to accomplish the unidimensionality required for the application of IRT [21]. Despite this fact, we think it is possible to develop a calibrated item pool to measure the underlying construct of generic HRQoL. Pursuing this aim, in a previous study [22], an expert panel proposed a pool of 140 five-level Likert items, chosen among several HRQoL questionnaires validated in Spain. That pool was first administered to a pilot sample and later to a general sample of patients belonging to 7 Primary Health centres. Two administration options were offered to the later sample: 1) on paper 2) on a touch panel. Item Response Theory psychometric properties (discrimination, reliability and validity) were evaluated by means of a Factorial Analysis and other methods. The Information Function was analyzed and an application method was tested by means of simulation: a minimum of 5 items and a maximum of 15 were shown; the first item was randomly selected among 13 which deal with generic health aspects and covered a broad HRQoL range. These 13 initial items were selected among the most informative items by an expert panel. The result was a calibrated pool of 96 items [22]. This pool of items showed a factorial structure in one dimension (with 45% of the variance explained and a lowest loading of 0,224) and evidenced high reliability (Cronbach's alfa = 0.99).

This manuscript presents the validation of CAT-Health: a CAT based on the described calibrated item pool, using the mentioned application method and implemented with a touch screen interface. This validation study, gathering information from a sample of subjects from the Spanish general population, pursues the goal of obtaining a feasible and accurate instrument to measure generic HRQoL in the clinical setting.

Methods

A cross-sectional study of subjects aged over 18 attending one of the four participant Primary Care Centres (PCC) for any reason was carried out, in order to assess the validity of CAT-Health. The study hence included subjects with chronic conditions or acute pathologies but also healthy subjects, for instance, patients' healthy relatives at the PCC. Before their inclusion, all patients were informed and provided written informed consent, in accordance with the ethical principles of the Declaration of Helsinki and the Good Clinical Practice guidelines.

Data were collected during three consecutive days in each PCC, between February and March 2007, by using two methods: a tablet PC (electronic pencil required) and a touch screen panel (neither mouse nor pencil necessary). Subjects completed a very short initial questionnaire about their age, sex and whether they had suffered any of the chronic conditions presented in a checklist including: anxiety, depression, acute disease, arterial hypertension, cardiac disease, diabetes, joint pain, migraine, pulmonary disease and "other diseases". The patients filled this chronic conditions checklist on their own. In addition, the SF-12 Health Survey was administered using the same devices [2325]. CAT-Health and SF-12 completion times were automatically recorded.

The CAT-Health system

The CAT-Health system evaluates the generic HRQoL of healthy or ill subjects from the general population by showing a variable number of items (between 5 and 15), extracted from a unidimensional calibrated pool of 96 items which had been previously developed [22]. All the items in the pool have 5 response categories. The first item is randomly selected among 13 initial items which cover a broad range of the measured construct (HRQoL) and which focus on generic health aspects. These 13 initial items were selected among the most informative items by an expert panel Based on the response to this first question, the system selects the most informative item to be presented as the following question, iteratively. The system stops when either: 1) the maximum number of items (n = 15) has been presented to the subject; or 2) the minimum number of items has been achieved, the estimation error is below the unity and the percentage of reduction of the error, with respect to the previous estimation, is below 5%. This application method was theoretically tested by means of a simulation study [22] and it provided an accurate score for moderately low or high HRQoL levels (near to general population mean score). The score calculated by CAT-Health system has a theoretical range between -3.85 and +3.87, but it was normalized to a 50 ± 10 distribution, in order to facilitate its interpretation: (CAT score - mean)/SD * 10 + 50. The higher the score, the better the HRQoL.

Evaluation of the CAT-Health system

CAT-Health was evaluated considering three different criteria: 1) feasibility of the system in the clinical practice, in terms of completion time and test length, paying special attention to elderly subjects (fourth quartile of the distribution). 2) Psychometric evaluation, including content range coverage, Item Exposure Rate (IER) and test precision; and 3) Validity assessment of CAT-Health. Construct validity was studied through the analysis of differences in CAT-Health scores depending on sex (females were expected to have worse scores than males), age (elderly people were expected to show worse scores) and the presence of reported chronic conditions (the higher the number of conditions, the worse the score). It was also hypothesized that subjects with one of the listed pathologies should have a worse score than subjects without them. Migraine, acute pathology, hypertension and "other pathologies", however, were not considered to be associated to HRQoL a priori, because the content of the items was not designed to take into account acute or silent pathologies. Finally, CAT-Health convergent validity was evaluated with respect to SF-12 physical and mental component scores. A moderate correlation between both questionnaires was expected (correlation coefficients between 0.3 and 0.6), as it is usually found when HRQoL generic questionnaires are compared [2628]

Statistical analysis

Absolute and relative frequencies were used to describe the sample distribution with respect to the nominal variables (sex and declared pathologies). Mean and standard deviation were used for the continuous variables (age, CAT-Health and SF-12 scores, and number of declared pathologies). Quartiles were used in the case of the CAT-Health completion times and test length. Differences in the number of items shown to subjects, according to age and chronic conditions, were assessed by means of a Kruskal-Wallis test. Differences according to sex were evaluated by means of a Mann-Whitney test.

Content range coverage of CAT-Health was studied through the analysis of floor and ceiling effects. Item Exposure Rate (IER) was defined as the ratio of the total number of times a given item is shown to the number of times CAT-Health was administered. Test precision was studied through the analysis of the Test Information Function (TIF), which is an aggregate of the information provided by each item. Considering the adaptive nature of the system and that the number of items shown within each test were limited to 15, a TIF using all the items in the pool is not representative of a typical test, so a TIF was constructed by using just the 15 items which provided more information at each level (given this was a continuous range, a process of discretization was necessary and 800 HRQoL levels were considered). Note that the selection of items might change within the HRQoL range.

Differences in CAT-Health scores between males and females and between subjects who declared having any of the listed pathologies were assessed by means of a t test. Lineal regression analysis was performed to confirm the association of each of the pathologies independently with the CAT-Health score. Correlation between CAT-Health scores and age and the number of pathologies was analyzed by means of Pearson and Spearman correlation coefficients, respectively. The sample was divided into 4 groups, according to the number of declared pathologies (none, 1, 2, 3 or more) and also according to the quartiles of the distribution of age; CAT-Health and SF-12 scores were compared among these groups by means of One-Way ANOVA. Effect size was computed for CAT-Health score and the physical and mental components of SF-12, when comparing mean differences between groups (age, sex and number of pathologies): Cohen's d in the case of a t test and eta square in the case of ANOVA. Following the guidelines proposed by Cohen [29], for t tests, an effect size of 0.1 was considered small, 0.3 was considered medium and 0.5 was large. In the case of ANOVA, 0.01, 0.06 and 0.14 were considered small, medium or large, respectively.

Correlations between the CAT-Health score and the SF-12 physical and mental components were assessed by means of Pearson correlation coefficients.

Results

The characteristics of the sample (N = 396) are described in Table 1. The mean age (SD) was 48.6 (17.7) years and two thirds of the subjects were female. Moreover, one third of the participants did not report any chronic condition from the list.

Table 1 Sample description (N = 396)

Regarding the analysis of the practical use of CAT-Health, the median completion time of CAT-Health was 81 seconds (IQ range = 59 seconds-118 seconds), increasing with age (p < 0.001) from 66 seconds in the group of subjects aged under Pc25 to 107 seconds in the group of subjects aged over Pc75. The median number of the CAT-Health items shown to subjects was 8 (IQ range = 6-10). There were not statistically significant differences (p > 0.05) in the number of items shown to males and females, to subjects from different age groups and to subjects according to the number of declared pathologies.

The CAT-Health non-normalized score ranged between -2.4 and +2.8 (theoretical range between -3.8 and +3.8). Neither ceiling nor floor effects were found. The mean normalized score was 50.88 (6.02), with a minimum of 34.71 and a maximum of 80.89. The mean Physical Component Summary (PCS) score of SF-12 was 46.84 (10.1) and it ranged between 19.12 and 67.06; the mean Mental Component Summary (MCS) score was 46.88 (10.96), ranging between 11.18 and 67.83.

Figure 1 shows CAT-Health Item Exposure Rate (IER). None of the items in the pool had an exposure rate of 100%, while 36 items (37.5%) were not shown at any time (20 of them could not be shown with the chosen application method). IER was over 5% for 26 items (27.1%). The best-15 TIF is shown in Figure 2 along with the standard error for each level of the scale. The Test Information Function (TIF) peaked between level -1 and 0 of HRQoL, which corresponds to the normalized scores 35.58 and 52.19. In this part of the scale, the error was below 0.2.

Figure 1
figure 1

The CAT-Health Item Exposure Rate (IER). The IER is the ratio of the total number of times one item is presented to the number of times CAT-Health is administered.

Figure 2
figure 2

The CAT-Health best-15 Test Information Function (TIF). The TIF is used to evaluate the test precision for different HRQoL levels.

Regarding construct validity, in Table 2 the comparison of CAT-Health and SF-12 scores is shown with respect to sex, age and the number of declared pathologies. CAT-Health and SF-12 MCS scores were higher for males than for females (p < 0.0001). The effect size (ES) of CAT-Health (0.46) was similar to that of MCS (0.51) and higher than that of PCS (0.12). The CAT-Health score showed a negative statistically significant correlation with age (r = -0.351; p < 0.001) as SF-12 PCS did (r = -0.255; p < 0.001); SF-12 MCS did not show a statistically significant correlation with age. By dividing the sample in four age groups (under 34.27 years; 34.27-46.26; 46.27-61.19; over 61.19), ANOVA analysis showed statistically significant differences (p < 0.0001) among age groups for CAT-Health and PCS scores. The CAT-Health score also showed a negative statistically significant correlation with the number of pathologies declared by the respondents (r = -0.548; p < 0.01), like PCS and MCS (r = -0.337 and r = -0.262, respectively; p < 0.01). The ES of CAT-Health (0.12) was higher than those of PCS (0.06) and MCS (0.01).

Table 2 Comparison of the CAT-Health and SF-12 scores according to sex, age and number of self-reported conditions

Figure 3 shows the CAT-Health scores of subjects who declared suffering from any of the listed pathologies and of those who did not. Differences were all statistically significant (p < 0.05), except that of acute pathology and migraine. These differences remained statistically significant when analysing each of the pathologies adjusting by the rest of them in a regression analysis. SF-12 PCS did not detect differences between patients with or without anxiety, depression, acute disease, pulmonary disease and migraine; neither did SF-12 MCS detect differences in the case of diabetes, acute disease, cardiac disease, pulmonary disease, arterial hypertension and "other disease".

Figure 3
figure 3

Differences in the CAT-Health scores according to self-reported conditions (means and 95% confidence intervals).

The correlation coefficients between CAT-Health scores and SF-12 PCS (r = 0.547) and MCS (r = 0.346) were moderate and statistically significant (p < 0.001).

Discussion

Several computer-adaptive tests (CAT) evaluating health outcomes have been developed and validated in recent years, but, to our knowledge, the CAT-Health system is one of the first CATs designed to evaluate generic HRQoL. The results of the present study show that CAT-Health is feasible, valid and efficient for HRQoL evaluation: its psychometric properties were satisfactory when evaluating HRQoL in a wide range of subjects attending primary care settings.

The use of HRQoL as a health outcome measure is becoming more important in the evaluation of patient care and health services. It is usually evaluated using questionnaires based on CTT, administered through pencil and paper. Once the answers of a subject are collected, the questionnaire has to be coded and scored, and then the results have to be interpreted. This is a time consuming process and, therefore, it is expensive, especially for follow-ups in clinical practice. These problems constitute a barrier that prevents the evaluation of HRQoL in the clinical setting [3]. CAT instruments clearly increase "measurement efficiency" (the ratio of a measure's psychometric soundness to the response burden the measures imposes) [7]. CAT instruments decrease the response burden, diminishing the number of questions to be answered by the subject; they have small floor and ceiling effects, when they use an extensive item bank; they reduce the error of measurement and so they measure much more accurately; they are flexible, adapting themselves to the trait level of the respondent and also to specific measurement contexts [1120].

Historically, HRQoL has been considered a multi-dimensional concept. Some authors argue, however, that there is an underlying construct that affects all them and can be directly measured [30]. In a previous paper, we presented the development and calibration of a generic HRQoL item bank, so that the assessment of HRQoL with a single dimension was feasible [22]. Using that item bank, we developed one of the first IRT-based CATs for the evaluation of generic HRQoL, the validation of which we have presented in this manuscript.

The evaluation of CAT-Health has shown that CAT-Health system median completion time is really short (under 1 minute and a half). Even though we have shown that the completion time was associated with the age of the respondents (it must be taken into account that elderly people are not familiar with the interfaces used to fill in the questionnaire), the median completion time for the group of individuals in the last quartile of age (over 61.19 years) was still well beneath 2 minutes. Also, the evaluation of generic HRQoL with CAT-health required a median of 8 items, a test length similar to that of published CATs for specific groups of pathologies: AM-PAC-CAT [16], for post-acute care, showed a mean of 6.6 items; each of the 5 domains of the CAT-5D-QOL [15], for back pain, 4.4 to 6.6 items; and the Anxiety-CAT [18] 6 to 8 items.

In this validation study, 60 items were shown at least once, which represents the 79% of the items in the pool that could be shown, according to the chosen application method (at least 20 items will never appear, as they are not amongst the 15 most informative for any HRQoL level). The fact that none of the items had an IER of 100% and that the number of different items used at some point was high indicates that the system actually adapted the items presented to the individuals in the sample, pointing to the adequacy of a CAT for HRQoL measurement.

With respect to the content range coverage of CAT-Health, the frequency distributions of the non-normalized scores of the subjects under study were normally distributed, with no floor nor ceiling effects, as expected for a generic instrument in this sample. On the contrary, the abovementioned domain-specific CATs presented ceiling effects: 10% for AM-PAC-CAT [16] (that presented a roughly normally distributed score) and 0% to 6.1% for the different CAT-5D-QOL scales [15]. Normalized CAT-Health scores (50 ± 10) had a similar range to those of SF-12 PCS and slightly narrower than those of MCS. The performance of CAT-Health in HRQoL assessment in the studied sample, which covered a broad spectrum of individuals attending primary care settings, indicates a good potential for the evaluation of the general population.

The analysis of the TIF showed that CAT-Health is a very discriminative measurement tool in the range of scores between 35 and 52, which corresponds to a normal or slightly deteriorated HRQoL, the most frequent status in people who demand health care at a primary care centre. Future research is needed in order to add new items to the pool which would allow CAT-Health to cover a broader range of HRQoL.

The analysis of validity demonstrated that the CAT-Health score is a valid generic measure of HRQoL. CAT-Health adequately detects the hypothesized differences between male and female subjects, as well as between different age groups and among groups by the number of declared pathologies.

Recently, the Adaptive Measurement of Change (AMC) has been proposed as a feasible and effective method for measuring individual change using CATs [31]. The availability of an error estimate for each subject, in this type of measurements, turns high the precision of CATs, like CAT-Health, into useful instruments for monitoring HRQoL. The sensitivity to change of CAT-Health will be addressed in the future by means of a longitudinal study. The validation of the system in a broader random sample of the general population and the adaptation for its use in English are also planned. These studies will include a larger number of clinical variables to allow for a detailed evaluation of the construct validity of the system.

Conclusions

Although domain specific CATs exist for various areas of HRQoL, CAT-Health is one of the first IRT-based CAT designed to evaluate generic HRQoL and it has proven feasible, valid and efficient, when administered to a broad sample of individuals attending primary care settings.

The reduced number of items required for HRQoL evaluation and the resulting shortened completion time, together with the characteristics inherent to computerized instruments, such as automatic scoring and interpretation of results, make of CAT-Health a practical instrument for clinical settings, as Primary Care Centres. These two facts, along with its sound psychometric properties, which open the possibility of evaluating HRQoL changes at the individual level, are important advantages of the CAT-Health system over other generic questionnaires based on CTT.

Note

The Spanish C.A.T-Health group is formed by researchers from:

BAP Health Outcomes Research, Oviedo, Spain; 4th Area Primary Care Centers, Principality of Asturias Health Service, Oviedo, Spain; Universidad de Oviedo, Psychology Department, Oviedo, Spain; Universidad Complutense de Madrid, Methodology Department, Madrid, Spain; Institut Municipal d'Investigació Mèdica (IMIM-Hospital del Mar), Health Research Unit Services, Barcelona, Spain.

References

  1. McHorney CA: Health status assessment methods for adults: past accomplishments and future challenges. Annu Rev Public Health 1999, 20: 309–335. 10.1146/annurev.publhealth.20.1.309

    Article  CAS  PubMed  Google Scholar 

  2. Deyo RA, Patrick DL: Barriers to the use of health status measures in clinical investigation, patient care, and policy research. Med Care 1989, 27: S254-S268. 10.1097/00005650-198903001-00020

    Article  CAS  PubMed  Google Scholar 

  3. Rebollo P, Valderas JM, Ortega F: [Progress in Spain of the described barriers to the use of perceived health status measures in the clinical practice]. Med Clin (Barc) 2005, 125: 703–705. 10.1016/S0025-7753(05)72161-8

    Article  Google Scholar 

  4. Hambleton RK, Swminathan J, Rogers HJ: Fundamentals of item response theory. Newbury Park, CA: Sage Publications; 1991.

    Google Scholar 

  5. Hambleton RK: Item Response Theory: introduction and bibliography. Psicothema 1990, 1: 97–107.

    Google Scholar 

  6. Hambleton RK: Applications of item response theory to improve health outcomes assessment: developing item banks, linking instruments, and computer-adaptive testing. In Outcomes assessment in cancer. Edited by: Lipscomb J, Gotay CC, Snyder C. Cambridge, U.K.: Cambridge University Press; 2005:445–464.

    Google Scholar 

  7. Cook KF, O'Malley KJ, Roddey TS: Dynamic assessment of health outcomes: time to let the CAT out of the bag? Health Serv Res 2005, 40: 1694–1711. 10.1111/j.1475-6773.2005.00446.x

    Article  PubMed Central  PubMed  Google Scholar 

  8. Ware JE Jr: Conceptualization and measurement of health-related quality of life: comments on an evolving field. Arch Phys Med Rehabil 2003, 84: S43-S51. 10.1053/apmr.2003.50246

    Article  PubMed  Google Scholar 

  9. Harniss M, Amtmann D, Cook D, Johnson K: Considerations for developing interfaces for collecting patient-reported outcomes that allow the inclusion of individuals with disabilities. Med Care 2007, 45: S48-S54. 10.1097/01.mlr.0000250822.41093.ca

    Article  PubMed Central  PubMed  Google Scholar 

  10. Revicki DA, Cella DF: Health status assessment for the twenty-first century: item response theory, item banking and computer adaptive testing. Qual Life Res 1997, 6: 595–600. 10.1023/A:1018420418455

    Article  CAS  PubMed  Google Scholar 

  11. Bjorner JB, Kosinski M, Ware JE Jr: Using item response theory to calibrate the Headache Impact Test (HIT) to the metric of traditional headache scales. Qual Life Res 2003, 12: 981–1002. 10.1023/A:1026123400242

    Article  PubMed  Google Scholar 

  12. Ware JE, Kosinski M, Bjorner JB, Bayliss MS, Batenhorst A, Dahlof CG, et al.: Applications of computerized adaptive testing (CAT) to the assessment of headache impact. Qual Life Res 2003, 12: 935–952. 10.1023/A:1026115230284

    Article  PubMed  Google Scholar 

  13. Martin M, Kosinski M, Bjorner JB, Ware JE, Maclean R, Li T: Item response theory methods can improve the measurement of physical function by combining the modified health assessment questionnaire and the SF-36 physical function scale. Qual Life Res 2007, 16: 647–660. 10.1007/s11136-007-9193-5

    Article  PubMed  Google Scholar 

  14. Kosinski M, Bjorner JB, Ware JE, Sullivan E, Straus WL: An evaluation of a patient-reported outcomes found computerized adaptive testing was efficient in assessing osteoarthritis impact. J Clin Epidemiol 2006, 59: 715–723. 10.1016/j.jclinepi.2005.07.019

    Article  PubMed  Google Scholar 

  15. Kopec JA, Badii M, McKenna M, Lima VD, Sayre EC, Dvorak M: Computerized adaptive testing in back pain: validation of the CAT-5D-QOL. Spine 2008, 33: 1384–1390. 10.1097/BRS.0b013e3181732a3b

    Article  PubMed  Google Scholar 

  16. Jette AM, Haley SM, Tao W, Ni P, Moed R, Meyers D, et al.: Prospective evaluation of the AM-PAC-CAT in outpatient rehabilitation settings. Phys Ther 2007, 87: 385–398. 10.2522/ptj.20060121

    Article  PubMed  Google Scholar 

  17. Haley SM, Gandek B, Siebens H, Black-Schaffer RM, Sinclair SJ, Tao W, et al.: Computerized adaptive testing for follow-up after discharge from inpatient rehabilitation: II. Participation outcomes. Arch Phys Med Rehabil 2008, 89: 275–283. 10.1016/j.apmr.2007.08.150

    Article  PubMed Central  PubMed  Google Scholar 

  18. Walter OB, Becker J, Bjorner JB, Fliege H, Klapp BF, Rose M: Development and evaluation of a computer adaptive test for 'Anxiety' (Anxiety-CAT). Qual Life Res 2007,16(Suppl 1):143–155. 10.1007/s11136-007-9191-7

    Article  PubMed  Google Scholar 

  19. Petersen MA, Groenvold M, Aaronson N, Fayers P, Sprangers M, Bjorner JB: Multidimensional computerized adaptive testing of the EORTC QLQ-C30: basic developments and evaluations. Qual Life Res 2006, 15: 315–329. 10.1007/s11136-005-3214-z

    Article  PubMed  Google Scholar 

  20. Allen DD, Ni P, Haley SM: Efficiency and sensitivity of multidimensional computerized adaptive testing of pediatric physical functioning. Disabil Rehabil 2008, 30: 479–484. 10.1080/09638280701625484

    Article  PubMed  Google Scholar 

  21. Reckase MD: Unifactor latent trait models applied to multifactor test: results and implications. Journal of Statistics 1979, 4: 207–230.

    Google Scholar 

  22. Rebollo P, García-Cueto E, Zardain PC, Cuervo J, Martínez I, Alonso J, et al.: [Development of the CAT-Health, the first Adaptive Computerized Test (CAT) for the evaluation of Health-Related Quality of Life in Spain. Med Clin (Barcelona) 2009, 133: 241–251. 10.1016/j.medcli.2008.09.045

    Article  Google Scholar 

  23. Vilagut G, Valderas JM, Ferrer M, Garin O, Lopez-Garcia E, Alonso J: [Interpretation of SF-36 and SF-12 questionnaires in Spain: physical and mental components]. Med Clin (Barc) 2008, 130: 726–735. 10.1157/13121076

    Article  Google Scholar 

  24. Gandek B, Ware JE, Aaronson NK, Apolone G, Bjorner JB, Brazier JE, et al.: Cross-validation of item selection and scoring for the SF-12 Health Survey in nine countries: results from the IQOLA Project. International Quality of Life Assessment. J Clin Epidemiol 1998, 51: 1171–1178. 10.1016/S0895-4356(98)00109-7

    Article  CAS  PubMed  Google Scholar 

  25. Vilagut G, Ferrer M, Rajmil L, Rebollo P, Permanyer-Miralda G, Quintana JM, et al.: [The Spanish version of the Short Form 36 Health Survey: a decade of experience and new developments.]25. Gac Sanit 2005, 19: 135–150. 10.1157/13074369

    Article  PubMed  Google Scholar 

  26. Badia X, Alonso J: Validity and reproducibility of the Spanish Version of the Sickness Impact Profile. J Clin Epidemiol 1996, 49: 359–365. 10.1016/0895-4356(95)00038-0

    Article  CAS  PubMed  Google Scholar 

  27. Schrag A, Selai C, Jahanshahi M, Quinn NP: The EQ-5D--a generic quality of life measure-is a useful instrument to measure quality of life in patients with Parkinson's disease. J Neurol Neurosurg Psychiatry 2000, 69: 67–73. 10.1136/jnnp.69.1.67

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  28. Brazier J, Roberts J, Tsuchiya A, Busschbach J: A comparison of the EQ-5 D and SF-6 D across seven patient groups. Health Econ 2004, 13: 873–884. 10.1002/hec.866

    Article  PubMed  Google Scholar 

  29. Cohen J: Statistical Power Analysis for the Behavioral Sciences. second edition. Lawrence Erlbaum Associates; 1988.

    Google Scholar 

  30. Fryback DG, Palta M, Cherepanov D, Bolt D, Kim JS: Comparison of 5 health-related quality-of-life indexes using item response theory analysis. Med Decis Making 2010, 30: 5–15. 10.1177/0272989X09347016

    Article  PubMed Central  PubMed  Google Scholar 

  31. Kim-Kang G, Weiss DJ: Adaptive Measurement of Individual Change. Journal of Psychology 2008, 216: 49–58.

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank the Health Director of the 4th Area Primary Care Canters of Asturias and all the GPs and pollsters of the Primary Care Centres that participated in this study: "El Cristo", "Colloto", "Paulino Prieto", "Pumarín", "Teatinos", "Vallobín-Concinos" and "Ventanielles". Thanks, also, to all the patients who kindly spent some minutes of their time to complete the questionnaire and to Adriana Pérez for the proofreading of this article.

Author information

Authors and Affiliations

Authors

Consortia

Corresponding author

Correspondence to Pablo Rebollo.

Additional information

Competing interests

The authors hereby declare that there is no conflict of interests, financial agreement or other involvement with any company whose product figures in the submitted work. Pablo Rebollo, Ignacio Castejón, Jesús Cuervo, Guillermo Villa and Helena Díaz-Cuervo work at BAP Health Outcomes Research, which is the Applicant of a Spanish patent application (P200701072) and a European patent application (EPO8013312) related to the CAT-Health system.

Authors' contributions

All authors are responsible for the reported manuscript and have participated in its concept and design, analysis and interpretation of data and, finally, in its drafting and review.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Rebollo, P., Castejón, I., Cuervo, J. et al. Validation of a computer-adaptive test to evaluate generic health-related quality of life. Health Qual Life Outcomes 8, 147 (2010). https://doi.org/10.1186/1477-7525-8-147

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1477-7525-8-147

Keywords