Skip to main content
Download PDF
Download ePub

Validity of instruments to measure physical activity may be questionable due to a lack of conceptual frameworks: a systematic review

Health and Quality of Life Outcomes volume 9, Article number: 86 (2011) Cite this article

Abstract

Background

Guidance documents for the development and validation of patient-reported outcomes (PROs) advise the use of conceptual frameworks, which outline the structure of the concept that a PRO aims to measure. It is unknown whether currently available PROs are based on conceptual frameworks. This study, which was limited to a specific case, had the following aims: (i) to identify conceptual frameworks of physical activity in chronic respiratory patients or similar populations (chronic heart disease patients or the elderly) and (ii) to assess whether the development and validation of PROs to measure physical activity in these populations were based on a conceptual framework of physical activity.

Methods

Two systematic reviews were conducted through searches of the Medline, Embase, PsycINFO, and Cinahl databases prior to January 2010.

Results

In the first review, only 2 out of 581 references pertaining to physical activity in the defined populations provided a conceptual framework of physical activity in COPD patients. In the second review, out of 103 studies developing PROs to measure physical activity or related constructs, none were based on a conceptual framework of physical activity.

Conclusions

These findings raise concerns about how the large body of evidence from studies that use physical activity PRO instruments should be evaluated by health care providers, guideline developers, and regulatory agencies.

Background

Patient-reported outcome (PRO) instruments have always been an important tool in epidemiological and clinical research. Recently, interest in these instruments has increased with their use as outcome measures in randomized trials of pharmacological and non-pharmacological interventions. Regulatory agencies, namely the United States Food and Drug Administration (FDA) and the European Medicines Agency (EMA), have developed guidance documents concerning the appropriate development, validation, and use of PRO instruments in clinical trials [1, 2]. Particular emphasis has been placed on their validity, that is, the ability of a PRO to measure the concept that it is intended to measure. To this end, the use of conceptual frameworks is advised [3–6]. The conceptual framework explicitly defines the concepts measured by the instrument in a diagram that represents the relationships between the main concept (e.g., health-related quality of life), the domains (e.g., symptoms), the sub-domains (e.g., dyspnea), and the items measured as well as the scores obtained from a PRO instrument [2, 7]. An absent or inadequate conceptual framework is likely to lead to inadequate development and validation of a PRO [3–6], which in turn, may create confusion about what is actually being measured [7].

The proportion of PROs for which a conceptual framework formed the basis for the development and validation process is currently unknown. For regulatory agencies and stakeholders such as patients and physicians, it is only possible to understand the meaning of the effects of health care interventions on PROs if the underlying concepts to be measured are clearly outlined. Because PROs represent a very broad group of outcomes, it would be overly ambitious to assess all types of PROs that have been developed. Therefore, we focused on PROs that capture aspects of physical activity as the main concept and chronic respiratory diseases as the main study subjects. Physical activity is a key concept in public health because reduced physical activity is a well-known risk factor for many chronic diseases and disorders [8], and sedentary lifestyles are common around the world [9]. Despite the importance of physical activity, it is challenging to define what physical activity actually means and how to capture the important aspects of physical activity. Thus, a conceptual framework of physical activity is particularly important for instruments that intend to measure this parameter. We focused on chronic respiratory diseases for two reasons: they are a leading cause of morbidity and mortality worldwide [9], and respiratory health is not included in most physical activity recommendations, despite the epidemiological and clinical evidence that regular physical activity may reduce the incidence and improve the prognosis of chronic respiratory diseases [10–12]. The current gap between research and public health needs may be partly due to the absence of a universally accepted definition of physical activity in studies of patients with chronic respiratory (and similar) diseases.

The aims of this study were (i) to identify available conceptual frameworks of physical activity in chronic respiratory patients or similar populations, and (ii) to determine whether the development and validation of currently used PRO instruments to measure physical activity in these populations were based on a conceptual framework of physical activity.

Methods

This study was part of the European Union-funded PROactive project (http://www.proactivecopd.com), which aims to develop, validate, and apply patient-reported outcome instruments to capture the dimensions of physical activity in daily life relevant to patients with chronic obstructive pulmonary disease (COPD). The PROactive consortium is multidisciplinary and includes academic partners, patient organizations, and pharmaceutical companies.

We utilized standard systematic review methodology following the handbooks of the Centre for Reviews and Dissemination [13] and the Cochrane Collaboration [14]. The manuscript follows the PRISMA [15] statement for reporting of systematic reviews and meta-analyses. All methods were specified in advance, documented in a protocol, and approved by the PROactive consortium. This manuscript includes data from two systematic reviews performed as part of the PROactive project. First, a systematic literature search, detailed below, was conducted to identify conceptual frameworks of physical activity. Second, we performed a secondary analysis from another systematic review of the PROactive consortium [unpublished observation] that identified existing PRO instruments for measuring physical activity.

Systematic review of conceptual frameworks of physical activity

Eligibility criteria

The following eligibility criteria were applied:

  1. 1.

    Type of studies: Any type of discussion article (e.g., seminar articles, viewpoints, unsystematic reviews or similar articles) that proposed and discussed a conceptual framework of physical activity, as defined by the FDA ("the conceptual framework explicitly defines the concepts measured by the instrument in a diagram that presents a description of the relationships between items, domain (subconcepts), and concepts measured and the scores produced by a PRO instrument"). We considered articles that were specifically focused on physical activity and excluded research articles in which only some parts of the introduction or discussion sections addressed physical activity. No language, publication date, or publication status restrictions were imposed.

  2. 2.

    Type of population: Elderly people (≥60 years of age) or subjects over 40 years of age with any of the following conditions: chronic respiratory disease (COPD, asthma or interstitial lung disease), symptomatic coronary heart disease, or congestive heart failure.

  3. 3.

    Type of information: Descriptions of what constitutes physical activity (the concept of the conceptual framework) and how it may be measured by domains, sub-domains, and, ultimately, items. We did not consider articles that described a concept of physical activity but lacked specifying domains (because they did not fulfill the conditions of a conceptual framework, which requires the specification of domains). Physical activity was defined as "any bodily movement produced by skeletal muscles which results in energy expenditure" [16]. This definition of physical activity includes activities such as activities of daily living, sports, and activities for personal fulfillment.

Information sources and search

We performed searches of the following electronic databases: Medline, Embase, CINAHL, and PsycINFO. We used the following search terms: chronic obstructive lung disease, interstitial lung disease, asthma, emphysema, coronary disease, heart failure, elderly, physical activity, motor activity, activity of daily living, physical inactivity, theoretical framework, conceptual framework, patient reported, patient self-reported, patient perception, control group, cross-over studies, meta-analysis, epidemiological studies, cohort studies, cross-sectional studies, and seroepidemiologic studies [see Additional file 1]. All publications prior to January 2010 (the time of the most recent search) were included. Additionally, because we expected that some documents on conceptual frameworks may not be published in the public domain and that electronic searches may miss relevant articles because of inconsistent indexing of articles in databases, we also performed manual searches of (i) all references listed in retrieved full-text articles and (ii) the first 50 references (sorted by link ranking) from PubMed's "Related Articles" search filter of retrieved full-text articles. We also contacted external scientists on this topic to identify further articles.

Management of references

The bibliographic details of all retrieved articles were stored in a RefWorks-COS file; RefWorks is a software program that is particularly helpful for organizing title and abstract screening by authors from remote sites. We removed duplicate records resulting from the database searches. The source of the identified articles (database, hand-search, expert contacts) was recorded in a "user-defined field" in each RefWorks-COS file. Additional user-defined fields were assigned to individual reviewers, who recorded their decisions for inclusion and exclusion.

Study selection

Two independent reviewers assessed the title and abstract of each identified citation. The decisions of the reviewers (order or reject) were recorded in the RefWorks-COS file and compared. Any disagreements were resolved by consensus, with close attention to the previously defined inclusion/exclusion criteria. Two independent reviewers evaluated the retrieved full text of all potentially eligible articles and made a decision on inclusion or exclusion according to the predefined selection criteria. Any disagreements were resolved by consensus, with close attention to the inclusion/exclusion criteria. In the case of a persistent disagreement, a third reviewer decided upon inclusion or exclusion. All studies that did not fulfill all of the predefined criteria were excluded, and their bibliographic details were listed with the specific reason for exclusion.

Data collection process

We developed a data extraction Microsoft® Office Excel sheet. Because the number of included studies was very small, a random pilot test was not feasible. To overcome this limitation and to avoid losing relevant information, two reviewers independently tested the form, which was refined prior to the final extraction process. The final version of the data extraction form was used by three independent reviewers to screen the full text of the included studies. Any disagreements were resolved by consensus, with close attention to the data extraction criteria.

Data extraction

The following information was extracted from each included study: (i) bibliographic details such as author, journal, year of publication, and language and (ii) details about the characteristics of conceptual frameworks and definitions of domains.

Quality of studies

Given the type of studies considered (no empirical data with estimates), the assessment of the quality of the studies is not applicable.

Summary measures

We summarized the conceptual frameworks. In addition, we drew a graph for each framework that included the concept being measured (level 1), its domains (level 2), their sub-domains, if applicable (level 3), and their items (level 4). We contacted the authors of the included studies, who confirmed that our graphs and descriptions appropriately represented the conceptual frameworks they proposed.

Systematic review of PRO instruments for measuring physical activity

We used data from a recent systematic review to determine which conceptual frameworks were used to support the development and validation of current PRO instruments for measuring physical activity. The detailed methods of that review are described elsewhere [unpublished observation].

Study selection

Two independent reviewers evaluated the retrieved full text of the 103 articles presenting PROs to assess physical activity previously included in the original review [unpublished observation] and excluded those not based on the type of population defined above (elderly people (≥60 years of age) or subjects over 40 years of age with any of the following conditions: chronic respiratory disease (COPD, asthma or interstitial lung disease), symptomatic coronary heart disease, congestive heart failure), and those not based on a conceptual framework. Any disagreements were resolved by consensus, with close attention to the inclusion/exclusion criteria. In the case of a persistent disagreement, a third reviewer decided upon inclusion or exclusion. All studies that did not fulfill all of the predefined criteria were excluded, and their bibliographic details were listed with the specific reason for exclusion.

Data extraction

We developed a data extraction Microsoft® Office Excel sheet, pilot tested it with a random sample of ten studies, and refined it accordingly. Two independent reviewers extracted the data, and any disagreements were resolved by consensus, with close attention to the data extraction criteria. The following information was extracted from each included study: (i) bibliographic details such as author, journal, year of publication, and language; (ii) whether the instrument was based on a conceptual framework; (iii) whether the conceptual framework was defined prior to statistical analysis, defined after statistical analysis, or refined after statistical analysis; (iv) the main concept and its definition; and (v) the domains and their definitions.

Summary measures

We summarized the results in a table and detailed all data extracted.

Results

Systematic review of conceptual frameworks of physical activity

A total of 569 references were identified from electronic database searches [Figure 1]. After deleting duplicates, 493 references remained. From these, 470 were excluded after screening based on the titles and abstracts. Therefore, 23 papers from the database searches, in addition to 6 additional papers obtained by hand-search and 6 papers provided by the experts, were included for full-text assessment. Of these papers, we excluded 33 articles for not focusing on physical activity (n = 9) or not providing a conceptual framework of physical activity (n = 11). Finally, 2 papers provided a conceptual framework that included the main concept, domains, sub-domains and potential items and thus were included in the review. Both papers provided conceptual frameworks of physical activity in COPD patients. We did not identify any conceptual framework for physical activity in other chronic respiratory diseases, symptomatic coronary heart disease, congestive heart failure, or elderly people.

Figure 1
figure 1

Flow diagram of process of systematic literature search.

Full size image

The article by Leidy [Figure 2] provided a conceptual framework based on qualitative research and expert opinion [17]. The author suggested that measuring activity should be broader than simply quantifying the amount of physical activity (e.g., as time spent on moderate or strenuous physical activity), which only reflects the perspective of health care professionals who want to increase people's physical activity levels to improve health outcomes ("health promotion"). The author argued that "functional activity", which has been identified in qualitative research as important to patients, should also be considered and should include activities of daily living (basic and instrumental) and personal fulfillment. We interpreted "activity" to be the main concept of the conceptual framework (level 1) and "physical activity-health perspective" and "functional activity-patient's perspective" to be the domains (level 2), as confirmed by the author The author provided examples of sub-domains and items for the "functional activity" domain derived from a previous paper on qualitative research in COPD patients [18].

Figure 2
figure 2

Conceptual framework proposed by Leidy (COPD, 2007).

Full size image

Larson provided a conceptual framework embedded in a rehabilitation context [19]. The author proposed a framework based on the International Classification of Functioning, Disability and Health (ICF) framework [20], the functional status framework [21], and the President's Fitness Council model [22]. We interpreted "physical activity behavior" to be the main concept, with "disability", "functional status", and "health & fitness" as the domains (level 2), again confirmed by the author. See Figure 3 for details on the sub-domains and items.

Figure 3
figure 3

Conceptual framework proposed by Larson (COPD, 2007).

Full size image

Systematic review of PRO instruments for measuring physical activity

From 103 studies of PRO instruments measuring physical activity, the dimensions of physical activity or related constructs, 45 studies (44%) did not satisfy the population inclusion criteria, and 36 studies (35%) were not based on a conceptual framework. None of the questionnaires with physical activity as the main concept was based on conceptual frameworks of physical activity derived from previous research or expert knowledge. Thus, 22 instruments (21%) based on a conceptual framework were included for data extraction. Their details are displayed in Table 1. None of these 22 instruments included physical activity as the main concept of the PRO conceptual framework, and only 7 (32%) considered physical activity as a domain. Most of the studies defined a conceptual framework prior to statistical analysis of the psychometric properties of the instrument. Only one defined its conceptual framework after the analysis, and three papers refined the domains after a factor analysis [see Table 1].

Table 1 Data Extraction Based on Physical Activity Questionnaires (n = 22)
Full size table

Discussion

This review identified only 2 conceptual frameworks for physical activity in COPD patients, whereas no conceptual frameworks seem to exist for patients with chronic heart disease, or elderly people. Furthermore, none of the available instruments for measuring dimensions of physical activity or related constructs in these populations was based on a conceptual framework for physical activity. These results may reflect the incomplete understanding of what physical activity means in chronic respiratory disease patients and similar populations (i.e., chronic heart disease patients or the elderly).

A potential limitation of this review is that some conceptual frameworks for physical activity may have been missed, despite a rigorous database search followed by a comprehensive hand-search and communication with expert. The indexing of this type of publication is not standardized, thus creating challenges in identifying relevant publications. Another potential limitation is that the FDA guidance for the PRO measures was published in 2006, whereas most of the PRO instruments included in our reviews were developed prior to that date. However, as early as 1985, previous guidelines for developing questionnaires included the requirement of a conceptual framework [3–6], even if this was labeled differently. The strengths of our review are the inclusion of chronic respiratory disease patients, patients with chronic cardiac diseases and elderly people, and the use of the same population criteria and concept definitions within two reviews.

A challenge of this review was understanding the definitions and concepts presented in the articles included in the full-text assessment because of the inconsistent use of terminology and the overlap between domains, sub-domains, and items within each conceptual framework. To resolve this issue, the authors strictly applied the definition of a conceptual framework (a concept to be measured by domains, sub-domains, and, ultimately, items). It was apparent that most articles considered for full-text assessment did not focus on physical activity as the concept to be measured or did not present a conceptual framework. Similarly, identifying a conceptual framework from the manuscripts developing PRO instruments was complicated because most articles provided the main concept, but the identification of their conceptual framework was much more difficult. A general recommendation from our review is that manuscripts should maintain consistency in the labeling of main concepts and domains, and in their definitions. Additionally, a discrepancy may be observed between the number of conceptual frameworks identified in the first (n = 2) and second reviews (n = 22). It is important to emphasize that none of the conceptual frameworks identified in the second review had physical activity as the main concept; consequently, they cannot be considered to represent conceptual frameworks of physical activity.

The requirement that PRO instrument development should be based on a conceptual framework has been long established and acknowledged in several guides and standards, such as the Medical Outcomes Trust [4, 5], Health Measurements Scales [6] and the American Psychological Association (APA) guidelines [3]. In particular, the Standards for Educational and Psychological Testing of the APA state that "the construct of interest for a particular test should be embedded in a conceptual framework, no matter how imperfect that framework may be" [3]. Our finding of a lack of conceptual frameworks for physical activity is in agreement with the lack of conceptual frameworks identified by O'Brien et al. for the comprehensive evaluation and treatment of people living with HIV [23]. Unfortunately, no other papers similar to this paper have been identified, which supports the view that there is little awareness and knowledge of this topic. Our second finding, that less than half of the PROs for physical activity or related constructs were based on a conceptual framework, is consistent with the finding of Pollard et al. that none of the PRO instruments for health outcome measures in osteoarthritis were based on a conceptual framework [24]. Of additional interest, we noted that only 3 questionnaires out of 22 refined their domains after the analysis, despite the need to develop PRO instruments through an iterative process, per FDA recommendations [25]. All things considered, our study suggests that there is limited knowledge of the complete process of developing and validating a PRO instrument.

It is debatable whether physical activity is a construct that requires a conceptual framework for its definition given the current trend in activity monitoring. The authors' opinion, based on the current state-of-the-art, is that physical activity is a multifaceted construct that goes well beyond the amount or frequency of physical activity. The concept of physical activity could also include, for example, the ability to perform activities of daily living and symptoms such as dyspnea or pain associated with physical activity, which are not captured by accelerometers or pedometers. Irrespective of the number of domains included in the construct of physical activity, it is critical that the use of questionnaires to measure it should be based on a previous conceptual framework.

The lack of conceptual frameworks for physical activity by individuals with chronic diseases such as COPD also has public health implications. In the meeting report entitled Implementation of the World Health Organization (WHO) Strategy for Prevention and Control of Chronic Respiratory Diseases, increasing physical activity levels was included in the recommendations for the development of policies in the area of chronic respiratory diseases [25]. The lack of a conceptual framework seems to preclude the success of potential interventions because there is no clear concept based upon which to intervene. One could question whether this lack of definition of physical activity is responsible, at least in part, for the lack of effectiveness of most physical activity interventions in chronic-disease patients at the population level [26]. A second potentially negative effect of the lack of conceptual frameworks is the difficulty of measuring the effectiveness of the interventions because instruments may not exactly measure what they claim to measure. Furthermore, using a PRO that is not based on a conceptual framework may lead to measurement error (information bias), which is a challenge to detect intervention effects. Therefore, we argue that (new) conceptual frameworks for physical activity for the elderly and for populations with chronic respiratory diseases and chronic heart diseases must be derived. These frameworks should precede the development of new PRO instruments for physical activity in these populations.

Conclusion

We identified only 2 conceptual frameworks for physical activity in COPD. We found that none of the currently available PROs that aim to measure physical activity in chronic respiratory disease patients or similar populations (chronic heart disease patients or the elderly) are based on a conceptual framework with physical activity as the main concept. Our findings contrast sharply with the FDA's guidance on the development and validation of PROs, raising the question of how the large body of evidence from trials that use these instruments should be evaluated by health care providers, guideline developers, and regulatory bodies.

Abbreviations

APA:

American Psychological Association

COPD:

Chronic Obstructive Pulmonary Disease

EMEA:

European Medicines Agency

FDA:

Food and Drug Administration

ICF:

International Classification of Functioning, Disability and Health

PRO:

Patient Reported Outcome

WHO:

World Health Organization.

References

  1. Bottomley A, Jones D, Claassens L: Patient-reported outcomes: assessment and current perspectives of the guidelines of the Food and Drug Administration and the reflection paper of the European Medicines Agency. Eur J Cancer 2009, 45: 347–353. 10.1016/j.ejca.2008.09.032

    PubMed  Article  Google Scholar 

  2. Center for Drug Evaluation and Research (CDER), Center for Biologics Evaluation and Reserach (CBER), Center for Devices and Radiological Health (CDRH): Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims. 2009. [http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM193282.pdf]

    Google Scholar 

  3. American Psychological Association, American Educational Research Association, National Council on Measurement in Education: Standards for educational and psychological testing. Whashington, DC: American Psychological Association; 1985.

    Google Scholar 

  4. Lohr KN, Aaronson NK, Alonso J, Burnam MA, Patrick DL, Perrin EB, Roberts JS: Evaluating quality-of-life and health status instruments: development of scientific review criteria. Clin Ther 1996, 18: 979–992. 10.1016/S0149-2918(96)80054-3

    CAS  PubMed  Article  Google Scholar 

  5. Lohr KN: Assessing health status and quality-of-life instruments: Attributes and review criteria. Quality of Life Research 2002, 11: 193–205. 10.1023/A:1015291021312

    PubMed  Article  Google Scholar 

  6. Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. New York: Oxford University Press; 1995.

    Google Scholar 

  7. Rothman ML, Beltran P, Cappelleri JC, Lipscomb J, Teschendorf B: Patient-reported outcomes: conceptual issues. Value Health 2007,10(Suppl 2):S66-S75.

    PubMed  Article  Google Scholar 

  8. Haskell WL, Lee IM, Pate RR, Powell KE, Blair SN, Franklin BA, Macera CA, Heath GW, Thompson PD, Bauman A: Physical activity and public health: updated recommendation for adults from the American College of Sports Medicine and the American Heart Association. Med Sci Sports Exerc 2007, 39: 1423–1434. 10.1249/mss.0b013e3180616b27

    PubMed  Article  Google Scholar 

  9. World Health Organization: Global Burden of Disease: 2004 update. [http://www.who.int/healthinfo/global_burden_disease/2004_report_update/en/index.html]

  10. Garcia-Aymerich J, Lange P, Benet M, Schnohr P, Anto JM: Regular physical activity modifies smoking-related lung function decline and reduces risk of chronic obstructive pulmonary disease: a population-based cohort study. Am J Respir Crit Care Med 2007, 175: 458–463.

    PubMed  Article  Google Scholar 

  11. Garcia-Aymerich J, Lange P, Benet M, Schnohr P, Anto JM: Regular physical activity reduces hospital admission and mortality in chronic obstructive pulmonary disease: a population based cohort study. Thorax 2006, 61: 772–778. 10.1136/thx.2006.060145

    CAS  PubMed Central  PubMed  Article  Google Scholar 

  12. Garcia-Aymerich J, Varraso R, Anto JM, Camargo CA Jr: Prospective study of physical activity and risk of asthma exacerbations in older women. Am J Respir Crit Care Med 2009, 179: 999–1003. 10.1164/rccm.200812-1929OC

    PubMed Central  PubMed  Article  Google Scholar 

  13. Centre for Reviews and Dissemination: Systematic reviews: CRD's guidance for undertaking reviews in health care. York: University of York; 2009. [http://www.york.ac.uk/inst/crd/SysRev/!SSL!/WebHelp/SysRev3.htm]

    Google Scholar 

  14. Higgins JPT, Green S: Cochrane Handbook for Systematic Reviews of Interventions, version 5.0.2 [update February 2009]. The Cochrane Collaboration; 2009. [http://www.cochrane-handbook.org/]

    Google Scholar 

  15. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Ann Intern Med 2009, 151: W65-W94.

    PubMed  Article  Google Scholar 

  16. Caspersen CJ, Powell KE, Christenson GM: Physical activity, exercise, and physical fitness: definitions and distinctions for health-related research. Public Health Rep 1985, 100: 126–131.

    CAS  PubMed Central  PubMed  Google Scholar 

  17. Leidy NK: Subjective measurement of activity in chronic obstructive pulmonary disease. COPD 2007, 4: 243–249. 10.1080/15412550701480414

    PubMed  Article  Google Scholar 

  18. Leidy NK: Functional performance in people with chronic obstructive pulmonary disease. Image J Nurs Sch 1995, 27: 23–34. 10.1111/j.1547-5069.1995.tb00809.x

    CAS  PubMed  Article  Google Scholar 

  19. Larson JL: Functional performance and physical activity in chronic obstructive pulmonary disease: theoretical perspectives. COPD 2007, 4: 237–242. 10.1080/15412550701480372

    PubMed  Article  Google Scholar 

  20. World Health Organization: International classification of functioning, disability and heatlh: ICF. Geneva, Switzerland. 2001. [http://www.disabilitaincifre.it/documenti/ICF_18.pdf]

    Google Scholar 

  21. Leidy NK: Functional status and the forward progress of merry-go-rounds: toward a coherent analytical framework. Nurs Res 1994, 43: 196–202.

    CAS  PubMed  Article  Google Scholar 

  22. Corbin C, Pangrazi R, Frank B: Definitions: Health, Fitness, and Physical Activity. Washington, DC: President's Council on Physical Fitness and Sports 2000.

    Google Scholar 

  23. O'Brien KK, Bayoumi AM, Strike C, Young NL, Davis AM: Exploring disability from the perspective of adults living with HIV/AIDS: development of a conceptual framework. Health Qual Life Outcomes 2008, 6: 76. 10.1186/1477-7525-6-76

    PubMed Central  PubMed  Article  Google Scholar 

  24. Pollard B, Johnston M, Dixon D: Theoretical framework and methodological development of common subjective health outcome measures in osteoarthritis: a critical review. Health Qual Life Outcomes 2007, 5: 14. 10.1186/1477-7525-5-14

    PubMed Central  PubMed  Article  Google Scholar 

  25. World Health Organization: Implementation of WHO strategy for prevention and control of chronic respiratory diseases. Meeting report. 2002. [http://www.who.int/respiratory/publications/WHO_MNC_CRA_02.2.pdf]

    Google Scholar 

  26. Physical Activity and Health: A Report of the Surgeon General. Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion. 1996. [http://www.fitness.gov/execsum/execsum.htm]

    Google Scholar 

  27. Arbuckle TY, Gold DP, Chaikelson JS, Lapidus S: Measurement of activity in the elderly: The Activities Checklist. Can J Aging 1994, 13: 550–65. 10.1017/S0714980800006395

    Article  Google Scholar 

  28. Avlund K, Kreiner S, Schultz-Larsen K: Functional ability scales for the elderly: a validation study. Eur J Public Health 1996, 6: 35–42. 10.1093/eurpub/6.1.35

    Article  Google Scholar 

  29. Carone M, Bertolotti G, Anchisi F, Zotti AM, Donner CF, Jones PW: Analysis of factors that characterize health impairment in patients with chronic respiratory failure. Quality of Life in Chronic Respiratory Failure Group. Eur Respir J 1999, 13: 1293–1300. 10.1183/09031936.99.13613019

    CAS  PubMed  Article  Google Scholar 

  30. Dunderdale K, Thompson DR, Beer SF, Furze G, Miles JNV: Development and validation of a patient-centered health-related quality-of-life measure: the Chronic Heart Failure Assessment Tool. J Cardiovasc Nurs 2008, 23: 364–70.

    PubMed  Article  Google Scholar 

  31. Eakman AM: A reliability and validity study of the Meaningful Activity Participation Assessment. PhD thesis. University of Southern California; 2007.

    Google Scholar 

  32. Fillenbaum GG, Smyer MA: The development, validity, and reliability of the OARS multidimensional functional assessment questionnaire. J Gerontol 1981, 36: 428–34.

    CAS  PubMed  Article  Google Scholar 

  33. Kempen GI, Suurmeijer TP: The development of a hierarchical polychotomous ADL-IADL scale for noninstitutionalized elders. Gerontologist 1990, 30: 497–502. 10.1093/geront/30.4.497

    CAS  PubMed  Article  Google Scholar 

  34. Lareau SC, Carrieri-Kohlman V, Janson-Bjerklie S, Roos PJ: Development and testing of the Pulmonary Functional Status and Dyspnea Questionnaire (PFSDQ). Heart Lung 1994, 23: 242–50.

    CAS  PubMed  Google Scholar 

  35. Lareau SC, Meek PM, Roos PJ: Development and testing of the modified version of the Pulmonary Functional Status and Dyspnea Questionnaire (PFSDQ-M). Heart Lung 1998, 27: 159–68. 10.1016/S0147-9563(98)90003-6

    CAS  PubMed  Article  Google Scholar 

  36. Lee L, Friesen M, Lambert IR, Loudon RG: Evaluation of Dyspnea During Physical and Speech Activities in Patients With Pulmonary Diseases. Chest 1998, 113: 625–32. 10.1378/chest.113.3.625

    CAS  PubMed  Article  Google Scholar 

  37. Leidy NK: Psychometric properties of the functional performance inventory in patients with chronic obstructive pulmonary disease. Nurs Res 1999, 48: 20–8. 10.1097/00006199-199901000-00004

    CAS  PubMed  Article  Google Scholar 

  38. Letrait M, Lurie A, Bean K, Mesbah M, Venot A, Strauch G, Grandordy BM, Chwalow J: The Asthma Impact Record (AIR) index: a rating scale to evaluate the quality of life of asthmatic patients in France. Eur Respir J 1996, 9: 1167–73. 10.1183/09031936.96.09061167

    CAS  PubMed  Article  Google Scholar 

  39. Maille AR, Koning CJM, Zwinderman AH, Willems LNA, Dijkman JH, Kaptein AA: The development of the Quality-of-Life for Respiratory Illness Questionnaire (QOL-RIQ): a disease-specific quality-of-life questionnaire for patients with mild to moderate chronic non-specific lung disease. Respir Med 1997, 91: 297–309. 10.1016/S0954-6111(97)90034-2

    CAS  PubMed  Article  Google Scholar 

  40. Migliore Norweg A, Whiteson J, Demetis S, Rey M: A new functional status outcome measure of dyspnea and anxiety for adults with lung disease: the dyspnea management questionnaire. J Cardiopulm Rehabil 2006, 26: 395–404. 10.1097/00008483-200611000-00010

    PubMed  Article  Google Scholar 

  41. Morimoto M, Takai K, Nakajima K, Kagawa K: Development of the chronic obstructive pulmonary disease activity rating scale: reliability, validity and factorial structure. Nurs Health Sci 2003, 5: 23–30. 10.1046/j.1442-2018.2003.00131.x

    PubMed  Article  Google Scholar 

  42. Morris WW, Buckwalter KC, Cleary TA, Gilmer JS: Issues related to the validation of the Iowa Self-Assessment Inventory. Educ Psychol Meas 1989, 49: 853–61. 10.1177/001316448904900408

    Article  Google Scholar 

  43. Schultz-Larsen K, Avlund K, Kreiner S: Functional ability of community dwelling elderly. Criterion-related validity of a new measure of functional ability. J Clin Epidemiol 1992, 45: 1315–26. 10.1016/0895-4356(92)90172-J

    CAS  PubMed  Article  Google Scholar 

  44. Tu SP, McDonell MB, Spertus JA, Steele BG, Fihn SD: A new self-administered questionnaire to monitor health-related quality of life in patients with COPD. Ambulatory Care Quality Improvement Project (ACQUIP) Investigators. Chest 1997, 112: 614–22. 10.1378/chest.112.3.614

    CAS  PubMed  Article  Google Scholar 

  45. van der Molen T, Willemse BW, Schokker S, ten Hacken NH, Postma DS, Juniper EF: Development, validity and responsiveness of the Clinical COPD Questionnaire. Health Qual Life Outcomes 2003, 1: 13–23. 10.1186/1477-7525-1-13

    PubMed Central  PubMed  Article  Google Scholar 

  46. Wigal JK, Creer TL, Kotses H: The COPD Self-Efficacy Scale. Chest 1991, 99: 1193–6. 10.1378/chest.99.5.1193

    CAS  PubMed  Article  Google Scholar 

  47. Zaragoza J, Lugli-Rivero Z: Development and Validation of a Quality of Life Questionnaire for Patients with Chronic Respiratory Disease (CV-PERC): Preliminary Results. Arch Bronconeumol 2009, 45: 81–6.

    PubMed  Article  Google Scholar 

  48. Zisberg A: Influence of routine on functional status in elderly: development and validation of an instrument to measure routine. PhD thesis. University of Washington; 2005.

    Google Scholar 

Download references

Acknowledgements

This work was conducted within the PROactive project which is funded by the Innovative Medicines Initiative Joint Undertaking [IMI JU # 115011]. JGA has a researcher contract from the Instituto de Salud Carlos III (CP05/00118), Ministry of Health, Spain. CIBERESP is funded by the Instituto de Salud Carlos III, Ministry of Health, Spain.

PROactive consortium: Chiesi Farmaceutici S.A.: Caterina Brindicci, Tim Higenbottam; Katholieke Universiteit Leuven: Thierry Trooster, Fabienne Dobbels; Glaxo Smith Kline: Margaret X. Tabberer; University of Edinburgh, Old College South Bridge: Roberto Rabinovich, Bill McNee; Thorax Research Foundation, Athens: Ioannis Vogiatzis; Royal Brompton and Harefield NHS Foundation Trust: Michael Polkey, Nick Hopkinson; Municipal Institute of Medical Research, Barcelona: Judith Garcia-Aymerich; Universität Zürich, Zürich: Milo Puhan, Anja Frei; University Medical Center, Groningen: Thys van der Molen, Corina De Jong; Netherlands Asthma Foundation, Leusden: Pim de Boer; British Lung Foundation, UK: Ian Jarrod; Choice Healthcare Solution, UK: Paul McBride; European Respiratory Society, Lausanne: Nadia Kamel; Pfizer: Katja Rudell, Frederick J. Wilson; Almirall: Nathalie Ivanoff; Novartis: Karoly Kulich, Alistair Glendenning; AstraZeneca AB: Niklas X. Karlsson, Solange Corriol-Rohou; UCB: Enkeleida Nikai; Boehringer Ingelheim: Damijen Erzen.

Author information

Authors and Affiliations

  1. Centre for Research in Environmental Epidemiology (CREAL), Barcelona, Spain

    Elena Gimeno-Santos & Judith Garcia-Aymerich

  2. Hospital del Mar Research Institute (IMIM), Barcelona, Spain

    Elena Gimeno-Santos & Judith Garcia-Aymerich

  3. CIBER Epidemiología y Salud Pública (CIBERESP), Barcelona, Spain

    Elena Gimeno-Santos & Judith Garcia-Aymerich

  4. Horten Centre for Patient-oriented Research, University Hospital of Zurich, Switzerland

    Anja Frei & Milo A Puhan

  5. Institute of General Practice and Health Services Research, University Hospital of Zurich, Switzerland

    Anja Frei

  6. Centre for Health Services and Nursing Research, Katholieke Universiteit Leuven, Leuven, Belgium

    Fabienne Dobbels

  7. Patient Reported Outcomes Centre of Excellence, Market Access, Primary Care Business Unit, Pfizer Ltd, Sandwich, Kent, UK

    Katja Rüdell

  8. Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Johns Hopkins University, Baltimore, (MD), USA

    Milo A Puhan

  9. Department of Experimental and Health Sciences, Universitat Pompeu Fabra (UPF), Barcelona, Spain

    Judith Garcia-Aymerich

Authors
  1. Elena Gimeno-Santos
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anja Frei
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fabienne Dobbels
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Katja Rüdell
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Milo A Puhan
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Judith Garcia-Aymerich
    View author publications

    You can also search for this author in PubMed Google Scholar

Consortia

the PROactive consortium

Corresponding author

Correspondence to Judith Garcia-Aymerich.

Additional information

Competing interests

The authors declare that they no have competing interests.

Authors' contributions

MP and JGA led the systematic review. EGS, AF, FD, KR, MP and JGA developed the study protocol. AF and EGS coordinated the review. EGS and AF conducted the electronic database searches; EGS conducted the additional searches. AF coordinated the references in RefWorks. AF and MP (1st reviewers) and EGS and JGA (2nd reviewers) screened titles and abstracts. AF and MP (1st reviewers) and EGS and JGA (2nd reviewers) assessed full texts of the identified studies and extracted the relevant data. EGS, MP and JGA drafted the manuscript. All authors contributed to revising the manuscript and approved the final version. PROactive consortium approved the final version of the manuscript.

Electronic supplementary material

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Gimeno-Santos, E., Frei, A., Dobbels, F. et al. Validity of instruments to measure physical activity may be questionable due to a lack of conceptual frameworks: a systematic review. Health Qual Life Outcomes 9, 86 (2011). https://doi.org/10.1186/1477-7525-9-86

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1477-7525-9-86

Keywords

  • Chronic heart disease
  • chronic respiratory disease
  • conceptual framework
  • elderly
  • patient reported outcomes
  • physical activity
  • questionnaire
  • systematic review

Health and Quality of Life Outcomes

ISSN: 1477-7525

Contact us