Critical appraisal of a brief 5 item version of the Neck Disability Index
© Gabel et al.; licensee BioMed Central Ltd. 2014
Received: 5 October 2013
Accepted: 5 March 2014
Published: 10 March 2014
We congratulate Walton and MacDermid  for their insightful proposal and brief 5-item Neck Disability Index (NDI-5). Their methodology addresses recognized NDI  validity problems including the dual factor structure , face and content validity from poor WHO-ICF compliance  and ordinal scale values due to descriptive response options .
The proposed NDI-5 overcomes these by providing a single factor structure ensuring all items can summate to a single score, WHO-ICF compliance through the conceptual reductive process, and interval scale values achieved from Rasch analysis.
The NDI problems highlighted focus concerns on the results from publications where the primary outcome is a single functional patient-reported outcome (PRO) measure, such as the NDI. Such large-scale, prospective trials can influence policy, funding, and opinions on the effectiveness of interventions, therapies, and professions . When such study results prefer one approach over another, based on a single PRO with validity concerns, the PRO’s clinimetric characteristics must be considered and why concurrent PROs were not used in such studies.
The stated NDI problems also raise questions for the NDI-5 items (personal care, concentration, work, driving, and recreation). The employed reductive conceptual retention methodology is well recognized ; however, the retained NDI-5 items differ notably from those identified by other authors using this methodology [8, 9]. Walton and MacDermid acknowledged this: “…item removal was liberal and other authorship groups may [arrive] at a different scale…”. Our recent study used Confirmatory Factor Analysis (CFA)  and determined two functional categories, retaining ‘Physical’ (personal care, lifting, work, driving, sleep, and recreation) and deleting ‘Mental’ (pain, headache, concentration, and reading). Consequently, four items agree, but we retained ‘sleep’ under ICF codes b134 and d410 and ‘lifting’ under d430, while ‘concentration’ was removed. Furthermore, the NDI-5 ‘driving’ item was “…modified…to read ‘driving/riding in a vehicle’, in recognition of…the population who do not drive” and reduced from six to five options. The authors stated they “…don’t believe this change…adversely affect[s] the properties of the scale”; however, “…the results…were achieved through use of the original wording.”
Face and content validity as the NDI-5 retains ‘concentration’ and four ‘Physical Function’ items, with ‘driving’ modified in both language and score options.
Clinimetric characteristics are unknown as the NDI-5 is yet to be prospectively tested and analysed.
Final score proportionality is affected as changing one item from six to five responses weights the other items disproportionately. Selectively disadvantaging one of five scale items is particularly problematic as all summed items should have identical response options.
Four further considerations implied within this study must be highlighted.
First, generalization to large populations is difficult and as Walton and Macdermid note “Confidence…will be increased when replicated in an independent cohort.” This homogenous physiotherapy mechanical neck pain population has only two-thirds with work status, cross-gender differential item functioning further reduces potential samples, and only 50 participants were examined for ‘longitudinal validity’. Though reasonable, the samples are proportionally small, a common problem in many outcome clinimetric studies.
Second, in the Rasch analyses, criterion for exclusion was not stated. Thus, there may have been items eliminated that technically were significant but practically not unreasonable. Additionally, the authors identify overall goodness of fit (Chi Square = 89.1) as being relatively poor when the Chi-square:df ratio was well within reasonable range (CHI/DF ≈ 0.28).
Third, to minimize bias the reduction process should ideally have had objective experts as highlighted by differences with the CFA study selected items .
Finally, full validation of the NDI-5 should include criterion-related validity and a direct comparison with the NDI-10 to determine whether the new proposed version is superior to the existing or other proposed reduced-versions.
Consequently the “…ripe directions for future research…” fall into three categories:
I) Concurrent PRO use as Walton and MacDermid concluded through use of “…patient-centred…[and]…symptom-specific scales…to allow separation of important constructs while maximizing sensitivity to change.” These concurrent PROs should consider the entire spinal kinetic chain (e.g. Spine Functional Index , Functional Rating Index ) or use software-based PROs from mobile computers and smart phones that employ computerized adaptive testing (FOTO)  or more progressively, decision support systems  integrating predictive screening and outcome use (AdviseRehab)  with the capacity to incorporate “…symptom-specific items”.
III) Recommendations on future tools with sound clinimetrics: fulfilling all necessary criteria [15, 16] including both psychometrics  and practicality , independently researched and sufficiently progressive as to be incorporated and used within available and future technology.
The NDI has served researchers, clinicians, and patients well. The discussed limitations are determined from evolutionary processes considering clinimetrics and evidence determination. We must not lose what the NDI has contributed but retain the benefits and move forward. The essential components of evidence  must remain and be supported by validity and critical insight from PROs that are adaptable and progressive in our technologically connected age.
Charles Philip Gabel, Antonio Cuesta-Vargas, Markus Melloh and Jason Osborne
- Walton DM, MacDermid JC: A brief 5-item version of the neck disability index shows good psychometric properties. Health Qual Life Outcomes 2013, 11: 108. 10.1186/1477-7525-11-108PubMed CentralView ArticlePubMedGoogle Scholar
- Vernon H, Mior S: The neck disability index: a study of reliability and validity. J Manipulative Physiol Ther 1991, 14: 409–415.PubMedGoogle Scholar
- Doward LC, McKenna SP: Defining patient-reported outcomes. Value Health 2004, 7: S4-S8.View ArticlePubMedGoogle Scholar
- International Classification of Functioning, Disability and Health (ICF) http://www.who.int/classifications/icf/en/
- Johansen JB, Andelic N, Bakke E, Holter EB, Mengshoel AM, Røe C: Measurement properties of the Norwegian version of the neck disability index in chronic neck pain. Spine (Phila Pa 1976) 2013, 38: 851–856. 10.1097/BRS.0b013e31827fc3e9View ArticleGoogle Scholar
- Lamb SE, Gates S, Williams MA, Williamson EM, Mt-Isa S, Withers EJ, Castelnuovo E, Smith J, Ashby D, Cooke MW, Petrou S, Underwood MR, on behalf of the Managing Injuries of the Neck Trial (MINT) Study Team: Emergency department treatments and physiotherapy for acute whiplash: a pragmatic, two-step, randomised controlled trial. Lancet 2013, 381: 546–556. 10.1016/S0140-6736(12)61304-XView ArticlePubMedGoogle Scholar
- Beaton DE, Wright JG, Katz JN, Group UEC: Development of the QuickDASH: comparison of three item-reduction approaches. J Bone Joint Surg Am 2005, 87: 1038–1046. 10.2106/JBJS.D.02060View ArticlePubMedGoogle Scholar
- Young SB, Aprill C, Braswell J, Ogard W, Richards JS, McCarthy JP: Psychological factors and domains of neck pain disability. Pain Med 2009, 10: 310–318. 10.1111/j.1526-4637.2009.00571.xView ArticlePubMedGoogle Scholar
- Gabel CP, Cuesta-Vargas AI, Osborne JO, Burkett B, Melloh M: Confirmatory factory analysis of the neck disability index indicates a one-factor model. Spine J 2013. In PressGoogle Scholar
- Gabel CP, Melloh M, Burkett B, Michener LA: A new outcome measure for the whole-spine demonstrates improved performance, clinimetric properties and practicality. Spine J 2013. Accepted for publicationGoogle Scholar
- Feise RJ, Menke JM: Functional rating index: a new valid and reliable instrument to measure the magnitude of clinical change in spinal conditions. Spine 2001, 26: 78–86. 10.1097/00007632-200101010-00015View ArticlePubMedGoogle Scholar
- FOTO 2013. Focus on Therapeutic Outcomes: http://www.fotoinc.com/index.html
- Garg AX, Adhikari NKJ, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. In 1993 SF-36 Health Survey: Manual and Interpretation Guide, The Health Institute, New England Medical Center 293rd edition. Edited by: Ware JE, Snow KK, Kosinski MM, Gandek B. 2005, 1223–1238.Google Scholar
- Advise Rehabilitation, decision support software http://www.adviserehab.com/
- Bot SD, Terwee CB, van der Windt DA, Bouter LM, Dekker J, de Vet HC: Clinimetric evaluation of shoulder disability questionnaires: a systematic review of the literature. Ann Rheum Dis 2004, 63: 335–341. 10.1136/ard.2003.007724PubMed CentralView ArticlePubMedGoogle Scholar
- Gabel CP, Michener L, Burkett B, Neller A: The Upper Limb Functional Index (ULFI): development and determination of reliability, validity and responsiveness. J Hand Ther 2006, 19: 328–349. 10.1197/j.jht.2006.04.001View ArticlePubMedGoogle Scholar
- Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC: Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol 2007, 60: 34–42. 10.1016/j.jclinepi.2006.03.012View ArticlePubMedGoogle Scholar
- Liang MH, Jette AM: Measuring functional ability in chronic arthritis: a critical review. Arthritis Rheum 1981, 24: 80–86. 10.1002/art.1780240113View ArticlePubMedGoogle Scholar
- Sackett DL, Rosenberg W, Muir Gray JA, Haynes RB, Richardson WS: Evidence based medicine: what it is and what it isn’t. BMJ 1996, 312: 71–72. 10.1136/bmj.312.7023.71PubMed CentralView ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.