Conceptual adequacy of the neuropathic pain symptom inventory in six countries
Health and Quality of Life Outcomes volume 6, Article number: 62 (2008)
Neuropathic pain results from a nerve lesion or nerve damage. Because it is a subjective experience, patient-reported outcomes may measure both the symptoms and impact on the patient's life. The purpose of this study was to determine whether the Neuropathic Pain Symptom Inventory (NPSI) adequately assesses neuropathic pain symptoms in patients with diabetic peripheral neuropathy, post-herpetic neuralgia, trigeminal neuralgia, and sciatica across multiple cultures.
From data collected from 132 subjects in 6 countries, qualitative research methods identified their most important symptoms (and verbal descriptions) associated with neuropathic pain. A core set of commonly described symptoms spanning multiple cultures was also described. Moderators using a semi-structured discussion guide conducted focus groups consisting of patients in the U.S., Brazil, Japan, China, Finland, and Spain to elicit concepts that were most important and relevant (concept elicitation phase). Study subjects ranked the importance of each neuropathic pain symptom, completed the NPSI, and commented on its ability to capture key symptoms (face and content validation phase).
Descriptive terms for sensations of neuropathic pain were similar in all countries; burning, electric shocks, and pins and needles were among the most-common sensations. Individuals with neuropathic pain experienced all sensations that were included in the NPSI. They also tended to describe pins and needles and numbness interchangeably, perhaps reflecting the relative number of DPN subjects on study.
Based on data from these focus groups, the NPSI is an acceptable instrument for assessing neuropathic pain.
Neuropathic pain results from a nerve lesion or nerve damage and may be experienced as burning, electric shock-like, sharp stabbing pains that come and go, deep aches that make sleep or normal activities difficult, or very sensitive skin that reacts to even a slight touch [1, 2]. These sensations not only affect the sensory system, but also translate into a wider impact on patients' health related quality of life in terms of alterations in sleep patterns, concentration and mood. Neuropathic pain has been defined by the International Association for the Study of Pain as pain initiated or caused by a primary lesion or dysfunction of the nervous system . Due to the fact that some researchers find this definition overly broad, neuropathic pain has also been characterized as pain caused by lesions of the peripheral or central nervous system (or both) that manifest sensory symptoms or signs . The assessment of neuropathic pain is often complex, given that it is associated with a wide variety of chronic diseases or conditions such as diabetes, carpal or ulnar nerve entrapments, sciatica, spinal cord injury and neuralgia .
Neuropathic pain is a subjective experience and the use of patient-reported outcomes (PROs) in measuring symptoms and their manifestation into the patient's life is important. There are several evaluative instruments dealing with neuropathic pain [6–9]. Selecting appropriate measures for the complex assessment of neuropathic pain is challenging. Regulatory agencies have developed guidelines that direct researchers on the development and validation of PRO measures [10, 11]. In order for an instrument to be considered well developed, the new guidelines have specified several key points. The development of the instrument must include patient involvement to assist in developing the concepts to be measured or, as the guidelines infer, the question generation process would be incomplete. A wide range of patients should be included in the development of a questionnaire to ensure a representative sample and variations in population characteristics. Following the development of the questions, it is important to review these questions with patients to ensure their clarity and relevance. A questionnaire is not considered valid until the statistical properties have been tested.
The new guidelines direct researchers on the validation steps to ensure the measurement properties are adequate for use in clinical trials. Regulatory agencies want to be sure the questionnaire reliably measures the concepts it was designed to measure. It should be noted, however, that the statistical testing of the questionnaire should guide the development and not dictate which items remain in the questionnaire. Relevance to the patient and clinical importance should always be considered. Most questionnaires were developed solely based on clinical expert opinions regarding which symptoms subjects experience and not the patients' perspective on treatment outcomes – an important scientific standard in questionnaire development . In addition, perceptions and descriptions of neuropathic pain might possibly differ between cultures. Thus, to ensure that the questionnaire is suitable for use in worldwide clinical trials, it should not reflect cultural bias.
This study evaluates the face and content validity of the Neuropathic Pain Symptom Inventory (NPSI) . The NPSI was developed to assess more specifically the different components of neuropathic pain syndromes (i.e. spontaneous ongoing and paroxysmal pain, evoked pain, paresthesia/dysesthesia). This self-questionnaire includes ten items related to different pain descriptors (e.g. burning, squeezing, electric-shock, stabbing, tingling) allowing the assessment of the different dimensions of neuropathic pain and two items on frequency and duration of pain. Each of the items has a recall of the past 24 hours and items are rated on an 11-point numeric rating scale anchored by 0: No (symptom) and 10: Worst (symptom) imaginable. We employed qualitative research methods to identify symptoms deemed most important to the subjects affected by neuropathic pain and the manner in which the subjects describe those symptoms. Because the NPSI may be used to study several forms of neuropathic pain, it is important to establish a core set of neuropathic pain symptoms. Therefore, this assessment focuses on a core set of symptoms commonly described as symptoms in neuropathic pain that also span multiple cultures.
The objective of this study was to determine if the NPSI adequately assesses neuropathic pain symptoms, and is acceptable and relevant to patients with diabetic peripheral neuropathy (DPN), post-herpetic neuralgia (PHN), trigeminal neuralgia (TN), and sciatica across multiple, diverse cultural norms.
Focus groups in six countries (U.S. [English], Brazil [Portuguese], Japan [Japanese], China [Mandarin], Finland [Finnish], Spain [Spanish]) were designed to elicit concepts that were most important and relevant to patients with neuropathic pain. Subjects were recruited through pain specialists via recruitment agencies. The recruitment agencies initiated contact with pain specialists who invited subjects to participate in the study. Subjects received an informational letter outlining the purpose of the study and the extent of their involvement, and physicians obtained informed consent prior to study. Both subjects and their physicians were required to complete a case report form (CRF) that included clinician and subject contact information and ensured the eligibility of the subject through a list of inclusion and exclusion criteria. Subjects were informed that the focus group session would last approximately two hours. The CRFs were reviewed for completeness and patient eligibility prior to beginning the focus group sessions.
Six to ten subjects were recruited for each focus group. An attempt was made to recruit subjects of differing age, gender, and ethnicity (the latter only in the U.S.). Subjects with mild to severe neuropathic pain were included to capture the full spectrum of patient pain.
Study inclusion criteria included: 18 years of age or older; diagnosed with DPN, PHN, TN, or sciatica; able to discern his/her neuropathic pain from any concomitant pain (e.g., joint pain) as determined by their physician; and ability to participate in a two-hour focus group discussion. In addition, subjects met at least three of the following inclusion criteria (abstracted from the ID Pain ) to verify the presence of neuropathic pain: described his/her pain as feeling like pins and needles; described his/her pain as feeling like hot/burning; described his/her pain as feeling numb; has described his/her pain as feeling like electrical shocks; and/or reported that his/her pain is worsened by the touch of clothing or bed sheets. Exclusion criteria included: serious mental health or cognition condition(s), including cognitive impairment, severe mental retardation, schizophrenia, and/or physician-assessed clinical depression.
Prior to the initiation of the focus groups, subjects completed forms for informed consent and background demographics, as well as pre-focus group questionnaires. These questionnaires asked subjects to list five terms that describe their nerve pain in conjunction with the five most-bothersome symptoms (i.e., "People feel pain in many ways and people might describe pain using many different terms. We are interested in how you would describe your nerve pain. Please list below five words that you would use to describe your nerve pain;" and "Please list below the three most bothersome sensations you feel related to your nerve pain."). Collecting this information spontaneously prior to discussing the topic with other subjects via questionnaire avoids the potential introduction of error through "yeah-saying" in the focus groups.
Concept elicitation and content validation
Trained moderators conducted the focus group sessions using a semi-structured discussion guide. Prior to the start of the focus group, the moderators explained the purpose of the study, reassured the subjects of the confidentiality of their responses, encouraged the subjects to take their time with their responses, and allowed all subjects an opportunity to share their views with the group. The moderator informed the participants that the focus group sessions would be audio- and/or video-recorded as stated in the consent form that each participant had signed prior to the focus group. The focus group guide consisted of: 1) a concept elicitation phase, and 2) face and content validation phase. During the concept elicitation phase, subjects received open-ended questions about their neuropathic pain experiences, focusing on symptoms they experienced due to their neuropathic pain. Subjects identified and described such sensations in detail. Initially, subjects responded spontaneously to these questions. If sensations previously described in the questionnaire were not mentioned spontaneously, the moderator probed the subjects to determine the accurateness of the sensations. These questions were asked prior to the content validation phase of the interview to ensure that the subjects were not unduly biased by the sensations covered in the NPSI. This allowed for a pure assessment of symptoms prior to the face and content validation of the questionnaire and a more guided assessment of symptoms during the second phase of the focus group.
During the concept elicitation phase, the importance of each neuropathic pain symptom was ranked by patients detailing the "most bothersome" sensation they experience. During the face and content validation phase of the focus groups, the subjects completed the NPSI and commented on the extent to which the questionnaire captured key symptoms associated with neuropathic pain. The purpose of this phase of the focus groups was to ensure: 1) the relevance of the concepts covered by the questionnaire, 2) the questionnaire's comprehensiveness and ease of understanding, and 3) the applicability/acceptability of the items.
Transcriptions were produced from the audiotapes of the sessions, and verbatim subject comments were analyzed. Recordings in Japanese, Spanish, Portuguese, and Chinese were transcribed into the respective native language prior to English translation. The English transcripts of the other countries' focus group data were then analyzed. The Finnish tapes were transcribed into Finnish and then analyzed in the native language. Subject quotes were grouped together by symptom and compared to the symptoms included in the NPSI.
Coding schemes were developed to translate descriptions of patient characteristics into thematic trends for data analysis. The thematic coding scheme underwent iterations as the research team coded the preliminary data. Initial coded material was aggregated into broader core categories and analyzed using grounded theory methods . For the concept elicitation sections of the focus groups, each subject comment was assigned a "classification" and "domain" and incorporated into a domain mapping grid. The classifications and domains identified, along with examples of subject quotes, were used as a basis for determining whether all relevant symptoms were included in the NPSI.
Results and discussion
One hundred and thirty-two subjects from six countries were interviewed (Table 1), Background demographics, including age and gender are summarized in Table 2. The type of neuropathic pain and clinician-rated severity of pain are included in Table 3.
In the U.S., the majority of the subjects (72%) were Caucasian. The remaining participants were African American (8%), Hispanic/Latino (11%), and from other ethnic groups (3%). As illustrated in Table 2, there was some variability by country in both educational level and marital status. Ethnicity was not collected in the other countries due to the ethnic homogeneity for each country. It should be noted that with the exception of the U.S., focus groups were conducted in or around major cities – Sao Paulo, Beijing and Shanghai, Seinajoki (smaller city in western Finland), Madrid and Tokyo.
Pre-focus group findings
Table 4 summarizes the spontaneous, independent report of symptoms by subjects on the pre-focus group questionnaire, as described in Methods. The most frequently listed words to describe neuropathic pain were "burning," "electric shock," "numbness," and "tingling"; however, not all of the subjects listed sensations.
"Squeezing" and "pressure" were the least likely sensations on the NPSI to be elicited spontaneously on the pre-focus group questionnaire. "Pressure" was reported in every country except Brazil and "squeezing" was only mentioned in Finland.
All sensations covered in the NPSI were mentioned spontaneously as being most bothersome on the pre-focus group questionnaire except for squeezing. The most frequent notations of bothersome were burning, tingling, and electric shocks.
Focus group findings
During the focus groups, the most common spontaneous descriptions were burning, electric shocks, numbness, and pins and needles. Subjects often used terms interchangeably; for example, in the U.S., "tingling" and "numbness" were described as "pins and needles."
In Brazil, all symptoms on the NPSI were spontaneously mentioned in the focus group except "squeezing" and "tingling." After probing, subjects also reported experiencing "squeezing." "Tingling" was the only sensation not mentioned by the subjects in Brazil. "Cramps" were described as "similar to twinging" and "coming after the burning pain." After a discussion with a professional translator, it was discovered that "twinging" might be the English translation of the Brazilian word for "tingling." One patient described "twinging" as "stabbing by needles."
In China, subjects also used the terms "heart stabbing," "needle through heart," "tremble," and "bursting" to describe their pain. Interviewers in China noted that these terms should not be interpreted literally. "Bursting" implies a "sudden, strong, and unbearable" feeling of pain. The two terms referring to the heart do not mean that the heart is in pain. When speaking about pain, the Chinese are more likely to relate extreme pain with the heart because they believe the heart is the most critical and sensitive part of the body.
In Spain, the two sensations of "pins and needles" and "stabbing" were combined into one term as "stabbing pins on fire" (n = 8). One subject defined it as if "hundreds, thousands of pins on fire (are) stuck into my body."
Table 5 summarizes the pain sensations experienced by the focus group members that they spontaneously described. The symptoms of the NPSI were consistently reported within the focus groups with the exception of "squeezing." Although "squeezing" was reported in the U.S., Finland and Japan, few subjects stated this as a spontaneous expression of their pain. "Squeezing" was only spontaneously mentioned by one subject and four subjects mentioned "squeezing" while describing other neuropathic pain sensations.
All of the sensations of neuropathic pain included in the NPSI (e.g., burning, squeezing, pressure, electric shocks, stabbing, pins and needles, and tingling) were spontaneously mentioned by subjects during the focus groups. Of the sensations included in the NPSI, "burning," "pins and needles," and "electric shocks" were most frequently mentioned by subjects in the focus groups. Subjects in China did not spontaneously mention three of the seven items (e.g., squeezing, pressure, and stabbing).
In addition to symptoms included on the NPSI, subjects also frequently mentioned "numbness" and "sharp" as sensations they experienced, although "sharp" was only mentioned in the U.S.
Patients in each country consistently described their pain with a single statement. Subjects in the U.S. used "burning," "electric shocks," and "sharp" while those in Spain used "electric shocks" or "sharp" only. Finnish and Japanese subjects also described their pain as "electric shocks," In addition, Japanese subjects used the term, "pins and needles."
The two most bothersome sensations in the U.S. were burning and electric shocks while the two most bothersome sensations in Brazil were cramps and pins and needles. The most bothersome sensations for Spanish subjects were either electric shocks or "stabbing pins on fire." Interestingly, subjects in China defined their worst pain by the emotions they felt or their inability to sleep in addition to the type and duration of the pain episode.
Review of the Neuropathic Pain Symptom Inventory questionnaire
The majority of the subjects did not raise any concerns with the NPSI: only three subjects mentioned that the recall period was too short, one subject felt that the questionnaire was confusing and another thought it did not capture all of their symptoms. Subjects responded positively when asked if the questionnaire was easy to understand, though one person reported that they did not know what was meant by "squeezing" pain. Next, subjects were asked which words (or kanji characters) they thought were above a sixth-grade reading level. The majority of subjects in other countries stated no concerns; however, words that some U.S. subjects thought were above a six-grade reading level included imaginable, neuropathic, provoke, severity, spontaneous, stimulation, and sensation. Although not thought to be above a six-grade reading level, Japanese subjects suggested that "pressure" was a concept that may be difficult to understand. However, no changes to the NPSI were consistently suggested by focus group subjects.
In China, four subjects felt that the questionnaire did not adequately reflect Chinese and/or Asian culture, and they suggested using a simplified NPSI. Because pain is not judged on a numerical scale, patients did not define their pain in such detail. Instead, subjects in China typically used descriptive terms ("mild," "moderate," or "severe") rather than numbers to quantify pain. However, five individuals felt that the NPSI was an acceptable tool, even if it incorporated a scale to measure pain.
The focus groups and interviews consisted of 2 phases: 1) concept elicitation, and 2) face and content validation. The information gathered from the focus groups in other countries (e.g., Japan, Brazil, China, Finland, and Spain) was consistent with that from group in the U.S. Descriptive terms for sensations of neuropathic pain were similar in all countries studied. Burning, electric shocks, and pins and needles were among the most-common sensations. Based on feedback from focus group subjects during the concept elicitation phase, all sensations included in the NPSI are indeed experienced by people with neuropathic pain. During the focus groups or individual interviews, subjects used the terms burning, electric shocks, and pins and needles.
Numbness was also consistently mentioned. Although "numbness" is not a true pain descriptor but is related to non-painful paresthesia/dysesthesia, the occurrence of numbness as a frequently reported sensation reflects the number of DPN subjects in the focus groups, as this sensation is typically experienced in DPN. Subjects also used the words numbness and pins and needles interchangeably to describing pain symptoms. Because pins and needles are already included in the NPSI, adding numbness should be considered when a DPN-specific questionnaire is required. Because numbness would not be a component of the validated scoring algorithm, this issue would be considered separately. Similarly, "itchiness" is not a true pain descriptor. In the validation of the NPSI , "itchiness" was found to be an unreliable item and therefore was removed. This study, unfortunately, was not designed to evaluate the "global" reliability of responses and therefore, we cannot recommend its inclusion at this time. The descriptor of "squeezing" was not consistently reported across cultures; however, "pressure" was reported more consistently. These two descriptors have been found to belong to the same pain dimension  – spontaneous ongoing pain, with similar factor loadings (0.88 and 0.87, respectively). It is therefore thought that these two descriptors will complementarily assess the spontaneous ongoing pain symptoms.
This study was not able to evaluate the differing etiology of pain in the analysis due to the separation of the participant's personal health information from the focus group transcripts. It is likely that subjects across different etiologies describe their pain slightly differently. It would have also been interesting to investigate the terminology utilized by subjects across cultures with the same etiology. As the objective of this study was to evaluate the adequacy of the NPSI for use in different neuropathic pain etiologies in different countries, the results support the broad objective. This is the first study to the knowledge of the authors to confirm such a "universality" of core neuropathic pain descriptors across etiologies and cultures. This study suggests that the small impact of culture on neuropathic pain expression may be related to its specific pathophysiologic mechanism; confirming the notion that neuropathic pain is a specific category of chronic pain that deserves special attention.
In conclusion, the information collected during the focus groups and their analyses demonstrate that the NPSI is an acceptable instrument for assessing neuropathic pain worldwide. Country-specific terms might further enhance its applicability.
Case Report Form
Diabetic Peripheral Neuropathy
Neuropathic Pain Symptom Inventory
Jensen TS, Gottrup H, Sindrup SH, Bach FW: The clinical picture of neuropathic pain. Eur J Pharmacol 2001, 429: 1–11. 10.1016/S0014-2999(01)01302-4
Hansson P: Neuropathic pain: clinical characteristics and diagnostic workup. Eur J Pain 2002, 6: 47–50. 10.1053/eujp.2001.0322
Merskey H, Bogduk N: Classification of Chronic Pain: Descriptions of Chronic Pain Syndromes and Definitions of Pain Terms. 2nd edition. Seattle: IASP Press; 1994.
Backonja M: Defining neuropathic pain. Anesth Analg 2003, 97: 785–790. 10.1213/01.ANE.0000062826.70846.8D
Cruccu G, Anand P, Attal N, Garcia-Larrea L, Haanpää M, Jørum E, Serra J, Jensen TS: EFNS guidelines on neuropathic pain assessment. Eur J Neurol 2004, 11: 153–162. 10.1111/j.1468-1331.2004.00791.x
Galer BS, Jensen MP: Development and preliminary validation of a pain measure specific to neuropathic pain: the Neuropathic Pain Scale. Neurology 1997, 48(2):332–338.
Krause SJ, Backonja MM: Development of a neuropathic pain questionnaire. Clin J Pain 2003, 19: 306–314. 10.1097/00002508-200309000-00004
Bouhassira D, Attal N, Fermanian J, Alchaar H, Gautron M, Masquelier E, Rostaing S, Lanteri-Minet M, Collin E, Grisart J, Boureau F: Development and validation of the Neuropathic Pain Symptom Inventory. Pain 2004, 108(3):248–257. 10.1016/j.pain.2003.12.024
Bastyr E, Price K, Bril V, the MBBQ Study Group: Development and validity testing of the neuropathy total symptom score-6: questionnaire for the study of sensory symptoms of diabetic peripheral neuropathy. Clinical Therapeutics 2005, 27(8):1278–94. 10.1016/j.clinthera.2005.08.002
US Department of Health and Human Services: Guidance for Industry Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. Food and Drug Administration 2006.
EMEA: Reflection Paper On The Regulatory Guidance For The Use Of Health Related Quality Of Life (HRQL): Measures In The Evaluation Of Medicinal Products. 2005.
Portenoy R: Development and testing of a neuropathic pain screening questionnaire: ID Pain. Curr Med Res Opin 2006, 22(8):1555–1565. 10.1185/030079906X115702
Charmaz K: Constructing Grounded Theory: A Practical Guide through Qualitative Analysis. Thousand Oaks, CA: SAGE Pu; 2006.
This research study was funded by Pfizer, Inc., New York, New York. The authors would like to thank Crystal Tellefsen, Jonathan Stokes and Kristina Fitzgerald for their assistance in the data collection and analysis process.
BC and AW are employees of Mapi Values, an outcomes research consulting firm. ED is an employee of Pfizer Inc. DB has received funding for research and speaking engagements from numerous pharmaceutical companies. There are no other competing interests.
BC and ED were responsible for the design and execution of this study. AW was the primary analyst. DB assisted in the interpretation of the results. All co-authors assisted in drafting the manuscript.
Bruce Crawford, Didier Bouhassira, Audrey Wong and Ellen Dukes contributed equally to this work.
About this article
Cite this article
Crawford, B., Bouhassira, D., Wong, A. et al. Conceptual adequacy of the neuropathic pain symptom inventory in six countries. Health Qual Life Outcomes 6, 62 (2008). https://doi.org/10.1186/1477-7525-6-62