Skip to main content
Download PDF
Download ePub

Validation of the generic medical interview satisfaction scale: the G-MISS questionnaire

Health and Quality of Life Outcomes volume 15, Article number: 36 (2017) Cite this article

Abstract

Background

Patients have about seven medical consultations a year. Despite the importance of medical interviews in the healthcare process, there is no generic instrument to assess patients’ experiences in general practices, medical specialties, and surgical specialties. The main objective was to validate a questionnaire assessing patients’ experiences with medical consultations in various practices.

Method

The G-MISS study was a prospective multi-center trial that enrolled patients from May to July 2016. A total of 2055 patients were included from general practices, medical specialties, and surgical specialties. Patients filled out a questionnaire assessing various aspects of their experience and satisfaction within 1 week after their medical interview. The validation process relied on item response theory. Internal validity was examined using exploratory factorial analysis. The statistical model used the root mean square error of approximation, confirmatory fit index, and standard root mean square residual as fit indices. Scalability and reliability were assessed with the Rasch model and Cronbach’s alpha coefficients, respectively. Scale properties across the three subgroups were explored with differential item functioning.

Results

The G-MISS final questionnaire contained 16 items, structured in three dimensions of patients’ experiences: “Relief”, “Communication”, and “Compliance”. A global index of patients’ experiences was computed as the mean of the dimension scores. All fit indices from the statistical model were satisfactory (RMSEA = 0.03, CFI = 0.98, SRMR = 0.06). The overall scalability had a good fit to the Rasch model. Each dimension was reliable, with Cronbach’s alpha ranging from 0.73 to 0.86. Differential item functioning across the three consultation settings was negligible. Patients undergoing medical or surgical specialties reported higher scores in the “Relief” dimension compared with general practice (83.0 ± 11.6 or 82.4 ± 11.6 vs. 73.2 ± 16.7; P < .001). A consultation shorter than 5 min correlated with low patient satisfaction in “Relief” and “Communication” and in the global index, P < .001.

Conclusions

The G-MISS questionnaire is a valid and reliable questionnaire for assessing patients’ experiences after consultations with general practitioners, medical specialists, and surgical specialists. The multidimensional structure relies on item response theory and assesses different aspects of patients’ experiences that could be useful in clinical practice and research settings.

Background

A patient has about seven doctors’ consultations per year [1]. Physicians are getting more involved in the quality assessment of daily practice [2], but few questionnaires have been validated to assess patients’ experiences with medical interviews [3, 4]. Patient-reported outcomes are considered valuable measures of healthcare and a step in the development of patient-centered care [5]. The assessment of patients’ experiences could enhance comparisons of strategies about physicians’ communication [6], treatment [7], or accountable care [8]. Available questionnaires in the field are not psychometrically sound [9], rely on expert generated items [3], and focus on specific physicians’ specialties [10] or specific patient courses [11, 12]. The Medical Interview Satisfaction Scale (MISS) was developed to assess patients’ experiences with interviews in primary care [4]. The authors used a rigorous method for item generation with patient interviews, but the factorial structure relied on the classical test theory (CTT) used at the time of questionnaire development [13]. Despite its predicted use in general practice, the original questionnaire tended to be a reference for the evaluation of patient-centered consultations [14,15,16]. Some questions were raised about the internal validity and acceptability of its 29 item form [17], and other authors suggested the factorial structure may differ across populations, stressing the need for a new validation process [18].

The main objective of the Generic Medical Interview Satisfaction Scale (G-MISS) study was to validate a generic version of the MISS questionnaire in general practice, medical specialties, and surgical specialties. The secondary objectives were to reduce the number of items and to explore the determinants of experience and satisfaction across patient groups, medical conditions, and consultation settings. The null hypothesis, defined as the lack of difference with the original questionnaire structure, was ruled out using Item Response Theory (IRT) with exploratory factorial analysis to assess patients’ experiences and satisfaction.

Methods

Patients

The protocol and statistical plan were approved by the Cerar ethical committee, Paris, France, ref. IRB 00010254-2016-023. The requirements of the Declaration of Tokyo were respected, and there was no interference in the physician-patient relationship.

All physicians, registered on the online health insurance server in the city of Marseille, France, were invited to participate in the study. Two thousand seventy-two physicians from various medical specialties were asked to enroll patients between May 2016 and July 2016. All consecutive adult patients undergoing medical consultations and able to complete a self-reported questionnaire were eligible. Non-inclusion criteria were the inability to fill an electronic form, cognitive impairment, and hospitalized patients.

Protocol and data collection

All patients received written information at the time of online registration. Patient consent was obtained by electronic signature and stored in the server. Various specialties were represented including general practice, anesthesia, cardiology, dermatology, gynecology, gastroenterology, neurology, pulmonology, rheumatology, and the following surgeries: neurosurgery, cardiac, thoracic, maxillofacial, ear-nose-throat (ENT), orthopedic, plastic, urologic, vascular, visceral, and ophthalmologic. Physicians who actively participated in the study recruited the patients by giving them a single connection voucher.

Patients were asked to fill out an electronic form about their individual experience within 1 week after their consultation with the physician. There was no accompaniment of the patient in the formulation of the answers.

In accordance with the principle of the self-reported questionnaire, patients have to complete the form on their own, so that their answers reflected only their feelings about consultation. An introductory sentence mentioned that there was no right or wrong answer and that the questionnaire was anonymous and their responses confidential.

The questionnaire relied upon the original MISS-29, which contained 29 items structured in four dimensions named after their content: “Distress Relief” (11 items), “Communication comfort” (4 items), “Rapport” (10 items), and “Compliance intent” (4 items). The 29 items of the Medical Interview Satisfaction Scale were generated after interviews with patients, according to guidelines about item generation (see Appendix) [13]. Demographics were gathered along with sociocultural and medical condition data.

All personal information was anonymized before being sent to the server, according to the recommendations of the French national commission on information technology and human rights [19].

Questionnaire reduction and validation

The questionnaire consisted of items structured into dimensions exploring the various aspects of patients’ experiences and satisfaction with medical consultations across three subgroups of physicians in general practice, medical specialties, and surgical specialties.

Item selection

We used the MISS-29 as an item bank to build the new questionnaire. A forward-backward translation was performed. A native English translator produced the first draft according to the original items. A bilingual expert back translated items to perform the cross-validation of the French version.

Items were considered for deletion if they loaded on two or more factors, or had a correlation of less than 0.40 with their own dimension according to the exploratory factorial analysis. Item deletion also relied on other standard criteria including inter-item correlation (lower than 0.40, or higher than 0.80), floor and ceiling effects (respectively higher than 15 and 40%) or low response rate (higher than 20% missing data). After the questionnaire’s multidimensional structure was identified, any item that, when deleted, would lead to a 0.02 increase in Cronbach’s alpha coefficient was removed.

Internal validity

An exploratory principal component factor analysis with varimax rotation [20] was performed along with inter-item, item-dimension, and inter-dimension correlations (Pearson r), to identify the questionnaire’s multidimensional structure. Each item was correlated with its own dimension and with the others.

If an item correlated higher (>0.4 after overlap correction) with its attendant dimension than with the others, the item internal consistency was supported, confirming its discriminant validity [21]. The internal consistency reliability of each potential dimension was assessed by Cronbach’s alpha coefficient with a threshold of 0.7 expected [22]. We used the polytomous Rasch model from IRT to explore the unidimensionality of the scale. This model assessed the ability of items to measure a “trait” or dimension of the scale. The Partial Credit Model, using threshold and discrimination parameters, was applied as an extension of the Rasch model [23, 24]. Each dimension’s scalability was explored by the pattern of item goodness-of-fit statistics (ranging from 0.5 to 1.5), ensuring that items belonging to the same dimension measured the same trait or concept [25].

Differential item functioning

We explored the differential item functioning (DIF) to assess the questionnaire properties across three settings of consultation, i.e. general practice, medical specialties, and surgical specialties. The DIF analysis sought to determine whether items and dimensions varied in their performance to assess patient satisfaction in these subgroups.

An increase in DIF would mean that the evaluated item functioned differently in the subgroup. The uniform DIF was calculated to determine the probability of giving a specific answer at a given level of satisfaction across physicians’ specialties.

The DIF was detected and the magnitude of the effect was quantified using the Crane and Larson model [26]. A significant DIF reports an increase in the explained variance of a given item when the subgroup’s variable is included, i.e. physicians’ specialties.

In case of statistical significance, Zumbo’s DIF classification was used to assess the DIF magnitude by computing delta R2. The DIF magnitude was considered negligible if delta R2 was <0.13, moderate if between 0.13 and 0.25, and large if >0.25.

External validity and acceptability

The original version of the MISS questionnaire reported correlation with occupational level [4]. Accordingly, we explored the external validity of the G-MISS across various groups of employment type. The G-MISS discriminant validity was further explored by comparisons between dimension scores and demographics, sociocultural levels, or medical conditions of patients using analysis of variance, Mann-Whitney U-test, and Pearson’s correlation. The online form of the questionnaire allowed the patient to skip any item without responding. The rate of missing data was assessed as an objective measure of acceptability [20].

Records showing fewer than 80% response rates were excluded from the validation analysis to ensure the quality of data.

Scoring

Items were answered using a five-point Likert scale, defined from 1 to 5 as “strongly disagree,” “disagree,” “neutral,” “agree,” and “strongly agree.” A dimension score was obtained by computing the mean of item scores for the dimension.

If less than one half of the items of a given dimension were missing, the mean of the non-missing items was substituted for scoring the dimension. Each dimension score was linearly transformed into a 0–100 scale with 0 indicating the worst level of satisfaction and 100 the best.

The global index was calculated as the mean of dimension scores. Dimensions were non-weighted, each was equal to the others for the computing the mean global index. Negatively phrased items were reversed when scored, so that higher scored items represented higher satisfaction (items 1, 5, 11, 15, 16, 18, 22, 24, 28, and 29) (see Appendix).

Results

A total of 2055 patients were included in the study between May 2016 and July 2016 (see Fig. 2 Flow diagram). The baseline characteristics of the patients and types of consultations appear in Table 1. The psychometric validation resulted in a final version comprising 16 items structured into three dimensions, depending on their content: Relief (eight items), Communication (six items), Compliance (two items), Table 2. This short form explained 54.5% of the total variance.

Table 1 Patient’s characteristics and type of consultations (n = 1822)
Full size table
Table 2 Principal Component Analysis (Varimax rotation) and DIF of the G-MISS
Full size table

Sample characteristics

Patients enrolled in the validation process were consulted at various medical and surgical specialties n = 1822 (Table 1). The mean patient age was 37.1 ± 14.7 years and 451 consultations were made in an emergency setting (25%). Five hundred ninety-eight patients (33%) reported a long course treatment and 378 had been hospitalized in the last 6 months (21%). This was the first consultation in 6 months for 283 patients (16%). Four hundred and ten patients were unemployed at the time of the consultation (22%) (Table 1).

Internal validity

The G-MISS final version contained 16 items structured in a three-factor questionnaire determined by exploratory factor analysis (Fig. 1). Thirteen items were suppressed according to their load factor and retained suppression criteria. The three dimensions were named after their item content, according to the original version of the MISS-29 questionnaire: “Relief” (eight items), “Communication” (six items), and “Compliance” (two items). The “Rapport” dimension from the original MISS-29 was removed and its remaining items were merged into the “Communication” dimension according to the exploratory factorial analysis. All the fit indices from the statistical model were satisfactory (RMSEA = 0.03, CFI = 0.98, SRMR = 0.06). The overall scalability was good, with items showing a good fit to the Rasch model in each dimension. Item internal consistency (IIC) was satisfactory for all dimensions; each item achieved the 0.40 standard threshold for IIC (ranging from 0.45 to 0.77, Table 3). The correlation of each item with its contributive dimension was higher than those with other dimensions (item discriminant validity, IDV). Cronbach’s alpha coefficients ranged from 0.73 to 0.86, indicating satisfactory reliability for each dimension.

Fig. 1
figure 1

Number of component scree plot of the 16-items G-MISS

Full size image
Table 3 Internal validity
Full size table

Floor effects ranged from 0.3 to 13.2%, and ceiling effects ranged from 18.2 to 36.9% (data not shown). Patients who finished the questionnaire responded to all items. The rate of missing values was low (see Applicability). According to the definition of DIF, six items (q8, q11, q19, q25, q26, q28) showed a statistically significant difference in their behavior according to the consultation specialty, but the magnitude of the DIF was negligible for each (Table 2).

External validity

The educational level and type of employment correlated with the “Communication” dimension and with the global index of the G-MISS. The type of employment also correlated with the “Relief” dimension.

Patients consulted by medical and surgical specialties showed higher satisfaction scores in the “Relief” dimension than those that attended general practices (83.0 ± 11.6 and 82.4 ± 11.6 vs. 73.2 ± 16.7, respectively; P < .001), but the most relevant discrepancies were reported for the global index (80.5 ± 9.9, 79.2 ± 10.4 vs. 74.1 ± 12.1, respectively; P < .001, Table 4). There were not differences in the “Compliance” dimension between physician specialties. There was no difference in terms of age, sex, or body mass index (BMI). Smoker patients showed lower satisfaction scores in the “Communication” and “Compliance” dimensions, and in the global index. Consultations shorter than 5 min correlated highly with low patient satisfaction in the “Relief” and “Communication” dimensions, and in the global index, P < .001. The “Compliance” dimension was not correlated with the duration of consultations (Table 4). The emergency context correlated with the “Relief” dimension and global index. There was a linear association between the number of consultations in the last 6 months and the level of satisfaction in the “Relief” dimension, P = .001.

Table 4 Comparisons of G-MISS scores according to patient’s characteristics and type of consultations (n = 1822)
Full size table

Hospitalization in the last 6 months was associated with a higher level of satisfaction in the “Relief” dimension (P = .005). A long course of treatment was not correlated with overall satisfaction scores on the G-MISS.

Applicability

Seventy-eight patients declined to participate after being screened (3.8%). One hundred and seven patients showed a rate of missing values >20% (5.2%). The percentage of missing values increased along with the progression of the questionnaire. Patients with a rate of missing values >20% did not respond to any items from number 15 (data not shown). Forty-five patients (2.2%) were excluded because they took more than 1 h to fill out the 29 item questionnaire (see Fig. 2 Flow diagram). The mean filing duration for the 16 items of the G-MISS was 6 min and 49 s, [±2 min, 41 s], vs. 12 min, 23 s [±5 min, 13 s] for the original set of 29 items, P < .001.

Fig. 2
figure 2

Flow Diagram of the G-MISS Study

Full size image

Discussion

Patient-reported outcome evaluations have become mandatory [27, 28]. Most regulatory authorities in Organisation for Economic Co-operation and Development (OECD) have included such outcomes in their quality assessment framework. In the United States, the Primary Care Assessment Survey (PCAS) was initially developed to measure the quality of service in seven domains of primary care through 11 scales [29] and was further developed and tested to assess performance [30]. The Consumer Assessment of Healthcare Providers & Systems (CAHPS) is used in the hospital setting to discriminate between strategies in Medicare Accountable Care Organizations [8].

In Europe, the UK’s Quality of Outcomes Framework was introduced in 2004 [31]. The General Practice Assessment Questionnaire (GPAQ) was derived from the original PCAS [32,33,34] and its psychometrical properties were retrospectively tested [35]. The GPAQ is used by the UK department of Public Health and Primary Care as a survey for general practitioners’ revalidations and practices [36]. These tools are oriented toward quality of service and performance assessments, but there is no generic tools forecasted to the evaluation of patient experience itself in various practice. However, patient satisfaction could be misleading if evaluated with tools that are validated to assess quality of service or inherited from the consumer field [5]. Taking into account patient expectations should help physicians with patient interactions and shared decision-making [37, 38].

In our study, the null hypothesis was rejected according to the differences that emerged between the original MISS-29 structure and that of the G-MISS short form reported here. The MISS-29 was specifically developed to assess patients’ experiences and expectations about physician consultations. The item generation relied on patient interviews to assess the cognitive, affective, and behavioral dimensions of patient-physician interactions [4]. The original set of items demonstrated good wording and comprehension compared with the Consultation Satisfaction Questionnaire [3]. The 29 item form was criticized for its acceptability, with a mean filling time of 12 min. This encouraged some authors to develop a short form of the MISS-29, for use only in general practice [17].

The purpose of the present study was to develop a questionnaire suitable for most consultation settings, by using IRT to select items and structure them into dimensions of experience.

One particular advantage of IRT over CTT is its independence in regard to the population being tested. The G-MISS final version is a self-reported questionnaire of 16 items structured into three dimensions of patients’ experiences and satisfaction with doctors’ consultations. One strength of the questionnaire is its large validation sample of 1822 patients, who were consulted in various general practices as well as medical and surgical specialties. The process of selection deleted items with equivocal loading into the factorial structure. There was no item switch from a dimension to another. The items belonging to the original “Rapport” and “Communication comfort” dimensions were merged into a single dimension, “Communication”, after the exploratory factorial analysis. The G-MISS questionnaire reported high levels of internal validity across its three dimensions, confirming that patients’ experiences are a multidimensional concept. Accordingly, the reliability indices of the three dimensions were satisfactory.

No notable differential item functioning was reported, ensuring that the questionnaire is equally reliable in every setting of consultation it was forecasted for, i.e. general practice, medical specialties and surgical specialties. The three-dimensional structure assesses different aspects of patients’ experiences. The G-MISS dimensions were named after the original MISS-29 questionnaire [13].

The “Relief” dimension assesses the alleviation of illness-related stress. It has been reported that patients experiencing symptoms of chronic or acute conditions worry about the potential impact of their disease on their life [39]. By relieving stress, physicians could improve health status and well-being [40]. The “Communication” dimension assesses the communication comfort between the patient and doctor.

It has been previously reported that patients consider communication to be one of the most important physician skills [41], but even if technically sound, the physician’s communication may appear inappropriate to the patient [42]. A recent systematic review stressed the lack of tools to assess physician’s communication [43]. The “Compliance” dimension reports the patient’s intent to follow doctor’s recommendations. It is well known that medical consultation influences patient compliance; [44] for example, specific attention should be given to verbal interactions, especially in long-term treatments like blood pressure control programs [45].

The items from the “Compliance” dimension were below the usual range of acceptance for the Infit in the general practice population [25]. One could hypothesize that there is an overlap between compliance and communication or relief, because of an indirect connection between these dimensions. A systematic review pointed out the link between physician-patient communication and outcomes in primary care [43].

The level of explanation given by the physician has been correlated with patient compliance [45] and could have influenced the “Compliance” and “Relief” or “Communication” dimensions assessed by the G-MISS scale. In contrast, unadapted behavior from a physician demonstrating nervousness or anger has been associated with less compliance from the patient and could also influence several dimensions of the patient’s experience [46]. The level of Infit was satisfactory in the global population, medical specialties, and surgical specialties, for all dimensions.

The level of satisfaction in the “Relief” dimension was significantly lower in general practice than medical or surgical specialties.

Some patients may not feel sufficiently reassured by their general practitioner’s explanations and need a referral to a specialist [39]. Specialists could be more likely to use situation-specific reassurance strategies while standard communication skills tend to stay generic [47]. These “Relief” dimension findings translated into the results for the global index with specialists’ interviews reporting higher satisfaction scores. Lack of practitioner’s time is classically reported as a cause of dissatisfaction for patients [48].

Although the perceived consultation duration has been associated with better patient satisfaction, the actual length of consultation has produced controversial results [49, 50]. One could hypothesize that the use of non-validated questionnaires may have explained the lack of difference [51]. In our study, interviews that lasted less than 5 min were significantly correlated with lower satisfaction scores in the “Relief” and “Communication” dimensions and global index. The G-MISS correlated with patients’ type of employment which is concordant with the original questionnaire. The external validity of the G-MISS scale was further emphasized by correlations with the emergency context, the educational level and the number of consultations in the last 6 months.

Among patients with a rate of missing values >20%, the number of responded items dramatically fell from item 15 to 29. This reinforces the interest for a short-form to improve the applicability of an everyday practice questionnaire. The final version of the G-MISS questionnaire is 16 items long and took about 6 min to complete. Despite this short form, the G-MISS questionnaire still explained 54.5% of the total variance.

The level of education wasn’t correlated with the rate of missing answers, suggesting that the questionnaire is widely administrable to patients able to read and complete an online survey. Application abilities in various medical fields of primary care underline the interest for the questionnaire in a patient-centered care approach.

Conclusion

The G-MISS questionnaire is a valid and reliable short-form questionnaire to assess patients’ experiences and satisfaction with physician consultations in general practices, medical specialties, and surgical specialties. The multidimensional structure relies on IRT and assesses different aspects of patients’ experiences that could be useful in clinical practice and research settings.

Abbreviations

BMI:

Body mass index

CAHPS:

Consumer Assessment of Healthcare Providers & Systems

CTT:

Classical test theory

DIF:

Differential Item Functionning

ENT:

Ear Nose Throat

G-MISS:

Generic Medical Interview Satisfaction Scale

GPAQ:

General Practice Assessment Questionnaire

IDV:

Item discriminant validity

IIC:

Item internal consistency

IRT:

Item Response Theory

MISS:

Medical Interview Satisfaction Scale

OECD:

Organisation for Economics Co-operation an Development

PCAS:

Primary Care Assessment Survey

References

  1. OECD Health statistics. 2016. http://stats.oecd.org/index.aspx?DataSetCode=HEALTH_STAT. Accessed 21 Jan 2017.

  2. Landon BE. Use of quality indicators in patient care: a senior primary care physician trying to take good care of his patients. JAMA. 2012;307:956–64.

    Article  CAS  PubMed  Google Scholar 

  3. Baker R. Development of a questionnaire to assess patients’ satisfaction with consultations in general practice. Br J Gen Pract. 1990;40:487–90.

    CAS  PubMed  PubMed Central  Google Scholar 

  4. Wolf MH, Putnam SM, James SA, Stiles WB. The Medical Interview Satisfaction Scale: development of a scale to measure patient perceptions of physician behavior. J Behav Med. 1978;1:391–401.

    Article  CAS  PubMed  Google Scholar 

  5. Kupfer JM, Bond EU. Patient satisfaction and patient-centered care: necessary but not equal. JAMA. 2012;308:139–40.

    Article  CAS  PubMed  Google Scholar 

  6. Hagihara A, Tarumi K. Doctor and patient perceptions of the level of doctor explanation and quality of patient-doctor communication. Scand J Caring Sci. 2006;20:143–50.

    Article  PubMed  Google Scholar 

  7. Welschen I, Kuyvenhoven M, Hoes A, Verheij T. Antibiotics for acute respiratory tract symptoms: patients’ expectations, GPs’ management and patient satisfaction. Fam Pract. 2004;21:234–7.

    Article  PubMed  Google Scholar 

  8. McWilliams JM, Landon BE, Chernew ME, Zaslavsky AM. Changes in patients’ experiences in Medicare Accountable Care Organizations. N Engl J Med. 2014;371:1715–24.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Grol R, et al. Patients in Europe evaluate general practice care: an international comparison. Br J Gen Pract. 2000;50:882–7.

    CAS  PubMed  PubMed Central  Google Scholar 

  10. Steine S, Finset A, Laerum E. A new, brief questionnaire (PEQ) developed in primary health care for measuring patients’ experience of interaction, emotion and consultation outcome. Fam Pract. 2001;18:410–8.

    Article  CAS  PubMed  Google Scholar 

  11. Garratt AM, Danielsen K, Hunskaar S. Patient satisfaction questionnaires for primary care out-of-hours services: a systematic review. Br J Gen Pract. 2007;57:741–7.

    PubMed  PubMed Central  Google Scholar 

  12. Regnault A, Viala-Danten M, Gilet H, Berdeaux G. Scoring and psychometric properties of the Eye-Drop Satisfaction Questionnaire (EDSQ), an instrument to assess satisfaction and compliance with glaucoma treatment. BMC Ophthalmol. 2010;10:1.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Wolf MH, Stiles WB. Further development of the medical interview satisfaction scale. Los Angeles: American Psychological Association Convention; 1981.

    Google Scholar 

  14. Wilkin D, Hallam L, Doggett M. Measures of Need and Outcome for Primary Health Care. 1992. p. 252–6.

    Google Scholar 

  15. Mead N, Bower P. Patient-centred consultations and outcomes in primary care: a review of the literature. Patient Educ Couns. 2002;48:51–61.

    Article  PubMed  Google Scholar 

  16. Little P, et al. Randomised controlled trial of effect of leaflets to empower patients in consultations in primary care. BMJ. 2004;328:441.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Meakin R, Weinman J. The ‘Medical Interview Satisfaction Scale’ (MISS-21) adapted for British general practice. Fam Pract. 2002;19:257–63.

    Article  PubMed  Google Scholar 

  18. Kinnersley P, Stott N, Peters T, Harvey I, Hackett P. A comparison of methods for measuring patient satisfaction with consultations in primary care. Fam Pract. 1996;13:41–51.

    Article  CAS  PubMed  Google Scholar 

  19. CNIL ACT n°2007-043 du 8 mars 2007. https://www.legifrance.gouv.fr/affichCnil.do?id=CNILTEXT000017652082. Accessed 2 Feb 2017.

  20. Nunnaly, Bernstein. Psychometric theory. 3rd ed. 1994.

    Google Scholar 

  21. Juniper E, Guyatt G, Jaeschke R. How to develop and validate a new health-related quality of life instrument. In: Spiker B (ed) Quality of Life and Pharmacoeconomics in Clinical Trials 2nd edn. Philadelphia: Lippincott-Raven Publishers; 1996. p. 49–56.

  22. CRONBACH LJ, WARRINGTON WG. Time-limit tests: estimating their reliability and degree of speeding. Psychometrika. 1951;16:167–88.

    Article  CAS  PubMed  Google Scholar 

  23. Andrich D. A rating formulation for ordered response categories. Psychometrika. 1978;43:561–73.

    Article  Google Scholar 

  24. Rasch G. Probabilistic models for some intelligence and attainment tests. Chicago: Mesa Press; 1993.

  25. Wright B, Linacre J, Wright BD, Linacre JM. Reasonable mean-square fit values. Rasch Meas Trans. 1994;8(3):370.

    Google Scholar 

  26. Crane PK, van Belle G, Larson EB. Test bias in a cognitive test: differential item functioning in the CASI. Stat Med. 2004;23:241–56.

    Article  PubMed  Google Scholar 

  27. The Joint Commission to include patient satisfaction data on quality check. Jt Comm Perspect. 2009;29:1.

  28. Black N. Patient reported outcome measures could help transform healthcare. BMJ. 2013;346:f167.

    Article  PubMed  Google Scholar 

  29. Safran DG, et al. The Primary Care Assessment Survey: tests of data quality and measurement performance. Med Care. 1998;36:728–39.

    Article  CAS  PubMed  Google Scholar 

  30. Safran DG, et al. Linking primary care performance to outcomes of care. J Fam Pract. 1998;47:213–20.

    CAS  PubMed  Google Scholar 

  31. Roland M. Linking physicians’ pay to the quality of care—a major experiment in the United kingdom. N Engl J Med. 2004;351:1448–54.

    Article  CAS  PubMed  Google Scholar 

  32. General Practice Assessment Survey (GPAS) Manual. National Primary Care Research and Development Centre; 1999.

  33. Ramsay J, Campbell JL, Schroter S, Green J, Roland M. The General Practice Assessment Survey (GPAS): tests of data quality and measurement properties. Fam Pract. 2000;17(5):372–9.

  34. Bower P, Mead N, Roland M. What dimensions underlie patient responses to the General Practice Assessment Survey? A factor analytic study. Fam Pract. 2002;19:489–95.

    Article  PubMed  Google Scholar 

  35. Mead N, Bower P, Roland M. The General Practice Assessment Questionnaire (GPAQ)–development and psychometric characteristics. BMC Fam Pract. 2008;9:13.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Royal College of General Practitioners. Review of Colleague and Patient Survey Instruments. http://www.rcgp.org.uk/training-exams/revalidation.aspx. Accessed 2 Feb 2017.

  37. Britten N. Patients’ expectations of consultations. BMJ. 2004;328:416–7.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Kon AA. The shared decision-making continuum. JAMA. 2010;304:903–4.

    Article  CAS  PubMed  Google Scholar 

  39. Giroldi E, et al. ‘Doctor, please tell me it’s nothing serious’: an exploration of patients’ worrying and reassuring cognitions using stimulated recall interviews. BMC Fam Pract. 2014;15:73.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Fassaert T, van Dulmen S, Schellevis F, van der Jagt L, Bensing J. Raising positive expectations helps patients with minor ailments: a cross-sectional study. BMC Fam Pract. 2008;9:38.

    Article  PubMed  PubMed Central  Google Scholar 

  41. McBride CA, et al. The physician’s role. Views of the public and the profession on seven aspects of patient care. Arch Fam Med. 1994;3:948–53.

    Article  CAS  PubMed  Google Scholar 

  42. Marvel MK, Epstein RM, Flowers K, Beckman HB. Soliciting the patient’s agenda: have we improved? JAMA. 1999;281:283–7.

    Article  CAS  PubMed  Google Scholar 

  43. Beck RS, Daughtridge R, Sloane PD. Physician-patient communication in the primary care office: a systematic review. J Am Board Fam Pract. 2002;15:25–38.

    PubMed  Google Scholar 

  44. Davis MS. Variations in patients’ compliance with doctors’ advice: an empirical analysis of patterns o communication. Am J Public Health Nations Health. 1968;58:274–88.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  45. Orth JE, Stiles WB, Scherwitz L, Hennrikus D, Vallbona C. Patient exposition and provider explanation in routine interviews and hypertensive patients’ blood pressure control. Health Psychol. 1987;6:29–42.

    Article  CAS  PubMed  Google Scholar 

  46. Stewart MA. Effective physician-patient communication and health outcomes: a review. CMAJ. 1995;152:1423–33.

    CAS  PubMed  PubMed Central  Google Scholar 

  47. Veldhuijzen W, Ram PM, van der Weijden T, Niemantsverdriet S, van der Vleuten CPM. Characteristics of communication guidelines that facilitate or impede guideline use: a focus group study. BMC Fam Pract. 2007;8:31.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Williams SJ, Calnan M. Key determinants of consumer satisfaction with general practice. Fam Pract. 1991;8:237–42.

    Article  CAS  PubMed  Google Scholar 

  49. Cape J. Consultation length, patient-estimated consultation length, and satisfaction with the consultation. Br J Gen Pract. 2002;52:1004–6.

    PubMed  PubMed Central  Google Scholar 

  50. Wilson AD, Childs S, Goncalves-Bradley DC, Irving GJ. Interventions to increase or decrease the length of primary care physicians’ consultation. Cochrane Database Syst Rev. 2016;CD003540. doi:10.1002/14651858.CD003540.pub3

  51. Eide TB, et al. Patient experiences and the association with organizational factors in general practice: results from the Norwegian part of the international, multi-centre, cross-sectional QUALICOPC study. BMC Health Serv Res. 2016;16:428.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors acknowledge Nicolas Tajan to have built the internet site, created the database server and extracted the data.

Funding

The prospective multicenter G-MISS study was funded by the public health laboratory of Marseille’s medical faculty, France.

Availability of data and materials

The whole database, raw data and material of the G-MISS study are freely available to any scientist wishing to use them.

Authors’ contributions

AMS conceived and designed the study, obtained the ethical committee approval, carried out the study coordination, performed the statistical analysis and drafted the manuscript. PM performed the statistical analysis for differential item functioning and reviewed the manuscript. AL formatted the database and performed item response theory statistical analysis. PA participated in the design of the study and helped to draft the manuscript. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

All patients gave express consent for the publication of the results of the G-MISS study.

Ethics approval and consent to participate

The protocol and statistical plan were approved by the Cerar ethical committee, Paris, France, ref. IRB 00010254-2016-023. The requirements of the Declaration of Tokyo were respected, and there was no interference in the physician-patient relationship. All patients gave informed consent to participate to the study.

Author information

Authors and Affiliations

  1. Laboratoire Universitaire EA 3279, Santé Publique et Maladies Chroniques, 27 boulevard Jean Moulin, Marseille, 13005, France

    Axel Maurice-Szamburski, Pierre Michel & Pascal Auquier

  2. Unité d’aide méthodologique, Direction de la Recherche Clinique, AP-HM, Marseille, France

    Anderson Loundou

Authors
  1. Axel Maurice-Szamburski
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pierre Michel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anderson Loundou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pascal Auquier
    View author publications

    You can also search for this author in PubMed Google Scholar

Consortia

For the G-MISS Study Investigators

Corresponding author

Correspondence to Axel Maurice-Szamburski.

Appendix

Appendix

Table 5 MISS-29 original and translated questionnaire
Full size table

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Maurice-Szamburski, A., Michel, P., Loundou, A. et al. Validation of the generic medical interview satisfaction scale: the G-MISS questionnaire. Health Qual Life Outcomes 15, 36 (2017). https://doi.org/10.1186/s12955-017-0608-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-017-0608-x

Keywords

Health and Quality of Life Outcomes

ISSN: 1477-7525

Contact us