With the emergence of a strong health consumer movement1,2 and an emphasis on quality improvement programs around the world,3 the patient’s perspective on the quality of health care has become a central driver of health care reform. In developed countries, patients are increasingly seen as well placed to make judgements about health care services.4 As a consequence, surveying patients about their experience of care is becoming a routine part of assessing the quality of hospital care and primary health care.5-9
Greater patient satisfaction with health care is associated with improved compliance, continuity of care and clinical outcomes.10 The General Practice Assessment Questionnaire (GPAQ), designed for use in general practice, assesses patient satisfaction with aspects of care. Although it has been extensively used and validated in studies in the United Kingdom,11-14 it has not been used on a large sample of general practice patients in Australia.
As part of a large longitudinal study called the Diagnosis, Management and Outcomes of Depression in Primary Care (diamond) study,15 we included the GPAQ in a mail-out screening survey of patients attending general practices in Victoria. To our knowledge, ours is the first Australian study to report patient satisfaction using the GPAQ.
The GPAQ was chosen because it is brief, was developed in a health system similar to that of Australia, has been shown to be acceptable to a broad cross-section of patients, and has high reliability and validity.13 We report patient responses to the GPAQ and explore patient characteristics associated with satisfaction on the six GPAQ scales.
To identify patients eligible for the diamond longitudinal study, 17 780 patients from 30 general practices in Victoria were sent a screening survey. A full description of the methods and sample size calculations are detailed elsewhere.15 Our article is based on the responses of patients who completed the screening survey. We did not conduct a power calculation for this article, as we provide 95% confidence intervals to summarise the precision of the estimates.
Thirty GPs were recruited from a randomly selected list of 200 GPs provided by the Health Insurance Commission.15 The Commission routinely uses “modified synchronised sampling” to select GPs for different research studies, taking into account the number of times a GP has already been sampled.16 GPs were sent an information package and an expression of interest fax-back form. GPs who did not return the fax-back form received a follow-up telephone call. GPs were eligible to participate if they had seen at least 600 patients aged 18–75 years in the previous year; were able to generate a computerised list of patients’ details; agreed to complete a survey; and were the only GP in their practice to take part in the study.
Patient records were searched to identify all patients aged 18–75 years who had seen the study GP in the previous year. Each GP examined the list of patients and excluded those who could not read English, were terminally ill, or resided in a nursing home.
Between January and December 2005, random samples of about 600 eligible patients from each general practice were mailed a screening survey with a covering letter from the GP. To maximise the response rate, a reminder letter was sent 2 weeks later to all patients. We collected de-identified information on the sex and age of all patients who were sent a survey.
In the screening survey, patients were asked about demographic details, their visits to GPs and other health professionals, their “usual GP”, and their overall health and wellbeing. The postal version of the GPAQ (Version 1.0) was also included in the survey.17 The GPAQ has six main scales (items), which relate to satisfaction with:
receptionists (1 question);
access to practice (11 questions);
continuity of care (2 questions);
communication (8 questions);
practice nurses (3 questions); and
the practice overall (1 question).
Patients indicated their level of satisfaction with each item, based on five-, six- or seven-point Likert scales. GPAQ item scores were expressed as a score between 0 and 100, with higher scores representing greater satisfaction.17 Patients were divided into 10-year age groups to match age-group categories used by the Australian Bureau of Statistics. The youngest and oldest age groups were truncated to ≥ 18 and ≤ 75 years, respectively, in accordance with our eligibility criteria.
Outcome measures were the six GPAQ item scores.17 Data were summarised using means and standard deviations for continuous data (outcomes), and frequencies and percentages for categorical data (GP and participant characteristics). Our analysis excluded responses from patients who indicated that the study GP was not their usual GP. Satisfaction with nursing care was reported only for patients from practices with a practice nurse.
A mixed effects linear regression model, fitted using restricted maximum likelihood estimation and treating GP practice as a random effect, was used to calculate 95% confidence intervals for the means and to estimate the intracluster correlation (ICC) for each GPAQ item score. When positive, the ICC can be interpreted as the proportion of the total variation in outcome due to variation between practices. The greater the variation in mean outcome between practices, the greater the ICC.18
Mixed effects linear regression models (treating GP practice as a random effect and patient characteristics as fixed effects) were also used to calculate differences in means and 95% confidence intervals for each outcome between each subgroup and the reference group for each participant character-istic, including age group, sex, geographical location, general health rating, number of visits to the patient’s usual GP, and number of GPs seen in the previous year. These patient characteristics were chosen because their association with patient ratings of GP care had been previously investigated.12 It was hypothesised that a patient’s level of contact with GPs (as determined by the number of visits to a GP and the number of different GPs seen in the previous 12 months) would be associated with the degree of satisfaction with GP care.
All analyses were performed using Stata software, version 9.2 (StataCorp, College Station, Tex, USA).
Ethics approval was granted by the University of Melbourne’s Human Research Ethics Committee.
From the list of 200 GPs, 88 GPs were either ineligible, could not be contacted, or were from geographical areas in which the recruitment quota had already been reached.15 Thirty GPs (26.8%) were recruited from the remaining 112 eligible GPs.
From 17 780 patients initially sent a screening survey, 7667 (43%) returned a completed survey. Of these, only the 7130 patients (93%) who reported that the study GP was their usual GP or that the practice in which the study GP practised was their usual general practice were included in our analysis.
Patient response rates by GP varied from 26.2% to 55.0%. During the 12-month period (January to December 2005), there was no seasonal variation in recruitment rates (data available from authors). The average number of patients returning a completed survey per GP was 238 (range, 124–316 patients per GP). Participant characteristics are summarised in Box 1. Compared with the total sample of patients who were sent the screening survey, the mean age of respondents was slightly higher (51 years [SD, 14.1 years] v 46 years [SD, 15.3 years]), and the proportion of respondents who were women was slightly higher (65.9% v 60.7%).
The proportion of missing responses was less than 3% for each GPAQ item. Responses to all items were well distributed across response categories. Summary measures and the ICC for each GPAQ item, together with postal benchmarks from the UK GP contract year April 2004 to March 200520 are presented in Box 2. Mean scores for the six GPAQ items ranged from 68.6 (95% CI, 66.1–71.0) for satisfaction with access to 84.0 (95% CI, 82.2–85.4) for satisfaction with communication, and were higher than the UK benchmarks.
Results of the multivariable regression analysis for each of the six GPAQ items, categorised by selected participant characteristics, are presented in Box 3. The differences presented have been adjusted for the effect of the remaining participant characteristics listed in the table. The results for each outcome are interpreted as the adjusted difference in mean score between the categories of each participant characteristic and the chosen reference category. For example, the adjusted difference in mean score for satisfaction with receptionists between the oldest age group and youngest age group in the sample (the reference group) is 6.6, and we can be 95% confident that the true difference in the mean score for the two age groups in the population lies between 4.2 and 9.0 — indicating that, on average, the oldest patients rated satisfaction with receptionists higher than did the youngest patients.
To our knowledge, ours is the first study to examine patient perceptions of the quality of health care in general practice using the GPAQ scale on a large sample of Australian patients. Administering a postal survey enabled us to sample a large, geographically diverse group of patients at relatively low cost. Our approach provides patient-reported quality ratings that can be attributed to individual doctors and practices. The minimal missing data in completed questionnaires suggests that the GPAQ is suitable for use in Australia. Unlike most epidemiological studies administering postal questionnaires, we were able to report information on age and sex of the entire patient sample sent a survey.
Several factors should be taken into account when considering the generalisability of our results. Firstly, the GPAQ was one of several questionnaires embedded within a survey about mental health. This may have influenced the response rate as well as the type of patients who chose to complete and return a questionnaire. Secondly, eligibility criteria for GPs and patients may have influenced the selection of participants: 11.2% of Australian general practices are not fully computerised,21 which may affect patients’ perceptions of access; and excluding GPs who see fewer than 600 patients a year may have biased the sample towards GPs working full-time (predominantly men).22 Thirdly, as the sample was limited to patients who had consulted their GP in the previous year, the views of patients consulting their GP less frequently may have been under-represented.
Other factors may have influenced the responses to our survey. Patients satisfied with their care may be more likely to complete satisfaction surveys. While response rates to surveys filled out in the doctor’s waiting room are usually higher than response rates to postal surveys,23 completing postal surveys in the privacy of one’s home may encourage more careful consideration of responses and result in fewer missing answers.23,24 Similarly, when measuring satisfaction, some patients may be reluctant to report negative experiences if they perceive that their responses may be accessed by the GP or practice staff. Bower et al identified bias towards a higher GPAQ score (ie, more favourable rating) among waiting room responders compared with postal responders.14 While this bias was greatest with regard to the receptionist item, GPAQ scores were higher across all items in the waiting room version. This is consistent with other studies of quality measures in primary care that have compared postal and waiting room surveys.23,25 In our study, the anonymity of the postal survey may have provided a welcome opportunity for patients who were dissatisfied with their care to express their views confidentially.
Overall, participants rated general practice care highly on the six GPAQ items, and GPAQ scores for each item were higher in our study than UK national benchmarks.20 Higher scores in our sample may be partially attributable to differences in the organisation of general practice: while Australians are free to consult any GP for their own health care, UK patients who consult GPs under the National Health Service are allocated to a GP based on postcode of residence and catchment area of the general practice. However, the observed differences in GPAQ scores between the two countries are likely to be mainly the result of the sampling methods used: the GPs who took part in our study were those who agreed to participate in mental health research, which may have led to the recruitment of a higher calibre of GP than one might expect from a compulsory quality assurance program.
Our finding that older patients gave higher ratings than younger patients on most of the GPAQ scales is consistent with the results of a UK study by Campbell et al.12 However, in contrast with that study, we found that female patients gave slightly higher ratings than male patients on satisfaction with receptionists, communication, nursing care and the practice overall. The strongest patient factors predicting higher GPAQ scores were self-rating of health as excellent or very good and frequency of general practice visits.
The association between GPAQ scores and patient characteristics may reflect the actual quality of care patients receive, but may also be partially explained by different patient expectations of GP care, overall engagement with general practice, and/or variation in reporting between patient groups.12
GPAQ scores are useful, as they enable comparisons of general practice care across time, between practices and between patient subgroups. At this time, it is difficult to interpret the clinical significance of our results, as the GPAQ is relatively new and we lack comparative Australian data.26 Increased use of the GPAQ will facilitate a greater understanding of the clinical meaning of the GPAQ scores.
1 Patient characteristics (N = 7130)
Long-term illness or disability |
|||||||||||||||
Length of time patient has been visiting GP and/or practice |
|||||||||||||||
Number of visits to GP in previous year |
|||||||||||||||
Number of GPs seen in previous year |
|||||||||||||||
2 GPAQ item scores and intracluster correlations (ICCs) for diamond study participants compared with United Kingdom national benchmarks*
diamond study participants (N = 7130) |
UK national benchmarks† (N = 20 146) |
||||||||||||||
Range in mean scores between practices |
|||||||||||||||
3 Results of multivariable linear regression analysis for each GPAQ item score, by patient characteristic*
Overall satisfaction (N = 6914) |
|||||||||||||||
Visits to GP in previous 12 months |
|||||||||||||||
Number of GPs seen in previous 12 months |
|||||||||||||||
Abstract
Objective: To report patient responses to the General Practice Assessment Questionnaire (GPAQ) as a measure of satisfaction with health care received from Australian general practitioners.
Design, setting and participants: A clustered cross-sectional study involving general practice patients from 30 randomly selected general practices in Victoria. Between January and December 2005, a screening survey, including a postal version of the GPAQ, was mailed to 17 780 eligible patients.
Main outcome measure: Scores on the six GPAQ items.
Results: We analysed data from 7130 patients who completed the screening survey and fulfilled our eligibility criteria. Levels of patient satisfaction with general practice care were generally high: mean GPAQ scores ranged from 68.6 (95% CI, 66.1–71.0) for satisfaction with access to the practice to 84.0 (95% CI, 82.2–85.4) for satisfaction with communication. Intracluster correlations for the GPAQ items ranged from 0.016 for overall satisfaction with the practice to 0.163 for satisfaction with access to the practice. Compared with national benchmarks in the United Kingdom, the GPs and practices participating in our study were rated higher on all six GPAQ items. Multivariable mixed effects linear regression showed that patients who were older, rated their health more highly, visited their GP more frequently and saw the same GP each time tended to express greater satisfaction with their care.
Conclusion: Generally patients reported high levels of satisfaction with GP care. Greater satisfaction with care was associated with older patients, good health, more frequent contact with the GP, and seeing the one GP consistently.