General practitioners view health and medical research positively, but their participation in postal surveys is typically low.1 Poor response rates reduce the sample size and consequently the generalisability of survey results.
As the impact of financial incentives in isolation on survey response rate and speed has not been investigated in Australia in randomised controlled trials,2 we examined the effect of a modest financial incentive on participation by GPs in a cross‐sectional postal survey in a single‐blinded randomised controlled trial during 28 March – 25 September 2019. The trial was nested within a cross‐sectional study that explored the views of GPs regarding health assessments for older people (a 15‐minute mailed pen‐and‐paper survey).3 The study was approved by the University of Newcastle Human Research Ethics Committee (H‐2018‐0474).
A random selection of 1000 GPs included in the Australasian Medical Publishing Company (AMPCo) database and currently practising in Australia (541 men, 54%) were invited by mail to participate in the survey, and concomitantly randomised to the control or intervention trial groups. In a personalised cover letter and information sheet, intervention group GPs were promised $20 gift vouchers (vendor unspecified) if they returned completed surveys; the offer was repeated in two subsequent reminder letters (at three and six weeks) if required. Control group GPs received identical survey‐related mail, except that the gift voucher was not mentioned. GPs were not informed about the incentive trial until a thank‐you letter was posted at the conclusion of the survey; all participating GPs then received $20 gift vouchers. The primary outcome was survey response rate; the secondary outcome (a post hoc exploratory analysis) was the response speed of survey responders (from despatch of initial mail from the researchers’ office to arrival of the completed survey) (further details on selection and analysis: ).
Overall, 103 intervention group GPs (21%; 95% confidence interval [CI], 18–25%) and 82 control group GPs (17%; 95% CI, 14–21%) returned completed surveys (absolute difference, +4.1 percentage points (95% CI, –0.8% to +9.2 percentage points) (Box). Intervention group GPs were more likely than control group GPs to return surveys, but the difference was not statistically significant (odds ratio, 1.31; 95% CI, 0.95–1.81). The median response speed was 36 (interquartile range [IQR], 19–61) days for the intervention group, 42 (IQR, 19–61) days for the control group (P = 0.39).
Mailed survey response rates and speed were not increased by offering $20 vouchers to GPs. Some overseas studies have found that even modest incentives were associated with higher response rates for GPs.4 Although we incorporated many study design elements reported to maximise physician response rates,5 the overall rate (19%) remained low. The AMPCo database provides access to a population‐based national sample, but databases of this type cannot support peer endorsement strategies. Further, our sample size may have been too small to detect between‐group differences.
The problem of low and falling professional participation in research6 may reflect changing attitudes to research and time pressure for GPs. We need to improve participation rates, but larger incentives would be expensive, might be seen as coercive, and could undermine research feasibility. The effect of non‐monetary incentives should be explored, such as the award of continuing professional development points for participating in research.
Box – Demographic characteristics of the 185 general practitioners who completed the survey
Characteristic |
Intervention |
Control |
|||||||||||||
Completed survey |
Did not complete survey*† |
Completed survey |
Did not complete survey* |
||||||||||||
|
|||||||||||||||
General practitioners |
103 |
381 |
82 |
398 |
|||||||||||
Sex |
|
|
|
|
|||||||||||
Men |
52 (50%) |
205 (54%) |
45 (55%) |
224 (56%) |
|||||||||||
Women |
51 (50%) |
176 (46%) |
37 (45%) |
174 (44%) |
|||||||||||
Practice location |
|
|
|
|
|||||||||||
Metropolitan |
77 (75%) |
292 (77%) |
58 (71%) |
299 (75%) |
|||||||||||
Regional/remote |
26 (25%) |
89 (23%) |
24 (29%) |
99 (25%) |
|||||||||||
Age group (years) |
|
|
|
|
|||||||||||
35 or younger |
9 (9%) |
— |
6 (7%) |
— |
|||||||||||
36–45 |
11 (11%) |
— |
16 (20%) |
— |
|||||||||||
46–55 |
29 (29%) |
— |
20 (25%) |
— |
|||||||||||
56–65 |
29 (29%) |
— |
27 (33%) |
— |
|||||||||||
66 or older |
21 (21%) |
— |
11 (13%) |
— |
|||||||||||
Missing data |
4 |
|
2 |
|
|||||||||||
Years in general practice |
|
|
|
|
|||||||||||
5 or fewer |
12 (12%) |
— |
7 (9%) |
— |
|||||||||||
6–10 |
6 (6%) |
— |
12 (15%) |
— |
|||||||||||
11–20 |
26 (26%) |
— |
16 (20%) |
— |
|||||||||||
More than 20 |
56 (56%) |
— |
46 (56%) |
— |
|||||||||||
Missing data |
3 |
— |
1 |
— |
|||||||||||
General practitioner fellowships† |
100 |
— |
81 |
— |
|||||||||||
RACGP |
69 (70%) |
— |
65 (80%) |
— |
|||||||||||
ACRRM |
7 (7%) |
— |
8 (10%) |
— |
|||||||||||
Neither |
26 (26%) |
— |
12 (15%) |
— |
|||||||||||
Missing data |
3 |
— |
3 |
— |
|||||||||||
|
|||||||||||||||
ACRRM = Australian College of Rural and Remote Medicine; RACGP = Royal Australian College of General Practitioners. * Does not include randomised participants later excluded because valid practice address was not available (Supporting Information, figure). The only demographic data available for non‐respondents were sex and practice location. † Multiple fellowships possible. |
Received 4 August 2021, accepted 14 January 2022
- 1. Cook JV, Dickinson HO, Eccles MP. Response rates in postal surveys of healthcare professionals between 1996 and 2005: an observational study. BMC Health Serv Res 2009; 9: 160.
- 2. Parkinson A, Jorm L, Douglas KA, et al. Recruiting general practitioners for surveys: reflections on the difficulties and some lessons learned. Aust J Prim Health 2015; 21: 254‐258.
- 3. Carey M, Zucca A, Rhee, J, et al. Essential components of health assessment for older people in primary care: a cross‐sectional survey of Australian general practitioners. Aust N Z J Public Health 2021; 45: 506‐511.
- 4. Pit SW, Vo T, Pyakurel S. The effectiveness of recruitment strategies on general practitioner’s survey response rates: a systematic review. BMC Med Res Methodol 2014; 14: 76.
- 5. Edwards PJ, Roberts I, Clarke MJ, et al. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev 2009; 2009:MR000008.
- 6. Campbell MK, Weijer C, Goldstein CE, Edwards SJ. Do doctors have a duty to take part in pragmatic randomised trials? BMJ 2017; 357: j2817.
Trial registration
Open Science Framework, doi: 10.17605/OSF.IO/VZMWJ; 30 September 2021 (retrospective).
Open access
Open access publishing facilitated by The University of Newcastle, as part of the Wiley ‐ The University of Newcastle agreement via the Council of Australian University Librarians.
This study was supported by the National Health and Medical Research Council (NHMRC) with a Dementia Research Team grant (APP1095078) and by infrastructure funding from the Hunter Medical Research Institute. Mariko Carey is supported by an NHMRC Boosting Dementia Research Leadership Fellowship (APP1136168). We acknowledge Grace Norton for research assistance and, Sandra Dowley for data entry (both University of Newcastle and Hunter Medical Research Institute), and Lucy Leigh for statistical analysis (Hunter Medical Research Institute).
No relevant disclosures.