Connect
MJA
MJA

Effect of a financial incentive on responses by Australian general practitioners to a postal survey: a randomised controlled trial

Alison C Zucca, Mariko Carey, Rob W Sanson‐Fisher, Joel Rhee, Balakrishnan (Kichu) R Nair, Christopher Oldmeadow, Tiffany‐Jane Evans and Simon Chiu
Med J Aust 2022; 216 (11): 585-586. || doi: 10.5694/mja2.51523
Published online: 20 June 2022

General practitioners view health and medical research positively, but their participation in postal surveys is typically low.1 Poor response rates reduce the sample size and consequently the generalisability of survey results.

As the impact of financial incentives in isolation on survey response rate and speed has not been investigated in Australia in randomised controlled trials,2 we examined the effect of a modest financial incentive on participation by GPs in a cross‐sectional postal survey in a single‐blinded randomised controlled trial during 28 March – 25 September 2019. The trial was nested within a cross‐sectional study that explored the views of GPs regarding health assessments for older people (a 15‐minute mailed pen‐and‐paper survey).3 The study was approved by the University of Newcastle Human Research Ethics Committee (H‐2018‐0474).

A random selection of 1000 GPs included in the Australasian Medical Publishing Company (AMPCo) database and currently practising in Australia (541 men, 54%) were invited by mail to participate in the survey, and concomitantly randomised to the control or intervention trial groups. In a personalised cover letter and information sheet, intervention group GPs were promised $20 gift vouchers (vendor unspecified) if they returned completed surveys; the offer was repeated in two subsequent reminder letters (at three and six weeks) if required. Control group GPs received identical survey‐related mail, except that the gift voucher was not mentioned. GPs were not informed about the incentive trial until a thank‐you letter was posted at the conclusion of the survey; all participating GPs then received $20 gift vouchers. The primary outcome was survey response rate; the secondary outcome (a post hoc exploratory analysis) was the response speed of survey responders (from despatch of initial mail from the researchers’ office to arrival of the completed survey) (further details on selection and analysis: ).

Overall, 103 intervention group GPs (21%; 95% confidence interval [CI], 18–25%) and 82 control group GPs (17%; 95% CI, 14–21%) returned completed surveys (absolute difference, +4.1 percentage points (95% CI, –0.8% to +9.2 percentage points) (Box). Intervention group GPs were more likely than control group GPs to return surveys, but the difference was not statistically significant (odds ratio, 1.31; 95% CI, 0.95–1.81). The median response speed was 36 (interquartile range [IQR], 19–61) days for the intervention group, 42 (IQR, 19–61) days for the control group (P = 0.39).

Mailed survey response rates and speed were not increased by offering $20 vouchers to GPs. Some overseas studies have found that even modest incentives were associated with higher response rates for GPs.4 Although we incorporated many study design elements reported to maximise physician response rates,5 the overall rate (19%) remained low. The AMPCo database provides access to a population‐based national sample, but databases of this type cannot support peer endorsement strategies. Further, our sample size may have been too small to detect between‐group differences.

The problem of low and falling professional participation in research6 may reflect changing attitudes to research and time pressure for GPs. We need to improve participation rates, but larger incentives would be expensive, might be seen as coercive, and could undermine research feasibility. The effect of non‐monetary incentives should be explored, such as the award of continuing professional development points for participating in research.

Box – Demographic characteristics of the 185 general practitioners who completed the survey

Characteristic


Intervention


Control


Completed survey

Did not complete survey*†

Completed survey

Did not complete survey*


General practitioners

103

381

82

398

Sex

 

 

 

 

 Men

52 (50%)

205 (54%)

45 (55%)

224 (56%)

 Women

51 (50%)

176 (46%)

37 (45%)

174 (44%)

Practice location

 

 

 

 

 Metropolitan

77 (75%)

292 (77%)

58 (71%)

299 (75%)

 Regional/remote

26 (25%)

89 (23%)

24 (29%)

99 (25%)

Age group (years)

 

 

 

 

 35 or younger

9 (9%)

6 (7%)

 36–45

11 (11%)

16 (20%)

 46–55

29 (29%)

20 (25%)

 56–65

29 (29%)

27 (33%)

 66 or older

21 (21%)

11 (13%)

 Missing data

4

 

2

 

Years in general practice

 

 

 

 

 5 or fewer

12 (12%)

7 (9%)

 6–10

6 (6%)

12 (15%)

 11–20

26 (26%)

16 (20%)

 More than 20

56 (56%)

46 (56%)

 Missing data

3

1

General practitioner fellowships

100

81

 RACGP

69 (70%)

65 (80%)

 ACRRM

7 (7%)

8 (10%)

 Neither

26 (26%)

12 (15%)

 Missing data

3

3


ACRRM = Australian College of Rural and Remote Medicine; RACGP = Royal Australian College of General Practitioners.  * Does not include randomised participants later excluded because valid practice address was not available (Supporting Information, figure). The only demographic data available for non‐respondents were sex and practice location.  † Multiple fellowships possible.

Received 4 August 2021, accepted 14 January 2022

  • Alison C Zucca1,2
  • Mariko Carey1,2
  • Rob W Sanson‐Fisher1,2
  • Joel Rhee3,4
  • Balakrishnan (Kichu) R Nair1,2
  • Christopher Oldmeadow2
  • Tiffany‐Jane Evans2
  • Simon Chiu2

  • 1 College of Health, Medicine and Wellbeing, University of Newcastle, Newcastle, NSW
  • 2 Hunter Medical Research Institute (HMRI), Newcastle, NSW
  • 3 University of Wollongong, Wollongong, NSW
  • 4 Illawarra Health and Medical Research Institute, Wollongong, NSW



Trial registration

Open Science Framework, doi: 10.17605/OSF.IO/VZMWJ; 30 September 2021 (retrospective).

Open access

Open access publishing facilitated by The University of Newcastle, as part of the Wiley ‐ The University of Newcastle agreement via the Council of Australian University Librarians.


Acknowledgements: 

This study was supported by the National Health and Medical Research Council (NHMRC) with a Dementia Research Team grant (APP1095078) and by infrastructure funding from the Hunter Medical Research Institute. Mariko Carey is supported by an NHMRC Boosting Dementia Research Leadership Fellowship (APP1136168). We acknowledge Grace Norton for research assistance and, Sandra Dowley for data entry (both University of Newcastle and Hunter Medical Research Institute), and Lucy Leigh for statistical analysis (Hunter Medical Research Institute).

Competing interests:

No relevant disclosures.

  • 1. Cook JV, Dickinson HO, Eccles MP. Response rates in postal surveys of healthcare professionals between 1996 and 2005: an observational study. BMC Health Serv Res 2009; 9: 160.
  • 2. Parkinson A, Jorm L, Douglas KA, et al. Recruiting general practitioners for surveys: reflections on the difficulties and some lessons learned. Aust J Prim Health 2015; 21: 254‐258.
  • 3. Carey M, Zucca A, Rhee, J, et al. Essential components of health assessment for older people in primary care: a cross‐sectional survey of Australian general practitioners. Aust N Z J Public Health 2021; 45: 506‐511.
  • 4. Pit SW, Vo T, Pyakurel S. The effectiveness of recruitment strategies on general practitioner’s survey response rates: a systematic review. BMC Med Res Methodol 2014; 14: 76.
  • 5. Edwards PJ, Roberts I, Clarke MJ, et al. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev 2009; 2009:MR000008.
  • 6. Campbell MK, Weijer C, Goldstein CE, Edwards SJ. Do doctors have a duty to take part in pragmatic randomised trials? BMJ 2017; 357: j2817.

Author

remove_circle_outline Delete Author
add_circle_outline Add Author

Comment
Do you have any competing interests to declare? *

I/we agree to assign copyright to the Medical Journal of Australia and agree to the Conditions of publication *
I/we agree to the Terms of use of the Medical Journal of Australia *
Email me when people comment on this article

Online responses are no longer available. Please refer to our instructions for authors page for more information.