A recent editorial in the MJA on the status of patient safety in Australia, a decade after the Quality in Australian Health Care Study1 (and, coincidentally, nearly 10 years after the first, and to date the only, government-sponsored study of patient-safety incidents in general practice2), lamented that “. . . the absence of recent system-wide data on patient safety . . . makes a mockery of the tenets of continuous quality improvement”, and advanced that we “manage what we measure”. Bagian et al, in reporting the development of the US Veterans Administration patient-safety program, subtitled their article “You can’t fix what you don’t know about”.3 Both these truisms are even more relevant in the apparent black hole of patient-safety incident reporting in Australian general practice.
This lack of information is particularly conspicuous in the area of medication-safety incidents, which constituted half of all incidents in the general practice incident monitoring study.2,4 Adverse drug events (ADEs) are regarded as an important subset of patient-safety incidents that cause, or have the potential to cause, harm to patients undergoing medical care.
ADEs reported by the Australian Incident Monitoring System5 (mostly from the acute care sector), and community-based research by Roughead et al,6 have shed some light on the problem. However, it is in the realm of postmarketing surveillance of ADEs by regulators that the deficiency in data becomes most obvious. In Australia, reporting rates by general practitioners to the Adverse Drug Reactions Advisory Committee of the Therapeutic Goods Administration (TGA) fell from 3314 in 2002 to 2075 in 2004 (Dr P Purcell, Medical Officer, Adverse Drug Reactions Unit, TGA, personal communication).
Reduction in the occurrence of ADEs, particularly those due to prescribing, dispensing and communication errors, has been an often-stated aim of the government’s Better Medication Management System and its successors, MediConnect and HealthConnect.7
The subsample used in our study is drawn from the larger sample of general practice encounters in the BEACH (Bettering the Evaluation And Care of Health) program. BEACH is a continuous national cross-sectional study of general practice activity in Australia. About 1000 randomly selected GPs per year each record information about encounters with 100 consecutive consenting patients, providing morbidity and treatment data on about 100 000 encounters annually.8
Throughout the year, a series of substudies are conducted in conjunction with the ongoing data collection from the GP–patient encounters. In each 5-week survey period, about 100 GPs each record information for about 30 patients for each topic. These substudies, known as SAND (Supplementary Analysis of Nominated Data), investigate aspects of patient health not necessarily managed at the encounter (the full methodology is reported elsewhere).9 Responses are recorded by the GP in discussion with the patient. Using a qualified medical practitioner to record morbidity, in conjunction with patient self-report, may provide a more accurate classification of patients’ health problems than self-report alone.10,11
For the purpose of our study, an ADE is defined as an “unintended event due to the use of a medication that could have harmed or did harm the patient”. “Harm” includes physical, psychological or emotional suffering. This definition is consistent with the definition of the broader concept of “clinical incidents” used in our study on patient-safety incidents in general practice in Australia.2
In Survey 1, severity was not recorded if the reason for the ADE was a recognised side effect of the drug; and hospitalisation was recorded only when the reason for the ADE was not a recognised side effect. In Survey 2, hospitalisation was recorded for all patients. In Survey 3, preventability was recorded instead of hospitalisation. GPs were asked to use their clinical judgement in assessing the type of event, its severity and preventability, but guiding definitions were provided for “severity” and “preventability” (Box 1).
A cluster sample design was used. The GP was the primary sampling unit, and the unit of analysis was patients at the GP–patient encounter. All reported confidence intervals were adjusted for the design effect of the cluster sample using procedures in SAS (version 8.2, SAS Institute, Cary, NC, USA). Rates were judged significantly different by the presence of non-overlapping 95% confidence intervals.
Ethics committees of the University of Sydney and the Australian Institute of Health and Welfare approved the BEACH study and this substudy.
Responses were received on 8285 encounter forms from 282 GPs. Of these, 70 were excluded (duplicate patients on the basis of matching demographic data), leaving a final sample of 8215 patients. The GPs reported that 852 patients (10.4%) had experienced an adverse event after using a medication in the past 6 months. This result was consistent over the three surveys (Box 2). All other results from questions repeated in the three surveys did not differ significantly and are reported here in consolidated form.
The age and sex distributions of the respondents did not differ from those of patients in the total sample of BEACH encounters for 2002–2003.8
Among children, those aged 1–4 years were three times more likely to have experienced an ADE than other age groups. In adults, the likelihood of an ADE increased with age to peak in those aged 65 years and over. Female patients were significantly more likely than male patients to have experienced a medication-related ADE (Box 3).
A GP severity rating for the most recent ADE was provided for 551 patients. Over half (53.9%) were rated as having a “mild” event(s), with a third rated as “moderate”. A “severe” rating was given for 55 patients (10.0% of those with an ADE or 6.7 per 1000 patients sampled) (Box 4).
One in 10 patients presenting to a GP has had an ADE in the preceding 6 months, almost 50% being in the moderate to severe range, as assessed by the GP. About 8% of patients were hospitalised as a result of the ADE.
Our study is limited, firstly, by the methodology of the SAND substudies of the BEACH program, being constrained both by the number of questions that could be asked and the time that GPs could devote, within the context of the consultation, to clarifying answers to the questions about ADEs.
Secondly, patients attend general practice at variable rates related to age and morbidity. Therefore, some groups of patients are more likely to be included in these samples. As a result, the frequency of ADEs in patients attending GPs cannot be extrapolated to a period prevalence of ADEs in the community.
Thirdly, the relationship between the adverse event and the medication was left to the judgement of the GP and the patient, and no attempt was made to grade the probability of causation. Furthermore, the individual drugs possibly causing the ADEs were not identified, nor was the duration of exposure or dosage.
Fourthly, the denominator was all patients presenting to the GP, regardless of whether or not they were receiving drug therapy. The frequency of ADEs in patients receiving drug therapy would undoubtedly be higher than that reported.
Finally, answers to the questions relied on the patient’s and the GP’s recall of events over a period of 6 months, a process that may result in some variable reliability.
Our study must therefore be regarded as a quantification of ADEs from the perspective of the GP and the patient. However, the overall consistency of the results over the three surveys by separate groups of about 100 GPs suggests a common interpretation of causality, severity and preventability.
A major strength of our study is that it contains data from a large sample of patients collected by hundreds of GPs representing 1.5% of all practising GPs in Australia. GPs in the BEACH program are nationally representative of all GPs practising in Australia.8 The GPs use their medical records, knowledge of the patient, and their clinical skills and experience to interpret the reported ADEs. In the SAND substudies they act as expert clinical interviewers.
Research on under-reporting of serious ADEs in the United States13-15 and Canada,16-18 suggests that formal reporting rates may be as low as 1.5% of total ADEs. US estimates place the mortality from ADEs as the fifth most common cause of death after heart disease, cancer, stroke and pulmonary disease.13
Under-reporting of serious ADEs is only part of the problem. To prevent “overload”, statutory reporting authorities actively discourage reporting of less severe ADEs and those due to known side effects of drugs. The Director of the US Food and Drug Administration (FDA) has publicly stated “If we were to get reports of all adverse reactions, we’d be overwhelmed, making it difficult for us to focus on the issues with the most public health impact”.19 Further, the FDA has stated that it “does not want reports of all adverse reactions, especially ones listed in a product’s labeling”.19
The level of morbidity due to known drug side effects is usually only explored in pre-marketing clinical trials conducted under very constrained circumstances, and is generally absent from postmarketing surveillance. Thus, a significant level of morbidity may escape notice. The number of reports by GPs to the Adverse Drug Reactions Advisory Committee of the TGA in 2004 (2075 reports) does not match the extrapolated results of our study. If 10.4% of the 96.3 million GP consultations in 2003–0420 were with patients with an adverse drug reaction in the preceding 6 months, then GPs had over 10 million consultations in that year with such patients.
The increasing frequency of ADEs with increasing age mirrors the increased prescription rate at encounters with patients in these age-groups and may therefore be due to the increased medication load. The higher frequency in the age group 1–4 years is not related to prescription rates and therefore requires further exploration.
Various interventions have been suggested and/or implemented in an attempt to reduce the occurrence of incidents, including ADEs.21 The introduction of computer-generated prescriptions and decision-support systems are frequently advocated as possible solutions to patient-safety incidents caused by medicines.22,23 However, doubts have been raised about computer prescription-generation systems without decision support.23,24
Roughead, in a recent editorial in the MJA, pointed out that adverse drug reactions are often considered part of the price to be paid for the therapeutic benefit of medicines. However, we, or more correctly our patients, may be currently paying too high a price.25 While very severe ADEs may occur and be managed in the acute care sector, the large number of mild and moderate ADEs and many of the severe reactions can only be managed or prevented in the community. Many of these ADEs are (in the GP’s opinion) preventable, and the patient-centred GP is ideally placed to lower the burden of this morbidity.
To encourage all participants — patients, doctors, pharmacists, educators and regulators — to collaborate in reducing ADEs, we need to monitor the real burden of ADEs in the community, not by requiring the impossible task of reporting all ADEs to the regulators, but by regular statistical sampling of the frequency and severity of ADEs, and more detailed research to further identify problem drugs and drug combinations and associated contributing factors. This could include further SAND studies of the association of ADEs with different drug groups, patient groups and morbidity patterns. It could also involve other community-based monitoring such as that suggested by Colebatch et al.26
As Roughead suggested “it is time to get serious”.25
1 Definitions provided to participating general practitioners
Mild: a reaction of limited duration which may or may not require further treatment; minimum impact on daily activities
Moderate: a reaction of longer duration or which requires further treatment; limits daily activities
Severe: a reaction of any duration which results in hospitalisation and/or long-term limitations of daily activities
An adverse event would be considered preventable if it is avoidable by any means currently available (unless that means is not considered standard care).12
2 Sample size and occurrence of reported adverse drug events (ADEs) in the three surveys
Number of general practitioners |
|||||||||||||||
Number of patients with an ADE |
|||||||||||||||
3 Age- and sex-specific rates of at least one adverse drug event (ADE) in general practice patients
Age- or sex- |
|||||||||||||||
4 Details of adverse drug events (ADEs) — patients reporting at least one ADE in past 6 months
Percentage of respondents (95% CI) |
|||||||||||||||
Received 8 September 2005, accepted 27 November 2005
Abstract
Objective: To investigate the frequency, cause, and severity of adverse drug events (ADEs) among general practice patients.
Design: Between May 2003 and February 2004, a subsample of 282 general practitioners in the BEACH (Bettering the Evaluation And Care of Health) data collection program recorded patient responses to questions about ADEs.
Main outcome measures: Frequency, cause, and severity of ADEs; and frequency of hospitalisation and proportion of events that were preventable.
Results: From 8215 encounters, GPs reported that 852 patients (10.4%) had experienced an ADE in the previous 6 months. Patients aged over 45 years (versus under 45 years), children aged 1–4 years (versus older children), and female patients (versus male patients) were significantly more likely to have experienced an ADE. Most patients (83.5%) had experienced only one ADE, with 10.7% and 5.8% experiencing two and three or more events, respectively. For 71.9% of patients, one reason for the most recent event was a recognised side effect, followed by drug sensitivity (12.4%) and allergy (11.0%). Over half of patients were rated as having a “mild” event, with 35.8% rated as “moderate”, and 10.0% as “severe”. GPs classified 23.2% of events as preventable, and 7.6% of events resulted in hospitalisation.
Conclusion: Our study reveals the high frequency of ADEs in patients attending general practice. This level of morbidity makes ADEs one of the most significant causes of morbidity in the Australian community.