Limited adverse occurrence screening: using medical record review to reduce hospital adverse patient events

Abstract

MJA 1996; 164: 458-461  

Introduction

Many preventable adverse patient events occur in hospitals. The Quality in Australian Health Care Study, which reviewed over 14 000 patient admissions in 28 hospitals in New South Wales and South Australia, found 16.6% involved an adverse event; half of these were assessed as highly preventable.² The Harvard Medical Practice Study, a review of over 30 000 inpatient medical records from 51 acute-care hospitals in the United States, showed that adverse events occurred in 3.7% of hospitalisations and that many of these were the result of substandard care.³ Both these studies used methods that required substantial resources in time and money to detect adverse patient events, and neither looked at the effect of intervention in preventing recurrence of an adverse event.

Limited adverse occurrence screening is a continuous process of retrospective screening and review of inpatient medical records to detect adverse patient occurrences.⁴ It is referred to as "limited" because only eight general patient outcome criteria are used. When an adverse occurrence is found, appropriate action is taken to prevent its recurrence and the success of the action is determined by ongoing monitoring.⁴ Thus, the quality assurance feedback loop is securely closed. This study was designed to determine whether limited adverse occurrence screening could reduce the number and rate of adverse occurrences and therefore improve the quality of patient care.  

Methods

Four doctors were chosen by the Hospital Medical Staff Group to be medical reviewers and to form a Patient Care Committee. All doctors held dual positions in the hospital and had postgraduate clinical qualifications. They were a physician (also Director of Intensive Care), a surgeon (also Chairman of the Medical Staff Group), a general practitioner (also Director of Postgraduate Education) and the Medical Director (also Director of the Accident and Emergency Department).

The medical records for all inpatients discharged between 1 July 1991 and 30 June 1994 were screened by medical records staff using eight general patient outcome criteria (Box 1, below). An adverse patient occurrence analysis form was attached to any medical record that met one or more of the criteria. The record was reviewed by the doctor allocated to that criterion, who evaluated the care given to determine if an adverse patient occurrence had arisen before or during admission, and then completed the form. Adverse occurrences for which patients had had previous admissions were excluded.

1. Death.
2. Return to operating theatre within 7 days.
3. Transfer from general ward to intensive care unit.
4. Unplanned readmission within 28 days of discharge.
5. Cardiac arrest.
6. Transfer to another acute-care facility.
7. Length of stay greater than 35 days (reduced to 21 days in 1993-1994).
8. Theatre booking cancelled.

An adverse patient occurrence was defined as "an untoward patient event which, under optimal conditions, is not a natural consequence of the patient's disease or treatment".¹ I have described the limited adverse occurrence screening method in detail in an earlier paper.⁴

Medical care was evaluated using a six-point scale,⁵ to help the reviewer decide whether an adverse patient occurrence was caused by medical management: 1 = little or no evidence, 2 = slight evidence, 3 = not likely (less than 50:50 odds but a close call), 4 = more likely than not (greater than 50:50 odds but a close call), 5 = strong evidence, 6 = virtually certain. A score of four or more on this scale was regarded as an adverse patient occurrence. Severity of adverse occurrences was graded on a seven-point scale:¹ 0 = minor severity, 1 = minor temporary, 2 = minor permanent, 3 = major temporary, 4 = major permanent, 5 = potential major or major continuing, 6 = death.

The medical reviewer wrote brief notes about the case for the Patient Care Committee. Adverse occurrences were discussed at the Committee's bimonthly meetings and recommendations for further action relating to patient care were made and forwarded to the Medical Staff Group, which consisted of all visiting medical officers in the hospital and the Director of Medical Services.

All data from the adverse patient occurrence analysis forms were entered into a database program developed from the Clipper Dbase Compiler software package.⁶ A chi-squared test was used for statistical analysis, and confidence intervals were calculated for odds ratios using standard methods.⁷  

Results

After medical review, 155 records (0.97% of all records screened) were found to contain an adverse patient occurrence using the six-point scale (Box 3). Of these adverse occurrences, 45 were minor and 110 were major (Box 4).

Of the 155 adverse patient occurrences confirmed on medical review, no further action was recommended by the Patient Care Committee in 88 cases (56.8%) (i.e., the adverse occurrence was considered to be not preventable or of minor significance). Recommended action for the other cases included changing the relevant hospital policy; presenting the case at a postgraduate meeting; undertaking a quality assurance program to investigate the adverse occurrence in detail; discussion with, or counselling of, the doctor involved; and, rarely, review of the doctor's clinical privileges or reporting the case to the hospital's insurers.

Over the three-year period of the study, 66 recommendations were made by the Patient Care Committee and almost all were accepted by the Medical Staff Group and became hospital policy. Changes in hospital policies were both clinical and administrative. Clinical policy changes included restricting some drug prescribing; revised protocols for reporting vital signs; eliminating use of multidose drug vials; formulating guidelines regarding fitness for general anaesthesia; and developing protocols for managing patients with alcohol withdrawal, haematemesis and melaena, and for patients who have had a cerebrovascular accident or who require analgesia.

Administrative policy changes included sending copies of referral letters when patients were transferred to other hospitals; sending private antenatal notes to the obstetric ward before the patient's confinement; redesigning the preadmission form to allow consent for procedures to be obtained in the consultant's room; and routinely including a copy of the death certificate in the medical record (if the patient had died in hospital). (Examples of the types of adverse occurrences, more detailed recommendations for further action and their subsequent reduction in incidence are given in an earlier paper.⁴)

The adverse patient occurrences were grouped by year to determine whether the actions instigated had any effect on the subsequent rate of adverse occurrences. The rate of adverse patient occurrences fell from 69 in the first year (1.35% of all patient discharges in that year) to 33 in the third year (0.58% of all patient discharges in that year) (Box 4). The proportion of adverse occurrences fell significantly with time (chi-squared = 17.11; df = 2; P = 0.0002) and this trend was linear (chi-squared = 16.87; df = 1; P< 0.0001).

When the severity rating of adverse events was divided into minor (severity score 0-2) and major (severity score 3-6), there was no significant change in the severity of adverse patient occurrences between the first, second and third years of the study (Box 4). Also, the proportion of adverse patient occurrences detected in each year by screening did not alter significantly over time for patient age, sex or insurance status (Box 5). The commonest major diagnostic categories, using the ICD-9 classification,⁸ in which patients had adverse occurrences were injury and poisoning, followed by digestive and circulatory disorders (Box 6, below).

Patient characteristics such as sex and age did not change significantly during the three years of the study, but the proportion of inpatients privately insured fell from 26.6% to 24.3% (chi-squared = 10.24; df = 2; P< 0.01).  

Discussion

Adverse occurrence screening has been shown to be valid and reliable, with a high level of agreement between reviewers as to whether a patient has had an adverse occurrence.¹⁰ Although in this study each medical record was reviewed by only one doctor, other studies using a similar methodology and rating scale have shown high agreement.⁵ Limited adverse occurrence screening is efficient as it requires the review of the medical records of slightly less than 10% of all patients discharged, costs only 0.1% of an acute-care hospital's total budget, and is fast and accurate (false positive rate, 2.0%; false negative rate, 0.4%).⁹

In this study, 9.21% of medical records were screened positive for one or more of the eight general patient outcome criteria and an adverse occurrence was confirmed in 0.97%. Little or no clinical judgement was required in the screening process. This compares with a rate of 8.4% (confirmed in 0.73%) in a study using similar screening criteria in a medium-sized New South Wales hospital.¹¹ In the Quality in Australian Health Care Study, potential adverse events were detected in 43.7% of the medical records on initial screening (a much higher rate than in other studies) using 18 criteria, some of which required clinical judgement.² Adverse events were confirmed in 16.6%, although, unlike in this study, 49% of these occurred before the sample admission. An average rate of potential adverse events of 13.2% was found in a study of 146 Veterans Affairs Medical Centers in the United States that used nine screening criteria.¹² There was considerable variation between centres, with a 25th percentile of 8.6% (confirmed in 1.7% of records) and a 75th percentile of 27.2% (confirmed in 7.9% of records). In the Harvard Medical Practice Study, potential adverse events were detected on initial screening in 25.9% of medical records using 18 screening criteria.¹³ Adverse events were confirmed in 0.2% to 7.9%, depending on hospital complexity and location, with the rate in rural hospitals being 1%.¹³

Limited adverse occurrence screening can be adapted to all sizes of hospital. It has recently been introduced into 10 small hospitals in central western Victoria by the Division of General Practice in that area working with the Monash University Centre for Rural Health in Moe, Victoria. In larger hospitals, limited adverse occurrence screening could be introduced on a departmental basis.

The program could be enhanced by combining its retrospective medical record review with prospective critical incident reporting. In the United States, adverse occurrence screening and incident reporting both detected a substantial number of adverse events; however, there was less than a 50% overlap in the adverse events detected by each method when used concurrently.¹⁴ Thus, a program that simultaneously uses both methods may detect the largest pool of adverse occurrences for analysis and development of preventive strategies.  

Acknowledgements

References

1. Craddick JW, Bader B. Medical management analysis: a systematic approach to quality assurance and risk management. Auburn (CA): Joyce W. Craddick, 1983.
2. Wilson RM, Runciman WB, Gibberd RW, et al. The Quality in Australian Health Care Study. Med J Aust 1995; 163: 458-471.
3. Brennan TA, Leape LL, Laird NM, et al. Incidence of adverse events and negligence in hospitalized patients. N Engl J Med 1991; 324: 370-376.
4. Wolff A. Limited adverse occurrence screening: a medical quality control system for medium sized hospitals. Med J Aust 1992; 156: 449-452.
5. Hiatt HH, Barnes BA, Brennan TA, et al. A study of medical injury and medical malpractice: an overview. N Engl J Med 1989; 321: 480-484.
6. Clipper [computer program]. Version 5.0. Los Angeles: Nantucket Corporation, 1990.
7. Daly LE, Bourke GJ, McGilbray J. Interpretation and uses of medical statistics. Oxford: Blackwell Scientific Publications, 1991: 398-424.
8. US Department of Health and Human Services. The international classification of diseases. 9th revision. Clinical modification (ICD-9-CM). 3rd ed. Bethesda, Md: DHHS, 1989.
9. Wolff A. Limited adverse occurrence screening: an effective and efficient method of medical quality control. J Qual Clin Pract 1995; 15: 221-233.
10. Panniers TL, Newland J. The adverse patient occurrence inventory: validity, reliability and implications. Qual Rev Bull 1986; 12: 311-315.
11. Britton S. A hospitalwide outcome study. Aust Clin Rev 1991; 11: 132-135.
12. Goldman R, Walder DJ. An initial assessment of the Veterans Affairs Occurrence Screening Program. Qual Rev Bull 1992; 18: 327-332.
13. 13. Brennan TA, Herbert LE, Laird NM, et al. Hospital characteristics associated with adverse events and substandard care. JAMA 1991; 265: 3265-3269.
14. 14. O'Neil AC, Petersen LA, Cook EF, et al. Physician reporting compared with medical record review to identify adverse medical events. Ann Intern Med 1993; 119: 370-376.