The final report of the National Health and Hospitals Reform Commission, released in 2009, recommended that, in promoting better quality care, “we have systems in place to provide comparative clinical performance data back to health services and hospitals, clinical units and clinicians.”1
Also in 2009, the Australian Institute of Health and Welfare (AIHW) released a report proposing 55 quality indicators for national reporting on safety and quality (Box).2 However, of the 31 hospital and specialised health service-specific indicators, only two indicators (22 and 25) are currently being reported nationally.3 Most cannot be measured in an epidemiologically sound manner (ie, reproducibly and accurately) within the available routinely collected data sources without extensive development of both the indicator and the systems to collect it.2 Most importantly, the AIHW indicators omit key outcome measures for hospital activities associated with high cost, such as cardiac surgery, trauma care and intensive care, where poor quality care can impose a significant ongoing burden on the community.
Given these deficiencies, attention has turned towards developing clinical registries from which robust quality indicators can be derived.4 In this article, we outline the rationale for developing registries, and a framework to ensure they are strategically developed to provide the best return on investment.
Clinical-quality registries collect a defined minimum dataset from people who undergo a particular procedure, are diagnosed with a disease, or use a health care resource.5 Quality indicators derived from registries and adjusted for differences in casemix are used to benchmark and improve performance across institutions. This information is, in general, credible to clinicians and effective at driving quality improvement.
More than 70 clinical registries have been developed in Sweden. The Swedish stroke registry has identified variations in care,6 characteristics of clinical units providing the best service7 and attributes of patients most likely to benefit from such care.8 Longer-term information has included quality of life and factors influencing capacity to return to work;9 and — through linkage with a prescribing database — adherence to medication such as statins 2 years after commencing treatment.10 Quality indicators routinely collected within the registry are reported back to hospitals; they allow comparisons at regional and hospital level and have driven development, evaluation and improvement of stroke services.11
In Australia, high-quality registries that collect outcome data from eligible populations are fewer. Only five national registries, encompassing joint replacement, renal dialysis and various forms of organ transplantation (kidney, bone marrow, liver and cardiothoracic organs), have national coverage. One of these, the Australia and New Zealand Dialysis and Transplant Registry (ANZDATA), collects data on patients receiving renal transplants or renal dialysis. It provides risk-adjusted outcomes to contributing organisations that can be compared within Australia and internationally. They can also be used to determine compliance with best practice guidelines12 and to identify problems with access and equity in the delivery of renal services.13
While other high-quality Australian registries exist, many lack high levels of coverage.14 For example, the Australian and New Zealand Intensive Care Society Adult Patient Database, which benchmarks performance, enables resource planning, monitors clinical practice and is a valuable research resource in identifying risk factors for poor outcomes,15,16 does not collect data from 30% of eligible intensive care units in Australia.
Increasing the number of nationwide clinical registries will provide an enlarged inventory of valid, reliable and clinically credible measures of quality that can be compared among different institutions within Australia and internationally. As with initiatives in other developed countries, this can be achieved by expanding several existing registries to become national in scope and by developing new registries in key areas where they currently do not exist. This calls for a framework for prioritising registry development that ensures they are developed in areas of greatest need.
The most pressing areas for registry development are high-cost areas of medicine with known or suspected variation in processes or outcomes that may indicate inappropriate care or inefficient use of limited resources. In the case of renal transplantation, for example, failed grafts typically lead to patients returning to high-cost dialysis associated with major reductions in quality of life. Registry data collected continuously from transplantation units provide a strong incentive for institutions to maximise performance on the basis of peer comparisons, which has contributed to the observed increase in rates of renal allograft survival.17
Establishing registries in other clinical areas, such as cardiac procedures involving angioplasty and stenting, may realise similar benefits.18 Despite rapid growth in the number and cost of these procedures, and in the number of studies showing variations according to factors such as operator skill and annual volumes of procedures,19 outcomes are not routinely monitored across Australia. Suboptimal outcomes may result in repeated hospitalisations for recurrent angina and heart failure, and consequent greater cost and reduced quality of life.
Registries should also focus on areas of medicine where achievement of good outcomes depends on a well performed sequence of care from different providers. For example, achieving the best outcomes in the management of myocardial infarction and stroke requires rapid attendance by emergency services, speedy diagnosis by paramedics and expedited transport to hospitals that have appropriate investigative and interventional care facilities. After the patient’s arrival at hospital, efficient triage, high levels of technical skill, excellent acute care and effective rehabilitation are needed for optimal outcomes. If any step is seriously deficient then outcomes may be poor despite excellence in other parts of the chain.
Registries can gather data for evaluating performance of each component of the sequence of care. The Victorian State Trauma Registry monitors the care of severely injured patients from the time of the injury and ascertains outcomes 2 years after the event. Analyses of trauma registry data showed better outcomes after the introduction of a new trauma management policy in Victoria stipulating that cases of severe trauma be transported directly to major trauma centres and bypass local hospitals, provided the transport time to the major trauma centre was 30 minutes or less.20 The registry also subsequently showed continuing improvement in each of the components of care, and resultant further improvement in overall trauma outcomes.21
Another high priority area for registries is medium to long-term monitoring of specific devices, procedures and drugs where an imperative exists to establish medium-term to long-term safety. Devices may malfunction, break and cause injury because of misuse or design flaws. Unlike new drugs, devices are commonly incorporated into medical practice without systematic pre-marketing evaluation of their clinical safety.22 Subsequent to marketing, reliance is usually placed on voluntary reporting to identify unanticipated safety concerns, whereas ongoing, systematic surveillance would provide a greater level of consumer protection.
The Australian National Joint Replacement Registry monitors outcomes such as revision surgery and prosthesis removal following hip, knee, spinal disc, shoulder, elbow, wrist and ankle surgery. This registry has changed clinical practice through analysis of and feedback on the performance of different types of joint prosthesis.23 A recent federal government review of health technology in Australia has recommended that registries for high-risk implantable devices or procedures be established to assist with post-marketing surveillance of safety and efficacy.24 If accepted by the current Cabinet, it would require manufacturers to establish registries or other forms of systematic data collection as a condition of licence approval.
For practical reasons, a program of registry development should also focus initially on areas of practice where the logistic challenges of establishing or expanding registries are relatively straightforward and the resources required are expected to be modest and commensurate with the potential benefits. In particular, priority should be given to procedures or diseases that are easily identified, are managed at a limited number of centres, and attract wide consensus on appropriate process and outcome measures that can be measured relatively easily. Monitoring diseases that cannot be systematically recognised at a defined point in their clinical history may generate misleading data as a result of subjective definitions of conditions or diseases and ill-defined staging criteria for disease. For example, fibromyalgia, irritable bowel syndrome or some mental health disorders pose challenges due to inconsistencies in diagnostic definitions and measures of illness severity.
The primary purpose of some registries is to monitor compliance with evidence-based clinical practice guidelines. In the United States, the ACTION Registry-GWTG (Acute Coronary Treatment and Intervention Outcomes Network Registry — Get with the Guidelines), related to care of acute coronary syndromes,25 and the OPTIMIZE-HF Registry (Organized Program to Initiate Life-saving Treatment in Hospitalized Patients with Heart Failure), related to care of acute heart failure,26 collect and benchmark process indicators. For both registries, this process has been positively associated with increased use of evidence-based therapy, more efficient patient care, and reduced length of stay.25,26 More work is required to assess whether these indicators are best collected by ongoing registries, targeted audits or defined cohort studies.27
Registries prioritised for development or expansion must be underpinned by robust governance structures and mechanisms to ensure transparency to stakeholders in terms of managerial decision making and oversight, data collection and analysis methodologies, and systems for reporting and disseminating results.28 This, in turn, requires consideration of a framework that ensures data are used responsibly to drive quality improvement and to analyse and address variation in clinical approach.5 Those reporting adverse outcomes that may be uncommon or rare need to use techniques of data display that will best motivate quality improvement, such as exponentially weighted moving average charts.29 More research into refining these methods is needed.
In future, it is likely that a broad range of medical conditions will be monitored using registries that collect data inexpensively from electronic medical records and administrative datasets. To reduce the burden and cost of registry data collection, registry science will need to evolve in ensuring that required data items are reliably captured within, and easily extracted from, these routinely collected electronic datasets.
Like most developed countries, Australia has few registries capable of benchmarking outcomes nationally. Given the increasing attention to quality in the health agenda both here and overseas, policymakers will be in need of a clinical registry prioritisation strategy which ensures that registry development targets three areas — conditions or procedures associated with large variations in processes or outcomes of care, which have a significant impact on overall health care costs and patient morbidity; areas where transition of care across health services influences optimal outcomes; and medium-term to long-term safety of new clinical interventions. Clinical registries can play an increasingly important role as a stimulus for quality improvement by providing high-quality data and analyses that are respected by clinicians.
National quality indicators proposed by the Australian Institute of Health and Welfare in 2009 and current capacity to collect data2
Provenance: Not commissioned; externally peer reviewed.
- Sue M Evans1,2
- Ian A Scott2,3
- Niall P Johnson4
- Peter A Cameron1,2
- John J McNeil2
- 1 NHMRC Centre of Research Excellence in Patient Safety, Monash University, Melbourne, VIC.
- 2 School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC.
- 3 Department of Internal Medicine, Princess Alexandra Hospital, Brisbane, QLD.
- 4 Australian Commission on Safety and Quality in Health Care, Sydney, NSW.
Sue Evans is supported by a National Health and Medical Research Council Public Health Fellowship (519580).
None identified.
- 1. National Health and Hospitals Reform Commission. A healthier future for all Australians: final report June 2009. Canberra: Department of Health and Ageing, 2009.
- 2. Australian Institute of Health and Welfare. Towards national indicators of safety and quality in health care. Canberra: AIHW, 2009. (AIHW Cat. No. HSE 75.)
- 3. Steering Committee for the Review of Government Service Provision. National Agreement performance information 2008-09: National Healthcare Agreement. Melbourne: Productivity Commission, 2009.
- 4. Evans SM, Bohensky M, Cameron PA, McNeil J. A survey of Australian clinical registries: can quality of care be measured? IntMed J 2011: 41; 42-48.
- 5. McNeil JJ, Evans SM, Johnson NP, Cameron PA. Clinical-quality registries: their role in quality improvement [editorial]. Med J Aust 2010; 192: 244-245. <MJA full text>
- 6. Glader E, Stegayr B, Norrving A, et al. Large variations in the use of oral anticoagulants in stroke patients with atrial fibrillation: a Swedish national perspective. J Intern Med 2004; 255: 22-32.
- 7. Asplund K, Hulter Asberg K, Norrving B, et al. Riks-stroke — a Swedish national quality register for stroke care. Cerebrovasc Dis 2003; 15 (Suppl 1): 5-7.
- 8. Terent A, Asplund K, Farahmand B, et al. Stroke unit care revisited: who benefits the most? A cohort study of 105,043 patients in Riks-Stroke, the Swedish Stroke Register. J Neurol Neurosurg Psychiatry 2009; 80: 881-887.
- 9. Lindstrom B, Röding J, Sundelin G. Positive attitudes and preserved high level of motor performance are important factors for return to work in younger persons after stroke: a national survey. J Rehabil Med 2009; 41: 714-718.
- 10. Glader EL, Sjolander M, Eriksson M, Lundberg M. Persistent use of secondary preventive drugs declines rapidly during the first 2 years after stroke. Stroke 2010; 41: 397-401.
- 11. Riks-Stroke. Use of Riks-Stroke data. (Last updated 8 Oct 2010.) http://www.riks-stroke.org/index.php?content=usage&lang=eng (accessed Mar 2011).
- 12. Irving MJ, Craig JC, Gallagher M, et al. Implementing iron management clinical practice guidelines in patients with chronic kidney disease having dialysis. Med J Aust 2006; 185: 310-314. <MJA full text>
- 13. Yeates KE, Cass A, Sequist TD, et al. Indigenous people in Australia, Canada, New Zealand and the United States are less likely to receive renal transplantation. Kidney Int 2009; 76: 659-664.
- 14. National Health and Medical Research Council Centre of Research Excellence in Patient Safety. Clinical Quality Registries in Australia. http://www.registries.org.au (accessed Mar 2011).
- 15. Pilcher DV, Duke GJ, George C, et al. After-hours discharge from intensive care increases the risk of readmission and death. Anaesth Intensive Care 2007; 35: 477-485.
- 16. Bagshaw SM, Bellomo R, Jacka MJ, et al. The impact of early hypoglycemia and blood glucose variability on outcome in critical illness. Crit Care 2009; 13: R91.
- 17. Chang SH, Russ GR, Chadban SJ, et al. Trends in kidney transplantation in Australia and New Zealand, 1993-2004. Transplantation 2007; 84: 611-618.
- 18. Scott IA. Why we need a national registry in interventional cardiology. Med J Aust 2008; 189: 223-227. <MJA full text>
- 19. Spaulding C, Morice MC, Lancelin B, et al. Is the volume-outcome relation still an issue in the era of PCI with systematic stenting? Results of the greater Paris area PCI registry. Eur Heart J 2006; 27: 1054-1056.
- 20. Cameron P, Gabbe B, Cooper D, et al. A statewide system of trauma care in Victoria: effects on patient survival. Med J Aust 2008; 189: 546-550. <MJA full text>
- 21. Victorian State Trauma Outcome Research and Monitoring (VSTORM) Group. Victorian State Trauma Registry 2008–09 Summary Report. Victoria: Department of Human Services, 2010.
- 22. Dhruva S, Bero L, Redberg RF. Strength of study evidence examined by the FDA in premarket approval of cardiovascular devices. JAMA 2009; 302: 2679-2685.
- 23. Australian Orthopaedic Association. Australian Orthopaedic Association National Joint Replacement Registry Annual Report 2009. Adelaide: University of Adelaide, 2009.
- 24. Australian Government Department of Health and Ageing. Review of health technology assessment in Australia. Canberra: Commonwealth of Australia, 2009.
- 25. Peterson ED, Roe MT, Rumsfeld JS, et al. A call to ACTION (Acute Coronary Teatment and Intervention Outcomes Network): a national effort to promote timely clinical feedback and support continuous quality improvement for acute myocardial infarction. Circ Cardiovasc Qual Outcomes 2009; 2: 491-499.
- 26. Fonarow GC, Abraham WT, Albert NM, et al. Influence of a performance-improvement initiative on quality of care for patients hospitalized with heart failure: results of the Organized Program to Initiate Lifesaving Treatment in Hospitalized Patients with Heart Failure (OPTIMIZE-HF). Arch Intern Med 2007; 167: 1493-1502.
- 27. Patterson ME, Hernandez AF, Hammill BG, et al. Process of care performance measures and long-term outcomes in patients hospitalized with heart failure. Med Care 2010; 48: 210-216.
- 28. Gliklich R, Dreyer NA, editors. Registries for evaluating patient outcomes: a user’s guide. 2nd ed. Rockville, MD: Agency for Healthcare Research and Quality, 2010. (AHRQ Publication No.10-EHC049.)
- 29. Pilcher DV, Hoffman T, Thomas C, et al. Risk-adjusted continuous outcome monitoring with an EWMA chart: could it have detected excess mortality among intensive care patients at Bundaberg Base Hospital? Crit Care Resusc 2010; 12: 36-41.
Abstract
Australia is developing a national performance framework aimed at measuring health outcomes across the health system.
Clinical registries provide a clinically credible means of monitoring health care processes and outcomes, yet only five Australian registries currently have national coverage.
At a national level, clinical registry development should be prioritised to target conditions or procedures that are suspected of being associated with large variations in processes or outcomes of care and that impact significantly on health care costs and patient morbidity.
Registries should also aim to capture information across care interfaces and to monitor the medium and long-term safety and effectiveness of specific devices, procedures and drugs.