Osteoarthritis (OA) is a degenerative joint disease and is one of the 10 most disabling diseases in developed countries.1 Self-report data suggest that 15% of Australians have arthritis, and much of this burden is OA.2 A major cause of pain, disability and use of health care resources among middle-aged and older people, the costs associated with ongoing care of patients with OA in terms of medications, days lost from work, and cost of long-term care facilities are high.3 There is no known cure for OA, but there is an abundance of evidence available to guide diagnosis and management, and many clinical practice guidelines (CPGs) exist at the local, national and international level.
The use of evidence-based CPGs to inform clinical practice is increasing throughout the world.4 Evidence-based CPGs have the potential to improve the quality of health care by promoting interventions of proven benefit and discouraging unnecessary, ineffective or harmful interventions.5 CPG developers are encouraged to employ evidence-based principles6,7 and undertake consultation with relevant stakeholders, and peer review, dissemination and implementation, and review and updating of the resultant CPG.6,7 CPG development groups should include consumer representatives as well as relevant clinical and methodological experts. The comprehensive nature of this process means that developing evidence-based CPGs can take time and be costly.
Despite this, national and international organisations are increasingly developing their own CPGs, potentially leading to multiple CPGs on the same topic, which may not be consistent in their recommendations or quality.7 Duplication of CPGs within the same clinical area has been demonstrated in type 2 diabetes,8 acute low back pain9 and lower-limb OA,10-12 where the recommendations are consistent among CPGs, but the evidence underpinning these recommendations varies.8 Methodological quality of CPGs is found to vary considerably. Overall quality and transparency of CPG development processes, and consistency in reporting is poor.9-12 While there have been descriptive overviews of CPGs for OA of the hip and/or knee, these reviews have not performed comprehensive searches and therefore only contain a subset of available relevant CPGs, and often conclude with a call for more CPGs.
This descriptive overview of CPGs for OA was conducted within a larger study evaluating a collaborative method to promote best practice in management of OA of the hip and/or knee in Victorian general practices.13 One outcome of this larger study was a key messages table (available at http://www.cochrane.org.au/projects/osteo_guidelines.php) that comprised a summary of CPG recommendations. This project was funded by a grant from the Australian Government Arthritis and Musculoskeletal Quality Improvement Program.
A systematic search was conducted of relevant databases and websites from 1966 to August 2005 (Box 1). Search terms included: osteoarthritis knee; osteoarthritis hip; practice guideline/s; guideline/s; and combinations of these terms.
CPGs were included if they dealt with diagnosis and/or management of OA of the hip and/or knee in any setting. Original CPGs and their corresponding updates were included and assessed independently of each other. Narrative and systematic reviews, primary research, economic modelling, editorials, letters and comment articles were excluded.
The quality of included CPGs was assessed independently by two appraisers using the Appraisal of Guidelines Research and Evaluation (AGREE) instrument.14 This instrument is a result of a collaboration of international researchers and policymakers from 13 countries which was formed in the mid 1990s to develop an internationally recognisable framework to assess the quality of CPGs. The resultant AGREE instrument is designed to assist guideline developers, users and those wishing to critically appraise CPGs, and consists of 23 items separated into six domains according to a dimension of guideline quality. We used the instrument and accompanying user guide (containing definitions and additional information for each item) in this overview to score each item in each domain. Using the AGREE protocol, we scored items on a four-point Likert scale with the following range: 4 (strongly agree); 3 (agree); 2 (disagree); 1 (strongly disagree). Domains were scored by summing all the item scores in a domain and standardising the total as a percentage of the maximum possible score for that domain. The AGREE instrument states that it is not possible to set thresholds for the domain scores to conclude that a guideline is good or bad. Instead, the domain scores can be used to help decide whether the guideline should be strongly recommended (if over half of the domains score > 60%), recommended (most of the domains score > 30%) or not recommended (most of the domains score < 30%). The most positive category was chosen in the case of a tie (ie, CPGs were recommended if half of the domains scored < 30% and half of the domains scored > 30%). Disagreements between appraisers were resolved through discussion until consensus was reached.
Recommendations were defined as evidence-based statements that promote or advocate a particular course of action in clinical practice. From each CPG, recommendations were extracted and categorised as: assessment and diagnosis; pharmacological management; nonpharmacological management; complementary/alternative therapy; or surgery.
Our search yielded a total of 291 potentially relevant articles. Of these, 193 were retrieved from databases and 98 from websites that specifically publish CPGs. Of the 291 potentially relevant articles, 242 were excluded after screening the titles and abstracts, leaving 49 to be assessed based on the full text version of the article. Of those 49 articles, 34 CPGs were identified for management of OA of the hip and/or knee and were included in this overview (Box 2).
CPGs varied considerably in format, coverage and scope. For example, some CPGs provided detailed information about indicators for diagnosis, while other CPGs were limited to a brief list of indicators only. Similarly, the scope varied, with some CPGs being limited to a specific management modality (pharmacological management) while others included more than one or all possible management modalities (pharmacological, nonpharmacological and surgery). Irrespective of the organisation that developed the CPG, population, coverage or scope, most CPGs had similar recommendations for aspects of diagnosis and treatment of OA of the hip and/or knee.
The evaluation of the methodological quality of the CPGs included in our overview, by means of the AGREE instrument,14 is summarised in Box 2. Disagreements between appraisers were rare, and were only in the order of one item score, where the disagreement was between “agree” and “strongly agree” or “disagree” and “strongly disagree”, but not between “agree” and “disagree”.
Despite the considerable variation in quality among the CPGs, six CPGs were appraised as “strongly recommended”: (i) an Australian (Clinical Epidemiology and Health Service Evaluation Unit) evidence-based clinical pathway for best practice management of OA of the hip and knee;17 (ii) the Ontario Program for Optimal Therapeutics guideline;18 (iii) the American Pain Society guideline;19 (iv) the American Geriatric Society Panel on Persistent Pain in Older Persons guideline;20 (v) the American Geriatric Society Panel on Exercise and Osteoarthris guideline;21 and (vi) the MOVE consensus guideline.22
A detailed list of recommendations for diagnosis and management with supporting evidence in the form of reference lists for each recommendation was compiled and is available at <http://www.cochrane.org.au/projects/osteo_guidelines.php>.
There is substantial investment in the development and dissemination of CPGs to inform clinical practice and promote effective health care.4 Multiple CPGs on the same topic are being developed by various local, national and international organisations, and these CPGs are not necessarily consistent in either their recommendations or their quality.7 Where recommendations are consistent, the duplication of effort is time- and resource-intensive and potentially wasteful; where inconsistent, they can provide conflicting treatment recommendations.23 Ideally, the quality of CPGs, as assessed by a validated framework, should be consistent across CPGs regardless of topic or setting.
Given the consistency among recommendations in existing CPGs, and the time-intensive and resource-intensive nature of CPG development, a possible approach for future guidance in this setting is the adaptation of existing high-quality CPGs to local contexts. This could form one step in an overall implementation strategy to ensure sustainable quality of care for patients with OA. Adaptating CPGs to local contexts, facilitated by key local knowledge translation experts who have experience in applying evidence to a local setting, also has the potential to lead to better uptake of CPGs. Adaptation of CPGs should be systematic and transparent, should involve stakeholders, and should report the key factors that influence decisions, including those in the original CPG, and the reasons for any modifications that are made.24 Steps often lacking in the original development process, such as piloting of CPGs among target users, patient input and review, auditing, external review, consideration of organisational barriers, cost implications and updating plans can be addressed in the adaptation process.
An example of a framework for identifying CPGs for local adaptation is ADAPTE.25 ADAPTE is useful for determining whether to adapt an existing CPG by means of a step-by-step process that promotes the use of evidence-based and rigorous development principles, and introduces concepts for adapting CPGs from their original setting to different contexts, whether cultural or organisational.25 Adaptation of CPGs is addressed in varying levels of detail in handbooks for preparing CPGs from the Council of Europe, the National Health and Medical Research Council (Australia), the National Institute for Clinical Excellence (UK), the New Zealand Guidelines Group and the Scottish Intercollegiate Guidelines Network.26
There have been cases where high-quality CPGs have been adapted to the local context and implemented successfully into clinical practice. One such model is the Australian-based Health for Kids (HFK) project that is designed to improve health care for children through best practice and partnerships among medical, nursing and allied health clinicians and consumers.27 The HFK model involves key local CPG development specialists adapting existing high-quality CPGs for local use, and has been implemented in the care of asthma and diarrhoea.28
1 Databases and websites that specifically publish clinical practice guidelines that were searched for this review
National Guideline Clearinghouse
The National Electronic Library for Health Guidelines Finder
Medical Journal of Australia Clinical Guidelines
National Health and Medical Research Council Publications
New South Wales Therapeutics Assessment Group
Therapeutic Guidelines
Therapeutic Goods Administration
Canadian Medical Association Clinical Guidelines
Centers for Disease Control and Prevention Guidelines
Queensland University Clinical Practice Guidelines
New Zealand Guidelines Group
Primary Care Clinical Guidelines (United States)
Scottish Intercollegiate Guidelines Network
PRODIGY (now called NHS [National Health Service] Clinical Knowledge Summaries)
Abstract
Objective: To present a descriptive overview of the quality and recommendations of clinical practice guidelines (CPGs) on diagnosis or management of osteoarthritis (OA) of the hip and/or knee.
Data sources: CPGs were identified from several research databases (MEDLINE, EMBASE and The Cochrane Library) and guideline-specific databases from 1966 to August 2005.
Guideline retrieval: Thirty-four relevant CPGs were identified.
Data extraction: Recommendations were extracted from CPGs and categorised into: assessment and diagnosis, pharmacological management, nonpharmacological management, complementary/alternative therapy, or surgery. The quality of the CPGs were assessed by two appraisers using the Appraisal of Guidelines Research and Evaluation (AGREE) instrument.
Data synthesis: Most recommendations for aspects of diagnosis and treatment of OA of the hip and/or knee were consistent among the CPGs included in this study. However, quality varied considerably, with few CPGs being “strongly recommended” according to the AGREE quality appraisal instrument.
Conclusions: Given the number of CPGs available relevant to OA, and the consistency of recommendations within them, and considering the time and resources required for CPG development, future efforts to guide management of OA of the hip and/or knee may be better directed towards adapting existing CPGs to the local context, implementing practices known to be effective, and facilitating research to answer important questions where there is little evidence.