Rapid changes in general practice have increased possibilities to diagnose and manage chronic diseases such as chronic obstructive pulmonary disease (COPD). Several national and international guidelines for COPD are available1-4 to help general practitioners with this.
“Monitoring”, or regular surveillance of patients’ health status, is a cornerstone of COPD management.5 Input of specialist knowledge into monitoring enables comparison of the process and outcome of care with evidence-based guidelines. It can also alert GPs to areas in which individual patient care falls short, and introduce explicit recommendations for management. Our group has demonstrated the effectiveness of expert-supported monitoring on the outcome of diabetes care in general practice.6
COPD management places a substantial demand on medical resources,7,8 and patient adherence is important to the success of treatment.9 Any expert-supported respiratory monitoring system depends on the cooperation of various groups (ie, GPs, specialists and patients), contains interacting components, and is, therefore, a complex intervention.10
We aimed to investigate the long-term effectiveness of a primary care monitoring system with respiratory expert recommendations for GPs’ management of patients with COPD, compared with usual care. We performed a detailed process evaluation along with the trial; elements of this evaluation are also reported here.
We conducted a multicentre parallel group study with a 24-month patient follow-up (www.clinicaltrials.gov NCT00542061). The trial took place from July 2005 to February 2008. We allocated general practices to intervention (ie, respiratory expert-supported COPD monitoring system) or usual care. All participants at each general practice were allocated to the same treatment group (cluster randomised design). We hypothesised that ongoing half-yearly monitoring with respiratory expert recommendations of patients with COPD would result in a clinically relevant gain in quality of life compared with usual care.
The study protocol was approved by the medical ethics committee of the Arnhem Nijmegen region in the Netherlands. All patients gave written informed consent.
We selected and invited study participants based on patient records already available at a regional diagnostic centre (RDC) in the south-western region of the Netherlands.
Inclusion criteria were:
patient diagnosed with COPD or asthma with persistent airflow obstruction, as confirmed with the patient’s most recent spirometry (forced expiratory volume in 1 second [FEV1]/forced vital capacity [FVC] < 70%, or postbronchodilator FEV1 < 80% predicted and ≥ 9% reversibility);11,12
the patient’s lung function data from the previous year were available at the general practice diagnostic centre; and
patient aged at least 25 years.
Exclusion criteria were:
patient treated by a chest physician;
patient participating in another respiratory intervention study;
GP considered it detrimental to the patient to participate in the study;
patient had any serious other non-pulmonary diseases (or disease stages) or pulmonary diseases (eg, sarcoidosis, lung cancer, lung fibrosis); or
patient could not read.
GPs at practices who had referred more than six patients to the RDC were contacted and asked to participate. We used computerised minimisation to allocate practices to the monitoring and usual care groups13,14 while stratifying for:
group versus solo practice;
practice nurse employed versus no practice nurse employed; and
≤ 10 versus > 10 patients fulfilling the study inclusion criteria.
A multilevel power calculation (ie, correction for clustering of subjects within general practices) was based on the mean difference in change in Chronic Respiratory Questionnaire (CRQ) score between monitoring and usual care. A difference of 0.5 points is generally accepted as a minimum important clinical difference for the CRQ score.15 We initially aimed to recruit 100 participants per group based on the following assumptions: an intracluster correlation coefficient of 0.04; α = 0.05; 1 2 β = 0.80; and a dropout rate of 25%.
The expert-supported COPD monitoring system had been in use in the RDC since 1995, and comprised several steps.
Step A. Patients with COPD were invited to the RDC for monitoring visits every 6 months. Pre- and post- (after inhaling 400 μg salbutamol) bronchodilator FEV1 and FVC were measured at each visit with a SpiroPerfect spirometer (WelchAllyn, Delft, The Netherlands) by certified lung function technicians. Body mass index was assessed, and information on respiratory symptoms, exacerbations, smoking and medication use in the previous 6 months was collected in a standardised way.
Step B. Information from the monitoring visit and previous visits was sent to a respiratory expert (chest physician or GP with special respiratory interest). The respiratory experts gave recommendations regarding treatment, additional diagnostic tests and referrals to other disciplines, based on national clinical practice guidelines for COPD and asthma.11,12 Experts’ interpretation based on spirometry results and written information has been shown to be valid.16
Step D. Ultimately, the patient should implement the recommendations made (eg, quit smoking, increase exercise).
Participants completed questionnaires at baseline, at 1 year, and at the end of the study. The primary study outcome was the CRQ score.17 Secondary outcomes were: CRQ domain scores; generic health-related quality of life (physical and mental domains of the Short-Form 12 [SF-12] and the EuroQol-5D);18-20 breathlessness according to level of exertion (Modified Medical Research Council [MMRC] score,2 dichotomised as 0–1 and 2–4); occurrence rate of self-reported exacerbations; and annual FEV1 decline.
For the process evaluation, the respiratory experts’ database was examined to collect data on their recommendations. The nurse consultant collected data on GPs’ implementation of recommendations. Patient questionnaires comprised questions about disease management. At the end of the study, the nurse consultant collected information on disease management from GPs in the usual care group.
Baseline characteristics for the participants in each group were compared using unpaired t tests, χ2 tests, and Mann–Whitney U tests, depending on the type of variable and normality of distribution.
Multilevel repeated measurement regression analysis was used to model the effect of monitoring on CRQ overall score, CRQ domain scores, SF-12 scores, EuroQol-5D scores, FEV1 decline, and dichotomised MMRC scores. We used a PROC MIXED procedure in SAS statistical software (SAS Institute, Cary, NC, USA), with general practice as the random coefficient and compound symmetry correlation structure. Multilevel logistic regression analysis was used to analyse effects on exacerbations. All models were corrected for sex, age, socioeconomic status, baseline cigarette smoking status, reversibility, exacerbations at baseline, use of inhaled corticosteroids, use of long-acting bronchodilators, and postbronchodilator FEV1 % of the predicted value. Participants were included in the analysis if they participated in the study (intention-to-treat analysis).
Box 1 shows the process of practice and patient recruitment and follow-up. Thirty-four general practices participated. From these, 261 of 286 eligible patients (91%) responded to the invitation, and 213 (74%) were willing to participate. No significant differences between participants and non-participants with regard to sociodemographic characteristics, medication use, and spirometric indices were found. Twenty-four patients did not enter the study, and 19 patients were excluded from analyses. Data from 170 participants were used for the analyses. Box 2 shows the baseline characteristics of both groups.
The study was originally designed to evaluate monitoring of patients with COPD and asthma with a chronic airflow obstruction. However, after the recruitment phase we found that almost all of the patients fulfilled the criteria for COPD (ie, FEV1/FVC < 70% postbronchodilator); therefore, we decided to focus on COPD.
Box 3 shows the mean overall CRQ scores in the monitoring and usual care groups. Based on repeated measurement analyses, the additional gain in CRQ score during follow-up was 0.004 points for monitoring compared with usual care (95% CI, −0.172 to 0.180). Box 4 summarises the results for the secondary outcomes. No significant differences between the monitoring and usual care groups were observed other than CRQ domain mastery.
A total of 292 visits took place among the monitoring group participants. Fifty-eight participants attended all four planned monitoring visits at the RDC (71%). Fifteen patients (18%) attended three, six patients attended two, and three patients attended one planned visit.
In total, respiratory experts gave 290 recommendations (Box 5). Smoking cessation was the most frequent recommendation (28% of all recommendations), and inhaler technique training and assessment of compliance with medical treatment were also recommended regularly. In 146 monitoring visits (50%), the respiratory experts did not consider any modification in disease management necessary. For 73 patients (89%), the GPs received at least one recommendation to change disease management.
Information about 274 of the 290 recommendations could be collected (Box 5). According to GPs, they attempted to implement 125 (46%) of the 274 recommendations. In practices with a practice nurse, the implementation rate of recommendations was higher than in practices without a practice nurse (P < 0.05); in particular, inhaler technique training and checking medication compliance were implemented more frequently (Box 5). The main reason why recommendations were not implemented was because patients did not visit the practice after their monitoring visit at the RDC. On 45 occasions, patients did not visit the GP after a monitoring visit that had resulted in at least one recommendation.
Changes in disease management are shown in Box 6. In general, only minor changes in disease management were achieved in the monitoring group, and these changes were comparable to usual care.
We did not find a clinical benefit for patients who received ongoing care according to a well structured respiratory expert-supported COPD monitoring system compared with usual care by GPs. The adherence of patients to the monitoring visits was good. In half the cases, the respiratory experts felt that disease management could be improved, and almost half the recommendations by respiratory experts were implemented by GPs. Non-adherence of patients to visiting the GPs and making lifestyle changes, and the low adherence of GPs to some recommendations (eg, referral to chest physician, chest x-ray) were the main barriers to the implementation of the expert recommendations.
All patients who were invited had previously visited the diagnostic centre for at least one lung function assessment. It may be argued that we did not find effects in the study because we studied the effect of monitoring on a population with pre-existing entry into the monitoring system, rather than the effect of monitoring on a newly diagnosed population. Essentially, we compared health effects in a control group that had discontinued monitoring with those in the treatment group that had continued and intensified monitoring. This might have resulted in less “room for improvement” compared with a “naïve” population of COPD patients. The inclusion of newly diagnosed patients could have resulted in better clinical results. However, our aim was to determine the long-term usefulness of disease monitoring. The evaluated monitoring system has already been implemented on a large scale in the Netherlands, and after patients with COPD have entered the service, they are usually followed for many years. Our results indicate that keeping an expert-supported monitoring system in place for years appears not to benefit COPD patients.
Moreover, it was not possible to blind GPs and patients in this study, as information on process and outcome was reported by them. Patients who are aware of their treatment assignment may expect certain benefits that may influence the outcome, especially when the outcome is influenced by individual opinions, as with quality of life. However, monitoring group participants reported no higher health-related quality-of-life scores compared with usual care group participants.
As far as we are aware, this is the first time the effectiveness of a COPD expert-supported monitoring system has been evaluated. However, other programs that focus on monitoring, like an integrated COPD and/or asthma management care model, a GP feedback system, and monitoring of health-related quality of life of patients with asthma and COPD, also did not result in clinical benefits, although some improvements in patient satisfaction and process outcomes were found.21-24 Other monitoring systems, such as monitoring of COPD by respiratory nurses in a general practice or a “patient-tailored” monitoring system, should be explored. Moreover, more information on the initial effect of the expert-supported monitoring system in newly diagnosed patients is needed (ie, including patients who were not already known to the RDC). It may be that the support system is able to put COPD management on track, and that after this initial support, GPs are sufficiently equipped to manage the patients.
The question remains whether the lack of effect was due to implementation failure — and therefore the system has the potential to be effective if implementation could be improved — or was a result of an ineffective intervention.10 Many participants failed to visit the GP, although the adherence rate to GP visits was significantly higher in general practices that invited patients for regular visits. Moreover, the presence of a practice nurse resulted in higher implementation levels. Therefore, implementation can be improved, but it is not possible to fully prevent dilution of effects in the process of monitoring and feedback. Options to reduce disease progression are limited in COPD.25,26 Moreover, little evidence exists that chronic disease management in primary care patients with COPD is effective.27 Potential effects are further diminished by the low adherence of the participants to health behaviour recommendations, which is in concordance with other studies.25,28
In conclusion, an ongoing respiratory expert-supported monitoring system for patients with COPD was not effective in terms of clinical outcomes. The lack of effectiveness may have been the result of a combination of limited options to intervene, the diluting effect on the intervention caused by the many steps in this complex process, and the low adherence of patients to crucial recommendations such as smoking cessation.
1 Flow chart of practice and participant recruitment, inclusion and drop-out
![]() |
* According to the patient’s general practitioner. † Analyses were based on the intention-to-treat principle. |
2 Baseline characteristics of participants
Monitoring group |
Usual care group |
||||||||||||||
Age in years, mean (SD) |
62 (10.5) |
64 (10.5) |
|||||||||||||
Male |
56* |
47 |
|||||||||||||
Post-BD FEV1 % of predicted |
70†‡ |
77 |
|||||||||||||
Post-BD FEV1/FVC |
61*‡ |
65 |
|||||||||||||
Short-acting BDs |
33‡ |
26 |
|||||||||||||
Long-acting BDs |
52‡ |
58 |
|||||||||||||
ICS |
59‡ |
65 |
|||||||||||||
Smoking |
|
|
|||||||||||||
Yes |
53† |
40 |
|||||||||||||
No |
6 |
18 |
|||||||||||||
Former smoker |
23 |
30 |
|||||||||||||
Pack-years, mean (SD) |
27.5 (21.8)* |
20.7 (18.1) |
|||||||||||||
MMRC score |
|
|
|||||||||||||
0 |
11‡ |
16 |
|||||||||||||
1 |
36 |
30 |
|||||||||||||
2 |
26 |
35 |
|||||||||||||
3 |
6 |
5 |
|||||||||||||
4–5 |
2 |
2 |
|||||||||||||
≥ 1 exacerbations in past year |
16§ |
17 |
|||||||||||||
BD = bronchodilator. FEV1 = forced expiratory volume in 1 second. FVC = forced vital capacity. ICS = inhaled corticosteroids. MMRC = Modified Medical Research Council. * Difference between monitoring group and usual care group significant; P < 0.05. † Difference between monitoring group and usual care group significant; P < 0.01. ‡ One missing value. § Two missing values. |
3 Mean CRQ score (95% CI) of expert-supported COPD monitoring compared with usual care at baseline and at 1 and 2 years
![]() | |||||||||||||||
COPD = chronic obstructive pulmonary disease. |
4 Effects of expert-supported chronic obstructive pulmonary disease monitoring compared with usual care on outcomes of respiratory health and quality of life
A. Mean (95% CI) at baseline, change (95% CI) at follow-up, and difference between groups (95% CI) for continuous variables
|
Monitoring group |
Usual care group |
Adjusted incremental 2-year change* |
MICD |
|||||||||||
|
Baseline (n = 82) |
Change at 2-year follow-up (n = 76) |
Baseline (n = 88) |
Change at 2-year follow-up (n = 80) |
|||||||||||
Overall CRQ score |
5.1 (4.9 to 5.3) |
0.12 (− 0.02 to 0.26) |
5.3 (5.2 to 5.5) |
0.12 (0.00 to 0.24) |
|
|
|||||||||
CRQ domain dyspnoea |
4.9 (4.6 to 5.3)† |
0.30 (0.10 to 0.50) |
5.4 (5.1 to 5.7)‡ |
0.29 (0.07 to 0.50)‡ |
0.018 (− 0.24 to 0.27) |
0.5 |
|||||||||
CRQ domain fatigue |
4.9 (4.7 to 5.2) |
− 0.09 (− 0.32 to 0.13) |
5.1 (4.9 to 5.3) |
0.13 (− 0.09 to 0.34) |
− 0.236 (− 0.54 to 0.07) |
0.5 |
|||||||||
CRQ domain emotions |
5.4 (5.2 to 5.6) |
0.08 (− 0.11 to 0.27) |
5.5 (5.3 to 5.7) |
0.09 (− 0.06 to 0.24) |
− 0.005 (− 0.26 to 0.25) |
0.5 |
|||||||||
CRQ domain mastery |
4.8 (4.7 to 5.0)§ |
0.17 (0.02 to 0.33) |
5.1 (4.9 to 5.3) |
− 0.03 (− 0.16 to 0.11) |
0.223† (0.02 to 0.42) |
0.5 |
|||||||||
SF-12 physical scale |
44.5 (43.0 to 46.1)¶ |
− 1.44 (− 2.98 to 0.10)‡ |
43.8 (42.3 to 45.4)** |
− 0.16 (− 1.73 to 1.42)†† |
− 1.323 (− 3.40 to 0.75) |
3–5 |
|||||||||
SF-12 mental scale |
52.2 (50.2 to 54.1)¶ |
0.09 (− 1.85 to 2.03)‡ |
52.7 (51.1 to 54.2)** |
− 0.23 (− 1.94 to 1.49)†† |
0.324 (− 2.24 to 2.89) |
3–5 |
|||||||||
EuroQol-5D score |
0.89 (0.86 to 0.92) |
− 0.02 (− 0.05 to 0.01) |
0.87 (0.84 to 0.89) |
0.00 (− 0.03 to 0.03) |
− 0.022 (− 0.07 to 0.02) |
0.07 |
B. Frequency (no. [%]) of categorical variables at baseline and follow-up, and odds ratios
Monitoring group |
Usual care group |
Odds ratio |
|||||||||||||
Baseline (n = 82) |
2-year follow-up (n = 76) |
Baseline (n = 88) |
2-year follow-up (n = 80) |
||||||||||||
MMRC score ≥ 2 |
8 (9.9%)¶ |
12 (15.8%) |
7 (8.0%) |
10 (12.7%)¶ |
1.05 (0.34–3.24) |
||||||||||
≥ 1 exacerbations in previous year |
16 (20.0%)‡ |
12 (15.8%) |
17 (19.8%)‡ |
10 (12.7%)¶ |
0.87‡‡ (0.38–2.11) |
||||||||||
CRQ = Chronic Respiratory Questionnaire. SF-12 = Short-Form 12. MICD = minimum important clinical difference. MMRC = Modified Medical Research Council. |
5 Number of times a respiratory expert recommended each disease management change, and general practitioner adherence to recommendations overall and in practices with and without a practice nurse
Recommendation |
Expert recommendations |
Recommendations evaluated* |
GPs’ adherence |
||||||||||||
Overall |
Practices with nurse† |
Practices without nurse† |
|||||||||||||
Cease smoking |
82 |
78 |
44 |
25/47 |
19/31 |
||||||||||
Optimise physical condition |
21 |
20 |
6 |
2/5 |
4/15 |
||||||||||
Avoid allergens and triggers |
4 |
4 |
3 |
1/1 |
2/3 |
||||||||||
Check inhaler technique |
47 |
45 |
21 |
15/23 |
6/22 |
||||||||||
Check treatment compliance |
49 |
46 |
29 |
18/25 |
11/21 |
||||||||||
Reduce bodyweight |
4 |
3 |
1 |
1/2 |
0/1 |
||||||||||
Introduce ICS |
15 |
14 |
5 |
2/7 |
3/7 |
||||||||||
Increase ICS dosage |
6 |
6 |
3 |
1/2 |
2/4 |
||||||||||
Reduce dosage or cease ICS |
10 |
10 |
6 |
6/10 |
0/0 |
||||||||||
Introduce short-acting BD |
1 |
1 |
1 |
1/1 |
0/0 |
||||||||||
Introduce long-acting BD |
10 |
8 |
0 |
0/4 |
0/4 |
||||||||||
Additional diagnostic procedures |
3 |
3 |
0 |
0/2 |
0/1 |
||||||||||
Chest x-ray |
14 |
13 |
3 |
1/8 |
2/5 |
||||||||||
Refer to chest physician |
24 |
23 |
3 |
1/9 |
2/14 |
||||||||||
Total |
290 |
274 |
125 |
74/146‡ |
51/128 |
||||||||||
Adherence = GP attempted to implement recommendation. BD = bronchodilator. ICS = inhaled corticosteroids. * Eleven recommendations were not discussed by GPs and three GPs’ responses were missing. † No. of GPs adhering to recommendation/no. of recommendations evaluated in each type of practice. ‡ Difference between practices with and without practice nurses is significant; P < 0.05 (χ2 test). |
6 Chronic obstructive pulmonary disease management by general practitioners and patients in the second year of the study
|
Monitoring group (n = 82) |
Usual care group (n = 86) |
|||||||||||||
|
Recommendations* |
Implementation† |
Recommendations* |
Implementation† |
|||||||||||
Cease smoking‡ |
14 |
3 |
13 |
0 |
|||||||||||
Increase bodyweight |
1 |
1§ |
0 |
— |
|||||||||||
Reduce bodyweight |
16 |
0§ |
12 |
0§ |
|||||||||||
Increase physical exercise |
13 |
na¶ |
7 |
na¶ |
|||||||||||
Check treatment compliance |
— |
22* |
— |
20* |
|||||||||||
Check inhaler technique |
— |
14* |
— |
18* |
|||||||||||
Introduce/increase ICS dosage** |
— |
4 |
— |
5 |
|||||||||||
Reduce dosage or cease ICS** |
— |
4 |
— |
3 |
|||||||||||
Introduce short-acting BD** |
— |
7 |
— |
5 |
|||||||||||
Introduce long-acting BD** |
— |
11 |
— |
8 |
|||||||||||
Chest x-ray** |
— |
6 |
— |
5 |
|||||||||||
Refer to chest physician |
9 |
9*† |
6 |
6* |
|||||||||||
BD = bronchodilator. ICS = inhaled corticosteroids. na = not applicable. Recommendations = by GPs.
In monitoring group, these were based on expert recommendation or own initiative. |
Received 13 April 2009, accepted 19 June 2009
Abstract
Objective: To investigate the long-term effectiveness of a general practice monitoring system with respiratory expert recommendations for general practitioners’ management of patients with chronic obstructive pulmonary disease (COPD), compared with usual care.
Design, settings and participants: A multicentre randomised controlled trial of patients with COPD, clustered by general practices; 200 participants were recruited to maintain at least 75 participants per group for analysis. The trial took place from July 2005 to February 2008 in the south-western region of the Netherlands.
Intervention: Ongoing half-yearly monitoring of COPD patients with respiratory expert recommendations for the GP was compared with usual care.
Main outcome measures: Primary outcome — Chronic Respiratory Questionnaire (CRQ) score; secondary outcomes — CRQ domain scores, generic health-related quality of life (Short-Form 12 and EuroQol-5D), breathlessness (Modified Medical Research Council score), exacerbations, and decline in forced expiratory volume in 1 second. A detailed process evaluation was performed along with the trial.
Results: Data from 170 participants were analysed. Based on repeated measurement analyses, the additional gain in CRQ score during follow-up was 0.004 points for monitoring compared with usual care (95% CI, − 0.172 to 0.180). Also, no important differences between monitoring and the usual care group were found for secondary outcomes. Half the monitoring visits resulted in disease management recommendations by a respiratory expert, and 46% of these recommendations were implemented by the GPs. Patient adherence to lifestyle recommendations was low.
Conclusion: An expert-supported monitoring system for patients with COPD was not clinically effective. As patients had a pre-existing entry in the monitoring system, the population may be well regulated, with reduced room for improvement.
Trial registration: www.clinicaltrials.gov NCT00542061.