Onsite “buddies” are not always available to monitor the donning and doffing of personal protective equipment (PPE) in hospitals, especially during a pandemic, potentially leading to poor PPE compliance and increased risk of health care infections.1,2 We therefore compared monitoring of PPE donning/doffing procedures in a standard critical care setting3,4 by remote buddies with monitoring by onsite buddies.
We designed 30 procedural scenarios (15 donning, 15 doffing) that included random errors in some procedural steps (online Supporting Information). Four buddies (two onsite, two remote), unaware of the number and type of errors in each scenario, concurrently viewed and assessed each step. The remote buddies viewed the procedures via videoconferencing on their computers. The camera of the transmitting laptop computer was positioned so that the entire body of the person donning or doffing PPE could be seen. Procedures were live‐streamed to the remote buddies via the hospital Wi‐Fi network. The buddies were not permitted to communicate with each other or with the person donning or doffing PPE. The study was approved by the Melbourne Health Human Research Ethics Committee (QA2020104).
Sensitivity (correctly identifying correct procedure) was 100% for both onsite and remote buddies; specificity (correctly identifying incorrect procedure) was 98.9% for onsite buddies and 94.5% for remote buddies; overall accuracy was respectively 99.7% and 98.7% (Box). Concordance between assessments by onsite and remote buddies (κ = 0.95), by the two onsite buddies (κ = 0.97), and by the two remote buddies (κ = 0.98) was very good. The most frequent error was remote buddies missing chin exposure below the mask, probably because of the two‐dimensional view provided by the camera. Paying specific attention to the mask position when the donner turns side on in front of the camera might prevent this error.
Practical considerations for remote buddies include the need for reliable hospital network and internet connections, or a wired hardware system, to avoid disruption of monitoring. As the remote buddy is unable to physically intervene when they identify an error, clear verbal communication is important. The psychological effect of having an onsite buddy was not characterised, but may influence user acceptability of remote buddies.
All buddies were very experienced in providing observation feedback, but we did not assess their proficiency. Their accuracy may also have reflected greater vigilance while being observed (the Hawthorne effect). Finally, we did not weight the donning and doffing steps according to their importance for safety.
Having a trained observer monitor PPE compliance is important for health care safety. The high level of accuracy and the agreement between onsite and remote buddies were encouraging. Apart from identifying errors, remote buddies could also provide step‐by‐step instruction in donning and doffing procedures, which could improve compliance and minimise contamination.5 Using remote buddies may help preserve PPE supplies and ensure reliable access to monitoring, even when PPE supply or onsite staff numbers are limited, while also reducing the infection exposure risk for the monitoring observers.
Box – Personal protective equipment (PPE) monitoring assessment accuracy by onsite and remote buddies
|
Scenario outcome* |
|
|||||||||||||
Buddy outcome* |
Pass |
Fail |
|
||||||||||||
|
|||||||||||||||
Onsite buddies (390 tests) |
|
|
|
||||||||||||
Pass |
298 |
1 |
PPV, 99.7% |
||||||||||||
Fail |
0 |
91 |
NPV, 100% |
||||||||||||
|
Sensitivity, 100% |
Specificity, 98.9% |
Overall accuracy, 99.7% |
||||||||||||
Remote buddies (383 tests†) |
|
|
|
||||||||||||
Pass |
292 |
5 |
PPV, 98.3% |
||||||||||||
Fail |
0 |
86 |
NPV, 100% |
||||||||||||
|
Sensitivity, 100% |
Specificity, 94.5% |
Overall accuracy, 98.7% |
||||||||||||
|
|||||||||||||||
PPV = positive predictive value; NPV = negative predictive value. * For each step of each PPE donning/doffing procedure: pass = correctly performed; fail = not correctly performed. † Seven assessments were missing because of internet interruptions. |
Received 28 November 2020, accepted 29 March 2021
- 1. Mulvey D, Mayer J, Visnovsky L, et al. Frequent and unexpected deviations from personal protective equipment guidelines increase contamination risks. Am J Infect Control 2019; 47: 1146–1147.
- 2. Tomas ME, Kundrapu S, Thota P, et al. Contamination of health care personnel during removal of personal protective equipment. JAMA Intern Med 2015; 175: 1904–1910.
- 3. United States Department of Labor, Occupational Safety and Health Administration. Personal protective equipment: general requirements [Occupational Safety and Health Standard 1910.132]. https://www.osha.gov/laws-regs/regulations/standardnumber/1910/1910.132 (viewed Mar 2021).
- 4. Australian Government. Guidance on the minimum recommendations for the use of personal protective equipment (PPE) in hospitals during the COVID‐19 outbreak; version 9. Nov 2020. https://www.health.gov.au/sites/default/files/documents/2020/11/guidance-on-the-use-of-personal-protective-equipment-ppe-in-hospitals-during-the-covid-19-outbreak.pdf (viewed May 2021).
- 5. Saran S, Gurjar M, Garg A. Identifying and implementing strategies to reduce the risk of self‐contamination of health care workers caused by doffing of personal protective equipment during the COVID‐19 pandemic. Disaster Med Public Health Prep 2020; https://doi.org/10.1017/dmp.2020.396.
We acknowledge Paul Mezzavia (Royal Melbourne Hospital), Roni Krieser (Royal Melbourne Hospital) and Keat Lee (Royal Melbourne Hospital; University of Melbourne) for their contributions to this study.
No relevant disclosures.