Progress in virtual reality simulators for surgical training and certification

Over the past decade, published studies have shown the benefits of using simulation for educating trainee surgeons, rather than traditional operating-room training methods with actual patients.1 Having fewer trainees in operating rooms not only lowers costs,2 but also reduces the risks and discomfort to the patient caused by the inexperience of trainee surgeons and their longer operating times. Apart from lowering costs, training by simulation provides unique benefits that training with patients cannot provide. These include:

• opportunities for controlled exposure — the instructor has control over the order, frequency and complexity of the training;

• easily defined metrics for assessing proficiency levels;

• “beyond real” capabilities; for example, case simplification, which lets trainees learn specific components of a procedure;1 and

  1. Hutchins M, Adcock M, Stevenson D, et al. The design of perceptual representations for practical networked multimodal virtual training environments. Proceedings of the 11th International Conference on Human–Computer Interaction; 2005 July 22-27; Las Vegas, USA. Philadelphia: Taylor & Francis Group LLC (Lawrence Erlbaum Associates, Inc), 2005.

• the possibility of continuing a simulated procedure after a mistake has been made, so trainees can learn to recognise when they are on a path to failure.

Existing surgical simulators vary in complexity, with different types suited to the various stages of surgical training. For providing surgeons-in-training with basic technical skills, the primary choice is the Box or part-task trainer, as used in the Fundamentals of Laparoscopic Surgery program of the Society of American Gastrointestinal Endoscopic Surgeons.3 More complex types of simulation are needed to practise the specific techniques and procedures encountered in surgery, and, traditionally, animal and cadaver models have been used. However, acquiring and maintaining high-level skills and gaining accreditation still involves, almost without exception, actual patients. Could current and future developments in computer-based or virtual reality (VR) simulators make them suitable for these purposes?

We discuss here the role of VR simulators in surgical training: their current limitations and potential uses, and the requirements for their progression into high-level skills training and increased incorporation into medical curricula.

VR simulators have so far played a fairly limited role in surgical training, mainly because existing VR simulators still fall behind “physical” simulators in several areas. For example, they are considerably more expensive than surgical Box trainers, and cannot yet match them for training certain tasks, such as laparoscopic suturing. They also cannot match animal and cadaver models for tissue behaviour, haptic (tactile) feedback and anatomical realism. Nevertheless, VR simulators have some distinct potential advantages over other simulation types. Metrics are much easier to specify and can be defined in much greater detail, a feature that offsets some of the price difference between VR simulators and Box trainers. Continuing after a mistake has been made is not costly, unlike in animal or cadaver models, and, in general, VR simulators have the potential to be less costly, more available, and do not have the ethical dilemmas of animal and cadaver models.

A comprehensive 2007 review of VR simulators for laparoscopy and colonoscopy training reported that current simulators were still too expensive and too “gameable” (ie, they allowed for too much rote learning, making them unsuitable for advanced skills training).4 In addition, further validation and opportunities for incorporating VR simulators into curricula were needed.4 Another recent study reached similar conclusions — that current VR simulators show benefits for novice-to-intermediate training in colonoscopy and can be used to distinguish experts from novices, but they are not yet ready to replace traditional training or be used for accreditation.5

However, there are now some strong indicators pointing to an expanding role for VR simulators. According to a prospective randomised controlled trial published in 2009, VR simulators are already not only providing basic skills and part-task training at the novice level, but also increasingly at the intermediate skills level, with VR training able to take novices to the performance level of a laparoscopist with intermediate experience.6

Supporting this expanding role are the continuing advances in the technologies underlying VR simulation, driven mainly by the games and entertainment industries. Developments in these industries have led to the availability of hardware and software that can provide much more realistic simulation models than those currently in use. Evidence for this can already be seen in the next generation of simulator prototypes showcased in recent journals and conferences,7,8 such as the colonoscopy simulator currently being developed at the CSIRO (Commonwealth Scientific and Industrial Research Organisation) Australian e-Health Research Centre. This makes use of the “massively parallel” processing power of current graphics processing units to provide highly detailed, dynamic interactive models of the colon and the colonoscope (Box).7

There is also continuing growth in simulation in the aviation industry and the military. Recently, large aviation training companies, such as CAE Inc, have ventured into the medical simulation field. Clearly, there are some substantial differences between aviation training and surgical training that prevent a simple transition to surgery of the technologies that have made VR simulators pivotal in assessing and maintaining high-level aviation skills. One of the main differences is in the modelling of the underlying physics, which, in aviation, is much better understood and less prone to large naturally occurring variations. Nevertheless, there are also some basic similarities, as both applications simulate interaction with a complex environment, potentially under stressful conditions with lives at stake. Furthermore, aviation companies bring into the field of medical simulation extensive technological experience and considerable budgets. What is required to turn this potential into the next level of medical simulators?

For a VR simulator to be effective as an advanced surgical training and assessment tool, it needs to provide adequate and relevant levels of physical realism, case complexity and performance assessment, with validation that use of the simulator is actually teaching and assessing the appropriate skills.

Physical realism includes visual, haptic and dynamic realism. A plastic-looking organ may be acceptable for practising basic coordination and manipulation tasks but, for more advanced training, organs, tissues and their environment need to be visualised with much more accurate detail, texture and colour, to show, for example, the different stages of a pathological condition. Accurate haptic, or force, feedback is crucial in procedures that rely on what a surgeon feels as much as what he or she sees. As the level of tolerable force varies greatly between patients and different pathological conditions, clinicians have to be cognisant of force sensitivity.

The final aspect of realism concerns dynamic accuracy. Organs not only need to look and feel realistic, they also need to behave as they would in real life, when forces are exerted on them; otherwise the trainee might be learning incorrect or even dangerous tissue or organ manipulation techniques. Hence, the underlying physical models determining the deformation of virtual organs and tools must be sound.

As every patient is different, and each patient’s pathological condition is subject to change, a great variety of case complexity is required to train advanced skills levels. A simulator that can only generate a few scenarios may only teach the trainee to “rote learn” the map to a specific scenario solution, not how to recognise which aspects of a procedure affect its progress and outcome and in which way. Hence, the simulator must be able to provide a significant variety of case scenarios in all aspects of the simulated procedure (ie, variations in pathology, anatomy, appearance, physical properties and complications). However, it must also be able to repeat a scenario exactly, as it is crucial for trainees, and trainers, to analyse mistakes and learn from them, as shown by Issenberg et al9 in their analysis of the features of high-fidelity simulations that lead to effective learning.

Performance assessment is important in the learning process, and essential in certification. To allow for objective assessment of a trainee’s performance, the simulator must be able to define appropriate metrics from the simulated task for qualitative assessment purposes. These metrics must be relevant to the procedure being trained, as well as accurate and validated. To provide trainees with a fair assessment relative to their peers, exam scenarios must be repeatable within certain limits and validated. Assessment should be used to provide comprehensive feedback to the trainee, as this is the most important feature of effective learning.9

Validation of any simulator requires a controlled trial, with the performance of a simulator-trained cohort of trainees compared with that of a traditionally trained cohort. Furthermore, validation of simulator-based certification will require comparison with traditional certification or assessment by experts.

Without this validation, no certifying body, trainer, trainee or patient will accept VR simulators.

The expectation for the next generation of simulators is to advance into the critical roles of high-level training and certification, with the aim of reducing the cost of training clinicians and improving patient safety. To achieve this requires both greater understanding of the tasks to be learnt and the right simulators to develop appropriate high-stakes simulations. Pressure is now on the simulation industry to incorporate the requirements identified and realise the potential for VR simulation.

The medical profession needs to increase its willingness to integrate VR simulators into curricula alongside current surgical training methods. Fortunately, more and more centres around the world are mandating a certain amount of training on simulators before allowing training with patients, yet the “see one, do one, teach one” paradigm is still the predominant approach in surgical training. The benefits of VR simulation over traditional training methods, such as reducing costs, eliminating ethical dilemmas, and prioritising patient comfort and safety, mean that we cannot afford not to demand and develop validated VR simulation-based assessment.