Importance of critical events training for anesthesiology residents: experience with computer simulator

Abstracts

JUSTIFICATIVA E OBJETIVOS: Em decorrência da grande evolução da monitorização e do arsenal terapêutico disponível nos últimos anos, houve uma redução na incidência de eventos adversos durante procedimentos anestésicos. Porém, continua importante o treinamento dos médicos residentes para este tipo de ocorrência. O objetivo deste estudo foi avaliar o desempenho prático do residente de Anestesiologia em eventos adversos durante uma anestesia simulada. MÉTODO: Foram avaliados 17 médicos em especialização do primeiro e segundo anos de Anestesiologia (ME1 e ME2) e 5 instrutores do Centro de Ensino e Treinamento (CET) do HCFMUSP (Título Superior em Anestesiologia - TSA). Foi utilizado o simulador computadorizado Anesthesia Simulator Consultant (ASC) versão 2.0 - 1995/Anesoft para realização das simulações dos eventos. Os incidentes críticos escolhidos foram fibrilação ventricular (FV) e choque anafilático. Após a realização da simulação, foram impressos os resultados de cada participante e avaliadas e pontuadas as condutas adotadas para resolver os incidentes críticos pré-determinados. Os participantes avaliaram o simulador através do preenchimento de um questionário. RESULTADOS: Não houve diferença estatística entre as médias obtidas pelos grupos, porém notou-se uma tendência de melhor desempenho dos grupos TSA e ME2 na simulação de FV. Com relação ao choque anafilático, houve uma tendência de melhor desempenho do grupo TSA. CONCLUSÕES: O treinamento para diagnóstico e condutas em eventos adversos deve ser foco de atenção durante o treinamento de médicos residentes e na atualização de anestesiologistas. O uso do simulador pode ser uma das formas de realizar o treinamento nestas situações.

COMPLICAÇÕES; COMPLICAÇÕES; ENSINO

Importance of critical events training for anesthesiology...

SCIENTIFIC ARTICLE

Importance of critical events training for anesthesiology residents. Experience with computer simulator^*

Importancia del entrenamiento de los practicantes (médicos en ejercicio) en eventos adversos durante la anestesia. Experiencia con el uso del simulador computadorizado

Domingos Dias Cicarelli, TSA, M.D.^I; Ricardo Boari Coelho, M.D.^II; Fábio Ely Martins Benseñor, M.D.^III; Joaquim Edson Vieira, TSA, M.D.^IV

^ICo-Responsável do CET da Disciplina de Anestesiologia do HCFMUSP

^IIME₂ do CET da Disciplina de Anestesiologia do HCFMUSP

^IIISupervisor da Unidade de Apoio Cirúrgico do HCFMUSP/Anestesiologista do HCFMUSP/Doutor em Anestesiologia pela FMUSP

^IVAnestesiologista do HCFMUSP/Doutor em Medicina pela FMUSP/Professor Colaborador da Disciplina de Clínica Geral da FMUSP

^{Correspondence}

SUMMARY

BACKGROUND AND OBJECTIVES: Because of monitoring and drugs evolution, there has been a decrease in the incidence of critical events during anesthetic procedures. Despite this low frequency, critical event training for Anesthesiology residents remains important. This study aimed at evaluating Anesthesiology residents' critical care skills during computer-simulated anesthesia.

METHODS: Seventeen anesthesiology residents (first and second year) and 5 anesthesiology instructors were evaluated. Using the Anesthesia Simulator Consultant (2.0 - 1995/Anesoft) simulations of ventricular fibrillation (VF) and anaphylactic reaction (AR) were performed. After simulation, results of each participant were printed and approaches to solve predetermined critical events were evaluated and scored. Participants have evaluated the simulator by filling out a questionnaire.

RESULTS: There were no significant differences in means obtained by groups, but there has been a trend toward better performance of second year residents and Anesthesiology instructors during VF simulation. There has been a trend toward better performance of Anesthesiology instructors during AR simulation.

CONCLUSIONS: Critical events management training should be the focus during residents and anesthesiologists training. Computer simulation could be a way to carry out such training.

Key words: COMPLICATIONS: allergy, cardiac arrest; TRAINING, Simulators

RESUMEN

JUSTIFICATIVA Y OBJETIVOS: Con la decurrencia de la grande evolución de la monitorización y del arsenal terapéutico disponible en los últimos años, hubo una reducción en la incidencia de eventos adversos durante los procedimientos anestésicos. Sin embargo, continua importante el entrenamiento de los médicos practicantes para este tipo de ocurrencia. El objetivo de este estudio fue evaluar el desempeño práctico de los médicos practicantes de Anestesiología en eventos adversos durante una anestesia simulada.

MÉTODO: Fueron evaluados 17 médicos en especialización de primero y segundo años de Anestesiología (ME₁ y ME₂) y 5 instructores del Centro de Enseñanza y Entrenamiento (CEE) del HCFMUSP (Título Superior en Anestesiología - TSA). Fue utilizado el simulador computadorizado Anesthesia Simulator Consultant (ASC) versión 2.0 - 1995/Anesoft para realización de las simulaciones de los eventos. Los incidentes críticos escogidos fueron fibrilación ventricular (FV) y choque anafiláctico. Después de la realización de la simulación, fueron impresos los resultados de cada participante, evaluados y puntuados las conductas adoptadas para resolver los incidentes críticos pre-determinados. Los participantes evaluaron el simulador a través de un cuestionario para ser respondido.

RESULTADOS: No hubo diferencia estadística entre las medias obtenidas por los grupos, sin embargo, se notó una tendencia de un desempeño mejor de los grupos TSA y ME₂ en la simulación de FV. En relación al choque anafiláctico, hubo una tendencia de desempeño mejor del grupo TSA.

CONCLUSIONES: El entrenamiento para el diagnóstico y conductas en eventos adversos debe ser un foco de atención durante el entrenamiento de médicos practicantes y en la actualización de anestesiologistas. El uso del simulador puede ser una de las formas de realizar el entrenamiento en estas situaciones.

INTRODUCTION

Scientific knowledge is estimated to double every 6 years and this has led to marked changes in anesthetic practice in the last 10 years ¹.

Data on anesthetic and surgical related mortality show decreased mortality in the last 50 years ², while at the same time more complex surgical procedures are performed in older patients ³. The concept that provider's skills directly influence quality of service is critical for all aspects of society ³.

Accordingly, one may assume that with more highly skilled anesthesiologists better performances will be observed and lower perioperative complication rates will be recorded ³. Some authors ³, however, believe that the incidence of adverse events is directly related to morbidity factors intrinsic to patients. Other authors ^4-6 recommend anesthesiologists updating courses every 6 months to maintain adequate skills and help adaptation to management protocols. Societies adopt written and oral tests to evaluate the theoretical knowledge of anesthesiologists ^1,7,8. Practical skills, however, are slightly harder to evaluate ^1,9. Some authors believe in the role of simulators for this evaluation, which could complement oral evaluations ^10-14.

Simulators had their origin in different activities, such as aircraft and nuclear industries, where operators have to be alert and trained to face critical events. Reproducing such events without any catastrophic consequence is only possible with the aid of a simulator ^10,14-18. In this sense, anesthesiology is a medical specialty very similar to the mentioned activities.

Anesthesia simulators may promote skills development and maintenance and provide prompt responses to uncommon, however severe, anesthetic incidents ^{4,10,11,15,19-21}. Due to such characteristics, they may become essential to training and evaluation of individual and teams performance during critical situations ^11,13,22-25. One limitation to their wide use is the high cost of high fidelity simulators ^{5,10,18,24,26-29} and the lack or realism of low fidelity simulators^{10,18,29,30-32}. However, even low fidelity computer simulators such as Anesthesia Simulator Consultant (ASC) ^10,33 have been used for training and teaching with positive results ^10,31,32.

This study aimed at evaluating the performance of resident anesthesiologists and instructors exposed to simulated critical events ^34,35.

METHODS

After the institution's Ethics Committee approval, participated of this study 22 physicians being 11 first year residents, 6 second year residents and 5 anesthesiology instructors of the Teaching and Training Center and belonging to the clinical team of Hospital das Clínicas, Faculdade de Medicina, Universidade de São Paulo. Participants answered a questionnaire about in-depth or updating courses they had attended in the last 2 years.

Anesthesia Simulator Consultant (ASC) version 2.0 - 1995 / Anesoft was used for simulations. This simulator has 4 different patients to be anesthetized with 11 possibilities of critical events and physiological and pharmacological models to be used to determine the effects of different interventions.

After selecting the case, the screen displays patient's clinical history and summarized physical evaluation, which are no longer accessed after beginning of simulation. The simulator allows the anesthesiologist to examine the patient, administer drugs, control airways, ventilate and administer fluids by clicking the mouse. It also provides real time display of ECG trace, pulse oximetry, noninvasive and invasive blood pressure, capnogram, blood gases and temperature.

An anesthesia machine with flowmeters, vaporizers and patient's image with the type of airway control (facial mask, tracheal tube) is displayed on the screen (Figure 1).

Brazilian Journal of Anesthesiology, 2005; 55: 2: 151-157

Importance of critical events training for anesthesiology residents. Experience with computer simulator

Domingos Dias Cicarelli; Ricardo Boari Coelho; Fábio Ely Martins Benseñor; Joaquim Edson Vieira

The menu, on top of the screen, displays options such as Patient (respiratory sounds, neurological status, pulse); Vent (respiratory circuit checking, spontaneous, controlled ventilation); Monitor (TOF, noninvasive and invasive blood pressure); Fluids (crystalloids, colloids); Airway (facial mask adaptation, laryngoscopy); Drugs (opioids, neuromuscular blockers, cardiovascular drugs); Surgeon (preparation, incision, starting cardiac resuscitation).

A simulated anesthesia without intercurrences and lasting approximately 15 minutes was performed to familiarize participants with the simulator. Next, participant performed two anesthesias in which two highly severe, and potentially lethal if not treated, critical events were simulated ³⁶: anaphylactic reaction (AR) and ventricular fibrillation (VF).

To prevent that potential inability in handling mouse and computer could interfere with anesthesiologist's performance, a physician not participating in the study handled the mouse according to participants' verbal orders.

Anaphylactic reaction simulation started with histamine release few minutes after the administration of the first anesthetic gas, causing tachycardia, vasodilation and hypotension. Maximal blood pressure decrease was seen in 3 minutes and was followed by skin erythema. Pulmonary auscultation revealed wheezing 5 minutes after with increased tracheal pressure and capnographic changes. If blood pressure were not corrected, patient would evolve to cardiac arrest. Treatment of hypotension would prevent cardiac arrest, but final treatment would include aggressive fluid administration and 2 to 3 µg.kg^-1 epinephrine's.

After the first simulation, a second anesthesia was started, in which participants anesthetized a patient who evolved to cardiac arrest in ventricular fibrillation. Correct diagnosis and resuscitation based on Advanced Cardiac Life Support (ACLS) protocol would assure the success of the treatment. Sinus rhythm returned when 360J defibrillation was performed after an epinephrine dose.

Results of each participant were printed after the simulation to evaluate the approaches adopted to solve critical events. An approach score was developed for each situation: no response to situation (0 points), compensatory intervention defined as physiological correction (5 points), correct treatment defined as final therapy (10 points) ³⁷ (Chart I). ACLS recommendations for cardiac complications were used to evaluate participants' responses. Groups were compared based on their scores.

Brazilian Journal of Anesthesiology, 2005; 55: 2: 151-157

Importance of critical events training for anesthesiology residents. Experience with computer simulator

Domingos Dias Cicarelli; Ricardo Boari Coelho; Fábio Ely Martins Benseñor; Joaquim Edson Vieira

At the completion of simulation, subjects filled out a questionnaire with their impressions about the simulator.

ANOVA test was used for between group comparisons ^40-42.

RESULTS

Table I shows means for all groups in terms of performance during both adverse events.

Brazilian Journal of Anesthesiology, 2005; 55: 2: 151-157

Importance of critical events training for anesthesiology residents. Experience with computer simulator

Domingos Dias Cicarelli; Ricardo Boari Coelho; Fábio Ely Martins Benseñor; Joaquim Edson Vieira

There were no statistically significant differences among means of the three groups.

Questionnaire evaluation has shown some participants' characteristics. All instructors had 5 to 10 years of clinical practice and had attended the ACLS course within the last 2 years. All second-year residents have attended the ACLS course in the last 6 months. Only two first year residents had attended the course so far and had the best performance during VF simulation.

From the 17 residents participating in the study, 16 had never seen the simulator and considered that its use might be useful for training. Among simulator's positive aspects, all residents stated that training might improve diagnostic skills and approaches for adverse events. Among negative aspects, 59% of participants considered that some situations cannot be simulated and 41% of participants stated that lack of realism is the most negative aspect.

When asked to list complications seen during their residence period, all residents had already experienced at least one cardiac arrest and one bronchospasm during their training. Among 17 residents, only one reported having seen a case of anaphylactic reaction.

DISCUSSION

Although no statistical difference among scores was observed, there was a clear trend toward better performance with VF in the groups whose participants had already attended the ACLS course (second-year residents and instructors). Among first-year residents, two participants who had attended ACLS had the best performance with VF. This trend agrees with other authors ⁶ who reported that individuals submitted to specific training perform better as compared to those not trained. Schwid et al. ⁶ have even stated that knowledge retention after a specific training is higher for a 6-months period, and that trained and untrained individuals have the same performance 2 years after training.

In our institution, the ACLS course is mandatory for second- year residents, aiming at complementing adverse events training ⁴³.

Anaphylactic reaction simulation results have shown a different picture. Since no resident had been submitted to a specific training for this situation, first and second-year resident means were very similar, with a trend to be lower as compared to instructors'. This observation may be explained by the lack of specific training for this situation and by the fact that anaphylactic reaction is a complication increasingly less frequent. Longer practical experience may be the only factor differentiating groups ⁴⁴. So, practical experience can make the difference for prompt diagnosis and adequate management ⁶.

In analyzing results, it has to be considered that this simulator has no alarms as compared to anesthesia machines and monitors, which prevents the physician to have his attention shifted to some alteration passively presented by the patient. The simulator imposes to participants an active search for alterations in patients' status. Most participants diagnosed bronchospasm and treated the patient without actively looking for other clinical signs, such as skin erythema. Very often during anesthesia, the anesthesiologist has his attention shifted to some passive clinical sign, such as the mere observation of an erythema, making the diagnosis without logic reasoning or active search to confirm such diagnosis.

In our study, 83% of participants have agreed with the potential usefulness of the simulator for the training of uncommon critical events during anesthesia, and that it is of significant importance for residents training. However, it is necessary to highlight the importance of adequate training supervision to obtain the best possible result ⁴⁵.

Major criticism to ASC was the difficulty in simulating some situations, as well as the lack of realism. This may be minimized with high fidelity simulators, however their high cost prevents their dissemination and decreases the importance of the positive impact of more realism. In spite of its low fidelity, the simulator used in our study may play an important role in resident physicians training ¹¹, and its cost makes it affordable to any anesthesiologist or Training Center ⁴⁵.

Training for adverse event diagnosis and management should be a constant focus of attention during resident physicians training and anesthesiologists' updates.

REFERENCES

Submitted for publication August 3, 2004

Accepted for publication December 1, 2004

• 01. Ellis FR - Measurement of competence. Br J Anaesth, 1995;75: 673-674.
• 02. Cicarelli DD, Gotardo AOM, Auler Jr JOC et al - Incidęncia de óbitos anestésico-cirúrgicos nas primeiras 24 Horas. Revisăo de prontuários de 1995 no Hospital das Clínicas da FMUSP. Rev Bras Anestesiol, 1998;48:289-294.
• 03. Longnecker DE - Planning the future of Anesthesiology. Anesthesiology, 1996;84:495-497.
• 04. Nocite JR - Formaçăo profissional: fator de segurança em anestesia. Rev Bras Anestesiol, 1993;43:3:155-156.
• 05. Byrne AJ, Jones JG - The expanding role of simulators in risk management. Br J Anaesth, 1997;79:411.
• 06. Schwid HA, O'Donnell D - Anesthesiologists management of simulated critical incidents. Anesthesiology, 1992;76:495-501.
• 07. Greaves JD - Anaesthesia and the competence revolution. Br J Anaesth, 1997;79:555-557.
• 08. Eagle CJ, Martineau R, Hamilton K - The oral examination in anaesthestic resident evaluation. Can J Anaesth, 1993;40: 947-953.
• 09. Sivarajan M, Miller E, Hardy C et al - Objective evaluation of clinical performance and correlation with knowledge. Anesth Analg, 1984;63:603-607.
• 10. Gaba DM - Human Works Environment and Simulators, em: Miller RD - Anesthesia, 5^th Ed, New York, Churchill Livingstone, 2000;2613-2668.
• 11. Devitt JH, Kurrek MM, Cohen MM et al - The validity of performance assessment using simulation. Anesthesiology, 2001;95:36-42.
• 12. Liu PH - Simulators in Anesthesiology education. Anesth Analg, 1999;88:472-473.
• 13. Kapur PA, Steadman RH - Patient simulator competency testing: ready for takeoff? Anesth Analg, 1998;86:1157-1159.
• 14. Doyle DJ, Arellano R - The virtual Anesthesiology training simulation system. Can J Anaesth, 1995;42:267-273.
• 15. Gaba DM, DeAnda A - The response of anesthesia trainees to simulated critical incidents. Anesth Analg, 1989;68:444-451.
• 16. Davies JM, Helmreich RL - Simulation: it's a start. Can J Anaesth, 1996;43:425-429.
• 17. Helmreich RL, Davies JM - Anaesthetic simulation and lessons to be learned from aviation. Can J Anaesth, 1997;44:907-912.
• 18. Byrne AJ, Jones JG - Responses to simulated anaesthetic emergencies by anaesthetists with different durations of clinical experience. Br J Anaesth, 1997;78:553-556.
• 19. Burt DE - Virtual reality in anaesthesia. Br J Anaesth, 1995;75:472-480.
• 20. Byrne AJ, Jones JG - Inaccurate reporting of simulated critical anaesthetic incidents. Br J Anaesth, 1997;78:637-641.
• 21. Davies JM - Simulators in Anesthesiology education. Can J Anaesth, 1998;45:1035.
• 22. Moll JR, Faria AA, Cella AVS et al - Simuladores de anestesia no Brasil: primeiros resultados. Rev Bras Anestesiol, 1999;49:24:160.
• 23. DeAnda A, Gaba DM - Unplanned incidents during comprehensive anesthesia simulation. Anesth Analg, 1990;71:77-82.
• 24. Spence AA - The expanding role of simulators in risk management. Br J Anaesth, 1997;78:633-634.
• 25. Byrne AJ, Hilton PJ, Lunn J - Basic simulations in anaesthesia. A pilot study of the ACCESS system. Anaesthesia, 1994;49:376-381.
• 26. Forrest F, Mather S, Tooley M - The expanding role of simulators in risk management. Br J Anaesth, 1998;80:128.
• 27. Black AM - The "METI" simulator at the Bristol Medical Simulation Centre. Br J Anaesth, 1999;83:526-527.
• 28. Chopra V, Engbers FH, Geerts MJ et al - The Leiden anaesthesia simulator. Br J Anaesth, 1994;73:287-292.
• 29. Asbury AJ - Simulators for general anaesthesia. Br J Anaesth, 1994;73:285-286.
• 30. Norman J, Wilkins D - Simulators in anaesthesia. J Clin Monit, 1996;12:91-99.
• 31. Chopra V, Gesink BJ, Jong J et al - Does training on an anaesthesia simulator lead to improvement in performance? Br J Anaesth, 1994;73:293-297.
• 32. Murray DJ - Clinical simulation: technical novelty or innovation in education. Anesthesiology, 1998;89:1-2.
• 33. Eisenach JC, Gutierrez KT - Anesthesia simulator consultant Version 2.0. Anesthesiology, 1995;83:1391.
• 34. Barreiro G, Garat J - Incidentes críticos em anestesia. Rev Bras Anestesiol, 1992;42:5:357-376.
• 35. Devitt JH, Kurrek MM, Cohen MM et al - Testing internal consistency and construct validity during evaluation of performance in a patient simulator. Anesth Analg, 1998;86:1160-1164.
• 36. DeAnda A, Gaba DM - Role of experience in the response to simulated critical incidents. Anesth Analg, 1991;72:308-315.
• 37. Devitt JH, Kurrek MM, Cohen MM et al - Testing the raters: inter-rater reliability of standardized anaesthesia simulator performance. Can J Anaesth, 1997;44:924-928.
• 38. American Heart Association - Guidelines for cardiopulmonary resuscitation and emergency cardiac care. JAMA, 1992;268:2171.
• 39. Kurrek MM, Fish KJ - Anaesthesia crisis resource management training: an intimidating concept, a rewarding experience. Can J Anaesth, 1996;43:430-434.
• 40. Noether EG - Introduçăo ŕ Estatística, 2Ş Ed, Rio de Janeiro, Guanabara Dois, 1983;64-82.
• 41. Doria Filho U - Introduçăo ŕ Bioestatística, 1Ş Ed, Săo Paulo, Negócio Editora, 1999;77-78.
• 42. Hulley SB, Cummings SR - Designing Clinical Research, 1^st Ed, Philadelphia, Williams & Wilkins, 1988;215-216.
• 43. Lighthall GK, Barr J, Howard SK et al - Use of a fully simulated intensive care unit environment for critical event management training for internal medicine residents. Crit Care Med, 2003;31: 2437-2443.
• 44. Boulet JR, Murray D, Kras J et al - Reliability and validity of a simulation-based acute care skills assessment for medical students and residents. Anesthesiology, 2003;99:1270-1280.
• 45. Carraretto AR - Simuladores em Anestesiologia. em: Manica J - Anestesiologia. Princípios e Técnicas, 3Ş Ed, Porto Alegre, Artmed, 2004;97-105.

Correspondence to

Dr. Domingos Dias Cicarelli

Address: Av. Piassanguaba, 2933/71 Planalto Paulista

ZIP: 04060-004 City: São Paulo, Brazil

^*

Received from CET da Disciplina de Anestesiologia do Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo (HC FMUSP), São Paulo, SP

Publication Dates

• Publication in this collection
  01 June 2005
• Date of issue
  Apr 2005

History

• Received
  03 Aug 2004
• Accepted
  01 Dec 2004