Open-access Adverse events in anesthesiology: analysis based on the Logbook tool used by specializing physicians in Brazil

Abstract

Logbook is a digital tool launched by the Brazilian Society of Anesthesiology in 2014 and has since been used. This tool allows physicians specializing in anesthesiology to record and store activities performed during the training period. This enabled a descriptive analysis of an extensive database of anesthetic procedures, as well as complications that occurred and were reported by these doctors. The present study includes the review of these data over a period of 2 years (2014–2015).

KEYWORDS Anesthesiology; Complications; Adverse events; Logbook; Physicians in specialization training; Brazilian Society of Anesthesiology

Resumo

O Logbook é uma ferramenta digital, lançada pela Sociedade Brasileira de Anestesiologia em 2014 e empregada desde então. Essa ferramenta permite, aos médicos em especialização em anestesiologia, o registro e o armazenamento das atividades executadas durante o período de treinamento. Isto possibilitou a análise descritiva de um extenso banco de dados dos procedimentos anestésicos, bem como das complicações ocorridas, relatadas por esses médicos. O presente estudo compreende a revisão desses dados num período de dois anos (2014-2015).

Palavras-chave Anestesiologia; Complicações; Eventos adversos; Logbook; Médicos em especialização; Sociedade Brasileira de Anestesiologia

Introduction

According to the World Health Organization (WHO) international classification,1 patient safety is the reduction of risk of unnecessary harm associated with healthcare to an acceptable minimum. One of the outcomes frequently analyzed in studies addressing this theme is the occurrence of adverse events. According to the terminology created by the WHO World Patient Safety Alliance, an adverse event is harm to a patient that was associated with healthcare, or, more precisely, it is the injury incident, classified as the event or circumstance that could have resulted, or, resulted in unnecessary harm to a patient. A study performed in Spain (Ibeas), which assessed the prevalence of adverse events occurring in hospital settings of various institutions in five Latin American countries, defined adverse event as “an event that caused harm to a patient and was more associated with healthcare than with the patient’s underlying disease”.2

In recent years, greater emphasis has been placed on initiatives for patient safety in anesthesiology in both developed and developing countries. The Brazilian Society of Anesthesiology has been a signatory to the Helsinki Declaration since 2006, which provides for a series of actions aimed at patient safety and has structured several projects that have contributed to reduce the incidence of adverse events in anesthesia. In 2017, the Federal Council of Medicine approved Resolution No. 2174 on guidelines for the practice of anesthesiology, which repealed the previous resolution (2006) and aimed, among others, at enhancing the safety of anesthetic procedures.3 In 2013, the Ministry of Health published Ordinance No. 529/2013, which instituted the National Patient Safety Program. According to the ordinance, one of the responsibilities of its implementation committee is the proposition and validation of protocols, guidelines, and manuals focused on patient safety in surgical and anesthesiology procedures.4

The literature on anesthesia-related adverse events shows a tendency towards a reduction in the occurrence of complications associated with anesthesia and a decrease in perioperative mortality. A systematic review assessing perioperative mortality in patients undergoing general anesthesia has shown a reduction in the risk of perioperative mortality and anesthesia-related mortality in the last 50 years, particularly in developed countries,5 corroborated by other more recent studies, including one performed in Brazil.6,7 Studies assessing mortality during anesthesia are relatively more common in the literature than studies assessing the incidence of different types of complications, such as the occurrence of cardiac arrest, both nationally and internationally.8 Studies evaluating the magnitude of anesthesiology-related adverse events in Brazil are still scarce, and most of them are systematic reviews or studies conducted in teaching hospitals, whose particularities are different from other hospitals.613

Logbook is a collection of learning objectives, additional information about a specific educational period, its use in various formats, from undergraduate to postgraduate, occurs in different parts of the world.14 The option for different means of recording, storing activity data during training entails advantages, disadvantages, either because of cost, filling time, ease of transport, specific expertise or the ability to share, secure data.15 In the United Kingdom, the use of the Logbook in digital media for educational activities in anesthesiology originated in the 1990s.16 The purpose of the Logbook is to record the acquisition of skills, independence achieved by the student during the training process, also to assist trainees, their supervisors to identify the learning objectives, verify their accomplishments, evaluate the outcomes.17 These authors further suggest that the standardized digital Logbook, if updated periodically, could serve as, a career identity card used throughout the medical career, enable the doctor’s integration in the healthcare systems of other countries.

The Brazilian Society of Anesthesiology (Sociedade Brasileira de Anestesiologia — SBA) launched the first version of the digital Logbook in Brazil. This system was designed to assess the training and practice of trainee doctors; it allows the recording and monitoring of anesthetic procedures performed by each professional and is an educational support instrument.18 In order to obtain the title of specialist and approval between the years of specialization training, the trainee doctor is required to complete the Logbook with at least 440 anesthetic procedures each year of training, and periodically feed this record in the internal area of the SBA website. The Logbook allowed the creation of an expressive database with records of anesthetic procedures performed in public and private hospitals in Brazil, which contains information on the characteristics of the anesthetic procedures performed and the occurrence of complications, among others. The objective of the present study was to use the Logbook tool to analyze the data on anesthetic procedures and their respective complications, having as perspective the concepts related to patient safety.

Methodology

This was a retrospective observational study. With the use of the Logbook tool, we evaluated information gathered in a database of 1,621,241 anesthetic procedures, which were collected by trainee physicians, members of the Brazilian Society of Anesthesiology, in public and private hospitals in various regions of Brazil.

To allow a descriptive analysis of the information in the database using the Logbook tool and to allow comparability with other published studies regarding the magnitude of anesthesiology complications, the main data analyzed were the total complications reported in the period, total anesthesia-related complications (adverse events), total avoidable events, and number of deaths. We also analyzed the incidence of perioperative complications, such as cardiac arrest and difficult airway, in addition to variables potentially associated with the occurrence of complications such as: timing of detection; medical specialty in which the anesthetic procedure was performed; anesthetic technique used; size of the surgery; inpatient regimen; patient care regimen; occurrence of preanesthetic visit; patient’s age, sex, and ASA physical status; and previous comorbidities.

The overall incidence of complications was calculated by the number of complications (numerator) divided by the total number of anesthesia performed during the study period (denominator). The incidence of adverse events in anesthesia was calculated by the number of anesthesia-related complications (numerator) divided by the total number of anesthesia performed during the study period (denominator). Results were presented as rates per 10,000 anesthesias, with the respective 95% confidence intervals (95% CI).

Taking into account the WHO classification and the nomenclature used in the Ibeas study,1,2 an adverse event was defined in the present study as the complication described in the database in which the physician attributed a causal link with anesthesia. It was based on two assumptions: (1) if a complication was described, the damage occurred; (2) if the physician who entered the information in the Logbook attributed the causal link to anesthesia, the event was more related to the care received (anesthetic procedure) than to the underlying disease or some clinical condition of the patient.

In general, we chose to group the complications for the analysis. For example, we grouped unexpected difficult airway, accidental extubation, and unplanned reintubation into a single category because they are related to patients’ airway problems. In some cases, it was decided to assess separately the following specialty groups: remote care setting, operating room, and obstetrics, as it is understood that these specialties cover different patient profiles, with different types of complications.

For the variables care setting, time of occurrence, time and method to detect complications, the proportions and their respective 95% confidence intervals were calculated. Pearson’s chi-square test was used to analyze complications according to specialty group and event avoidability (according to type of complication and in case of death), in cases that met the criteria for the test application.19 A significance level of 5% was considered. The statistical software SPSS version 22 was used for analyzes.

The study was approved by the Ethics Committee of the Escola Politécnica Joaquim Venâncio, Fundação Oswaldo Cruz (No. 60761516.1.0000.5241, 10/24/16).

Results

Of the 1,621,241 anesthetic procedures performed, 1414 complications were reported, with an incidence of 8.72 complications per 10,000 anesthetic procedures (95% CI: 8.27–9.19). Of the 1414 complications, 445 were adverse events (31.5%; 95% CI: 29.1–34.0), i.e., complications related to the anesthetic procedure reported by the physicians who entered the information in the Logbook, which makes up an incidence of adverse events in anesthesiology of 2.74 events per 10,000 anesthetic procedures. (95% CI: 2.49–3.01).

In the sample analyzed, 455 deaths were recorded, with an incidence of 2.81 deaths per 10,000 procedures (95% CI: 2.55–3.08).

Table 1 provides a descriptive analysis of the anesthetic procedures contained in the Logbook, showing that most patients are female (55.5%), aged between 18 and 65 years (69.4%), underwent general anesthesia/sedation (54.1%), with physical status ASA I (45.3%), and no comorbidities (53%). 76.3% of the procedures were performed electively and with hospitalization (80.9%). Among the procedures, 74.1% had a pre-anesthetic visit and 80.9% were performed in the operating room.

Table 1
Global characteristic of anesthetic procedures — Brazil (2014-2015).

Table 2 shows that OR was the place where complications occurred most frequently (79.3%). The most frequent occurrence times were during anesthesia maintenance (34.5%) and anesthetic induction (21.5%). Most complications were detected very quickly (66.5% of cases under one minute and 17% under five minutes). Complication detection methods (checking and monitors) accounted for almost all cases (96.8%).

Table 2
Care setting, time of occurrence, time and method of detecting complication in anesthetic procedures — Brazil (2014-2015).

The analysis of Table 3 revealed that the complications: perioperative cardiac arrest, unexpected difficult airway/accidental extubation/unplanned reintubation, and others, accounted for almost all occurrences in the operating room, remote care setting, and obstetrics (86 9%) for the three specialty groups. Perioperative cardiac arrest had the highest representation (55.1%) in the remote care setting, decreased to 28% (2nd place) in the operating room and to 17.4% (2nd place) in obstetrics. The unexpected difficult airway/accidental extubation/unplanned reintubation complication was more present in the operating room (21%). The category “other complications” had an expressive representation (67.4%) in obstetrics and also the highest percentage (37.3%) in the operating room.

Table 3
Types of complications in anesthetic procedures, according to the specialty group of the complications that occurred.

Among the avoidable events (Table 4), the highest percentages were found for unexpected difficult airway/accidental extubation/unplanned reintubation and other complications. Together, they reached 78.1% of the cases. These two categories of complications also appeared prominently among the unavoidable events. The category unexpected difficult airway/accidental extubation/unplanned reintubation significantly decreased (15.6%), while the category “other complications” had a slight fall (37.1%). Also noteworthy is the significant percentage (34.1%) of perioperative cardiac arrest among unavoidable events. The chi-square test showed a statistically significant difference between avoidable and unavoidable events, according to the types of complications (p< 0.001).

Table 4
Types of complications occurred in anesthetic procedures, according to avoidability — Brazil (2014-2015).

Table 5 shows the complications of cases in which the outcome was death, practically with responses only to perioperative cardiac arrest and other complications that together accounted for more than 90% of cases. Such complications stood out, both among avoidable events (30.8% and 53.8% respectively) and non-avoidable events (35.3% and 56.1%, respectively).

Table 5
Types of complications, according to avoidability of deaths occurred in anesthetic procedures — Brazil (2014-2015).

Discussion

Methods for risk identification and assessment of adverse events related to anesthetic procedures have been suggested for over three decades.20 Anesthetic-related morbidity and mortality data have decreased over the years,9,21 although the occurrence of adverse events with low or moderate morbidity are still high.22 These authors highlight that more recent data on the prevalence of cardiac arrest and brain damage have values between 0.8–3.3 and 0.15–0.9, respectively, per 10,000 anesthetic procedures. Mortality rates are around 1:100,000 cases for ASA I and II patients and 5.4 deaths per million general anesthesia resulting from airway management complications.23 The incidence of complications is due to a combination of factors involving inadequate training and experience, challenging work environment, limitations on team performance, stress and fatigue, but most complications are multifactorial and rarely due to a single factor.24 Difficult airway accounts for 37% of respiratory events and is more likely to occur outside the operating room (OR), but 67% of difficult intubations are seen inside the OR during anesthesia induction.25

The findings of the present study show that most procedures were performed in adult patients (69.4%), female (55.5%), ASA physical status I and II (85.1%), using general/sedation or regional analgesia (89.4%) in elective surgeries (76.3%), and this is compatible with the exposure to cases and techniques expected in the training of these professionals.

It is noteworthy that this was the first study performed in Brazil that evaluated a sample of over one million anesthesias, performed in public and private hospitals in several Brazilian regions. Several types of complications were analyzed, such as cardiopulmonary arrest, difficult airway, and acute myocardial infarction, important outcomes in anesthesiology, and their occurrence was considered according to specialty groups and avoidability. In the present study, the incidence rates found for cardiac arrest and death outcomes were much lower than the rates found in the literature.613 There were 407 cases of cardiac arrest in 1,621,241 anesthetic procedures, giving an incidence of 251 cases per 10,000 anesthesias for the two-year period (2014–2015). Although there has been a decrease in the incidence of this outcome over the past 25 years, the incidence of 2.5 for the two-year period is still well below the incidence of 13 cases per 10,000 anesthesias for 2007, as observed in a previous study.6 This difference can be mainly explained by two factors. Firstly, by the continuous advancement of anesthetic techniques and safety related to the anesthetic procedure in more recent years. Secondly, it is important to highlight the peculiarities related to the information entered in the Logbook. Data should be entered into this platform by the last day of the month following the date of the procedure. After this date, the system was locked for data entry. The deadline for data entry by the trainee physician coincided with the date recorded for the end of each doctor’s specialization period.

It is believed that the possibility of the procedure and its complications being retroactively recorded by the physician may have substantially contributed to the underreporting of these events due to two main aspects: (1) memory bias, related to forgetfulness or loss of important information about the case over time; (2) the culture of fear, which despite the efforts of recent years, still exists among health professionals since the publication of the Ministry of Health’s 2013 Ordinance on the National Patient Safety Program, in order to seek the adverse event not to punish those involved but, above all, to learn how to act preventively in the future with these occurrences. Added to this is the fact that these data were entered by physicians in specialization training, which may have contributed to the underreporting of complications. Underreporting was also observed for the incidence of deaths.

The study also allowed the observation of important data regarding the most frequent care setting in which complications occurred (79.3% in the OR) and the most frequent times of occurrence (56% during anesthesia induction and maintenance). A study of surgical adverse events in hospitals in Rio de Janeiro also showed that the most frequent place where these events occur is in the OR (78.1% of cases).26 The identification of the times in which complications occur more frequently is important to signal potential areas for improvement.

The most common types of complications observed in the study (87% of cases) were: perioperative cardiac arrest, airway-related problems (difficult airway/accidental extubation/unplanned reintubation), and other complications. In the analysis of test results for anesthetic procedures recording in Personal Digital Assistant (PDA), Bent et al. (2002) identified a serious incident rate of 2.5% in Australia and New Zealand, half of these events were airway related and 40% were cardiovascular.27

When comparing the percentage of avoidable complications and avoidable deaths by type of complications, we can see that there were more avoidable deaths related to cardiac arrest. Regarding difficult airway, although it was one of the complications with the highest percentage of avoidability, no avoidable deaths associated with this complication were recorded. However, we should carefully analyze the data due to the limitations already described regarding Logbook data entry, as well as the subjective nature of the avoidability assessment and the fact that the six-point avoidability assessment scale was not used, which is commonly used in adverse event assessment studies.2

Logbook has been adopted to follow the training of anesthetists in some countries, providing useful information on exposure, training and experience in anesthesiology subspecialties.2830 However, as Nixon (2000)29 points out, the isolated use of case numbers are a limited indicator for competence assessment, but the use of the Logbook can serve as a tool for measuring competence when the level of supervision, the complexity of cases, and the complication rate are included in its analysis.29 The recording of adverse events during anesthesia and the feedback of this information to the clinical team led to a significant decrease in the rates of these events,31 signaling a possible use of Logbook data for perioperative evaluation and monitoring of anesthetic procedures.

The present study allowed the descriptive analysis of an extensive database of anesthetic procedures and related complications. It is the first of its magnitude conducted in the country using the Logbook tool. Thus, the data obtained should be evaluated considering the particularities involved with data entry.

References

  • 1 The Conceptual Framework for the International Classification for Patient Safety. Final Technical Report. World Alliance for Patient Safety Taxonomy. World Health Organization (WHO). 2009 Jan.
  • 2 Aranaz-Andrés JM, Aibar-Remón C, Limón-Ramírez R, et al. Prevalence of adverse events in the hospitals of five Latin American countries: results of the Iberoamerican study of adverse events (IBEAS). BMJ Qual Safet. 2011;20:1043-51.
  • 3 Conselho Federal de Medicina. Resolução nº 2174, de 2017. Dispõe sobre a prática do ato anestésico e revoga a Resolução CFM nº 1802/2006.
  • 4 Ministério da Saúde. Portaria nº 529, de 1° de abril de 2013. Institui o Programa Nacional de Segurança do Paciente (PNSP).
  • 5 Bainbridge D, Martin J, Arango M, et al. Perioperative and anaesthetic-related mortality in developed and developing countries: a systematic review and meta-analysis. The Lancet. 2012;380:1075-1081.
  • 6 Vane MF, Nuzzi RXP, Aranha GF, et al. Parada cardíaca perioperatória: uma análise evolutiva da incidência de parada cardíaca intraoperatória em centros terciários no Brasil. Rev Bras Anestesiol. 2016;66:176-182.
  • 7 Koga FA, El Dib R, Wakasugui W, et al. Anesthesia-related and perioperative cardiac arrest in low and high-income countries. Medicine. 2015;94:e1465.
  • 8 Braz JRC. Morbimortalidade em anestesia: estado atual. Medicina Perioperatória. 2007;114:1009-19.
  • 9 Braz LG, Módolo NSP, Nascimento P, et al. Perioperative cardiac arrest: a study of 53718 anaesthetics over 9 yr from a Brazilian teching hospital. Br J Anaesth. 2006;96:569-75.
  • 10 Pignaton W, Braz JRC, Kusano PS, et al. Perioperative and anesthesia-related mortality. Medicine. 2016;95:e2208.
  • 11 Braz LG, Braz JRC, Módolo NSP, et al. Incidência de parada cardíaca durante anestesia, em hospital universitário de atendimento terciário Estudo prospectivo entre 1996 e 2002. Rev Bras Anestesiol. 2004;54:755-68.
  • 12 Sebbag I, Carmona MJC, Gonzalez MMC, et al. Frequency of intraoperative cardiac arrest and medium-term survival. São Paulo Med J. 2013;131:309-14.
  • 13 Limongi JAG, Lins RSM. Parada cardiorrespiratória em raquianestesia. Rev Bras Anestesiol. 2011;61:110-20.
  • 14 Schüttpetz-Brauns K, Narciss E, Schneyinck C, et al. Twelve tips for successfully implementing logbooks in clinical training. Med Teach. 2016;38:564-9.
  • 15 McIndoe A, Hammond E. How to maintain an anaesthetic logbook. Bulletin. 2008;51:2633-7.
  • 16 Nixon MC. The anaesthetic logbook - a survey. Anaesthesia. 2000;55:10776-80.
  • 17 Barbieri A, Giuliani E, Lazzeroti S, et al. Education in anesthesia: three years of online logbook implementation in an Italian school. BMC Med Educ. 2015;15:14.
  • 18 Portal da Sociedade Brasileira de Anestesiologia. Available from: http://www.sba.com.br/ [Accessed September 2016].
    » http://www.sba.com.br/
  • 19 Siqueira AL, Tibúrcio JD. Estatística na área de saúde: conceitos, metodologia, aplicações e prática computacional. Belo Horizonte: Editora Coopmed; 2011. Página 272.
  • 20 Derrington MC, Smith G. A review of studies of anaesthetic risk, morbidity and mortality. Br J Anaesth. 1987;59:815-33.
  • 21 Braz LG, Braz DG, Cruz DS, et al. Mortality in anesthesia: a systematic review. Clinics (Sao Paulo). 2009;64:999-1006.
  • 22 Haller G, Laroche T, Clergue F. Morbidity in anaesthesia: today and tomorrow. Best Pract Res Clin Anaesthesiol. 2011;25:123-32.
  • 23 Wacker J, Staender S. The role of the anaesthesiologist in perioperative patient safety. Curr Opin Anaesthesiol. 2014;27:649-56.
  • 24 Valchanov K, Webb ST, Sturgess J. Anaesthetic and perioperative complications. New York: Cambridge University Press; 2011.
  • 25 Steadman J, Catalani B, Sharp C, et al. Life-threatening perioperative anesthetic complications: major issues surrounding perioperative morbidity and mortality. Trauma Surg Acute Care Open. 2017;2:1-7.
  • 26 Moura MLO, Mendes W. Avaliação de eventos adversos cirúrgicos em hospitais do Rio de Janeiro. Rev Bras Epidemiol. 2012;15:523-35.
  • 27 Bent PD, Bolsin SN, Creati BJ, et al. Professional monitoring and critical incident reporting using personal digital assistants. Med J Aust. 2002;177:496-9.
  • 28 Hammond EJ, Sweeney BP. Electronic data collection by trainee anaesthetists using palm top computers. Eur J Anaesthesiol. 2000;17:91-8.
  • 29 Nixon MC. The anaesthetic logbook - a survey. Anaesthesia. 2000;55:1076-80.
  • 30 Kwok CY, Hung CT. Clinical experience of trainee anaesthesiologists: logbook analysis. Hong Kong Med J. 2006;12:125-32.
  • 31 Wacker J, Kolbe M. The challenge of learning from perioperative patient harm. Trends Anaesth Crit Care. 2016;7–8:5-10.

Publication Dates

  • Publication in this collection
    20 Dec 2019
  • Date of issue
    Sep-Oct 2019

History

  • Received
    26 Nov 2018
  • Accepted
    14 June 2019
location_on
Sociedade Brasileira de Anestesiologia R. Professor Alfredo Gomes, 36, 22251-080 Botafogo RJ Brasil, Tel: +55 21 2537-8100, Fax: +55 21 2537-8188 - Campinas - SP - Brazil
E-mail: bjan@sbahq.org
rss_feed Stay informed of issues for this journal through your RSS reader
Acessibilidade / Reportar erro