Acessibilidade / Reportar erro

Impact of a respiratory ICU rotation on resident knowledge and confidence in managing mechanical ventilation

ABSTRACT

Objective:

To develop and apply a competency-based test to assess learning among internal medicine residents during a respiratory ICU rotation at a university hospital.

Methods:

We developed a test comprising 19 multiple-choice questions regarding knowledge of mechanical ventilation (MV) and 4 self-assessment questions regarding the degree of confidence in the management of MV. The test was applied on the first and last day of a 30-day respiratory ICU rotation (pre-rotation and post-rotation, respectively). During the rotation, the residents had lectures, underwent simulator training, and shadowed physicians on daily bedside rounds focused on teaching MV management.

Results:

Fifty residents completed the test at both time points. The mean score increased from 6.9 ± 1.2 (pre-rotation) to 8.6 ± 0.8 (post-rotation; p < 0.001). On questions regarding the approach to hypoxemia, the recognition of patient-ventilator asynchrony, and the recognition of risk factors for extubation failure, the post-rotation scores were significantly higher than the pre-rotation scores. Confidence in airway management increased from 6% before the rotation to 22% after the rotation (p = 0.02), whereas confidence in making the initial MV settings increased from 31% to 96% (p < 0.001) and confidence in adjusting the ventilator modes increased from 23% to 77% (p < 0.001).

Conclusions:

We developed a competency-based test to assess knowledge of MV among residents before and after an rotation in a respiratory ICU. Resident performance increased significantly after the rotation, as did their confidence in caring for patients on MV.

Keywords:
Education, medical; Respiration, artificial; Surveys and questionnaires; internship and residency; Competency-based education; Educational measurement

RESUMO

Objetivo:

Desenvolver e aplicar um teste baseado em competências para avaliar o aprendizado de residentes de clínica médica em estágio na UTI respiratória de um hospital universitário.

Métodos:

Desenvolvemos um teste com 19 questões de múltipla escolha sobre conhecimento em ventilação mecânica (VM) e 4 questões de autoavaliação sobre o nível de confiança no manejo da VM. Os testes foram aplicados no primeiro (pré-estágio) e no último dia (pós-estágio) do estágio de 30 dias na UTI respiratória. Durante o estágio, os residentes tiveram aulas teóricas, treinamento com simulador e visitas diárias à beira do leito focadas no ensino de VM.

Resultados:

Cinquenta residentes completaram o teste nos dois momentos. A média de pontuação (0-10 pontos) aumentou de 6,9 ± 1,2 no pré-estágio para 8,6 ± 0,8 no pós-estágio (p < 0,001). Observamos um aumento significativo no pós-estágio comparado com o pré-estágio em questões sobre abordagem da hipoxemia, reconhecimento da assincronia paciente-ventilador e reconhecimento de fatores de risco para falha de extubação. A confiança na abordagem de vias aéreas aumentou de 6% para 22% ao final do estágio (p = 0,02). A confiança no ajuste inicial da VM subiu de 31% para 96% (p < 0,001), e a confiança no ajuste dos modos ventilatórios aumentou de 23% para 77% (p < 0,001).

Conclusões:

Desenvolvemos um teste baseado em competências para avaliar o conhecimento sobre VM entre residentes antes e depois de um estágio em UTI respiratória. O desempenho dos residentes ao final do estágio aumentou significativamente, assim como sua confiança para cuidar de pacientes sob VM.

Descritores:
Educação médica; Respiração artificial; Inquéritos e questionários; Internato e residência; Educação baseada em competências; Avaliação educacional

INTRODUCTION

Since the polio epidemic in Copenhagen in 1952,11 Kelly FE, Fong K, Hirsch N, Nolan JP. Intensive care medicine is 60 years old: the history and future of the intensive care unit. Clin Med (Lond). 2014;14(4):376-379. https://doi.org/10.7861/clinmedicine.14-4-376
https://doi.org/10.7861/clinmedicine.14-...

2 Tomicic V, Espinoza M, Andresen M, Molina J, Calvo M, Ugarte H, et al. Characteristics and factors associated with mortality in patients receiving mechanical ventilation: first Chilean multicenter study [Article in Spanish]. Rev Med Chil. 2008;136(8):959-967. https://doi.org/10.4067/S0034-98872008000800001
https://doi.org/10.4067/S0034-9887200800...
-33 LASSEN HC. A preliminary report on the 1952 epidemic of poliomyelitis in Copenhagen with special reference to the treatment of acute respiratory insufficiency. Lancet. 1953;1(6749):37-41. https://doi.org/10.1016/S0140-6736(53)92530-6
https://doi.org/10.1016/S0140-6736(53)92...
mechanical ventilation (MV) has been the key element in the care of patients with respiratory failure44 Esteban A, Frutos-Vivar F, Muriel A, Ferguson ND, Peñuelas O, Abraira V, et al. Evolution of mortality over time in patients receiving mechanical ventilation. Am J Respir Crit Care Med. 2013;188(2):220-230. https://doi.org/10.1164/rccm.201212-2169OC
https://doi.org/10.1164/rccm.201212-2169...
and continues to be the most widely used technique for providing life support .55 Pham T, Brochard LJ, Slutsky AS. Mechanical Ventilation: State of the Art. Mayo Clin Proc. 2017;92(9):1382-1400. https://doi.org/10.1016/j.mayocp.2017.05.004
https://doi.org/10.1016/j.mayocp.2017.05...

The use of MV is associated with significantly higher daily costs for patients receiving treatment in the ICU.66 Wunsch H, Linde-Zwirble WT, Angus DC, Hartman ME, Milbrandt EB, Kahn JM. The epidemiology of mechanical ventilation use in the United States. Crit Care Med. 2010;38(10):1947-1953. https://doi.org/10.1097/CCM.0b013e3181ef4460
https://doi.org/10.1097/CCM.0b013e3181ef...
In addition to the costs, the need for MV continues to be associated with high mortality, in Brazil and in other countries, despite scientific advances in the area.44 Esteban A, Frutos-Vivar F, Muriel A, Ferguson ND, Peñuelas O, Abraira V, et al. Evolution of mortality over time in patients receiving mechanical ventilation. Am J Respir Crit Care Med. 2013;188(2):220-230. https://doi.org/10.1164/rccm.201212-2169OC
https://doi.org/10.1164/rccm.201212-2169...
,77 Fialkow L, Farenzena M, Wawrzeniak I, Brauner JS, Vieira SR, Vigo A, et al. Mechanical ventilation in patients in the intensive care unit of a general university hospital in southern Brazil: an epidemiological study. Clinics (Sao Paulo). 2016;71(3):144-151. https://doi.org/10.6061/clinics/2016(03)05
https://doi.org/10.6061/clinics/2016(03)...
,88 Azevedo LC, Park M, Salluh JI, Rea-Neto A, Souza-Dantas VC, Varaschin P, et al. Clinical outcomes of patients requiring ventilatory support in Brazilian intensive care units: a multicenter, prospective, cohort study. Crit Care. 2013;17(2):R63. https://doi.org/10.1186/cc12594
https://doi.org/10.1186/cc12594...

Strategies that result in shorter ICU stays or less time on MV could lead to substantial reductions in the total cost per inpatient.99 Dasta JF, McLaughlin TP, Mody SH, Piech CT. Daily cost of an intensive care unit day: the contribution of mechanical ventilation. Crit Care Med. 2005;33(6):1266-1271. https://doi.org/10.1097/01.CCM.0000164543.14619.00
https://doi.org/10.1097/01.CCM.000016454...
In addition, the appropriate adjustment of MV settings could reduce mortality in various clinical scenarios.44 Esteban A, Frutos-Vivar F, Muriel A, Ferguson ND, Peñuelas O, Abraira V, et al. Evolution of mortality over time in patients receiving mechanical ventilation. Am J Respir Crit Care Med. 2013;188(2):220-230. https://doi.org/10.1164/rccm.201212-2169OC
https://doi.org/10.1164/rccm.201212-2169...
,1010 Amato MB, Meade MO, Slutsky AS, Brochard L, Costa EL, Schoenfeld DA, et al. Driving pressure and survival in the acute respiratory distress syndrome. N Engl J Med. 2015;372(8):747-755. https://doi.org/10.1056/NEJMsa1410639
https://doi.org/10.1056/NEJMsa1410639...

11 Acute Respiratory Distress Syndrome Network, Brower RG, Matthay MA, Morris A, Schoenfeld D, Thompson BT, et al. Ventilation with lower tidal volumes as compared with traditional tidal volumes for acute lung injury and the acute respiratory distress syndrome. N Engl J Med. 2000;342(18):1301-1308. https://doi.org/10.1056/NEJM200005043421801
https://doi.org/10.1056/NEJM200005043421...

12 Weiss H, Baker DW, Weiner S, Bechel M, Ragland M, Rademaker A, et al. Low Tidal Volume Ventilation Use in Acute Respiratory Distress Syndrome. Crit Care Med. 2016;44(8):1515-1522. https://doi.org/10.1097/CCM.0000000000001710
https://doi.org/10.1097/CCM.000000000000...
-1313 Bellani G, Laffey JG, Pham T, Fan E, Brochard L, Esteban A, et al. Epidemiology, Patterns of Care, and Mortality for Patients With Acute Respiratory Distress Syndrome in Intensive Care Units in 50 Countries [published correction appears in JAMA. 2016 Jul 19;316(3):350] [published correction appears in JAMA. 2016 Jul 19;316(3):350]. JAMA. 2016;315(8):788-800. https://doi.org/10.1001/jama.2016.0291
https://doi.org/10.1001/jama.2016.0291...
Therefore, instruction regarding the indications for and management of MV is essential to ensure the appropriate training of residents who will treat critically ill patients. Given that most ICU patients in Brazil and elsewhere are treated by clinicians who are not intensivists,1414 Hassegawa LCU, Escobar AL, Silva LRG, Katsuragawa TH. he Profile of Medical Education on Intensive Care in the State of Rondônia, Brazil [Article in Portuguese]. Rev Bras Educ Med. 2017;41(1):38-43. https://doi.org/10.1590/1981-52712015v41n1rb20160011
https://doi.org/10.1590/1981-52712015v41...

15 Piquette D, Fowler RA, Slutsky AS. Impact of intensivist staffing on patient care and trainee education: a Canadian perspective. Am J Respir Crit Care Med. 2010;182(4):442-444. https://doi.org/10.1164/rccm.201006-0973ED
https://doi.org/10.1164/rccm.201006-0973...
-1616 Pastores SM, Kevtan V. Shortage of intensive care specialists in the United States: recent insights and proposed solutions. Rev Bras Ter Intensiva. 2015;27(1):5-6. https://doi.org/10.5935/0103-507X.20150002
https://doi.org/10.5935/0103-507X.201500...
an MV curriculum for residents is important not only residency programs in intensive care but also in those in internal medicine.

There are few data in the literature on whether and how residency programs provide appropriate training in the management of MV.1717 Cox CE, Carson SS, Ely EW, Govert JA, Garrett JM, Brower RG, et al. Effectiveness of medical resident education in mechanical ventilation. Am J Respir Crit Care Med. 2003;167(1):32-38. https://doi.org/10.1164/rccm.200206-624OC
https://doi.org/10.1164/rccm.200206-624O...
,1818 O'Boyle AL, Mink RB, Anas NG, Kallay TC. Development of learning objectives and a validated testing tool for management of pediatric mechanical ventilation*. Pediatr Crit Care Med. 2014;15(7):594-599. https://doi.org/10.1097/PCC.0000000000000195
https://doi.org/10.1097/PCC.000000000000...
In a study conducted by Willcox et al.,1919 Wilcox SR, Strout TD, Schneider JI, Mitchell PM, Smith J, Lutfy-Clayton L, et al. Academic Emergency Medicine Physicians' Knowledge of Mechanical Ventilation. West J Emerg Med. 2016;17(3):271-279. https://doi.org/10.5811/westjem.2016.2.29517
https://doi.org/10.5811/westjem.2016.2.2...
emergency medicine residents reported that, although they frequently treated patients on MV, they felt that they had not received sufficient instruction on the management of MV. In a study involving medical students, residents, and emergency medicine physicians in Brazil, 85% of the participants believed that they had not received enough information about MV during their medical training and considered themselves underqualified to care for patients on MV.2020 Tallo FS, de Campos Vieira Abib S, de Andrade Negri AJ, Cesar P Filho, Lopes RD, Lopes AC. Evaluation of self-perception of mechanical ventilation knowledge among Brazilian final-year medical students, residents and emergency physicians. Clinics (Sao Paulo). 2017;72(2):65-70. https://doi.org/10.6061/clinics/2017(02)01
https://doi.org/10.6061/clinics/2017(02)...
In addition, there is no consensus on how to assess resident knowledge of MV. Although the development of validated assessment tools to measure learning is the most highly recommended method,2121 Holmboe ES, Hawkins RE, Durning SJ. Practical Guide to the Evaluation of Clinical Competence, 1st ed. Philadelphia: Mosby Elsevier; 2008.,2222 Tibério IF, Daud-Gallotti, RM, Troncon LE, Martins MA. Avaliação Prática de Habilidades Clínicas em Medicina. São Paulo: Atheneu; 2012. the effective application of such tools still presents a challenge in all areas of medicine.2323 Carraccio C, Wolfsthal SD, Englander R, Ferentz K, Martin C. Shifting paradigms: from Flexner to competencies. Acad Med. 2002;77(5):361-367. https://doi.org/10.1097/00001888-200205000-00003
https://doi.org/10.1097/00001888-2002050...

For an assessment to be considered well-planned, competencies and learning objectives in MV must first be established.1818 O'Boyle AL, Mink RB, Anas NG, Kallay TC. Development of learning objectives and a validated testing tool for management of pediatric mechanical ventilation*. Pediatr Crit Care Med. 2014;15(7):594-599. https://doi.org/10.1097/PCC.0000000000000195
https://doi.org/10.1097/PCC.000000000000...
,2424 Goligher EC, Ferguson ND, Kenny LP. Core competency in mechanical ventilation: development of educational objectives using the Delphi technique. Crit Care Med. 2012;40(10):2828-2832. https://doi.org/10.1097/CCM.0b013e31825bc695
https://doi.org/10.1097/CCM.0b013e31825b...

In the present study, we developed and applied a test to assess the knowledge and learning of internal medicine residents who completed a supervised rotation at a university hospital respiratory ICU. Our hypothesis was that their knowledge of MV and confidence in managing patients on MV would increase after a 30-day respiratory ICU rotation focused on MV management.

METHODS

Location and participants

This study was carried out in the Respiratory ICU of the Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo (HCFMUSP, University of São Paulo School of Medicine Hospital das Clínicas), located in the city of São Paulo, Brazil, between September of 2014 and August of 2015. The study was approved by the local research ethics committee. Given that it was a project designed to assess resident performance, an activity that is within the scope of the medical residency program, the requirement for informed consent was waived.

The study participants were second-year internal medicine residents at the HCFMUSP. The study inclusion criteria were being an internal medicine resident at the HCFMUSP and being an intern in the HCFMUSP respiratory ICU during the study period. The exclusion criterion was not completing the assessments during the rotation.

Test development

We developed a multiple-choice question test based on clinical cases, initially comprising 22 questions. The questions were developed on the basis of lists of competencies and learning objectives in MV in adult individuals, described in the literature,1818 O'Boyle AL, Mink RB, Anas NG, Kallay TC. Development of learning objectives and a validated testing tool for management of pediatric mechanical ventilation*. Pediatr Crit Care Med. 2014;15(7):594-599. https://doi.org/10.1097/PCC.0000000000000195
https://doi.org/10.1097/PCC.000000000000...
,2424 Goligher EC, Ferguson ND, Kenny LP. Core competency in mechanical ventilation: development of educational objectives using the Delphi technique. Crit Care Med. 2012;40(10):2828-2832. https://doi.org/10.1097/CCM.0b013e31825bc695
https://doi.org/10.1097/CCM.0b013e31825b...
as well as on the basis of our respiratory ICU residency program. Most questions were based on clinical cases, and a given case could be used for multiple questions.

First, the questions were discussed with our senior team, consisting of five MV specialists with more than 10 years of experience in ICUs, all of whom were involved in researching and teaching MV. On the basis of those discussions, 3 questions were excluded because they were not considered highly relevant for assessing knowledge of MV. Therefore, the final version of the test comprised 19 questions. To improve clarity, the group of specialists modified some of those questions, and the consensus opinion was that the final version of the test (Chart S1, supplementary material) was appropriate.

The key knowledge topics addressed on the test were cardiopulmonary physiology, interpretation of waveforms, adjustment of ventilator settings, and ventilator mode recognition (Chart 1). In addition to the questions regarding adjustment of MV, we included 4 self-assessment questions about the degree of confidence in airway management, in applying noninvasive ventilation (NIV), in making the initial MV settings, and in adjusting basic ventilator modes. Those four questions were scored on a Likert scale with 5 possible answers, ranging from 0 (I am not at all confident) to 4 (I am completely confident). The scores were later regrouped into two categories: low confidence (0, 1, and 2); and high confidence (3 and 4).

Chart 1
Competencies associated with the knowledge questions on the test.

Data collection

The test was administered to residents twice during their rotation in the HCFMUSP respiratory ICU. The rotation lasted 30 days, and the test was administered on the first and last days of that period (pre-rotation and post-rotation, respectively).

During the between-test interval, the residents were responsible for the care of patients on MV, making changes to the ventilator settings with the help of pulmonology residents, pulmonologists, and intensivists, who were responsible for supervising the residents during their ICU rotation. Rotation activities included daily multidisciplinary rounds to discuss cases and plan treatment, with a focus on MV, as well as to provide overall care to the patients. Rounds lasted an average of two hours, with the participation of a supervising physician, all residents, and the ICU respiratory therapist. In addition, the residents participated in bedside discussions that focused on the care of patients on MV, involving ventilator waveform interpretation and ventilator setting adjustments. Those discussions were based on the needs of the resident. Whenever the MV settings were going to be changed in the morning, the supervising physician and the residents gathered at the bedside to discuss the ventilator settings. Throughout the day, depending on the complexity of each case, the settings were reviewed, and the residents had the opportunity to adjust the settings under the supervision of the pulmonology residents or supervising physicians. The residents had four one-hour lectures addressing the following topics: ventilator modes; MV in acute respiratory distress syndrome (ARDS) and severe hypoxemia; MV in patients with obstructive lung disease; and weaning from MV. The lectures combined a traditional expository model, in which ventilator waveforms were drawn on a whiteboard, and a participatory model, in which the residents posed questions and made suggestions. In addition, MV simulations were carried out using online software (xlung Excellence in teaching mechanical ventilation management simulator; Pulmocenter, Fortaleza, Brazil). The practical training with the virtual tool lasted approximately 90 min, and, using standardized clinical cases, the residents were encouraged to suggest adjustments to the virtual ventilator settings and evaluate the result of their decisions. The same supervising physicians were responsible for teaching the residents throughout the study period.

The primary outcome variable was the test score, normalized to vary from 0 to 10. The secondary outcome variables were the degrees of confidence (high or low) for the four key competencies addressed in the self-assessment questions.

Statistical analysis

We tested the primary outcome variable for normality with the Shapiro-Wilk test. We used paired t-tests to compare the pre- and post-rotation total scores, whereas we used McNemar’s test to compare the pre- and post-rotation rates of correct answers to each knowledge question and to compare the pre- and post-rotation scores on the questions regarding confidence. The level of significance was set at p < 0.05. We used the R statistical program, version 3.5.1 (The R Foundation for Statistical Computing, Vienna, Austria).

RESULTS

During the study period, 59 residents completed an rotation at the HCFMUSP respiratory ICU, and 50 of those residents completed the test at both time points. The mean score increased from 6.9 ± 1.2 (pre-rotation) to 8.6 ± 0.8 (post-rotation; p < 0.001), with a mean pre-rotation to post-rotation difference of 1.67 (95% CI: 1.3-2.0; Figure 1).

Figure 1
The blue bars represent the means and the error bars represent the standard deviation of the pre- and post-rotation scores (on a scale from 0 to 10).

Table 1 shows the proportion of individuals who answered each question correctly at each of the two time points, and Table S1 (supplementary material) describes the knowledge topic assessed by each question and its correspondence with a list of competencies described in the literature.1818 O'Boyle AL, Mink RB, Anas NG, Kallay TC. Development of learning objectives and a validated testing tool for management of pediatric mechanical ventilation*. Pediatr Crit Care Med. 2014;15(7):594-599. https://doi.org/10.1097/PCC.0000000000000195
https://doi.org/10.1097/PCC.000000000000...
,2424 Goligher EC, Ferguson ND, Kenny LP. Core competency in mechanical ventilation: development of educational objectives using the Delphi technique. Crit Care Med. 2012;40(10):2828-2832. https://doi.org/10.1097/CCM.0b013e31825bc695
https://doi.org/10.1097/CCM.0b013e31825b...
The questions with the highest pre-rotation rates of correct answers were those assessing knowledge of how to calculate respiratory system compliance and resistance, of the characteristics of the basic MV modes, of protective ventilation in ARDS, and of permissive hypercapnia. In contrast, the questions regarding the recognition of asynchrony and of risk factors for extubation failure had the lowest pre-rotation rates of correct answers.

Table 1
Knowledge topics assessed and participant performance on each question before and after the respiratory ICU rotation (N = 50).a

We found that the post-rotation rates of correct answers to questions regarding the treatment of hypoxemia, the recognition of patient-ventilator asynchrony, the risks of high inspiratory pressures, and the recognition of risk factors for extubation failure were significantly higher than the pre-rotation ones. The pre-rotation and post-rotation rates of correct answers were both low for only one question, which addressed particularities in the ventilatory management of patients with COPD (Table 1).

The questions regarding the degree of confidence in managing MV after the rotation were answered by 48 residents. Comparing the pre- and post-rotation scores on those questions (Figure 2), we found that the degree of confidence increased from 6% to 22% for airway management (p = 0.02), from 96% to 100% for applying NIV (p = 0.47), from 31% to 96% for making the initial MV settings (p < 0.001), and from 23% to 77% for adjusting the ventilator modes increased (p < 0.001).

Figure 2
Proportion of participants (n = 48) by degree of confidence as measured by the self-assessment questions before the rotation (light blue) and after the rotation (dark blue).

DISCUSSION

In the present study, we found that the overall performance of second-year internal medicine residents on a clinical case-based test assessing knowledge of MV was moderately good; however, their performance on questions assessing knowledge related to core competencies, such as the recognition of asynchrony and of risk factors for extubation failure, was poor. After a 30-day rotation in a respiratory ICU, their overall performance was significantly higher on most questions. Resident confidence in caring for patients on MV, which was low at the beginning of the rotation, increased significantly as a result of the training.

Although MV management is considered an important skill for residents of various specialties,1717 Cox CE, Carson SS, Ely EW, Govert JA, Garrett JM, Brower RG, et al. Effectiveness of medical resident education in mechanical ventilation. Am J Respir Crit Care Med. 2003;167(1):32-38. https://doi.org/10.1164/rccm.200206-624OC
https://doi.org/10.1164/rccm.200206-624O...
studies have shown that physicians and other health professionals who work in ICUs have difficulty in interpreting ventilator waveforms,2525 Colombo D, Cammarota G, Alemani M, Carenzo L, Barra FL, Vaschetto R, et al. Efficacy of ventilator waveforms observation in detecting patient-ventilator asynchrony. Crit Care Med. 2011;39(11):2452-2457. https://doi.org/10.1097/CCM.0b013e318225753c
https://doi.org/10.1097/CCM.0b013e318225...
show poor adherence to protective MV protocols in patients with ARDS1212 Weiss H, Baker DW, Weiner S, Bechel M, Ragland M, Rademaker A, et al. Low Tidal Volume Ventilation Use in Acute Respiratory Distress Syndrome. Crit Care Med. 2016;44(8):1515-1522. https://doi.org/10.1097/CCM.0000000000001710
https://doi.org/10.1097/CCM.000000000000...
,2626 Spece LJ, Mitchell KH, Caldwell ES, Gundel SJ, Jolley SE, Hough CL. Low tidal volume ventilation use remains low in patients with acute respiratory distress syndrome at a single center. J Crit Care. 2018;44:72-76. https://doi.org/10.1016/j.jcrc.2017.10.021
https://doi.org/10.1016/j.jcrc.2017.10.0...
and feel poorly prepared to care for patients on MV.2020 Tallo FS, de Campos Vieira Abib S, de Andrade Negri AJ, Cesar P Filho, Lopes RD, Lopes AC. Evaluation of self-perception of mechanical ventilation knowledge among Brazilian final-year medical students, residents and emergency physicians. Clinics (Sao Paulo). 2017;72(2):65-70. https://doi.org/10.6061/clinics/2017(02)01
https://doi.org/10.6061/clinics/2017(02)...
This is probably due, in part, to the fact that instruction in MV is not well standardized, because there is no widely used list of competencies in MV, nor is there consensus on how to develop a specific curriculum in MV and to quantify learning.1818 O'Boyle AL, Mink RB, Anas NG, Kallay TC. Development of learning objectives and a validated testing tool for management of pediatric mechanical ventilation*. Pediatr Crit Care Med. 2014;15(7):594-599. https://doi.org/10.1097/PCC.0000000000000195
https://doi.org/10.1097/PCC.000000000000...
,2424 Goligher EC, Ferguson ND, Kenny LP. Core competency in mechanical ventilation: development of educational objectives using the Delphi technique. Crit Care Med. 2012;40(10):2828-2832. https://doi.org/10.1097/CCM.0b013e31825bc695
https://doi.org/10.1097/CCM.0b013e31825b...
,2727 Yee J, Fuenning C, George R, Hejal R, Haines N, Dunn D, et al. Mechanical Ventilation Boot Camp: A Simulation-Based Pilot Study. Crit Care Res Pract. 2016;2016:4670672. https://doi.org/10.1155/2016/4670672
https://doi.org/10.1155/2016/4670672...

28 Spadaro S, Karbing DS, Fogagnolo A, Ragazzi R, Mojoli F, Astolfi L, et al. Simulation Training for Residents Focused on Mechanical Ventilation: A Randomized Trial Using Mannequin-Based Versus Computer-Based Simulation. Simul Healthc. 2017;12(6):349-355. https://doi.org/10.1097/SIH.0000000000000249
https://doi.org/10.1097/SIH.000000000000...
-2929 Rogers PL, Jacob H, Rashwan AS, Pinsky MR. Quantifying learning in medical students during a critical care medicine elective: a comparison of three evaluation instruments. Crit Care Med. 2001;29(6):1268-1273. https://doi.org/10.1097/00003246-200106000-00039
https://doi.org/10.1097/00003246-2001060...

In the present study, the pre-rotation total score was moderately high, reflecting the knowledge of MV that was acquired during the ICU rotations in the first year of the residency program. However, the increase in the mean total score after the rotation shows a significant gain of knowledge after the training focused on MV management, a gain that was also observed in a study involving residents who underwent intensive training in MV.2727 Yee J, Fuenning C, George R, Hejal R, Haines N, Dunn D, et al. Mechanical Ventilation Boot Camp: A Simulation-Based Pilot Study. Crit Care Res Pract. 2016;2016:4670672. https://doi.org/10.1155/2016/4670672
https://doi.org/10.1155/2016/4670672...

We found that the rate of correct answers to the question assessing protective ventilation in patients with ARDS increased from 94% (pre-rotation) to 100% (post-rotation), a rate that is higher than the 52% reported by Cox et al.1717 Cox CE, Carson SS, Ely EW, Govert JA, Garrett JM, Brower RG, et al. Effectiveness of medical resident education in mechanical ventilation. Am J Respir Crit Care Med. 2003;167(1):32-38. https://doi.org/10.1164/rccm.200206-624OC
https://doi.org/10.1164/rccm.200206-624O...
in another study involving medical residents. That difference might be due to the fact that protective ventilation has come to be more widely used in recent years and that the study by Cox et al.1717 Cox CE, Carson SS, Ely EW, Govert JA, Garrett JM, Brower RG, et al. Effectiveness of medical resident education in mechanical ventilation. Am J Respir Crit Care Med. 2003;167(1):32-38. https://doi.org/10.1164/rccm.200206-624OC
https://doi.org/10.1164/rccm.200206-624O...
was published more than a decade ago. With regard to managing NIV, we found rates of correct answers of 76% (pre-rotation) and 98% (post-rotation), compared with 73% in the Cox et al. study.1717 Cox CE, Carson SS, Ely EW, Govert JA, Garrett JM, Brower RG, et al. Effectiveness of medical resident education in mechanical ventilation. Am J Respir Crit Care Med. 2003;167(1):32-38. https://doi.org/10.1164/rccm.200206-624OC
https://doi.org/10.1164/rccm.200206-624O...
With regard to adjusting ventilator settings to correct auto-positive end-expiratory pressure, the rate of correct answers in the Cox et al. study1717 Cox CE, Carson SS, Ely EW, Govert JA, Garrett JM, Brower RG, et al. Effectiveness of medical resident education in mechanical ventilation. Am J Respir Crit Care Med. 2003;167(1):32-38. https://doi.org/10.1164/rccm.200206-624OC
https://doi.org/10.1164/rccm.200206-624O...
was 65%, whereas we found rates of 84% (pre-rotation) and 96% (post-rotation).

The rate of correct answers to some questions was low before the rotation but improved significantly after the rotation. That could be attributed to the training and discussions that took place during the rotation, corroborating findings from similar studies.2727 Yee J, Fuenning C, George R, Hejal R, Haines N, Dunn D, et al. Mechanical Ventilation Boot Camp: A Simulation-Based Pilot Study. Crit Care Res Pract. 2016;2016:4670672. https://doi.org/10.1155/2016/4670672
https://doi.org/10.1155/2016/4670672...
The high rate of correct answers to some questions before the rotation may be related to knowledge of MV gained during previous rotations or to the varying degree of difficulty of the questions.

We found that resident confidence in managing MV before the rotation varied depending on the question. The residents reported a high degree of confidence only in applying NIV, and that remained unaltered after the rotation. That finding differs from one reported by Tallo et al.,2020 Tallo FS, de Campos Vieira Abib S, de Andrade Negri AJ, Cesar P Filho, Lopes RD, Lopes AC. Evaluation of self-perception of mechanical ventilation knowledge among Brazilian final-year medical students, residents and emergency physicians. Clinics (Sao Paulo). 2017;72(2):65-70. https://doi.org/10.6061/clinics/2017(02)01
https://doi.org/10.6061/clinics/2017(02)...
who found that only 23% of the participants in their study felt confident enough to initiate NIV. However, in comparison with ours, the sample evaluated in that study2020 Tallo FS, de Campos Vieira Abib S, de Andrade Negri AJ, Cesar P Filho, Lopes RD, Lopes AC. Evaluation of self-perception of mechanical ventilation knowledge among Brazilian final-year medical students, residents and emergency physicians. Clinics (Sao Paulo). 2017;72(2):65-70. https://doi.org/10.6061/clinics/2017(02)01
https://doi.org/10.6061/clinics/2017(02)...
was more heterogeneous, including final-year medical students and emergency physicians, which may have contributed to the difference relative to our finding.

The participants in our study had low confidence in airway management, in making the initial MV settings, and in adjusting ventilator modes before the rotation, corroborating previous findings.2020 Tallo FS, de Campos Vieira Abib S, de Andrade Negri AJ, Cesar P Filho, Lopes RD, Lopes AC. Evaluation of self-perception of mechanical ventilation knowledge among Brazilian final-year medical students, residents and emergency physicians. Clinics (Sao Paulo). 2017;72(2):65-70. https://doi.org/10.6061/clinics/2017(02)01
https://doi.org/10.6061/clinics/2017(02)...
Their confidence increased significantly for those three skills but remained relatively low for airway management. Although airway management in an emergency setting was not a learning objective of the rotation, the low degree of resident confidence even after the rotation indicates the need for additional training in this area.

Our study has some limitations that should be taken into account when interpreting our results. First, this was a single-center study. Therefore, performance on the test may be associated with the prior knowledge level of the residents selected for admission to our residency program; with specific training, provided in our residency program, in rotations in emergency rooms and ICUs; and with the particularities of the rotation in our respiratory ICU. Second, the test was developed only by professionals in our department, which again may represent the specific view of our residency program. Third, education experts have conflicting opinions on multiple choice tests to measure learning and many now consider the use of simulations to be a more appropriate means of assessment.2929 Rogers PL, Jacob H, Rashwan AS, Pinsky MR. Quantifying learning in medical students during a critical care medicine elective: a comparison of three evaluation instruments. Crit Care Med. 2001;29(6):1268-1273. https://doi.org/10.1097/00003246-200106000-00039
https://doi.org/10.1097/00003246-2001060...

30 Lino JA, Gomes GC, Sousa ND, Carvalho AK, Diniz ME, Viana Junior AB, et al. A Critical Review of Mechanical Ventilation Virtual Simulators: Is It Time to Use Them?. JMIR Med Educ. 2016;2(1):e8. https://doi.org/10.2196/mededu.5350
https://doi.org/10.2196/mededu.5350...
-3131 Schroedl CJ, Corbridge TC, Cohen ER, Fakhran SS, Schimmel D, McGaghie WC, et al. Use of simulation-based education to improve resident learning and patient care in the medical intensive care unit: a randomized trial. J Crit Care. 2012;27(2):. https://doi.org/10.1016/j.jcrc.2011.08.006
https://doi.org/10.1016/j.jcrc.2011.08.0...
Finally, there is no list of validated and widely accepted MV competencies. Nevertheless, our study has some strengths. We conducted an objective assessment based on clinical cases with scenarios similar to those that residents are exposed to in ICUs in real life. In addition, when we developed the questions, we took into consideration the pre-defined learning objectives in our residency program and in the literature.2424 Goligher EC, Ferguson ND, Kenny LP. Core competency in mechanical ventilation: development of educational objectives using the Delphi technique. Crit Care Med. 2012;40(10):2828-2832. https://doi.org/10.1097/CCM.0b013e31825bc695
https://doi.org/10.1097/CCM.0b013e31825b...
Furthermore, this was the first study to assess knowledge of MV in a low- or middle-income country.

In terms of future directions, it is essential for residency programs that train physicians who will work in ICUs to have a well-structured MV curriculum based on well-defined learning objectives and competencies, including diversified teaching strategies that combine theoretical classes, discussions, simulations, and bedside teaching.2727 Yee J, Fuenning C, George R, Hejal R, Haines N, Dunn D, et al. Mechanical Ventilation Boot Camp: A Simulation-Based Pilot Study. Crit Care Res Pract. 2016;2016:4670672. https://doi.org/10.1155/2016/4670672
https://doi.org/10.1155/2016/4670672...
,2828 Spadaro S, Karbing DS, Fogagnolo A, Ragazzi R, Mojoli F, Astolfi L, et al. Simulation Training for Residents Focused on Mechanical Ventilation: A Randomized Trial Using Mannequin-Based Versus Computer-Based Simulation. Simul Healthc. 2017;12(6):349-355. https://doi.org/10.1097/SIH.0000000000000249
https://doi.org/10.1097/SIH.000000000000...
,3131 Schroedl CJ, Corbridge TC, Cohen ER, Fakhran SS, Schimmel D, McGaghie WC, et al. Use of simulation-based education to improve resident learning and patient care in the medical intensive care unit: a randomized trial. J Crit Care. 2012;27(2):. https://doi.org/10.1016/j.jcrc.2011.08.006
https://doi.org/10.1016/j.jcrc.2011.08.0...
,3232 Santhosh L, Brown W, Ferreira J, Niroula A, Carlos WG. Practical Tips for ICU Bedside Teaching. Chest. 2018;154(4):760-765. https://doi.org/10.1016/j.chest.2018.06.034
https://doi.org/10.1016/j.chest.2018.06....
The validation of a list of competencies in MV that can be adopted by various medical residency programs would also be quite useful to ensure that the training provided to residents is appropriate.2424 Goligher EC, Ferguson ND, Kenny LP. Core competency in mechanical ventilation: development of educational objectives using the Delphi technique. Crit Care Med. 2012;40(10):2828-2832. https://doi.org/10.1097/CCM.0b013e31825bc695
https://doi.org/10.1097/CCM.0b013e31825b...
Finally, the development of tools that are more effective in assessing competency in MV, not only in terms of knowledge, but also in terms of skills and attitudes, such as tools based on simulations or structured objective assessments, would further contribute to improving residency programs so that the training given to physicians working in ICUs in Brazil is appropriate for the care of critically ill patients on MV, which could result in reduced mortality and reduced ICU costs.

In conclusion, we have developed a test, based on lists of competencies in MV, that made it possible to assess the knowledge and learning of second-year internal medicine residents before and after a 30-day rotation in a respiratory ICU, as well as to determine their degree of confidence in the management of MV. At the beginning of the rotation, resident performance on some core topics was insufficient and their confidence in their skills related to the application of MV was low. After the rotation, the performance of the residents improved significantly, as did their confidence in caring for patients on MV.

REFERENCES

  • 1
    Kelly FE, Fong K, Hirsch N, Nolan JP. Intensive care medicine is 60 years old: the history and future of the intensive care unit. Clin Med (Lond). 2014;14(4):376-379. https://doi.org/10.7861/clinmedicine.14-4-376
    » https://doi.org/10.7861/clinmedicine.14-4-376
  • 2
    Tomicic V, Espinoza M, Andresen M, Molina J, Calvo M, Ugarte H, et al. Characteristics and factors associated with mortality in patients receiving mechanical ventilation: first Chilean multicenter study [Article in Spanish]. Rev Med Chil. 2008;136(8):959-967. https://doi.org/10.4067/S0034-98872008000800001
    » https://doi.org/10.4067/S0034-98872008000800001
  • 3
    LASSEN HC. A preliminary report on the 1952 epidemic of poliomyelitis in Copenhagen with special reference to the treatment of acute respiratory insufficiency. Lancet. 1953;1(6749):37-41. https://doi.org/10.1016/S0140-6736(53)92530-6
    » https://doi.org/10.1016/S0140-6736(53)92530-6
  • 4
    Esteban A, Frutos-Vivar F, Muriel A, Ferguson ND, Peñuelas O, Abraira V, et al. Evolution of mortality over time in patients receiving mechanical ventilation. Am J Respir Crit Care Med. 2013;188(2):220-230. https://doi.org/10.1164/rccm.201212-2169OC
    » https://doi.org/10.1164/rccm.201212-2169OC
  • 5
    Pham T, Brochard LJ, Slutsky AS. Mechanical Ventilation: State of the Art. Mayo Clin Proc. 2017;92(9):1382-1400. https://doi.org/10.1016/j.mayocp.2017.05.004
    » https://doi.org/10.1016/j.mayocp.2017.05.004
  • 6
    Wunsch H, Linde-Zwirble WT, Angus DC, Hartman ME, Milbrandt EB, Kahn JM. The epidemiology of mechanical ventilation use in the United States. Crit Care Med. 2010;38(10):1947-1953. https://doi.org/10.1097/CCM.0b013e3181ef4460
    » https://doi.org/10.1097/CCM.0b013e3181ef4460
  • 7
    Fialkow L, Farenzena M, Wawrzeniak I, Brauner JS, Vieira SR, Vigo A, et al. Mechanical ventilation in patients in the intensive care unit of a general university hospital in southern Brazil: an epidemiological study. Clinics (Sao Paulo). 2016;71(3):144-151. https://doi.org/10.6061/clinics/2016(03)05
    » https://doi.org/10.6061/clinics/2016(03)05
  • 8
    Azevedo LC, Park M, Salluh JI, Rea-Neto A, Souza-Dantas VC, Varaschin P, et al. Clinical outcomes of patients requiring ventilatory support in Brazilian intensive care units: a multicenter, prospective, cohort study. Crit Care. 2013;17(2):R63. https://doi.org/10.1186/cc12594
    » https://doi.org/10.1186/cc12594
  • 9
    Dasta JF, McLaughlin TP, Mody SH, Piech CT. Daily cost of an intensive care unit day: the contribution of mechanical ventilation. Crit Care Med. 2005;33(6):1266-1271. https://doi.org/10.1097/01.CCM.0000164543.14619.00
    » https://doi.org/10.1097/01.CCM.0000164543.14619.00
  • 10
    Amato MB, Meade MO, Slutsky AS, Brochard L, Costa EL, Schoenfeld DA, et al. Driving pressure and survival in the acute respiratory distress syndrome. N Engl J Med. 2015;372(8):747-755. https://doi.org/10.1056/NEJMsa1410639
    » https://doi.org/10.1056/NEJMsa1410639
  • 11
    Acute Respiratory Distress Syndrome Network, Brower RG, Matthay MA, Morris A, Schoenfeld D, Thompson BT, et al. Ventilation with lower tidal volumes as compared with traditional tidal volumes for acute lung injury and the acute respiratory distress syndrome. N Engl J Med. 2000;342(18):1301-1308. https://doi.org/10.1056/NEJM200005043421801
    » https://doi.org/10.1056/NEJM200005043421801
  • 12
    Weiss H, Baker DW, Weiner S, Bechel M, Ragland M, Rademaker A, et al. Low Tidal Volume Ventilation Use in Acute Respiratory Distress Syndrome. Crit Care Med. 2016;44(8):1515-1522. https://doi.org/10.1097/CCM.0000000000001710
    » https://doi.org/10.1097/CCM.0000000000001710
  • 13
    Bellani G, Laffey JG, Pham T, Fan E, Brochard L, Esteban A, et al. Epidemiology, Patterns of Care, and Mortality for Patients With Acute Respiratory Distress Syndrome in Intensive Care Units in 50 Countries [published correction appears in JAMA. 2016 Jul 19;316(3):350] [published correction appears in JAMA. 2016 Jul 19;316(3):350]. JAMA. 2016;315(8):788-800. https://doi.org/10.1001/jama.2016.0291
    » https://doi.org/10.1001/jama.2016.0291
  • 14
    Hassegawa LCU, Escobar AL, Silva LRG, Katsuragawa TH. he Profile of Medical Education on Intensive Care in the State of Rondônia, Brazil [Article in Portuguese]. Rev Bras Educ Med. 2017;41(1):38-43. https://doi.org/10.1590/1981-52712015v41n1rb20160011
    » https://doi.org/10.1590/1981-52712015v41n1rb20160011
  • 15
    Piquette D, Fowler RA, Slutsky AS. Impact of intensivist staffing on patient care and trainee education: a Canadian perspective. Am J Respir Crit Care Med. 2010;182(4):442-444. https://doi.org/10.1164/rccm.201006-0973ED
    » https://doi.org/10.1164/rccm.201006-0973ED
  • 16
    Pastores SM, Kevtan V. Shortage of intensive care specialists in the United States: recent insights and proposed solutions. Rev Bras Ter Intensiva. 2015;27(1):5-6. https://doi.org/10.5935/0103-507X.20150002
    » https://doi.org/10.5935/0103-507X.20150002
  • 17
    Cox CE, Carson SS, Ely EW, Govert JA, Garrett JM, Brower RG, et al. Effectiveness of medical resident education in mechanical ventilation. Am J Respir Crit Care Med. 2003;167(1):32-38. https://doi.org/10.1164/rccm.200206-624OC
    » https://doi.org/10.1164/rccm.200206-624OC
  • 18
    O'Boyle AL, Mink RB, Anas NG, Kallay TC. Development of learning objectives and a validated testing tool for management of pediatric mechanical ventilation*. Pediatr Crit Care Med. 2014;15(7):594-599. https://doi.org/10.1097/PCC.0000000000000195
    » https://doi.org/10.1097/PCC.0000000000000195
  • 19
    Wilcox SR, Strout TD, Schneider JI, Mitchell PM, Smith J, Lutfy-Clayton L, et al. Academic Emergency Medicine Physicians' Knowledge of Mechanical Ventilation. West J Emerg Med. 2016;17(3):271-279. https://doi.org/10.5811/westjem.2016.2.29517
    » https://doi.org/10.5811/westjem.2016.2.29517
  • 20
    Tallo FS, de Campos Vieira Abib S, de Andrade Negri AJ, Cesar P Filho, Lopes RD, Lopes AC. Evaluation of self-perception of mechanical ventilation knowledge among Brazilian final-year medical students, residents and emergency physicians. Clinics (Sao Paulo). 2017;72(2):65-70. https://doi.org/10.6061/clinics/2017(02)01
    » https://doi.org/10.6061/clinics/2017(02)01
  • 21
    Holmboe ES, Hawkins RE, Durning SJ. Practical Guide to the Evaluation of Clinical Competence, 1st ed. Philadelphia: Mosby Elsevier; 2008.
  • 22
    Tibério IF, Daud-Gallotti, RM, Troncon LE, Martins MA. Avaliação Prática de Habilidades Clínicas em Medicina. São Paulo: Atheneu; 2012.
  • 23
    Carraccio C, Wolfsthal SD, Englander R, Ferentz K, Martin C. Shifting paradigms: from Flexner to competencies. Acad Med. 2002;77(5):361-367. https://doi.org/10.1097/00001888-200205000-00003
    » https://doi.org/10.1097/00001888-200205000-00003
  • 24
    Goligher EC, Ferguson ND, Kenny LP. Core competency in mechanical ventilation: development of educational objectives using the Delphi technique. Crit Care Med. 2012;40(10):2828-2832. https://doi.org/10.1097/CCM.0b013e31825bc695
    » https://doi.org/10.1097/CCM.0b013e31825bc695
  • 25
    Colombo D, Cammarota G, Alemani M, Carenzo L, Barra FL, Vaschetto R, et al. Efficacy of ventilator waveforms observation in detecting patient-ventilator asynchrony. Crit Care Med. 2011;39(11):2452-2457. https://doi.org/10.1097/CCM.0b013e318225753c
    » https://doi.org/10.1097/CCM.0b013e318225753c
  • 26
    Spece LJ, Mitchell KH, Caldwell ES, Gundel SJ, Jolley SE, Hough CL. Low tidal volume ventilation use remains low in patients with acute respiratory distress syndrome at a single center. J Crit Care. 2018;44:72-76. https://doi.org/10.1016/j.jcrc.2017.10.021
    » https://doi.org/10.1016/j.jcrc.2017.10.021
  • 27
    Yee J, Fuenning C, George R, Hejal R, Haines N, Dunn D, et al. Mechanical Ventilation Boot Camp: A Simulation-Based Pilot Study. Crit Care Res Pract. 2016;2016:4670672. https://doi.org/10.1155/2016/4670672
    » https://doi.org/10.1155/2016/4670672
  • 28
    Spadaro S, Karbing DS, Fogagnolo A, Ragazzi R, Mojoli F, Astolfi L, et al. Simulation Training for Residents Focused on Mechanical Ventilation: A Randomized Trial Using Mannequin-Based Versus Computer-Based Simulation. Simul Healthc. 2017;12(6):349-355. https://doi.org/10.1097/SIH.0000000000000249
    » https://doi.org/10.1097/SIH.0000000000000249
  • 29
    Rogers PL, Jacob H, Rashwan AS, Pinsky MR. Quantifying learning in medical students during a critical care medicine elective: a comparison of three evaluation instruments. Crit Care Med. 2001;29(6):1268-1273. https://doi.org/10.1097/00003246-200106000-00039
    » https://doi.org/10.1097/00003246-200106000-00039
  • 30
    Lino JA, Gomes GC, Sousa ND, Carvalho AK, Diniz ME, Viana Junior AB, et al. A Critical Review of Mechanical Ventilation Virtual Simulators: Is It Time to Use Them?. JMIR Med Educ. 2016;2(1):e8. https://doi.org/10.2196/mededu.5350
    » https://doi.org/10.2196/mededu.5350
  • 31
    Schroedl CJ, Corbridge TC, Cohen ER, Fakhran SS, Schimmel D, McGaghie WC, et al. Use of simulation-based education to improve resident learning and patient care in the medical intensive care unit: a randomized trial. J Crit Care. 2012;27(2):. https://doi.org/10.1016/j.jcrc.2011.08.006
    » https://doi.org/10.1016/j.jcrc.2011.08.006
  • 32
    Santhosh L, Brown W, Ferreira J, Niroula A, Carlos WG. Practical Tips for ICU Bedside Teaching. Chest. 2018;154(4):760-765. https://doi.org/10.1016/j.chest.2018.06.034
    » https://doi.org/10.1016/j.chest.2018.06.034
  • Financial support:

    This study received financial support from the Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP, São Paulo Research Foundation).
  • 2
    Study carried out in the Divisão de Pneumologia, Instituto do Coração, Hospital das Clínicas - HCFMUSP - Faculdade de Medicina, Universidade de São Paulo, São Paulo (SP) Brasil.

Publication Dates

  • Publication in this collection
    15 June 2020
  • Date of issue
    2020

History

  • Received
    11 Apr 2019
  • Accepted
    28 July 2019
Sociedade Brasileira de Pneumologia e Tisiologia SCS Quadra 1, Bl. K salas 203/204, 70398-900 - Brasília - DF - Brasil, Fone/Fax: 0800 61 6218 ramal 211, (55 61)3245-1030/6218 ramal 211 - São Paulo - SP - Brazil
E-mail: jbp@sbpt.org.br