Acessibilidade / Reportar erro

High and low-fidelity simulation for respiratory diseases pediatric training: a prospective and randomized study

Abstract

Objective:

To compare high and low-fidelity simulations for the recognition of respiratory distress and failure in urgency and emergency pediatric scenarios.

Methods:

70 fourth-year medical students were randomly distributed in high and low-fidelity groups and simulated different types of respiratory problems. Theory tests, performance checklists, and satisfaction and self-confidence questionnaires were used in the assessment. Face-to-face simulation and memory retention was applied. The statistics were evaluated by averages and quartiles, Kappa, and generalized estimating equations. The p-value was considered 0.05.

Results:

In the theory test there was an increase in scores in both methodologies (p < 0.001 ); in memory retention (p = 0.043) and at the end of the process the high-fidelity group had better results. The performance in the practical checklists was better after the second simulation (p > 0,05). The high-fidelity group felt more challenged in both phases (p = 0.042; p = 0.018) and showed greater self-confidence to recognize changes in clinical conditions and in memory retention (p = 0.050). The same group, in relation to the hypothetical real patient to be treated in the future, felt better confident to recognize respiratory distress and failure (p = 0.008; p = 0.004), and better prepared to make a systematic clinical evaluation of the patient in memory retention (p = 0.016).

Conclusion:

The two levels of simulations enhance diagnostic skills. High fidelity improves knowledge, leads the student to feel more challenged and more self-confident in recognizing the severity of the clinical case, including memory retention, and showed benefits regarding self-confidence in recognizing respiratory distress and failure in pediatric cases.

KEYWORDS
Simulation training; Respiratory tract diseases; Medical education; Pediatrics

Introduction

In the context of simulated medical environments, it is possible to develop clinical reasoning and to accelerate the performance of the expert.11 Peixoto JM, Santos SME, Faria RMD. Clinical reasoning development in medical students. Rev Bras Educ Med. 2018;42:75–83. Accordingly, health care simulation provides learning in a safe environment, case scenarios that involve feedback and skill repetition, promoting deliberate practice among its participants.22 Causer J, Barach P, Williams AM. Expertise in medicine: using the expert performance approach to improve simulation training. Med Educ. 2014;48:115–23.,33 Mutter MK, Martindale JR, Shah N, Gusic ME, Wolf SJ. Case-based teaching: does the addition of high-fidelity simulation make a difference in medical students’ clinical reasoning skills? Med Sci Educ. 2020;30:307–13. It is a growing field that combines innovative technologies and adult learning theory to reproducibly train medical professionals in clinical skills and practices.44 Urbina J, Monks SM. Validating assessment tools in simulation. Treasure Island (FL): StatPearls Publishing; 2020.,55 Sauer CJ. Realistic simulation methodology in Brazil’s new medical education curriculum: Potentialities. World Academy of Science, Engineering and Technology. Int J Educat Pedagog Sci. 2020;14:833–7.

The terms “modality” and “fidelity” are different elements of the simulation that can generate different impacts on the activity.66 Carey JM, Rossler K. The how when why of high fidelity simulation. Treasure Island (FL): StatPearls Publishing; 2023, [updated 2022 May 8]. Available from https://www.ncbi.nlm.nih.gov/ books/NBK559313/.
https://www.ncbi.nlm.nih.gov/ books/NBK5...
The modality is related to the type of equipment used and levels (low, medium, and high-fidelity) refer to the realism provided in the selection of equipment and scenario. Fidelity refers to the degree of accuracy achieved and corresponds to the credibility of the experience.77 Kim J, Park JH, Shin S. Effectiveness of simulation-based nursing education depending on fidelity: a meta-analysis. BMC Med Educ. 2016;16:152.,88 Cook DA, Hamstra SJ, Brydges R, Zendejas B, Szostek H, Wang AT, et al. Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis. Med Teach. 2013;35:e867–98. The choice of simulation level depends on the learning objective. Similar results to compare high (HF) and low-fidelity (LF) simulations for training are published in the literature, but greater satisfaction and self-confidence are reported in the first.99 Massoth C, Röder H, Ohlenburg H, Hessler M, Zarbock A, Pöpping DM, Wenk M. High-fidelity is not superior to low-fidelity simulation but leads to overconfidence in medical students. BMC Med Educ. 2019;19:29. HF is a practical methodology for teaching skills and competencies based on learning objectives.1010 Fragapane L, Li W, Ben Khallouq B, Cheng ZJ, Harris DM. Comparison of knowledge retention between high-fidelity patient simulation and read-only participants in undergraduate biomedical science education. Adv Physiol Educ. 2018;42:599–604.,1111 Helyer R, Dickens P. Progress in the utilization of high-fidelity simulation in basic science education. Adv Physiol Educ. 2016;40:143–4. Its synesthetic feature allows students to learn and show their peers how to do it, and it is superior for assessing diagnostic ability in a variety of technical and non-technical skills.77 Kim J, Park JH, Shin S. Effectiveness of simulation-based nursing education depending on fidelity: a meta-analysis. BMC Med Educ. 2016;16:152.,88 Cook DA, Hamstra SJ, Brydges R, Zendejas B, Szostek H, Wang AT, et al. Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis. Med Teach. 2013;35:e867–98.,99 Massoth C, Röder H, Ohlenburg H, Hessler M, Zarbock A, Pöpping DM, Wenk M. High-fidelity is not superior to low-fidelity simulation but leads to overconfidence in medical students. BMC Med Educ. 2019;19:29.,1010 Fragapane L, Li W, Ben Khallouq B, Cheng ZJ, Harris DM. Comparison of knowledge retention between high-fidelity patient simulation and read-only participants in undergraduate biomedical science education. Adv Physiol Educ. 2018;42:599–604.,1111 Helyer R, Dickens P. Progress in the utilization of high-fidelity simulation in basic science education. Adv Physiol Educ. 2016;40:143–4. Participants interact with the manikin and interpret changes more quickly, make decisions, and retain knowledge, which can benefit the future assessment of the real patient.44 Urbina J, Monks SM. Validating assessment tools in simulation. Treasure Island (FL): StatPearls Publishing; 2020.,1212 Stellflug SM, Lowe NK. The Effect of high fidelity simulators on knowledge retention and skill self-efficacy in pediatric advanced life support courses in a rural state. J Pediatr Nurs. 2018;39:21–6. Another positive aspect of HF is better integration and communication among team members in emergency care and in simulated practices.1313 Fagan MJ, Connelly CD, Williams BS, Fisher ES. Integrating team training in the pediatric life support program: an effective and efficient approach? J Nurs Adm. 2018;48:279–84.

Acute respiratory distress is one of the most common reasons why parents take their children to the Emergency Room (ER). Given its potential to cause life-threatening diseases, emergency physicians need to maintain and update their knowledge on recommendations for childhood respiratory diseases.1414 Choi J, Lee GL. Common pediatric respiratory emergencies. Emerg Med Clin North Am. 2012;30. 529-x. Therefore, the development of simulated scenarios for teaching students in pediatric emergencies addressing severe respiratory illness is extremely important and rare in the literature.1515 Agudelo SI, López DS, Obando EP, Paredes IA, Milanés R, Rodríguez F, et al. Ensayo clinico aleatorizado de la comparación entre Método de Ensenanza tradicional y escenario simulado para la adquisición de competencias en el reconocimiento de signos de enfermedad respiratoria aguda en pacientes pediátricos. Rev Fund Educ Med. 2015;18:269.,1616 Zar HJ, Ferkol TW. The global burden of respiratory disease-impact on child health. Pediatr Pulmonol. 2014;49:430–4. Early recognition and treatment of this condition prevent progression to cardiopulmonary arrest and death.1717 Topjian AA, Raymond TT, Atkins D, Chan M, Duff JP, Joyner Jr BL, et al. Part 4: pediatric basic and advanced life support: 2020 American heart association guidelines for cardiopulmonary resuscitation and emergency cardiovascular care. Circulation. 2020;142:S469–523.

The present study aims to compare the ability of medical students to develop expert performance in training using HF and LF simulations, addressing respiratory discomfort and failure in pediatrics and, after three months, assess memory retention in relation to learning.

Material and methods

This is a cross-sectional, randomized, and prospective study with 70 students in their fourth year of medical school from a private institution in the city of Belo Horizonte, state of Minas Gerais, Brazil. They were taking a mandatory course called “Child and Adolescent Health III,” which aims to introduce initial knowledge regarding pediatric patient care in urgent and emergency situations. The previous use of simulation as a teaching methodology of them was based on LF. The research was conducted in the SIMULAB (the university’s simulation laboratory), in the first semester of 2021, for six days in January and two days in April, with a total workload of 6 h per participant.

The courseware was prepared in accordance with internationally accepted guidelines1717 Topjian AA, Raymond TT, Atkins D, Chan M, Duff JP, Joyner Jr BL, et al. Part 4: pediatric basic and advanced life support: 2020 American heart association guidelines for cardiopulmonary resuscitation and emergency cardiovascular care. Circulation. 2020;142:S469–523. and regional evidencebased protocols, widely used by pediatricians.1818 Fundação Hospitalar do Estado de Minas Gerais. Fhemig. Protocolos clínicos. [cited 2 May 2023]. Available from: http://www. fhemig.mg.gov.br/acesso-rapido/protocolos-clinicos
http://www. fhemig.mg.gov.br/acesso-rapi...
,1919 Hospital das Clínicas. Universidade Federal de Minas Gerais/ Ebserh. Protocolos clínicos assistenciais. [cited 2 May 2023]. Available from: http://www.gov.br/ebersh/pt/hospitais-uni-versitario/regiao-sudeste/hc-ufmg
http://www.gov.br/ebersh/pt/hospitais-un...
Eleven judges were selected by convenience sample for the construction validation2020 Cook DA, Brydges R, Ginsburg S, Hatala R. A contemporary approach to validity arguments: a practical guide to Kane’s framework. Med Educ. 2015;49:560–75. of all parts of the course.

A pilot project was carried out to provide feasibility to the study. The sample size was calculated using the results of a pilot project. The effect size adopted was 0.8 since the HF and LF groups obtained respectively average values of 16.9 (± 3.08) and 15.9 (± 3.28) in the theory pretest (total of 30 points). An average of 21.8 (± 3.23) was obtained in the post-test. The power of the test adopted was 80% and the confidence interval was 95%. The sample calculated at least 64 participants.

This research was randomized through the software (random.org)2121 Harvard: Haahr, M. RANDOM.ORG: true random number service. [cited 30 Dec 2020]. Available from: https://www.random.org
https://www.random.org...
in three steps. First, the randomization process was applied to define on which day HF or LF training would be tested (three different dates for each of the modalities). In the second stage, the participants were randomized into two groups, 31 students in HF and 39 in LF, in a non-blind approach. After that, randomization was performed to select a case in which the participant would act as a leader and would be evaluated, composing a work team in the remaining 7 cases, according to functions predetermined by the leader. Two rooms were organized, one with a manikin and equipment for infants and the other for children, being prepared according to the LF or HF simulation.

The questions addressed the topics contained in the digitalized material previously made available (topics of pediatric respiratory urgency and emergency). The students filled out a form with their sociodemographic data. On the training day, they were sent to a classroom to answer a pretest consisting of 30 multiple-choice questions (each question was worth 1 point), then they took part in an expository class. The next step was to direct the students to the simulation rooms. Participants randomized into two groups were directed to act as a leader in one case of eight scenarios: severe acute viral laryngotracheobronchitis, foreign body aspiration, moderate acute asthma, severe acute viral bronchiolitis, infectious pneumonia without effusion, complicated pneumonic pleural effusion, benzodiazepine drug intoxication, hydrocephalus with obstruction of the ventriculoperitoneal shunt. Both groups received standard training with a pre-briefing, practice simulated, and a debriefing. While one group was assessed, the other waited in a separate room, without contact, and snacks were provided to reduce the stress of waiting.

In the HF group, the following high-complexity manikins were used: SimBaby® and SimJunior® (Laerdal, USA, 2015), which were designed to help health professionals to recognize and respond effectively to pediatric patients. The scenario was an interactive room, like an emergency room with unidirectional glass, sound, and image control, and with instructors and evaluators outside the simulation room. There was an observation room with unidirectional glass exclusively for the evaluators so that the students could not have eye contact with them. The case instructor remained in another room with similar characteristics. For the LF group, the low complexity Babyboy LM-026M® (Koken, Japan, 2014) and 1005808 W45085® (Gaumard, USA, 2013) manikins were used, without stipulated function. The scenario was unlike HF, a simple classroom without a realism degree, with instructors and evaluators present in the same environment. Cognitive material to aid in activities (scanned handouts, theory testing, expository class, clinical cases for simulation, performance checklist, and cognitive material) was provided for both groups.

The randomly chosen case a scenario for each participant, using the software random.org,2121 Harvard: Haahr, M. RANDOM.ORG: true random number service. [cited 30 Dec 2020]. Available from: https://www.random.org
https://www.random.org...
was simulated in a team twice. In both simulations, the participant was individually assessed only as scenario leader, by two independent researchers using a performance checklist. The checklist included determining the following correct actions: team functions, monitoring, high or low flow oxygen, venous access, airway, breathing, types of respiratory and severity disorders, intubation and correct tube size, drugs, circulation, reevaluations, proceedings, and destination. The checklist was individualized according to the case scenario and contained an average of 10 items, to be marked by two evaluators independently.

A posttest with the same 30 multiple-choice questions used in the pretest was applied to the participants after the second simulated practice. A semi-structured questionnaire of participant’s satisfaction and self-confidence using the Likert scale of five categories was answered. Figure 1 summarizes the data collection.

Figure 1
Data collection flowchart. FICF, Free and informed consent form; HF, high fidelity; LF, low fidelity. Source: survey data.

The participant’s satisfaction of the expositive class with knowledge of the teacher, and ability to solve doubts; satisfaction and self-confidence in acquiring knowledge about the initial assessment of patients with respiratory diseases, differentiating respiratory distress and failure, and identifying different types of respiratory problems were evaluated. The items evaluated during the simulated practices were the participants’ degree of satisfaction and self-confidence in solving their doubts, decision-making, degree of realism of the simulated environment, recognition of the types of respiratory problems, differentiation of respiratory distress and failure, recognition of changes in simulated patients, the challenge provided by the environment, knowledge of team dynamics and the initial treatment of simulated cases.

After three months of training, the epidemiological data of the pandemic did not allow a face-to-face meeting, so a practical online simulation (telesimulation) using the Zoom platform was carried out to measure memory retention with a sample stratum (convenience method) with two teams of five participants in each group. In this practical assessment, the HF and LF participants were analyzed as team leaders to use only the case scenarios of asthma, chosen by lot. Performance evaluation checklists, satisfaction, and self-confidence test were applied, and tele-debriefing was performed.

The data were treated according to the outcomes of the variables. The results were analyzed using the STATA software, and were submitted to normality tests and, as a result, treated as non-parametric. The Kappa method was used to check the agreement between the two experts in the pre and post-training simulation regarding the practical performance of each participant in each group. As the LF theory pretest score does not have a normal distribution, comparisons were made using non-parametric tests and the results were displayed as quartiles. To compare the scores obtained in the theoretical pre and post-test in both groups generalized estimating equations were used to allow comparisons between groups and intra-groups in the same analysis. The p-value was considered 0.05.

An informed consent was requested to utilize the data. The project was approved by two institutions’ ethics and research committees involved, under the code CAAE: 07827319.0.0000.5149 and CAAE: 07827319.0.3001.8107).

Results

The data in Table 1 indicate that the sociodemographic characteristics of the recruited groups are similar (p > 0.05), ensuring the absence of data bias.

Table 1
Type of capacitation (HF and BF) and student profile according to sociodemographic characteristics.

The score obtained in the theory test indicated that the data do not present normal distribution and therefore they are presented in the form of median and quartiles. The results indicate that there was an increase in scores in both methodologies (p-value < 0.001 for HF and LF). When the two methodologies are compared between themselves in phase 1 of the study (HF median 16- IQR 4 and LF median 17-IQR 3; p = 0.336) there is no statistical difference, but this difference exists in memory retention (HF median 21 – IQR 4 and LF median 20 – IQR4; p = 0.043). Therefore, there is an improvement in both groups after applying the methodology, but the HF group, at the end of the process, had better results.

According to the Kappa index, the agreement between evaluators was significant for all items of the checklist of practical tests. The performance of the groups in the practical checklists was better after the second simulation in both groups (p > 0.05). The two evaluators agreed that most participants performed the expected functions for the simulated case scenario including the memory retention phase.

In the satisfaction and self-confidence evaluation using the Likert scale, the participants of both groups attributed high marks to the scanned handout and the expositive class. In the items: delivery on time, didactics, knowledge, and the teacher’s ability, acquisition of knowledge on identifying the types of respiratory problems, differentiation between respiratory discomfort (RD) and failure (RF), acquisition of knowledge about working in a team, systematic evaluation and understanding of the text, both the HF and LF group considered themselves as satisfied (>0.05).

The results of the satisfaction and self-confidence tests, in relation to the simulation practices and a hypothetical patient to be treated in the future, are presented in Tables 2 3, respectively.

Table 2
Satisfaction and self-confidence according to Likert scale – face-to-face simulated practices (n = 70) and simulated practice after three months to assess memory retention (n = 20).
Table 3
Satisfaction study according to Likert scale regarding the feeling triggered in the face of a real case with training (n = 70) and after three months (n = 20).

Discussion

There is no standardization of instruments for the assessment of diagnostic skills acquired in simulated practices, as assessment materials are created around learning objectives.44 Urbina J, Monks SM. Validating assessment tools in simulation. Treasure Island (FL): StatPearls Publishing; 2020. Theoretical knowledge is normally measured by a theory test performed right after training or a few months later. The practical skills can be evaluated through performance checklists, satisfaction and self-confidence tests, memory retention, or even team dynamics like task execution time and team mental strain. Our study covered practically all the existing tests for the assessment of learning except memory knowledge and team dynamics.

Nimbalkar et al.2222 Nimbalkar A, Patel D, Kungwani A, Phatak A, Vasa R, Nimbalkar S. Randomized control trial of high fidelity vs low fidelity simulation for training undergraduate students in neonatal resuscitation. BMC Res Notes. 2015;8:636. and Curran et al.2323 Curran V, Fleet L, White S, Bessell C, Deshpandey A, Drover A, et al. A randomized controlled study of manikin simulator fidelity on neonatal resuscitation program learning outcomes. Adv Health Sci Educ Theory Pract. 2015;20:205–18. used neonatal resuscitation cases for training in simulation and did not observe a statistically significant difference in the scores achieved in the theory posttest after training, between HF and LF participants. Agudelo et al.1515 Agudelo SI, López DS, Obando EP, Paredes IA, Milanés R, Rodríguez F, et al. Ensayo clinico aleatorizado de la comparación entre Método de Ensenanza tradicional y escenario simulado para la adquisición de competencias en el reconocimiento de signos de enfermedad respiratoria aguda en pacientes pediátricos. Rev Fund Educ Med. 2015;18:269. and Couto et al.2424 Couto TB, Farhat SC, Geis GL, Olsen O, Schvartsman C. High-fidelity simulation versus case-based discussion for teaching medical students in Brazil about pediatric emergencies. Clinics (Sao Paulo). 2015;70:393–9. compared HF with clinical case discussion in pediatric respiratory cases of anaphylaxis and pneumonia. They found higher scores in the posttest, similar between the two groups. In this study, increased scores in both methodologies were observed, therefore the HF group, at the end of the process, had better theory results.

It is the relationship between the content of a test and the construct that is intended to be measured that consolidates the validation of the instrument used.44 Urbina J, Monks SM. Validating assessment tools in simulation. Treasure Island (FL): StatPearls Publishing; 2020. Schmutz et al. tested the construct of 2 respiratory scenarios and concluded that only reliable and valid performance measures will allow medical educators to accurately evaluate the behavioral effects of training interventions and further enhance the quality of patient care.2525 Schmutz J, Manser T, Keil J, Heimberg E, Hoffmann F. Structured performance assessment in three pediatric emergency scenarios: a validation study. J Pediatr. 2015;166:1498–1504.e1. In this study, every didactic and evaluation material was submitted to construct validation, including the performance evaluation checklists. Here, the participants of both groups performed well and improved after the second simulation.

Participants and educators prefer the highest levels of fidelity, believing them to be superior to lower levels, but some authors have found that all levels of fidelity are beneficial when used appropriately.66 Carey JM, Rossler K. The how when why of high fidelity simulation. Treasure Island (FL): StatPearls Publishing; 2023, [updated 2022 May 8]. Available from https://www.ncbi.nlm.nih.gov/ books/NBK559313/.
https://www.ncbi.nlm.nih.gov/ books/NBK5...
,88 Cook DA, Hamstra SJ, Brydges R, Zendejas B, Szostek H, Wang AT, et al. Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis. Med Teach. 2013;35:e867–98.,1212 Stellflug SM, Lowe NK. The Effect of high fidelity simulators on knowledge retention and skill self-efficacy in pediatric advanced life support courses in a rural state. J Pediatr Nurs. 2018;39:21–6. Meyers et al. performed a single-center, non-randomized, two-group observational pilot trial design using an adult manikin. The authors concluded that high-fidelity simulation improves first-year medical students’ performance and overall satisfaction in teaching pulmonary physiology and suggest future studies to further explore the effectiveness of use in preclinical medical students.2626 Meyers L, Mahoney B, Schaffernocker T, Way D, Winfield S, Uribe A, et al. The effect of supplemental high Fidelity simulation training in medical students. BMC Med Educ. 2020;20:421. Participants in our study were fourth-year medical students who, having been trained in severe respiratory disease scenarios, and in face-to-face simulation, considering themselves more challenged, felt more self-confident in recognizing DR and IR, and clinical changes in simulated patients, in HF.

Simulations also allow participants to navigate the group dynamics and experience its effects on teamwork.1111 Helyer R, Dickens P. Progress in the utilization of high-fidelity simulation in basic science education. Adv Physiol Educ. 2016;40:143–4.,1313 Fagan MJ, Connelly CD, Williams BS, Fisher ES. Integrating team training in the pediatric life support program: an effective and efficient approach? J Nurs Adm. 2018;48:279–84. Team Strategies and Tools to Enhance Performance and Patient Safety (STEPPS) is a specialist approach to training health professionals in teamwork. Fagan et al. use professionals with PALS certification and the additional course STEPPS to access the effect on teamwork and report the ability to help a team make decisions that integrate brief team training and positively influence the culture of safety.1313 Fagan MJ, Connelly CD, Williams BS, Fisher ES. Integrating team training in the pediatric life support program: an effective and efficient approach? J Nurs Adm. 2018;48:279–84. A study carried out at our institution evaluating teamwork, by fourth-year medical students, used the STEPPS methodology, in cases of cardiorespiratory arrest in children and also improved performance in team behavior and group technical achievement.2727 Gonçalves BA, de Melo MD, Ferri Liu PM, Valente BC, Ribeiro VP, Vilaça E, Silva PH. Teamwork in pediatric resuscitation: training medical students on high-fidelity simulation. Adv Med Educ Pract. 2022;13:697–708. In our study, the PALS guidelines regarding teamwork were followed, without additional training for such, and in the satisfaction questionnaire there was the question “Do you consider that you learned how to work in a team?” and more than 80% of the students in both groups answered the question positively.

Pediatric simulation scenarios have been shown to be effective as an assessment tool for medical students.2525 Schmutz J, Manser T, Keil J, Heimberg E, Hoffmann F. Structured performance assessment in three pediatric emergency scenarios: a validation study. J Pediatr. 2015;166:1498–1504.e1. Despite the high prevalence of respiratory diseases among children, a study showed that medical students do not consider themselves able to deal with severe cases.1515 Agudelo SI, López DS, Obando EP, Paredes IA, Milanés R, Rodríguez F, et al. Ensayo clinico aleatorizado de la comparación entre Método de Ensenanza tradicional y escenario simulado para la adquisición de competencias en el reconocimiento de signos de enfermedad respiratoria aguda en pacientes pediátricos. Rev Fund Educ Med. 2015;18:269. This study showed that the training was effective as an educational resource and was able to quantitatively assess the two proposed levels of simulation in teaching, addressing topics of severe respiratory diseases in pediatrics.

Abulebda et al. in a cohort study involving simulation and enhanced pediatric readiness found an association with improvement in the processes of care in the general emergency department.2828 Abulebda K, Whitfill T, Montgomery EE, Thomas A, Dudas RA, Leung JS, et al. Improving pediatric readiness in general emergency departments: a prospective interventional study. J Pediatr. 2021;230:230–237.e1. Spadaro et al. in a randomized trial compared computer-based and mannequin-based approaches for training residents on mechanical ventilation using five different scenarios of acute respiratory failure. They observed a difference regarding the ability to deal with a “real” patient, including observations of continuous variations in clinical parameters, in contrast with the simple interaction with a computer screen, and only the scores of the mannequin group improved significantly [3.0 (2.5–4.0) vs. 2.0 (2.0–3.0), p = 0.005].2929 Spadaro S, Karbing DS, Fogagnolo A, Ragazzi R, Mojoli F, Astolfi L, et al. Simulation training for residents focused on mechanical ventilation: a randomized trial using mannequinbased versus computer-based simulation. Simul Healthc. 2017;12:349–55. Our study demonstrated, in relation to the hypothetical patient to be treated in the future, better confidence among medical students, to recognize RD and RI, and better preparation for systematic clinical evaluation of the patient, in HF.

For this research, the Covid-19 pandemic made data collection difficult due to the epidemiological moment in our city. Thus, a limiting factor that the authors should highlight is the decrease in the number of participants in the memory retention phase. In addition, there was a change in the assessment format from face-to-face to virtual. However, a systematic review study using randomized clinical trials observed high levels of overall satisfaction (0.60, 95% CI 0.38–0.83; p < .001) significantly favored distance online health education over traditional education.

Another limitation of this study was the unequal number of participants distributed in each group. This occurred because the participants offered to participate in the training on the dates of their availability and the randomization took place in the cases to be simulated and on the dates of the training type (HF or LF) and not directly between the participants. Finally, despite the inability of the HF manikins to demonstrate accessory muscle usage, they were able to reproduce respiratory auscultation, cyanosis, and lung expansion, facilitating the clinical discernment of respiratory distress and failure.

In this way, our findings allowed us to better understand two learning tools and describe the impacts of HF and LF simulations on the acquisition of diagnostic skills regarding major respiratory problems in pediatrics. An increase in the performance and acquisition of skills of the participants was noticed and both simulations are beneficial for the learning process in question. The authors can conclude also that our study goes beyond satisfaction and self-confidence with the applied technique. It contributes to specific aspects of satisfaction and self-confidence in severe respiratory scenarios. HF simulations lead the participant to feel more challenged and showed benefits regarding self-confidence in recognizing changes in clinical conditions, in recognizing respiratory distress and failure in pediatric cases, and in evaluating the real patients in the future. In addition, participants in this group had better grades in the theory test with better performance in terms of memory retention.

Continued advances in simulation pedagogy illustrate the need for better elucidation and standardization by researchers in future studies of the modality, levels, and types of adopted simulation fidelity so that one can be certain of the influence on the results found. Depending on the learning objective of the proposed case scenario, one level of fidelity may be more suitable than the other.

Acknowledgments

The authors thank the coordinators and collaborators of the Simulation Laboratory at Faculdade de Minas (Faminas-BH), where the study was carried out.

  • Funding
    This study did not receive any funding.

References

  • 1
    Peixoto JM, Santos SME, Faria RMD. Clinical reasoning development in medical students. Rev Bras Educ Med. 2018;42:75–83.
  • 2
    Causer J, Barach P, Williams AM. Expertise in medicine: using the expert performance approach to improve simulation training. Med Educ. 2014;48:115–23.
  • 3
    Mutter MK, Martindale JR, Shah N, Gusic ME, Wolf SJ. Case-based teaching: does the addition of high-fidelity simulation make a difference in medical students’ clinical reasoning skills? Med Sci Educ. 2020;30:307–13.
  • 4
    Urbina J, Monks SM. Validating assessment tools in simulation. Treasure Island (FL): StatPearls Publishing; 2020.
  • 5
    Sauer CJ. Realistic simulation methodology in Brazil’s new medical education curriculum: Potentialities. World Academy of Science, Engineering and Technology. Int J Educat Pedagog Sci. 2020;14:833–7.
  • 6
    Carey JM, Rossler K. The how when why of high fidelity simulation. Treasure Island (FL): StatPearls Publishing; 2023, [updated 2022 May 8]. Available from https://www.ncbi.nlm.nih.gov/ books/NBK559313/
    » https://www.ncbi.nlm.nih.gov/ books/NBK559313/
  • 7
    Kim J, Park JH, Shin S. Effectiveness of simulation-based nursing education depending on fidelity: a meta-analysis. BMC Med Educ. 2016;16:152.
  • 8
    Cook DA, Hamstra SJ, Brydges R, Zendejas B, Szostek H, Wang AT, et al. Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis. Med Teach. 2013;35:e867–98.
  • 9
    Massoth C, Röder H, Ohlenburg H, Hessler M, Zarbock A, Pöpping DM, Wenk M. High-fidelity is not superior to low-fidelity simulation but leads to overconfidence in medical students. BMC Med Educ. 2019;19:29.
  • 10
    Fragapane L, Li W, Ben Khallouq B, Cheng ZJ, Harris DM. Comparison of knowledge retention between high-fidelity patient simulation and read-only participants in undergraduate biomedical science education. Adv Physiol Educ. 2018;42:599–604.
  • 11
    Helyer R, Dickens P. Progress in the utilization of high-fidelity simulation in basic science education. Adv Physiol Educ. 2016;40:143–4.
  • 12
    Stellflug SM, Lowe NK. The Effect of high fidelity simulators on knowledge retention and skill self-efficacy in pediatric advanced life support courses in a rural state. J Pediatr Nurs. 2018;39:21–6.
  • 13
    Fagan MJ, Connelly CD, Williams BS, Fisher ES. Integrating team training in the pediatric life support program: an effective and efficient approach? J Nurs Adm. 2018;48:279–84.
  • 14
    Choi J, Lee GL. Common pediatric respiratory emergencies. Emerg Med Clin North Am. 2012;30. 529-x.
  • 15
    Agudelo SI, López DS, Obando EP, Paredes IA, Milanés R, Rodríguez F, et al. Ensayo clinico aleatorizado de la comparación entre Método de Ensenanza tradicional y escenario simulado para la adquisición de competencias en el reconocimiento de signos de enfermedad respiratoria aguda en pacientes pediátricos. Rev Fund Educ Med. 2015;18:269.
  • 16
    Zar HJ, Ferkol TW. The global burden of respiratory disease-impact on child health. Pediatr Pulmonol. 2014;49:430–4.
  • 17
    Topjian AA, Raymond TT, Atkins D, Chan M, Duff JP, Joyner Jr BL, et al. Part 4: pediatric basic and advanced life support: 2020 American heart association guidelines for cardiopulmonary resuscitation and emergency cardiovascular care. Circulation. 2020;142:S469–523.
  • 18
    Fundação Hospitalar do Estado de Minas Gerais. Fhemig. Protocolos clínicos. [cited 2 May 2023]. Available from: http://www. fhemig.mg.gov.br/acesso-rapido/protocolos-clinicos
    » http://www. fhemig.mg.gov.br/acesso-rapido/protocolos-clinicos
  • 19
    Hospital das Clínicas. Universidade Federal de Minas Gerais/ Ebserh. Protocolos clínicos assistenciais. [cited 2 May 2023]. Available from: http://www.gov.br/ebersh/pt/hospitais-uni-versitario/regiao-sudeste/hc-ufmg
    » http://www.gov.br/ebersh/pt/hospitais-uni-versitario/regiao-sudeste/hc-ufmg
  • 20
    Cook DA, Brydges R, Ginsburg S, Hatala R. A contemporary approach to validity arguments: a practical guide to Kane’s framework. Med Educ. 2015;49:560–75.
  • 21
    Harvard: Haahr, M. RANDOM.ORG: true random number service. [cited 30 Dec 2020]. Available from: https://www.random.org
    » https://www.random.org
  • 22
    Nimbalkar A, Patel D, Kungwani A, Phatak A, Vasa R, Nimbalkar S. Randomized control trial of high fidelity vs low fidelity simulation for training undergraduate students in neonatal resuscitation. BMC Res Notes. 2015;8:636.
  • 23
    Curran V, Fleet L, White S, Bessell C, Deshpandey A, Drover A, et al. A randomized controlled study of manikin simulator fidelity on neonatal resuscitation program learning outcomes. Adv Health Sci Educ Theory Pract. 2015;20:205–18.
  • 24
    Couto TB, Farhat SC, Geis GL, Olsen O, Schvartsman C. High-fidelity simulation versus case-based discussion for teaching medical students in Brazil about pediatric emergencies. Clinics (Sao Paulo). 2015;70:393–9.
  • 25
    Schmutz J, Manser T, Keil J, Heimberg E, Hoffmann F. Structured performance assessment in three pediatric emergency scenarios: a validation study. J Pediatr. 2015;166:1498–1504.e1.
  • 26
    Meyers L, Mahoney B, Schaffernocker T, Way D, Winfield S, Uribe A, et al. The effect of supplemental high Fidelity simulation training in medical students. BMC Med Educ. 2020;20:421.
  • 27
    Gonçalves BA, de Melo MD, Ferri Liu PM, Valente BC, Ribeiro VP, Vilaça E, Silva PH. Teamwork in pediatric resuscitation: training medical students on high-fidelity simulation. Adv Med Educ Pract. 2022;13:697–708.
  • 28
    Abulebda K, Whitfill T, Montgomery EE, Thomas A, Dudas RA, Leung JS, et al. Improving pediatric readiness in general emergency departments: a prospective interventional study. J Pediatr. 2021;230:230–237.e1.
  • 29
    Spadaro S, Karbing DS, Fogagnolo A, Ragazzi R, Mojoli F, Astolfi L, et al. Simulation training for residents focused on mechanical ventilation: a randomized trial using mannequinbased versus computer-based simulation. Simul Healthc. 2017;12:349–55.
  • 30
    He L, Yang N, Xu L, Oing F, Li W, Sun Q, et al. Synchronous distance education vs. traditional education for health science students: a systematic review and meta-analysis. Med Educ. 2021;55:293–308.

Publication Dates

  • Publication in this collection
    13 Oct 2023
  • Date of issue
    2023

History

  • Received
    27 Nov 2022
  • Accepted
    12 Apr 2023
  • Published
    24 May 2023
Sociedade Brasileira de Pediatria Av. Carlos Gomes, 328 cj. 304, 90480-000 Porto Alegre RS Brazil, Tel.: +55 51 3328-9520 - Porto Alegre - RS - Brazil
E-mail: jped@jped.com.br