Acessibilidade / Reportar erro

SIMULATED PATIENT VERSUS HIGH-FIDELITY SIMULATOR: SATISFACTION, SELF-CONFIDENCE AND KNOWLEDGE AMONG NURSING STUDENTS IN BRAZIL

ABSTRACT

Objective

to assess and compare satisfaction, self-confidence and knowledge among Nursing students in the use of simulated patients and high-fidelity simulators.

Method

a quasi-experimental study conducted in 2017 with 150 students from a private university The participants answered a pre-test to assess knowledge and participated in a lecture and in skills training. After the simulation, the students answered the Satisfaction with Simulated Clinical Experiences scale and the Satisfaction and Self-confidence in Learning and Knowledge scale. The data were analyzed based on non-parametric tests.

Results

the students showed high rates of satisfaction (93.5 and 92.5), self-confidence (4.3 and 4.4) and knowledge gain (6.2 and 6.4). There were no significant differences in the comparison between the simulated patient group and the high-fidelity simulator group regarding satisfaction, self-confidence and knowledge.

Conclusion

the findings showed that well-prepared settings can be obtained with lower costs, and with an effective impact on the students’ learning.

DESCRIPTORS
Simulation; Patient Simulation; Training with High-Fidelity Simulation; Nursing Students; Learning

RESUMO

Objetivo

avaliar e comparar satisfação, autoconfiança e conhecimento entre estudantes de enfermagem na utilização de paciente simulado e simulador de alta fidelidade.

Método

estudo quase experimental, com 150 estudantes de uma universidade privada, em 2017. Os participantes responderam pré-teste para avaliação de conhecimento, participaram de aula expositiva e treino de habilidades. Após a simulação, os estudantes responderam a Escala de Satisfação com as Experiências Clínicas Simuladas, Escala de Satisfação e Autoconfiança no aprendizado e conhecimento. Os dados foram analisados a partir de testes não paramétricos.

Resultados

estudantes demonstraram altos índices de satisfação (93,5 e 92,5) e autoconfiança (4,3 e 4,4) e ganho de conhecimento (6,2 e 6,4). Não houve diferenças significativas na comparação do grupo paciente simulado e do grupo simulador de alta fidelidade quanto à satisfação, autoconfiança e conhecimento.

Conclusão

os achados demonstraram que cenários bem-preparados podem ser obtidos com menores custos, com impacto no aprendizado dos estudantes.

DESCRITORES
Simulação; Simulação de Paciente; Treinamento com Simulação de Alta Fidelidade; Estudantes de Enfermagem; Aprendizagem

RESUMEN

Objetivo

evaluar y comparar la satisfacción, la seguridad en sí mismos y el conocimiento entre estudiantes de Enfermería en la utilización de pacientes simulados y simuladores de alta fidelidad.

Método

estudio cuasi experimental, realizado en el año 2017 con 150 estudiantes de una universidad privada. Los participantes respondieron una prueba previa para evaluar el conocimiento, participaron de una clase de exposición y de entrenamiento de habilidades. Después de la simulación, los estudiantes respondieron la Escala de Satisfacción con las Experiencias Clínicas Simuladas, y la Escala de Satisfacción y Seguridad en sí mismos en relación con el aprendizaje y el conocimiento. Los datos se analizaron a partir de pruebas no paramétricas.

Resultados

los estudiantes demostraron altos índices de satisfacción (93,5 y 92,5), seguridad en sí mismos (4,3 y 4,4) y aumento del conocimiento (6,2 y 6,4). No hubo diferencias significativas en la comparación entre el grupo del paciente simulado y el del simulador de alta fidelidad en términos de satisfacción, seguridad en sí mismos y conocimiento.

Conclusión

las conclusiones obtenidas demuestran que pueden lograrse escenarios ficticios bien preparados con menores costos, con efecto sobre el aprendizaje de los estudiantes.

DESCRIPTORES
Simulación; Simulación de paciente; Entrenamiento con simulación de alta fidelidad; Estudiantes de Enfermería; Aprendizaje

INTRODUCTION

Nursing training has been based on scientific evidence, in search for a competent, critical and reflective professional, capable of developing cognitive, technical and attitudinal skills(11 Itatani T, Nagata K, Yanagihara K, Tabuchi N. Content analysis of student essays after attending a problem-based learning course: facilitating the development of critical thinking and communication skills in japanese nursing students. Healthcare [Internet]. 2017 [acesso em 21 mar 2021]; 5(3). Disponível em: https://doi.org/10.3390/healthcare5030047.
https://doi.org/10.3390/healthcare503004...
). In this context, evidence has shown that the use of technologies can be a strong ally in the improvement of teaching strategies that train nurses, both during their training and in their performance in health services(22 Teixeira INDO, Felix JVC. Simulação como estratégia de ensino em enfermagem: revisão de literatura. Interface (Botucatu) [Internet]. 2011 [acesso em 20 jan 2018]; 15(39): 1173-84. Disponível em: https://doi.org/10.1590/S1414-32832011005000032.
https://doi.org/10.1590/S1414-3283201100...
).

Among the several technologies used for training in health, clinical simulation is a pedagogical strategy that provides experiential learning opportunities, capable of joining theory and practice, and must be stimulated in Nursing training so as to prepare the students for providing care to patients with safety and quality based on training, improvement and reflections in laboratories(33 Oliveira SN de, Massaroli A, Martini JG, Rodrigues J. From theory top ratice, operating the clinical simulation in Nursing teaching. Rev. Bras. Enferm. [Internet]. 2018 [acesso em 21 mar 2021]; 71. Disponível em: https://doi.org/10.1590/0034-7167-2017-0180.
https://doi.org/10.1590/0034-7167-2017-0...
-44 Miranda FBG, Mazzo A, Pereira Junior GA. Avaliação de competências individuais e interprofissionais de profissionais de saúde em atividades clínicas simuladas: scoping review. Interface [Internet]. 2018 [acesso em 20 jan 2018]; 22(67). Disponível em: http://doi.org/10.1590/1807-57622017.0628.
https://doi.org/10.1590/1807-57622017.06...
).

Clinical simulation is a strategy included in the active teaching methodologies, which awakens the student’s motivation, enables reflection about the knowledge acquired and attributes meaning to it. In simulation, the feeling of motivation leads to satisfaction and self-confidence with the learning process(55 Baptista RCN, Martins JCA, Pereira MFCR, Mazzo A. Students’ satisfaction with simulated clinical experiences: validation of an assessment scale. Rev. Latino-Am. Enfermagem [Internet]. 2014 [acesso em 20 jan 2018]; 22(5): 709-15. Disponível em: http://doi.org/10.1590/0104-1169.3295.2471.
https://doi.org/10.1590/0104-1169.3295.2...

6 Costa RR de O, Medeiros SM de, Coutinho VRD, Mazzo A, Araújo MS de. Satisfaction and self-confidence in the learning of nursing students: randomized clinical trial. Esc. Anna Nery [Internet]. 2020 [acesso em 20 mar 2021]; 24(1). Disponível em: https://doi.org/10.1590/2177-9465-ean-2019-0094.
https://doi.org/10.1590/2177-9465-ean-20...

7 Nascimento MS do, Magro MC da S. Realistic simulation: method of improving knowledge and self-confidence of nursing students in the administration of medication. Rev. Min Enferm [Internet]. 2018 [acesso em 20 mar 2021]; 22. Disponível em: http://www.dx.doi.org/10.5935/1415-2762.20180024.
https://doi.org/10.5935/1415-2762.201800...
-88 Franzon JC, Meska MHG, Cotta Filho CK, Machado GCC, Mazzo A. Implications of the clinical pratice in simulated activies: student satisfaction and selfconfidence. Rev. Min Enferm [Internet]. 2020 [acesso em 20 mar 2021]; 24. Disponível em: http://www.dx.doi.org/10.5935/1415-2762.20200003.
https://doi.org/10.5935/1415-2762.202000...
).

Despite the increasing use of simulators, clinical simulation is not a new concept. Simulators have been incorporated into teaching since 1950. Initially, they consisted in static models used for skills learning; in the last decades, simulators have incorporated enough computing and robotics to bring them closer to several human functions(99 Martins JCA, Mazzo A, Baptista RCN, Coutinho VRD, Godoy S de, Mendes IAC, et al. The simulated clinical experience in nursing education: a historical review. Acta paul. Enferm. [Internet]. 2012 [acesso em 20 jan 2018]; 25(4): 619-25. Disponível em: http://doi.org/10.1590/S0103-21002012000400022.
https://doi.org/10.1590/S0103-2100201200...
).

However, the greater the demand for technology, the greater the cost of the simulators and the greater the need to train the professionals, so that they can effectively handle the technology, as well as adequate physical spaces prepared to meet the necessary requirements for simulated practices and bring them closer to the real clinical practice(1010 Brandão CFS, Carvalho-Filho MA de, Cecilio-Fernandes D. Simulation centers and pedagogical planning: Two sides of the same coin. Sci Med. [Internet]. 2018. [acesso em 10 mar 2019]; 28(1). Disponível em: https://revistaseletronicas.pucrs.br/ojs/index.php/scientiamedica/article/view/28709.
https://revistaseletronicas.pucrs.br/ojs...
).

Given the financial problems of many educational and health institutions, the use of actors, students and/or other professionals, who play the role of simulated patients in simulated clinical practices, can be considered a good alternative, since it associates liveliness with activity and does not require onerous technologies. When associated to anatomical pieces, they characterize what we call mixed patients(1111 Negri EC, Mazzo A, Martins JCA, Pereira Junior GA, Almeida RG dos S, Pedersoli CE. Clinical simulation with dramatization: gains perceived by students and health professionals. Rev. Latino-Am. Enfermagem [Internet]. 2017 [acesso em 05 abr 2019]; 25. Disponível em: http://doi.org/10.1590/1518-8345.1807.2916.
https://doi.org/10.1590/1518-8345.1807.2...
), favor procedures and confer verisimilitude to the simulated practices.

A number of studies show that, regardless the fidelity level or modality, clinical simulation contributes positively to learning(1212 Ribeiro V dos S, Garbuio DC, Zamarolli CM, Eduardo AHA, Carvalho EC de. Clinical simulation and training for Advanced Nursing Practices: na integrative review. Acta Paul Enferm. [Internet]. 2018 [acesso em 03 mar 2021]; 31(6): 659-66. Disponível em: https://doi.org/10.1590/1982-0194201800090.
https://doi.org/10.1590/1982-01942018000...
). However, the number of studies comparing the use of simulated patients to simulators is still scarce(1313 Zapko KA, Ferranto MLG, Blasiman R, Shelestak D. Evaluating best educational practices, student satisfaction, and self-confidence in simulation: a descriptive study. Nurse Educ Today [Internet]. 2018 [acesso em 20 jan 2020]; 60. Disponível em: http://doi.org/10.1016/j.nedt.2017.09.006.
https://doi.org/10.1016/j.nedt.2017.09.0...

14 Ignacio J, Dolmans D, Scherpbier A, Rethans Jan-Joost, Chan S, Liaw SY. Comparison of standardized patients with high-fidelity simulators for managing stress and improving performance in clinical deterioration: a mixed methods study. Nurse Educ Today. [Internet]. 2015 [acesso em 20 jan 2018]; 35(12): 1161-68. Disponível em: http://doi.org/10.1016/j.nedt.2015.05.009.
https://doi.org/10.1016/j.nedt.2015.05.0...
-1515 Reis SN, Neves CC, Alves DA, Lopes RR de S, Souza KV de, Ribeiro L da CC, et al. Conhecimentos, satisfação e autoconfiança em profissionais de saúde: simulação com manequim versus paciente-ator. Revista de Enfermagem Referência [Internet]. 2020 [acesso em 20 mar 2021]; 3. Disponível em: https://www.redalyc.org/articulo.oa?id=388264768002.
https://www.redalyc.org/articulo.oa?id=3...
). In this sense, there is difficulty comparing the gains in the teaching-learning process in Nursing training between these two strategies.

Consequently, this study aims at assessing and comparing satisfaction, self-confidence and knowledge among Nursing students in the use of simulated patients and high-fidelity simulators.

The following hypotheses were considered: 1) Null Hypothesis: there is no difference in the levels of satisfaction, self-confidence and knowledge of the Nursing students who participate in high-fidelity clinical simulation using the high-fidelity simulator versus the simulated patient; 2) Alternative Hypothesis: there is a difference in the levels of satisfaction, self-confidence and knowledge of the Nursing students who participate in high-fidelity clinical simulation using the high-fidelity simulator versus simulated patient.

METHOD

A quantitative study of a quasi-experimental nature. The population consisted of undergraduate Nursing students regularly enrolled in the sixth, seventh and eighth semesters of a private university in the inland of the state of São Paulo. The inclusion criteria were as follows: being an undergraduate Nursing student, over 18 years old, who had already attended the Nursing Assistance for Surgical Patients academic subject and completed all the stages proposed for the development of the study.

Sampling was non-probabilistic and by convenience. The students enrolled in the sixth, seventh and eighth semesters of the Nursing course were invited to participate in the research. For recruitment, a workshop entitled “Nursing Assistance for Stomized Patients” was conducted. The event was held on three consecutive days, disclosed on the institution page and with free enrollment. Subsequently, the enrolled participants were offered access to the theoretical content on the theme proposed for previous exploration. The material was elaborated following the theoretical framework(1616 Freire D de A, Angelim RC de M, Souza NR de, Brandão BMG de M, Torres KMS, Serrano SQ. Self-image and self-care in the experience of ostomy patints: the nursing look. Rev. Min. Enferm. [Internet]. 2017 [acesso em 25 ago 2018]; 21. Disponível em: http://www.dx.doi.org/10.5935/1415-2762.20170029.
https://doi.org/10.5935/1415-2762.201700...
-1717 Leite M de S, Aguiar LC de. Diagnóstico de enfermagem em pacientes submetidos à colostomia. Enferm. Foco. [Internet]. 2017 [acesso em 10 mar 2021]; 8(2): 72-6. Disponível em: https://doi.org/10.21675/2357-707X.2017.v8.n2.1227.
https://doi.org/10.21675/2357-707X.2017....
).

The workshop took place on August 9th, 10th and 11th, 2017. On the first day, the students answered the instrument for collecting sociodemographic data and assessing knowledge, followed by an expository-dialog class given by a specialist in stomatherapy, lasting one hour and 30 minutes.

The sample consisted in 150 students who met the inclusion criteria. The students received an identification number and were divided into two groups, as follows: a) Simulated Patient Group (SPG): comprised by students undergoing skills training, high-fidelity clinical simulation, with the use of a simulated patient; b) High-Fidelity Simulator (HFS): comprised by students undergoing skills training and high-fidelity clinical simulation, with the use of a high-fidelity simulator (SIM MAN 3G Laerdal®). For division of the groups, the course semester in which the students were enrolled was considered, so as they were homogeneous.

The groups were subdivided into subgroups of 10 students and, at a scheduled time, they performed skills training followed by a simulated clinical setting and debriefing(1818 Coutinho VRD, Martins JCA, Pereira F. Structured debriefing in nursing simulation: students’ perceptions. J Nurs Educ Pract. [Internet]. 2016 [acesso em 15 jul 2019]; 6(9): 127-34. Disponível em: http://doi.org/10.5430/jnep.v6n9p127.
https://doi.org/10.5430/jnep.v6n9p127...
).

The didactic laboratories were duly equipped with low-fidelity simulators composed of MDF plates, with biscuit stoma, collecting devices, adhesive bases and multiple adjuvants for intestinal stomas (protective barrier in powder and pastes, skin film former, adjustable elastic belt, clips, adhesive remover, activated carbon filter and thickener for effluents). For skills training, a committee made up by specialists previously trained by the researchers was assembled.

After skills training, the subgroups were directed to conduct the simulated clinical setting. The setting proposed for the activity was built based on the theoretical framework(1616 Freire D de A, Angelim RC de M, Souza NR de, Brandão BMG de M, Torres KMS, Serrano SQ. Self-image and self-care in the experience of ostomy patints: the nursing look. Rev. Min. Enferm. [Internet]. 2017 [acesso em 25 ago 2018]; 21. Disponível em: http://www.dx.doi.org/10.5935/1415-2762.20170029.
https://doi.org/10.5935/1415-2762.201700...
-1717 Leite M de S, Aguiar LC de. Diagnóstico de enfermagem em pacientes submetidos à colostomia. Enferm. Foco. [Internet]. 2017 [acesso em 10 mar 2021]; 8(2): 72-6. Disponível em: https://doi.org/10.21675/2357-707X.2017.v8.n2.1227.
https://doi.org/10.21675/2357-707X.2017....
), validated by a group of nine specialists in clinical simulation and stomatherapy. A Content Validity Index (CVI) equal to or greater than 0.8 was considered(1919 Grant JS, Davis LL. Selection and use of content experts for instrument development. Res. Nurs Health [Internet]. 1998 [acesso em 31 mai 2018]; 20(3): 269-74. Disponível em: https://doi.org/10.1002/(SICI)1098-240X(199706)20:3%3C269::AID-NUR9%3E3.0.CO;2-G.
https://doi.org/10.1002/(SICI)1098-240X(...
).

The environments of the simulated clinical settings – either with a simulated patient or with a high-fidelity simulator – were prepared with the same furniture resources. The following was observed: a) the high-fidelity simulator and the simulated patient were characterized with appropriate clothing for the hospital environment; b) for making the stoma located on the left lateral region of the abdomen, close to the transumbilical line, latex was used for fixation; as well as artistic makeup mass; red paint and artificial blood; c) the colostomy bag feces were prepared with a characteristic odor from fermented foods.

When conducting the scenarios, in each of the subgroups two students assisted the patient, led by a facilitator (pre-briefing, briefing and debriefing). The other students monitored the setting following an evaluation checklist. The situations lasted approximately 15 minutes and, at the end, the students participated in a structured debriefing(1818 Coutinho VRD, Martins JCA, Pereira F. Structured debriefing in nursing simulation: students’ perceptions. J Nurs Educ Pract. [Internet]. 2016 [acesso em 15 jul 2019]; 6(9): 127-34. Disponível em: http://doi.org/10.5430/jnep.v6n9p127.
https://doi.org/10.5430/jnep.v6n9p127...
) session lasting from 25 to 30 minutes.

After solving the situation, the students answered the Scale of Satisfaction with Simulated Clinical Experiences (Escala de Satisfação com as Experiências Clínicas Simuladas, ESECS)(5), the Scale of Satisfaction and Self-Confidence in Learning (Escala de Satisfação e Autoconfiança na Aprendizagem, ESAA)(2020 Almeida RG dos S, Mazzo A, Martins JCA, Baptista RCN, Girão FB, Mendes IAC. Validation to Portuguese of the Scale of Student Satisfaction and Self-Confidence in Learning. Rev. Latino-Am. Enfermagem. [Internet]. 2015 [acesso em 20 jan 2018]; 23(6): 1007-13. Disponível em: http://doi.org/10.1590/0104-1169.0472.2643.
https://doi.org/10.1590/0104-1169.0472.2...
), and the Instrument for sociodemograpic characterization and knowledge assessment, all described below.

The knowledge assessment instrument (pre- and post-tests) consisted of 10 multiple-choice questions with an overall score of 10 points, which addressed care with the ostomy bag, characteristics of the effluents, aspects of the peristomal skin, complications and guidelines referring to self-care, elaborated based on the theoretical frameworks(1616 Freire D de A, Angelim RC de M, Souza NR de, Brandão BMG de M, Torres KMS, Serrano SQ. Self-image and self-care in the experience of ostomy patints: the nursing look. Rev. Min. Enferm. [Internet]. 2017 [acesso em 25 ago 2018]; 21. Disponível em: http://www.dx.doi.org/10.5935/1415-2762.20170029.
https://doi.org/10.5935/1415-2762.201700...
-1717 Leite M de S, Aguiar LC de. Diagnóstico de enfermagem em pacientes submetidos à colostomia. Enferm. Foco. [Internet]. 2017 [acesso em 10 mar 2021]; 8(2): 72-6. Disponível em: https://doi.org/10.21675/2357-707X.2017.v8.n2.1227.
https://doi.org/10.21675/2357-707X.2017....
, 2121 Paula MAB, Cesaretti IUR. Cuidando de Pessoas com Complicação nas Estomias Intestinais e Pele Periestoma. In: Santos VLCG, Cesaretti IUR. Assistência em Estomaterapia: Cuidando de Pessoas com Estoma. São Paulo: Atheneu; 2015. 345-362.).

ESECS has 17 10-point Likert-type items, subdivided into the following three dimensions: Practice dimension, Realism dimension and Cognitive dimension(55 Baptista RCN, Martins JCA, Pereira MFCR, Mazzo A. Students’ satisfaction with simulated clinical experiences: validation of an assessment scale. Rev. Latino-Am. Enfermagem [Internet]. 2014 [acesso em 20 jan 2018]; 22(5): 709-15. Disponível em: http://doi.org/10.1590/0104-1169.3295.2471.
https://doi.org/10.1590/0104-1169.3295.2...
). On the other hand, ESAA has 13 5-point Likert-type items, divided into two dimensions (satisfaction and self-confidence in learning), developed by the National League for Nursing (NLN), translated and validated for Portuguese(2020 Almeida RG dos S, Mazzo A, Martins JCA, Baptista RCN, Girão FB, Mendes IAC. Validation to Portuguese of the Scale of Student Satisfaction and Self-Confidence in Learning. Rev. Latino-Am. Enfermagem. [Internet]. 2015 [acesso em 20 jan 2018]; 23(6): 1007-13. Disponível em: http://doi.org/10.1590/0104-1169.0472.2643.
https://doi.org/10.1590/0104-1169.0472.2...
).

After collection, the data were double coded into Excel spreadsheets, and exported and analyzed in the SAS 9.2 (Statistical Analysis Software) program. The ESAA and ESECS dimensions were calculated based on the validation articles(55 Baptista RCN, Martins JCA, Pereira MFCR, Mazzo A. Students’ satisfaction with simulated clinical experiences: validation of an assessment scale. Rev. Latino-Am. Enfermagem [Internet]. 2014 [acesso em 20 jan 2018]; 22(5): 709-15. Disponível em: http://doi.org/10.1590/0104-1169.3295.2471.
https://doi.org/10.1590/0104-1169.3295.2...
,2020 Almeida RG dos S, Mazzo A, Martins JCA, Baptista RCN, Girão FB, Mendes IAC. Validation to Portuguese of the Scale of Student Satisfaction and Self-Confidence in Learning. Rev. Latino-Am. Enfermagem. [Internet]. 2015 [acesso em 20 jan 2018]; 23(6): 1007-13. Disponível em: http://doi.org/10.1590/0104-1169.0472.2643.
https://doi.org/10.1590/0104-1169.0472.2...
). In the case of ESAA, the dimensions were calculated based on the mean of the answers to the corresponding items. In the case of ESECS, on the other hand, the dimensions were calculated in the form of percentages, obtaining a value between zero and 100.

For the comparisons between the groups in relation to ESAA, ESECS and knowledge (pre- and post-test), the analysis of covariance (ANCOVA) was proposed, which, in addition to comparing groups, allows for the adjustment of covariates. A significance level of 5% was adopted for all the comparisons.

In relation to the ethical aspects, it is emphasized that this study was approved by the Research Ethics Committee, under opinion No. 1,771,330.

RESULTS

Of the 150 participants, 72 (48%) were allocated to the Simulated Patient Group and 78 (52%) to the High-Fidelity Simulator Group. The female gender prevailed with 136 (90.7%). The mean age was 26.2 years old (SD±7), with minimum and maximum ages of 19 and 51, respectively. Most of them were in the sixth semester; 64 (42.7%), and 112 (74.7%) were active students. However, 31 (20,7%) had work experience in Nursing(nursing assistants or technicians). All, 150 (100%), had previous experience with simulation; 92 (61.3%) with simulated patients. Preference for active learning methods was stated by 89 (59.3%) participants.

The setting proposed for the activity was built based on the theoretical framework about stomas(1616 Freire D de A, Angelim RC de M, Souza NR de, Brandão BMG de M, Torres KMS, Serrano SQ. Self-image and self-care in the experience of ostomy patints: the nursing look. Rev. Min. Enferm. [Internet]. 2017 [acesso em 25 ago 2018]; 21. Disponível em: http://www.dx.doi.org/10.5935/1415-2762.20170029.
https://doi.org/10.5935/1415-2762.201700...
-1717 Leite M de S, Aguiar LC de. Diagnóstico de enfermagem em pacientes submetidos à colostomia. Enferm. Foco. [Internet]. 2017 [acesso em 10 mar 2021]; 8(2): 72-6. Disponível em: https://doi.org/10.21675/2357-707X.2017.v8.n2.1227.
https://doi.org/10.21675/2357-707X.2017....
), validated by a group of nine specialists in clinical simulation and stomatherapy. The CVI of the setting evaluation by the experts was 1.0 and that of the knowledge assessment instrument was 0.9.

Table 1 presents the sociodemographic profile, the previous experience with the topic and the learning method.

Table 1
Distribution of the Nursing undergraduate students by group regarding gender, age, occupation, preference in relation to learning modalities, training, previous activity in lab, and previous experience with the theme. Ribeirão Preto, SP, Brazil, 2017

Table 2 shows the scores obtained in the ESECS, ESAA and Knowledge Assessment scales (pre- and post-test). Internal consistency of the instruments was verified by means of Cronbach’s alpha, with the following results: ESECS (0.870), ESAA (0.807).

Table 2
Values obtained by the undergraduate Nursing students of the Simulated Patient and High-Fidelity Simulator groups, according to the ESECS * * ESECS - Escala de Satisfação com as Experiências Clínicas Simuladas (Scale of Satisfaction with Simulated Clinical Experiences); , ESAA ESAA - Escala de Satisfação e Autoconfiança no Aprendizado (Scale of Satisfaction and Self-Confidence in Learning); SPG: , and Knowledge Assessment scales (pre- and post-test) and the skills assessment checklist. Ribeirão Preto, SP, Brazil, 2017

When comparing the groups (Simulated Patient Group and High-Fidelity Simulator Group), it was possible to observe that there were no statistically significant differences (p-value<0.05) in the ESECS and ESAA results, which confirms the null hypothesis (no difference in the satisfaction and self-confidence levels of the Nursing students participating in a high-fidelity clinical simulation using the high-fidelity simulator versus the simulated patient). This comparison is presented in Table 3.

Table 3
Comparison between the Simulated Patient and High-Fidelity Simulator groups regarding the values obtained in ESECS and ESAA. Ribeirão Preto, São Paulo, Brazil, 2017

Table 4 shows the comparison of the study variables (semester attended) in the pre- and post-test knowledge assessment values. There was a statistically significant difference in pre- and post- test knowledge, regardless of the group and of the semester the student was attending. It was discovered that knowledge gain can be considered identical in both groups.

Table 4
Comparison between the Simulated Patient and High-Fidelity Simulator groups in the values of the pre- and post-test Knowledge Assessment per semester attended. Ribeirão Preto, São Paulo, Brazil, 2017

Table 5 presents the comparison of knowledge between the Simulated Patient and High-Fidelity Simulator groups and the ESAA and ESECS factors, in which it is evidenced that, regarding the satisfaction and self-confidence levels, there is a statistical difference between the groups post- and pre-test.

Table 5
Comparison of the pre- and post-test knowledge and the factors of the ESAA * * ESAA - Escala de Satisfação e Autoconfiança no Aprendizado (Scale of Satisfaction and Self-Confidence in Learning) and ESECS ESECS - Escala de Satisfação com as Experiências Clínicas Simuladas (Scale of Satisfaction with Simulated Clinical Experiences); scales. Ribeirão Preto, SP, Brazil, 2017

DISCUSSION

The study compared satisfaction, self-confidence and knowledge among Nursing students with the use of a simulated patient and a high-fidelity simulator in the care provided to stomized patients. The results show that there was no statistically significant difference between both clinical simulation modalities adopted. In addition to that, they also show that both strategies are effective means to promote learning.

Assessing students’ satisfaction with the pedagogical strategies used is an important indicator of the teaching process quality. Students satisfied with knowledge acquisition presented higher rates of self-confidence and motivation to learn, impacting on the quality of the educational process(55 Baptista RCN, Martins JCA, Pereira MFCR, Mazzo A. Students’ satisfaction with simulated clinical experiences: validation of an assessment scale. Rev. Latino-Am. Enfermagem [Internet]. 2014 [acesso em 20 jan 2018]; 22(5): 709-15. Disponível em: http://doi.org/10.1590/0104-1169.3295.2471.
https://doi.org/10.1590/0104-1169.3295.2...
). Thus, it is relevant that Higher Education Institutions (HEIs) study the use of tools that value significant learning and its evidence.

In ESECS, the three domains (“Practice dimension”, “Realism dimension” and “Cognitive dimension”) presented high scores in both groups. It is believed that the high level of satisfaction with the simulated experience may have contributed to greater gains in satisfaction and self-confidence. In this study, the physical and material resources, the participation of specialists and the simulation stages were meticulously respected, which led to successful activity scenarios, regardless of the method.

The results support other research studies that assessed students’ satisfaction and self-confidence and that used the clinical simulation strategy with the use of simulated patients and simulators(1313 Zapko KA, Ferranto MLG, Blasiman R, Shelestak D. Evaluating best educational practices, student satisfaction, and self-confidence in simulation: a descriptive study. Nurse Educ Today [Internet]. 2018 [acesso em 20 jan 2020]; 60. Disponível em: http://doi.org/10.1016/j.nedt.2017.09.006.
https://doi.org/10.1016/j.nedt.2017.09.0...

14 Ignacio J, Dolmans D, Scherpbier A, Rethans Jan-Joost, Chan S, Liaw SY. Comparison of standardized patients with high-fidelity simulators for managing stress and improving performance in clinical deterioration: a mixed methods study. Nurse Educ Today. [Internet]. 2015 [acesso em 20 jan 2018]; 35(12): 1161-68. Disponível em: http://doi.org/10.1016/j.nedt.2015.05.009.
https://doi.org/10.1016/j.nedt.2015.05.0...
-1515 Reis SN, Neves CC, Alves DA, Lopes RR de S, Souza KV de, Ribeiro L da CC, et al. Conhecimentos, satisfação e autoconfiança em profissionais de saúde: simulação com manequim versus paciente-ator. Revista de Enfermagem Referência [Internet]. 2020 [acesso em 20 mar 2021]; 3. Disponível em: https://www.redalyc.org/articulo.oa?id=388264768002.
https://www.redalyc.org/articulo.oa?id=3...
).

A study involving 62 Nursing students(2222 Ates E, Ünver V, Ulus B. Effect of Two Different Simulation Modalities in Environmental Safety Teaching for Stroke Patients on Nursing Students’Stress, Self-Confidence and Satisfaction. J Hacettepe University Faculty of Nursing [Internet]. 2020 [acesso em 30 ago 2020]; 7(1). Disponível em: https://dergipark.org.tr/tr/download/article-file/1037982.
https://dergipark.org.tr/tr/download/art...
) compared the use of the medium-fidelity simulator and the simulated patient, and identified high scores in the students’ satisfaction and self-confidence; however, the simulated patient group obtained higher satisfaction and self-confidence scores.

Regarding knowledge gain, it was significantly higher after the simulated practices in both groups, regardless of the semester attended. When comparing knowledge between the groups and the ESAA and ESECS factors, it is perceived that, among the students who presented higher satisfaction levels, there was less improvement in knowledge; however, those who showed better self-confidence had greater knowledge gains.

The findings corroborate the idea that self-confidence is strongly related to knowledge. Students need self-confidence to be successful in entering the clinical practice in health. However, a study(2323 Shinnick MA, Woo MA. Does nursing student self-efficacy correlate with knowledge when using human patient simulation? Clin Simul Nurs. [Internet]. 2014 [acesso em 20 jan 2018]; 10(2): 71-9. Disponível em: http://doi.org/10.1016/j.ecns.2013.07.006.
https://doi.org/10.1016/j.ecns.2013.07.0...
) drew the attention to the fact that self-confidence cannot be an acceptable replacement measure for knowledge, and should not be used as the only or prime variable to assess students’ understanding of concepts.

Simulation allows developing clinical skills, reflective-critical judgment and performance assessment, through feedback to the students, which contributes to self-knowledge and to the development of self-confidence(2424 Araújo PRS, Duarte TT da P, Magro MC da S. Effect of simulation for significant learning. J Nurs UFPE [Internet]. 2018 [acesso em 20 ago 2019]; 12(12): 3416-25. Disponível em: http://doi.org/10.5205/1981-8963-v12i12a237671p3416-3425-2018.
https://doi.org/10.5205/1981-8963-v12i12...
-2525 Ribeiro V dos S, Garbuio DC, Zamarolli CM, Eduardo AHA, Carvalho EC de. Clinical simulation and training for Advanced Nursing Pratices: an integrative review. Acta Paul Enferm. [Internet]. 2018 [acesso em 03 mar 2021]; 31(6): 659-66. Disponível em: https://doi.org/10.1590/1982-0194201800090.
https://doi.org/10.1590/1982-01942018000...
).

For the simulated clinical practice to be successful and arouse the students’ interest, realism is of great relevance in order to allow veracity, critical thinking and decision-making skills. Several studies show that the use of simulated patients is perceived as very close to real patients, and provides greater satisfaction and self-confidence with the educational process, as it makes it significant(1111 Negri EC, Mazzo A, Martins JCA, Pereira Junior GA, Almeida RG dos S, Pedersoli CE. Clinical simulation with dramatization: gains perceived by students and health professionals. Rev. Latino-Am. Enfermagem [Internet]. 2017 [acesso em 05 abr 2019]; 25. Disponível em: http://doi.org/10.1590/1518-8345.1807.2916.
https://doi.org/10.1590/1518-8345.1807.2...
,1515 Reis SN, Neves CC, Alves DA, Lopes RR de S, Souza KV de, Ribeiro L da CC, et al. Conhecimentos, satisfação e autoconfiança em profissionais de saúde: simulação com manequim versus paciente-ator. Revista de Enfermagem Referência [Internet]. 2020 [acesso em 20 mar 2021]; 3. Disponível em: https://www.redalyc.org/articulo.oa?id=388264768002.
https://www.redalyc.org/articulo.oa?id=3...
).

However, simulated patients imply limitations for the conduction of some procedures. In this sense, the use of simulators coupled to simulated patients can be resorted to as a strategy to overcome such limitations.

High-fidelity simulators also have limitations in terms of realism, but they help to link theoretical knowledge to practice, in addition to reflective critical thinking and decision-making. On the other hand, activities using a high-fidelity simulator can lead the student to focus exclusively on the task and lose the spectrum of the patient’s global needs(2626 Crofts JF, Bartlett C, Ellis D, Winter C, Donald F, Hunt LP, et al. Patient-actor perception of care: a comparison of obstetric emergency training using manikins and patient-actors. BMJ Quality Safety [Internet]. 2008 [acesso em 20 jan 2018]; 17(1): 20-4. Disponível em: http://doi.org/10.1136/qshc.2006.021873.
https://doi.org/10.1136/qshc.2006.021873...
).

It is notorious that HEIs, seeking to promote the use of active learning methods in the curricula, have promoted high investments in clinical simulation centers, with high costs and with many technological resources. In addition to the high cost involved, in many places these resources are underused, with low acceptance by professors and students, and disconnected from the pedagogical and political project(1010 Brandão CFS, Carvalho-Filho MA de, Cecilio-Fernandes D. Simulation centers and pedagogical planning: Two sides of the same coin. Sci Med. [Internet]. 2018. [acesso em 10 mar 2019]; 28(1). Disponível em: https://revistaseletronicas.pucrs.br/ojs/index.php/scientiamedica/article/view/28709.
https://revistaseletronicas.pucrs.br/ojs...
).

Simulation implies varied costs depending on the resources used. These resources are determined by the learning objectives, so that they can maximize the educational results(2727 Maloney S, Haines T. Issues of cost-benefit and cost-effectiveness for simulation in health professions education. Advances in Simulation [Internet]. 2016 [acesso em 20 jan 2018]; 1(13): 1-6. Disponível em: http://doi.org/10.1186/s41077-016-0020-3.
https://doi.org/10.1186/s41077-016-0020-...
). In this study, the high-fidelity simulation using a simulated patient and moulage was a low-cost simulated scenario, which did not depend on technological resources to contribute knowledge, satisfaction and self-confidence to the students.

It is important to highlight that clinical simulation is associated with creativity and teaching dedication in its elaboration and execution. This is a high-potential tool, provided that it is used correctly and grounded on the theoretical principles and guidelines. The need to support teacher training as with transforming potential for training in health stands out.

A possible limitation of this study is the choice of the setting’s objective. The fact that the simulated setting did not involve the need to perform any invasive procedure may have contributed to not finding statistical differences between the modalities. However, the results are relevant, as they show high levels of satisfaction, self-confidence and knowledge gain in both groups, after the simulated practices.

For further studies, the recommendation is to use settings in line with the learning objectives, as well as their verification within the scope of the various health care areas and fulfillment of all the clinical simulation stages.

CONCLUSION

Well-prepared simulated strategies lead to positive outcomes, both with the use of onerous resources (high-fidelity simulators) and by resorting to more accessible resources (simulated patients). In this study, there were no significant differences in the comparison between the simulated patient group and the high-fidelity simulator group regarding satisfaction, self-confidence and knowledge in clinical settings of care for stomized patients.

The findings of this study contribute to the Nursing science by showing that well-prepared clinical settings can be obtained with lower costs and exert an impact on the students’ learning, however, they require attributes such as creativity in the elaboration and execution of the pedagogical strategy.

HOW TO REFERENCE THIS ARTICLE

  • Negri EC, Almeida RG dos S, Meska MHG, Mazzo A. Simulated patient versus high-fidelity simulator: satisfaction, self-confidence and knowledge among nursing students in Brazil. Cogit. Enferm. [Internet]. 2021 [accessed “insert day, monh and year”]; 26. Available from: http://dx.doi.org/10.5380/ce.v26i0.76730
  • *
    Article extracted from the PhD thesis entitled “High-fidelity simulator versus dramatization: impact on satisfaction, selfconfidence and learning in nursing students”: Universidade de São Paulo, 2018.

REFERÊNCIAS

  • 1
    Itatani T, Nagata K, Yanagihara K, Tabuchi N. Content analysis of student essays after attending a problem-based learning course: facilitating the development of critical thinking and communication skills in japanese nursing students. Healthcare [Internet]. 2017 [acesso em 21 mar 2021]; 5(3). Disponível em: https://doi.org/10.3390/healthcare5030047.
    » https://doi.org/10.3390/healthcare5030047
  • 2
    Teixeira INDO, Felix JVC. Simulação como estratégia de ensino em enfermagem: revisão de literatura. Interface (Botucatu) [Internet]. 2011 [acesso em 20 jan 2018]; 15(39): 1173-84. Disponível em: https://doi.org/10.1590/S1414-32832011005000032.
    » https://doi.org/10.1590/S1414-32832011005000032
  • 3
    Oliveira SN de, Massaroli A, Martini JG, Rodrigues J. From theory top ratice, operating the clinical simulation in Nursing teaching. Rev. Bras. Enferm. [Internet]. 2018 [acesso em 21 mar 2021]; 71. Disponível em: https://doi.org/10.1590/0034-7167-2017-0180.
    » https://doi.org/10.1590/0034-7167-2017-0180
  • 4
    Miranda FBG, Mazzo A, Pereira Junior GA. Avaliação de competências individuais e interprofissionais de profissionais de saúde em atividades clínicas simuladas: scoping review. Interface [Internet]. 2018 [acesso em 20 jan 2018]; 22(67). Disponível em: http://doi.org/10.1590/1807-57622017.0628.
    » https://doi.org/10.1590/1807-57622017.0628
  • 5
    Baptista RCN, Martins JCA, Pereira MFCR, Mazzo A. Students’ satisfaction with simulated clinical experiences: validation of an assessment scale. Rev. Latino-Am. Enfermagem [Internet]. 2014 [acesso em 20 jan 2018]; 22(5): 709-15. Disponível em: http://doi.org/10.1590/0104-1169.3295.2471.
    » https://doi.org/10.1590/0104-1169.3295.2471
  • 6
    Costa RR de O, Medeiros SM de, Coutinho VRD, Mazzo A, Araújo MS de. Satisfaction and self-confidence in the learning of nursing students: randomized clinical trial. Esc. Anna Nery [Internet]. 2020 [acesso em 20 mar 2021]; 24(1). Disponível em: https://doi.org/10.1590/2177-9465-ean-2019-0094.
    » https://doi.org/10.1590/2177-9465-ean-2019-0094
  • 7
    Nascimento MS do, Magro MC da S. Realistic simulation: method of improving knowledge and self-confidence of nursing students in the administration of medication. Rev. Min Enferm [Internet]. 2018 [acesso em 20 mar 2021]; 22. Disponível em: http://www.dx.doi.org/10.5935/1415-2762.20180024.
    » https://doi.org/10.5935/1415-2762.20180024
  • 8
    Franzon JC, Meska MHG, Cotta Filho CK, Machado GCC, Mazzo A. Implications of the clinical pratice in simulated activies: student satisfaction and selfconfidence. Rev. Min Enferm [Internet]. 2020 [acesso em 20 mar 2021]; 24. Disponível em: http://www.dx.doi.org/10.5935/1415-2762.20200003.
    » https://doi.org/10.5935/1415-2762.20200003
  • 9
    Martins JCA, Mazzo A, Baptista RCN, Coutinho VRD, Godoy S de, Mendes IAC, et al. The simulated clinical experience in nursing education: a historical review. Acta paul. Enferm. [Internet]. 2012 [acesso em 20 jan 2018]; 25(4): 619-25. Disponível em: http://doi.org/10.1590/S0103-21002012000400022.
    » https://doi.org/10.1590/S0103-21002012000400022
  • 10
    Brandão CFS, Carvalho-Filho MA de, Cecilio-Fernandes D. Simulation centers and pedagogical planning: Two sides of the same coin. Sci Med. [Internet]. 2018. [acesso em 10 mar 2019]; 28(1). Disponível em: https://revistaseletronicas.pucrs.br/ojs/index.php/scientiamedica/article/view/28709
    » https://revistaseletronicas.pucrs.br/ojs/index.php/scientiamedica/article/view/28709
  • 11
    Negri EC, Mazzo A, Martins JCA, Pereira Junior GA, Almeida RG dos S, Pedersoli CE. Clinical simulation with dramatization: gains perceived by students and health professionals. Rev. Latino-Am. Enfermagem [Internet]. 2017 [acesso em 05 abr 2019]; 25. Disponível em: http://doi.org/10.1590/1518-8345.1807.2916.
    » https://doi.org/10.1590/1518-8345.1807.2916
  • 12
    Ribeiro V dos S, Garbuio DC, Zamarolli CM, Eduardo AHA, Carvalho EC de. Clinical simulation and training for Advanced Nursing Practices: na integrative review. Acta Paul Enferm. [Internet]. 2018 [acesso em 03 mar 2021]; 31(6): 659-66. Disponível em: https://doi.org/10.1590/1982-0194201800090.
    » https://doi.org/10.1590/1982-0194201800090
  • 13
    Zapko KA, Ferranto MLG, Blasiman R, Shelestak D. Evaluating best educational practices, student satisfaction, and self-confidence in simulation: a descriptive study. Nurse Educ Today [Internet]. 2018 [acesso em 20 jan 2020]; 60. Disponível em: http://doi.org/10.1016/j.nedt.2017.09.006.
    » https://doi.org/10.1016/j.nedt.2017.09.006
  • 14
    Ignacio J, Dolmans D, Scherpbier A, Rethans Jan-Joost, Chan S, Liaw SY. Comparison of standardized patients with high-fidelity simulators for managing stress and improving performance in clinical deterioration: a mixed methods study. Nurse Educ Today. [Internet]. 2015 [acesso em 20 jan 2018]; 35(12): 1161-68. Disponível em: http://doi.org/10.1016/j.nedt.2015.05.009.
    » https://doi.org/10.1016/j.nedt.2015.05.009
  • 15
    Reis SN, Neves CC, Alves DA, Lopes RR de S, Souza KV de, Ribeiro L da CC, et al. Conhecimentos, satisfação e autoconfiança em profissionais de saúde: simulação com manequim versus paciente-ator. Revista de Enfermagem Referência [Internet]. 2020 [acesso em 20 mar 2021]; 3. Disponível em: https://www.redalyc.org/articulo.oa?id=388264768002
    » https://www.redalyc.org/articulo.oa?id=388264768002
  • 16
    Freire D de A, Angelim RC de M, Souza NR de, Brandão BMG de M, Torres KMS, Serrano SQ. Self-image and self-care in the experience of ostomy patints: the nursing look. Rev. Min. Enferm. [Internet]. 2017 [acesso em 25 ago 2018]; 21. Disponível em: http://www.dx.doi.org/10.5935/1415-2762.20170029.
    » https://doi.org/10.5935/1415-2762.20170029
  • 17
    Leite M de S, Aguiar LC de. Diagnóstico de enfermagem em pacientes submetidos à colostomia. Enferm. Foco. [Internet]. 2017 [acesso em 10 mar 2021]; 8(2): 72-6. Disponível em: https://doi.org/10.21675/2357-707X.2017.v8.n2.1227.
    » https://doi.org/10.21675/2357-707X.2017.v8.n2.1227
  • 18
    Coutinho VRD, Martins JCA, Pereira F. Structured debriefing in nursing simulation: students’ perceptions. J Nurs Educ Pract. [Internet]. 2016 [acesso em 15 jul 2019]; 6(9): 127-34. Disponível em: http://doi.org/10.5430/jnep.v6n9p127.
    » https://doi.org/10.5430/jnep.v6n9p127
  • 19
    Grant JS, Davis LL. Selection and use of content experts for instrument development. Res. Nurs Health [Internet]. 1998 [acesso em 31 mai 2018]; 20(3): 269-74. Disponível em: https://doi.org/10.1002/(SICI)1098-240X(199706)20:3%3C269::AID-NUR9%3E3.0.CO;2-G.
    » https://doi.org/10.1002/(SICI)1098-240X(199706)20:3%3C269::AID-NUR9%3E3.0.CO;2-G
  • 20
    Almeida RG dos S, Mazzo A, Martins JCA, Baptista RCN, Girão FB, Mendes IAC. Validation to Portuguese of the Scale of Student Satisfaction and Self-Confidence in Learning. Rev. Latino-Am. Enfermagem. [Internet]. 2015 [acesso em 20 jan 2018]; 23(6): 1007-13. Disponível em: http://doi.org/10.1590/0104-1169.0472.2643.
    » https://doi.org/10.1590/0104-1169.0472.2643
  • 21
    Paula MAB, Cesaretti IUR. Cuidando de Pessoas com Complicação nas Estomias Intestinais e Pele Periestoma. In: Santos VLCG, Cesaretti IUR. Assistência em Estomaterapia: Cuidando de Pessoas com Estoma. São Paulo: Atheneu; 2015. 345-362.
  • 22
    Ates E, Ünver V, Ulus B. Effect of Two Different Simulation Modalities in Environmental Safety Teaching for Stroke Patients on Nursing Students’Stress, Self-Confidence and Satisfaction. J Hacettepe University Faculty of Nursing [Internet]. 2020 [acesso em 30 ago 2020]; 7(1). Disponível em: https://dergipark.org.tr/tr/download/article-file/1037982
    » https://dergipark.org.tr/tr/download/article-file/1037982
  • 23
    Shinnick MA, Woo MA. Does nursing student self-efficacy correlate with knowledge when using human patient simulation? Clin Simul Nurs. [Internet]. 2014 [acesso em 20 jan 2018]; 10(2): 71-9. Disponível em: http://doi.org/10.1016/j.ecns.2013.07.006.
    » https://doi.org/10.1016/j.ecns.2013.07.006
  • 24
    Araújo PRS, Duarte TT da P, Magro MC da S. Effect of simulation for significant learning. J Nurs UFPE [Internet]. 2018 [acesso em 20 ago 2019]; 12(12): 3416-25. Disponível em: http://doi.org/10.5205/1981-8963-v12i12a237671p3416-3425-2018.
    » https://doi.org/10.5205/1981-8963-v12i12a237671p3416-3425-2018
  • 25
    Ribeiro V dos S, Garbuio DC, Zamarolli CM, Eduardo AHA, Carvalho EC de. Clinical simulation and training for Advanced Nursing Pratices: an integrative review. Acta Paul Enferm. [Internet]. 2018 [acesso em 03 mar 2021]; 31(6): 659-66. Disponível em: https://doi.org/10.1590/1982-0194201800090.
    » https://doi.org/10.1590/1982-0194201800090
  • 26
    Crofts JF, Bartlett C, Ellis D, Winter C, Donald F, Hunt LP, et al. Patient-actor perception of care: a comparison of obstetric emergency training using manikins and patient-actors. BMJ Quality Safety [Internet]. 2008 [acesso em 20 jan 2018]; 17(1): 20-4. Disponível em: http://doi.org/10.1136/qshc.2006.021873.
    » https://doi.org/10.1136/qshc.2006.021873
  • 27
    Maloney S, Haines T. Issues of cost-benefit and cost-effectiveness for simulation in health professions education. Advances in Simulation [Internet]. 2016 [acesso em 20 jan 2018]; 1(13): 1-6. Disponível em: http://doi.org/10.1186/s41077-016-0020-3.
    » https://doi.org/10.1186/s41077-016-0020-3

Edited by

Associate editor: Cremilde Aparecida Trindade Radovanovic

Publication Dates

  • Publication in this collection
    22 Nov 2021
  • Date of issue
    2021

History

  • Received
    23 Sept 2020
  • Accepted
    06 Apr 2021
Universidade Federal do Paraná Av. Prefeito Lothário Meissner, 632, Cep: 80210-170, Brasil - Paraná / Curitiba, Tel: +55 (41) 3361-3755 - Curitiba - PR - Brazil
E-mail: cogitare@ufpr.br