Acessibilidade / Reportar erro

Learning challenges in Physical Therapy, Speech-Language-Hearing Sciences, and Occupational Therapy undergraduate programs during the COVID-19 pandemic

Desafios de aprendizagem nos cursos de graduação em Fisioterapia, Fonoaudiologia e Terapia Ocupacional durante a pandemia de COVID-19

ABSTRACT

Purpose

COVID-19 posed numerous challenges to educational programs that had to quickly adapt to remote online learning (ROL) to ensure the continuity of health professional training over the pandemic. We aimed to assess the students' and professors' perceptions of the teaching-learning process in the Physical Therapy, Speech-Language-Hearing Sciences, and Occupational Therapy undergraduate programs at a Brazilian public university.

Methods

We used an electronic self-reported questionnaire with multiple-choice questions on a Likert scale ranged 1-5; higher the score, higher the level of agreement/importance/satisfaction.

Results

Most of undergraduate students and teachers had previous experience using information and communication technologies, and 85% stated their preference for in-person learning. Students expressed their appreciation for more active learning methodologies with clear objectives, accessible content, and visualization of abstract concepts. Regarding benefits and barriers, some similar perceptions were observed between students and teachers with ROL favoring time management, benefits in the teaching-learning process, satisfaction and motivation with the course content, and low attendance rates to general academic activities due to absent or poor access to technological resources.

Conclusion

ROL is an alternative learning mode when the in-person classes cannot be carried out, as in the case of the COVID-19 pandemic. ROL is believed to be unfit to replace in-person learning, although it can complement the traditional classroom-based education in a hybrid model, respecting the nature of each program in the field of health that requires in-person practical training.

Keywords:
Covid-19; Teaching; Education; Distance; Student; Learning

RESUMO

Objetivo

O COVID-19 impôs inúmeros desafios aos programas educacionais que tiveram que se adaptar rapidamente ao aprendizado remoto on-line (ARO) para garantir a continuidade da formação dos profissionais de saúde durante a pandemia. O objetivo do estudo foi avaliar a percepção de alunos e professores sobre o processo ensino-aprendizagem dos cursos de graduação em Fisioterapia, Fonoaudiologia e Terapia Ocupacional de uma universidade pública brasileira.

Métodos

Foi utilizado um questionário eletrônico autoaplicável com questões de múltipla escolha em escala Likert de 1 a 5; quanto maior a pontuação, maior o nível de concordância/importância/satisfação.

Resultados

A maioria dos alunos de graduação e professores tinha experiência anterior no uso de tecnologias de informação e comunicação, e 85% afirmaram preferir o ensino presencial. Os alunos expressaram preferência por metodologias de aprendizagem mais ativas, com objetivos claros, conteúdo acessível e visualização de conceitos abstratos. Em relação aos benefícios e barreiras, algumas percepções semelhantes foram observadas entre alunos e professores com ARO favorecendo a gestão do tempo, benefícios no processo ensino-aprendizagem, satisfação e motivação com o conteúdo do curso e baixa frequência às atividades acadêmicas gerais por ausência ou dificuldade de acesso aos recursos tecnológicos.

Conclusão

O ARO pode ser uma modalidade alternativa de aprendizado quando as aulas presenciais não podem ser realizadas, como no caso da pandemia do COVID-19. Porém, o ARO é inadequado para substituir a aprendizagem presencial, embora possa complementar a educação presencial tradicional em um modelo híbrido, respeitando a natureza de cada programa na área da saúde que exige formação prática presencial.

Descritores:
Covid-19; Docentes; Educação a Distância; Estudante; Ensino

INTRODUCTION

The advent of COVID-19, in 2020, imposed not only social distancing but also changes in our way of thinking and learning. We do not know yet how long this situation will last, nor its effects on the post-pandemic “new learning environment”. What can educators do to create an adequate learning environment? What is happening with the students’ teaching-learning process? What can educators do to have an adequate working environment? Are educators and students motivated with this remote learning mode?

Educational systems worldwide felt the effects of the COVID-19 pandemic and have been facing unprecedented challenges. A world report pointed out that about 1.4 billion students in more than 156 countries had not been attending school since the beginning of the pandemic(11 World Bank Group. Políticas Educacionais na Pandemia a COVID-19: o que o Brasil pode aprender com o resto do mundo? [Internet]. Washington: World Bank Group; 2020 [cited 2020 Aug 7]. p. 1-4. Available from: http://pubdocs.worldbank.org/en/413781585870205922/pdf/politicas-educacionais-na-pandemia-da-covid-19-o-que-o-brasil-pode-aprender-com-o-resto-do-mundo.pdf
http://pubdocs.worldbank.org/en/41378158...
). In such a scenario, schools and universities have been resorting, with greater or lesser success, to distance learning (DL) and a variety of remote learning (RL) modes to diminish the impacts of the pandemic on the educational routine.

RL follows the same principles of the in-person teaching-learning process. The strategy is similar to DL in the sense that the professor is not in the same environment as the students and that it is developed with the use of technology - which is not the only option in the case of DL. In its turn, DL requires atemporal support from tutors and greater flexibility on the part of the students to organize their study schedule, thus focusing on asynchronous activities and interactions(22 Gusso HL, Archer AB, Bordignon LF, Sahão FT, Luca GG, Henklain MHO, et al. Higher education in the times of pandemic: university management guidelines. Educ Soc. 2020;41:e238957. http://dx.doi.org/10.1590/es.238957.
http://dx.doi.org/10.1590/es.238957...
).

Classes have been canceled in Brazil as well, which led the Ministry of Education (MEC) to pass a regulation authorizing classes to be given online instead of in-person in the entire federal school system while the COVID-19 pandemic lasts(33 Brasil. Ministério da Educação. Portaria nº 343, de 17 de Março de 2020. Dispõe sobre a substituição das aulas presenciais por aulas em meios digitais enquanto durar a situação de pandemia do Novo Coronavírus - COVID-19 [Internet]. Diário Oficial da União; Brasília; 18 mar. 2020, ed. 53, seção 1, p. 39. [cited 2020 Aug 7]. Available from: http://www.in.gov.br/en/web/dou/-/portaria-n-343-de-17-de-marco-de-2020-248564376
http://www.in.gov.br/en/web/dou/-/portar...
).

This necessary transition from in-person to RL, though temporary, caused countless difficulties to educators. They, much like the students, experience the sanitary, social, and economic restrictions and concerns that either appeared in the pandemic or were aggravated by it. In RL, educators must take on new challenges, which include adapting the content, classroom dynamics, lectures, and assessments, ensuring the quality of the learning process while maintaining the students’ interest and commitment(44 Gustafsson L. Occupational therapy has gone online: what will remain beyond COVID-19? Aust Occup Ther J. 2020;67(3):197-8. http://dx.doi.org/10.1111/1440-1630.12672. PMid:32538488.
http://dx.doi.org/10.1111/1440-1630.1267...
).

Studies on the learning process showed that the transition from in-person to remote classes requires a gradual and adaptive process for both educators and students. The unexpected fully online learning imposed by the COVID-19 pandemic has inevitable weaknesses, as students feel more distant from the educators and less focused in the online format(55 Durrani M. Debate style lecturing to engage and enrich resident education virtually. Med Educ. 2020;54(10):955-6. http://dx.doi.org/10.1111/medu.14217. PMid:32392355.
http://dx.doi.org/10.1111/medu.14217...

6 Zhang Q, He YJ, Zhu YH, Dai MC, Pan MM, Wu JQ, et al. The evaluation of online course of Traditional Chinese Medicine for MBBS international students during the COVID-19 epidemic period. Integr Med Res. 2020;9(3):1004-49. http://dx.doi.org/10.1016/j.imr.2020.100449. PMid:32632357.
http://dx.doi.org/10.1016/j.imr.2020.100...
-77 Shahrvini BB, Baxter CC, McDonald BBV, Lander SL. Pre-clinical remote undergraduate medical education during the COVID-19 pandemic: a survey study. BMC Med Educ. 2021;21(1):13. http://dx.doi.org/10.1186/s12909-020-02445-2. PMid:33407376.
http://dx.doi.org/10.1186/s12909-020-024...
).

Countries with advanced technology have e-learning systems. However, this is not the case in many low- and middle-income countries. For instance, a study conducted in Pakistan during the pandemic, while in-person classes were canceled, revealed that the challenges faced by medical school professors and students included a lack of faculty training, little institutional support, Internet connectivity issues, students’ low commitment, online assessment difficulties, and problems understanding the unique dynamics of remote online learning (ROL). All the people involved need to cooperate and participate to meet these challenges(88 Farooq F, Rathore FA, Mansoor SN. Challenges of online medical education in Pakistan during COVID-19 pandemic. J Coll Physicians Surg Pak. 2020;30(6):67-9. http://dx.doi.org/10.29271/jcpsp.2020.Supp1.S67. PMid:32723456.
http://dx.doi.org/10.29271/jcpsp.2020.Su...
).

Studies with Brazilian medical school students verified that most of them agree with the implementation of ROL while in-person academic activities remain canceled because of the pandemic - especially those already in the third or fourth year (63.9%) and fifth or sixth year (66.8%). On the other hand, 66.1% of the participants who are in their first or second year and 56.0% of those in the third or fourth year of medical school suggested that the ROL activities be retaken in in-person classes(99 Tempski P, Arantes-Costa FM, Kobayasi R, Siqueira MAM, Torsani MB, Amaro BQRC, et al. Medical students’ perceptions and motivations during the COVID-19 pandemic. PLOS One. 2021;16(3):e0248627. http://dx.doi.org/10.1371/journal.pone.0248627.
http://dx.doi.org/10.1371/journal.pone.0...
).

On the same perspective, less than half (49.2%) of the pharmacy students at a Saudi university had a positive attitude toward the ROL offered during the COVID-19 pandemic, and 34% pointed out barriers to learning in this mode - which suggests the need for training(1010 Shawaqfeh MS, Al Bekairy AM, Al-Azayzih A, Alkatheri AA, Qandil AM, Obaidat AA, et al. Pharmacy students perceptions of their distance online learning experience during the COVID-19 pandemic: a cross-sectional survey study. J Med Educ Curricular Develop. 2020;7:2382120520963039. http://dx.doi.org/10.1177/2382120520963039.
http://dx.doi.org/10.1177/23821205209630...
).

Given the challenges imposed on education by the COVID-19 pandemic, this study aimed to assess the students’ and professors’ perceptions of the teaching-learning process in the courses taught in ROL mode throughout 2020 in the Physical Therapy, Speech-Language-Hearing Sciences, and Occupational Therapy programs at a Brazilian public university.

METHODS

Study population

This study was approved by the local Ethical Committee (CAAE: 40023420.6.0000.0068). The online survey was conducted between November 2020 and January 2021 and sent to all registered students in the first- to fifth-year Physical Therapy and Speech-Language-Hearing and first- to fourth-year Occupational Therapy and professors who teach these specific courses at the Medical School, University of São Paulo, Brazil. Students and professors participated voluntarily in the study, upon agreement with the informed consent form.

Survey design and implementation

The research began after its project was approved by the institution’s Research Ethics Committee.

Two questionnaires - one for students, the other for professors - were developed based on a previous study(66 Zhang Q, He YJ, Zhu YH, Dai MC, Pan MM, Wu JQ, et al. The evaluation of online course of Traditional Chinese Medicine for MBBS international students during the COVID-19 epidemic period. Integr Med Res. 2020;9(3):1004-49. http://dx.doi.org/10.1016/j.imr.2020.100449. PMid:32632357.
http://dx.doi.org/10.1016/j.imr.2020.100...
). The questions were adapted to Brazilian reality and the undergraduate courses assessed.

With these instruments, the students and professors assessed the value of a variety of RL resources and characteristics; curricular structure; communication, economic, academic, and mental health vulnerability; and adjustment to their study or work setting. Other variables, such as access to technology and family and pedagogical issues, were also included. The questions had multiple-choice answers, many of which were on a Likert scale (ranging from 1 to 5) with the highest score as the greatest level of agreement, importance and satisfaction regarding the subject investigated.

The questionnaires were administered online via Google Forms and available between November 2020 and January 2021. The answers were stored automatically in an Excel databank for analysis. Each questionnaire took about 10 minutes to be filled out. The participation was anonymous and optional, unrelated to any assessment of either the student or professor.

Statistical analyses

The mean values and standard deviations were calculated, as well as the absolute and relative frequencies when appropriate for descriptive data analysis. In the inferential stage, the ANOVA and chi-square tests were used when pertinent, at the 5% significance level.

RESULTS

Of the 369 enrolled students, 98 (26.6%) answered the questionnaire (41 Physical Therapy, 35 Speech-Language-Hearing, and 22 Occupational Therapy students). As for the term they were attending, 30 were in their first year (30.6%), 19 in the second year (19.4%), 31 in the third year (31.6%), and 19 in either the fourth or fifth year (19.38%). The students’ mean age was 23.3 years (SD: 6.6), and 81.6% were women. Concerning the courses they had taken, 56.3% were predominantly theoretical, 36.5% predominantly theoretical-practical, and 7.3% predominantly practical. Most of the students (60.2%) had previous experience with information and communications technology (ICT).

Of the 36 professors in the Department of Physical Therapy, Speech-Language-Hearing Sciences, and Occupational Therapy, 20 (55.6%) answered the questionnaire (10 Physical Therapy, 5 Speech-Language-Hearing Sciences, and 5 Occupational Therapy professors). Their mean age was 54 years (SD: 7.2), and 90% were females. A total of 60% of these professors had experience with ICT. All of them taught remote online classes during the pandemic and 90% taught classes with synchronous and asynchronous activities, while 10.0% used only synchronous activities. Of the courses taught by the professors, 68.4% were predominantly theoretical-practical and 31.6%, were predominantly theoretical.

Students’ and professors’ perceptions of the teaching-learning process

The students’ and professors’ preferences regarding the learning mode are described in Table 1.

Table 1
Absolute and relative frequencies of students and professors in relation to learning mode preference.

The scores given by students and professors to ROL variables are described respectively in Tables 2 and 3.

Table 2
Descriptive measures (mean and standard deviation) of the scores (Likert scale) given by the students to the remote online learning variables (strategies, characteristics, resources, and motivation)
Table 3
Descriptive measures (mean and standard deviation) of the scores (Likert scale) given by the professors to the remote online learning variables (strategies, characteristics, resources, and motivation)

Regarding pedagogical strategies and resources, 100% of the professors referred to required reading; 95% to videos; 80% to clinical case discussions; and 45% to recorded classes. Other options were also included by 10% of the participants (peer discussions, questionnaires and exercises, seminars, simulations, problem-based activities, complementary material, and so forth).

The scores given by students and professors to ROL variables regarding benefits and barriers are shown in Table 4.

Table 4
Comparison of the means of the scores (Likert scale) given by the students and professors to the remote online learning variables (benefits, barriers)

DISCUSSION

This study assessed the students’ and professors’ perceptions of the teaching-learning process in the courses taught in ROL mode throughout 2020 in the Physical Therapy, Speech-Language-Hearing Sciences, and Occupational Therapy programs at a Brazilian public university.

Concerning the teaching mode (Table 1), 85% of the students and professors preferred in-person classes, corroborating the findings of previous studies(1111 Mahoney JS, Marfurt M, Cunha JE. Projeto e avaliação de estratégia de ensino online em curso de graduação em enfermagem psiquiátrica. Arch Psychiatr Nurs. 2005;19(6):264-72. http://dx.doi.org/10.1016/j.apnu.2005.08.002. PMid:16308126.
http://dx.doi.org/10.1016/j.apnu.2005.08...
,1212 Attardi SM, Choi S, Barnett J, Roger KA. Métodos mistos: avaliação de aluno de um curso online de anatomia humana sistêmica com laboratório. Anat Sci Educ. 2016;9(3):272-85. http://dx.doi.org/10.1002/ase.1584. PMid:26588051.
http://dx.doi.org/10.1002/ase.1584...
). Similar results were reported in another study(66 Zhang Q, He YJ, Zhu YH, Dai MC, Pan MM, Wu JQ, et al. The evaluation of online course of Traditional Chinese Medicine for MBBS international students during the COVID-19 epidemic period. Integr Med Res. 2020;9(3):1004-49. http://dx.doi.org/10.1016/j.imr.2020.100449. PMid:32632357.
http://dx.doi.org/10.1016/j.imr.2020.100...
), in which 54.17% of the students preferred face-to-face rather than online learning. The authors highlighted that ROL is a good alternative when in-person classes are canceled, as in the case of the COVID-19 pandemic, but that it cannot replace in-person learning; instead, it must be only a complement to the traditional learning mode. They further emphasized that, in post-COVID-19 times, it would be desirable to offer a hybrid teaching model combining face-to-face and online learning to provide synergic and complementary instruction(66 Zhang Q, He YJ, Zhu YH, Dai MC, Pan MM, Wu JQ, et al. The evaluation of online course of Traditional Chinese Medicine for MBBS international students during the COVID-19 epidemic period. Integr Med Res. 2020;9(3):1004-49. http://dx.doi.org/10.1016/j.imr.2020.100449. PMid:32632357.
http://dx.doi.org/10.1016/j.imr.2020.100...
).

The courses taken by the students were predominantly theoretical and theoretical-practical (56.3% and 36.5%, respectively), whereas only 7.3% were predominantly practical. It must be pointed out, though, that most of the students that answered the questionnaire were in the first years of the Physical Therapy, Speech-Language-Hearing Sciences, and Occupational Therapy programs, whose curriculum at such stage offer basic science courses, i.e., predominantly theoretical ones - taught by professors of other areas, such as Biology, Anatomy, Physiology, Psychology, and others. Moreover, the predominantly practical courses taught to students in the last years (internships) were temporarily canceled at the beginning of the pandemic, following the recommendations of the university to meet the social distancing sanitary measures taken during the pandemic.

Authors (1313 Machado RA, Bonan PRF, Perez DEDC, Martelli DRB, Martelli-Júnior H. I am having trouble keeping up with virtual teaching activities: reflections in the COVID-19 era. Clinics (São Paulo). 2020;75:e1945. http://dx.doi.org/10.6061/clinics/2020/e1945. PMid:32401961.
http://dx.doi.org/10.6061/clinics/2020/e...
) emphasize that, as part of the social distancing measures, the professors had to quickly rearrange their classes and other activities, including research and clinical practice, to online platforms. However, they also point out that not everything was feasible, which temporarily decreased the course load of the predominantly practical classes. This is noticed in the results of the present research as well, especially regarding the professors’ answers.

Different from the students’ answers about the courses taken, 68.42% of the courses taught by the professors were predominantly theoretical-practical and 31.58%, predominantly theoretical. It must be pointed out that the professors that answered the questionnaire do not teach the general basic courses offered in the programs’ first years. Rather, they teach each program’s specific required courses. Thus, the courses considered by students and professors in their answers were not necessarily the same.

Most of the students and professors had previous experience using ICT (60.2% and 60%, respectively). All the professors taught ROL classes during the pandemic (90% with synchronous and asynchronous activities and 10% with synchronous activities). Such results corroborate those obtained by previous study(1414 Oliveira MH, Lopes LNS, Gottsfritz IB, João LLS, Sproesser GB, Silva TI, et al. Avaliação da percepção de graduandos da USP referente à integração do ensino acadêmico com a tecnologia em saúde. Rev Grad USP. 2020;4(1):85-91. http://dx.doi.org/10.11606/issn.2525-376X.v4i1p85-91.
http://dx.doi.org/10.11606/issn.2525-376...
), who assessed how undergraduate health students perceived the integration of academic teaching with technology. They observed that those students often use digital platforms, which make their learning and professional practice easier, and that they want to increase their knowledge continuously using technology tools while in college. The authors also mentioned that some professors are reluctant to use ICT because of difficulties learning how to handle them; hence, much time and effort would be necessary to adapt to ICT, as they do not master it yet.

Concerning the students’ perception of ROL strategies and resources (Table 2), they preferred the ones with active teaching methodologies (e.g., case studies - mean: 4.03) or more related to practical, know-how activities (e.g., video demonstrations - mean: 4.04; and instructional material and resources - mean: 4.29). Such results corroborate those obtained by another study(1515 Durfee SM, Goldenson RP, Gill RR, Rincon SP, Flower E, Avery LL. Medical student education roadblock due to COVID-19: virtual radiology core clerkship to the rescue. Acad Radiol. 2020;27(10):1461-6. http://dx.doi.org/10.1016/j.acra.2020.07.020. PMid:32747181.
http://dx.doi.org/10.1016/j.acra.2020.07...
), whose emphasis was on learning based on case studies and problem-solving, thus offering the students an opportunity to work independently.

Some studies (6,16) showed similar results as the present one, highlighting the professors’ lectures as an important teaching strategy (mean: 3.9). They also valued technical support (mean: 4.1), accessible learning content (mean: 4.8), and highlights and summaries (mean: 4.1) as resources to help develop the programs remotely. In the present study, the students also valued clear learning objectives (mean: 4.5) and visualizing abstract concepts (mean: 4.4).

Professors should consider teaching with strategies such as interactive activities involving problem-solving, discussions, and debates during class because they improve the students’ motivation and attitude, creating an active study environment with effective learning. As a result, these educational strategies are considered more effective(1515 Durfee SM, Goldenson RP, Gill RR, Rincon SP, Flower E, Avery LL. Medical student education roadblock due to COVID-19: virtual radiology core clerkship to the rescue. Acad Radiol. 2020;27(10):1461-6. http://dx.doi.org/10.1016/j.acra.2020.07.020. PMid:32747181.
http://dx.doi.org/10.1016/j.acra.2020.07...
,1616 Yang D. Estratégias instrucionais e desenho de cursos para ensinar estatísticas online: perspectivas de alunos online. Int J STEM Educ. 2017;4(1):34. http://dx.doi.org/10.1186/s40594-017-0096-x. PMid:30631690.
http://dx.doi.org/10.1186/s40594-017-009...
), which explains their higher scores in the present study. Active classroom learning helps students acquire higher-order cognitive skills, as they relate new knowledge and skills to what they had previously acquired(1515 Durfee SM, Goldenson RP, Gill RR, Rincon SP, Flower E, Avery LL. Medical student education roadblock due to COVID-19: virtual radiology core clerkship to the rescue. Acad Radiol. 2020;27(10):1461-6. http://dx.doi.org/10.1016/j.acra.2020.07.020. PMid:32747181.
http://dx.doi.org/10.1016/j.acra.2020.07...
).

Online course developers state that education must be focused on the students‘ needs(1717 Chumley-Jones HS, Dobbie A, Alford CA. Aprendizagem baseada na Web: método educativo sonoro ou hype? Uma revisão da literatura de avaliação. Acad Med. 2002;77:S86-93. http://dx.doi.org/10.1097/00001888-200210001-00028. PMid:12377715.
http://dx.doi.org/10.1097/00001888-20021...
). Hence, they must consider using most of the time more active instructional strategies, in agreement with the results of this study.

The lowest means regarding ROL strategies, resources, characteristics, and motivation (Table 2) referred to increasing knowledge (mean: 2.99) and getting a good final grade (mean: 3.36), considering that students deemed it necessary, after the pandemic, to retake content taught remotely(99 Tempski P, Arantes-Costa FM, Kobayasi R, Siqueira MAM, Torsani MB, Amaro BQRC, et al. Medical students’ perceptions and motivations during the COVID-19 pandemic. PLOS One. 2021;16(3):e0248627. http://dx.doi.org/10.1371/journal.pone.0248627.
http://dx.doi.org/10.1371/journal.pone.0...
). The results of the present study suggest that the students are somewhat reluctant to or suspicious of the teaching-learning process in this mode. It must be taken into account, though, that the pandemic forced the universities to quickly transition from in-person to remote teaching, not allowing the professors the necessary time and training to reorganize their courses. Likewise, the students did not have time to get prepared for remote learning.

The professors gave lower scores to variables related to ROL strategies, characteristics, resources, and motivation (Table 3). None of the means was above 4, and the lowest ones referred to teaching motivated by pedagogical strategies and resources used in ROL and to the interaction with students in this teaching mode. Such aspects corroborate the data obtained by previous study(1818 Chinelatto LA, Costa TRD, Medeiros VMB, Boog GHP, Hojaij FC, Tempski PZ, et al. What you gain and what you lose in COVID-19: perception of medical students on their education. Clinics (São Paulo). 2020;75:e2133. http://dx.doi.org/10.6061/clinics/2020/e2133. PMid:32667495.
http://dx.doi.org/10.6061/clinics/2020/e...
), who mentioned that some professors still have difficulties handling new technologies, particularly when it comes to planning videoconferences and using interactive methods. They also reported that, even in well-adjusted programs, clinical case discussions structured for virtual classrooms demand greater interaction effort from the professor and students - which in turn decreases the quantity and quality of classroom discussions.

Likewise, authors(99 Tempski P, Arantes-Costa FM, Kobayasi R, Siqueira MAM, Torsani MB, Amaro BQRC, et al. Medical students’ perceptions and motivations during the COVID-19 pandemic. PLOS One. 2021;16(3):e0248627. http://dx.doi.org/10.1371/journal.pone.0248627.
http://dx.doi.org/10.1371/journal.pone.0...
) highlighted that the professor’s emotional status interferes with their teaching activities. It also affects the students’ learning, motivation to put new technologies into practice, and resistance to innovations. The authors emphasize that medical schools should offer emotional and pedagogical support to their professors and students, considering the challenges posed by the COVID-19 pandemic.

Similar perceptions were observed between students and professors regarding many of the ROL benefits and barriers (Table 4). The ones that stood out were “ROL favors time management” (means: 3.31; 3.25) and “ROL has some benefits” (means: 3.49; 3.45). Concerning time management, our results agree with the ones obtained by other authors(1818 Chinelatto LA, Costa TRD, Medeiros VMB, Boog GHP, Hojaij FC, Tempski PZ, et al. What you gain and what you lose in COVID-19: perception of medical students on their education. Clinics (São Paulo). 2020;75:e2133. http://dx.doi.org/10.6061/clinics/2020/e2133. PMid:32667495.
http://dx.doi.org/10.6061/clinics/2020/e...
), who verified that offering asynchronous ROL classes allowed students to organize their studying time and consequently develop time-management skills. Moreover, ROL reduces the time the students take going from one place to another - which, combined with the significant decrease in scheduled classes and the effectiveness of the faster video classes, helped the students find more time to engage in extracurricular activities, such as research and mental and/or physical health self-care(77 Shahrvini BB, Baxter CC, McDonald BBV, Lander SL. Pre-clinical remote undergraduate medical education during the COVID-19 pandemic: a survey study. BMC Med Educ. 2021;21(1):13. http://dx.doi.org/10.1186/s12909-020-02445-2. PMid:33407376.
http://dx.doi.org/10.1186/s12909-020-024...
,1818 Chinelatto LA, Costa TRD, Medeiros VMB, Boog GHP, Hojaij FC, Tempski PZ, et al. What you gain and what you lose in COVID-19: perception of medical students on their education. Clinics (São Paulo). 2020;75:e2133. http://dx.doi.org/10.6061/clinics/2020/e2133. PMid:32667495.
http://dx.doi.org/10.6061/clinics/2020/e...
). Also, authors(77 Shahrvini BB, Baxter CC, McDonald BBV, Lander SL. Pre-clinical remote undergraduate medical education during the COVID-19 pandemic: a survey study. BMC Med Educ. 2021;21(1):13. http://dx.doi.org/10.1186/s12909-020-02445-2. PMid:33407376.
http://dx.doi.org/10.1186/s12909-020-024...
) reported that about two-thirds of the students complimented the increased flexibility, indicating it as the best aspect of the curriculum in remote learning.

Furthermore, regarding the perceptions of ROL benefits and barriers (Table 4), the lowest scores (i.e., means close to 2.0) were given to “ROL is better than traditional face-to-face learning” (means: 1.72; 2.10; p<0.001) and “difficulties following (or offering) remote academic activities due to absent or poor access to technological resources” (means: 2.11; 2.05; p=0.657).

Concerning the preference for traditional face-to-face learning, our results corroborate those obtained by previous studies(66 Zhang Q, He YJ, Zhu YH, Dai MC, Pan MM, Wu JQ, et al. The evaluation of online course of Traditional Chinese Medicine for MBBS international students during the COVID-19 epidemic period. Integr Med Res. 2020;9(3):1004-49. http://dx.doi.org/10.1016/j.imr.2020.100449. PMid:32632357.
http://dx.doi.org/10.1016/j.imr.2020.100...
,1212 Attardi SM, Choi S, Barnett J, Roger KA. Métodos mistos: avaliação de aluno de um curso online de anatomia humana sistêmica com laboratório. Anat Sci Educ. 2016;9(3):272-85. http://dx.doi.org/10.1002/ase.1584. PMid:26588051.
http://dx.doi.org/10.1002/ase.1584...
). This last study verified with a longitudinal assessment of an online program that the students were satisfied with its content and reported that it had many benefits. On the other hand, they emphasized that online learning is not better than traditional face-to-face learning, agreeing, though, that they could be combined in the future. The face-to-face environment favors learning in both lectures and laboratory classes, as the students get personally more involved with the professors and less distracted by the surroundings(1212 Attardi SM, Choi S, Barnett J, Roger KA. Métodos mistos: avaliação de aluno de um curso online de anatomia humana sistêmica com laboratório. Anat Sci Educ. 2016;9(3):272-85. http://dx.doi.org/10.1002/ase.1584. PMid:26588051.
http://dx.doi.org/10.1002/ase.1584...
).

As for the second variable with the lowest means, “difficulties following (or offering) remote academic activities due to absent or poor access to technological resources”, the data indicate that few participants faced such difficulties. However, it must be pointed out that the college to which these programs belong, in a joint effort with their students’ councils, lent computers (Chromebooks) and Internet SIM cards to some of the students to make ROL possible during the pandemic. Moreover, aided by the Medical Education Development Center (CEDEM, its Portuguese acronym) and volunteer students, the professors had the opportunity to improve their know-how on the use of online platforms and adjust their teaching objectives and classes to ROL. Hence, there was an evident effort on the part of the college to maintain the quality of the undergraduate programs, which would explain the scores(1818 Chinelatto LA, Costa TRD, Medeiros VMB, Boog GHP, Hojaij FC, Tempski PZ, et al. What you gain and what you lose in COVID-19: perception of medical students on their education. Clinics (São Paulo). 2020;75:e2133. http://dx.doi.org/10.6061/clinics/2020/e2133. PMid:32667495.
http://dx.doi.org/10.6061/clinics/2020/e...
,1919 Samelli AG, Matas CG, Nakagawa NK, da Silva TNR, Martins MA, João SMA. COVID-19 pandemic: challenges and advances in the physical therapy, speech-language-hearing science, and occupational therapy undergraduate programs in Brazil. Clinics (São Paulo). 2020;75:e2490. http://dx.doi.org/10.6061/clinics/2020/e2490. PMid:33263636.
http://dx.doi.org/10.6061/clinics/2020/e...
).

The perceptions regarding the other ROL benefits and barriers (Table 4) were not as balanced between the groups. Rather, there were statistically significant differences, for instance in “ROL helped improve professional skills” (means: 2.70; 3.40); “ROL helped develop communications skills” (means: 2.62; 3.30); “There was a need to perform household chores and assist relatives due to social distancing and longer time at home, thus limiting the time available to carry out remote pedagogical activities” (means: 4.18; 3.40).

Similar results were presented by other authors(1212 Attardi SM, Choi S, Barnett J, Roger KA. Métodos mistos: avaliação de aluno de um curso online de anatomia humana sistêmica com laboratório. Anat Sci Educ. 2016;9(3):272-85. http://dx.doi.org/10.1002/ase.1584. PMid:26588051.
http://dx.doi.org/10.1002/ase.1584...
), who point out the distraction caused by the family environment as a barrier to ROL. The same study emphasized some of the professors’ concerns, such as the absence of practical activities and the unproductivity of some students who lacked self-discipline. In another study(66 Zhang Q, He YJ, Zhu YH, Dai MC, Pan MM, Wu JQ, et al. The evaluation of online course of Traditional Chinese Medicine for MBBS international students during the COVID-19 epidemic period. Integr Med Res. 2020;9(3):1004-49. http://dx.doi.org/10.1016/j.imr.2020.100449. PMid:32632357.
http://dx.doi.org/10.1016/j.imr.2020.100...
), the students brought up other limitations, such as the absence of clinical practice and in-person communication with the professors and other classmates. Likewise, students in a medical school in California identified the lack of learning clinical skills and the absence of practical laboratory activities as the greatest deficits of the curriculum in remote learning(77 Shahrvini BB, Baxter CC, McDonald BBV, Lander SL. Pre-clinical remote undergraduate medical education during the COVID-19 pandemic: a survey study. BMC Med Educ. 2021;21(1):13. http://dx.doi.org/10.1186/s12909-020-02445-2. PMid:33407376.
http://dx.doi.org/10.1186/s12909-020-024...
).

Meta-analysis studies on interactivity in online programs concluded that increasing the interaction between students and professors can contribute positively to the students’ learning experience(2020 Bernard RM, Abrami PC, Borokhovski E, Wade CA, Tamim RM, Surkes MA, et al. A meta-analysis of three types of interaction treatments in distance education. Rev Educ Res. 2009;79(3):1243-89. http://dx.doi.org/10.3102/0034654309333844.
http://dx.doi.org/10.3102/00346543093338...
). They also pointed out that this can be provided with text- or audio-based online discussions (for instance, in videoconferences), increasing the students’ satisfaction(2121 Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Instructional design variations in internet-based learning for health professions education: a systematic review and meta-analysis. Acad Med. 2010;85(5):909-22. http://dx.doi.org/10.1097/ACM.0b013e3181d6c319. PMid:20520049.
http://dx.doi.org/10.1097/ACM.0b013e3181...
).

As for the students’ overload observed in this research (Table 4), digital fatigue has been pointed out as a barrier to the students’ involvement and efficient learning in ROL. Hence, a suggestion for future initiatives is the development of more efficient remote learning curricula, in which small group sessions lasting 3 or 4 hours are replaced with shorter modules(77 Shahrvini BB, Baxter CC, McDonald BBV, Lander SL. Pre-clinical remote undergraduate medical education during the COVID-19 pandemic: a survey study. BMC Med Educ. 2021;21(1):13. http://dx.doi.org/10.1186/s12909-020-02445-2. PMid:33407376.
http://dx.doi.org/10.1186/s12909-020-024...
).

The unprecedentedly canceled in-person classes led to the need for developing educational strategies that suited ROL. However, various studies demonstrate that transitioning from face-to-face to online teaching-learning model is not an easy task for either students or professors. Its success requires a gradual and adaptive process(44 Gustafsson L. Occupational therapy has gone online: what will remain beyond COVID-19? Aust Occup Ther J. 2020;67(3):197-8. http://dx.doi.org/10.1111/1440-1630.12672. PMid:32538488.
http://dx.doi.org/10.1111/1440-1630.1267...
,1212 Attardi SM, Choi S, Barnett J, Roger KA. Métodos mistos: avaliação de aluno de um curso online de anatomia humana sistêmica com laboratório. Anat Sci Educ. 2016;9(3):272-85. http://dx.doi.org/10.1002/ase.1584. PMid:26588051.
http://dx.doi.org/10.1002/ase.1584...
,2222 Brewer EW, Dejonge JO, Stout VJ. Passando para o online: fazendo a transição das estratégias tradicionais de instrução e comunicação. California: Corwin Press; 2001.).

Besides the difficulties of such a transition, attention must be paid to the nature of the programs and the requirements of professional training - which is necessary for the undergraduate health programs, including Physical Therapy, Speech-Language-Hearing Sciences, and Occupational Therapy. However, conducting them exclusively in a distance or remote learning mode impairs the future professionals’ comprehensive training, as well as the integration between teaching and not only services but especially the community and its health needs(22 Gusso HL, Archer AB, Bordignon LF, Sahão FT, Luca GG, Henklain MHO, et al. Higher education in the times of pandemic: university management guidelines. Educ Soc. 2020;41:e238957. http://dx.doi.org/10.1590/es.238957.
http://dx.doi.org/10.1590/es.238957...
,2323 Brasil. Conselho Nacional de Saúde. Recomendação nº 003, de 24 de Janeiro de 2020 [Internet]. Diário Oficial da União; Brasília; 2020. [cited 2020 Aug 7]. Available from: https://www.coffito.gov.br/nsite/wp-content/uploads/2020/02/Recomendacao_CNS_Portaria.pdf
https://www.coffito.gov.br/nsite/wp-cont...
). Therefore, despite the experiences during the pandemic that proved it possible to conduct the programs in RL, it is essential to highlight that it took place as a response to a worldwide sanitary crisis that has been lasting for more than a year. Hence, to adopt new teaching-learning models such as hybrid classes, further studies must be conducted to asses which curricular components are benefitted from online educational strategies, thus ensuring quality training(44 Gustafsson L. Occupational therapy has gone online: what will remain beyond COVID-19? Aust Occup Ther J. 2020;67(3):197-8. http://dx.doi.org/10.1111/1440-1630.12672. PMid:32538488.
http://dx.doi.org/10.1111/1440-1630.1267...
).

This study has limited potential for generalization because it was conducted in the Physical Therapy, Speech-Language-Hearing Sciences, and Occupational Therapy programs at a single higher education institution. Also, there may have been volunteer response bias, in which people with stronger opinions present more exacerbated either positive or negative perceptions of the matter at hand. Moreover, to ensure the students’ and professors’ anonymity, no sociodemographic data were surveyed. Hence, the perceptions could not be analyzed in relation to socioeconomic aspects, including age, sex, race, and/or ethnicity. Despite the limitations, this is an unprecedented study, assessing the perceptions of Physical Therapy, Speech-Language-Hearing, and Occupational Therapy students and professors about ROL in the context of the COVID-19 pandemic. Although various studies have been developed, particularly with medical and pharmacy students, no research was found approaching the ROL experiences in the three programs studied in this one.

Concerning the future perspective, it is important to conduct a longitudinal study, following up the students’ and professors’ perceptions at different moments of the courses during the pandemic. A more in-depth analysis of the questionnaire is also necessary regarding the theoretical, theoretical-practical, and practical courses.

Regarding education, the COVID-19 pandemic brought at least one positive aspect, as it stimulated changes: in a short time, educators were led to think, to innovate, to practice, to evaluate and to research to adapt he present and the future to new realities. This milestone will lead to educational institutions to change attitudes towards curricula, teaching, learning and assessment methods, as well as towards approaches to students and teachers, seeking a balance between the old and the new(2424 Gibbs T. The Covid-19 pandemic: provoking thought and encouraging change. Med Teach. 2020;42(7):738-40. http://dx.doi.org/10.1080/0142159X.2020.1775967. PMid:32608302.
http://dx.doi.org/10.1080/0142159X.2020....
). But for this to happen in an organized and systematic way, educational practices and innovations must be registered and evaluated, as they will serve as the basis for shaping the future of education and training of health professionals(2525 Cleland J, McKimm J, Fuller R, Taylor D, Janczukowicz J, Gibbs T. Adapting to the impact of COVID-19: sharing stories, sharing practice. Med Teach. 2020;42(7):772-5. http://dx.doi.org/10.1080/0142159X.2020.1757635. PMid:32401079.
http://dx.doi.org/10.1080/0142159X.2020....
).

CONCLUSION

Based on the students’ and professors’ perceptions presented in the results of this study, we concluded that ROL is an alternative learning mode when in-person classes cannot be carried out, as in the case of the COVID-19 pandemic. ROL is believed to be unfit to replace in-person learning, although it can complement the traditional classroom-based education in a hybrid model, respecting the nature of each program in the field of health that requires in-person practical training.

  • Study conducted at Departamento de Fisioterapia, Fonoaudiologia e Terapia Ocupacional, Faculdade de Medicina - FM, Universidade de São Paulo - USP, São Paulo (SP), Brasil.
  • Financial support: nothing to declare.

REFERENCES

  • 1
    World Bank Group. Políticas Educacionais na Pandemia a COVID-19: o que o Brasil pode aprender com o resto do mundo? [Internet]. Washington: World Bank Group; 2020 [cited 2020 Aug 7]. p. 1-4. Available from: http://pubdocs.worldbank.org/en/413781585870205922/pdf/politicas-educacionais-na-pandemia-da-covid-19-o-que-o-brasil-pode-aprender-com-o-resto-do-mundo.pdf
    » http://pubdocs.worldbank.org/en/413781585870205922/pdf/politicas-educacionais-na-pandemia-da-covid-19-o-que-o-brasil-pode-aprender-com-o-resto-do-mundo.pdf
  • 2
    Gusso HL, Archer AB, Bordignon LF, Sahão FT, Luca GG, Henklain MHO, et al. Higher education in the times of pandemic: university management guidelines. Educ Soc. 2020;41:e238957. http://dx.doi.org/10.1590/es.238957
    » http://dx.doi.org/10.1590/es.238957
  • 3
    Brasil. Ministério da Educação. Portaria nº 343, de 17 de Março de 2020. Dispõe sobre a substituição das aulas presenciais por aulas em meios digitais enquanto durar a situação de pandemia do Novo Coronavírus - COVID-19 [Internet]. Diário Oficial da União; Brasília; 18 mar. 2020, ed. 53, seção 1, p. 39. [cited 2020 Aug 7]. Available from: http://www.in.gov.br/en/web/dou/-/portaria-n-343-de-17-de-marco-de-2020-248564376
    » http://www.in.gov.br/en/web/dou/-/portaria-n-343-de-17-de-marco-de-2020-248564376
  • 4
    Gustafsson L. Occupational therapy has gone online: what will remain beyond COVID-19? Aust Occup Ther J. 2020;67(3):197-8. http://dx.doi.org/10.1111/1440-1630.12672 PMid:32538488.
    » http://dx.doi.org/10.1111/1440-1630.12672
  • 5
    Durrani M. Debate style lecturing to engage and enrich resident education virtually. Med Educ. 2020;54(10):955-6. http://dx.doi.org/10.1111/medu.14217 PMid:32392355.
    » http://dx.doi.org/10.1111/medu.14217
  • 6
    Zhang Q, He YJ, Zhu YH, Dai MC, Pan MM, Wu JQ, et al. The evaluation of online course of Traditional Chinese Medicine for MBBS international students during the COVID-19 epidemic period. Integr Med Res. 2020;9(3):1004-49. http://dx.doi.org/10.1016/j.imr.2020.100449 PMid:32632357.
    » http://dx.doi.org/10.1016/j.imr.2020.100449
  • 7
    Shahrvini BB, Baxter CC, McDonald BBV, Lander SL. Pre-clinical remote undergraduate medical education during the COVID-19 pandemic: a survey study. BMC Med Educ. 2021;21(1):13. http://dx.doi.org/10.1186/s12909-020-02445-2 PMid:33407376.
    » http://dx.doi.org/10.1186/s12909-020-02445-2
  • 8
    Farooq F, Rathore FA, Mansoor SN. Challenges of online medical education in Pakistan during COVID-19 pandemic. J Coll Physicians Surg Pak. 2020;30(6):67-9. http://dx.doi.org/10.29271/jcpsp.2020.Supp1.S67 PMid:32723456.
    » http://dx.doi.org/10.29271/jcpsp.2020.Supp1.S67
  • 9
    Tempski P, Arantes-Costa FM, Kobayasi R, Siqueira MAM, Torsani MB, Amaro BQRC, et al. Medical students’ perceptions and motivations during the COVID-19 pandemic. PLOS One. 2021;16(3):e0248627. http://dx.doi.org/10.1371/journal.pone.0248627
    » http://dx.doi.org/10.1371/journal.pone.0248627
  • 10
    Shawaqfeh MS, Al Bekairy AM, Al-Azayzih A, Alkatheri AA, Qandil AM, Obaidat AA, et al. Pharmacy students perceptions of their distance online learning experience during the COVID-19 pandemic: a cross-sectional survey study. J Med Educ Curricular Develop. 2020;7:2382120520963039. http://dx.doi.org/10.1177/2382120520963039
    » http://dx.doi.org/10.1177/2382120520963039
  • 11
    Mahoney JS, Marfurt M, Cunha JE. Projeto e avaliação de estratégia de ensino online em curso de graduação em enfermagem psiquiátrica. Arch Psychiatr Nurs. 2005;19(6):264-72. http://dx.doi.org/10.1016/j.apnu.2005.08.002 PMid:16308126.
    » http://dx.doi.org/10.1016/j.apnu.2005.08.002
  • 12
    Attardi SM, Choi S, Barnett J, Roger KA. Métodos mistos: avaliação de aluno de um curso online de anatomia humana sistêmica com laboratório. Anat Sci Educ. 2016;9(3):272-85. http://dx.doi.org/10.1002/ase.1584 PMid:26588051.
    » http://dx.doi.org/10.1002/ase.1584
  • 13
    Machado RA, Bonan PRF, Perez DEDC, Martelli DRB, Martelli-Júnior H. I am having trouble keeping up with virtual teaching activities: reflections in the COVID-19 era. Clinics (São Paulo). 2020;75:e1945. http://dx.doi.org/10.6061/clinics/2020/e1945 PMid:32401961.
    » http://dx.doi.org/10.6061/clinics/2020/e1945
  • 14
    Oliveira MH, Lopes LNS, Gottsfritz IB, João LLS, Sproesser GB, Silva TI, et al. Avaliação da percepção de graduandos da USP referente à integração do ensino acadêmico com a tecnologia em saúde. Rev Grad USP. 2020;4(1):85-91. http://dx.doi.org/10.11606/issn.2525-376X.v4i1p85-91
    » http://dx.doi.org/10.11606/issn.2525-376X.v4i1p85-91
  • 15
    Durfee SM, Goldenson RP, Gill RR, Rincon SP, Flower E, Avery LL. Medical student education roadblock due to COVID-19: virtual radiology core clerkship to the rescue. Acad Radiol. 2020;27(10):1461-6. http://dx.doi.org/10.1016/j.acra.2020.07.020 PMid:32747181.
    » http://dx.doi.org/10.1016/j.acra.2020.07.020
  • 16
    Yang D. Estratégias instrucionais e desenho de cursos para ensinar estatísticas online: perspectivas de alunos online. Int J STEM Educ. 2017;4(1):34. http://dx.doi.org/10.1186/s40594-017-0096-x PMid:30631690.
    » http://dx.doi.org/10.1186/s40594-017-0096-x
  • 17
    Chumley-Jones HS, Dobbie A, Alford CA. Aprendizagem baseada na Web: método educativo sonoro ou hype? Uma revisão da literatura de avaliação. Acad Med. 2002;77:S86-93. http://dx.doi.org/10.1097/00001888-200210001-00028 PMid:12377715.
    » http://dx.doi.org/10.1097/00001888-200210001-00028
  • 18
    Chinelatto LA, Costa TRD, Medeiros VMB, Boog GHP, Hojaij FC, Tempski PZ, et al. What you gain and what you lose in COVID-19: perception of medical students on their education. Clinics (São Paulo). 2020;75:e2133. http://dx.doi.org/10.6061/clinics/2020/e2133 PMid:32667495.
    » http://dx.doi.org/10.6061/clinics/2020/e2133
  • 19
    Samelli AG, Matas CG, Nakagawa NK, da Silva TNR, Martins MA, João SMA. COVID-19 pandemic: challenges and advances in the physical therapy, speech-language-hearing science, and occupational therapy undergraduate programs in Brazil. Clinics (São Paulo). 2020;75:e2490. http://dx.doi.org/10.6061/clinics/2020/e2490 PMid:33263636.
    » http://dx.doi.org/10.6061/clinics/2020/e2490
  • 20
    Bernard RM, Abrami PC, Borokhovski E, Wade CA, Tamim RM, Surkes MA, et al. A meta-analysis of three types of interaction treatments in distance education. Rev Educ Res. 2009;79(3):1243-89. http://dx.doi.org/10.3102/0034654309333844
    » http://dx.doi.org/10.3102/0034654309333844
  • 21
    Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Instructional design variations in internet-based learning for health professions education: a systematic review and meta-analysis. Acad Med. 2010;85(5):909-22. http://dx.doi.org/10.1097/ACM.0b013e3181d6c319 PMid:20520049.
    » http://dx.doi.org/10.1097/ACM.0b013e3181d6c319
  • 22
    Brewer EW, Dejonge JO, Stout VJ. Passando para o online: fazendo a transição das estratégias tradicionais de instrução e comunicação. California: Corwin Press; 2001.
  • 23
    Brasil. Conselho Nacional de Saúde. Recomendação nº 003, de 24 de Janeiro de 2020 [Internet]. Diário Oficial da União; Brasília; 2020. [cited 2020 Aug 7]. Available from: https://www.coffito.gov.br/nsite/wp-content/uploads/2020/02/Recomendacao_CNS_Portaria.pdf
    » https://www.coffito.gov.br/nsite/wp-content/uploads/2020/02/Recomendacao_CNS_Portaria.pdf
  • 24
    Gibbs T. The Covid-19 pandemic: provoking thought and encouraging change. Med Teach. 2020;42(7):738-40. http://dx.doi.org/10.1080/0142159X.2020.1775967 PMid:32608302.
    » http://dx.doi.org/10.1080/0142159X.2020.1775967
  • 25
    Cleland J, McKimm J, Fuller R, Taylor D, Janczukowicz J, Gibbs T. Adapting to the impact of COVID-19: sharing stories, sharing practice. Med Teach. 2020;42(7):772-5. http://dx.doi.org/10.1080/0142159X.2020.1757635 PMid:32401079.
    » http://dx.doi.org/10.1080/0142159X.2020.1757635

Publication Dates

  • Publication in this collection
    03 July 2023
  • Date of issue
    2023

History

  • Received
    01 Feb 2022
  • Accepted
    26 May 2023
Sociedade Brasileira de Fonoaudiologia Al. Jaú, 684, 7º andar, 01420-002 São Paulo - SP Brasil, Tel./Fax 55 11 - 3873-4211 - São Paulo - SP - Brazil
E-mail: revista@codas.org.br