Acessibilidade / Reportar erro

COVID-19 pandemic and impact on dental education: perception of Brazilian dental students

Abstract

Aim

The aim of the present study is to assess the perception of undergraduate students on the impact of the COVID-19 pandemic on Brazilian dental education.

Methods

This cross-sectional study was conducted using an online questionnaire hosted in Google Forms platform and publicized on Instagram® and Facebook®. The questionnaire was available between July 8-27, 2020. Absolute and relative frequencies were obtained for variables of interest using Pearson’s chi-squared and considering 95% confidence intervals. Prevalence of learning resource variables according to self-reported skin color, educational institution, and Brazilian region were presented using equiplots.

Results

A total of 1,050 undergraduate dental students answered the questionnaire. Most students reported being in full-distance learning mode. Among the undergraduate students, 65.4% reported perceiving a very high impact in dental education, and 16.6% of students reported not being able to follow distance learning. In addition, 14% reported not having a personal laptop or desktop to study with, with this condition being more prevalent among non-white than white individuals.

Conclusion

We conclude that Brazilian dental students perceived a high impact of COVID-19 on dental education, as well as one-sixth of the students reported not having adequate resources to continue with distance learning. It is important that different policies are developed at the institutional and governmental levels to reduce the impact of the pandemic on dental education.

Education, dental; Students, dental; Dentistry; COVID-19; Pandemics


Introduction

Coronavirus Disease 2019 (COVID-19) emerged in December 2019 in Wuhan, China, as pneumonia cases of an unknown cause11. Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A Novel Coronavirus from Patients with Pneumonia in China, 2019. N Engl J Med. 2020 Feb;382(8):727-33. doi: 10.1056/NEJMoa2001017.. After drawing the attention of international authorities and the World Health Organization (WHO), there were an increasing number of cases in different countries. Then in March 2020, the WHO determined that the world was experiencing a pandemic22. Pan American Health Organization. WHO characterizes COVID-19 as a pandemic. Pan American Health Organization. 2020 Mar 11 [cited 2021 Jul 19]. Available from: https://www.paho.org/en/news/11-3-2020-who-characterizes-covid-19-pandemic.
https://www.paho.org/en/news/11-3-2020-w...
. More than 10 million cases and 244,737 deaths by COVID-19 were recorded in Brazil between February 2020 (first case reported of COVID-19) and February 202133. World Health Organization (WHO). COVID-19 Dashboard. COVID-19. 2021 [cited 2021 Jul 19]. Available from: https://covid19.who.int/region/amro/country/br.
https://covid19.who.int/region/amro/coun...
. This scenario led the country to occupy the third place in the ranking of countries with the most confirmed cases of COVID-19, being considered one of the epicenters of the pandemic33. World Health Organization (WHO). COVID-19 Dashboard. COVID-19. 2021 [cited 2021 Jul 19]. Available from: https://covid19.who.int/region/amro/country/br.
https://covid19.who.int/region/amro/coun...
.

Many countries in the world, including Brazil, experienced episodes of exponential growth in the number of cases, hospitalizations and overload of health systems33. World Health Organization (WHO). COVID-19 Dashboard. COVID-19. 2021 [cited 2021 Jul 19]. Available from: https://covid19.who.int/region/amro/country/br.
https://covid19.who.int/region/amro/coun...
between March and December 2020 due to the high infection rate, enhanced by transmission via oral and nasal secretion mainly in direct contact44. Peng X, Xu X, Li Y, Cheng L, Zhou X, Ren B. Transmission routes of 2019-nCoV and controls in dental practice. Int J Oral Sci. 2020 Mar;12(1):9. doi: 10.1038/s41368-020-0075-9.,55. Sabino-Silva R, Jardim ACG, Siqueira WL. Coronavirus COVID-19 impacts to dentistry and potential salivary diagnosis. Clin Oral Investig. 2020 Apr;24(4):1619-21. doi: 10.1007/s00784-020-03248-x., and the absence of a vaccine and/or specific treatment against the SARS-CoV-2 virus for most of world’s population. Thus, different measures of individual and collective protection against contagion were instituted, such as social distancing, hygiene of hands, objects and surfaces and the use of masks in order to mitigate the infection spreading in different populations11. Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A Novel Coronavirus from Patients with Pneumonia in China, 2019. N Engl J Med. 2020 Feb;382(8):727-33. doi: 10.1056/NEJMoa2001017.,44. Peng X, Xu X, Li Y, Cheng L, Zhou X, Ren B. Transmission routes of 2019-nCoV and controls in dental practice. Int J Oral Sci. 2020 Mar;12(1):9. doi: 10.1038/s41368-020-0075-9.,66. Chu DK, Akl EA, Duda S, Solo K, Yaacoub S, Schünemann HJ, et al. Physical distancing, face masks, and eye protection to prevent person-to-person transmission of SARS-CoV-2 and COVID-19: a systematic review and meta-analysis. Lancet. 2020 Jun;395(10242):1973-87. doi: 10.1016/S0140-6736(20)31142-9.
https://doi.org/10.1016/S0140-6736(20)31...
. In this context, one of the fields most susceptible to exposure to the virus is dentistry, increasing the risk of contagion for professionals and patients55. Sabino-Silva R, Jardim ACG, Siqueira WL. Coronavirus COVID-19 impacts to dentistry and potential salivary diagnosis. Clin Oral Investig. 2020 Apr;24(4):1619-21. doi: 10.1007/s00784-020-03248-x.,77. The New York Times. The Workers Who Face the Greatest Coronavirus Risk. The New York Times. 2020. [cited 2021 Jul 30]. Available from: https://www.nytimes.com/interactive/2020/03/15/business/economy/coronavirus-worker-risk.html.
https://www.nytimes.com/interactive/2020...
. Most dental procedures require proximity to the patient, in addition to the fact that aerosols and droplets are present during various dental procedures55. Sabino-Silva R, Jardim ACG, Siqueira WL. Coronavirus COVID-19 impacts to dentistry and potential salivary diagnosis. Clin Oral Investig. 2020 Apr;24(4):1619-21. doi: 10.1007/s00784-020-03248-x.,88. Meng L, Hua F, Bian Z. Coronavirus Disease 2019 (COVID-19): Emerging and Future Challenges for Dental and Oral Medicine. J Dent Res. 2020 May;99(5):481-7. doi: 10.1177/0022034520914246.. Moreover, Brazil is one of the countries with the largest number of professionals in the dental field, around 350,00099. Federal Council of Dentistry. [Professionals and entities registered in 2020]. Brasília: FCD; 2020. Portuguese., and the COVID-19 pandemic introduced important impacts for public and private dentists in the country1010. Moraes RR, Correa MB, Queiroz AB, Daneris Â, Lopes JP, Pereira-Cenci T, et al. COVID-19 challenges to dentistry in the new pandemic epicenter: Brazil. PLoS One. 2020 Nov;15(11):e0242251. doi: 10.1371/journal.pone.0242251..

There were 412 public and private dental schools in Brazil until 2019, totaling approximately 100,000 students99. Federal Council of Dentistry. [Professionals and entities registered in 2020]. Brasília: FCD; 2020. Portuguese.. In addition to the impacts reported by professionals, dental education has been facing several other challenges in this period1111. Caldarelli PG, Gabardo MCL. [Health training in the context of the COVID-19 pandemic: challenges and perspectives]. REFACS. 2021;1(Suppl. 1):188-9. Portuguese.. An undergraduate dental clinic requires professors to supervise students and the model followed in most of institutions is a dental clinic with simultaneous assistance1212. Iyer P, Aziz K, Ojcius DM. Impact of COVID-19 on dental education in the United States. J Dent Educ. 2020 Jun;84(6):718-22. doi: 10.1002/jdd.12163.. Moreover, the need for provisional closure of clinical activities in educational institutions tends to interfere in dental training, mainly due to the need for practical activities1212. Iyer P, Aziz K, Ojcius DM. Impact of COVID-19 on dental education in the United States. J Dent Educ. 2020 Jun;84(6):718-22. doi: 10.1002/jdd.12163.. Therefore, the possibility of distance learning resources can partially supply the pedagogical need. However, internet access is not yet a reality for all Brazilian students1313. de Oliveira SS, Postal EA, Afonso DH. [Medical Schools and the challenges of medical training in the face of the Brazilian COVID-19 epidemic: from academic (un)certainties to social commitment]. APS Rev. 2020 Feb;2(1):56–60. doi: 10.14295/aps.v2i1.69. Portuguese., which can be a barrier to e-learning, in addition to depending on the type of interactive learning of teachers and also on the relationship of students with technology1414. Xavier TB, Barbosa GM, Meira CLS, Neto NC, Pontes HAR. [Use of Dentistry Education Web Resources during Pandemic COVID-19]. Braz J Health Rev. 2020 May;3(3):4989–5000. Portuguese. doi: 10.34119/bjhrv3n3-081.. To the best of our knowledge, no study has assessed the impact of the COVID-19 pandemic in the Brazilian dental education. Thus, the aim of the present study is to assess the impact of the COVID-19 pandemic on Brazilian dental education through the perception of undergraduate students.

Methods

This study was reported following SURGE (the SUrvey Reposting GuidelinE)1515. Grimshaw J. SURGE (The SUrvey Reporting GuidelinE). In: Moher D, Altman DG, Schulz KF, Simera I, Wager E, editors. Guidelines for Reporting Health Research: A User’s Manual. Ottawa, Canada: John Wiley & Sons; 2014. p.206-13. doi: 10.1002/9781118715598.ch20.
https://doi.org/10.1002/9781118715598.ch...
and the STROBE (STrengthening the Reporting of Observational studies in Epidemiology) Statement1616. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Clin Epidemiol. 2008 Apr;61(4):344-9. doi: 10.1016/j.jclinepi.2007.11.008. for cross-sectional studies.

Study design

This study protocol was approved by research ethics committee of the Faculty of Medicine - Federal University of Pelotas (#4121205/2020). This cross-sectional study was conducted using an online questionnaire developed and pre-tested with questions that aimed to evaluate the impact of the COVID-19 pandemic on Brazilian dental education1717. Fernandez M dos S, Vieira IS, Silva NRJ da, Cardoso T de A, Bielavski CH, Rakovski C, et al. Anxiety symptoms and alcohol abuse during the COVID-19 pandemic: A cross-sectional study with Brazilian dental undergraduate students. J Dent Educ. 2021 Nov;85(11):1739-48. doi: 10.1002/jdd.12742..

Questionnaire development and pre-testing

The self-administered questionnaire used in this study was developed based on previous findings in the literature considering adversities faced by dental professionals and students related to access to technology and previous experience of distance learning1010. Moraes RR, Correa MB, Queiroz AB, Daneris Â, Lopes JP, Pereira-Cenci T, et al. COVID-19 challenges to dentistry in the new pandemic epicenter: Brazil. PLoS One. 2020 Nov;15(11):e0242251. doi: 10.1371/journal.pone.0242251.,1212. Iyer P, Aziz K, Ojcius DM. Impact of COVID-19 on dental education in the United States. J Dent Educ. 2020 Jun;84(6):718-22. doi: 10.1002/jdd.12163.. After ethical approval, the questionnaire was hosted online on the Google Forms platform and submitted to a pre-test carried out with 12 graduate dental students in order to assess the clarity, writing, organization and internal consistency of questions. Students were instructed to answer the questionnaire, record the time to complete, and then fill in a clarity scale for each question from 1 (not clear) to 5 (very clear)1010. Moraes RR, Correa MB, Queiroz AB, Daneris Â, Lopes JP, Pereira-Cenci T, et al. COVID-19 challenges to dentistry in the new pandemic epicenter: Brazil. PLoS One. 2020 Nov;15(11):e0242251. doi: 10.1371/journal.pone.0242251.. After the evaluation, 6 questions with a rating ≤3 were discussed among the researchers and were edited later. The questions together obtained an average clarity score of 4.78 (0.49). In addition, the mean response time to complete the questionnaire was 12 (2.2) minutes. The present study did not aim to validate the questionnaire used in this study.

Questionnaire content

The questionnaire should be accessed from the link in the invitation to participate in the study. The questionnaire was introduced on the first page, where the participant was informed about the study objective, the average response time and contact of the researchers involved. The participants had to read the Informed Consent Term and agree to participate in the study by selection of an affirmative answer “Yes” in order to access the following pages and questionnaire sections.

The final questionnaire was composed of 41 mandatory and closed-ended questions in five sections. The sections covered the following themes: student characteristics (n=10); dental education during the COVID-19 pandemic (n=17); knowledge about COVID-19 (n=4); biosafety and dental care (n=7); alcohol consumption and psychological symptoms (n=3). The options “I’d rather not say” and “does not apply” were available on all questions.

Setting, participant recruitment and survey administration

Participants were recruited through online resources without assuming a convenience sample1717. Fernandez M dos S, Vieira IS, Silva NRJ da, Cardoso T de A, Bielavski CH, Rakovski C, et al. Anxiety symptoms and alcohol abuse during the COVID-19 pandemic: A cross-sectional study with Brazilian dental undergraduate students. J Dent Educ. 2021 Nov;85(11):1739-48. doi: 10.1002/jdd.12742.. The final questionnaire hosted on the Google Forms platform was available on the Instagram® social network (Facebook, Menlo Park, CA) together with images and informative texts about the study content, eligible participants, average response time and ethical approval. The link which hosted the questionnaire was made available in Instagram in the @ensino.odonto_covid19 bio, a professional profile specifically created for the study. In addition, the researchers involved acted directly in sharing content of the research profile and content and inviting professors and students at dental schools around the country to share the research link with their colleagues through feed and stories posts in their personal profiles on Instagram®, Twitter® and Facebook®. Responses were collected between July 8-27, 2020 and the project’s profile had a maximum of 1,389 followers1717. Fernandez M dos S, Vieira IS, Silva NRJ da, Cardoso T de A, Bielavski CH, Rakovski C, et al. Anxiety symptoms and alcohol abuse during the COVID-19 pandemic: A cross-sectional study with Brazilian dental undergraduate students. J Dent Educ. 2021 Nov;85(11):1739-48. doi: 10.1002/jdd.12742.. In addition to the social network approach, e-mails with information and a link to access the survey were sent to 250 coordinating departments of Brazilian dental schools across the country1717. Fernandez M dos S, Vieira IS, Silva NRJ da, Cardoso T de A, Bielavski CH, Rakovski C, et al. Anxiety symptoms and alcohol abuse during the COVID-19 pandemic: A cross-sectional study with Brazilian dental undergraduate students. J Dent Educ. 2021 Nov;85(11):1739-48. doi: 10.1002/jdd.12742.. Of these, 121 institutions responded to the e-mail (48.4% response rate)1717. Fernandez M dos S, Vieira IS, Silva NRJ da, Cardoso T de A, Bielavski CH, Rakovski C, et al. Anxiety symptoms and alcohol abuse during the COVID-19 pandemic: A cross-sectional study with Brazilian dental undergraduate students. J Dent Educ. 2021 Nov;85(11):1739-48. doi: 10.1002/jdd.12742..

Participants and sample size

Participants were undergraduate dental students in public or private Brazilian dental schools. Considering ~100.000 undergraduate students in public and private dental schools in Brazil99. Federal Council of Dentistry. [Professionals and entities registered in 2020]. Brasília: FCD; 2020. Portuguese., we estimated that 500 responses would be necessary to obtain a 95% confidence interval, admitting 30% losses and unknown prevalence (50%).

Variables

Considering the students’ characteristics section, the variables included gender (female or male), self-reported skin color (white vs non-white - Brown, Black, Yellow and Indigenous), residence area (rural or urban). Age was collected in years and categorized into ranges of 17-19 years, 20-25 years, 26-31 years, 32 years or more. Additionally, the variable Brazilian regions was obtained from the categorization of Brazilian states following the classification of the Brazilian Institute of Geography and Statistics - IBGE (North, Northeast, Midwest, Southeast and South)1818. Brazilian Institute of Geography and Statistics. Regional Divisions of Brazil; 2017 [cited 2021 Jun 4]. Available from: https://www.ibge.gov.br/en/geosciences/territorial-organization/regional-division/21536-regional-divisions-of-brazil.html?=&t=o-que-e.
https://www.ibge.gov.br/en/geosciences/t...
.

Variables associated with the context of dental education during the Covid-19 pandemic collected were the type of institution (public, private or other), undergraduate stage (semester) categorized as initial stage (up to the fourth semester), intermediate stage (fifth to seventh semester) and final stage (eighth to tenth semester), and the learning methodology used in the dental school during the pandemic (“full distance learning”, “partial distance learning”, “no activities”).

The students self-reported impact on dental education was collected through the question “How do you consider the impact of Covid-19 pandemic on dental education?”, with answers ranging in a five-point scale from 0 “no impact” to 4 “very high impact”. Additionally, data were collected regarding the students’ access to infrastructure to follow the classes including “adequate resources for distance learning”, “internet access”, “smartphone”, “laptop”, “desktop”, all dichotomized as “yes” or “no” questions. Moreover, when a computer was available, the number of persons sharing the computer was collected (“None”, “One”, “Two”, “Three or more”).

Data analysis

The data were imported from the Google Forms platform in spreadsheet format to Microsoft Excel software. All analysis was performed in the Stata 15.0 software program (StataCorp. CollegeStation, TX, USA). Absolute and relative frequencies were obtained for variables of interest using Pearson’s chi-squared test with 5% significance level and 95% confidence intervals. The options “I’d rather not say” and “does not apply” were treated as missing data. In addition, prevalence of learning resource variables according to self-reported skin color (white and non-white), educational institution (public and private) and Brazilian region (South, Southeast, Midwest, Northeast, North) were presented using equiplots (http://www.equidade.org/equiplot).

Results

A total of 1,050 undergraduate dental students answered the questionnaire online and were considered part of the final sample. Among the participants, most were female (70.5%), aged 20 to 25 years (64.2%) and with self-declared skin color as white (66.2%). A majority of the students reported living in urban area (95.5%) and in the South region of Brazil, followed by the Northeast and Southeast regions (Table 1).

Table 1
Descriptive analysis of the sample according to student characteristics (n = 1,050).

Table 2 shows a similar distribution of students between public and private institutions and that the majority of students were at the intermediate stage of their graduate course (41.5%). Additionally, considering the learning methodology during the pandemic, most students reported being in full distance learning mode (48.9%). Among the undergraduate students, 65.4% reported having perceived a very high impact on their dental education. In Table 3 it is possible to observe that 16.6% of students reported not being able to follow distance learning, 19.7% of students reported not having a laptop, and 84.7% not having a desktop. In addition, only 1.3% have no access to internet and 0.4% declared no access to a smartphone. Most of those who owned a computer (37.5%) reported not sharing with another person.

Table 2
Descriptive analysis of the sample according to dental education characteristics in the pandemic (n = 1,050).

Table 3
Descriptive analysis of the sample according to students’ resources for distance learning (n = 1,050).

Data on two variables about adequate resources for distance learning and computers (laptop or desktop) are presented by Brazilian region, educational institution, and self-declared skin color in Figures 1 and 2. Among students, 14% reported not having a personal laptop or desktop to study, being more prevalent among non-whites than whites (18.1% vs 11.9%, respectively, p<0.001) (Figure 2). In addition, it is possible to observe a gap in the prevalence of absence of personal computer to study between regions, varying from 10.5% and 12.1% in northeast and southeast to 19.1% and 21.6% in Midwest and North regions, respectively. An absence of resources for distance learning was more frequently reported by participants classified as non-white (19.0%), studying in private institutions (18.0%) and living in Midwest Brazilian region (19.0%); however, no statistical significance was observed (p > 0.05) (Figure 1).

Figure 2
Equiplot of prevalence about abscence of personal laptop/desktop to study by Brazilian region, educational institution and skin color (n = 1,050).

Figure 1
Equiplot of prevalence about abscence of adequate student resources for distance learning by Brazilian region, eucational institution and skin color (n = 1,050).

Discussion

The results obtained by this study are a source of concern, mainly because dental students reported a high impact from the COVID-19 pandemic. Additionally, our findings shed some light on the fact that a significant number of students present important limitations to follow distance learning, with inequalities in distribution. About one sixth of students reported not having adequate resources for distance learning, and an important part reported being in full or partial learning distance mode. Among dental students, 19.7% reported not having a laptop, and more than 80% not having a desktop; of those who have these resources, more than 60% share with at least one person. Additionally, not having a laptop or desktop to study was significantly more prevalent among students who self-declared non-white, which comprises racial and ethnic minorities in Brazil, such as blacks, browns and indigenous.

Although some dental schools had already adopted the system of e-learning before the pandemic1919. Hillenburg KL, Cederberg RA, Gray SA, Hurst CL, Johnson GK, Potter BJ. E-learning and the future of dental education: opinions of administrators and information technology specialists. Eur J Dent Educ. 2006 Aug;10(3):169-77. doi: 10.1111/j.1600-0579.2006.00413.x., most of essential courses had to adhere to the Remote Emergency Education (REE) modality to meet the pedagogical needs required after the COVID-19 pandemic and social distancing measures. Medical schools in Brazil similarly also suspended face-to-face theoretical and undergraduate activity practices1313. de Oliveira SS, Postal EA, Afonso DH. [Medical Schools and the challenges of medical training in the face of the Brazilian COVID-19 epidemic: from academic (un)certainties to social commitment]. APS Rev. 2020 Feb;2(1):56–60. doi: 10.14295/aps.v2i1.69. Portuguese.. In the present study, most students were only studying by distance learning methods, totally (48.9%) or partially (24.5%), as well as most institutions worldwide1212. Iyer P, Aziz K, Ojcius DM. Impact of COVID-19 on dental education in the United States. J Dent Educ. 2020 Jun;84(6):718-22. doi: 10.1002/jdd.12163.,2020. Amir LR, Tanti I, Maharani DA, Wimardhani YS, Julia V, Sulijaya B, et al. Student perspective of classroom and distance learning during COVID-19 pandemic in the undergraduate dental study program Universitas Indonesia. BMC Med Educ. 2020 Oct;20(1):392. doi: 10.1186/s12909-020-02312-0.

21. Jum’ah AA, Elsalem L, Loch C, Schwass D, Brunton PA. Perception of health and educational risks amongst dental students and educators in the era of COVID-19. Eur J Dent Educ. 2021 Aug;25(3):506-15. doi: 10.1111/eje.12626.

22. Loch C, Kuan IBJ, Elsalem L, Schwass D, Brunton PA, Jum’ah A. COVID-19 and dental clinical practice: Students and clinical staff perceptions of health risks and educational impact. J Dent Educ. 2021 Jan;85(1):44-52. doi: 10.1002/jdd.12402.
-2323. Peres KG, Reher P, de Castro RD, Vieira AR. Covid-19-related challenges in dental education: Experiences from Brazil, the USA, and Australia. Pesq Bras Odontopediatria Clin Integr. 2020 Aug;20:e0131. doi: 10.1590/pboci.2020.130.. The REE may have contributed to the fact that majority of dental students reported a high impact of the COVID-19 pandemic on their education. Still, many institutions completely suspended their activities at times during 2020, and the impact for these students is assumed to be even greater. As dentistry is a very practical course, the absence of clinics and laboratories directly affect student performance and clinical skills development1212. Iyer P, Aziz K, Ojcius DM. Impact of COVID-19 on dental education in the United States. J Dent Educ. 2020 Jun;84(6):718-22. doi: 10.1002/jdd.12163.,2020. Amir LR, Tanti I, Maharani DA, Wimardhani YS, Julia V, Sulijaya B, et al. Student perspective of classroom and distance learning during COVID-19 pandemic in the undergraduate dental study program Universitas Indonesia. BMC Med Educ. 2020 Oct;20(1):392. doi: 10.1186/s12909-020-02312-0.,2121. Jum’ah AA, Elsalem L, Loch C, Schwass D, Brunton PA. Perception of health and educational risks amongst dental students and educators in the era of COVID-19. Eur J Dent Educ. 2021 Aug;25(3):506-15. doi: 10.1111/eje.12626.. This is one of the greatest challenges for dental education because although some face-to-face classroom lectures were replaced by e-learning, distance methods cannot replace clinical practice1212. Iyer P, Aziz K, Ojcius DM. Impact of COVID-19 on dental education in the United States. J Dent Educ. 2020 Jun;84(6):718-22. doi: 10.1002/jdd.12163.,2424. Machado RA, Bonan PRF, da Cruz Perez DE, Martelli Júnior H. COVID-19 pandemic and the impact on dental education: Discussing current and future perspectives. Braz Oral Res. 2020 Jun;34:e083. doi: 10.1590/1807-3107bor-2020.vol34.0083..

The great impact on activities reported by students in this study may also be due to feelings arising from students such as insecurity, fear, anguish, and stress, as well as a difficulty in virtual learning by some undergraduate students2525. Agius AM, Gatt G, Vento Zahra E, Busuttil A, Gainza-Cirauqui ML, Cortes ARG, et al. Self-reported dental student stressors and experiences during the COVID-19 pandemic. J Dent Educ. 2021 Feb;85(2):208-15. doi: 10.1002/jdd.12409.. A study carried out through an online questionnaire applied in April 2020 at a private dental school in the Northeast region in Brazil observed one of the most affected domains of dental student quality of life was the psychological domain2626. Silva PG de B, de Oliveira CAL, Borges MMF, Moreira DM, Alencar PNB, Avelar RL, et al. Distance learning during social seclusion by COVID-19: Improving the quality of life of undergraduate dentistry students. Eur J Dent Educ. 2021 Feb;25(1):124-34. doi: 10.1111/eje.12583.. Other studies carried out in different regions and countries, such as North America1212. Iyer P, Aziz K, Ojcius DM. Impact of COVID-19 on dental education in the United States. J Dent Educ. 2020 Jun;84(6):718-22. doi: 10.1002/jdd.12163.,2727. Akinkugbe AA, Garcia DT, Smith CS, Brickhouse TH, Mosavel M. A descriptive pilot study of the immediate impacts of COVID-19 on dental and dental hygiene students’ readiness and wellness. J Dent Educ. 2021 Mar;85(3):401-10. doi: 10.1002/jdd.12456., Indonesia2020. Amir LR, Tanti I, Maharani DA, Wimardhani YS, Julia V, Sulijaya B, et al. Student perspective of classroom and distance learning during COVID-19 pandemic in the undergraduate dental study program Universitas Indonesia. BMC Med Educ. 2020 Oct;20(1):392. doi: 10.1186/s12909-020-02312-0. Jordan2121. Jum’ah AA, Elsalem L, Loch C, Schwass D, Brunton PA. Perception of health and educational risks amongst dental students and educators in the era of COVID-19. Eur J Dent Educ. 2021 Aug;25(3):506-15. doi: 10.1111/eje.12626. and New Zealand2222. Loch C, Kuan IBJ, Elsalem L, Schwass D, Brunton PA, Jum’ah A. COVID-19 and dental clinical practice: Students and clinical staff perceptions of health risks and educational impact. J Dent Educ. 2021 Jan;85(1):44-52. doi: 10.1002/jdd.12402. using online surveys had similar results, with undergraduate dental students reporting fear from COVID-19, anxiety and depressive symptoms due to social distancing situations, family economic issues and return to face-to-face activities. The context of the COVID-19 pandemic in a middle-income country, routine changes promoted by social distancing, socioeconomic and family environment factors may intensify students’ stress1717. Fernandez M dos S, Vieira IS, Silva NRJ da, Cardoso T de A, Bielavski CH, Rakovski C, et al. Anxiety symptoms and alcohol abuse during the COVID-19 pandemic: A cross-sectional study with Brazilian dental undergraduate students. J Dent Educ. 2021 Nov;85(11):1739-48. doi: 10.1002/jdd.12742.,2424. Machado RA, Bonan PRF, da Cruz Perez DE, Martelli Júnior H. COVID-19 pandemic and the impact on dental education: Discussing current and future perspectives. Braz Oral Res. 2020 Jun;34:e083. doi: 10.1590/1807-3107bor-2020.vol34.0083..

The COVID-19 pandemic is disproportionately affecting the most vulnerable strata in different societies, especially in low- and middle-income countries, which already have important inequalities in living conditions, health and education, such as Brazil2828. Shadmi E, Chen Y, Dourado I, Faran-Perach I, Furler J, Hangoma P, et al. Health equity and COVID-19: Global perspectives. Int J Equity Health. 2020 Jun;19(1):104. doi: 10.1186/s12939-020-01218-z.. As found in the present study, although most also have the necessary resources, a significant portion of students (16.6%) still do not have resources for distance learning classes. According to data from the National Continuous Household Survey, in 2018, almost 46 million of the included Brazilian households do not have an internet connection2929. Brazilian Institute of Geography and Statistics. [National Continuous Household Sample Survey 2017-2018]. 2020. Available from: https://biblioteca.ibge.gov.br/visualizacao/livros/liv101705_informativo.pdf. Portuguese.
https://biblioteca.ibge.gov.br/visualiza...
. Internet access for learning is not yet a reality for all students1313. de Oliveira SS, Postal EA, Afonso DH. [Medical Schools and the challenges of medical training in the face of the Brazilian COVID-19 epidemic: from academic (un)certainties to social commitment]. APS Rev. 2020 Feb;2(1):56–60. doi: 10.14295/aps.v2i1.69. Portuguese.. It is therefore necessary to consider students who do not have sufficient resources for distance learning classes and who are in a situation of social vulnerability2828. Shadmi E, Chen Y, Dourado I, Faran-Perach I, Furler J, Hangoma P, et al. Health equity and COVID-19: Global perspectives. Int J Equity Health. 2020 Jun;19(1):104. doi: 10.1186/s12939-020-01218-z.. Differences in the access to a personal computer was also found considering Brazilian regions, where it was observed that students from the North and Midwest regions presented less access to a desktop or laptop to study. It is also worth mentioning that, although it is possible to watch classes by a mobile device, the presence of a computer is absolutely necessary to perform e-learning activities. North and Midwest regions are less economically developed in Brazil compared with the Southeast3030. United Nations Development Programme. Institute of Applied Economic Research. João Pinheiro Foundation, editors. [Human development in Brazilian macro-regions]. 2016 [cited 2021 Jun 4]. Available from: http://repositorio.ipea.gov.br/bitstream/11058/6217/1/Desenvolvimento%20humano%20nas%20macrorregi%c3%b5es%20brasileiras.pdf. Portuguese.
http://repositorio.ipea.gov.br/bitstream...
. Thus, differences between regions can be explained by socioeconomic differences, calling attention to the need for digital inclusion actions mostly directed at these vulnerable regions. Emergency e-learning maintains inequalities and provides a window into the colonial process of social exclusion of the ethnicity and racial minority population in Brazil3131. Ferreira SC. [Apartheid digital in times of remote education:reinvention of brazilian racism]. Interfaces Cient. 2020 Sep;10(1):11-24. Portuguese. doi: 10.17564/2316-3828.2020v10n1p11-24.
https://doi.org/10.17564/2316-3828.2020v...
,3232. Bailey ZD, Krieger N, Agénor M, Graves J, Linos N, Bassett MT. Structural racism and health inequities in the USA: evidence and interventions. Lancet. 2017 Apr;389(10077):1453-63. doi: 10.1016/S0140-6736(17)30569-X..

A statistically significant difference was found in the present study, showing inequality in the access to a personal computer between whites and blacks/browns. In addition, it is observed that most respondents in this study are white, even though the majority of Brazilians self-declared black or brown. Racial inequalities in different outcomes are well described in the literature and occurs as a result of structural racism3232. Bailey ZD, Krieger N, Agénor M, Graves J, Linos N, Bassett MT. Structural racism and health inequities in the USA: evidence and interventions. Lancet. 2017 Apr;389(10077):1453-63. doi: 10.1016/S0140-6736(17)30569-X.. Structural racism is an oppressive manifestation through interconnected systems, with racial discrimination occurring from the space of the individual, employment, residential location, education, health care, justice, reflecting on the history, culture and institutions present in our society3333. Reskin B. The race discrimination system. Ann Rev Sociol. 2012 Aug;38:17-35. doi: 10.1146/annurev-soc-071811-145508.. This historical racial discrimination generates a marginalized population, with worse housing conditions, lower income and fewer opportunities for professional advancement, and in turn makes it impossible or delays access of blacks/browns to more modern technologies in relation to whites3333. Reskin B. The race discrimination system. Ann Rev Sociol. 2012 Aug;38:17-35. doi: 10.1146/annurev-soc-071811-145508.. Consequently, whites are more likely to finish high school than blacks/browns and thus they are also more likely to enter and complete an undergraduate course, as there is racial disparity in access, training and resources available in different schools, corroborating the majority of university students interviewed who declared themselves whites3434. Tragtenberg MHR, Bastos JLD, Moura LH, Peres MA. [How to increase the rate of black students at university?] Cad Pesq. 2006;36(128):473-95. Portuguese. doi: 10.1590/S0100-15742006000200010..

In view of the reduction of these inequalities, Brazilian Universities went through a huge expansion at the end of 2000s and at the beginning of the last decade. As part of this expansion, racial quotas were implemented in public institutions, allowing black/brown people an increase in possibilities to access all careers, including those with more prestige in society, where dentistry can be included3535. Guarnieri FV, Melo-Silva LL. University quotas in Brazil: analysis of a decade of scientific production. Psicol Esc Educ. 2017 Aug;21(2):183-93. Portuguese. doi: 10.1590/2175-3539201702121100.. Federal universities increased policies directed to offer home, transport and food for this group to guarantee the permanence of students in situations of vulnerability3535. Guarnieri FV, Melo-Silva LL. University quotas in Brazil: analysis of a decade of scientific production. Psicol Esc Educ. 2017 Aug;21(2):183-93. Portuguese. doi: 10.1590/2175-3539201702121100.. At this moment, it is also necessary that digital inclusion actions should be promoted, allowing all students to have adequate conditions to follow on-line courses. A survey which studied digital inclusion in the poorest sectors of the population found that while the percentage of white people with a computer exceeds the average (9.0%), and that of mixed race is equal to it, the black population has a level equivalent to half the average3636. Sorj B, Guedes LE. [Digital divide: conceptual issues, empirical evidence and public policy]. Novos Est CEBRAP. 2005;(72):101-17. Portuguese. doi: 10.1590/S0101-33002005000200006.. Brazilian data showed that only 55% of black people used computers at least once in their lives, demonstrating the differences in access to technology in the country2929. Brazilian Institute of Geography and Statistics. [National Continuous Household Sample Survey 2017-2018]. 2020. Available from: https://biblioteca.ibge.gov.br/visualizacao/livros/liv101705_informativo.pdf. Portuguese.
https://biblioteca.ibge.gov.br/visualiza...
.

This study presents some limitations that should be discussed. Although the sampling method is not representative, the dental community is very present on social networks, where more than 1000 students answered the questionnaire, alleviating this limitation. In addition, with limitation, we can point out that the sample was not from the region of the country where most dentistry courses are concentrated, which may have impacted the representativeness and generalization of our results for the country. By the online application method, attendance by the participant is prevented when the participant does not understand a question, there is exclusion of people who do not usually use social networks or do not have access to the internet, in addition to not knowing the circumstances in which the questionnaire was answered. Thus, the results regarding access to devices for e-learning could be overestimated since students with difficulty to access the internet had less chance to answer the questionnaire. As a strength, the use of the social networking tool is a good option in times of social isolation where contact between people has been avoided, as well as being important to emphasize the educational inequalities that occur due to the pandemic. Moreover, knowledge of the dental education context in the COVID-19 era is necessary in order to understand the limitations and losses caused by the period and to outline strategies to qualify and reduce the impacts, mainly in a middle-income country.

The COVID-19 pandemic caused many challenges related to education to arise, both for educational institutions and for students and teachers. However, distance learning resources can meet the orientation of social distancing and at the same time preserve the connection and support to academics1313. de Oliveira SS, Postal EA, Afonso DH. [Medical Schools and the challenges of medical training in the face of the Brazilian COVID-19 epidemic: from academic (un)certainties to social commitment]. APS Rev. 2020 Feb;2(1):56–60. doi: 10.14295/aps.v2i1.69. Portuguese.. However, it is necessary that the distance learning discipline has some criteria to be attended, such as organization, planning, technological availability to meet the needs of the students, demands and training of teachers. Furthermore, the need to maintain healthy students, teachers and staff with the presence of individual protection equipment, knowledge about the disease and adequacy of work spaces and routines in a context of theoretical and practical activities is highlighted2323. Peres KG, Reher P, de Castro RD, Vieira AR. Covid-19-related challenges in dental education: Experiences from Brazil, the USA, and Australia. Pesq Bras Odontopediatria Clin Integr. 2020 Aug;20:e0131. doi: 10.1590/pboci.2020.130.. Public policies aimed at Democratizing Higher Distance Education should not only take into account the increase in the number of courses and vacancies, but also variables that impact the access, permanence and conclusion of the course of these students, such as individual characteristics and regional inequalities in the country3535. Guarnieri FV, Melo-Silva LL. University quotas in Brazil: analysis of a decade of scientific production. Psicol Esc Educ. 2017 Aug;21(2):183-93. Portuguese. doi: 10.1590/2175-3539201702121100.. Providing classes without these adjustments puts the teaching proposal in a safe and correct way at risk in the current pandemic scenario of COVID-19.

In this study, we concluded that Brazilian dental students reported a high impact of COVID-19 on their dental education, and one sixth of the students reported not having adequate resources to continue with distance learning. In addition, self-declared non-white students reported more than whites not having a laptop or computer, which is an important obstacle in being able to follow class activities. The social inequalities that already exist among students are accentuated in a pandemic moment, and thus it is important that different policies are developed at institutional and governmental levels to reduce the impact of the pandemic on dental education, providing assistance to students to guarantee internet access and availability of electronic devices.

Acknowledgment

The authors gratefully acknowledge all Brazilian undergraduate dental students who participated in this study and professors and other collaborators who helped disseminate the research on their social networks and institutions. This study was partly supported by CAPES/Brazil (Coordenação de Aperfeiçoamento de Pessoal de Nível Superior/Brasil) – Finance code 001.

References

  • 1
    Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A Novel Coronavirus from Patients with Pneumonia in China, 2019. N Engl J Med. 2020 Feb;382(8):727-33. doi: 10.1056/NEJMoa2001017.
  • 2
    Pan American Health Organization. WHO characterizes COVID-19 as a pandemic. Pan American Health Organization. 2020 Mar 11 [cited 2021 Jul 19]. Available from: https://www.paho.org/en/news/11-3-2020-who-characterizes-covid-19-pandemic
    » https://www.paho.org/en/news/11-3-2020-who-characterizes-covid-19-pandemic
  • 3
    World Health Organization (WHO). COVID-19 Dashboard. COVID-19. 2021 [cited 2021 Jul 19]. Available from: https://covid19.who.int/region/amro/country/br
    » https://covid19.who.int/region/amro/country/br
  • 4
    Peng X, Xu X, Li Y, Cheng L, Zhou X, Ren B. Transmission routes of 2019-nCoV and controls in dental practice. Int J Oral Sci. 2020 Mar;12(1):9. doi: 10.1038/s41368-020-0075-9.
  • 5
    Sabino-Silva R, Jardim ACG, Siqueira WL. Coronavirus COVID-19 impacts to dentistry and potential salivary diagnosis. Clin Oral Investig. 2020 Apr;24(4):1619-21. doi: 10.1007/s00784-020-03248-x.
  • 6
    Chu DK, Akl EA, Duda S, Solo K, Yaacoub S, Schünemann HJ, et al. Physical distancing, face masks, and eye protection to prevent person-to-person transmission of SARS-CoV-2 and COVID-19: a systematic review and meta-analysis. Lancet. 2020 Jun;395(10242):1973-87. doi: 10.1016/S0140-6736(20)31142-9.
    » https://doi.org/10.1016/S0140-6736(20)31142-9
  • 7
    The New York Times. The Workers Who Face the Greatest Coronavirus Risk. The New York Times. 2020. [cited 2021 Jul 30]. Available from: https://www.nytimes.com/interactive/2020/03/15/business/economy/coronavirus-worker-risk.html
    » https://www.nytimes.com/interactive/2020/03/15/business/economy/coronavirus-worker-risk.html
  • 8
    Meng L, Hua F, Bian Z. Coronavirus Disease 2019 (COVID-19): Emerging and Future Challenges for Dental and Oral Medicine. J Dent Res. 2020 May;99(5):481-7. doi: 10.1177/0022034520914246.
  • 9
    Federal Council of Dentistry. [Professionals and entities registered in 2020]. Brasília: FCD; 2020. Portuguese.
  • 10
    Moraes RR, Correa MB, Queiroz AB, Daneris Â, Lopes JP, Pereira-Cenci T, et al. COVID-19 challenges to dentistry in the new pandemic epicenter: Brazil. PLoS One. 2020 Nov;15(11):e0242251. doi: 10.1371/journal.pone.0242251.
  • 11
    Caldarelli PG, Gabardo MCL. [Health training in the context of the COVID-19 pandemic: challenges and perspectives]. REFACS. 2021;1(Suppl. 1):188-9. Portuguese.
  • 12
    Iyer P, Aziz K, Ojcius DM. Impact of COVID-19 on dental education in the United States. J Dent Educ. 2020 Jun;84(6):718-22. doi: 10.1002/jdd.12163.
  • 13
    de Oliveira SS, Postal EA, Afonso DH. [Medical Schools and the challenges of medical training in the face of the Brazilian COVID-19 epidemic: from academic (un)certainties to social commitment]. APS Rev. 2020 Feb;2(1):56–60. doi: 10.14295/aps.v2i1.69. Portuguese.
  • 14
    Xavier TB, Barbosa GM, Meira CLS, Neto NC, Pontes HAR. [Use of Dentistry Education Web Resources during Pandemic COVID-19]. Braz J Health Rev. 2020 May;3(3):4989–5000. Portuguese. doi: 10.34119/bjhrv3n3-081.
  • 15
    Grimshaw J. SURGE (The SUrvey Reporting GuidelinE). In: Moher D, Altman DG, Schulz KF, Simera I, Wager E, editors. Guidelines for Reporting Health Research: A User’s Manual. Ottawa, Canada: John Wiley & Sons; 2014. p.206-13. doi: 10.1002/9781118715598.ch20.
    » https://doi.org/10.1002/9781118715598.ch20
  • 16
    von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Clin Epidemiol. 2008 Apr;61(4):344-9. doi: 10.1016/j.jclinepi.2007.11.008.
  • 17
    Fernandez M dos S, Vieira IS, Silva NRJ da, Cardoso T de A, Bielavski CH, Rakovski C, et al. Anxiety symptoms and alcohol abuse during the COVID-19 pandemic: A cross-sectional study with Brazilian dental undergraduate students. J Dent Educ. 2021 Nov;85(11):1739-48. doi: 10.1002/jdd.12742.
  • 18
    Brazilian Institute of Geography and Statistics. Regional Divisions of Brazil; 2017 [cited 2021 Jun 4]. Available from: https://www.ibge.gov.br/en/geosciences/territorial-organization/regional-division/21536-regional-divisions-of-brazil.html?=&t=o-que-e
    » https://www.ibge.gov.br/en/geosciences/territorial-organization/regional-division/21536-regional-divisions-of-brazil.html?=&t=o-que-e
  • 19
    Hillenburg KL, Cederberg RA, Gray SA, Hurst CL, Johnson GK, Potter BJ. E-learning and the future of dental education: opinions of administrators and information technology specialists. Eur J Dent Educ. 2006 Aug;10(3):169-77. doi: 10.1111/j.1600-0579.2006.00413.x.
  • 20
    Amir LR, Tanti I, Maharani DA, Wimardhani YS, Julia V, Sulijaya B, et al. Student perspective of classroom and distance learning during COVID-19 pandemic in the undergraduate dental study program Universitas Indonesia. BMC Med Educ. 2020 Oct;20(1):392. doi: 10.1186/s12909-020-02312-0.
  • 21
    Jum’ah AA, Elsalem L, Loch C, Schwass D, Brunton PA. Perception of health and educational risks amongst dental students and educators in the era of COVID-19. Eur J Dent Educ. 2021 Aug;25(3):506-15. doi: 10.1111/eje.12626.
  • 22
    Loch C, Kuan IBJ, Elsalem L, Schwass D, Brunton PA, Jum’ah A. COVID-19 and dental clinical practice: Students and clinical staff perceptions of health risks and educational impact. J Dent Educ. 2021 Jan;85(1):44-52. doi: 10.1002/jdd.12402.
  • 23
    Peres KG, Reher P, de Castro RD, Vieira AR. Covid-19-related challenges in dental education: Experiences from Brazil, the USA, and Australia. Pesq Bras Odontopediatria Clin Integr. 2020 Aug;20:e0131. doi: 10.1590/pboci.2020.130.
  • 24
    Machado RA, Bonan PRF, da Cruz Perez DE, Martelli Júnior H. COVID-19 pandemic and the impact on dental education: Discussing current and future perspectives. Braz Oral Res. 2020 Jun;34:e083. doi: 10.1590/1807-3107bor-2020.vol34.0083.
  • 25
    Agius AM, Gatt G, Vento Zahra E, Busuttil A, Gainza-Cirauqui ML, Cortes ARG, et al. Self-reported dental student stressors and experiences during the COVID-19 pandemic. J Dent Educ. 2021 Feb;85(2):208-15. doi: 10.1002/jdd.12409.
  • 26
    Silva PG de B, de Oliveira CAL, Borges MMF, Moreira DM, Alencar PNB, Avelar RL, et al. Distance learning during social seclusion by COVID-19: Improving the quality of life of undergraduate dentistry students. Eur J Dent Educ. 2021 Feb;25(1):124-34. doi: 10.1111/eje.12583.
  • 27
    Akinkugbe AA, Garcia DT, Smith CS, Brickhouse TH, Mosavel M. A descriptive pilot study of the immediate impacts of COVID-19 on dental and dental hygiene students’ readiness and wellness. J Dent Educ. 2021 Mar;85(3):401-10. doi: 10.1002/jdd.12456.
  • 28
    Shadmi E, Chen Y, Dourado I, Faran-Perach I, Furler J, Hangoma P, et al. Health equity and COVID-19: Global perspectives. Int J Equity Health. 2020 Jun;19(1):104. doi: 10.1186/s12939-020-01218-z.
  • 29
    Brazilian Institute of Geography and Statistics. [National Continuous Household Sample Survey 2017-2018]. 2020. Available from: https://biblioteca.ibge.gov.br/visualizacao/livros/liv101705_informativo.pdf Portuguese.
    » https://biblioteca.ibge.gov.br/visualizacao/livros/liv101705_informativo.pdf
  • 30
    United Nations Development Programme. Institute of Applied Economic Research. João Pinheiro Foundation, editors. [Human development in Brazilian macro-regions]. 2016 [cited 2021 Jun 4]. Available from: http://repositorio.ipea.gov.br/bitstream/11058/6217/1/Desenvolvimento%20humano%20nas%20macrorregi%c3%b5es%20brasileiras.pdf Portuguese.
    » http://repositorio.ipea.gov.br/bitstream/11058/6217/1/Desenvolvimento%20humano%20nas%20macrorregi%c3%b5es%20brasileiras.pdf
  • 31
    Ferreira SC. [Apartheid digital in times of remote education:reinvention of brazilian racism]. Interfaces Cient. 2020 Sep;10(1):11-24. Portuguese. doi: 10.17564/2316-3828.2020v10n1p11-24.
    » https://doi.org/10.17564/2316-3828.2020v10n1p11-24
  • 32
    Bailey ZD, Krieger N, Agénor M, Graves J, Linos N, Bassett MT. Structural racism and health inequities in the USA: evidence and interventions. Lancet. 2017 Apr;389(10077):1453-63. doi: 10.1016/S0140-6736(17)30569-X.
  • 33
    Reskin B. The race discrimination system. Ann Rev Sociol. 2012 Aug;38:17-35. doi: 10.1146/annurev-soc-071811-145508.
  • 34
    Tragtenberg MHR, Bastos JLD, Moura LH, Peres MA. [How to increase the rate of black students at university?] Cad Pesq. 2006;36(128):473-95. Portuguese. doi: 10.1590/S0100-15742006000200010.
  • 35
    Guarnieri FV, Melo-Silva LL. University quotas in Brazil: analysis of a decade of scientific production. Psicol Esc Educ. 2017 Aug;21(2):183-93. Portuguese. doi: 10.1590/2175-3539201702121100.
  • 36
    Sorj B, Guedes LE. [Digital divide: conceptual issues, empirical evidence and public policy]. Novos Est CEBRAP. 2005;(72):101-17. Portuguese. doi: 10.1590/S0101-33002005000200006.
  • Data availability
    Datasets related to this article will be available upon request to the corresponding author.

Publication Dates

  • Publication in this collection
    16 Jan 2023
  • Date of issue
    2023

History

  • Received
    11 Apr 2021
  • Accepted
    12 Feb 2022
Faculdade de Odontologia de Piracicaba - UNICAMP Avenida Limeira, 901, cep: 13414-903, Piracicaba - São Paulo / Brasil, Tel: +55 (19) 2106-5200 - Piracicaba - SP - Brazil
E-mail: brjorals@unicamp.br