Acessibilidade / Reportar erro

Distance education in dentistry in Brazil: a critical STROBE-based analysis

Abstract

The COVID-19 pandemic has forced dentistry schools (DSs) to adapt their teaching techniques to digital platforms. Therefore, we aimed to evaluate distance classes in the Brazilian DS curriculum. After an online search of higher education institutions (HEIs) with DS on the e-Ministry of Education (MEC) platform, we included institutions with at least one graduated class to extract the age/localization of the DS, funding, number of authorized seats, MEC-grade, ENADE-score, and workload. HEIs’ webpages were consulted to identify the curriculum, subjects offered in the distance education (DE) format, extracurricular programs, scientific events, postgraduate programs, and institutional YouTube channels. Chi-square/Fisher’s tests plus binary logistic regression were performed (SPSS 20.0, p < 0.05). Of the 241 DSs evaluated, 82 (34.0%) offered distance classes, and a high prevalence was observed in the southeast region (p <0.001) and private HEIs (p = 0.001). HEIs with distance classes had lower ENADE scores (p = 0.004), lower workload (p = 0.007), and higher workload for optional subjects (p = 0.016), doctoral programs (p = 0.041), specialization courses (p = 0.017), and institutional YouTube channels (p < 0.001). Southern dental schools (p < 0.001), lower workload (p = 0.022), optional subjects (p = 0.033), and institutional YouTube channels (p = 0.005) were independently associated with distance classes. In one-third of the Brazilian DSs, distance classes and institutional YouTube channels were strongly associated variables. The association of distance learning with lower workload and low academic performance draws attention to the need for regulatory bodies for controlling the quality of DE.

Schools; Dentistry; Education; Brazil

Introduction

Between March and April 2020, several Brazilian states started to adopt quarantine measures, and face-to-face classes were suspended because of the pandemic caused by the 2019 novel coronavirus (SARS-CoV-2), responsible for the coronavirus disease 2019 (COVID-19).11. Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A novel coronavirus from patients with pneumonia in China, 2019. N Engl J Med. 2020 Feb;382(8):727-,22. Omary MB, Eswaraka J, Kimball SD, Moghe PV, Panettieri RA Jr, Scotto KW. The COVID-19 pandemic and research shutdown: staying safe and productive. J Clin Invest. 2020 Jun;130(6):2745-8. https://doi.org/10.1172/JCI138646
https://doi.org/10.1172/JCI138646...
Therefore, the restrictions imposed on face-to-face classes prompted numerous higher education institutions (HEIs), supported by online technologies, to reinvent and virtualize theoretical content. No higher education teachers working exclusively with in-class teaching were prepared for such an abrupt change in work style, and several teachers had difficulties adapting to the virtualization of theoretical content.33. Fleming J, Becker K, Newton C. Factors for successful e-learning: does age matter? Educ Train. 2017 Jun;59(1):76-89. https://doi.org/10.1108/ET-07-2015-0057
https://doi.org/10.1108/ET-07-2015-0057...
However, it is not known when face-to-face classes will fully resume, with projections suggesting that conventional classroom activities might dramatically increase the number of new cases of coronavirus infections in schools.44. Koo JR, Cook AR, Park M, Sun Y, Sun H, Lim JT, et al. Interventions to mitigate early spread of SARS-CoV-2 in Singapore: a modelling study. Lancet Infect Dis. 2020 Jun;20(6):678-88. https://doi.org/10.1016/S1473-3099(20)30162-6
https://doi.org/10.1016/S1473-3099(20)30...
Thus, it appears that higher education in dentistry will be forced to adapt its teaching methods to the process of distance education (DE) until there is complete resumption of all commercial activities.55. Ministério da Educação (BR). Portaria N° 343, de 17 de março de 2020. Dispõe sobre a substituição das aulas presenciais por aulas em meios digitais enquanto duras a situação de pandemia - COVID-19. Diário Oficial União. 2020 Mar 18.,66. Ministério da Educação (BR). Portaria N° 544, de 16 de junho de 2020. Dispõe sobre a substituição das aulas presenciais por aulas em meios digitais, enquanto durar a situação de pandemia do novo coronavírus - Covid-19. Diário Oficial União. 2020 Jun 17.

Some HEIs have already offered DE in dentistry based on the premise that new technologies are indispensable for facing challenges concerning new pedagogical concepts and teaching methodologies.77. Franco LL, Soares EF, Martorell LB, Marcelo VC. The teacher of the dentistry course: his education and the challenges. Rev Prof Docente. 2009;9(20):57-74. https://doi.org/10.31496/rpd.v9i20.235
https://doi.org/10.31496/rpd.v9i20.235...
In Europe, e-learning systems have been already in use for some time in dental schools.88. Nattestad A, Attstrom R, Mattheos N, Ramseier C, Canegallo L, Eaton K, et al. 4.1 Web-based interactive learning programmes. Eur J Dent Educ. 2002;6(3 Suppl 3):127-37. https://doi.org/10.1034/j.1600-0579.6.s3.17.x
https://doi.org/10.1034/j.1600-0579.6.s3...
In Brazil, some areas such as oral radiology have already been implementing distance learning methodologies without any significant differences compared with the standard face-to-face method.99. Cruz AD, Costa JJ, Almeida SM. Distance learning in dental radiology: immediate impact of the implementation. 2014 Oct-Dec;17(4):90-7. https://doi.org/10.14295/bds.2014.v17i4.930
https://doi.org/10.14295/bds.2014.v17i4....

For students and teachers, e-learning is a promising way to save time as it cuts down the travel time for school. Similarly, students can work on their courses according to their own schedules. However, some students have problems in comprehending course information that is technical, quantitative, or scientifically oriented. Moreover, course expectations are often unclear, and because of the physical separation between the teacher and student, such problems might be difficult to resolve.1010. Hannay M, Newvine M. Perceptions of distance learning: a comparison of online and traditional learning. J Online Learn Teach. 2006;2(1):1-11.Although the objective of many DE initiatives might increase the learning opportunities for geographically distant learners, teachers have reported that the use of technology may lead to feelings of isolation and alienation.1111. Dickey MD. The impact of web-logs (blogs) on student perceptions of isolation and alienation in a web-based distance-learning environment. Open Learn. 2004;19(3):279-91. https://doi.org/10.1080/0268051042000280138
https://doi.org/10.1080/0268051042000280...

Nevertheless, classic departmental bureaucracy regarding curricular innovations1212. Hendricson WD, Cohen PA. Future directions in dental school curriculum, teaching, and learning. In: Tedesco L, Haden K. Leadership for the future: the dental school in the university. Washington, DC: American Association of Dental Schools; 1999. p. 37-62. has added to inequities in computer and internet access in Brazil.1313. Wainer J, Vieira P, Melguizo T. The association between having access to computers and Internet and educational achievement for primary students in Brazil. Comp Educ. 2015 Jan;80:68-76. https://doi.org/10.1016/j.compedu.2014.08.007
https://doi.org/10.1016/j.compedu.2014.0...
This further hinders the implementation of new teaching technologies and e-learning systems in dentistry, especially since the acceptance of e-learning depends heavily on the quality of the technology involved.1414. Koohang A, Durante A. Learners’ perceptions toward the web-based distance learning activities/assignments portion of an undergraduate hybrid instructional model. J Inf Technol Educ. 2003;2(1):105-13. https://doi.org/10.28945/316
https://doi.org/10.28945/316...
Considering that our slow journey toward e-learning in dentistry was drastically accelerated by the COVID-19 pandemic, it raises the following question: is Brazil prepared for this new teaching-learning model?

Identifying the pioneers of e-learning in dentistry is indispensable for recognizing the limitations of these systems. Thus, documented studies are important in providing ways to correctly implement DE with pedagogical responsibility. We hypothesize that there are important indicators that improve or worsen the quality of education in e-learning. Since the COVID-19 pandemic has increased the use of e-learning without any advanced planning in dentistry schools (DS), the aim of this study was to identify indicators of DE in the core curriculum of dentistry courses before the COVID-19 pandemic in Brazil and their association with predictive factors and quality indicators.

Methodology

Type of study and inclusion and exclusion criteria

This was a cross-sectional study using a secondary data source (documentary) based on the STROBE checklist for cross-sectional studies (Supplementary File 01).1515. Malta M, Cardoso LO, Bastos FI, Magnanini MM, Silva CM. STROBE initiative: guidelines on reporting observational studies. Rev Saude Publica. 2010 Jun;44(3):559-65. https://doi.org/10.1590/S0034-89102010000300021
https://doi.org/10.1590/S0034-8910201000...
Publicly available data from regulated dentistry courses in Brazil were analyzed, and despite these data not directly involving humans or their information, all national and international ethical precepts were followed, including what establishes Resolution 466/2012 and 510/2016 of the National Health Council.

This study included all HEIs accredited by the Ministry of Education (MEC) of Brazil with undergraduate dentistry courses in activity in 2020. The exclusion criteria were as follows: HEIs with no graduated students (curriculum consolidation), HEIs with unavailable curricular information on their website, and HEIs in which the dentistry course was in the cancellation process.

Data search

Initially, the online platform of the MEC (e-MEC; https://emec.mec.gov.br) was consulted using the advanced search tool to gather official information on undergraduate dentistry courses in each federal state. The following information was collected: institution name and acronym, funding (public or private), start date of the dentistry course, authorized number of seats, operating status, National Exam of Student Performance (ENADE) score, and the course grading given by the MEC. The host state, total workload, and status of the dentistry course were also determined. All data were collected on May 16, 2020, and all evaluated e-MEC data were used in this study.

Data related to the curriculum were consolidated in a four-step approach to select items.1616. Johnston JM, Leung GM, Fielding R, Tin KY, Ho LM. The development and validation of a knowledge, attitude and behaviour questionnaire to assess undergraduate evidence-based practice teaching and learning. Med Educ. 2003 Nov;37(11):992-1000. https://doi.org/10.1046/j.1365-2923.2003.01678.x
https://doi.org/10.1046/j.1365-2923.2003...
First, a thematic review of questionnaires evaluating the study profile in e-learning was accessed to understand the important items required to investigate it.1010. Hannay M, Newvine M. Perceptions of distance learning: a comparison of online and traditional learning. J Online Learn Teach. 2006;2(1):1-11.,1111. Dickey MD. The impact of web-logs (blogs) on student perceptions of isolation and alienation in a web-based distance-learning environment. Open Learn. 2004;19(3):279-91. https://doi.org/10.1080/0268051042000280138
https://doi.org/10.1080/0268051042000280...
,1717. Yu S, Yang KF. Attitudes toward Web-based distance learning among public health nurses in Taiwan: a questionnaire survey. Int J Nurs Stud. 2006 Aug;43(6):767-74. https://doi.org/10.1016/j.ijnurstu.2005.09.005
https://doi.org/10.1016/j.ijnurstu.2005....
,1818. Andrews KG, Demps EL. Distance education in the U.S. and Canadian undergraduate dental curriculum. J Dent Educ. 2003 Apr;67(4):427-38. https://doi.org/10.1002/j.0022-0337.2003.67.4.tb03644.x
https://doi.org/10.1002/j.0022-0337.2003...
Second, a teaching expert designed a structured questionnaire based on the information previously described. Third, the items were evaluated by three specialists: a doctor in health education, a doctor in teaching, and a doctor in biostatistics. Fourth, minor item disposition corrections (objectification of responses) were made based on the suggestions of the three specialists, and the questionnaires were launched. This process was conducted over 4 days (one process per day) to minimize fatigue bias, and the meetings were conducted via videoconference due to the COVID-19 pandemic.

The website of each HEI was searched using the full name of the institution on Google Search. The page referring to the dentistry course of each HEI was then searched for the core curriculum, number of subjects, workload, presence of optional subjects, type of curriculum (subject-oriented, modular, and mixed), and the presence of subjects offered in a DE format. Extracurricular services and programs (tutoring, extension, scientific initiation, scientific events, and scientific meetings organized by students) as well as specialization and postgraduate programs were verified on the websites.

The online video-sharing platform YouTube was consulted to verify the presence of teaching channels for each institution by typing the name of each HEI in the search bar. When there was no information on the institution’s website about what the research aimed to evaluate, we contacted the institutional e-mail for clarification. All searches were conducted between May 20, 2020 and June 2, 2020.

Training and calibrating the examiners

Previously, two examiners were trained and calibrated by a gold standard researcher (18 years of PhD in dentistry) to analyze the type of curriculum, extracurricular services and programs, and specialization and postgraduate programs on the websites. First, theoretical training was provided to differentiate between subject-oriented, modular, and mixed-type curricula as well as stricto sensu and lato sensu courses; and to identify extracurricular services and programs (search for official notices).

Second, 10% of the total sample (n = 55/551) was randomly selected (“= random()” command in Microsoft Excel, Microsoft Corporation®) from the non-included HEIs, and websites were shown by the gold standard researcher only once to the two examiners. The two examiners evaluated the curriculum individually, and data from the analyses were tabulated in Microsoft Excel. The kappa value was calculated by the gold standard researcher (kappa = 0.892).

Therefore, the search was performed independently by the two examiners, and when no consensus was reached on the interpretation of data available on the HEI, the gold standard researcher gave a final interpretation.

Statistical analysis

Data were tabulated in a standard Microsoft Excel spreadsheet and exported to the Statistical Package for the Social Sciences (SPSS, version 20.0, for Windows) software, in which the analyses were performed with a 95% confidence level.

Continuous variables (total workload, workload of optional subjects, years of activity, and seats offered) were categorized by medians. The other independent variables (region, HEI funding, ENADE score, MEC grade, accreditation request for DE, curriculum type, optional subjects, master’s degree programs, doctoral programs, specialization courses, tutoring programs, extension programs, scientific initiation programs, scientific events, scientific meetings organized by students, and institutional YouTube channels) were expressed as absolute and percentage frequencies and crosschecked against the availability of distance classes (dependent variable) using Fisher’s exact test and Pearson’s chi-squared test.

Binary logistic regression (multivariate analysis) with the presence of e-learning was applied using all variables to reduce confounding bias. Adjusted odds ratios (95% confidence intervals) were plotted.

Results

Characterization of HEIs with dentistry courses in Brazil

A total of 551 HEI records with dentistry courses were found on the MEC website. Of these institutions, 241 were included in the study. HEIs were excluded for the following reasons: not having fully started the dentistry course (n = 70), being in the curriculum consolidation phase (n = 233), not providing enough information on their website (n = 3), and being in the cancellation process (n = 4) (Figure).

Figure 1
Distribution of dental schools in Brazil included and excluded of survey.

Most of the included HEIs were from the southeast region (n = 101, 41.9%), followed by the northeast (n = 50, 20.7%) and southern (n = 46, 19.1%) regions. The macro-regions with fewer dentistry courses were the north (n = 23, 9.5%) and central-west (n = 21, 8.7%) regions. The state of São Paulo had the largest number of dentistry courses (n = 53, 22.0%) (Table 1).

Table 1
Macroregional distribution of regulated dentistry courses in Brazil.

On average, the courses have been in activity for 29.7 ± 26.0 years, with a median of 20 (5–120) years and offer an average of 140 ± 151 seats (median = 100; 20–2,050). The average total workload of these courses was 4,374 ± 400 h, with a median of 4253 (3454–5800) h. The workload of optional subjects was 60 ± 31 h, with a median of 55 (11–258) h.

Dentistry courses with distance classes are significantly concentrated in the southeast region of Brazil

A total of 82 (34.0%) HEIs had dentistry courses offering DE. As previously mentioned, most dentistry courses in the country were located in the southeastern region of Brazil, with a significantly higher number of courses having DE compared with the other regions (p < 0.001). The prevalence of private DSs with DE was 4.37 (95% CI = 1.77–10.80) times higher (p = 0.001) than that of public dental schools (p = 0.001) (Table 2).

Table 2
Profile of regulated dentistry courses with and without distance classes in Brazil.

Most dentistry courses were from privately funded HEIs (n = 192, 80.7%). More than half of the courses were active for 20 years or longer (n = 118, 50.2%) and offered more than 100 seats (n = 145, 60.9%) for dental students. The years of activity (p = 0.111) and the number of seats offered (p = 0.258) were not associated with the availability of DE (Table 2).

Regarding quality indicators, most HEIs received a course grade of 4 by the MEC (n = 119, 57.8%) and a score of 3 by ENADE (n = 77, 38.5%). There was no association between the availability of DE and MEC course grade (p = 0.052), but HEIs offering DE had a higher prevalence of low ENADE scores (p = 0.004) than HEIs that did not offer DE (Table 2).

Curricular flexibility, presence of postgraduate programs, and institutional YouTube channels are indicators of dentistry courses with distance classes

Only two HEIs presented accreditation requests for implementing fully distance courses and both had already offered DE (p = 0.070). The workload of most dentistry courses was ≤4,200 h, and the workload was inversely associated with the presence of DE (p = 0.007). Workload of optional subjects greater than 55 h was observed in most dentistry courses (n = 110, 51.6%), which was directly associated with the offering of DE (p = 0.016) (Table 3).

Table 3
Didactic-pedagogical profile of regulated dentistry courses with and without distance classes in Brazil.

Most institutions had a subject-oriented curriculum (n = 124, 58.2%). Optional subjects were offered by most HEIs (n = 196, 95.2%), although most HEIs offered specialization courses (n = 162, 68.1%); 111 (46.6%) offered master’s degree programs, and only 82 (34.0%) had doctoral programs. The offering of DE was significantly higher in HEIs with doctoral (p = 0.041) and specialization programs (p = 0.017) (Table 3).

Tutoring (n = 211, 89.4%), extension (n = 216, 91.5%), scientific initiation (n = 89.4%), scientific events (n = 148, 62.2%), scientific meetings organized by students (n = 197, 82.8%), and institutional YouTube channels (n = 158, 66.4%) were observed on the web pages of most dentistry courses included in this study. Only the presence of institutional YouTube channels was significantly associated with DE (p <0.001) (Table 4).

Table 4
Profile of the extracurricular activities and programs and presence of Youtube channels in regulated dentistry courses with and without distance classes in Brazil.

Multivariate analysis: YouTube institutional channels and flattening of workload are the main indicators of distance classes in HEIs with dentistry courses

The unadjusted ORs from significant independent variables are shown in Table 5. The binary regression model (multivariate analysis) showed that DSs in the southeast region (p < 0.001) were most strongly associated with e-learning, showing a prevalence of 20.68 (95% CI = 6.23–68.65) times higher DE availability. Lower workloads (≤4,200 h) were 3.32 (95% CI = 1.19–9.31) times more prevalent when DE was available (p = 0.022), and offering of optional subjects increased this prevalence by 6.66 (95% CI = 1.17–37.97) times (p = 0.033). The presence of YouTube channels was also directly associated with DE with an adjusted odds ratio of 6.37 (95% CI = 1.76–22.97) times (p = 0.005). These variables were independently associated with the presence of distance classes in dentistry courses.

Table 5
Multivariate analysis of factors associated with increased prevalence of dentistry courses in Brazil offering distance classes.

Discussion

This study showed that most dentistry courses with DE in Brazil are concentrated in the southern macro-regions and private schools, have institutional YouTube channels, and are inversely associated with total workload and ENADE scores. Currently, the National Curricular Guidelines (NCD) implemented for undergraduate courses in dentistry since 2002 are responsible for reorganizing and reformulating the pedagogical projects of HEIs in Brazil and do not permit the establishment of dentistry courses in a fully DE format, as a major part of the workload of dentistry courses is devoted to face-to-face activities.1919. Fonseca EP. [The National Curriculum Guidelines and training of brazilian dentists]. J Manag Prim Health Care. 2012 Oct;3(2):158-78. Portuguese. https://doi.org/10.14295/jmphc.v3i2.154
https://doi.org/10.14295/jmphc.v3i2.154...
However, in December 6, 2019, through ordinance No. 2117, the MEC authorized universities to offer up to 40% of the workload through distance learning in undergraduate courses in the health field, including dentistry.2020. Ministério da Educação (BR). Portaria N° 2.117, de 6 de dezembro de 2019. Dispõe sobre a oferta de carga horária na modalidade de Ensino a Distância - EaD em cursos de graduação presenciais ofertados por Instituições de Educação Superior - IES pertencentes ao Sistema Federal de Ensino. Diário Oficial União. 2019 Dec 7.

Face-to-face learning remains invaluable for the integration of theory and clinical practice.2121. Lamers JMS, Baumgarten A, Bittencourt FV, Toassi RF. Mudanças curriculares na educação superior em Odontologia: inovações, resistências e avanços conquistados. Rev ABENO. Dez. 2016;16(4):2-18. https://doi.org/10.30979/rev.abeno.v16i4.324
https://doi.org/10.30979/rev.abeno.v16i4...
However, given the impossibility of maintaining in-class teaching, dentistry courses in Brazil were forced to virtualize theoretical classes to enable the continuity of teaching activities.55. Ministério da Educação (BR). Portaria N° 343, de 17 de março de 2020. Dispõe sobre a substituição das aulas presenciais por aulas em meios digitais enquanto duras a situação de pandemia - COVID-19. Diário Oficial União. 2020 Mar 18.,66. Ministério da Educação (BR). Portaria N° 544, de 16 de junho de 2020. Dispõe sobre a substituição das aulas presenciais por aulas em meios digitais, enquanto durar a situação de pandemia do novo coronavírus - Covid-19. Diário Oficial União. 2020 Jun 17. This scenario of teaching dentistry through digital platforms draws attention to a particular issue: would it be possible to adapt a part of the core curriculum of DS to a permanent DE format?77. Franco LL, Soares EF, Martorell LB, Marcelo VC. The teacher of the dentistry course: his education and the challenges. Rev Prof Docente. 2009;9(20):57-74. https://doi.org/10.31496/rpd.v9i20.235
https://doi.org/10.31496/rpd.v9i20.235...

E-learning systems have been used for some time in dental schools in Europe88. Nattestad A, Attstrom R, Mattheos N, Ramseier C, Canegallo L, Eaton K, et al. 4.1 Web-based interactive learning programmes. Eur J Dent Educ. 2002;6(3 Suppl 3):127-37. https://doi.org/10.1034/j.1600-0579.6.s3.17.x
https://doi.org/10.1034/j.1600-0579.6.s3...
and in developing countries such as South Africa, where the digitization of higher education has been increasing in recent years despite difficulties with Internet access.2222. Ravjee N. The politics of e-learning in South African higher education. Int J Educ Dev Using Inf Commun Technol. 2007 Aug;3(4):27-41.Several e-learning models have been developed worldwide;2323. Ruggeri K, Farrington C, Brayne C. A global model for effective use and evaluation of e-learning in health. Telemed J E Health. 2013 Apr;19(4):312-21. https://doi.org/10.1089/tmj.2012.0175
https://doi.org/10.1089/tmj.2012.0175...
therefore, there is an urgent need to develop skills and competencies to adapt to distance learning in dentistry.

As previously described, most dentistry courses in the country are in the southeast region.2424. Martin AS, Chisini LA, Martelli S, Sartori LR, Ramos EC, Demarco FF. Distribution of Dental Schools and dentists in Brazil: an overview of the labor Market. Rev ABENO. 2018 Jul;18(1):63-73. https://doi.org/10.30979/rev.abeno.v18i1.399
https://doi.org/10.30979/rev.abeno.v18i1...
This region also encompasses most dentistry courses offering DE, which was expected, as it is described as the most advanced in the process of DE in HEIs.2525. Silva AR, Nunes CS, Spanhol FJ, Santos JV, Rabelo S. [Models used for distance education: an overview focused on higher education institutions of Brazil]. Rev GUAL. 2011 Sep/Dec;4(3):153-69. Portuguese. https://doi.org/10.5007/1983-4535.2011v4n3p153
https://doi.org/10.5007/1983-4535.2011v4...
It is the wealthiest region in the country and enables the private sector in higher education to increase investments in virtual platforms, thus offering a greater number of DE programs.

However, students in the DE program exhibited lower ENADE scores. The effectiveness of DE for undergraduate dentistry courses is still debatable, and it is necessary to pay attention to this result.2626. Sales LN, Nascimento LS, Brandão GA, Magalhães AC, Pontes FS. [Distance education and use of information technology for an education in dentistry: the student’s perception]. Rev ABENO. 2012 Dec;12(2):227-32. Portuguese. https://doi.org/10.30979/rev.abeno.v12i2.128
https://doi.org/10.30979/rev.abeno.v12i2...
The private education network is strongly associated with capital production, which may lead to investments in less costly and underperforming platforms,1919. Fonseca EP. [The National Curriculum Guidelines and training of brazilian dentists]. J Manag Prim Health Care. 2012 Oct;3(2):158-78. Portuguese. https://doi.org/10.14295/jmphc.v3i2.154
https://doi.org/10.14295/jmphc.v3i2.154...
thus directly impacting the quality of the teaching-learning process.2727. Woelber JP, Hilbert TS, Ratka-Krüger P. Can easy-to-use software deliver effective e-learning in dental education? A randomised controlled study. Eur J Dent Educ. 2012 Aug;16(3):187-92. https://doi.org/10.1111/j.1600-0579.2012.00741.x
https://doi.org/10.1111/j.1600-0579.2012...

DE still receives much criticism regarding its quality and credibility. This requires the establishment of protocols to guide publications that would avoid inconsistencies in the quality of the content offered by these platforms. Protocols such as the Guidelines for Medical and Health Information on the Internet and the Health on the Net Foundation serve as guidelines for the quality of healthcare content on the Internet. In the United Kingdom, similar initiatives are promoted by the British Medical Journal in partnership with the British Medical Association.2828. Christante L, Ramos MP, Bessa R, Sigulem D. [The role of distance education in continuing medical education: a critical review]. Rev Assoc Med Bras. 2003 Jul-Sep;49(3):326-9. Portuguese. https://doi.org/10.1590/S0104-42302003000300039
https://doi.org/10.1590/S0104-4230200300...
Therefore, mechanisms to control the quality of this teaching model in Brazil are also necessary.

Despite these limitations, DE is a process that has been shown to improve the quality of courses in the health field. Recently, Brazil participated in a large multicenter trial that evaluated the integration of an e-learning system in health care, which demonstrated superior results for groups who adopted e-learning over those who continued to implement traditional teaching methods.2929. Kulier R, Gülmezoglu AM, Zamora J, Plana MN, Carroli G, Cecatti JG, et al. Effectiveness of a clinically integrated e-learning course in evidence-based medicine for reproductive health training: a randomized trial. JAMA. 2012 Dec;308(21):2218-25. https://doi.org/10.1001/jama.2012.33640
https://doi.org/10.1001/jama.2012.33640...
Local studies have also shown that DE can achieve equal or even higher levels of learning than in-class teaching.3030. Barros MM, Borges Neto H, Sousa MS, Silva PG, Teixeira CN, Almeida ME. Digital information and communication technologies as a support to the Internship in Dentistry. Rev ABENO. 2019 Jun;19(2):117-26. https://doi.org/10.30979/rev.abeno.v19i2.670
https://doi.org/10.30979/rev.abeno.v19i2...
However, teachers and students need to adapt to this teaching model, as it requires students to be responsible for their own learning process in an autonomous way.3131. Santos CM, Bulgarelli PT, Frichembruder K, Colvara BC, Hugo FN. [Evaluation of the learning quality in the virtual environment (Moodle) in oral health, in the students’ perspective]. Rev ABENO. 2018 Sep;18(1):116-23. Portuguese. https://doi.org/10.30979/rev.abeno.v18i1.433
https://doi.org/10.30979/rev.abeno.v18i1...

DE needs student autonomy; therefore, optional subjects and lower workloads are beneficial to students in HEIs with DE platforms. This approach has also shown similar levels of satisfaction among students as the traditional classroom approach.3232. Allen M, Bourhis J, Burrell N, Mabry E. Comparing student satisfaction with distance education to traditional classrooms in higher education: a meta-analysis. Am J Distance Educ. 2002 Jun;16(2):83-97. https://doi.org/10.1207/S15389286AJDE1602_3
https://doi.org/10.1207/S15389286AJDE160...
A reduction in workload combined with an increase in flexibility of the teaching process in dentistry courses has demonstrated a significant association with stress reduction in dental students.3333. Alzahem AM, Van der Molen HT, Alaujan AH, De Boer BJ. Stress management in dental students: a systematic review. Adv Med Educ Pract. 2014 May;5:167-76. https://doi.org/10.2147/AMEP.S46211
https://doi.org/10.2147/AMEP.S46211...
This might partially explain the relationship observed in our study because flexibility is the most important factor for student adherence to DE practices.2626. Sales LN, Nascimento LS, Brandão GA, Magalhães AC, Pontes FS. [Distance education and use of information technology for an education in dentistry: the student’s perception]. Rev ABENO. 2012 Dec;12(2):227-32. Portuguese. https://doi.org/10.30979/rev.abeno.v12i2.128
https://doi.org/10.30979/rev.abeno.v12i2...

This study also found that dentistry courses at HEIs with specialization and postgraduate programs were directly associated with greater availability of distance classes in undergraduate courses. The DE modality in dentistry is especially adopted by postgraduate and specialization programs as well as refresher courses. Consequently, the presence of postgraduate programs could be an indicator that favors the implementation of these teaching technologies in undergraduate courses.3434. Silva AN, Santos AM, Cortez EA, Cordeiro BC. Limits and possibilities of distance learning in continuing education in health: integrative review. Cienc Saúde Colet. 2015 Apr;20(4):1099-07. https://doi.org/10.1590/1413-81232015204.17832013
https://doi.org/10.1590/1413-81232015204...

Of all the indicators, the presence of institutional YouTube channels was the factor most strongly associated with the offering of distance classes in the dentistry courses evaluated in our study. The inclusion of social networks in the teaching process is well received by dentistry students,3535. Souza FB, Lopes MGQ, Filho RML. Social networks in dental training: opinion of students from a Brazilian university. Rev Cuba Estomatol. 2017 Apr-Jun;54(2):1-11. especially because this student category strongly adheres to these technologies.3636. Kenny P, Johnson IG. Social media use, attitudes, behaviours and perceptions of online professionalism amongst dental students. Br Dent J. 2016 Nov;221(10):651-5. https://doi.org/10.1038/sj.bdj.2016.864 PMID:27857111
https://doi.org/10.1038/sj.bdj.2016.864...
Social networks are also part of the infinite tools of the virtual teaching and learning process, especially in a generation prone to knowledge assimilation through new technologies.3434. Silva AN, Santos AM, Cortez EA, Cordeiro BC. Limits and possibilities of distance learning in continuing education in health: integrative review. Cienc Saúde Colet. 2015 Apr;20(4):1099-07. https://doi.org/10.1590/1413-81232015204.17832013
https://doi.org/10.1590/1413-81232015204...

However, the acceptance of DE among teachers is quite different. Low acceptance of technological advancements and lack of knowledge in managing virtual tools3737. Ramos ER, Souza FB, Melo MM. Incorporation of information and communication technologies in the teaching-service integration of health courses of a public university. Rev ABENO. 2018 Jul;18(3):159-68. https://doi.org/10.30979/rev.abeno.v18i3.580
https://doi.org/10.30979/rev.abeno.v18i3...
hinder the implementation of curricular and technological innovations in dentistry courses.1212. Hendricson WD, Cohen PA. Future directions in dental school curriculum, teaching, and learning. In: Tedesco L, Haden K. Leadership for the future: the dental school in the university. Washington, DC: American Association of Dental Schools; 1999. p. 37-62. A recent systematic review showed that organizational, economic, software, hardware, and support barriers play a major role in generating resistance to the implementation of e-learning for health professionals. Psychological resistance to change is also one of the biggest obstacles in the adoption of DE in health education, which also generates pedagogical issues that affect DE implementation.3838. Childs S, Blenkinsopp E, Hall A, Walton G. Effective e-learning for health professionals and students-barriers and their solutions: a systematic review of the literature-findings from the HeXL project. Health Info Libr J. 2005 Dec;22(s2 Suppl 2):20-32. https://doi.org/10.1111/j.1470-3327.2005.00614.x
https://doi.org/10.1111/j.1470-3327.2005...

DE is an important asset in the democratization of the teaching-learning process.3939. Martinez-Mier EA, Soto-Rojas AE, Stelzner SM, Lorant DE, Riner ME, Yoder KM. An international, multidisciplinary, service-learning program: an option in the dental school curriculum. Educ Health (Abingdon). 2011 Apr;24(1):259. Although infrastructural, technological, and psychological barriers to the implementation of distance learning in dentistry still exist, the COVID-19 pandemic has shown that we have taken a big step toward this process. We expect an increase in the number of dental schools with distance learning after the pandemic, especially due to this forced transition and the low cost of this teaching method.4040. Frehywot S, Vovides Y, Talib Z, Mikhail N, Ross H, Wohltjen H, et al. E-learning in medical education in resource constrained low- and middle-income countries. Hum Resour Health. 2013 Feb;11(1):4. https://doi.org/10.1186/1478-4491-11-4
https://doi.org/10.1186/1478-4491-11-4...

However, our findings should be interpreted with caution due to its limitations. The major limitation of this study is that most HEIs with dental schools were not included because they were still in the curriculum consolidation phase, and the fact that many institutions during May and June (data collection period) were planning for remote activities and did not make public information available. Therefore, these data could introduce significant bias in the results and greatly modify the outcomes. Thus, we recommend that similar studies be reproduced in the future when most of these HEIs will have consolidated dentistry courses. Even with these limitations, we report an important finding: low academic performance was directly associated with e-learning, and if official regulatory conducts are not performed, as in England,2828. Christante L, Ramos MP, Bessa R, Sigulem D. [The role of distance education in continuing medical education: a critical review]. Rev Assoc Med Bras. 2003 Jul-Sep;49(3):326-9. Portuguese. https://doi.org/10.1590/S0104-42302003000300039
https://doi.org/10.1590/S0104-4230200300...
the quality dental education in Brazil may deteriorate.4141. Aamodt PO, Havnes A. Factors affecting professional job mastery: quality of study or work experience? Qual High Educ. 2008;14(3):233-48. https://doi.org/10.1080/13538320802507539
https://doi.org/10.1080/1353832080250753...
Other important limitations are that many different and novel forms of e-learning were developed after the suspension of classes; however, in this study, they were grouped under e-learning. This grouping increases the amplitude of screening (national level) but decreases the sensitivity of identifying risk factors for poor quality of learning in dentistry. Future studies are needed to investigate the influence of different types of e-learning on the quality of DS.

The major supporters of e-learning in Brazil are private dental schools.4242. Fonseca EP, Rocha CM, Kruger E, Tennant M, Mialhe FL, Meneghim MC. Distribution of dental schools in Brazil, 2015. Eur J Gen Dent. 2016;5(2):47-52. https://doi.org/10.4103/2278-9626.179534
https://doi.org/10.4103/2278-9626.179534...
They need continuous professional education and employment stability to implement and maintain e-learning in dentistry.4343. Zhukovskiy YL, Vasilev BU, Koteleva N. Quality estimation of continuing professional education of technical specialists. 2017 Int Conf “Quality Management, Transport and Information Security, Information Technologies” (IT&QM&IS). 2017;1(1):704-7. https://doi.org/10.1109/ITMQIS.2017.8085921
https://doi.org/10.1109/ITMQIS.2017.8085...
,4444. Çınkır S, Kurum G. Discrepancy in teacher employment: the problem of out-of-field teacher employment. J Int Soc Educ Plann. 2015;22(1):29:40. Dentistry teachers should be encouraged in implementing this teaching method, leading to improvements in the levels of engagement and activity of educators, which is the strongest predictor of professional development in higher education.4545. Shaha SH, Ellsworth H. Predictors of success for professional development: linking student achievement to school and educator successes through on-demand, online professional learning. J Instruc Psychol. 2013 Mar;40(1):19-26.

Conclusion

More than one-third of the dentistry courses evaluated in this study offered distance classes, and considering that the presence of digital media channels was an important predictor, an increase in the offering of this teaching modality is expected in all dentistry courses in Brazil after the quarantine period ends. Nevertheless, the association between distance learning and low academic performance has drawn attention to the need for regulatory bodies for controlling the quality of the content available in DE.

References

  • 1
    Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A novel coronavirus from patients with pneumonia in China, 2019. N Engl J Med. 2020 Feb;382(8):727-
  • 2
    Omary MB, Eswaraka J, Kimball SD, Moghe PV, Panettieri RA Jr, Scotto KW. The COVID-19 pandemic and research shutdown: staying safe and productive. J Clin Invest. 2020 Jun;130(6):2745-8. https://doi.org/10.1172/JCI138646
    » https://doi.org/10.1172/JCI138646
  • 3
    Fleming J, Becker K, Newton C. Factors for successful e-learning: does age matter? Educ Train. 2017 Jun;59(1):76-89. https://doi.org/10.1108/ET-07-2015-0057
    » https://doi.org/10.1108/ET-07-2015-0057
  • 4
    Koo JR, Cook AR, Park M, Sun Y, Sun H, Lim JT, et al. Interventions to mitigate early spread of SARS-CoV-2 in Singapore: a modelling study. Lancet Infect Dis. 2020 Jun;20(6):678-88. https://doi.org/10.1016/S1473-3099(20)30162-6
    » https://doi.org/10.1016/S1473-3099(20)30162-6
  • 5
    Ministério da Educação (BR). Portaria N° 343, de 17 de março de 2020. Dispõe sobre a substituição das aulas presenciais por aulas em meios digitais enquanto duras a situação de pandemia - COVID-19. Diário Oficial União. 2020 Mar 18.
  • 6
    Ministério da Educação (BR). Portaria N° 544, de 16 de junho de 2020. Dispõe sobre a substituição das aulas presenciais por aulas em meios digitais, enquanto durar a situação de pandemia do novo coronavírus - Covid-19. Diário Oficial União. 2020 Jun 17.
  • 7
    Franco LL, Soares EF, Martorell LB, Marcelo VC. The teacher of the dentistry course: his education and the challenges. Rev Prof Docente. 2009;9(20):57-74. https://doi.org/10.31496/rpd.v9i20.235
    » https://doi.org/10.31496/rpd.v9i20.235
  • 8
    Nattestad A, Attstrom R, Mattheos N, Ramseier C, Canegallo L, Eaton K, et al. 4.1 Web-based interactive learning programmes. Eur J Dent Educ. 2002;6(3 Suppl 3):127-37. https://doi.org/10.1034/j.1600-0579.6.s3.17.x
    » https://doi.org/10.1034/j.1600-0579.6.s3.17.x
  • 9
    Cruz AD, Costa JJ, Almeida SM. Distance learning in dental radiology: immediate impact of the implementation. 2014 Oct-Dec;17(4):90-7. https://doi.org/10.14295/bds.2014.v17i4.930
    » https://doi.org/10.14295/bds.2014.v17i4.930
  • 10
    Hannay M, Newvine M. Perceptions of distance learning: a comparison of online and traditional learning. J Online Learn Teach. 2006;2(1):1-11.
  • 11
    Dickey MD. The impact of web-logs (blogs) on student perceptions of isolation and alienation in a web-based distance-learning environment. Open Learn. 2004;19(3):279-91. https://doi.org/10.1080/0268051042000280138
    » https://doi.org/10.1080/0268051042000280138
  • 12
    Hendricson WD, Cohen PA. Future directions in dental school curriculum, teaching, and learning. In: Tedesco L, Haden K. Leadership for the future: the dental school in the university. Washington, DC: American Association of Dental Schools; 1999. p. 37-62.
  • 13
    Wainer J, Vieira P, Melguizo T. The association between having access to computers and Internet and educational achievement for primary students in Brazil. Comp Educ. 2015 Jan;80:68-76. https://doi.org/10.1016/j.compedu.2014.08.007
    » https://doi.org/10.1016/j.compedu.2014.08.007
  • 14
    Koohang A, Durante A. Learners’ perceptions toward the web-based distance learning activities/assignments portion of an undergraduate hybrid instructional model. J Inf Technol Educ. 2003;2(1):105-13. https://doi.org/10.28945/316
    » https://doi.org/10.28945/316
  • 15
    Malta M, Cardoso LO, Bastos FI, Magnanini MM, Silva CM. STROBE initiative: guidelines on reporting observational studies. Rev Saude Publica. 2010 Jun;44(3):559-65. https://doi.org/10.1590/S0034-89102010000300021
    » https://doi.org/10.1590/S0034-89102010000300021
  • 16
    Johnston JM, Leung GM, Fielding R, Tin KY, Ho LM. The development and validation of a knowledge, attitude and behaviour questionnaire to assess undergraduate evidence-based practice teaching and learning. Med Educ. 2003 Nov;37(11):992-1000. https://doi.org/10.1046/j.1365-2923.2003.01678.x
    » https://doi.org/10.1046/j.1365-2923.2003.01678.x
  • 17
    Yu S, Yang KF. Attitudes toward Web-based distance learning among public health nurses in Taiwan: a questionnaire survey. Int J Nurs Stud. 2006 Aug;43(6):767-74. https://doi.org/10.1016/j.ijnurstu.2005.09.005
    » https://doi.org/10.1016/j.ijnurstu.2005.09.005
  • 18
    Andrews KG, Demps EL. Distance education in the U.S. and Canadian undergraduate dental curriculum. J Dent Educ. 2003 Apr;67(4):427-38. https://doi.org/10.1002/j.0022-0337.2003.67.4.tb03644.x
    » https://doi.org/10.1002/j.0022-0337.2003.67.4.tb03644.x
  • 19
    Fonseca EP. [The National Curriculum Guidelines and training of brazilian dentists]. J Manag Prim Health Care. 2012 Oct;3(2):158-78. Portuguese. https://doi.org/10.14295/jmphc.v3i2.154
    » https://doi.org/10.14295/jmphc.v3i2.154
  • 20
    Ministério da Educação (BR). Portaria N° 2.117, de 6 de dezembro de 2019. Dispõe sobre a oferta de carga horária na modalidade de Ensino a Distância - EaD em cursos de graduação presenciais ofertados por Instituições de Educação Superior - IES pertencentes ao Sistema Federal de Ensino. Diário Oficial União. 2019 Dec 7.
  • 21
    Lamers JMS, Baumgarten A, Bittencourt FV, Toassi RF. Mudanças curriculares na educação superior em Odontologia: inovações, resistências e avanços conquistados. Rev ABENO. Dez. 2016;16(4):2-18. https://doi.org/10.30979/rev.abeno.v16i4.324
    » https://doi.org/10.30979/rev.abeno.v16i4.324
  • 22
    Ravjee N. The politics of e-learning in South African higher education. Int J Educ Dev Using Inf Commun Technol. 2007 Aug;3(4):27-41.
  • 23
    Ruggeri K, Farrington C, Brayne C. A global model for effective use and evaluation of e-learning in health. Telemed J E Health. 2013 Apr;19(4):312-21. https://doi.org/10.1089/tmj.2012.0175
    » https://doi.org/10.1089/tmj.2012.0175
  • 24
    Martin AS, Chisini LA, Martelli S, Sartori LR, Ramos EC, Demarco FF. Distribution of Dental Schools and dentists in Brazil: an overview of the labor Market. Rev ABENO. 2018 Jul;18(1):63-73. https://doi.org/10.30979/rev.abeno.v18i1.399
    » https://doi.org/10.30979/rev.abeno.v18i1.399
  • 25
    Silva AR, Nunes CS, Spanhol FJ, Santos JV, Rabelo S. [Models used for distance education: an overview focused on higher education institutions of Brazil]. Rev GUAL. 2011 Sep/Dec;4(3):153-69. Portuguese. https://doi.org/10.5007/1983-4535.2011v4n3p153
    » https://doi.org/10.5007/1983-4535.2011v4n3p153
  • 26
    Sales LN, Nascimento LS, Brandão GA, Magalhães AC, Pontes FS. [Distance education and use of information technology for an education in dentistry: the student’s perception]. Rev ABENO. 2012 Dec;12(2):227-32. Portuguese. https://doi.org/10.30979/rev.abeno.v12i2.128
    » https://doi.org/10.30979/rev.abeno.v12i2.128
  • 27
    Woelber JP, Hilbert TS, Ratka-Krüger P. Can easy-to-use software deliver effective e-learning in dental education? A randomised controlled study. Eur J Dent Educ. 2012 Aug;16(3):187-92. https://doi.org/10.1111/j.1600-0579.2012.00741.x
    » https://doi.org/10.1111/j.1600-0579.2012.00741.x
  • 28
    Christante L, Ramos MP, Bessa R, Sigulem D. [The role of distance education in continuing medical education: a critical review]. Rev Assoc Med Bras. 2003 Jul-Sep;49(3):326-9. Portuguese. https://doi.org/10.1590/S0104-42302003000300039
    » https://doi.org/10.1590/S0104-42302003000300039
  • 29
    Kulier R, Gülmezoglu AM, Zamora J, Plana MN, Carroli G, Cecatti JG, et al. Effectiveness of a clinically integrated e-learning course in evidence-based medicine for reproductive health training: a randomized trial. JAMA. 2012 Dec;308(21):2218-25. https://doi.org/10.1001/jama.2012.33640
    » https://doi.org/10.1001/jama.2012.33640
  • 30
    Barros MM, Borges Neto H, Sousa MS, Silva PG, Teixeira CN, Almeida ME. Digital information and communication technologies as a support to the Internship in Dentistry. Rev ABENO. 2019 Jun;19(2):117-26. https://doi.org/10.30979/rev.abeno.v19i2.670
    » https://doi.org/10.30979/rev.abeno.v19i2.670
  • 31
    Santos CM, Bulgarelli PT, Frichembruder K, Colvara BC, Hugo FN. [Evaluation of the learning quality in the virtual environment (Moodle) in oral health, in the students’ perspective]. Rev ABENO. 2018 Sep;18(1):116-23. Portuguese. https://doi.org/10.30979/rev.abeno.v18i1.433
    » https://doi.org/10.30979/rev.abeno.v18i1.433
  • 32
    Allen M, Bourhis J, Burrell N, Mabry E. Comparing student satisfaction with distance education to traditional classrooms in higher education: a meta-analysis. Am J Distance Educ. 2002 Jun;16(2):83-97. https://doi.org/10.1207/S15389286AJDE1602_3
    » https://doi.org/10.1207/S15389286AJDE1602_3
  • 33
    Alzahem AM, Van der Molen HT, Alaujan AH, De Boer BJ. Stress management in dental students: a systematic review. Adv Med Educ Pract. 2014 May;5:167-76. https://doi.org/10.2147/AMEP.S46211
    » https://doi.org/10.2147/AMEP.S46211
  • 34
    Silva AN, Santos AM, Cortez EA, Cordeiro BC. Limits and possibilities of distance learning in continuing education in health: integrative review. Cienc Saúde Colet. 2015 Apr;20(4):1099-07. https://doi.org/10.1590/1413-81232015204.17832013
    » https://doi.org/10.1590/1413-81232015204.17832013
  • 35
    Souza FB, Lopes MGQ, Filho RML. Social networks in dental training: opinion of students from a Brazilian university. Rev Cuba Estomatol. 2017 Apr-Jun;54(2):1-11.
  • 36
    Kenny P, Johnson IG. Social media use, attitudes, behaviours and perceptions of online professionalism amongst dental students. Br Dent J. 2016 Nov;221(10):651-5. https://doi.org/10.1038/sj.bdj.2016.864 PMID:27857111
    » https://doi.org/10.1038/sj.bdj.2016.864
  • 37
    Ramos ER, Souza FB, Melo MM. Incorporation of information and communication technologies in the teaching-service integration of health courses of a public university. Rev ABENO. 2018 Jul;18(3):159-68. https://doi.org/10.30979/rev.abeno.v18i3.580
    » https://doi.org/10.30979/rev.abeno.v18i3.580
  • 38
    Childs S, Blenkinsopp E, Hall A, Walton G. Effective e-learning for health professionals and students-barriers and their solutions: a systematic review of the literature-findings from the HeXL project. Health Info Libr J. 2005 Dec;22(s2 Suppl 2):20-32. https://doi.org/10.1111/j.1470-3327.2005.00614.x
    » https://doi.org/10.1111/j.1470-3327.2005.00614.x
  • 39
    Martinez-Mier EA, Soto-Rojas AE, Stelzner SM, Lorant DE, Riner ME, Yoder KM. An international, multidisciplinary, service-learning program: an option in the dental school curriculum. Educ Health (Abingdon). 2011 Apr;24(1):259.
  • 40
    Frehywot S, Vovides Y, Talib Z, Mikhail N, Ross H, Wohltjen H, et al. E-learning in medical education in resource constrained low- and middle-income countries. Hum Resour Health. 2013 Feb;11(1):4. https://doi.org/10.1186/1478-4491-11-4
    » https://doi.org/10.1186/1478-4491-11-4
  • 41
    Aamodt PO, Havnes A. Factors affecting professional job mastery: quality of study or work experience? Qual High Educ. 2008;14(3):233-48. https://doi.org/10.1080/13538320802507539
    » https://doi.org/10.1080/13538320802507539
  • 42
    Fonseca EP, Rocha CM, Kruger E, Tennant M, Mialhe FL, Meneghim MC. Distribution of dental schools in Brazil, 2015. Eur J Gen Dent. 2016;5(2):47-52. https://doi.org/10.4103/2278-9626.179534
    » https://doi.org/10.4103/2278-9626.179534
  • 43
    Zhukovskiy YL, Vasilev BU, Koteleva N. Quality estimation of continuing professional education of technical specialists. 2017 Int Conf “Quality Management, Transport and Information Security, Information Technologies” (IT&QM&IS). 2017;1(1):704-7. https://doi.org/10.1109/ITMQIS.2017.8085921
    » https://doi.org/10.1109/ITMQIS.2017.8085921
  • 44
    Çınkır S, Kurum G. Discrepancy in teacher employment: the problem of out-of-field teacher employment. J Int Soc Educ Plann. 2015;22(1):29:40.
  • 45
    Shaha SH, Ellsworth H. Predictors of success for professional development: linking student achievement to school and educator successes through on-demand, online professional learning. J Instruc Psychol. 2013 Mar;40(1):19-26.

Publication Dates

  • Publication in this collection
    19 Nov 2021
  • Date of issue
    2021

History

  • Received
    29 June 2020
  • Accepted
    1 Mar 2021
  • Reviewed
    23 Apr 2021
Sociedade Brasileira de Pesquisa Odontológica - SBPqO Av. Prof. Lineu Prestes, 2227, 05508-000 São Paulo SP - Brazil, Tel. (55 11) 3044-2393/(55 11) 9-7557-1244 - São Paulo - SP - Brazil
E-mail: office.bor@ingroup.srv.br