E-learning program for medical students in dermatology

Silva, Cristiana Silveira; Souza, Murilo Barreto; Silva Filho, Roberto Silveira; Medeiros, Luciana Molina de; Criado, Paulo Ricardo

doi:10.1590/S1807-59322011000400016

Abstract

INTRODUCTION: Dermatological disorders are common in medical practice. In medical school, however, the time devoted to teaching dermatology is usually very limited. Therefore, online educational systems have increasingly been used in medical education settings to enhance exposure to dermatology. OBJECTIVE: The present study was designed to develop a e-learning program for medical students in dermatology and evaluate the impact of this program on learning. METHODS: This prospective study included second year medical students at the University of Technology and Science, Salvador, Brazil. All students attended discussion seminars and practical activities, and half of the students had adjunct online seminars (blended learning). Tests were given to all students before and after the courses, and test scores were evaluated. RESULTS: Students who participated in online discussions associated with face-to-face activities (blended learning) had significantly higher posttest scores (9.0 + 0.8) than those who only participated in classes (7.75+1.8, p <0.01). CONCLUSIONS: The results indicate that an associated online course might improve the learning of medical students in dermatology.

medical education; distance learning; distance education; internet; undergraduate medical education

CLINICAL SCIENCE

^IDepartment of Dermatology, Universidade de São Paulo, São Paulo, SP, Brazil

^IIDepartment of Medical Informatics, Faculdade de Medicina da FTC Salvador-Ba

^IIISoftware Engineering from the Department of Informatics of the Donald Bren School of Information and Computer Sciences at University of California, Irvine, Ca

ABSTRACT

INTRODUCTION: Dermatological disorders are common in medical practice. In medical school, however, the time devoted to teaching dermatology is usually very limited. Therefore, online educational systems have increasingly been used in medical education settings to enhance exposure to dermatology.

OBJECTIVE: The present study was designed to develop a e-learning program for medical students in dermatology and evaluate the impact of this program on learning.

METHODS: This prospective study included second year medical students at the University of Technology and Science, Salvador, Brazil. All students attended discussion seminars and practical activities, and half of the students had adjunct online seminars (blended learning). Tests were given to all students before and after the courses, and test scores were evaluated.

RESULTS: Students who participated in online discussions associated with face-to-face activities (blended learning) had significantly higher posttest scores (9.0 + 0.8) than those who only participated in classes (7.75+1.8, p <0.01).

CONCLUSIONS: The results indicate that an associated online course might improve the learning of medical students in dermatology.

Keywords: medical education; distance learning; distance education; internet; undergraduate medical education.

INTRODUCTION

In recent years, medical education has undergone several modifications related to pedagogic principles and methods.^1-3 A problem-based, self-directed learning process has replaced traditional teaching in some universities, and students participate in tutorial groups.³ In medical education, however, the ability to teach visual specialties, such as dermatology, within a restricted time schedule remains challenging.⁴

Published surveys have demonstrated that the amount of time devoted to dermatology in the medical student curriculum represents only 0.24-0.3% of the 4 years of study.⁵ Indeed, a survey of several medical schools found that an average medical student receives less than 18 hours of dermatology training during his or her medical education.⁶

The current available time for dermatology training in medical schools in the U.S., European countries (e.g., the U.K.) and Brazil is not proportional to the number of cutaneous diseases that are likely to be encountered in a typical ambulatory care setting.^7,8 It is estimated that 4-7% of office visits by adult and pediatric patients are for dermatological complaints.^4,5,6,9 With respect to the evaluation and treatment of skin disease, many studies have clearly demonstrated that nondermatologists have inferior performances compared with dermatologists.¹⁰

Because the majority of patients with cutaneous problems are not initially seen by a dermatologist, doctors involved in general care medicine will be expected to deal with an increasing frequency of skin disorders.⁷ To improve the dermatological background of future general physicians, new tools should be developed to increase medical students' exposure to dermatology.⁷

Online medical educational systems have shown interesting benefits for learning processes. One attraction of online methods is that learners have the opportunity to share information and learn collaboratively without having to physically be present in a group.¹¹ These new formats, however, have been poorly investigated, and there are some doubts about whether they are superior to traditional teaching methods.^12,13

E-learning has several advantages, including the ability to access materials at any time in almost any place, which also permits interactive web seminars and conferences with participants who may be located far away from one another.¹⁴

The objective of the present study was to develop a e-learning program in dermatology, which could be used as an adjunct tool for traditional teaching. In addition, we evaluated the impact of this program on student learning.

MATERIALS AND METHODS

This prospective study selected students in their second year of medical school at the University of Technology and Science (Salvador, Brazil). None of these students had prior formal exposure to dermatology. The participants were divided into two groups: a control group and an online group. Students in second semester of 2009 were included in the control group and took the traditional course and seminars. Those who attended classes in the discipline in the first semester of 2010 took the traditional course and participated in online discussion seminars (online group). The Institutional Review Board approved the study, and informed consent forms were obtained prior to the study from the participants.

Students in the control and online groups received identical evidence-based content, used the same textbook and participated in similar, but not identical, instructional activities. The course had the same duration for both groups. Activities of the control and online groups included face-to-face seminars and patient care. In addition to these activities, students in the online group completed an online program that incorporated educational elements similar to those provided in the classes.

The content addressed by the course included essentials on the physical examination of the skin and the terminology used to describe skin lesion morphology, skin physiology and anatomy. We reviewed practice guidelines, textbooks and primary journal articles to develop an evidence-based, e-learning module for each topic.

A e-learning environment was prepared using the open-source Moodle learning management system.¹⁵ The e-learning module included a twelve-week course that was developed simultaneously with face-to-face activities. A new text, video and online discussion forum, which addressed the same content as the face-to-face activities, was available each week. In addition to face-to-face communication, students in the online group could receive feedback with the discussion boards or by sending direct messages to the course tutor.

Data consisted of a precourse and a postcourse examination score in each group.

After identifying the information and skills to be learned, multiple-choice questions were written in accordance with the National Board of Medical Examiners recommenda-tions¹⁶ to assess knowledge, combined comprehension and application, and problem-solving ability. The exam content covered the course objectives. Each exam had 20 questions, and the final score ranged from 0 to 10.

Although the content was the same for the precourse and postcourse exams, the questions were slightly different; however, the exam questions were identical for the control and online groups.

Two independent dermatology experts evaluated the content of the 2 exams, and the pre- and postcourse scores were compared. According to the normality test, we applied a paired t test or Wilcoxon signed-rank test for intragroup comparisons and a t test or Mann-Whitney test for intergroup comparisons.

Internal consistency of the pre- and posttest exam reliability was estimated using an item-total correlation (r value). This value, which ranged from - 1.00 to + 1.00, represented the Pearson correlation coefficient between individual item score and the individual overall score on all the others items. Higher values indicated that items were well correlated with the total score. When a question had a low item-total correlation (usually r <0.30), it was considered an unreliable assessment item.¹⁷

At the end of the course, the students completed a satisfaction questionnaire-based evaluation. The results of the satisfaction survey were used to improve the e-learning teaching course.

RESULTS

Forty-four students were included in this study (20 in the control group and 24 in the online group), and all subjects completed the course. Participants in the online and control groups did not differ significantly with regard to age, sex or knowledge prior to the course. The average scores achieved in the pretest exam were 3.75+ 1.16 and 3.92+ 2.1 SD for the control and online groups, respectively. There was no statistically significant difference in the pretest exam scores between the two groups (p =0.7).

Although the posttest exam scores significantly improved for both groups (p <0.01), the students who participated in the online discussions associated with face-to-face seminars had significantly higher posttest scores than the students who only attended face-to-face discussions (9.0+ 0.8 vs. 7.75+ 1.8; p <0.01) (Table 1).

Thumbnail

Two dermatology experts confirmed the content validity of the two tests. Item-total correlation values had a range of 0.44 to 0.74 in the pretest and 0.38 to 0.77 in the posttest.

Internal consistencies (Cronbach's a) for the pretest and posttest exams were 0.67 and 0.70, respectively. Although no definitive agreement exists regarding thresholds for Cronbach's a, it is conventionally accepted among test designers that a lenient Cronbach's a coefficient $0.6 is satisfactory for exploratory research.

Overall, the online course was highly rated: 90.9% of the students rated the course as very good to excellent in the satisfaction questionnaire.

DISCUSSION

In general, medical schools have dedicated little time to dermatology training.⁶ Our department has a 20-hour dermatology course time, which is comparable to the majority of medical schools worldwide. Curricular revisions have emphasized that case-based, small-group teaching and problem-based learning techniques are useful tools for increasing the learning capacity of medical students. These methods, however, take a long time to achieve satisfactory integration, and new teaching methods should be tested to provide better courses for students.^1,7

Despite the limited time devoted to dermatology, all medical school graduates are expected to be able to describe the skin and record their findings each time that they see a patient.¹ Faced with this reality, online learning becomes a useful tool for teaching dermatology to medical students. E-learning programs offer several advantages over conventional teaching mechanisms, and they can provide high-quality images at a lower cost. They may also be accessed by students anytime and almost anywhere.^4,6,18 Further advantages of e-learning include interactivity, immediate feedback, and the use of audio and video media.^6,18

Previous studies of the impact of e-learning content on gains in student knowledge have provided variable results. Although some studies have shown slight improvements in student learning,^22,23 others have shown no significant differences.^6,12,14 In the present study, the pretest scores between the two groups were not significantly different, which indicated the same degree of knowledge before the course. At the end of the course, however, students who took the E-learning course had higher posttest scores than students who took the conventional course alone.

Similar to the present study, a recent randomized controlled trial showed that online programs could produce gains in knowledge compared to effective face-to-face activities.²⁴

Despite these favorable results, some disadvantages of distance learning should be considered. Similar to the Fordis et al. study,²⁴ we found that online facilitation was more challenging than face-to-face teaching for the design, organization, delivery, and engagement of participants in discussion. Another disadvantage of online programs is that they are time consuming, not only for adapting content to e-learning but also for the time that must be devoted to answering students' questions. Prompt feedback is an advantage of the method and important to the students, but is a disvantage to course instructors as it is time consuming.²⁵

Cook also suggested some potential disadvantages of distance learning, including social isolation, lack of individualized instruction, high development and maintenance costs, technical problems and poor instructional design.²⁶ Some legal and ethical issues must also be considered because the use of images involves consent and copyright considerations.²⁵

The present study addressed the use of an online educational program in dermatology, but there were several limitations. Although gains in practical skills are a pivotal issue in clinical practice, the present study only analyzed knowledge gains. Therefore, we could only speculate about the effects of this program on practical skills. In addition, we did not evaluate long-term retention of knowledge because it was not one of the study objectives. Moreover, the limited number of students evaluated represents another potential weakness.

Although studies have not investigated whether the use of online educational programs in dermatology improves learning or whether online education is superior to traditional teaching,⁶ our results indicate that the use of a e-learning program associated with a traditional course for medical students provides a way to improve the teaching of dermatology. Further investigation is recommended because e-learning may add benefits to the learning process and can significantly enhance the overall dermatology education provided to medical students.

Received for publication on November 15, 2010; First review completed on December 29, 2010; Accepted for publication on January 17, 2011

E-mail: silveira.cristiana@gmail.com Tel.: 55 71 33362850

1. Kunz R, Nagy E, Coppus SF, Emparanza JI, Hadley J, Kulier R, et al. How far did we get? How far to go? A European survey on postgraduate courses in evidence-based medicine. Journal of Evaluation in Clinical Practice. 2009;15:1196-204, doi: 10.1111/j.1365-2753.2009.01268.x.
2. Siqueira-Batista R, Siqueira-Batista R. The rings of snake: problem-based learning and the societies of control Ciência & Saúde Coletiva. 14:118392.
3. Hong C, McLean D, Shapiro J, Lui H. Using the internet to assess and teach medical students in dermatology. Journal of Cutaneous Medicine and Surgery. 2002;6:315-9, doi: 10.1007/s10227-001-0049-2.
4. Hartmann AC, Cruz PD. Interactive mechanisms for teaching dermatology to medical students. Archives of dermatology. 1998;134:725-8, doi:10.1001/archderm.134.6.725.
5. McCleskey PE, Gilson RT, DeVillez RL. Medical Student Core Curriculum in Dermatology Survey. Journal of the American Academy of Dermatology. 2009;61:30-5, doi: 10.1016/j.jaad.2008.10.066.
6. Jenkins S, Goel R, Morrell DS. Computer-assisted instruction versus traditional lecture for medical student teaching of dermatology morphology: a randomized control trial. Journal of the American Academy of Dermatology. 2008;59:255-9, doi: 10.1016/j.jaad.2008.04.026.
7. Knable A, Hood AF, Pearson TG. Undergraduate medical education in dermatology: report from the AAD Interdisciplinary Education Committee, Subcommittee on Undergraduate Medical Education. Journal of the American Academy of Dermatology. 1997;36:467-70, doi: 10.1016/S0190-9622(97)80227-7.
8. Davies E, Burge S. Audit of dermatological content of U.K. undergraduate curricula. The British Journal of Dermatology. 2009;160:999-1005, doi: 10.1111/j.1365-2133.2009.09056.x.
9. Federman D, Hogan D, Taylor JR, Caralis P, Kirsner RS. A comparison of diagnosis, evaluation, and treatment of patients with dermatologic disorders. Journal of the American Academy of Dermatology. 1995;32:726-9, doi: 10.1016/0190-9622(95)91449-8.
10. Whitaker-Worth DL, Susser WS, Grant-Kels JM. Clinical dermatologic education and the diagnostic acumen of medical students and primary care residents. International Journal of Dermatology. 1998;37:855-9, doi: 10.1046/j.1365-4362.1998.00537.x.
11. Sandars J. Twelve tips for effective online discussions in continuing medical education. Medical Teacher. 2006:28;591-3, doi: 10.1080/ 01421590600879455.
12. Cook DA, Dupras DM, Thompson WG, Pankratz VS. Web-based learning in residents' continuity clinics: A randomized, controlled trial. Academic Medicine. 2005;80:897-905.
13. McKimm J, Jollie C, Cantillon P. ABC of learning and teaching: Web based learning. BMJ. 2003;326:870-3, doi: 10.1136/bmj.326.7394.870.
14. Hammoud M, Gruppen L, Erickson SS, Cox SM, Espey E, Goepfert A, et al. To the Point: reviews in medical education online computer assisted instruction materials. American Journal of Obstetrics and Gynecology. 2006;194:1064-9, doi: 10.1016/j.ajog.2005.08.023.
¹⁵
Moodle, version 1.9.5 (2009) http://moodle.org (accessed 2009).
16. Case SM, Swanson DB. Constructing Written Test Questions for the Basic and Clinical Sciences. National Board of Medical Examiners 2002, 3ed.
17. Quadrelli S, Davoudi M, Galíndez F, Colt HG. Reliability of a 25-item low-stakes multiple-choice assessment of bronchoscopic knowledge. Chest. 2009;135:315-21, doi: 10.1378/chest.08-0867.
18. McKimm J, Jollie C, Cantillon P. ABC of learning and teaching: Web-based learning. British Medical Journal. 2003;326:870-3, doi: 10.1136/bmj. 326.7394.870.
19. HansraNK,O'SullivanP,ChenCL,BergerTG.Medicalschool dermatology curriculum: are we adequately preparing primary care physicians? Journal of the American Academy of Dermatology. 2009;61:23-9, doi: 10.1016/j.jaad.2008.11.912.
20. Bello G, Pennisi MA, Maviglia R, Maggiore SM, Bocci MG, Montini L, et al. Online vs live methods for teaching difficult airway management to anesthesiology residents. Intensive Care Medicine. 2005;31:547-52, doi: 10.1007/s00134-005-2561-0.
21. Bernard RM, Abrami PC, Lou Y, Borokhovski E, Wade A, Wozney L, et al. How Does Distance Education Compare With Classroom Instruction? A Meta-Analysis of the Empirical Literature. Review of Educational Research. 2004;74:379-439, doi: 10.3102/00346543074003379.
22. Campbell M, Gibson W, Hall A, Richards D, Callery P. Online vs. face-to-face discussion in a Web-based research methods course for postgraduate nursing students: a quasi-experimental study. International Journal of Nursing Studies. 2008;45:750-9, doi: 10.1016/j.ijnurstu.2006.12.011.
23. Davis J, Education T. Developing Online Courses: A Comparison of Web-based Instruction with Traditional Instruction. Methods. 1997;126-30.
24. Fordis M, King JE, Ballantyne CM, Jones PH, Schneider KH, Spann SJ, et al. Comparison of the Instructional Efficacy of Internet-Based CME With Live Interactive CME Workshops. JAMA. 2005:249;1043-51, doi: 10. 1001/jama.294.9.1043.
25. Lockyer J, Sargeant J, Curran V, Fleet L. The transition from face-to-face to online CME facilitation Medical Teacher. 2006;28:625-30.
26. Cook D. Where are we with web based learning in medical education? Medical Teacher. 2006:28;594-8, doi: 10.1080/01421590601028854.