Prospective Analysis of Short- and Mid-term Knowledge Retention after a Brief Ultrasound Course for Undergraduate Medical Students

Abstract

OBJECTIVES:

The benefits of implementing point-of-care ultrasound (POCUS) in the emergency department are well established. Ideally, physicians should be taught POCUS during medical school. Several different courses have been designed for that purpose and have yielded good results. However, medical students need specifically designed courses that address the main objectives of knowledge acquisition and retention. Despite that, there is limited evidence to support knowledge retention, especially in the mid-term. The purpose of this study is to evaluate short- and mid-term knowledge retention after a student-aimed ultrasound course.

METHODS:

Medical students participating in a medical student trauma symposium (SIMPALT) in 2017 were included. Their profiles and baseline ultrasound knowledge were assessed by a precourse questionnaire (PRT). The same questionnaire was used one week (1POT) and three months (3POT) after the course.

RESULTS:

Most of the participants were 1^st- to 4^th- year medical students. None had prior ultrasound knowledge. They reported costs as the major barrier (65%) to enrollment in an ultrasound course. A comparison between the PRT and 1POT results showed a statistically significant difference (p<0.02), while no difference was found between 1POT and 3POT (p>0.09).

CONCLUSION:

Our findings support the use of a tailored ultrasound course for medical students. Knowledge acquisition and mid-term retention may be achieved by this specific population.

Medical Education; Medical Student; Ultrasonography; Point-of-Care Technology

INTRODUCTION

Point-of-care ultrasound (POCUS) is becoming an integral part of the assessment of critical care patients. It is considered “the new stethoscope” by some authors (¹,²) and is a useful tool for the evaluation of abdominal pain, intracranial hypertension, pleuropulmonary diseases, shock, and airway control (³,⁴).

As with any technology with widely expanding applications, it is imperative that physicians be well trained in POCUS. Moreover, there is an ongoing debate regarding whether training in POCUS should be offered to medical students. FAST (Focused Assessment with Sonography for Trauma) is one of the simplest applications of POCUS. Free fluid identification is straightforward due to the contrast with the adjacent structures and does not depend on artifact interpretation (⁵). Hence, FAST is a good example to present to medical students as the first step in ultrasound training.

Various POCUS courses are reported in the literature (⁶-¹¹), some of which are aimed at medical students (¹²-¹⁷). However, their use is limited by factors such as duration and financial cost. Most courses assess knowledge acquisition using a questionnaire administered shortly after course completion. However, there is little evidence to support knowledge retention in the mid-term. This gap may undermine the interpretation of course efficacy and contribute to a lower enrollment rate.

An ideal tailored course for medical students should be short and inexpensive while resulting in satisfactory knowledge retention. Hence, the present study aims to evaluate the effects of a brief, student-tailored ultrasound course by focusing on short- and mid-term knowledge retention.

METHODS

This is a nonrandomized prospective study that included participants who enrolled in the skills stations at a medical student trauma symposium (SIMPALT) in 2017. The ultrasound course was one of the four skills stations of the symposium. The students were separated into four groups that rotated through the stations every 50 minutes.

The ultrasound course encompassed basic theoretical explanations of ultrasound physics, transducer choice, FAST systematization, E-FAST windows, and image interpretation. The theoretical session was followed by practical training in performing a FAST exam of a healthy volunteer. The course format was elaborated by one of the authors (CAMM). Every student received two questionnaires before the course. The first was intended to gather participants’ profile information and to determine what they considered barriers to enrolling in ultrasound courses. The second questionnaire (PRT) was composed of 8 multiple-choice theoretical questions, each of which had a unique correct answer, with the aim of assessing the students’ baseline knowledge. We excluded participants who did not answer both questionnaires from further evaluation.

Every student received the same questions one week (1POT) and three months (3POT) postcourse. Responses were compared between PRT and 1POT to evaluate knowledge acquisition and between 1POT and 3POT to evaluate knowledge retention in the mid-term. Students were also asked to grade the overall quality of the activity on a scale of 1 to 10.

We performed chi-square and Fisher’s exact tests using STATA software (STATACorp. 2007. Stata Statistical Software: Release 10.0. College Station, Texas: Stata Corporation) to compare the responses. The confidence interval was 95%, and p-values <0.05 were considered statistically significant.

RESULTS

This study was approved by the Institutional Ethics Committee and is reported according to the STROBE guidelines. Thirty-seven students answered the first two questionnaires and were eligible for inclusion. Table 1 presents the profile information of the included students and their responses regarding the main barriers to enrollment in an ultrasound course. The response rates for 1POT and 3POT were 49% and 32%, respectively. None of the students had participated in previous ultrasound courses. The mean course satisfaction score was 9.03 out of 10.

Table 1
Profile of the participants according to their responses to one of the precourse questionnaires (n=37).

Age
<20 years	12 (32%)
21-25 years	22 (60%)
>25 years	3 (8%)
Gender
Male	13 (35%)
Female	24 (65%)
Year of medical education
1st and 2nd years	18 (49%)
3rd and 4th years	15 (40%)
5th and 6th years	4 (11%)
Baseline familiarity with ultrasound equipment (more than one answer per student permitted)
None	30 (79%)
Knows how to change transducers	3 (8%)
Knows how to choose the appropriate transducer	Zero
Knows basic features	2 (5%)
Knows advanced features	Zero
Barriers to enrollment in an ultrasound course (more than one answer per student permitted)
Financial investment	24 (65%)
Release from routine activities	14 (38%)
Course location	14 (38%)
Course duration	9 (24%)

A comparison of the PRT and 1POT responses showed overall knowledge acquisition, which was statistically significant for 6 of the 8 questions (Table 2). A comparison between 1POT and 3POT revealed no significant difference despite a mild decrease in correct answers (Table 3). This finding was correlated with knowledge retention in the mid-term (3 months).

Table 2
Comparison of correct responses at PRT and 1POT.

Topic	PRT (n=37)	1POT (n=18)	p-value
Q1. US machine functionalities	26 (70%)	15 (83%)	0.346
Q2. Transducer selection	28 (78%)	15 (83%)	0.731
Q3. FAST acoustic windows	27 (73%)	18 (100%)	0.021
Q4. EFAST acoustic windows	10 (27%)	13 (72%)	0.001*
Q5. Comparison: X-ray vs. US	6 (17%)	10 (55%)	0.004
Q6. Free fluid identification	8 (22%)	12 (66%)	0.001*
Q7. Hepatorenal evaluation in FAST	8 (22%)	13 (72%)	<0.001*
Q8. Pericardial evaluation in FAST	2 (6%)	12 (66%)	<0.001

• p-value using Fisher’s exact test.
• ^*
  p-value using the chi-square test.

DISCUSSION

The results of this study support the effectiveness and feasibility of a brief student-tailored ultrasound course. Comparisons of the answers to the questionnaires show acquisition and mid-term retention of knowledge.

The current study confirmed previous observations of the perceived barriers to ultrasound course enrollment. Financial investments, routine curricular activities, course location and time spent on the course were the main barriers. This brief course was also low-cost (less than US$ 30), included in symposium’s main scientific program, and performed at the same site. Hence, the main barriers were overcome. Some studies evaluate factors associated with limited incorporation of POCUS. One of the most important factors is the lack of training (¹⁸,¹⁹). However, evidence regarding a specific analysis of barriers to course enrollment is lacking. This unexplored subject may undermine the development of newer educational platforms (²⁰). Our study provides potentially useful results to enhance students’ participation in courses.

The optimal time to introduce POCUS concepts during medical education is still a matter of debate. The American Academy of Emergency Medicine advocates offering POCUS training to medical students (²,²¹,²²). In fact, the incorporation of ultrasonography is well accepted among students who recognize various applications of that technology (¹⁵,²³). Brunner et al. (²⁴) in 1995, debated the introduction of ultrasound concepts to medical students by using echocardiography as an adjunct to the cardiac physiology course. The author demonstrated that echocardiography received the best rating among several topics of the course. This success may be related to a unique ability of ultrasound: increased integration of other subjects, such as anatomy, physiology, radiology, and surgery. FAST is an excellent example of such integration and is easily reproducible.

Studies have shown that medical students are capable of using ultrasound. In a study by Gogalniceanu et al., UK medical students demonstrated 88% accuracy in identifying free peritoneal fluid after a 5-hour POCUS course (¹⁸). Additionally, participants reported overall improvement of their knowledge regarding radiological anatomy and interest in further ultrasound training. They stressed the need to have this training widely available during medical school. Indeed, there are several benefits associated with such curriculum modifications. Barriers such as costs and the search for an adequate course would likely disappear. Additionally, ultrasound education for medical students would be homogeneous and standardized.

Several studies have analyzed knowledge acquisition by medical students after an ultrasound course. However, as noted in Table 4, none evaluated its retention in the mid- or long-term (²⁰). Our results highlight the mid-term efficacy of a short and straightforward ultrasound course. Another interesting finding of our study is that the majority of the participants were enrolled in the preclinical stages of medical education. This result supports the ability of students in the early phases of medical school to acquire and retain knowledge.

Table 3
Comparison of correct responses at 1POT and 3POT.

Topic	1POT (n=18)	3POT (n=12)	p-value
Q1. US machine functionalities	15 (83%)	10 (83%)	0.999
Q2. Transducer selection	15 (83%)	10 (83%)	0.999
Q3. FAST acoustic windows	18 (100%)	10 (83%)	0.152
Q4. EFAST acoustic windows	13 (72%)	8 (66%)	0.999
Q5. Comparison: X-ray vs. US	10 (55%)	7 (58%)	0.999
Q6. Free fluid identification	12 (66%)	5 (41%)	0.119*
Q7. Hepatorenal evaluation in FAST	13 (72%)	5 (41%)	0.094*
Q8. Pericardial evaluation in FAST	12 (66%)	6 (50%)	0.361*

• p-value using Fisher’s exact test.
• ^*
  p-value using the chi-square test.

Table 4
Studies analyzing the impact of an ultrasound course on the knowledge of medical students.

	Number of participants	Subject	Course duration	Evaluation of knowledge acquisition	Evaluation of knowledge retention
Arger 2005 (17)	33	Kidney and aorta	4 weeks	Yes	No
Kondrashov 2015 (14)	248	Mixed	Not specified	Yes	No
Wong 2011 (13)	13	Aorta	21 days	Yes	No
Bell 2015 (15)	20	Heart	Not specified	Yes	No
Florescu 2015 (16)	64	Mixed	6 days	Yes	No
Gogalniceanu 2010 (18)	26	FAST	Not specified	Yes	No
Menegozzo 2019 (23)	37	FAST	50 min	Yes	Yes

Limitations

The evaluation of knowledge based on theoretical questions, and no practical evaluation was performed. Hence, we could not assess mid-term knowledge retention in terms of actual performance of the exam. The participants’ response rate decreased during the study, and only 32% completed the 3POT questionnaire. This means that a potential significant difference may not have been detected and that there is a risk of selection bias. Moreover, we could not compare the results to a control group because every student participated in the course. Last, we did not determine whether the students had gathered information from other sources during the 3-month interval between the two questionnaires (1POT and 3POT), although this was unlikely.

CONCLUSION

This study makes two main contributions. First, a brief student-tailored ultrasound course results in knowledge acquisition and mid-term retention. Second, we demonstrated that costs, release from routine activities, location, and duration may undermine course enrollment. Factors impacting the dissemination and routine application of POCUS should be systematically assessed. The adoption of structured POCUS courses for medical students depends on a better understanding of the results of such training. We should make efforts to establish effective educational strategies to avoid potential barriers to course enrollment. Further prospective studies evaluating the impact of mid-term knowledge retention on the development of practical skills must be designed.

ACKNOWLEDGMENTS

We thank Dr. Inês Nishimoto for performing the statistical analysis of the study’s data.

REFERENCES

• ¹
  Wittenberg M. Will ultrasound scanners replace the stethoscope? BMJ. 2014;348:g3463. https://doi.org/10.1136/bmj.g3463
  » https://doi.org/10.1136/bmj.g3463
• ²
  Fakoya FA, du Plessis M, Gbenimacho IB. Ultrasound and stethoscope as tools in medical education and practice: considerations for the archives. Adv Med Educ Pract. 2016;7:381-7. https://doi.org/10.2147/AMEP.S99740
  » https://doi.org/10.2147/AMEP.S99740
• ³
  Lindelius A, Törngren S, Nilsson L, Pettersson H, Adami J. Randomized clinical trial of bedside ultrasound among patients with abdominal pain in the emergency department: impact on patient satisfaction and health care consumption. Scand J Trauma Resusc Emerg Med. 2009;17:60. https://doi.org/10.1186/1757-7241-17-60
  » https://doi.org/10.1186/1757-7241-17-60
• ⁴
  Arntfield RT, Millington SJ. Point of care cardiac ultrasound applications in the emergency department and intensive care unit-a review. Curr Cardiol Rev. 2012;8(2):98-108. https://doi.org/10.2174/157340312801784952
  » https://doi.org/10.2174/157340312801784952
• ⁵
  Davis JJ, Wessner CE, Potts J, Au AK, Pohl CA, Fields JM. Ultrasonography in Undergraduate Medical Education: A Systematic Review. J Ultrasound Med. 2018;37(11):2667-79. https://doi.org/10.1002/jum.14628
  » https://doi.org/10.1002/jum.14628
• ⁶
  Montoya J, Stawicki SP, Evans DC, Bahner DP, Sparks S, Sharpe RP, et al. From FAST to E-FAST: an overview of the evolution of ultrasound-based traumatic injury assessment. Eur J Trauma Emerg Surg. 2016;42(2):119-26. https://doi.org/10.1007/s00068-015-0512-1
  » https://doi.org/10.1007/s00068-015-0512-1
• ⁷
  Mandavia DP, Aragona J, Chan L, Chan D, Henderson SO. Ultrasound training for emergency physicians - a prospective study. Acad Emerg Med. 2000;7(9):1008-14. https://doi.org/10.1111/j.1553-2712.2000.tb02092.x
  » https://doi.org/10.1111/j.1553-2712.2000.tb02092.x
• ⁸
  Zago M, Martinez Casas I, Pereira J, Mariani D, Silva AR, Casamassima A, et al. Tailored ultrasound learning for acute care surgeons: a review of the MUSEC (Modular UltraSound ESTES Course) project. Eur J Trauma Emerg Surg. 2016;42(2):161-8. https://doi.org/10.1007/s00068-016-0651-z
  » https://doi.org/10.1007/s00068-016-0651-z
• ⁹
  Cartier RA 3rd, Skinner C, Laselle B. Perceived effectiveness of teaching methods for point of care ultrasound. J Emerg Med. 2014;47(1):86-91. https://doi.org/10.1016/j.jemermed.2014.01.027
  » https://doi.org/10.1016/j.jemermed.2014.01.027
• ¹⁰
  Walcher F, Kirschning T, Muller MP, Byhahn C, Stier M, Russeler M, et al. Accuracy of prehospital focused abdominal sonography for trauma after a 1-day hands-on training course. Emerg Med J. 2010;27(5):345-9. https://doi.org/10.1136/emj.2008.059626
  » https://doi.org/10.1136/emj.2008.059626
• ¹¹
  Halverson AL, Darosa DA, Borgstrom DC, Caropreso PR, Hughes TG, Hoyt DB, et al. Evaluation of a blended learning surgical skills course for rural surgeons. Am J Surg. 2014;208(1):136-42. https://doi.org/10.1016/j.amjsurg.2013.12.039
  » https://doi.org/10.1016/j.amjsurg.2013.12.039
• ¹²
  Abbasi S, Farsi D, Hafezimoghadam P, Fathi M, Zare M. Accuracy of emergency physician-performed ultrasound in detecting traumatic pneumothorax after a 2-h training course. Eur J Emerg Med. 2013;20(3):173-7. https://doi.org/10.1097/MEJ.0b013e328356f754
  » https://doi.org/10.1097/MEJ.0b013e328356f754
• ¹³
  Wong I, Jayatilleke T, Kendall R, Atkinson P. Feasibility of a focused ultrasound training programme for medical undergraduate students. Clin Teach. 2011;8(1):3-7. https://doi.org/10.1111/j.1743-498X.2010.00416.x
  » https://doi.org/10.1111/j.1743-498X.2010.00416.x
• ¹⁴
  Kondrashov P, Johnson JC, Boehm K, Rice D, Kondrashova T. Impact of the clinical ultrasound elective course on retention of anatomical knowledge by second-year medical students in preparation for board exams. Clin Anat. 2015;28(2):156-63. https://doi.org/10.1002/ca.22494
  » https://doi.org/10.1002/ca.22494
• ¹⁵
  Bell FE 3rd, Wilson LB, Hoppmann RA. Using ultrasound to teach medical students cardiac physiology. Adv Physiol Educ. 2015;39(4):392-6. https://doi.org/10.1152/advan.00123.2015
  » https://doi.org/10.1152/advan.00123.2015
• ¹⁶
  Florescu CC, Mullen JA, Nguyen VM, Sanders BE, Vu PQ. Evaluating Didactic Methods for Training Medical Students in the Use of Bedside Ultrasound for Clinical Practice at a Faculty of Medicine in Romania. J Ultrasound Med. 2015;34(10):1873-82. https://doi.org/10.7863/ultra.14.09028
  » https://doi.org/10.7863/ultra.14.09028
• ¹⁷
  Arger PH, Schultz SM, Sehgal CM, Cary TW, Aronchick J. Teaching medical students diagnostic sonography. J Ultrasound Med. 2005;24(10):1365-9. https://doi.org/10.7863/jum.2005.24.10.1365
  » https://doi.org/10.7863/jum.2005.24.10.1365
• ¹⁸
  Gogalniceanu P, Sheena Y, Kashef E, Purkayastha S, Darzi A, Paraskeva P. Is basic emergency ultrasound training feasible as part of standard undergraduate medical education? J Surg Educ. 2010;67(3):152-6. https://doi.org/10.1016/j.jsurg.2010.02.008
  » https://doi.org/10.1016/j.jsurg.2010.02.008
• ¹⁹
  von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. Int J Surg. 2014;12(12):1495-9. https://doi.org/10.1016/j.ijsu.2014.07.013
  » https://doi.org/10.1016/j.ijsu.2014.07.013
• ²⁰
  Shah S, Bellows BA, Adedipe AA, Totten JE, Backlund BH, Sajed D. Perceived barriers in the use of ultrasound in developing countries. Crit Ultrasound J. 2015;7(1):28. https://doi.org/10.1186/s13089-015-0028-2
  » https://doi.org/10.1186/s13089-015-0028-2
• ²¹
  Eisen LA, Leung S, Gallagher AE, Kvetan V. Barriers to ultrasound training in critical care medicine fellowships: a survey of program directors. Crit Care Med. 2010;38(10):1978-83. https://doi.org/10.1097/CCM.0b013e3181eeda53
  » https://doi.org/10.1097/CCM.0b013e3181eeda53
• ²²
  Soucy ZP, Mills LD. American Academy of Emergency Medicine Position Statement: Ultrasound Should Be Integrated into Undergraduate Medical Education Curriculum. J Emerg Med. 2015;49(1):89-90. https://doi.org/10.1016/j.jemermed.2014.12.092
  » https://doi.org/10.1016/j.jemermed.2014.12.092
• ²³
  Menegozzo CAM, Utiyama EM. Getting out of the comfort zone with point-of-care ultrasound. Am J Surg. 2019;217(1):190-1. https://doi.org/10.1016/j.amjsurg.2018.02.006
  » https://doi.org/10.1016/j.amjsurg.2018.02.006
• ²⁴
  Brunner M, Moeslinger T, Spieckermann PG. Echocardiography for teaching cardiac physiology in practical student courses. Am J Physiol. 1995;268(6 Pt 3):S2-9. https://doi.org/10.1152/advances.1995.268.6.S2
  » https://doi.org/10.1152/advances.1995.268.6.S2

Publication Dates

• Publication in this collection
  16 Sept 2019
• Date of issue
  2019

History

• Received
  5 Dec 2018
• Accepted
  5 June 2019