Acessibilidade / Reportar erro

Injury Frequency in Handball Players: A Descriptive Study of Injury Pattern in São Paulo State Regional Teams

Abstract

Aim:

To assess the frequency of injuries among male and female handball athletes, identifying injured anatomic parts, injury diagnostics, their severity and type.

Methods:

The participants were composed of 122 handball players from São Paulo state teams, being 63 male (21.2±5.3 years) and 59 female (19.9±5.3 years) athletes who were interviewed using the “Champion Profile” questionnaire. The injuries were sorted by type: acute or overuse; and severity (major, moderate, slight, minor), given by the period of absence from team activities (training sessions and matches), and our results are presented as descriptive statistics.

Results:

The majority of injuries was found in the lower limbs, both in female (69.6%) and male (47.4%) players, as well as the knee was the most commonly injured anatomic part, representing 33.7% and 20.8% of the total number of injuries for the respective genders. We found a higher number of major injuries in female (35.8%) and male (20.8%) players when compared to the other severity categories. The acute injuries were more common among the total sample (48%) when compared to overuse injuries (22.7%), while a sprain was the most commonly diagnosed injury.

Conclusion:

It was observed that Brazilian handball players demonstrated an important number of major and acute injuries, forcing them to abstain from training sessions and matches, which can lead to both team and athlete performance losses. Furthermore, we suggest the inclusion of preventive training to reduce the frequency of injuries in handball athletes.

Keywords:
Handball; sports injury; knee injury; ankle injury; ACL rupture

Introduction

Regular sports participation may greatly benefit the health, life quality, and welfare of the general human population, helping to prevent diseases and provide a healthier aging. However, besides the benefits, there is always the risk of injuries, inherent to any physical activity11. Verhagen EA, Van der Beek AJ, Bouter LM, Bahr RM, Van Mechelen W. A one season prospective cohort study of volleyball injuries. Br J Sports Med. 2004 Aug;38(4):477-81. PubMed PMID: 15273190. Pubmed Central PMCID: 1724865.), (22. Tirabassi J, Brou L, Khodaee M, Lefort R, Fields SK, Comstock RD. Epidemiology of High School Sports-Related Injuries Resulting in Medical Disqualification: 2005-2006 Through 2013-2014 Academic Years. Am J Sports Med. 2016 Nov;44(11):2925-32. PubMed PMID: 27166289. Epub 2016/05/12. eng..

According to van Mechelen, Hlobil33. Van Mechelen W, Hlobil H, Kemper HC. Incidence, severity, aetiology and prevention of sports injuries. A review of concepts. Sports medicine (Auckland, NZ). 1992 Aug;14(2):82-99. PubMed PMID: 1509229. Epub 1992/08/01.eng., injuries are damage occurring in body tissues, resulting from a physical trauma generated by intrinsic and extrinsic factors. The intrinsic factors are related to individual physical, cognitive, and performance characteristics; the extrinsic factors are related to external or environmental characteristics which may influence the risk of injuries44. Meeuwisse WH. Assessing Causation in Sport Injury: A Multifactorial Model. Clin J Sport Med. 1994;4(3):166-70.. The combination of intrinsic characteristics and injury related extrinsic factors may result in an increased risk of injury33. Van Mechelen W, Hlobil H, Kemper HC. Incidence, severity, aetiology and prevention of sports injuries. A review of concepts. Sports medicine (Auckland, NZ). 1992 Aug;14(2):82-99. PubMed PMID: 1509229. Epub 1992/08/01.eng..

Handball is one of the most popular sports in Europe55. Moller M, Attermann J, Myklebust G, Wedderkopp N. Injury risk in Danish youth and senior elite handball using a new SMS text messages approach. Br J Sports Med. 2012 Jun;46(7):531-7. PubMed PMID: 22554848. Epub 2012/05/05. eng., considered a high-intensity sport, in which physical contact is common, as well as cuttings and feints during sprints66. Langevoort G, Myklebust G, Dvorak J, Junge A. Handball injuries during major international tournaments. Scand J Med Sci Sports. 2007 Aug;17(4):400-7. PubMed PMID: WOS:000248481300015. English.), (77. Myklebust G, Maehlum S, Engebretsen L, Strand T, Solheim E. Registration of cruciate ligament injuries in Norwegian top level team handball. A prospective study covering two seasons. Scand J Med Sci Sports. 1997 Oct;7(5):289-92. PubMed PMID: WOS:A1997YA31600006. English., increasing the risk of injury and raising interest of the epidemiological area in this modality88. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English.), (99. Noyes FR, Dunworth LA, Andriacchi TP, Andrews M, Hewett TE. Knee hyperextension gait abnormalities in unstable knees - Recognition and preoperative gait retraining. Am J Sport Med. 1996 Jan-Feb;24(1):35-45. PubMed PMID: WOS:A1996TR33800007. English..

In particular, when it comes to injuries in handball, the lower limbs are more frequently affected1010. Seil R, Rupp S, Tempelhof S, Kohn D. Sports injuries in team handball A one-year prospective study of sixteen men's senior teams of a superior nonprofessional level. Am J Sports Med. 1998;26(5):681-7.)- (1212. Giroto N, Hespanhol Junior LC, Gomes MR, Lopes AD. Incidence and risk factors of injuries in Brazilian elite handball players: A prospective cohort study. Scand J Med Sci Sports. 2017 Feb;27(2):195-202. PubMed PMID: 26661576. Epub 2015/12/15. eng., with the knee and ankle joints being the most commonly injured anatomic parts77. Myklebust G, Maehlum S, Engebretsen L, Strand T, Solheim E. Registration of cruciate ligament injuries in Norwegian top level team handball. A prospective study covering two seasons. Scand J Med Sci Sports. 1997 Oct;7(5):289-92. PubMed PMID: WOS:A1997YA31600006. English.)- (1010. Seil R, Rupp S, Tempelhof S, Kohn D. Sports injuries in team handball A one-year prospective study of sixteen men's senior teams of a superior nonprofessional level. Am J Sports Med. 1998;26(5):681-7.), (1313. Cumps E, Verhagen E, Meeusen R. Efficacy of a sports specific balance training programme on the incidence of ankle sprains in basketball. J Sports Sci Med. 2007;6(2):212-9. PubMed PMID: 24149331. Pubmed Central PMCID: 3786242.)- (1515. Higashi RH, Santos MB, de Castro GTM, Ejnisman B, Sano SS, Da Cunha RA. Lesões musculoesqueléticas em jovens atletas de handebol: um estudo transversal. Fisioterapia e Pesquisa. 2015;22(1):84-9.. However, due to different study designs, injury definition, and populations investigated, it is difficult to understand and estimate the incidence of injuries in this sport77. Myklebust G, Maehlum S, Engebretsen L, Strand T, Solheim E. Registration of cruciate ligament injuries in Norwegian top level team handball. A prospective study covering two seasons. Scand J Med Sci Sports. 1997 Oct;7(5):289-92. PubMed PMID: WOS:A1997YA31600006. English.), (88. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English..

In this sense, Olsen, Myklebust88. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English. and Wedderkopp, Kaltoft1414. Wedderkopp N, Kaltoft M, Lundgaard B, Rosendahl M, Froberg K. Injuries in young female players in European team handball. Scand J Med Sci Sports. 1997 Dec;7(6):342-7. PubMed PMID: 9458500. describe the sprain as the most common injury in handball, and the predominant diagnostic as anterior cruciate ligament (ACL) rupture, with increased injury values for this anatomic part in epidemiological studies with male and female handball athletes1616. Engebretsen L, Soligard T, Steffen K, Alonso JM, Aubry M, Budgett R, et al. Sports injuries and illnesses during the London Summer Olympic Games 2012. Br J Sports Med. 2013 May;47(7):407-14. PubMed PMID: 23515712.)- (1818. Griffin LY, Albohm MJ, Arendt EA, Bahr R, Beynnon BD, Demaio M, et al. Understanding and preventing noncontact anterior cruciate ligament injuries: a review of the Hunt Valley II meeting, January 2005. Am J Sports Med. 2006 Sep;34(9):1512-32. PubMed PMID: 16905673.. An ACL rupture may occur with or without physical contact between players. However, in 70 to 84% of the cases the ACL is injured during non-contact game actions1919. Micheo W, Hernandez L, Seda C. Evaluation, management, rehabilitation, and prevention of anterior cruciate ligament injury: current concepts. PM R. 2010 Oct;2(10):935-44. PubMed PMID: 20970763., it being important to emphasize that female athletes are twice as likely to injure this ligament than male athletes77. Myklebust G, Maehlum S, Engebretsen L, Strand T, Solheim E. Registration of cruciate ligament injuries in Norwegian top level team handball. A prospective study covering two seasons. Scand J Med Sci Sports. 1997 Oct;7(5):289-92. PubMed PMID: WOS:A1997YA31600006. English.. Hewett, Myer2020. Hewett TE, Myer GD, Ford KR. Prevention of anterior cruciate ligament injuries. Current women's health reports. 2001 Dec;1(3):218-24. PubMed PMID: 12112973. affirm that women are more susceptible to ACL rupture during cuts, landings, and rotation movements due to three factors: hormonal, anatomical, and neuromuscular differences, only the latter of which can possibly be improved with training2121. Arendt E, Bershadsky B, Agel J. Periodicity of noncontact anterior cruciate ligament injuries during the menstrual cycle. J Gend Specif Med. 2002;5(2):19-26..

Moreover, the time of practice is also related to the incidence of injuries in handball athletes. Higashi, Santos1515. Higashi RH, Santos MB, de Castro GTM, Ejnisman B, Sano SS, Da Cunha RA. Lesões musculoesqueléticas em jovens atletas de handebol: um estudo transversal. Fisioterapia e Pesquisa. 2015;22(1):84-9. point out that athletes with more than 6 years of experience are more frequently injured, mainly knee and ankle joints, which together represent approximately 50% of the total trauma in handball players. Furthermore, Olsen, Myklebust88. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English. report that 79% of the injuries in handball are acute. The same authors found a greater incidence of acute major injuries during matches than during training sessions, however acute injuries of lesser severities (Slight and Minor) were more frequently reported during matches when compared to those reported during training sessions.

A study conducted in Denmark via electronic questionnaire2222. Bueno AM, Pilgaard M, Hulme A, Forsberg P, Ramskov D, Damsted C, et al. Injury prevalence across sports: a descriptive analysis on a representative sample of the Danish population. Injury epidemiology. 2018 Apr 2;5(1):6. PubMed PMID: 29607462. Pubmed Central PMCID: PMC5879036. Epub 2018/04/03. eng., found that handball is one of the sport’s most likely to provoke injuries to children and adolescents (7 to 15-year-old), representing almost 14% of the total injuries reported between several sports. Therefore, according to van Mechelen, Hlobil2323. van Mechelen W, Hlobil H, Kemper HC. Incidence, severity, aetiology and prevention of sports injuries. Sports Med. 1992;14(2):82-99., studies that focus on sports injuries are necessary to understand the risk factors and mechanisms which lead to the occurrence of injuries in handball players.

Therefore, sports injury epidemiological investigations are of indubitable importance to achieve better understanding regarding the studied population, i.e.: Brazilian handball players. However, we observed that there are a lack of data and research concerning handball in Brazil1212. Giroto N, Hespanhol Junior LC, Gomes MR, Lopes AD. Incidence and risk factors of injuries in Brazilian elite handball players: A prospective cohort study. Scand J Med Sci Sports. 2017 Feb;27(2):195-202. PubMed PMID: 26661576. Epub 2015/12/15. eng.), (2424. Sanches FG, Borin SH. Lesões mais comuns no Handebol. Anuário da Produção Acadêmica Docente. 2009;2(3):233-40., highlighting the need for more studies with the purpose of determining real and solid values in this science field, especially when comparing physical, tactical, and game characteristics between European and South American handball athletes.

Thus, the present study aimed to investigate the frequency of injuries among São Paulo State handball players of both genders, specifying the most commonly injured anatomic parts, the injury diagnostics, their severity and type.

Methods

Design

A transversal retrospective study with elite handball players defending teams from São Paulo State. Female and male athletes agreed to participate in this research.

Sample

The sample included 122 handball athletes, from São Paulo state leagues, which have great representation and prominence in the national scenario. Regarding the categories investigated, according to the International Handball Federation - IHF (2007), junior (under-21 for male and under-20 for female) and adult categories (≥ 22 years for male and ≥ 21 years for female) were included, of which 63 belong to male teams (21.2 ± 5.3 years) and 59 to female teams (19.9 ± 5.3 years).

All athletes were participants in systematized training sessions with a minimum frequency of three sessions/week with a duration between 90 and 120 minutes each. In addition, all participants had a minimum of three years training experience. The average age at which the participants started to practice handball was 12.8 ± 2.6 and 12.2 ± 2.9 years for male and female groups, respectively.

The participants agreed to answer the proposed questionnaire and signed the informed consent and agreement term approved by the institutional Ethics Committee (protocol 1490/2012).

Questionnaire

To gain information on injury frequency, injured anatomic parts, and diagnostics, the Champion Profile questionnaire, from the National Center of Sports Excellence (CENESP, Brazil Sports Ministry) was implemented2525. De Rose G, Tadiello FF, de Rose D. Lesões esportivas: um estudo com atletas do basquetebol brasileiro. Lecturas: Educación física y deportes. 2006 (94):19.), (2626. Antonio ED, Ruschel C, Back R, de Souza TG, Haupenthal A, Pereira SM. Prevalência de Lesões em Atletas de Voleibol de Diferentes Categorias. Arquivos em Movimento. 2013;9(2):34-47.. This instrument was applied during the team training sessions, individually with each athlete, by the researchers of the institution concerned. From the collected data it was possible to identify results concerning injury frequency, injured anatomic parts, diagnostics, and severity, and classify injuries between acute and chronic88. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English.), (2727. Yang JZ, Tibbetts AS, Covassin T, Cheng G, Nayar S, Heiden E. Epidemiology of Overuse and Acute Injuries Among Competitive Collegiate Athletes. J Athl Training. 2012 Mar-Apr;47(2):198-204. PubMed PMID: WOS:000302386600011. English.. The classifications of injury type and severity are presented in Table 1.

Table 1
Adopted injury definitions and classifications regarding type (Yang, Tibbetts2727. Yang JZ, Tibbetts AS, Covassin T, Cheng G, Nayar S, Heiden E. Epidemiology of Overuse and Acute Injuries Among Competitive Collegiate Athletes. J Athl Training. 2012 Mar-Apr;47(2):198-204. PubMed PMID: WOS:000302386600011. English.) and severity (Olsen, Myklebust88. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English.).

Statistical Analysis

The results were analyzed by descriptive statistics (percentage, mean and standard deviation) and are presented in tables and graphics. Relative frequency of groups (male and female) and subgroups (anatomic part, severity, and type) were compared using Pearson chi-square tests. The statistical analysis was performed using SPSS.20 and the statistical significance level was set at α = 0.05.

Results

High numbers of injuries were found for both genders in this study, with a total value of 218 injuries, of which 120 were in male athletes and 98 in female (Table 2). Injuries to the lower limbs represented 47.4% of total male injuries and 69.6% of female injuries. The most commonly reported injured anatomic part was the knee (20.8% and 33.8% for male and female athletes, respectively). Concerning the upper limbs, the shoulder joint was reported as the most frequently injured, accounting for 19.2% of total injuries in male participants and 5.1% in female participants (Table 2). The injury severities reported by both genders and total values are presented in Figure 1.

Table 2
Absolute and percent values of injuries by anatomic part reported by handball players (male, female, and both genders (total)).

Figure 1
Severity of injuries reported by handball players: male (A), female (B), and both genders

According to Olsen, Myklebust88. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English. who identified injury severity classifications, from total values, 40.3% were major injuries (Figure 1c), being more frequently reported by male (44.1%) than female players (35.7%) (Figure 1a), while slight injuries were more often reported by women (30.6%) than men (23%) (Figure 1b).

Acute injuries were more common (48%), with overuse injuries representing 22.71% of the total (Figure 2). A similar frequency of acute injuries was found between men and women (53.1% versus 41.4%). Furthermore, the male sample reported higher values of overuse injuries, with statistical difference (21.7% versus 16.2%, p = .001).

Interactions were found between gender and injured anatomic part, while male athletes reported a higher proportion of injuries to upper limbs (39.2% versus 21.4%; p = .015), female athletes presented a greater proportion in the lower limbs (73% versus 55%; p = .015). No statistical differences were found for injury severity between genders.

Figure 2
Injury types reported by handball players (male and female).

In total, 229 diagnostics were observed, this number being greater than the total number of injuries as some presented multiple diagnostics. Of the 229, 130 (57%) were reported by male and 99 by female teams. A total of 39 different diagnostics were found, with sprains being the most common in both genders (21.2% in female and 13.1% in male athletes - Table 3). Following sprains, tendinitis was reported as the second most frequent diagnosis, representing 10% and 12.3% for male and female genders, respectively.

Table 3
Injury diagnostics reported by handball athletes (male, female, and both genders (total)).

Discussion

Handball is a contact sport with high potential for the occurrence of injury, due to its characteristics and the interaction between intrinsic and extrinsic factors of the players. This high potential is especially observed among female players, with a focus on the lower limbs. Thus, the objective of the present study was to investigate the injury frequency among São Paulo State handball players, which was described as high, especially in the lower limbs, with acute injuries as the most common injury type and sprains as the most commonly reported diagnostic.

The majority of injuries occurred, for both genders, to the lower limbs, with the sprain being the most common injury, corroborating findings in the literature88. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English.), (1010. Seil R, Rupp S, Tempelhof S, Kohn D. Sports injuries in team handball A one-year prospective study of sixteen men's senior teams of a superior nonprofessional level. Am J Sports Med. 1998;26(5):681-7.)- (1212. Giroto N, Hespanhol Junior LC, Gomes MR, Lopes AD. Incidence and risk factors of injuries in Brazilian elite handball players: A prospective cohort study. Scand J Med Sci Sports. 2017 Feb;27(2):195-202. PubMed PMID: 26661576. Epub 2015/12/15. eng.), (1414. Wedderkopp N, Kaltoft M, Lundgaard B, Rosendahl M, Froberg K. Injuries in young female players in European team handball. Scand J Med Sci Sports. 1997 Dec;7(6):342-7. PubMed PMID: 9458500.. This finding is likely to be specific to the investigated sport, as continuous direction changes and cuts, repeated landings, floor type, and intensity of the game result in excessive loads on lower limbs. Moreover, Giroto, Hespanhol Junior1212. Giroto N, Hespanhol Junior LC, Gomes MR, Lopes AD. Incidence and risk factors of injuries in Brazilian elite handball players: A prospective cohort study. Scand J Med Sci Sports. 2017 Feb;27(2):195-202. PubMed PMID: 26661576. Epub 2015/12/15. eng. found similar results with Brazilian athletes: increased levels of traumatic/acute injuries, in which the lower limbs were the most affected anatomic part.

Likewise, a predominance of acute in comparison to chronic/overuse injuries was observed, as reported in some reviewed studies88. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English.), (2727. Yang JZ, Tibbetts AS, Covassin T, Cheng G, Nayar S, Heiden E. Epidemiology of Overuse and Acute Injuries Among Competitive Collegiate Athletes. J Athl Training. 2012 Mar-Apr;47(2):198-204. PubMed PMID: WOS:000302386600011. English.. This might be due to the lack of follow up performed by a medical/physiotherapist committee, and the absence of early diagnostics for chronic injuries in the population of this study, as the majority of participating teams do not have sports physicians and physiotherapists accompanying the athletes daily. Furthermore, the high number of different diagnostics can be explained by the influence of previous injuries55. Moller M, Attermann J, Myklebust G, Wedderkopp N. Injury risk in Danish youth and senior elite handball using a new SMS text messages approach. Br J Sports Med. 2012 Jun;46(7):531-7. PubMed PMID: 22554848. Epub 2012/05/05. eng.. Wedderkopp, Kaltoft1414. Wedderkopp N, Kaltoft M, Lundgaard B, Rosendahl M, Froberg K. Injuries in young female players in European team handball. Scand J Med Sci Sports. 1997 Dec;7(6):342-7. PubMed PMID: 9458500. and Van Mechelen, Twisk2828. Van Mechelen W, Twisk J, Molendijk A, Blom B, Snel J, Kemper HC. Subject-related risk factors for sports injuries: a 1-yr prospective study in young adults. Med Sci Sports Exerc. 1996 Sep;28(9):1171-9. PubMed PMID: 8883006. Epub 1996/09/01. eng. pointed out the relationship between new and previous injuries, especially ankle sprains. The same can be applied to overuse injuries, since Giroto, Hespanhol Junior1212. Giroto N, Hespanhol Junior LC, Gomes MR, Lopes AD. Incidence and risk factors of injuries in Brazilian elite handball players: A prospective cohort study. Scand J Med Sci Sports. 2017 Feb;27(2):195-202. PubMed PMID: 26661576. Epub 2015/12/15. eng. showed that handball players with previous injuries presented a 2.5-times increased risk of reporting a new overuse injury; this type of injury being more common in adult than young athletes, due to several factors, such as accumulated residual trauma and more injuries sustained over time2929. Roos KG, Marshall SW, Kerr ZY, Golightly YM, Kucera KL, Myers JB, et al. Epidemiology of Overuse Injuries in Collegiate and High School Athletics in the United States. Am J Sports Med. 2015 Jul;43(7):1790-7. PubMed PMID: 25930673. Epub 2015/05/02. eng..

Specifically regarding the lower limbs, knee and ankle joints were the most frequently injured, as found by Giroto, Hespanhol Junior1212. Giroto N, Hespanhol Junior LC, Gomes MR, Lopes AD. Incidence and risk factors of injuries in Brazilian elite handball players: A prospective cohort study. Scand J Med Sci Sports. 2017 Feb;27(2):195-202. PubMed PMID: 26661576. Epub 2015/12/15. eng., Olsen, Myklebust88. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English., Seil, Rupp1010. Seil R, Rupp S, Tempelhof S, Kohn D. Sports injuries in team handball A one-year prospective study of sixteen men's senior teams of a superior nonprofessional level. Am J Sports Med. 1998;26(5):681-7., Wedderkopp, Kaltoft1414. Wedderkopp N, Kaltoft M, Lundgaard B, Rosendahl M, Froberg K. Injuries in young female players in European team handball. Scand J Med Sci Sports. 1997 Dec;7(6):342-7. PubMed PMID: 9458500., and the main mechanisms responsible for susceptibility to these injuries, were identified as tibia anterior rotation, due to knee valgus collapse1818. Griffin LY, Albohm MJ, Arendt EA, Bahr R, Beynnon BD, Demaio M, et al. Understanding and preventing noncontact anterior cruciate ligament injuries: a review of the Hunt Valley II meeting, January 2005. Am J Sports Med. 2006 Sep;34(9):1512-32. PubMed PMID: 16905673.), (3030. Kristianslund E, Faul O, Bahr R, Myklebust G, Krosshaug T. Sidestep cutting technique and knee abduction loading: implications for ACL prevention exercises. Brit J Sport Med. 2012 May;48(9):779-83. PubMed PMID: WOS:000334672600011. English., as well as dorsiflexion strength and amplitude, muscular reaction, and coordination, when considering the ankle3131. Willems TM, Witvrouw E, Delbaere K, Philippaerts R, De Bourdeaudhuij I, De Clercq D. Intrinsic risk factors for inversion ankle sprains in females--a prospective study. Scand J Med Sci Sports. 2005 Oct;15(5):336-45. PubMed PMID: 16181258. Epub 2005/09/27. eng.), (3232. Willems TM, Witvrouw E, Delbaere K, Mahieu N, De Bourdeaudhuij I, De Clercq D. Intrinsic risk factors for inversion ankle sprains in male subjects: a prospective study. Am J Sports Med. 2005 Mar;33(3):415-23. PubMed PMID: 15716258. Epub 2005/02/18. eng., since a sprain was identified as the most common injury for these participants.

Wedderkopp, Kaltoft1414. Wedderkopp N, Kaltoft M, Lundgaard B, Rosendahl M, Froberg K. Injuries in young female players in European team handball. Scand J Med Sci Sports. 1997 Dec;7(6):342-7. PubMed PMID: 9458500. found a high incidence of injury among handball players (40.7 injuries/1000 hours of game), the majority in the lower limbs. Agreeing with these results, Olsen, Myklebust88. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English. identified the knee and ankle joints as the most injured anatomic parts in this sport, considering both genders. However, the findings of the present study are in agreement with those found by Seil, Rupp1010. Seil R, Rupp S, Tempelhof S, Kohn D. Sports injuries in team handball A one-year prospective study of sixteen men's senior teams of a superior nonprofessional level. Am J Sports Med. 1998;26(5):681-7., which indicate that female players are more susceptible to suffer injuries to the lower limbs than male athletes. In the same way, the epidemiological study of Lindblad, Hoy3838. Lindblad BE, Hoy K, Terkelsen CJ, Helleland HE, Terkelsen CJ. Handball injuries. An epidemiologic and socioeconomic study. Am J Sports Med. 1992; 20(4):441-4. found women to be injured 2-times more than men in handball, which, according to Hewett, Torg3636. Hewett TE, Torg JS, Boden BP. Video analysis of trunk and knee motion during non-contact anterior cruciate ligament injury in female athletes: lateral trunk and knee abduction motion are combined components of the injury mechanism. Brit J Sport Med. 2009;43(6):417-22., is due to hormonal, anatomic, and neuromuscular factors that, consequently, influences in the valgus (mechanism of injury), making female athletes more susceptible to sport injuries than their male counterparts.

The disparity in the frequency of knee injuries between genders may be related to anatomic (ACL thickness), biomechanical (Q angle and knee valgus) (3333. Hewett TE, Ford KR, Myer GD. Anterior cruciate ligament injuries in female athletes - Part 2, a meta-analysis of neuromuscular interventions aimed at injury prevention. Am J Sport Med. 2005 Mar;34(3):490-8. PubMed PMID: WOS:000235449900020. English., hormonal (relation between female sex hormones peak and ligament laxity) (2121. Arendt E, Bershadsky B, Agel J. Periodicity of noncontact anterior cruciate ligament injuries during the menstrual cycle. J Gend Specif Med. 2002;5(2):19-26., and neuromuscular divergences (differences between activation of quadriceps and hamstrings) (3434. Hewett TE. Neuromuscular and hormonal factors associated with knee injuries in female athletes. Sports Med. 2000;29(5):313-27.. It is important to emphasize that these factors, alone or together, mean female athletes are much more susceptible to sports injuries, especially when exposed to risky situations.

As our results show, the knee joint is the main focus of injuries, and this finding is corroborated by the studied literature88. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English.), (1313. Cumps E, Verhagen E, Meeusen R. Efficacy of a sports specific balance training programme on the incidence of ankle sprains in basketball. J Sports Sci Med. 2007;6(2):212-9. PubMed PMID: 24149331. Pubmed Central PMCID: 3786242.), (1414. Wedderkopp N, Kaltoft M, Lundgaard B, Rosendahl M, Froberg K. Injuries in young female players in European team handball. Scand J Med Sci Sports. 1997 Dec;7(6):342-7. PubMed PMID: 9458500.), (3535. Mandelbaum BR, Silvers HJ, Watanabe DS, Knarr JF, Thomas SD, Griffin LY, et al. Effectiveness of a neuromuscular and proprioceptive training program in preventing anterior cruciate ligament injuries in female athletes: 2-year follow-up. Am J Sports Med. 2005 Jul;33(7):1003-10. PubMed PMID: 15888716., although it was not evident from our data that the ACL is the most injured knee tissue, as described by many works77. Myklebust G, Maehlum S, Engebretsen L, Strand T, Solheim E. Registration of cruciate ligament injuries in Norwegian top level team handball. A prospective study covering two seasons. Scand J Med Sci Sports. 1997 Oct;7(5):289-92. PubMed PMID: WOS:A1997YA31600006. English.), (1717. Zebis MK, Andersen LL, Bencke J, Kjær M, Aagaard P. Identification of athletes at future risk of anterior cruciate ligament ruptures by neuromuscular screening. Am J Sports Med. 2009;37(10):1967-73.), (3636. Hewett TE, Torg JS, Boden BP. Video analysis of trunk and knee motion during non-contact anterior cruciate ligament injury in female athletes: lateral trunk and knee abduction motion are combined components of the injury mechanism. Brit J Sport Med. 2009;43(6):417-22.), (3737. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury mechanisms for anterior cruciate ligament injuries in team handball a systematic video analysis. Am J Sport Med. 2004 Jun;32(4):1002-12. PubMed PMID: WOS:000221706200021. English.. Concerning the ankle joint, which presented a high number of injuries, some authors have found an equally elevated number of injuries for this anatomic part66. Langevoort G, Myklebust G, Dvorak J, Junge A. Handball injuries during major international tournaments. Scand J Med Sci Sports. 2007 Aug;17(4):400-7. PubMed PMID: WOS:000248481300015. English.), (88. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English.), (3535. Mandelbaum BR, Silvers HJ, Watanabe DS, Knarr JF, Thomas SD, Griffin LY, et al. Effectiveness of a neuromuscular and proprioceptive training program in preventing anterior cruciate ligament injuries in female athletes: 2-year follow-up. Am J Sports Med. 2005 Jul;33(7):1003-10. PubMed PMID: 15888716.), (3838. Lindblad BE, Hoy K, Terkelsen CJ, Helleland HE, Terkelsen CJ. Handball injuries. An epidemiologic and socioeconomic study. Am J Sports Med. 1992; 20(4):441-4., with a sprain being the most common injury reported by the athletes, once again, agreeing with the investigated studies88. Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English.), (1414. Wedderkopp N, Kaltoft M, Lundgaard B, Rosendahl M, Froberg K. Injuries in young female players in European team handball. Scand J Med Sci Sports. 1997 Dec;7(6):342-7. PubMed PMID: 9458500.. As suggested by Aman, Forssblad3939. Aman M, Forssblad M, Larsen K. Incidence and body location of reported acute sport injuries in seven sports using a national insurance database. Scand J Med Sci Sports. 2018 Mar;28(3):1147-58. PubMed PMID: 28782303. Epub 2017/08/07. eng., special attention should be given to preventing upper and lower limb injuries in handball, mainly at higher levels of practice, as they found an increased incidence of injuries in Swedish national leagues.

Although female athletes presented a greater prevalence of injuries to the lower limbs, the exact opposite was found for the upper limbs, as the male sample presented the highest number for this anatomic part, with the shoulder being the most commonly injured structure. A similar result was found in Brazilian athletes in a study that identified an increased injury risk for the shoulder4040. Constante SF. Incidência de lesões em atletas de handebol.: Universidade do Sul de Santa Catarina; 2005.. Similar results were also found by Giroto, Hespanhol Junior1212. Giroto N, Hespanhol Junior LC, Gomes MR, Lopes AD. Incidence and risk factors of injuries in Brazilian elite handball players: A prospective cohort study. Scand J Med Sci Sports. 2017 Feb;27(2):195-202. PubMed PMID: 26661576. Epub 2015/12/15. eng., in which the shoulder was the anatomic part with greater values for chronic/overuse injuries, and by Myklebust, Hasslan4141. Myklebust G, Hasslan L, Bahr R, Steffen K. High prevalence of shoulder pain among elite Norwegian female handball players. Scand J Med Sci Sports. 2013 Jun;23(3):288-94. PubMed PMID: 22092886. Epub 2011/11/19. eng. where handball athletes presented a history of shoulder pain, directly affecting training and competition performance. These types of results arise from game/training actions, as the large numbers of throws and passes, in addition to tackles and defensive actions, in many cases directly to the shoulder, increase the vulnerability of this joint to injuries4242. Wilk KE, Meister K, Andrews JR. Current concepts in the rehabilitation of the overhead throwing athlete. Am J Sports Med. 2002 Jan-Feb;30(1):136-51. PubMed PMID: 11799012. Epub 2002/01/19. eng.)- (4444. Andersson SH, Bahr R, Clarsen B, Myklebust G. Risk factors for overuse shoulder injuries in a mixed-sex cohort of 329 elite handball players: previous findings could not be confirmed. Br J Sports Med. 2017 Aug 7. PubMed PMID: 28784621. Epub 2017/08/09. eng.. In this way, it has been suggested that external rotation strength, scapular muscle strength, kinetic chain, and thoracic mobility are efficient to prevent shoulder injuries4545. Andersson SH, Bahr R, Clarsen B, Myklebust G. Preventing overuse shoulder injuries among throwing athletes: a cluster-randomised controlled trial in 660 elite handball players. Br J Sports Med. 2017 Jul;51(14):1073-80. PubMed PMID: 27313171. Epub 2016/06/18. eng..

The most significant limitation of this study is the application of a retrospective questionnaire, as the athletes were required to remember all the aspects investigated regarding their past injuries, impairing the data collection regarding time if they could not specify all information needed (i.e., past events that led to injuries). Due to this fact a longitudinal approach is recommended to determine, in a more effective manner, the epidemiological scope of injuries and traumas coming from handball practice. In addition, it is also suggested that future studies aim to identify the mechanisms of injuries in handball via medical and coach reports, elucidating how they occur, how to avoid them, and how to decrease their severity, in the inevitable case of occurrence.

Through our results, it is possible to observe an increased risk of lower limb injuries, particularly among women, and an equally augmented danger of the occurrence of acute injuries in both male and female athletes. Furthermore, attention should be given to overuse and upper limb injuries, mainly between male handball players, as, in the present research, they showed a higher proportion of injuries to this anatomic segment than their female counterparts.

These findings focus attention on the search for specific and efficient countermeasures, which aim to lower/prevent the occurrence of injuries, especially, but not uniquely, in the female population, decreasing individual and team losses. Finally, future studies may use the results of the present research to prepare and suggest injury prevention protocols (proprioception, neuromuscular, balance training, etc.) in order to assist coaches and physical trainers to reduce the risk of injuries.

Acknowledgements

The authors would like to thank the National Council of Technological and Scientific Development (CNPq - Brazil) (process: 2010.1.204.90.2, 2011.1.395.90.3 and 2012.1.366.90.4) for the financial support. Moreover, the authors thank the technical committee and athletes of each team for participating and contributing to the present study.

References

  • 1
    Verhagen EA, Van der Beek AJ, Bouter LM, Bahr RM, Van Mechelen W. A one season prospective cohort study of volleyball injuries. Br J Sports Med. 2004 Aug;38(4):477-81. PubMed PMID: 15273190. Pubmed Central PMCID: 1724865.
  • 2
    Tirabassi J, Brou L, Khodaee M, Lefort R, Fields SK, Comstock RD. Epidemiology of High School Sports-Related Injuries Resulting in Medical Disqualification: 2005-2006 Through 2013-2014 Academic Years. Am J Sports Med. 2016 Nov;44(11):2925-32. PubMed PMID: 27166289. Epub 2016/05/12. eng.
  • 3
    Van Mechelen W, Hlobil H, Kemper HC. Incidence, severity, aetiology and prevention of sports injuries. A review of concepts. Sports medicine (Auckland, NZ). 1992 Aug;14(2):82-99. PubMed PMID: 1509229. Epub 1992/08/01.eng.
  • 4
    Meeuwisse WH. Assessing Causation in Sport Injury: A Multifactorial Model. Clin J Sport Med. 1994;4(3):166-70.
  • 5
    Moller M, Attermann J, Myklebust G, Wedderkopp N. Injury risk in Danish youth and senior elite handball using a new SMS text messages approach. Br J Sports Med. 2012 Jun;46(7):531-7. PubMed PMID: 22554848. Epub 2012/05/05. eng.
  • 6
    Langevoort G, Myklebust G, Dvorak J, Junge A. Handball injuries during major international tournaments. Scand J Med Sci Sports. 2007 Aug;17(4):400-7. PubMed PMID: WOS:000248481300015. English.
  • 7
    Myklebust G, Maehlum S, Engebretsen L, Strand T, Solheim E. Registration of cruciate ligament injuries in Norwegian top level team handball. A prospective study covering two seasons. Scand J Med Sci Sports. 1997 Oct;7(5):289-92. PubMed PMID: WOS:A1997YA31600006. English.
  • 8
    Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury pattern in youth team handball: a comparison of two prospective registration methods. Scand J Med Sci Sports. 2006 Dec;16(6):426-32. PubMed PMID: WOS:000242610300008. English.
  • 9
    Noyes FR, Dunworth LA, Andriacchi TP, Andrews M, Hewett TE. Knee hyperextension gait abnormalities in unstable knees - Recognition and preoperative gait retraining. Am J Sport Med. 1996 Jan-Feb;24(1):35-45. PubMed PMID: WOS:A1996TR33800007. English.
  • 10
    Seil R, Rupp S, Tempelhof S, Kohn D. Sports injuries in team handball A one-year prospective study of sixteen men's senior teams of a superior nonprofessional level. Am J Sports Med. 1998;26(5):681-7.
  • 11
    Sallis R, Jones K, Sunshine S, Smith G, Simon L. Comparing sports injuries in men and women. Int J Sports Med. 2001;22(6):420-3.
  • 12
    Giroto N, Hespanhol Junior LC, Gomes MR, Lopes AD. Incidence and risk factors of injuries in Brazilian elite handball players: A prospective cohort study. Scand J Med Sci Sports. 2017 Feb;27(2):195-202. PubMed PMID: 26661576. Epub 2015/12/15. eng.
  • 13
    Cumps E, Verhagen E, Meeusen R. Efficacy of a sports specific balance training programme on the incidence of ankle sprains in basketball. J Sports Sci Med. 2007;6(2):212-9. PubMed PMID: 24149331. Pubmed Central PMCID: 3786242.
  • 14
    Wedderkopp N, Kaltoft M, Lundgaard B, Rosendahl M, Froberg K. Injuries in young female players in European team handball. Scand J Med Sci Sports. 1997 Dec;7(6):342-7. PubMed PMID: 9458500.
  • 15
    Higashi RH, Santos MB, de Castro GTM, Ejnisman B, Sano SS, Da Cunha RA. Lesões musculoesqueléticas em jovens atletas de handebol: um estudo transversal. Fisioterapia e Pesquisa. 2015;22(1):84-9.
  • 16
    Engebretsen L, Soligard T, Steffen K, Alonso JM, Aubry M, Budgett R, et al. Sports injuries and illnesses during the London Summer Olympic Games 2012. Br J Sports Med. 2013 May;47(7):407-14. PubMed PMID: 23515712.
  • 17
    Zebis MK, Andersen LL, Bencke J, Kjær M, Aagaard P. Identification of athletes at future risk of anterior cruciate ligament ruptures by neuromuscular screening. Am J Sports Med. 2009;37(10):1967-73.
  • 18
    Griffin LY, Albohm MJ, Arendt EA, Bahr R, Beynnon BD, Demaio M, et al. Understanding and preventing noncontact anterior cruciate ligament injuries: a review of the Hunt Valley II meeting, January 2005. Am J Sports Med. 2006 Sep;34(9):1512-32. PubMed PMID: 16905673.
  • 19
    Micheo W, Hernandez L, Seda C. Evaluation, management, rehabilitation, and prevention of anterior cruciate ligament injury: current concepts. PM R. 2010 Oct;2(10):935-44. PubMed PMID: 20970763.
  • 20
    Hewett TE, Myer GD, Ford KR. Prevention of anterior cruciate ligament injuries. Current women's health reports. 2001 Dec;1(3):218-24. PubMed PMID: 12112973.
  • 21
    Arendt E, Bershadsky B, Agel J. Periodicity of noncontact anterior cruciate ligament injuries during the menstrual cycle. J Gend Specif Med. 2002;5(2):19-26.
  • 22
    Bueno AM, Pilgaard M, Hulme A, Forsberg P, Ramskov D, Damsted C, et al. Injury prevalence across sports: a descriptive analysis on a representative sample of the Danish population. Injury epidemiology. 2018 Apr 2;5(1):6. PubMed PMID: 29607462. Pubmed Central PMCID: PMC5879036. Epub 2018/04/03. eng.
  • 23
    van Mechelen W, Hlobil H, Kemper HC. Incidence, severity, aetiology and prevention of sports injuries. Sports Med. 1992;14(2):82-99.
  • 24
    Sanches FG, Borin SH. Lesões mais comuns no Handebol. Anuário da Produção Acadêmica Docente. 2009;2(3):233-40.
  • 25
    De Rose G, Tadiello FF, de Rose D. Lesões esportivas: um estudo com atletas do basquetebol brasileiro. Lecturas: Educación física y deportes. 2006 (94):19.
  • 26
    Antonio ED, Ruschel C, Back R, de Souza TG, Haupenthal A, Pereira SM. Prevalência de Lesões em Atletas de Voleibol de Diferentes Categorias. Arquivos em Movimento. 2013;9(2):34-47.
  • 27
    Yang JZ, Tibbetts AS, Covassin T, Cheng G, Nayar S, Heiden E. Epidemiology of Overuse and Acute Injuries Among Competitive Collegiate Athletes. J Athl Training. 2012 Mar-Apr;47(2):198-204. PubMed PMID: WOS:000302386600011. English.
  • 28
    Van Mechelen W, Twisk J, Molendijk A, Blom B, Snel J, Kemper HC. Subject-related risk factors for sports injuries: a 1-yr prospective study in young adults. Med Sci Sports Exerc. 1996 Sep;28(9):1171-9. PubMed PMID: 8883006. Epub 1996/09/01. eng.
  • 29
    Roos KG, Marshall SW, Kerr ZY, Golightly YM, Kucera KL, Myers JB, et al. Epidemiology of Overuse Injuries in Collegiate and High School Athletics in the United States. Am J Sports Med. 2015 Jul;43(7):1790-7. PubMed PMID: 25930673. Epub 2015/05/02. eng.
  • 30
    Kristianslund E, Faul O, Bahr R, Myklebust G, Krosshaug T. Sidestep cutting technique and knee abduction loading: implications for ACL prevention exercises. Brit J Sport Med. 2012 May;48(9):779-83. PubMed PMID: WOS:000334672600011. English.
  • 31
    Willems TM, Witvrouw E, Delbaere K, Philippaerts R, De Bourdeaudhuij I, De Clercq D. Intrinsic risk factors for inversion ankle sprains in females--a prospective study. Scand J Med Sci Sports. 2005 Oct;15(5):336-45. PubMed PMID: 16181258. Epub 2005/09/27. eng.
  • 32
    Willems TM, Witvrouw E, Delbaere K, Mahieu N, De Bourdeaudhuij I, De Clercq D. Intrinsic risk factors for inversion ankle sprains in male subjects: a prospective study. Am J Sports Med. 2005 Mar;33(3):415-23. PubMed PMID: 15716258. Epub 2005/02/18. eng.
  • 33
    Hewett TE, Ford KR, Myer GD. Anterior cruciate ligament injuries in female athletes - Part 2, a meta-analysis of neuromuscular interventions aimed at injury prevention. Am J Sport Med. 2005 Mar;34(3):490-8. PubMed PMID: WOS:000235449900020. English.
  • 34
    Hewett TE. Neuromuscular and hormonal factors associated with knee injuries in female athletes. Sports Med. 2000;29(5):313-27.
  • 35
    Mandelbaum BR, Silvers HJ, Watanabe DS, Knarr JF, Thomas SD, Griffin LY, et al. Effectiveness of a neuromuscular and proprioceptive training program in preventing anterior cruciate ligament injuries in female athletes: 2-year follow-up. Am J Sports Med. 2005 Jul;33(7):1003-10. PubMed PMID: 15888716.
  • 36
    Hewett TE, Torg JS, Boden BP. Video analysis of trunk and knee motion during non-contact anterior cruciate ligament injury in female athletes: lateral trunk and knee abduction motion are combined components of the injury mechanism. Brit J Sport Med. 2009;43(6):417-22.
  • 37
    Olsen OE, Myklebust G, Engebretsen L, Bahr R. Injury mechanisms for anterior cruciate ligament injuries in team handball a systematic video analysis. Am J Sport Med. 2004 Jun;32(4):1002-12. PubMed PMID: WOS:000221706200021. English.
  • 38
    Lindblad BE, Hoy K, Terkelsen CJ, Helleland HE, Terkelsen CJ. Handball injuries. An epidemiologic and socioeconomic study. Am J Sports Med. 1992; 20(4):441-4.
  • 39
    Aman M, Forssblad M, Larsen K. Incidence and body location of reported acute sport injuries in seven sports using a national insurance database. Scand J Med Sci Sports. 2018 Mar;28(3):1147-58. PubMed PMID: 28782303. Epub 2017/08/07. eng.
  • 40
    Constante SF. Incidência de lesões em atletas de handebol.: Universidade do Sul de Santa Catarina; 2005.
  • 41
    Myklebust G, Hasslan L, Bahr R, Steffen K. High prevalence of shoulder pain among elite Norwegian female handball players. Scand J Med Sci Sports. 2013 Jun;23(3):288-94. PubMed PMID: 22092886. Epub 2011/11/19. eng.
  • 42
    Wilk KE, Meister K, Andrews JR. Current concepts in the rehabilitation of the overhead throwing athlete. Am J Sports Med. 2002 Jan-Feb;30(1):136-51. PubMed PMID: 11799012. Epub 2002/01/19. eng.
  • 43
    Kelly BT, Barnes RP, Powell JW, Warren RF. Shoulder injuries to quarterbacks in the national football league. Am J Sports Med. 2004 Mar;32(2):328-31. PubMed PMID: 14977655. Epub 2004/02/24. eng.
  • 44
    Andersson SH, Bahr R, Clarsen B, Myklebust G. Risk factors for overuse shoulder injuries in a mixed-sex cohort of 329 elite handball players: previous findings could not be confirmed. Br J Sports Med. 2017 Aug 7. PubMed PMID: 28784621. Epub 2017/08/09. eng.
  • 45
    Andersson SH, Bahr R, Clarsen B, Myklebust G. Preventing overuse shoulder injuries among throwing athletes: a cluster-randomised controlled trial in 660 elite handball players. Br J Sports Med. 2017 Jul;51(14):1073-80. PubMed PMID: 27313171. Epub 2016/06/18. eng.

Publication Dates

  • Publication in this collection
    22 Aug 2019
  • Date of issue
    2019

History

  • Received
    25 Apr 2018
  • Accepted
    22 Nov 2018
Universidade Estadual Paulista Universidade Estadual Paulista, Av. 24-A, 1515, 13506-900 Rio Claro, SP/Brasil, Tel.: (55 19) 3526-4330 - Rio Claro - SP - Brazil
E-mail: motriz.rc@unesp.br