Acessibilidade / Reportar erro

Translation and cross-cultural adaptation of the Motor Behavior Checklist (MBC) into Brazilian Portuguese

Tradução e adaptação transcultural para o português do Brasil do Motor Behavior Checklist (MBC)

Abstract

Introduction

There are only a few instruments available to assess behavioral problems in school-age children based on reports of physical education teachers. The Motor Behavior Checklist (MBC) was designed to be completed by this professional in free play-situations or during physical education classes to rate students’ motor-related behavior using 5-point Likert scales. The MBC comprises 59 items distributed into two broadband factors (externalizing and internalizing) and seven behavior problem scales: rule breaking, hyperactivity/impulsivity, lack of attention, low energy, stereotyped behaviors, lack of social interaction, and lack of self-regulation. The objective of this study was to describe the translation and cross-cultural adaptation processes of the MBC into Brazilian Portuguese.

Method

The following procedures were conducted: forward translation of the original instrument, production of a synthesized version, back-translation, literal and semantic comparison, back-translator’s evaluation of divergent items, synthesized version with back-translator’s suggestions, clarity assessment of the synthesized version by professionals (physical education teachers), focus group to assess clarity indicators of the instrument, evaluation of adjustments by the author of the instrument, and production of the final version.

Results

The results indicated a satisfactory level of agreement between the original and the back-translated versions, with 68% of exact equivalence between the translated items and 16% of terms requiring minor adjustments. In the draft version, 84% of the items were evaluated as clear by physical education teachers.

Conclusion

The translated version has compatible content with the original version. Future studies should be conducted to assess the psychometric properties of the Brazilian Portuguese version of the MBC.

Motor behavior; children; physical education; attention; cross-cultural adaptation

Resumo

Introdução

Existem poucos instrumentos disponíveis para avaliar problemas de comportamento em crianças em idade escolar com base no relato de professores de educação física. O Motor Behavior Checklist (MBC) foi criado para ser usado por este profissional observando a criança em uma situação de brincadeira livre ou nas aulas de educação física utilizando escalas Likert de 5 pontos. O MBC compreende 59 itens distribuídos em duas categorias (externalizantes e internalizantes) e sete escalas de problemas de comportamento: quebra de regras, hiperatividade/impulsividade, falta de atenção, baixa energia, comportamentos estereotipados, falta de interação social e falta de autorregulação. O objetivo deste estudo foi descrever o processo de tradução e adaptação transcultural do MBC para o português do Brasil.

Método

Os procedimentos foram: tradução do instrumento original, produção de uma versão sintetizada, retrotradução, comparação literal e semântica, parecer do retrotradutor sobre itens divergentes, versão síntese com as sugestões do retrotradutor, avaliação da clareza da versão síntese por profissionais (professores de educação física), grupo focal para avaliar indicadores de clareza do instrumento, avaliação dos ajustes pelo autor do instrumento e produção da versão final.

Resultados

Os resultados indicaram um nível satisfatório de concordância entre as versões originais e retrotraduzidas, com 68% de itens iguais e 16% de itens com poucas alterações. A versão síntese teve 84% dos itens avaliados como claros por professores de educação física.

Conclusão

A versão traduzida possui conteúdo compatível com a versão original. Estudos futuros deverão ser conduzidos para a verificação das propriedades psicométricas da versão em português brasileiro do MBC.

Comportamento motor; crianças; educação física; atenção; adaptação transcultural

Introduction

Neurodevelopmental disorders (NDD) are a group of disorders that typically manifest early in development, usually before the age at which children start school. NDD are characterized by developmental deficits that range from specific limitations of learning or control of executive functions to global impairments of social skills or intelligence.11. Associação Americana de Psiquiatria. Manual Diagnóstico e Estatístico de Transtornos Mentais, 5ª edição (DSM-5). Porto Alegre: Artmed; 2014. Parents/teachers are often asked to answer questions about the behavior of their children/students during the assessment of developmental impairments and/or behavioral problems. This approach allows the collection of standardized information about child behavior in different environments and in natural conditions. Considering the school setting, most studies show that classroom teachers play a key role in providing information about a child’s behavior.22. Lyra GFD, Assis SG de, Njaine K, Oliveira R de VC de, Pires TdeO. A relação entre professores com sofrimento psíquico e crianças escolares com problemas de comportamento. Cienc Saude Coletiva. 2009;14:435-44.

3. Bordin IA, Rocha MM, Paula, CS, Teixeira MCTV, Achenbach TM, Rescorla LA, et al. Child Behavior Checklist (CBCL), Youth Self-Report (YSR) and Teacher’s Report Form (TRF): an overview of the development of the original and Brazilian versions. Cad Saude Publica. 2013;29:13-28.

4. Hanssen-Bauer K, Langsrud Ø, Kvernmo S, Heyerdahl S. Clinician-rated mental health in outpatient child and adolescent mental health services: associations with parent, teacher and adolescent ratings. Child Adolesc Psychiatry Ment Health. 2010;4:29.
-55. Gooch D, Maydew H, Sears C, Norbury CF. Does a child’s language ability affect the correspondence between parent and teacher ratings of ADHD symptoms? BMC Psychiatry. 2017;17:129.

Only a few studies have assessed instruments that rely on physical education teachers as a main source of information about emotional, behavioral, and/or developmental problems in school-age children. Although reports of physical education teachers could be used as a criterion to identify signs of NDD in children, the instruments aimed at these professionals are not considered as important sources of information for behavioral difficulties because they usually focus on movement and motor coordination problems.66. Efstratopoulou M, Janssen R, Simons J. Assessing children at risk: psychometric properties of the Motor Behavior Checklist. J Atten Disord. 2015;19:1054-63. However, physical education classes and team games allow the naturalistic observation of several behavioral repertoires exhibited during social interactions, cooperative games, competitions, decision making and problem solving scenarios, and rule-following situations, among others.77. Johnson RC, Rosén LA. Sports behavior of ADHD children. J Atten Disord. 2000;4:150-60.,88. Clendenin AA, Businelle MS, Kelley ML. Sports Behavior Checklist: factor structure, convergent and divergent validity, and screening ADHD problems in the group differences. J Atten Disord. 2005;8:79-87. Therefore, physical education teachers could play a key role in assessing their students’ behavior.66. Efstratopoulou M, Janssen R, Simons J. Assessing children at risk: psychometric properties of the Motor Behavior Checklist. J Atten Disord. 2015;19:1054-63.

Attention deficit hyperactivity disorder (ADHD) is one among the NDD that physical education teachers could help identify by gathering information about student behavior. During physical education classes, students are required to behave in a variety of ways; in the presence of ADHD, a child usually exhibits problems in executive functioning areas such as turn-taking, motor movement at varying levels (depending on the type of activity), cooperation, decision-making, and focusing on the same task for an extended period.

The Sports Behavior Checklist is a 29-item informant report measure developed to assess behavioral difficulties in children with ADHD. The instrument evaluates involvement in individual and team sports, addressing the length of participation, types of sports played, and quality of involvement.77. Johnson RC, Rosén LA. Sports behavior of ADHD children. J Atten Disord. 2000;4:150-60. The remaining 26 items assess frequency of aggression, emotional reactivity, injury, disqualification, adherence to rules, and sportsman-like conduct. A study with boys aged 6-17 years – 34 with ADHD and 41 without ADHD – showed higher levels of aggression, emotional reactivity, and frequency of disqualification in children with ADHD when compared to those without the disorder. However, both groups presented high levels of aggression and emotional reactivity when playing team sports compared to individual sports.77. Johnson RC, Rosén LA. Sports behavior of ADHD children. J Atten Disord. 2000;4:150-60.

Clendenin et al.88. Clendenin AA, Businelle MS, Kelley ML. Sports Behavior Checklist: factor structure, convergent and divergent validity, and screening ADHD problems in the group differences. J Atten Disord. 2005;8:79-87. verified the psychometric properties of the Sport Behavior Checklist in a sample of 5-13-year-old children composed of 58 boys and 34 girls, 49 with ADHD and 43 without ADHD. They also found higher levels of aggression, emotional reactivity, and frequency of disqualification in children with ADHD, similar to the results of the other study previously mentioned.77. Johnson RC, Rosén LA. Sports behavior of ADHD children. J Atten Disord. 2000;4:150-60. Although the Sports Behavior Checklist is widely used to assess the behavior of children in sports settings, the instrument was not designed as a screening tool to identify different disorders during sports practice.

In this scenario, the Motor Behavior Checklist (MBC) for Children99. Efstratopoulou M, Janssen R, Simons J. Differentiating children with attention-deficit/hyperactivity disorder, conduct disorder, learning disabilities and autistic spectrum disorders by means of their motor behavior characteristics. Res Dev Disabil. 2012;33:196-204. was developed with 59 items evaluating motor behavior distributed into two broadband factors – internalizing and externalizing behaviors – and seven behavior problem scales. Externalizing behaviors include rule-breaking (7 items), hyperactivity and impulsivity (14 items), and lack of attention (10 items). Internalizing behaviors include low energy (4 items), stereotyped behaviors (2 items), lack of social interaction (10 items), and lack of self-regulation (12 items). Many of these categories of behavioral problems can be observed in the form of both deficits and excesses in ADHD and autistic spectrum disorder (ASD).1010. Efstratopoulou M, Janssen R, Simons J. Agreement among physical educators, teachers and parents on children’s behaviors: a multitrait-multimethod design approach. Res Dev Disabil. 2012;33:1343-51. The MBC should be completed observing the child in a free-play situation or during physical education classes. The score is obtained through a 5-point Likert scale ranging from never (0) to almost always (4). Efstratopoulou et al.99. Efstratopoulou M, Janssen R, Simons J. Differentiating children with attention-deficit/hyperactivity disorder, conduct disorder, learning disabilities and autistic spectrum disorders by means of their motor behavior characteristics. Res Dev Disabil. 2012;33:196-204. evaluated the psychometric properties of the MBC: coefficients of internal consistency (α) ranged from 0.82 to 0.95, reproducibility according to intraclass correlation coefficients (ICC) ranged from 0.85 to 0.90, and concordance (also ICC) ranged from 0.75 to 0.91. These data suggest that the MBC for children is a homogeneous instrument in terms of content, with high stability and correlation.99. Efstratopoulou M, Janssen R, Simons J. Differentiating children with attention-deficit/hyperactivity disorder, conduct disorder, learning disabilities and autistic spectrum disorders by means of their motor behavior characteristics. Res Dev Disabil. 2012;33:196-204.

The authors of that study99. Efstratopoulou M, Janssen R, Simons J. Differentiating children with attention-deficit/hyperactivity disorder, conduct disorder, learning disabilities and autistic spectrum disorders by means of their motor behavior characteristics. Res Dev Disabil. 2012;33:196-204. evaluated 83 children with different diagnoses (ADHD, conduct disorder, learning disorders, and ASD) using physical education teachers as informants for the MBC. The instrument revealed that children with ADHD displayed more symptoms of hyperactivity and attention deficit, that children with conduct disorder had more problems related to breaking rules, that children with ASD showed more problems with stereotyped behaviors and lack of social interaction, and that children with learning disorders showed no significant differences in relation to the other groups. These results indicate that the MBC is a useful tool to discriminate between the core symptoms of ADHD, conduct disorder, and ASD.99. Efstratopoulou M, Janssen R, Simons J. Differentiating children with attention-deficit/hyperactivity disorder, conduct disorder, learning disabilities and autistic spectrum disorders by means of their motor behavior characteristics. Res Dev Disabil. 2012;33:196-204.

In another study, Efstratopoulou et al.1010. Efstratopoulou M, Janssen R, Simons J. Agreement among physical educators, teachers and parents on children’s behaviors: a multitrait-multimethod design approach. Res Dev Disabil. 2012;33:1343-51. examined the agreement among different instruments by assessing a group of students as follows: the MBC completed by the physical education teacher; the Teacher Report Form (TRF) and the ADHD Rating Scale-IV completed by the classroom teacher; and the parent’s version of the Child Behavior Checklist (CBCL) and the ADHD Rating Scale-IV completed by the parents. The authors found significant correlations with specific MBC subscales and the corresponding subscales of the TRF, CBCL, and ADHD Rating Scale-IV. In particular, they found significant correlations for the rule breaking, lack of attention, hyperactivity/impulsivity, and lack of social interaction problem scales, and for the internalizing, externalizing, and total scores. In relation to the ADHD scale – more specifically lack of attention and hyperactivity/impulsivity scales –, the MBC items demonstrated convergent relationships with the ADHD Rating Scale-IV (teachers and parents), with greater correlations between physical educators and teachers than between physical educators and parents for both scales.

The MBC has also shown highly sensitive psychometric properties in the identification of ASD signs,99. Efstratopoulou M, Janssen R, Simons J. Differentiating children with attention-deficit/hyperactivity disorder, conduct disorder, learning disabilities and autistic spectrum disorders by means of their motor behavior characteristics. Res Dev Disabil. 2012;33:196-204. a disorder characterized by persistent deficits in social communication and social interaction in multiple settings, including deficits in social reciprocity and non-verbal and verbal communication. In addition to deficits in social communication, the diagnosis of ASD requires the presence of restricted and repetitive patterns of behavior, interests, or activities.11. Associação Americana de Psiquiatria. Manual Diagnóstico e Estatístico de Transtornos Mentais, 5ª edição (DSM-5). Porto Alegre: Artmed; 2014.

In social interaction settings with multiple stimuli, the behavioral patterns of children with ADHD and ASD can be more clearly expressed than in a classroom environment, where stimuli are tightly controlled and students are supposed to follow more rigid rules of behavior. Therefore, the MBC is an important tool both to assist physical education teachers in the process of referring students for a more detailed evaluation and to collect information from children and adolescents as part of the process of clinical investigation.

Although no consensus can be found in the literature on the steps for a cross-cultural adaptation process, scholars agree that this process must go beyond a simple translation,1111. Borsa JC, Damasio BF, Bandeira DR. Adaptação e validação de instrumentos psicológicos entre culturas: algumas considerações. Paideia. 2012;22:423-32.,1212. Gjersing L, Caplehorn JR, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. 2010;10:13. since a translation alone does not guarantee the reliability and construct validity of the instrument.1111. Borsa JC, Damasio BF, Bandeira DR. Adaptação e validação de instrumentos psicológicos entre culturas: algumas considerações. Paideia. 2012;22:423-32. Several steps are necessary to ensure a careful process of cross-cultural adaptation of an instrument.1111. Borsa JC, Damasio BF, Bandeira DR. Adaptação e validação de instrumentos psicológicos entre culturas: algumas considerações. Paideia. 2012;22:423-32.

12. Gjersing L, Caplehorn JR, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. 2010;10:13.
-1313. International Test Commission. The ITC guidelines for translating and adapting tests (second edition) [Internet]. 2017 [cited 2018 Mar 21]. https://www.intestcom.org/files/guideline_test_adaptation_2ed.pdf
https://www.intestcom.org/files/guidelin...
The first step consists of translating the document, which must be performed by more than one translator.1111. Borsa JC, Damasio BF, Bandeira DR. Adaptação e validação de instrumentos psicológicos entre culturas: algumas considerações. Paideia. 2012;22:423-32.

12. Gjersing L, Caplehorn JR, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. 2010;10:13.
-1313. International Test Commission. The ITC guidelines for translating and adapting tests (second edition) [Internet]. 2017 [cited 2018 Mar 21]. https://www.intestcom.org/files/guideline_test_adaptation_2ed.pdf
https://www.intestcom.org/files/guidelin...
While the translation as the first step is common to all works, the subsequent steps may be diverse.

Some studies propose a synthesis of the translated versions followed by a back-translation.1212. Gjersing L, Caplehorn JR, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. 2010;10:13.,1414. Mondrzak R, Reinert C, Sandri A, Spanemberg L, Nogueira EL, Bertoluci M, et al. Translation and cross-cultural adaptation of the Rating Scale for Countertransference (RSCT) to American English. Trends Psychiatry Psychother. 2016;38:4.

15. Conti MA, Scagliusi F, Queiroz GK de O, Hearst N, Cordás TA. Adaptação transcultural: tradução e validação de conteúdo para o idioma português do modelo da Tripartite Influence Scale de insatisfação corporal. Cad Saude Publica. 2010;26:503-13.
-1616. Mattos P, Segenreich D, Saboya E, Louzã M, Dias G, Romano M. Adaptação transcultural para o português da escala Adult Self-Report Scale para avaliação do transtorno de déficit de atenção/hiperatividade (TDAH) em adultos. Rev Psiquiatr Clin. 2006;33:188-94. It is also recommended that more than one back-translator be used, which may increase financial costs.1212. Gjersing L, Caplehorn JR, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. 2010;10:13. The next step is the analysis by an expert panel and by target groups.1212. Gjersing L, Caplehorn JR, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. 2010;10:13.,1414. Mondrzak R, Reinert C, Sandri A, Spanemberg L, Nogueira EL, Bertoluci M, et al. Translation and cross-cultural adaptation of the Rating Scale for Countertransference (RSCT) to American English. Trends Psychiatry Psychother. 2016;38:4.

15. Conti MA, Scagliusi F, Queiroz GK de O, Hearst N, Cordás TA. Adaptação transcultural: tradução e validação de conteúdo para o idioma português do modelo da Tripartite Influence Scale de insatisfação corporal. Cad Saude Publica. 2010;26:503-13.
-1616. Mattos P, Segenreich D, Saboya E, Louzã M, Dias G, Romano M. Adaptação transcultural para o português da escala Adult Self-Report Scale para avaliação do transtorno de déficit de atenção/hiperatividade (TDAH) em adultos. Rev Psiquiatr Clin. 2006;33:188-94. Another possibility, as proposed by Borsa et al.,1111. Borsa JC, Damasio BF, Bandeira DR. Adaptação e validação de instrumentos psicológicos entre culturas: algumas considerações. Paideia. 2012;22:423-32. is that the evaluation by experts and later by target groups be done before the back-translation process.

After these steps, some authors also suggest a pilot study to assess the need for adjustment of the instrument before the final application.1111. Borsa JC, Damasio BF, Bandeira DR. Adaptação e validação de instrumentos psicológicos entre culturas: algumas considerações. Paideia. 2012;22:423-32.,1212. Gjersing L, Caplehorn JR, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. 2010;10:13.,1414. Mondrzak R, Reinert C, Sandri A, Spanemberg L, Nogueira EL, Bertoluci M, et al. Translation and cross-cultural adaptation of the Rating Scale for Countertransference (RSCT) to American English. Trends Psychiatry Psychother. 2016;38:4.

15. Conti MA, Scagliusi F, Queiroz GK de O, Hearst N, Cordás TA. Adaptação transcultural: tradução e validação de conteúdo para o idioma português do modelo da Tripartite Influence Scale de insatisfação corporal. Cad Saude Publica. 2010;26:503-13.
-1616. Mattos P, Segenreich D, Saboya E, Louzã M, Dias G, Romano M. Adaptação transcultural para o português da escala Adult Self-Report Scale para avaliação do transtorno de déficit de atenção/hiperatividade (TDAH) em adultos. Rev Psiquiatr Clin. 2006;33:188-94. Statistical analyses should be carried out in a complementary fashion to the cross-cultural adaptation process to evaluate the extent to which the instrument can, in fact, be considered valid for the setting to which it has been adapted.1111. Borsa JC, Damasio BF, Bandeira DR. Adaptação e validação de instrumentos psicológicos entre culturas: algumas considerações. Paideia. 2012;22:423-32.,1313. International Test Commission. The ITC guidelines for translating and adapting tests (second edition) [Internet]. 2017 [cited 2018 Mar 21]. https://www.intestcom.org/files/guideline_test_adaptation_2ed.pdf
https://www.intestcom.org/files/guidelin...

Mondrzak et al.1414. Mondrzak R, Reinert C, Sandri A, Spanemberg L, Nogueira EL, Bertoluci M, et al. Translation and cross-cultural adaptation of the Rating Scale for Countertransference (RSCT) to American English. Trends Psychiatry Psychother. 2016;38:4. used the guidelines proposed by the Task Force for Translation and Cultural Adaptation of the International Society for Pharmacoeconomics and Outcomes Research, which divides the translation process into 10 steps: preparation, forward translation, reconciliation of different translations into a single version, back-translation, back-translation review, harmonization, cognitive debriefing, review of cognitive debriefing results and finalization, proofreading, and final report.

Gjersing et al.,1212. Gjersing L, Caplehorn JR, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. 2010;10:13. in turn, performed a careful process of cross-cultural adaptation of a research instrument following 12 steps: investigation of conceptual and item equivalence, original instrument translation (by two fluent translators), compilation of a synthesized translated version (by a third translator), back-translation (by two fluent translators), compilation of a synthesized back-translated version (by a third back-translator), expert committee judgment, instrument pretest, revision of the instrument, investigation of operational equivalence, main study conduction, exploratory and confirmatory analysis, and final instrument consolidation.

Finally, Borsa et al.1111. Borsa JC, Damasio BF, Bandeira DR. Adaptação e validação de instrumentos psicológicos entre culturas: algumas considerações. Paideia. 2012;22:423-32. suggest a six-step process of cross-cultural adaptation: 1) translation of the instrument from the source language into the target language; 2) synthesis of translated versions; 3) synthesis evaluation by expert judges; 4) evaluation of the instrument by the target groups; 5) back-translation; and 6) pilot study. In addition to these six steps, the authors emphasize the importance of an assessment of the factorial structure of the instrument to confirm its stability in relation to the original document.

The objectives of the study were to describe the translation and cross-cultural adaptation processes of the MBC into Brazilian Portuguese and to present a validated version of the instrument in the target language.

Method

The translation and cross-cultural adaptation processes adopted in this study followed the main recommendations described in the works previously mentioned,1111. Borsa JC, Damasio BF, Bandeira DR. Adaptação e validação de instrumentos psicológicos entre culturas: algumas considerações. Paideia. 2012;22:423-32.

12. Gjersing L, Caplehorn JR, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. 2010;10:13.

13. International Test Commission. The ITC guidelines for translating and adapting tests (second edition) [Internet]. 2017 [cited 2018 Mar 21]. https://www.intestcom.org/files/guideline_test_adaptation_2ed.pdf
https://www.intestcom.org/files/guidelin...
-1414. Mondrzak R, Reinert C, Sandri A, Spanemberg L, Nogueira EL, Bertoluci M, et al. Translation and cross-cultural adaptation of the Rating Scale for Countertransference (RSCT) to American English. Trends Psychiatry Psychother. 2016;38:4. following 10 stages, which are described in sequential order in Figure 1 and Table 1.

Figure 1
Stages involved in the translation and cross-cultural adaptation processes of the Motor Behavior Checklist

Table 1
Description of the translation and cross-cultural adaptation stages

The project was approved by the ethics committee of Universidade Presbiteriana Mackenzie (protocol 1886171, CAAE 61179416.8.0000.0084). We received the author’s permission to translate and cross-culturally adapt the original version of the MBC into Brazilian Portuguese.

Results

The comparison of the back-translated version with the original version (stage 4) revealed 38 items satisfactorily translated (68%) and 18 divergent items (32%), which were forwarded to the back-translator along with the original version for consideration. The back-translator considered nine of these items as semantically identical – and, therefore acceptable –, but made comments about the other nine items (Table 2), setting up stage 5.

Table 2
Comparison between the original version of the Motor Behavior Checklist and the translated and back-translated versions with semantic adaptation

Taking into consideration the back-translator’s comments, a further synthesized version of the instrument was produced (stage 6). The following stage, clarity assessment, revealed that 84.7% of the items were clear (36 items [61%] had a mean score of 3, and 14 items [23.7%] had a mean of 2.75). Nine items were considered partially clear (3 [5%] with a mean of 2.5, 4 [6.8%] with a mean of 2.25, and 2 [3.3%] with a mean of 2).

The results of the analysis of the back-translated version with modifications as proposed by the focus group (stage 8) are shown in Table 3. Item 9 was considered clear by the focus group, and therefore required no alterations. Items 21 and 7 were modified in accordance with the focus group. The other items were kept according to the preliminary translated version, despite the modification suggestions.

Table 3
Modifications proposed by the focus group to the back-translated version of the Motor Behavior Checklist

Discussion

The cross-cultural adaptation and translation processes used in this article allowed the formulation of a Brazilian Portuguese version of the MBC that will enable physical education teachers to evaluate their student’s behavioral aspects in sports and free-play situations. It will also contribute to the identification of emotional and behavioral problems related to some NDD highly prevalent among children and adolescents.

Detailed assessment by a team of professionals with multiple instruments can benefit proper identification of behavior changes and/or developmental delays. Therefore, we highlight the importance of the cross-cultural adaptation of instruments for use in different countries, as demonstrated by previous works and performed in our study.1111. Borsa JC, Damasio BF, Bandeira DR. Adaptação e validação de instrumentos psicológicos entre culturas: algumas considerações. Paideia. 2012;22:423-32.

12. Gjersing L, Caplehorn JR, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. 2010;10:13.
-1313. International Test Commission. The ITC guidelines for translating and adapting tests (second edition) [Internet]. 2017 [cited 2018 Mar 21]. https://www.intestcom.org/files/guideline_test_adaptation_2ed.pdf
https://www.intestcom.org/files/guidelin...
In addition, evidence of validity should be demonstrated through multiple informants.

The translated and culturally adapted version of the MBC, as described in this article, should contribute to the development of another instrument for the assessment of children by physical education teachers or classroom teachers. Supported by such instruments, these professionals can provide reports on children’s behaviors observed in natural conditions of interaction and competition, which are rarely considered in evaluation protocols.

Our results revealed a satisfactory level of agreement between the original and back-translated versions, with 68% of exact equivalence between the translated items and 16% of terms requiring minor adjustments. Clarity assessment using reports from physical education teachers revealed an 84% agreement with the draft version of the MBC. Consequently, the Brazilian Portuguese version of the instrument showed adequate indicators of semantic equivalence after the translation, back-translation, and clarity assessment by professionals and the focus group. The synthetized version of the instrument required a few modifications for semantic and cultural adequacy in relation to the original version.

The present study sought maximum equivalence between the original instrument and the translated version. Our results are in accordance with other studies that revealed that, based on the synthetized version, the translation and back-translation processes were adequate and without major distortions.1717. Giusti E, Befi-Lopes DM. Tradução e adaptação transcultural de instrumentos estrangeiros para o português brasileiro (PB). Pró-Fono Rev Atual Cient. 2008;20:207-10.,1818. Pasquali L. Validade dos testes psicológicos: será possível reencontrar o caminho? Psic Teor Pesq. 2007;23:99-107. After this adaptation stage with satisfactory results, assessment of the psychometric properties of the instrument can be conducted.1919. Alexandre NMC, Coluci MCO. Content validity in the development and adaptation processes of measurement instruments. Cienc Saude Coletiva. 2011;16:3061-8. A study currently in progress, by our group, has started to assess the psychometric properties of our translated version of the checklist. The aim of that study is to investigate whether the Brazilian Portuguese version of the MBC can be used as a valid and reliable assessment instrument by physical education teachers.

The Brazilian Portuguese version of the MBC was produced following rigorous translation and cross-cultural adaptation procedures and is presented in Appendix 1. Our instrument fills a gap in the evaluation process of students in sports and free-play situations. Moreover, it can help school teachers to better understand and effectively deal with their students’ behavioral profiles, especially those with behavior problems compatible with NDD.

Appendix 1

INVENTÁRIO DE COMPORTAMENTO MOTOR – MBC

Versão brasileira do “Motor Behavior Checklist (MBC)”

Efstratopoulou, M., Janssen, R. & Simons J. (2015)

Instrumento traduzido e adaptado por Ronê Paiano; Maria Cristina Triguero Veloz Teixeira; Carla Nunes Cantiere; Maria Efstratopoulou; Luiz Renato Rodrigues Carreiro

Nome da criança: ________________________________________________________Sexo: ( )Masc.( )Fem.

Data de Nascimento: ____________________________ Data da aplicação:______________________________

Nome da Escola: ____________________________________________ Ano Escolar:______________________

Nome do professor: ___________________________________________________________________________

Abaixo há uma lista de itens que descrevem comportamentos motores de crianças durante a aula de educação física e tempo de lazer. Por favor, leia cuidadosamente cada comportamento e circule cada número correrspondete a sua resposta, usando as opções: 0=nunca; 1= às vezes; 2= frequentemente; 3= muito frequentemente e 4= quase sempre. Responda a todas as questões mesmo que algumas não pareçam se aplicar a criança em avaliação.

Não deixar nenhum item sem ser circulado.

Nunca Às vezes Frequentemente Muito Frequentemente Quase sempre 1. Não segue regras, especialmente em situação de jogo 0 1 2 3 4 2. Tem dificuldade em aguardar sua vez para executar tarefas 0 1 2 3 4 3. É descuidado 0 1 2 3 4 4. Apresenta cansaço, até mesmo, após um mínimo de esforço 0 1 2 3 4 5. Apresenta movimentos corporais estereotipados, que incluem as mãos (por exemplo, bater palmas, estalar os dedos) 0 1 2 3 4 6. Apresenta comprometimento em gestos que regulam a interação social 0 1 2 3 4 7. Apresenta interesse persistente com partes de objetos 0 1 2 3 4 8. Apresenta desobediência para com seu professor 0 1 2 3 4 9. Apresenta hiperatividade durante a aula 0 1 2 3 4 10. Tem dificuldade de concentração 0 1 2 3 4 11. Sente tontura, instabilidade, fraqueza ou sensação de desmaio 0 1 2 3 4 12. Apresenta padrões repetitivos de atividades 0 1 2 3 4 13. Evita atividades sociais apropriadas para sua idade 0 1 2 3 4 14. Não mostra interesse pela aula 0 1 2 3 4 15. É agressivo em relação a figuras de liderança 0 1 2 3 4 16. Interrompe os outros (por exemplo, intromete-se em conversa) 0 1 2 3 4 17. Tem dificuldade em manter a atenção em tarefas 0 1 2 3 4 18. Apresenta falta de energia 0 1 2 3 4 19. Não mostra objetos que acha interessante 0 1 2 3 4 20. Apresenta prejuízo marcante no uso de comportamentos não-verbais (contato olho-no-olho) 0 1 2 3 4 21. É negativo em relação aos seus colegas de classe (por exemplo comportamentos fisicamente agressivos) 0 1 2 3 4 22. Interrompe os outros (por exemplo, intromete-se em jogos) 0 1 2 3 4 23. Parece que não escutou o que acabou de ser dito 0 1 2 3 4 24. Mostra diminuição do seu nível de atividade 0 1 2 3 4 25. Não traz objetos que acha interessante 0 1 2 3 4 26. Apresenta prejuízo na expressão facial 0 1 2 3 4 27. Culpa os outros por seus erros 0 1 2 3 4 28. Não cuida dos equipamentos 0 1 2 3 4 29. Evita ou tem uma forte antipatia por atividades que exigem extrema concentração 0 1 2 3 4 30. Evita contato com outras pessoas 0 1 2 3 4 31. Não reconhece o seu medo como excessivo 0 1 2 3 4 32. Joga bruto demais durante os jogos da equipe 0 1 2 3 4 33. Muda de uma atividade inacabada para outra 0 1 2 3 4 34. Apresenta dificuldade de concentração no início da aula 0 1 2 3 4 35. Apresenta falta de comunicação com seus colegas de classe 0 1 2 3 4 36. Tem medo de ficar em fila 0 1 2 3 4 37. Apresenta tendência a cometer bullying com seus colegas de classe 0 1 2 3 4 38. Envolve-se em atividades perigosas sem considerar possíveis consequências 0 1 2 3 4 39. Tem dificuldades para organizar tarefas 0 1 2 3 4 40. É isolado pelos seus colegas de classe 0 1 2 3 4 41. Apresenta ansiedade que pode se expressar por choro, ataques de raiva, imobilidade ou se agarrar. 0 1 2 3 4 42. Parece estar com um motor ligado 0 1 2 3 4 43. Comete erros por descuido em atividades 0 1 2 3 4 44. Procura manter-se próximo a adultos familiares 0 1 2 3 4 45. Apresenta dificuldade em tomar decisões 0 1 2 3 4 46. Tem dificuldade para jogar ou envolver-se silenciosamente em atividades de lazer 0 1 2 3 4 47. Falha em prestar atenção a detalhes 0 1 2 3 4 48. Não quer contato físico 0 1 2 3 4 49. Acha difícil controlar preocupações 0 1 2 3 4 50. Fica chateado quando perde 0 1 2 3 4 51. Não participa ativamente nas brincadeiras sociais simples 0 1 2 3 4 52. Fica chateado quando não consegue completar uma tarefa 0 1 2 3 4 53. Superestima suas capacidades 0 1 2 3 4 54. Tem dificuldades para organizar atividades de grupo 0 1 2 3 4 55. Evita ou tem uma forte antipatia por atividades que exigem organização 0 1 2 3 4 56. Apresenta comportamento impulsivo 0 1 2 3 4 57. Mexe em coisas que não são para mexer 0 1 2 3 4 58. Apresenta pouca variedade nas brincadeiras de faz-de-conta 0 1 2 3 4 59. Perde a calma 0 1 2 3 4

Confira se todas as perguntas foram respondidas.

Obrigado pela sua participação!

Efstratopoulou, M., Janssen, R. & Simons J. (2015). Assessing Children at Risk: Psychometric Properties of the Motor Behavior Checklist. J Atten Disord. Dec;19(12):1054-63. doi: 10.1177/1087054713484798.

Efstratopoulou, M. (2014). Working with challenging children: From theory to practice in primary education. Novinka, New York.

Acknowledgements

This study was supported in part by Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES; financial support code 001) and CAPES PROEX (grant 0653/2018). The authors would like to thank Fundo Mackenzie de Pesquisa – Mackpesquisa for their additional financial support.

References

  • 1
    Associação Americana de Psiquiatria. Manual Diagnóstico e Estatístico de Transtornos Mentais, 5ª edição (DSM-5). Porto Alegre: Artmed; 2014.
  • 2
    Lyra GFD, Assis SG de, Njaine K, Oliveira R de VC de, Pires TdeO. A relação entre professores com sofrimento psíquico e crianças escolares com problemas de comportamento. Cienc Saude Coletiva. 2009;14:435-44.
  • 3
    Bordin IA, Rocha MM, Paula, CS, Teixeira MCTV, Achenbach TM, Rescorla LA, et al. Child Behavior Checklist (CBCL), Youth Self-Report (YSR) and Teacher’s Report Form (TRF): an overview of the development of the original and Brazilian versions. Cad Saude Publica. 2013;29:13-28.
  • 4
    Hanssen-Bauer K, Langsrud Ø, Kvernmo S, Heyerdahl S. Clinician-rated mental health in outpatient child and adolescent mental health services: associations with parent, teacher and adolescent ratings. Child Adolesc Psychiatry Ment Health. 2010;4:29.
  • 5
    Gooch D, Maydew H, Sears C, Norbury CF. Does a child’s language ability affect the correspondence between parent and teacher ratings of ADHD symptoms? BMC Psychiatry. 2017;17:129.
  • 6
    Efstratopoulou M, Janssen R, Simons J. Assessing children at risk: psychometric properties of the Motor Behavior Checklist. J Atten Disord. 2015;19:1054-63.
  • 7
    Johnson RC, Rosén LA. Sports behavior of ADHD children. J Atten Disord. 2000;4:150-60.
  • 8
    Clendenin AA, Businelle MS, Kelley ML. Sports Behavior Checklist: factor structure, convergent and divergent validity, and screening ADHD problems in the group differences. J Atten Disord. 2005;8:79-87.
  • 9
    Efstratopoulou M, Janssen R, Simons J. Differentiating children with attention-deficit/hyperactivity disorder, conduct disorder, learning disabilities and autistic spectrum disorders by means of their motor behavior characteristics. Res Dev Disabil. 2012;33:196-204.
  • 10
    Efstratopoulou M, Janssen R, Simons J. Agreement among physical educators, teachers and parents on children’s behaviors: a multitrait-multimethod design approach. Res Dev Disabil. 2012;33:1343-51.
  • 11
    Borsa JC, Damasio BF, Bandeira DR. Adaptação e validação de instrumentos psicológicos entre culturas: algumas considerações. Paideia. 2012;22:423-32.
  • 12
    Gjersing L, Caplehorn JR, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. 2010;10:13.
  • 13
    International Test Commission. The ITC guidelines for translating and adapting tests (second edition) [Internet]. 2017 [cited 2018 Mar 21]. https://www.intestcom.org/files/guideline_test_adaptation_2ed.pdf
    » https://www.intestcom.org/files/guideline_test_adaptation_2ed.pdf
  • 14
    Mondrzak R, Reinert C, Sandri A, Spanemberg L, Nogueira EL, Bertoluci M, et al. Translation and cross-cultural adaptation of the Rating Scale for Countertransference (RSCT) to American English. Trends Psychiatry Psychother. 2016;38:4.
  • 15
    Conti MA, Scagliusi F, Queiroz GK de O, Hearst N, Cordás TA. Adaptação transcultural: tradução e validação de conteúdo para o idioma português do modelo da Tripartite Influence Scale de insatisfação corporal. Cad Saude Publica. 2010;26:503-13.
  • 16
    Mattos P, Segenreich D, Saboya E, Louzã M, Dias G, Romano M. Adaptação transcultural para o português da escala Adult Self-Report Scale para avaliação do transtorno de déficit de atenção/hiperatividade (TDAH) em adultos. Rev Psiquiatr Clin. 2006;33:188-94.
  • 17
    Giusti E, Befi-Lopes DM. Tradução e adaptação transcultural de instrumentos estrangeiros para o português brasileiro (PB). Pró-Fono Rev Atual Cient. 2008;20:207-10.
  • 18
    Pasquali L. Validade dos testes psicológicos: será possível reencontrar o caminho? Psic Teor Pesq. 2007;23:99-107.
  • 19
    Alexandre NMC, Coluci MCO. Content validity in the development and adaptation processes of measurement instruments. Cienc Saude Coletiva. 2011;16:3061-8.

Publication Dates

  • Publication in this collection
    30 May 2019
  • Date of issue
    Apr-Jun 2019

History

  • Received
    23 Aug 2017
  • Accepted
    14 Nov 2018
Associação de Psiquiatria do Rio Grande do Sul Av. Ipiranga, 5311/202, 90610-001 Porto Alegre RS/ Brasil, Tel./Fax: (55 51) 3024 4846 - Porto Alegre - RS - Brazil
E-mail: trends@aprs.org.br