Acessibilidade / Reportar erro

STUDY OF THE MULTIDIMENSIONALITY OF THE MABC-2 (7 TO 10 YEARS OLD) IN CHILDREN FROM THE METROPOLITAN REGION OF RECIFE-PE

ESTUDO DA MULTIDIMENSIONALIDADE DO MABC-2 (7 A 10 ANOS) EM CRIANÇAS DA REGIÃO METROPOLITANA DE RECIFE-PE

ABSTRACT

The objective of this study was to evaluate the multidimensionality of the MABC-2 (7 to 10 years old) in children from Recife (PE). A total of 123 children (7 to 10 years old) from the metropolitan region of Recife (PE) were assessed, including 64 boys and 59 girls. The data were tested for normality using the Kolmogorov-Smirnov test and the adequacy of factor analysis (FA) was evaluated using the KMO measure of sampling adequacy, Bartlett’s sphericity test and individual measures of sampling adequacy (MSA). The main extraction method was principal axis factoring (varimax rotation). The number of factors was determined by parallel analysis (Monte Carlo simulation). The subtests showed low correlations between each other, with unsatisfactory individual measures in two of the subtests. Parallel analysis identified two factors that diverged from the MABC-2 grouping and subtests without significant loadings within factors. The exclusion of three subtests resulted in a better adjusted model. Although multidimensionality was confirmed, the structure diverged from that proposed by the authors, with problems in the correlation of the variables, in the number of factors extracted, and in the grouping of subtests. The exclusion of three subtests (MD3, AC2, and B3) resulted in a better fit of the model.

Keywords:
Validity of tests; Validation studies; Factor analysis.

RESUMO

O objetivo desta pesquisa foi de analisar a multidimensionalidade do MABC-2 (7 a 10 anos) em crianças de Recife (PE). Foram avaliadas 123 crianças (7 a 10 anos) da região metropolitana de Recife (PE), sendo 64 do sexo masculino e 59 do feminino. Os dados foram avaliados quanto à normalidade com o teste de Kolmogorov-Sminov e à adequacidade da realização da Análise Fatorial (AF) com os testes de adequacidade da amostra de KMO e as medidas individuais e de Esfericidade de Bartlett. O método de extração foi principal axis factoring (rotação Varimax), com aplicação da Parallel Analysis (Monte Carlo Simulation) para determinar o número de fatores. Os subtestes apresentaram baixa correlação entre si, com medidas individuais insatisfatórias em dois dos subtestes. A Parallel Analysis identificou a presença de dois fatores, com agrupamento diferente do MABC-2 e com subtestes sem cargas fatoriais significativas nos fatores. A exclusão de três subtestes resultou em um modelo melhor ajustado. Apesar de confirmada a multidimensionalidade, esta divergiu daquela proposta pelos autores, com problemas nas correlações das variáveis, extração no número de fatores, assim como no agrupamento dos subtestes. A exclusão de três subtestes (DM3, AR2 e EQ 3) revelou um modelo mais ajustado.

Palavras-chave:
Validade dos testes; Estudos de validação; Análise fatorial.

Introduction

Motor disorders can compromise the functional performance of children in activities of daily living as well as school activities11. Wang T-N, Tseng M-H, Wilson BN, Hu F-C. Functional performance of children with developmental coordination disorder at home and at school. Dev Med Child Neurol 2009;51(10):817-25. Doi: 10.1111/j.1469-8749.2009.03271.x
https://doi.org/10.1111/j.1469-8749.2009...
),(22. Summers J, Larkin D, Dewey D. Activities of daily living in children with developmental coordination disorder: dressing, personal hygiene, and eating skills. Hum Mov Sci 2008;27(2): 215-29. Doi:10.1016/j.humov.2008.02.002
https://doi.org/10.1016/j.humov.2008.02....
. This impairment can persist into adulthood, excluding them from important everyday activities33. Cousins M, Smyth MM. Developmental coordination impairments in adulthood. Hum Mov Sci 2003;22(4-5):433-59. Doi:10.1016/j.humov.2003.09.003
https://doi.org/10.1016/j.humov.2003.09....
. In this regard, the early detection of these disorders using specific assessment tools permits intervention and minimization of these effects44. Araújo CRS. Efeitos da terapia motora cognitiva no desempenho de atividades de crianças com transtorno do desenvolvimento da coordenação. [Dissertação de Mestrado em Ciências da Reabilitação]. Belo Horizonte: Universidade Federal de Minas Gerais. Escola de Educação Física, Fisioterapia e Terapia Ocupacional; 2010.),(55. Gillberg C, Kadesjö B. Why bother about clumsiness ? The implications of having Developmental Coordination Disorder (DCD). Neural Plast 2003;10(1-2):59-68. Doi: 10.1155/NP.2003.59
https://doi.org/10.1155/NP.2003.59...
.

One of the most common tests used to evaluate motor skills in children is the Movement Assessment Battery for Children (MABC)66. Wuang Y-P, Su J-H, Su C-Y. Reliability and responsiveness of the Movement Assessment Battery for Children-Second Edition Test in children with developmental coordination disorder. Dev Med Child Neurol 2012;54(2):160-5. Doi:10.1111/j.1469-8749.2011.04177.x.
https://doi.org/10.1111/j.1469-8749.2011...
),(77. Edwards J, Berube M, Erlandson K, Haug S, Johnstone H, Meagher M, et al. Developmental coordination disorder in school-aged children born very preterm and/or at very low birth weight: a systematic review. J Dev Behav Pediatr 2011;32(9):678-87. Doi:10.1097/DBP.0b013e31822a396a.
https://doi.org/10.1097/DBP.0b013e31822a...
),(88. Ellinoudis T, Evaggelinou C, Kourtessis T, Konstantinidou Z, Venetsanou F, Kambas A. Reliability and validity of age band 1 of the Movement Assessment Battery for Children--second edition. Res Dev Disabil 2011;32(3):1046-51. Doi:10.1016/j.ridd.2011.01.035.
https://doi.org/10.1016/j.ridd.2011.01.0...
),(99. Venetsanou F, Kambas A, Ellinoudis T, Fatouros I, Giannakidou D, Kourtessis T. Can the movement assessment battery for children-test be the ‘gold standard’ for the motor assessment of children with Developmental Coordination Disorder? Res Dev Disabil 2011;32(1):1-10. Doi:10.1016/j.ridd.2010.09.006.
https://doi.org/10.1016/j.ridd.2010.09.0...
),(1010. Toniolo CS, Capelline SA. Transtorno do desenvolvimento da coordenação : revisão de literatura sobre os instrumentos de avaliação. Rev Psicopedag 2010;27(82):109-16.),(1111. Geuze RH, Jongmans MJ, Schoemaker MM, Smits-Engelsman BC. Clinical and research diagnostic criteria for developmental coordination disorder: a review and discussion. Hum Mov Sci 2001;20(1-2):7-47. Doi: 10.1016/S0167-9457(01)00027-6
https://doi.org/10.1016/S0167-9457(01)00...
, which is already in its second edition1212. Henderson SE, Sugden DA, Barnett AL. Movement Assessment Battery for Children - 2: second edition (Movement ABC - 2). London: Pearson, 2007.. The differences between the two versions include a broader age range, a reduction in the number of age groups (from four to three), revision and inclusion of items, presentation of an innovative interpretation method, inclusion of a more representative sample, and restructuring of subtests66. Wuang Y-P, Su J-H, Su C-Y. Reliability and responsiveness of the Movement Assessment Battery for Children-Second Edition Test in children with developmental coordination disorder. Dev Med Child Neurol 2012;54(2):160-5. Doi:10.1111/j.1469-8749.2011.04177.x.
https://doi.org/10.1111/j.1469-8749.2011...
. This instrument is already used in Brazil1313. Iwamizu JS. Tradução, adaptação transcultural, validade e fidedignidade de um instrumento para identificação do perfil motor de crianças entre 3 e 5 anos de idade. [Dissertação de Mestrado em Ciências]. São Paulo: Universidade de São Paulo. Escola de Educação Física e Esporte; 2013.),(1414. Nascimento EMF, Contreira AR, Beltrame TS. Desempenho motor de escolares com idade entre 11 e 14 anos. ConScientiae Saúde. 2011;10(2):231-8. Doi:10.5585/ConsSaude.v10i2.2590
https://doi.org/10.5585/ConsSaude.v10i2....
),(1515. Silva EVA, Contreira AR, Beltrame TS, Sperandio FF. Programa de intervenção motora para escolares com indicativo de Transtorno do Desenvolvimento da Coordenação - TDC. Rev Bras Ed Esp 2011;17(1):137-50. Doi: 10.1590/S1413-65382011000100010
https://doi.org/10.1590/S1413-6538201100...
),(1616. Miranda TB. Perfil motor de escolares de 7 a 10 anos de com idade com indicativo de desordem coordenativa desenvolvimental (DCD). [Dissertação de Mestrado em Ciências do Movimento Humano]. Florianópolis: Universidade do Estado de Santa Catarina. Programa de Pós-Graduação em Ciência do Movimento Humando; 2010.),(1717. Miranda TB, Beltrame TS, Cardoso FL. Desempenho motor e estado nutricional de escolares com e sem transtorno do desenvolvimento da coordenação. Rev Bras Cineantropom Desempenho Hum 2011;13(1):59-66. Doi: 10.5007/1980-0037.2011v13n1p59
https://doi.org/10.5007/1980-0037.2011v1...
, but few studies have evaluated aspects of its validity and/or reliability in Brazilian children1818. Valentini NC, Ramalho MH, Oliveira M. Movement Assessment Battery for Children-2: Translation, reliability, and validity for Brazilian children. Res Dev Disabil 2013; 35(3):733-40. Doi:10.1016/j.ridd.2013.10.028
https://doi.org/10.1016/j.ridd.2013.10.0...
),(1919. Silveira RA. Avaliação das baterias motoras EDM, MABC-2 e TGMD-2. [Dissertação de Mestrado em Ciências do Movimento Humano]. Florianóplis: Universidade do Estado de Santa Catarina. Programa de Pós-Graduação em Ciências do Movimento Humano; 2010..

Validity studies can be divided into predictive validity, concurrent validity, content validity, and construct validity2020. Cronbach L, Meehl P. Construct validity in psychological tests. Psychol Bull. 1955; 52(4): 281-302.. According to these authors, predictive validity is established when the criterion is obtained after application of the test. Concurrent validity is evaluated when one test is proposed as a substitute for another. Content validity is established deductively by demonstrating that the test items are a sample of a universe of the object of study. Construct validity evaluates to what extent a measure varies from the construct for which it was elaborated2121. Sechrest L. Validity of measures is no simple matter. Health Serv Res 2005;40(5p2):1584-604. Doi:10.1111/j.1475-6773.2005.00443.x
https://doi.org/10.1111/j.1475-6773.2005...
. The lack of construct validity implies difficulties in the interpretation of the results obtained with a test2222. Westen D, Rosenthal R. Quantifying construct validity: two simple measures. J Pers Soc Psychol 2003;84(3):608-18. Doi:10.1037/0022-3514.84.3.608%5
https://doi.org/10.1037/0022-3514.84.3.6...
.

One of the conditions necessary, although not sufficient, for construct validity is factorial validity, which refers to the study of constructs measured by a scale and their numbers, as well as the variables that compose the constructs2323. Rubin A, Babbie E. Research methods for social work. 8. ed. Belmont (CA): Brook/Cole Empowerment Series, 2014.. Construct is the name given to hypothetical factors that determine behaviors, which cannot be measured directly, only estimated2121. Sechrest L. Validity of measures is no simple matter. Health Serv Res 2005;40(5p2):1584-604. Doi:10.1111/j.1475-6773.2005.00443.x
https://doi.org/10.1111/j.1475-6773.2005...
. According to Kita et al.2424. Kita Y, Suzuki K, Hirata S, Sakihara K, Inagaki M, Nakai A. Applicability of the Movement Assessment Battery for Children-Second Edition to Japanese children: A study of the Age Band 2. Brain Dev 2016;38(8):706-13. Doi:10.1016/j.braindev.2016.02.012
https://doi.org/10.1016/j.braindev.2016....
, factorial validity should be verified because it influences different aspects of the MABC-2, such as the agreement between domains and their items and the calculation of domain and total scores. Factorial validity of the MABC-2 has been evaluated in the studies of Wagner et al.2525. Wagner MO, Kastner J, Petermann F, Bos K. Factorial validity of the Movement Assessment Battery for Children-2 (age band 2). Res Dev Disabil 2011;32(2):674-80. Doi: 10.1016/j.ridd.2010.11.016
https://doi.org/10.1016/j.ridd.2010.11.0...
, Silveira1919. Silveira RA. Avaliação das baterias motoras EDM, MABC-2 e TGMD-2. [Dissertação de Mestrado em Ciências do Movimento Humano]. Florianóplis: Universidade do Estado de Santa Catarina. Programa de Pós-Graduação em Ciências do Movimento Humano; 2010.) and Hua et al.2626. Hua J, Gu G, Meng W, Wu Z. Age band 1 of the Movement Assessment Battery for Children-Second Edition: exploring its usefulness in mainland China. Res Dev Disabil 2013;34(2):801-8. Doi:10.1016/j.ridd.2012.10.012
https://doi.org/10.1016/j.ridd.2012.10.0...
. However, all of them detected a problematic structure in the composition of three domains. In addition, regarding reliability, the MABC-2 exhibited the lowest Cronbach alpha (α=0.432) when compared to the Test of Gross Motor Development-2 and Escala de Desenvolvimento Motor (EDM)(1919. Silveira RA. Avaliação das baterias motoras EDM, MABC-2 e TGMD-2. [Dissertação de Mestrado em Ciências do Movimento Humano]. Florianóplis: Universidade do Estado de Santa Catarina. Programa de Pós-Graduação em Ciências do Movimento Humano; 2010.) . However, Kita et al.2424. Kita Y, Suzuki K, Hirata S, Sakihara K, Inagaki M, Nakai A. Applicability of the Movement Assessment Battery for Children-Second Edition to Japanese children: A study of the Age Band 2. Brain Dev 2016;38(8):706-13. Doi:10.1016/j.braindev.2016.02.012
https://doi.org/10.1016/j.braindev.2016....
obtained high factorial validity of age band 2 of the MABC-2 in Japanese children.

Since factorial validation is one of the steps in the determination of the validity of an instrument, the objective of this study was to evaluate the multidimensionality of the MABC-2 (7 to 10 years old) in children from the metropolitan region of Recife-PE.

Methods

Participants

This was a methodological study for instrument validation, which involved 123 children from public and private schools in the metropolitan region of Recife-PE. All children, including 64 boys and 59 girls, ranged in age from 7 to 10 years ( x =9.0 years; SD=1.11 years). Weight ranged from 17.6 to 68.4 kg ( x =31 kg; SD=9.46 kg) and height from 113 to 160 cm ( x =133.09 cm; SD=9.78 cm). The children were evaluated in a private area of the schools at times agreed upon by the institutions, researchers and persons responsible for the children. Children with orthopedic, neurological or cardiac problems were excluded from the study.

The study was approved by the Ethics Committee of Complexo Hospitalar HUOC/ PROCAPE (Approval No. 171.473) on December 13, 2012. All children and their legal guardians received information about the study procedures and the responsible person agreed to the child’s participation by signing the free informed consent form.

Instrument

The motor performance of the children was evaluated using the MABC-2, age band 2 (7 to 10 years). The test consists of eight items divided into three domains: Manual Dexterity - MD (three items: posting coins - MD1, threading lace - MD2, drawing trail - MD3); Aiming and Catching - AC (two items: catching with two hands - AC1, throwing a beanbag onto a mat - AC2); balance (three items: one-board balance - B1, walking heel-to-toe forward - B2, hoping on mats - B3). The results (raw scores) were converted to standard scores according to the child’s age for each domain, which generated component scores and patterns for each skill. Summing these scores, the diagnosis of overall motor performance was obtained. Scores equal to or below the 5th percentile indicated significant movement difficulty; scores between the 6th and 16th percentile indicated a higher chance of movement difficulty, and scores above the 16th percentile indicated the absence of movement difficulty. In addition, weight was measured with a digital scale and height with an appropriate anthropometric instrument.

Procedures

The children were evaluated in the schools between April 2013 and October 2014 at times agreed upon by the institutions and researchers. The test was applied by two evaluators following the protocol suggested by the authors1212. Henderson SE, Sugden DA, Barnett AL. Movement Assessment Battery for Children - 2: second edition (Movement ABC - 2). London: Pearson, 2007..

Data analysis

Factor analysis (FA) can be used to reduce the number of variables (correlated with each other), grouping them into few factors, as well as to study the underlying data structure2727. Editor IJSMI. Tutorial: Factor analysis revisited - An overview with the help of SPSS, SAS and R packages. Int J Stat Med Informatics 2017;3(1):1-14.. The data were analyzed by FA using the SPSS v. 17.0 program whose assumption is multivariate normality2828. Reio Jr TG, Shuck B. Exploratory factor analysis: implications for theory, research, and practice. Adv Dev Hum Resour 2014;17(1):12-25. Doi:10.1177/1523422314559804
https://doi.org/10.1177/1523422314559804...
. Standard scores of each task were evaluated by the Kolmogorov-Smirnov test (p>0.05). Since the data did not show a normal distribution, principal axis factoring indicated in these cases was applied as extraction method2929. Damásio BF. Uso da análise fatorial exploratória em psicologia. Avaliação Psicológica 2012;11(2):213-28..

Rotation methods, which are either orthogonal or oblique, are used to improve the interpretation of the results of FA. Among orthogonal methods, varimax rotation is the most commonly used, which simplifies interpretation by maximizing the sum of variances of loadings in the factorial matrix. This rotation results in very high factor loadings, i.e., close to +1 or -1, or very low loadings (close to 0), facilitating interpretation of the results3030. Hair JF, Black WC, Babin B, Anderson RE, Tatham RL. Análise fatorial. In: Análise multivariada de dados. 6th ed. Porto Alegre - RS: Bookman, 2006.. According to these authors3030. Hair JF, Black WC, Babin B, Anderson RE, Tatham RL. Análise fatorial. In: Análise multivariada de dados. 6th ed. Porto Alegre - RS: Bookman, 2006., factor loadings of 0.3 to 0.4 are considered minimally acceptable for factorial solution. In the present study, subtests with loadings higher than 0.4 were considered significant. In addition, simple structuring of the components of the factors was performed in an attempt to eliminate possible cross-loadings (loadings present in more than one factor).

The fit of the FA model was verified using the Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy, Bartlett’s test of sphericity and individual measures of sampling adequacy (MSA). The KMO sampling adequacy was defined as follows: < 0.5 - unacceptable; 0.5 to 0.6 - miserable; 0.6 to 0.7 - mediocre; 0.7 to 0.8 - reasonable; 0.8 to 0.9 - good; ≥ 0.9 - excellent3131. Hutcheson GD, Sofroniou N. The multivariate social scientist: introductory statistics using generalized linear models. London: Sage Publications; 1999.. A 95% confidence level was considered for Bartlett’s test of sphericity and values < 0.5 were defined as unacceptable for MSA3030. Hair JF, Black WC, Babin B, Anderson RE, Tatham RL. Análise fatorial. In: Análise multivariada de dados. 6th ed. Porto Alegre - RS: Bookman, 2006..

The number of factors was defined using parallel analysis (Monte Carlo simulation), with a 95% confidence interval. Factor loadings > 0.4 were considered significant. Parallel analysis is one of the most accurate methods3232. Watkins MW. Determining Parallel Analysis Criteria. J Mod Appl Stat Methods 2006;5(2):344-6. Doi: 10.22237/jmasm/1162354020
https://doi.org/10.22237/jmasm/116235402...
, in which eigenvalues prior to rotation are compared with those originating from a matrix of random values of the same dimension. Eigenvalues of FA that are higher than those from the corresponding random data can be retained; lower eigenvalues may not be true3333. Franklin SB, Gibson DJ, Robertson PA, Pohlmann JT, Fralish JS. Parallel analysis: a method for determining significant principal components. J Veg Sci1995;6(1):99-106. Doi: 10.2307/3236261
https://doi.org/10.2307/3236261...
.

The analyses were performed using the SPSS v. 17.0 program. The standard scores of each subtest were considered for analysis. In cases in which both limbs were tested (MD1, B1, and B3), the final standard score of the subtest was used, totaling eight components for analysis.

Results

One of the first steps of FA is to evaluate the correlations between the variables selected for grouping3030. Hair JF, Black WC, Babin B, Anderson RE, Tatham RL. Análise fatorial. In: Análise multivariada de dados. 6th ed. Porto Alegre - RS: Bookman, 2006.. Among the 28 possible correlations between variables, 17 (60.7%) showed significant correlations (Table 1).

Table 1
Correlations between subtests

In addition, the execution of FA was justified by the KMO test of sampling adequacy (0.57) and the Bartlett’s test of sphericity (sig. 0.000). These tests demonstrated satisfactory values for continuation of the analysis and the existence of significant correlations between some variables. However, when individual measures of sampling adequacy (MSA) were used, according to the criterion proposed by Hair et al.3030. Hair JF, Black WC, Babin B, Anderson RE, Tatham RL. Análise fatorial. In: Análise multivariada de dados. 6th ed. Porto Alegre - RS: Bookman, 2006., MD2 and AC2 were found to be problematic, with values less than 0.5 (Table 2).

Table 2
Individual measures of sampling adequacy and partial correlations based on the anti-image matrix

An important decision to make in FA is the extraction of the number of factors2929. Damásio BF. Uso da análise fatorial exploratória em psicologia. Avaliação Psicológica 2012;11(2):213-28.. Parallel analysis (Monte Carlo simulation) was used for this purpose, which is one of the most accurate methods3232. Watkins MW. Determining Parallel Analysis Criteria. J Mod Appl Stat Methods 2006;5(2):344-6. Doi: 10.22237/jmasm/1162354020
https://doi.org/10.22237/jmasm/116235402...
. According to this criterion, the extraction of two factors is recommended for the MABC-2 (Figure 1), contrary to the initial proposal of the instrument composed of three assessment domains.

Figure 1
Number of factors using parallel analysis (Monte Carlo simulation) at a level of significance of 95%

Performing FA by varimax rotation, three of the subtests (B2, B3, and MD3) did not show significant loadings (>0.4) in their respective factors (Table 3). In addition, replication of the composition of the originally proposed instrument was not observed in either factor.

Table 3
Structural matrix and factor loadings of the factors extracted from the MABC-2

Since two of the subtests did not show significant factor loadings in the model, consecutive analyses were performed removing variables one by one (Table 4). For exclusion, the first criterion observed in the subtests without representative loadings in the model was MSA: the one with the lowest value would be removed if it was less than 0.4, as suggested by Hair et al.3030. Hair JF, Black WC, Babin B, Anderson RE, Tatham RL. Análise fatorial. In: Análise multivariada de dados. 6th ed. Porto Alegre - RS: Bookman, 2006.. If MSA were higher than 0.4, the communality values would be observed: the subtest with the lowest variance explained by the factor would be excluded from the next analysis. Thus, new FA was performed, removing subtest AC2 since it obtained the lowest MSA value (< 0.4) (Table 2).

Table 4
Factor analysis excluding the subtests not contemplated in the models

The data were submitted to two other analyses, excluding variables AC2 and B3. Model 3, composed of subtests MD1, MD2, AC1, B1 and B2, exhibited the highest percentage of variance explained by the factors and had all variables with representative loadings in their respective factors (Table 4), suggesting a better fit to the data of this study.

Discussion

Factor analysis permits to demonstrate the agreement of variables in measuring one or more common dimensions and can be used to describe the underlying conceptual structure of an instrument3434. McDowell I. Measuring health: A guide to rating scales and questionnaires. 3rd ed. New York (NY): Oxford University Press, 2006.. The dimensions, which consist of a group of highly correlated variables, are considered to represent the dimensions within the data3030. Hair JF, Black WC, Babin B, Anderson RE, Tatham RL. Análise fatorial. In: Análise multivariada de dados. 6th ed. Porto Alegre - RS: Bookman, 2006.. Thus, an important step in FA is the observation of correlations between variables. Variables without significant correlations may not belong to the factors, whereas those with a large number of correlations may participate in different factors simultaneously3030. Hair JF, Black WC, Babin B, Anderson RE, Tatham RL. Análise fatorial. In: Análise multivariada de dados. 6th ed. Porto Alegre - RS: Bookman, 2006.. In general, the ideal is a correlation matrix in which most coefficients are higher than 0.33535. Figueiredo Filho DB, Silva Júnior JA. Visão além do alcance: uma introdução à análise fatorial. Opinião Pública 2010;16(1):160-85. Doi: 10.1590/S0104-62762010000100007
https://doi.org/10.1590/S0104-6276201000...
. This was not observed in the present study in which only five of the possible combinations of variables exhibited correlations above this value. This finding could have been one of the reasons for the low value of the KMO test which, however, is acceptable for this analysis. This test is influenced by these correlations, as well as by the sample size and number of variables and inversely by the number of factors3030. Hair JF, Black WC, Babin B, Anderson RE, Tatham RL. Análise fatorial. In: Análise multivariada de dados. 6th ed. Porto Alegre - RS: Bookman, 2006.. However, Bartlett’s test of sphericity confirmed the existence of at least one significant correlation between the subtests of the MABC-2.

Another factor that must be considered in FA is the size of the sample. In general, it is recommended that analysis be performed with number of observations ≥ 100, with a participant-variable ratio of 5:1 or higher2828. Reio Jr TG, Shuck B. Exploratory factor analysis: implications for theory, research, and practice. Adv Dev Hum Resour 2014;17(1):12-25. Doi:10.1177/1523422314559804
https://doi.org/10.1177/1523422314559804...
),(3030. Hair JF, Black WC, Babin B, Anderson RE, Tatham RL. Análise fatorial. In: Análise multivariada de dados. 6th ed. Porto Alegre - RS: Bookman, 2006.. Both criteria were met in the present study in which the total sample consisted of 123 children, with 8 variables in the model.

Analysis performed with eight subtests revealed the presence of variables with MSA values less than 0.5 According to Hair et al.3030. Hair JF, Black WC, Babin B, Anderson RE, Tatham RL. Análise fatorial. In: Análise multivariada de dados. 6th ed. Porto Alegre - RS: Bookman, 2006., these measures can be used to identify possible variables to be eliminated from the model. These variables should be removed one by one, starting with the variable with the lowest MSA and recalculating the FA until the individual measures reach an acceptable level. However, the final decision about continuation should be made based on the level of association between the variable and the extracted factor, i.e., communality3535. Figueiredo Filho DB, Silva Júnior JA. Visão além do alcance: uma introdução à análise fatorial. Opinião Pública 2010;16(1):160-85. Doi: 10.1590/S0104-62762010000100007
https://doi.org/10.1590/S0104-6276201000...
.

The data point to the existence of only two dimensions as indicated by parallel analysis (Monte Carlo simulation), contrary to the original proposal of the authors for the MABC-2. The alignment of subtests different from the expected and the better fit of the model after the exclusion of three subtests (AC2, B3, and MD3) suggest the possibility of adaptation of some items to improve the construct validity of the MABC-2, as demonstrated in the study of Hua et al.2626. Hua J, Gu G, Meng W, Wu Z. Age band 1 of the Movement Assessment Battery for Children-Second Edition: exploring its usefulness in mainland China. Res Dev Disabil 2013;34(2):801-8. Doi:10.1016/j.ridd.2012.10.012
https://doi.org/10.1016/j.ridd.2012.10.0...
. In that study, the proposed model with three motor skill domains also showed unsatisfactory fit in age band 1 for Chinese children2626. Hua J, Gu G, Meng W, Wu Z. Age band 1 of the Movement Assessment Battery for Children-Second Edition: exploring its usefulness in mainland China. Res Dev Disabil 2013;34(2):801-8. Doi:10.1016/j.ridd.2012.10.012
https://doi.org/10.1016/j.ridd.2012.10.0...
. However, the exclusion of the subtests “drawing trail” and “walking heels raised” resulted in a better fit of the data to the model in children of that country.

Silveira1919. Silveira RA. Avaliação das baterias motoras EDM, MABC-2 e TGMD-2. [Dissertação de Mestrado em Ciências do Movimento Humano]. Florianóplis: Universidade do Estado de Santa Catarina. Programa de Pós-Graduação em Ciências do Movimento Humano; 2010., who analyzed the same age range as the present study, also identified a different grouping of subtests in the three factors, in addition to low internal consistency (α=0.432). On the other hand, the study of Valentini, Ramalho and Oliveira1818. Valentini NC, Ramalho MH, Oliveira M. Movement Assessment Battery for Children-2: Translation, reliability, and validity for Brazilian children. Res Dev Disabil 2013; 35(3):733-40. Doi:10.1016/j.ridd.2013.10.028
https://doi.org/10.1016/j.ridd.2013.10.0...
indicated good construct validity. However, the assessment was only based on Cronbach’s alpha, which was 0.78.

Although the study of Wagner et al.2525. Wagner MO, Kastner J, Petermann F, Bos K. Factorial validity of the Movement Assessment Battery for Children-2 (age band 2). Res Dev Disabil 2011;32(2):674-80. Doi: 10.1016/j.ridd.2010.11.016
https://doi.org/10.1016/j.ridd.2010.11.0...
provided evidence that confirmed the factorial validity of the MABC-2 in German children (age band 2), problems were identified in its substructures. The authors indicated subtests MD3, AC1, B2 and B3 to be poorly reliable since less than 40% of their respective variances were explained by the factors. Similarly, three of the four variables considered in the cited study2525. Wagner MO, Kastner J, Petermann F, Bos K. Factorial validity of the Movement Assessment Battery for Children-2 (age band 2). Res Dev Disabil 2011;32(2):674-80. Doi: 10.1016/j.ridd.2010.11.016
https://doi.org/10.1016/j.ridd.2010.11.0...
to be less reliable also had lower variances explained by the factorial solution (B2, B3, MD3), demonstrating nonsignificant factor loadings in the analysis with eight subtests (Table 4).

The disagreement in the grouping of variables of the MABC-2 proposal suggests the impossibility to use component (MD, AC, B) scores for interpretation. However, a scale does not have to be multidimensional, i.e., contain subscores measuring various components. It can be unidimensional and contain a final score to evaluate a given phenomenon. For this purpose, the results of FA should indicate the existence of a single factor and its scale will thus have factorial validity2323. Rubin A, Babbie E. Research methods for social work. 8. ed. Belmont (CA): Brook/Cole Empowerment Series, 2014.. However, the present study showed that the MABC-2 is multidimensional since parallel analysis demonstrated the existence of two factors, which differ from the original proposal of the instrument and the structure of the original instrument could therefore not be confirmed. An instrument is developed from a theoretical framework so that, through operational indicators, a broader construct can be known. Validity tests are then used to demonstrate how much of the evidence and theoretical support are present in the instrument developed3636. Reppold CT, Gurgel LG, Hutz CS. O processo de construção de escalas psicométricas. Avaliação Psicológica 2014;13(2):307-10. Although the proposal of the motor skill test battery seems attractive and some subtests appear to capture some of the components of motor performance, the psychometric properties of the instrument does not favor the tool. The lack of this validity suggests the need to revise the composition of some items of the test so that it becomes adequate to evaluate Brazilian children, in addition to compromising other types of validity (divergent, concurrent).

Practical implications

The divergence in the multidimensionality of the MABC-2 indicates that the domains intended for the instrument do not function as predicted by the authors. This can compromise the practical utility of the test since the capacity to evaluate motor performance as predicted was not confirmed. This fact does not imply that the result of the MABC-2 is invalid, but the results of its subscales (manual dexterity, aiming and catching, and balance) should be interpreted with caution since they may be prone to errors, considering that the results showed a structure different from that proposed by the authors of the test.

It should also be noted that the construct validity in FA should not simply be assumed if the instrument appears to have an adequate factorial structure. In fact, construct validity must be based on a nomological context that includes consistent data, which give rise to the impression of acceptance of the construct validity of a given measure2121. Sechrest L. Validity of measures is no simple matter. Health Serv Res 2005;40(5p2):1584-604. Doi:10.1111/j.1475-6773.2005.00443.x
https://doi.org/10.1111/j.1475-6773.2005...
.

Limitations of the study

Although this study corroborates data of previous studies, some limitations should be addressed. Since Brazil is a very large country with many cultural influences, it is interesting to evaluate the transcultural validity of the MABC-2 in different regions of the country using larger samples. Other techniques might be applied to analyze the degree of adjustment of the initial model of the MABC-2, such as techniques employing semi-structured equations. Other age groups (age bands 1 and 3) should also be included in subsequent studies.

Conclusions

The MABC-2, although commonly used in Brazil, had its multidimensionality confirmed but diverges from the structure proposed by the authors. The data revealed problems in the correlation between variables, in the number of factors extracted, and in the grouping of subtests. The exclusion of three subtests (MD3, AC2, and B3) from the analysis resulted in a better fit of the model, suggesting the possibility of modifying these activities for application of the MABC-2 to Brazilian children. However, further studies involving a larger sample and using other analysis techniques, as well as investigating other age groups, are needed.

Acknowledgments:

To Sarah Weinberg, Pearson Publisher; Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq), and Laboratório de Cognição e Comportamento Humano da Escola Superior de Educação Física da UPE.

References

  • 1
    Wang T-N, Tseng M-H, Wilson BN, Hu F-C. Functional performance of children with developmental coordination disorder at home and at school. Dev Med Child Neurol 2009;51(10):817-25. Doi: 10.1111/j.1469-8749.2009.03271.x
    » https://doi.org/10.1111/j.1469-8749.2009.03271.x
  • 2
    Summers J, Larkin D, Dewey D. Activities of daily living in children with developmental coordination disorder: dressing, personal hygiene, and eating skills. Hum Mov Sci 2008;27(2): 215-29. Doi:10.1016/j.humov.2008.02.002
    » https://doi.org/10.1016/j.humov.2008.02.002
  • 3
    Cousins M, Smyth MM. Developmental coordination impairments in adulthood. Hum Mov Sci 2003;22(4-5):433-59. Doi:10.1016/j.humov.2003.09.003
    » https://doi.org/10.1016/j.humov.2003.09.003
  • 4
    Araújo CRS. Efeitos da terapia motora cognitiva no desempenho de atividades de crianças com transtorno do desenvolvimento da coordenação. [Dissertação de Mestrado em Ciências da Reabilitação]. Belo Horizonte: Universidade Federal de Minas Gerais. Escola de Educação Física, Fisioterapia e Terapia Ocupacional; 2010.
  • 5
    Gillberg C, Kadesjö B. Why bother about clumsiness ? The implications of having Developmental Coordination Disorder (DCD). Neural Plast 2003;10(1-2):59-68. Doi: 10.1155/NP.2003.59
    » https://doi.org/10.1155/NP.2003.59
  • 6
    Wuang Y-P, Su J-H, Su C-Y. Reliability and responsiveness of the Movement Assessment Battery for Children-Second Edition Test in children with developmental coordination disorder. Dev Med Child Neurol 2012;54(2):160-5. Doi:10.1111/j.1469-8749.2011.04177.x.
    » https://doi.org/10.1111/j.1469-8749.2011.04177.x
  • 7
    Edwards J, Berube M, Erlandson K, Haug S, Johnstone H, Meagher M, et al. Developmental coordination disorder in school-aged children born very preterm and/or at very low birth weight: a systematic review. J Dev Behav Pediatr 2011;32(9):678-87. Doi:10.1097/DBP.0b013e31822a396a.
    » https://doi.org/10.1097/DBP.0b013e31822a396a
  • 8
    Ellinoudis T, Evaggelinou C, Kourtessis T, Konstantinidou Z, Venetsanou F, Kambas A. Reliability and validity of age band 1 of the Movement Assessment Battery for Children--second edition. Res Dev Disabil 2011;32(3):1046-51. Doi:10.1016/j.ridd.2011.01.035.
    » https://doi.org/10.1016/j.ridd.2011.01.035
  • 9
    Venetsanou F, Kambas A, Ellinoudis T, Fatouros I, Giannakidou D, Kourtessis T. Can the movement assessment battery for children-test be the ‘gold standard’ for the motor assessment of children with Developmental Coordination Disorder? Res Dev Disabil 2011;32(1):1-10. Doi:10.1016/j.ridd.2010.09.006.
    » https://doi.org/10.1016/j.ridd.2010.09.006
  • 10
    Toniolo CS, Capelline SA. Transtorno do desenvolvimento da coordenação : revisão de literatura sobre os instrumentos de avaliação. Rev Psicopedag 2010;27(82):109-16.
  • 11
    Geuze RH, Jongmans MJ, Schoemaker MM, Smits-Engelsman BC. Clinical and research diagnostic criteria for developmental coordination disorder: a review and discussion. Hum Mov Sci 2001;20(1-2):7-47. Doi: 10.1016/S0167-9457(01)00027-6
    » https://doi.org/10.1016/S0167-9457(01)00027-6
  • 12
    Henderson SE, Sugden DA, Barnett AL. Movement Assessment Battery for Children - 2: second edition (Movement ABC - 2). London: Pearson, 2007.
  • 13
    Iwamizu JS. Tradução, adaptação transcultural, validade e fidedignidade de um instrumento para identificação do perfil motor de crianças entre 3 e 5 anos de idade. [Dissertação de Mestrado em Ciências]. São Paulo: Universidade de São Paulo. Escola de Educação Física e Esporte; 2013.
  • 14
    Nascimento EMF, Contreira AR, Beltrame TS. Desempenho motor de escolares com idade entre 11 e 14 anos. ConScientiae Saúde. 2011;10(2):231-8. Doi:10.5585/ConsSaude.v10i2.2590
    » https://doi.org/10.5585/ConsSaude.v10i2.2590
  • 15
    Silva EVA, Contreira AR, Beltrame TS, Sperandio FF. Programa de intervenção motora para escolares com indicativo de Transtorno do Desenvolvimento da Coordenação - TDC. Rev Bras Ed Esp 2011;17(1):137-50. Doi: 10.1590/S1413-65382011000100010
    » https://doi.org/10.1590/S1413-65382011000100010
  • 16
    Miranda TB. Perfil motor de escolares de 7 a 10 anos de com idade com indicativo de desordem coordenativa desenvolvimental (DCD). [Dissertação de Mestrado em Ciências do Movimento Humano]. Florianópolis: Universidade do Estado de Santa Catarina. Programa de Pós-Graduação em Ciência do Movimento Humando; 2010.
  • 17
    Miranda TB, Beltrame TS, Cardoso FL. Desempenho motor e estado nutricional de escolares com e sem transtorno do desenvolvimento da coordenação. Rev Bras Cineantropom Desempenho Hum 2011;13(1):59-66. Doi: 10.5007/1980-0037.2011v13n1p59
    » https://doi.org/10.5007/1980-0037.2011v13n1p59
  • 18
    Valentini NC, Ramalho MH, Oliveira M. Movement Assessment Battery for Children-2: Translation, reliability, and validity for Brazilian children. Res Dev Disabil 2013; 35(3):733-40. Doi:10.1016/j.ridd.2013.10.028
    » https://doi.org/10.1016/j.ridd.2013.10.028
  • 19
    Silveira RA. Avaliação das baterias motoras EDM, MABC-2 e TGMD-2. [Dissertação de Mestrado em Ciências do Movimento Humano]. Florianóplis: Universidade do Estado de Santa Catarina. Programa de Pós-Graduação em Ciências do Movimento Humano; 2010.
  • 20
    Cronbach L, Meehl P. Construct validity in psychological tests. Psychol Bull. 1955; 52(4): 281-302.
  • 21
    Sechrest L. Validity of measures is no simple matter. Health Serv Res 2005;40(5p2):1584-604. Doi:10.1111/j.1475-6773.2005.00443.x
    » https://doi.org/10.1111/j.1475-6773.2005.00443.x
  • 22
    Westen D, Rosenthal R. Quantifying construct validity: two simple measures. J Pers Soc Psychol 2003;84(3):608-18. Doi:10.1037/0022-3514.84.3.608%5
    » https://doi.org/10.1037/0022-3514.84.3.608%5
  • 23
    Rubin A, Babbie E. Research methods for social work. 8. ed. Belmont (CA): Brook/Cole Empowerment Series, 2014.
  • 24
    Kita Y, Suzuki K, Hirata S, Sakihara K, Inagaki M, Nakai A. Applicability of the Movement Assessment Battery for Children-Second Edition to Japanese children: A study of the Age Band 2. Brain Dev 2016;38(8):706-13. Doi:10.1016/j.braindev.2016.02.012
    » https://doi.org/10.1016/j.braindev.2016.02.012
  • 25
    Wagner MO, Kastner J, Petermann F, Bos K. Factorial validity of the Movement Assessment Battery for Children-2 (age band 2). Res Dev Disabil 2011;32(2):674-80. Doi: 10.1016/j.ridd.2010.11.016
    » https://doi.org/10.1016/j.ridd.2010.11.016
  • 26
    Hua J, Gu G, Meng W, Wu Z. Age band 1 of the Movement Assessment Battery for Children-Second Edition: exploring its usefulness in mainland China. Res Dev Disabil 2013;34(2):801-8. Doi:10.1016/j.ridd.2012.10.012
    » https://doi.org/10.1016/j.ridd.2012.10.012
  • 27
    Editor IJSMI. Tutorial: Factor analysis revisited - An overview with the help of SPSS, SAS and R packages. Int J Stat Med Informatics 2017;3(1):1-14.
  • 28
    Reio Jr TG, Shuck B. Exploratory factor analysis: implications for theory, research, and practice. Adv Dev Hum Resour 2014;17(1):12-25. Doi:10.1177/1523422314559804
    » https://doi.org/10.1177/1523422314559804
  • 29
    Damásio BF. Uso da análise fatorial exploratória em psicologia. Avaliação Psicológica 2012;11(2):213-28.
  • 30
    Hair JF, Black WC, Babin B, Anderson RE, Tatham RL. Análise fatorial. In: Análise multivariada de dados. 6th ed. Porto Alegre - RS: Bookman, 2006.
  • 31
    Hutcheson GD, Sofroniou N. The multivariate social scientist: introductory statistics using generalized linear models. London: Sage Publications; 1999.
  • 32
    Watkins MW. Determining Parallel Analysis Criteria. J Mod Appl Stat Methods 2006;5(2):344-6. Doi: 10.22237/jmasm/1162354020
    » https://doi.org/10.22237/jmasm/1162354020
  • 33
    Franklin SB, Gibson DJ, Robertson PA, Pohlmann JT, Fralish JS. Parallel analysis: a method for determining significant principal components. J Veg Sci1995;6(1):99-106. Doi: 10.2307/3236261
    » https://doi.org/10.2307/3236261
  • 34
    McDowell I. Measuring health: A guide to rating scales and questionnaires. 3rd ed. New York (NY): Oxford University Press, 2006.
  • 35
    Figueiredo Filho DB, Silva Júnior JA. Visão além do alcance: uma introdução à análise fatorial. Opinião Pública 2010;16(1):160-85. Doi: 10.1590/S0104-62762010000100007
    » https://doi.org/10.1590/S0104-62762010000100007
  • 36
    Reppold CT, Gurgel LG, Hutz CS. O processo de construção de escalas psicométricas. Avaliação Psicológica 2014;13(2):307-10

Publication Dates

  • Publication in this collection
    04 Oct 2018
  • Date of issue
    2018

History

  • Received
    09 Mar 2017
  • Reviewed
    30 June 2017
  • Accepted
    13 Dec 2017
Universidade Estadual de Maringá Avenida Colombo, 5790 - cep: 87020-900 - tel: 44 3011 4315 - Maringá - PR - Brazil
E-mail: revdef@uem.br