Acessibilidade / Reportar erro

EVIDENCES OF CONSTRUCT VALIDITY, CRITERIA AND VALIDATION OF THE MOTOR COMPETENCE ASSESSMENT BATERY OF TESTS IN PRESCHOOLERS

EVIDÊNCIAS DE VALIDADE DE CONSTRUTO, CRITÉRIO E FIDEDIGNIDADE DA MOTOR COMPETENCE ASSESSMENT EM PRÉ-ESCOLARES

ABSTRACT

The literature has evidenced the need for validation studies of motor tests to assess motor competence (MC). Luz et al (2016) proposed a battery of tests, that is, the Motor Competence Assessment (MCA) to evaluate MC in Portuguese children and adolescents. The purpose of the present study was to investigate the evidences of this MCA validity in a sample of Brazilian preschoolers, in addition to assess the correlation between the MC results obtained through MCA and the Test of Gross Motor Development-2 (TGMD-2). 251 male and female preschool-age children from six reference Centers in Early Childhood Education in the city of João Pessoa-PB participated in study. Data were collected by using MCA and TGMD-2. The results of the Confirmatory Factor Analysis (CFA) showed two models, one of them with appropriate adjustment indexes. The interclass correlation coefficients ranged between 0.77 and 0.96, which indicates an excellent reliability; the correlation between MCA and TGMD-2 was significant with a moderate magnitude (r = 0.57, p <0.01). The structure of three latent variables of the MC construct in the MCA was confirmed by the CFA. However, a two-dimensional model is suggested. MCA and TGMD-2 seemed to measure similar aspects of MC. Reliability enabled us to conclude that the MCA protocol applied to preschoolers maintains temporal stability.

Keywords:
Validation; Motor Competence; Preschoolers; Reliability

RESUMO

A literatura tem evidenciado a necessidade de estudos de validação de testes motores para avaliação da competência motora (CM). Assim, Luz e colaboradores propuseram uma bateria de testes Motor Competence Assessment (MCA) para avaliação da CM em crianças e adolescentes portugueses. Objetivou-se investigar as evidências de validade da MCA em uma amostra de pré-escolares brasileiros e testar a correlação entre resultados da CM avaliados com a MCA e o Test of Gross Motor Development -2 (TGMD-2). Participaram 251 pré-escolares de ambos os sexos, de seis Centros de Referência em Educação Infantil de João Pessoa-PB. Os dados foram coletados por meio da MCA e do TGMD-2. Os resultados da análise fatorial confirmatória (AFC) mostraram dois modelos, um com índices de ajuste adequados; Os coeficientes de correlação interclasse variaram entre 0,77 e 0,96, indicando confiabilidade excelente; a correlação entre a MCA e o TGMD-2 foi significante com magnitude moderada (r = 0,57, p<0,01). A estrutura de três variáveis latentes do construto CM na MCA foi confirmada pela AFC. Entretanto, sugere-se um modelo bidimensional. A MCA e o TGMD-2 parecem medir aspectos semelhantes da CM. A confiabilidade permitiu concluir que o protocolo da MCA aplicado a pré-escolares mantém estabilidade temporal.

Palavras-chave:
Desempenho psicomotor; Destreza motora; Validade dos testes

Introduction

Motor competence has been the focus of attention in recent years due to its significance for maintaining and developing an active healthy lifestyle. Being motor competent provides an individual greater autonomy for participating in motor practice and sports contexts, which promotes positive influences in children's health and prevents obesity11 Payne V, Isaacs L. Desenvolvimento motor humano: Uma abordagem vitalícia. Rio de Janeiro: Guanabara Koogan; 2007.

2 Robinson LE, Stodden DF, Barnett LM, Lopes VP, Logan SW, Rodrigues LP, et al. Motor competence and its effect on positive developmental trajectories of health. Sports Med 2015;45(9):1273-1284. Doi: 10.1007/s40279-015-0351-6
https://doi.org/10.1007/s40279-015-0351-...
-33 Logan SW, Robinson LE, Getchell N. The comparison of performances of preschool children on two motor asessments. Percept Mot Skills 2011;113(3):715-723. Doi: 10.2466/03.06.25.PMS.113.6.715-723
https://doi.org/10.2466/03.06.25.PMS.113...
.

Despite this evidence and the growing interest of the scientific community in the sense of exploring motor competence, an issue specifically about its evaluation has been raised, Assessing motor competence is especially worthy during childhood because it contributes to an early and broad view of the children's motor skills development, since this is a sensitive phase when considering the acquisition of fundamental motor skills, besides being critical for the development of healthy behavior44 Gallahue D. Donnelly, F. Developmental physical education for all children. 4.ed. Champaign: Human Kinetics;2003.

5 Cools W, Martelaer K, Vandaele B, Samaey C, Andries C. Assessment of movement skill performance in preschool children: Convergent validity between MOT 4-6 and M-ABC. J Sports Sci Med 2010;9(4):597-604.
-66 Timmons BW, LeBlanc AG, Carson V, Gorber SC, Dillman C, Janssen I, Kho ME, et al. Systematic review of physical activityand health in the early years (aged 0-4 years). Appl Physiol Nutr Metab 2012;37(4):773-792. Doi:10.1139/h2012-070.
https://doi.org/10.1139/h2012-070...
.

However, the assessment of motor competence is reported as a difficult procedure77 Stodden DF, Goodway JD, Langendorfer SJ, Roberton MA, Rudisill ME, Garcia C, et al. A developmental perspective on the role of motor skill competence in physical activity: an emergent relationship. Quest 2008;60 (2):290-306. Doi: 10.1080/00336297.2008.10483582
https://doi.org/10.1080/00336297.2008.10...
and part of this difficulty is due to the diversity of the instruments used in research. The Motoriktest für Vier-bis Sechjärige Kinder88 Zimmer R, Volkamer M. 1987. Motoriktest fu¨r vier-bis-sechsjahrige Kinder. Manual. Betz: Weinheim, 1987., Movement Assessment Battery for Children - 299 Henderson SE, Sugden DA, Barnett AL. Movement assessment battery for chidren. Second edition: examiner's manual. London: Pearson Assesment, 2007., Körperkoordinationtest für Kinder1010 Kiphard EJ, Schilling F. Körperkoordinationstest für Kinder KTK. Weinheim: Beltz; 1974., Test of Gross Motor Development-21111 Ulrich DA. Test of gross motor development-2 (examiner's manual). Austin: Prod-Ed; 2000. and Bruininks-Oseretsky test of Motor Proficiency 12 are some of the instruments widely used for the assessment of preschoolers’ motor skills. This diversity can hinder the development of longitudinal research, the comparison of results in studies and their respective correlatrelations with other significant variables22 Robinson LE, Stodden DF, Barnett LM, Lopes VP, Logan SW, Rodrigues LP, et al. Motor competence and its effect on positive developmental trajectories of health. Sports Med 2015;45(9):1273-1284. Doi: 10.1007/s40279-015-0351-6
https://doi.org/10.1007/s40279-015-0351-...
,77 Stodden DF, Goodway JD, Langendorfer SJ, Roberton MA, Rudisill ME, Garcia C, et al. A developmental perspective on the role of motor skill competence in physical activity: an emergent relationship. Quest 2008;60 (2):290-306. Doi: 10.1080/00336297.2008.10483582
https://doi.org/10.1080/00336297.2008.10...
. In addition, several tests have initially been developed with the purpose of diagnosing motor disorders55 Cools W, Martelaer K, Vandaele B, Samaey C, Andries C. Assessment of movement skill performance in preschool children: Convergent validity between MOT 4-6 and M-ABC. J Sports Sci Med 2010;9(4):597-604..

Although the instruments have widely been used in scientific research and applied to the most diverse contexts, the validation process must be confirmed by using more than one approach and multiple techniques. Therefore, obtaining a comprehensive evidence is essential so as to establish reliability before using an instrument in practice1313 Nunnally JC, Bernstein IH. The assessment of reliability. Psychometric Theory 1994;3:248-292.,1414 Cook DA, Beckman, T. J. Current concepts in validity and reliability for psychometric instruments: Theory and application. Am J Med 2006;119(2)..

The need for validation studies to improve the psychometric quality of existing tests, especially in educational contexts, was suggested by Scheuer et al1515 Scheuer C, Herrmann C, Bund A. Motor tests for primary school aged children: A systematic review. J Sports Sci 2019;3:1-16. Doi.org/10.1080/02640414.2018.1544535
https://doi.org/10.1080/02640414.2018.15...
. In a recent review that aimed to analyze the areas of application and psychometric properties of motor test batteries for preschoolers, the authors showed that both, the application of existing motor tests for specific theoretical structures and the use of the corresponding terminology have not been consistent so far1515 Scheuer C, Herrmann C, Bund A. Motor tests for primary school aged children: A systematic review. J Sports Sci 2019;3:1-16. Doi.org/10.1080/02640414.2018.1544535
https://doi.org/10.1080/02640414.2018.15...
.

According to Luz et al.1616 Luz C, Rodrigues LP, Almeida G, Cordovil R. Development and validation of a model of motor competence in children and adolescents. J Sci Med Sport 2016;19(7):568-572. Doi.org/10.1016/j.jsams.2015.07.005
https://doi.org/10.1016/j.jsams.2015.07....
there is a discrepancy between the theoretical structure of motor competence and its clinical application or use in scientific research to which MC is a subject of interest. This shows the lack of a strong conceptual model that can be used in different contexts and ages. The authors proposed a battery of tests for the quantitative assessment of motor competence with a practical and rapid application. Making use of tasks from instruments and protocols widely applied in the literature, this battery consists of six motor tasks: two locomotion tasks, two manipulation tasks and two stabilization tasks validated for 6-14-year-old Portuguese children1616 Luz C, Rodrigues LP, Almeida G, Cordovil R. Development and validation of a model of motor competence in children and adolescents. J Sci Med Sport 2016;19(7):568-572. Doi.org/10.1016/j.jsams.2015.07.005
https://doi.org/10.1016/j.jsams.2015.07....
. Although this battery of tests was created for middle childhood, the authors suggest its application in a wide age group, which could benefit the development of longitudinal studies and, consequently, enable researchers to obtain knowledge on motor competence in different stages of life. For these reasons, the battery of motor tests proposed by Luz et al.1616 Luz C, Rodrigues LP, Almeida G, Cordovil R. Development and validation of a model of motor competence in children and adolescents. J Sci Med Sport 2016;19(7):568-572. Doi.org/10.1016/j.jsams.2015.07.005
https://doi.org/10.1016/j.jsams.2015.07....
is a quite promising instrument for testing motor competence throughout childhood and adolescence.

There is no empirical evidence so far that the battery of tests proposed by Luz et al.1616 Luz C, Rodrigues LP, Almeida G, Cordovil R. Development and validation of a model of motor competence in children and adolescents. J Sci Med Sport 2016;19(7):568-572. Doi.org/10.1016/j.jsams.2015.07.005
https://doi.org/10.1016/j.jsams.2015.07....
to assess MC facilitates a valid reproduction for preschool-age children. Therefore, the relevance of the present investigation is due to the lack of validated instruments that could be used to evaluate preschoolers’ MC in Brazil. Thus, the purposes of this study were: (1) investigating the evidences of construct validity and some test-retest reliability aspects of the tasks proposed by the Motor Competence Assessment battery of tests in a sample of Brazilian preschoolers; (2) assessing the criterion validity by considering the motor competence results obtained through two batteries of tests, that is, the Motor Competence Assessment and the Test of Gross Motor Development-2.

Methods

Participants

The present investigation analyzed the secondary data of the project entitled ‘Movement's cool’, whose research protocol was approved by the Research Ethics Committee from the Health Sciences Center of the Brazilian university referred to as Universidade Federal da Paraíba (Opinion number: 2.727.698; CAAE: 88995778.7.0000.5188 ).

In the city of João Pessoa, the preschool public education area is divided into nine sectors, where 86 Reference Centers for Early Childhood Education (CREIs) are located. In these sectors, fifty institutions have 3-5-year-old children enrolled, however only ten of them have an appropriate area for performing motor tests. A representative number of CREIs was calculated per sector and six institutions were randomly selected for the present study. In view of a population of 573 children, a representative sample was calculated per sector, CREI and age, considering an estimated prevalence of 50%, a confidence interval of 95%, a maximum tolerable error of 5% and a design effect of 1.0.

The sample was randomly selected, thus, 251 preschoolers (50.60% boys) participated in the first stage of the study, and 53 preschoolers participated in the second stage for the test-retest reliability assessment. Parents and guardians signed the Free Informed Consent Form to attest they agreed with the child's participation.

Instruments and Procedures

Motor competence (MC) was measured by using two batteries of tests: (1) Motor Competence Assessment (MCA)1616 Luz C, Rodrigues LP, Almeida G, Cordovil R. Development and validation of a model of motor competence in children and adolescents. J Sci Med Sport 2016;19(7):568-572. Doi.org/10.1016/j.jsams.2015.07.005
https://doi.org/10.1016/j.jsams.2015.07....
, and (2) Test of Gross Motor Development - Second Edition (TGMD-2)1111 Ulrich DA. Test of gross motor development-2 (examiner's manual). Austin: Prod-Ed; 2000.

The MCA battery was proposed based on a theoretical model1616 Luz C, Rodrigues LP, Almeida G, Cordovil R. Development and validation of a model of motor competence in children and adolescents. J Sci Med Sport 2016;19(7):568-572. Doi.org/10.1016/j.jsams.2015.07.005
https://doi.org/10.1016/j.jsams.2015.07....
, which involves skills in the categories of stability, locomotion and object control; it includes the following tests:

  • (a) Lateral Jump: the child performs the largest amount of jumps with two feet together on a small wooden beam (60 x 50 x 0.8 cm) over a wooden pole (60 x 4 x 2 cm) in 15s; 1 point is scored for each correct jump. Two attempts are made, and a short time interval (approximately 1 min) is given for the participant to recover. The best performance between the two attempts (the highest score) was used as the test final result.

  • (b) Platform shifting: the child moves sideways as fast as possible for 20 seconds, using two wooden platforms (25cm x 25cm x 2cm). The participant starts with both feet on the right platform, grasps the left one with both hands and carries it to the right side, then he/she places the feet on this platform and so on. Each successful transfer from one platform to the other scored two points (one point for each stage).

  • (c) Shuttle run: the child runs across a straight line at maximum speed between points separated 10m apart; he/she picks up a wooden block and places it behind the starting line. Then, the child repeats the procedure to recover a second wooden block. The participants performed two attempts and only the best result was considered.

  • (d) Standing long jump: the child jumps with both feet together as far as possible. The distance (in meters) is marked between the starting line and the back of the heel at landing. The final score was the result corresponding to the longest distance after two attempts.

  • (e) Throwing velocity: the child throws a baseball (circumference: 22.86 cm; weight: 142 g) at a maximum speed against a wall using an overarm action without a preparatory race.

  • (f) Kicking velocity: after a preparatory run, the child kicks a soccer ball (no. 4, circumference: 64 cm, weight: 350 g) against a wall with as much strength as possible.

Considering the last two tasks, each participant made three attempts and the final result was given by the maximum speed in km/h obtained using the radar pistol (Bushnell, model 10-1911, USA). The total MC score was calculated by the average of the scores for all categories, based on Luz et al.1717 Luz C, Rodrigues LP, Meester AD, Cordovil R. The relationship between motor competence and health-related fitness in children and adolescents. PLoS ONE 2017;12(6):1. Doi: 10.1371/journal.pone.0179993
https://doi.org/10.1371/journal.pone.017...
.

The Test of Gross Motor Development - Second Edition (TGMD-2)1111 Ulrich DA. Test of gross motor development-2 (examiner's manual). Austin: Prod-Ed; 2000. is one of the best known tests used to assess children's motor performance; moreover, it is valid and reliable for being applied to Brazilian children1818 Valentini NC. Validity and reliability of the TGMD-2 for Brazilian children. J Mot Behav 2012;44(4):275-280. Doi: 10.1080/00222895.2012.700967
https://doi.org/10.1080/00222895.2012.70...
. This test assesses gross motor performance in 3-10-year-old children and includes two subtests: six locomotion skills (run, gallop, hop, leap, horizontal jump and slide/side run) and six skills for object controll (striking a stationary ball, stationary dribble, catch, kick, overhand throw). According to the protocol proposed by Ulrich1111 Ulrich DA. Test of gross motor development-2 (examiner's manual). Austin: Prod-Ed; 2000., trained appliers provided verbal instruction and showed the ability so as the child could make an attempt (trial). After identifying the child's understanding, two attempts of each skill were filmed and the same procedure was reproduced throughout the application process. A checklist is needed to decode the footage, in which the criteria for the quality of movements (ranging from 3 to 5) are described for each skill; if the criterion is met, a point is assigned, or zero when it is not met. Finally, the gross score was obtained per specific skills (between 6 and 10 points), per subtests (locomotor and object control that vary between 0 and 48 points), and the general score (between 0 and 96 points), obtained through the total of points in both subtests. The analysis of the videos was performed by two evaluators, thus, obtaining high intra- and inter-rater reliability (ICC values between 0.93 and 0.98).

Statistical analysis

Initially, descriptive analyzes were performed by using mean and standard deviation for the variables. Exploratory factor analysis (EFA) was performed to verify the data suitability by using the parameters suggested by Hutcheson and Sofroniou1919 Hutcheson GD, Sofroniou N. The multivariate social scientist: Introductory statistics using generalized linear models. London: Sage Publications; 1999.: Kaiser Meyer Olklin test (KMO), which must be> 0.70, and Bartlett's test of sphericity, which must have p <0.05. In order to examine the factorial validity of MCA in a sample of preschoolers, the correlations of latent factors were examined in confirmatory analysis in two models by using the Maximum Likelihood Estimation method. The analyzes were carried out using the SPSS AMOS 7.0 statistical package (v. 21.0, SPSS, Statistical Packages for Social Sciences, IBM® company).

For assessing the adjustment quality, the following indices were taken into account: X² (chi-square); RMSEA (Root Mean Square Error of Aproximation); GFI (Goodness-of-fit Index) and TLI (Tucker-Lewis Index). In addition to the X² adjustment values, the CFI adjustment index (Comparative Fit Index) and the SRMR (Standardized Root Mean Square Residual) were also ascertainied. Index values are considered desirable when RMSEA is close to or below 0.08; TLI greater than 0.90; 0.95 for CFI and 0.80 for SRMR2020 Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 1999; 6:1-55.11. Doi:10.1371/journal.pone.0179993
https://doi.org/10.1371/journal.pone.017...
.

Once the normality assumptions were considered acceptable, the correlation coefficients between the total scores of TGMD-2 and MCA were evaluated using Pearson’s test. The z score inverse values of the shuttle run skill were used, since higher values represent lower performance.

In order to examine reliability, Intraclass Correlation Coefficient (ICC) analyzes were used for test-retest measurements, determined by the total scores of each item in two tests at different periods of time with an interval of approximately 15 days between each of them.

The SPSS software (v. 21.0, SPSS, Statistical Packages for Social Sciences, An IBM® company) was used, and a 0.05 significance level was adopted.

Results

Table 1 shows the description of the sample according to the sex of the participants. The final sample of the present study included 251 children with a mean age of 4.53 (± 0.77) years. According to the descriptive data shown, higher values were seen for boys in most variables, with the exception of the shuttle run variable.

Table 1
Descriptive statistics (mean and standard deviation) of the age and motor skills variables of the 3-5-year-old participants (n = 251) separated according to sex. João Pessoa (PB), 2018

Regarding exploratory factor analysis, Kaiser-Meier-Olklin measure (KMO) = 0.81 (95% CI, 85-0.88) and Barlett’s Test of Sphericity (X² = 563.807; p <0.001) show that the Factor Analysis model for these data is suitable.

Figure 1 shows the model with three latent factors according to the original model proposed by Luz et al.1616 Luz C, Rodrigues LP, Almeida G, Cordovil R. Development and validation of a model of motor competence in children and adolescents. J Sci Med Sport 2016;19(7):568-572. Doi.org/10.1016/j.jsams.2015.07.005
https://doi.org/10.1016/j.jsams.2015.07....
. It was seen that the lateral jump task had the greatest factor load in the stability subtest (0.81); the standing long jump task showed a greater factor load in locomotion (0.80), whereas kicking had a factor load of 0.81 for object control.

Figure 1
Result of the confirmatory analysis for the model initially hypothesized by Luz et al. (2016)

This model showed appropriate adjustment indexes [x² = 0.425 p> 0.000; RMSEA = 0.000 (90% CI: 0.00-0.82); GFI = 0.92; TLI = 1.00; CFI = 1.00 and SRMR = 0.01], which supporting the three-factor model for MCA. However, a high correlation was seen in the factor load between latent stability and locomotion factors (1.04).

Due to the high correlation found between the latent factors, that is, stability and locomotion, a two-dimensional structure model was tested (Figure 2), which showed a better suitability of the adjustment indices [x² = 7.929 p> 0.440); RMSEA = 0.001 (90% IC 0.00-0.81); GFI = 0.98 TLI = 1.00; CFI = 1.00 and SRMR = 0.02], similar to those found in the three-factor model. This standardized solution is shown in Figure 2 by a structure that contains a Loc/Est factor: lateral jump; platform shifting , standing long jump and shuttle run, in addition to a second object control factor: kicking and throwing. The shuttle run variable has a negative value depending on its characteristic; the best values are expressed in the shortest periods of time in the test, that is, the higher the time, the worse the performance. It was seen that kicking skill had the highest factor load (0.86), whereas throwing had the lowest factor load (0.54).

Figure 2
Result of the confirmatory analysis for the model containing two dimensions

Considering the bivariate correlation, a significant association of moderate magnitude (r = 0.57; p <0.001) was found between the MCA and TGMD-2 batteries of tests.

Table 2 shows the results concerning reliability, in addition to the statistical data of the means, standard deviation and the 95% confidence intervals for the ICCs. Considering the test-retest analysis, the lowest values occurred for the lateral jump and throwing velocity, however, the ICC values reached are acceptable.

Table 2
Means and standard deviation of the test-retest scores and 95% confidence interval for intraclass correlation coefficients. João Pessoa (PB), 2018 (n = 53)

Discussion

This study assessed significant aspects of the construct validity, criteria and reliability of MCA1616 Luz C, Rodrigues LP, Almeida G, Cordovil R. Development and validation of a model of motor competence in children and adolescents. J Sci Med Sport 2016;19(7):568-572. Doi.org/10.1016/j.jsams.2015.07.005
https://doi.org/10.1016/j.jsams.2015.07....
in Brazilian preschoolers. The results found show two models for MCA factorial structure in preschoolers, a three-dimensional model and a two-dimensional one. Although the two solutions produced a good model fit2020 Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 1999; 6:1-55.11. Doi:10.1371/journal.pone.0179993
https://doi.org/10.1371/journal.pone.017...
, the present study provides evidence for using the battery based on a two-dimensional model (locomotion/stability and object control) of MC in early childhood, considering a reduced number of factors (just two). One of them encompasses locomotion and stability skills. Even revealing a contemporary trend, the inclusion of balance/stability abilities into the batteries to assess MC2121 Rudd J, Butson ML, Barnett L, Farrow D, Berry J, Borkoles E, et al. Fundamental Movement Skills Are More than Run, Throw and Catch: The Role of Stability Skills. PLoS ONE 2015;10(10):1-15. Doi.org/10.1080/02640414.2015.1061202
https://doi.org/10.1080/02640414.2015.10...
, the stabilization skills have traditionally been categorized as the ones underlying locomotor skills2222 Burton AW, Rodgerson RW. New perspectives on the assessment of movement skills and motor abilities. Adapt Phys Activ Q 2001;18: 347-365. Doi:10.1123/apaq.18.4.347
https://doi.org/10.1123/apaq.18.4.347...
.

Such results corroborate with the theoretical taxonomy base developed for TGMD-21111 Ulrich DA. Test of gross motor development-2 (examiner's manual). Austin: Prod-Ed; 2000., which uses two subdomains to assess gross motor skills (locomotion and object control)2323 Yun J, Ulrich D. A. Estimating measurement validity: A tutorial. Adapt Phys Activ Q 2002;19:32-47.. Burton and Miller2424 Burton AW, Miller, D. Movement skill assessment. Champaign, Il: Human Kinetics;1998. only consider the locomotion and object control classifications because they are the most commonly used in the literature, besides being the basis for most of the tools that have been developed to assess MC in children and adolescents. In addition, they are considered fundamental to be applied to sports, games and other physical activities specific to the context33 Logan SW, Robinson LE, Getchell N. The comparison of performances of preschool children on two motor asessments. Percept Mot Skills 2011;113(3):715-723. Doi: 10.2466/03.06.25.PMS.113.6.715-723
https://doi.org/10.2466/03.06.25.PMS.113...
,2525 Clark JE, Whitall J, What Is Motor Development? The Lessons of History. Quest 1989;41(3):183- 202..

However, these findings differ from the initial study on MCA carried out in Portugal with a specific population of children and adolescents, which suggests a solution with three factors. The difference in the latent factors found in the present study, compared to the original investigation, is likely to be related to the age range of the participants. The complexity of the assessment of movement skills reflects a multifactorial identity of the motor system55 Cools W, Martelaer K, Vandaele B, Samaey C, Andries C. Assessment of movement skill performance in preschool children: Convergent validity between MOT 4-6 and M-ABC. J Sports Sci Med 2010;9(4):597-604.. This result can be explained by the fact that the latent trait underlying motor assessment can be divided into multiple domains due to maturation and environmental experiences.

The comparison between the findings of the present study and the results found in the literature is complex, since there are no studies that have applied MCA. Despite this, the presentation of a two-dimensional model is shown as a valid alternative for assessing MC in preschool-age children, associated with practicality and the application of tasks widely used in other tests (KTK and TGMD-2), which may include MC construct.

Despite the fact that both batteries have similar tasks, the result of the correlations between MCA and TGMD-2 is likely to be related to the specificities found in each battery. MCA is a battery that evaluates the product, whose results related to skills are quantitatively measured. On the other hand , TGMD-2 provides a qualitative assessment of the execution of skills.

Previous research has shown evidence2626 Logan SW, Barnett LM, Goodway JD, Stodden DF. Comparison of performance on process- and product-oriented assessments of fundamental motor skills across childhood. J Sports Sci.2016;35(7): 634-641. Doi: 10.1080/02640414.2016.1183803
https://doi.org/10.1080/02640414.2016.11...
that evaluations oriented to processes and products measure similar constructions2727 Lander N, Morgan PJ, Salmon J, Logan SW, Barnett LM.The reliability and validity of an authentic motor skill assessment tool for early adolescent girls in an Australian school setting. J Sci Med Sport. 2017; 20: 590-594. Doi: 10.1016/j.jsams.2016.11.007
https://doi.org/10.1016/j.jsams.2016.11....
. The results shown herein seem to reinforce this finding, although the evaluations were carried out with different age groups. Both assessment strategies provide a useful assessment of MC and should be concurrently used to obtain a more holistic assessment of MC in preschoolers2121 Rudd J, Butson ML, Barnett L, Farrow D, Berry J, Borkoles E, et al. Fundamental Movement Skills Are More than Run, Throw and Catch: The Role of Stability Skills. PLoS ONE 2015;10(10):1-15. Doi.org/10.1080/02640414.2015.1061202
https://doi.org/10.1080/02640414.2015.10...
.

Considering the repeated administration of the protocol of the six items/tasks in the same participants, the results were expected to be acceptable, since the objective nature of the measures generally guarantees a high level of reliability among the evaluators over time2828 Haga M, Pedersen AV, Sigmundsson H. Interrelationship among selected measures of motor skills. Child Care Health Dev 2008;34:245-248. Doi.org/10.1111/j.1365-2214.2007.00793.x
https://doi.org/10.1111/j.1365-2214.2007...
. The present results confirmed this information, thus, showing that they are consistent over time in preschool-age children, whose ICCs varied between 0.77 and 0.96 for the items, which indicates excellent reliability.

Despite this, the motor performance assessment is particularly prone to variability in consistency in different motor tasks2929 Gallahue DL. Assessing motor development in young children studies in educational evaluation. Studies in Educational Evaluation 1983;8:247-252.. When seen among preschoolers, such tasks can also be associated with inconsistent performance and fatigue in the performance of tests. In addition, 3-4-year-old children are often easily bored with repetitive activities and are not worried to do them to please evaluators3030 Burton AW, Miller, D. Movement skill assessment. Champaign, Il: Human Kinetics; 1998.. Considering throwing, specifically, a certain difficulty in capturing the dice with the use of the radar pistol was seen, since this equipment requires a minimum speed, which sometimes can not be reached by younger children. Defining an adaptation criterion material (ball) and/or the number of valid repetitions is significant to prevent 3-4-year-old children from making tasks that are more difficult to be measured. These practical considerations must be taken into account when selecting a protocol for evaluating MC in preschoolers.

Conversely, high consistency in locomotion skills, shuttle run and standing long jump was seen. Similarly to this phenomenon, test-retest reliability was also confirmed in Brazilian children1818 Valentini NC. Validity and reliability of the TGMD-2 for Brazilian children. J Mot Behav 2012;44(4):275-280. Doi: 10.1080/00222895.2012.700967
https://doi.org/10.1080/00222895.2012.70...
and high values were found for locomotion skills. Locomotion movements have a phylogenetic basis, which enables the humans to reach the initial and elementary stages of these movements before other movements3131 Clark JE, Metcalfe J. The mountain of motor development: A metaphor. In: Clark JE, Humphrey J. Motor development: research and reviews. Champaign: Human Kinetics; 2002, p. 163-190.. This is likely to be a possible explanation for the occurrence of this phenomenon in the sample evaluated.

The present study assessed significant aspects of construct validity with regard to the assessment of MC with MCA1616 Luz C, Rodrigues LP, Almeida G, Cordovil R. Development and validation of a model of motor competence in children and adolescents. J Sci Med Sport 2016;19(7):568-572. Doi.org/10.1016/j.jsams.2015.07.005
https://doi.org/10.1016/j.jsams.2015.07....
. In addition, the correlation between MCA and TGMD-2 bateries of tests widely used in the literature was verified. The use of different procedures, such as the exploratory and confirmatory factor analysis, reliability and correlation between tests is highlighted as the main aspect, since evidence of validity must be provided by using multiple techniques and evidences so as to make interpretations and argue on solid decisions2323 Yun J, Ulrich D. A. Estimating measurement validity: A tutorial. Adapt Phys Activ Q 2002;19:32-47.. Another point that deserves to be highlighted is that the results of this study represent an important step towards the use of a battery with motor tasks widely used in previous research scenarios as representative of MC77 Stodden DF, Goodway JD, Langendorfer SJ, Roberton MA, Rudisill ME, Garcia C, et al. A developmental perspective on the role of motor skill competence in physical activity: an emergent relationship. Quest 2008;60 (2):290-306. Doi: 10.1080/00336297.2008.10483582
https://doi.org/10.1080/00336297.2008.10...
,1010 Kiphard EJ, Schilling F. Körperkoordinationstest für Kinder KTK. Weinheim: Beltz; 1974.,3232 Gallahue DL, Ozmun JC, Goodway JD. Compreendendo o desenvolvimento motor: Bebês, crianças, adolescentes e adultos. 7. ed. São Paulo: Phorte Editora; 2013., oriented to the product and at the same time objective and easy to be applied to preschoolers. A product-oriented assessment can be part of process-oriented assessments, enabling a more comprehensive analysis of MC, as recommended in some studies2121 Rudd J, Butson ML, Barnett L, Farrow D, Berry J, Borkoles E, et al. Fundamental Movement Skills Are More than Run, Throw and Catch: The Role of Stability Skills. PLoS ONE 2015;10(10):1-15. Doi.org/10.1080/02640414.2015.1061202
https://doi.org/10.1080/02640414.2015.10...
,2727 Lander N, Morgan PJ, Salmon J, Logan SW, Barnett LM.The reliability and validity of an authentic motor skill assessment tool for early adolescent girls in an Australian school setting. J Sci Med Sport. 2017; 20: 590-594. Doi: 10.1016/j.jsams.2016.11.007
https://doi.org/10.1016/j.jsams.2016.11....
,3333 Ré AHN, Logan SW, Cattuzzo MT, Henrique RS, Tudela MC, Stodden DF. Comparison of motor competence levels on two assessments across childhood. J Sports Sci 2018;36(1):01-06. Doi: 10.1080/02640414.2016.1276294
https://doi.org/10.1080/02640414.2016.12...
.

Finally, in spite of the fact that a model different from a three-dimensional one for assessing motor competence was found, it is worth mentioning the sample size and the study sampling process. The sample was randomized, representative by age and sex due to the epidemiological design of this investigation and to the institutions that were located in different regions of the city of João Pessoa. However, some limitations must be recognized. A significant limitation of the present study is that the adaptation of specific materials regarding the object control ability was not made respecting the physical characteristics of the participants in early childhood. It is suggested that further studies investigate the two-dimensional model shown in this study by using six motor tasks for the investigation of the motor competence of preschoolers. Assessing the model invariance would be useful over time. This process is essential to monitor the development of children’s MC and wheher this construct changes throughout childhood3434 Utesch T, Bardid F, Hyuben F, Strauss B, Tietjens M, Martelaer KD, et al. Using rasch modeling to investigate the construct of motor competence in early childhood. Psychol Sport Exerc 2016;24:179-187. Doi: 10.1016/j.psychsport.2016.03.001
https://doi.org/10.1016/j.psychsport.201...
.

Conclusions

In view of the results found in the present study, the latent structure represented by three variables of the MC construct in the Motor Competence Assessment was confirmed by the confirmatory factor analysis. Despite this, a two-dimensional model showed better adjustment rates for the sample of Brazilian preschoolers. MCA and TGMD-2 have a significant correlation of moderate magnitude, which indicates that the two batteries seem to measure, in part, similar aspects of MC. The protocol of MCA tasks when applied to preschool children with typical development maintains temporal stability. The findings of the present study may impact the practice of Physical Education professionals and researchers, since a two-dimensional model is shown as an option for assessing MC of preschoolers.

Acknowledgments

The authors thank the academic program of the University of Pernambuco referred to as Programa de Fortalecimento Acadêmico da Universidade de Pernambuco - PFA/UPE

References

  • 1
    Payne V, Isaacs L. Desenvolvimento motor humano: Uma abordagem vitalícia. Rio de Janeiro: Guanabara Koogan; 2007.
  • 2
    Robinson LE, Stodden DF, Barnett LM, Lopes VP, Logan SW, Rodrigues LP, et al. Motor competence and its effect on positive developmental trajectories of health. Sports Med 2015;45(9):1273-1284. Doi: 10.1007/s40279-015-0351-6
    » https://doi.org/10.1007/s40279-015-0351-6
  • 3
    Logan SW, Robinson LE, Getchell N. The comparison of performances of preschool children on two motor asessments. Percept Mot Skills 2011;113(3):715-723. Doi: 10.2466/03.06.25.PMS.113.6.715-723
    » https://doi.org/10.2466/03.06.25.PMS.113.6.715-723
  • 4
    Gallahue D. Donnelly, F. Developmental physical education for all children. 4.ed. Champaign: Human Kinetics;2003.
  • 5
    Cools W, Martelaer K, Vandaele B, Samaey C, Andries C. Assessment of movement skill performance in preschool children: Convergent validity between MOT 4-6 and M-ABC. J Sports Sci Med 2010;9(4):597-604.
  • 6
    Timmons BW, LeBlanc AG, Carson V, Gorber SC, Dillman C, Janssen I, Kho ME, et al. Systematic review of physical activityand health in the early years (aged 0-4 years). Appl Physiol Nutr Metab 2012;37(4):773-792. Doi:10.1139/h2012-070.
    » https://doi.org/10.1139/h2012-070
  • 7
    Stodden DF, Goodway JD, Langendorfer SJ, Roberton MA, Rudisill ME, Garcia C, et al. A developmental perspective on the role of motor skill competence in physical activity: an emergent relationship. Quest 2008;60 (2):290-306. Doi: 10.1080/00336297.2008.10483582
    » https://doi.org/10.1080/00336297.2008.10483582
  • 8
    Zimmer R, Volkamer M. 1987. Motoriktest fu¨r vier-bis-sechsjahrige Kinder. Manual. Betz: Weinheim, 1987.
  • 9
    Henderson SE, Sugden DA, Barnett AL. Movement assessment battery for chidren. Second edition: examiner's manual. London: Pearson Assesment, 2007.
  • 10
    Kiphard EJ, Schilling F. Körperkoordinationstest für Kinder KTK. Weinheim: Beltz; 1974.
  • 11
    Ulrich DA. Test of gross motor development-2 (examiner's manual). Austin: Prod-Ed; 2000.
  • 12
    Bruininks R, Bruininks B. Bruininks-Oseretsky. Test of Motor Proficiency. 2th. ed. Minneapolis: NCS Pearson; 2005.
  • 13
    Nunnally JC, Bernstein IH. The assessment of reliability. Psychometric Theory 1994;3:248-292.
  • 14
    Cook DA, Beckman, T. J. Current concepts in validity and reliability for psychometric instruments: Theory and application. Am J Med 2006;119(2).
  • 15
    Scheuer C, Herrmann C, Bund A. Motor tests for primary school aged children: A systematic review. J Sports Sci 2019;3:1-16. Doi.org/10.1080/02640414.2018.1544535
    » https://doi.org/10.1080/02640414.2018.1544535
  • 16
    Luz C, Rodrigues LP, Almeida G, Cordovil R. Development and validation of a model of motor competence in children and adolescents. J Sci Med Sport 2016;19(7):568-572. Doi.org/10.1016/j.jsams.2015.07.005
    » https://doi.org/10.1016/j.jsams.2015.07.005
  • 17
    Luz C, Rodrigues LP, Meester AD, Cordovil R. The relationship between motor competence and health-related fitness in children and adolescents. PLoS ONE 2017;12(6):1. Doi: 10.1371/journal.pone.0179993
    » https://doi.org/10.1371/journal.pone.0179993
  • 18
    Valentini NC. Validity and reliability of the TGMD-2 for Brazilian children. J Mot Behav 2012;44(4):275-280. Doi: 10.1080/00222895.2012.700967
    » https://doi.org/10.1080/00222895.2012.700967
  • 19
    Hutcheson GD, Sofroniou N. The multivariate social scientist: Introductory statistics using generalized linear models. London: Sage Publications; 1999.
  • 20
    Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 1999; 6:1-55.11. Doi:10.1371/journal.pone.0179993
    » https://doi.org/10.1371/journal.pone.0179993
  • 21
    Rudd J, Butson ML, Barnett L, Farrow D, Berry J, Borkoles E, et al. Fundamental Movement Skills Are More than Run, Throw and Catch: The Role of Stability Skills. PLoS ONE 2015;10(10):1-15. Doi.org/10.1080/02640414.2015.1061202
    » https://doi.org/10.1080/02640414.2015.1061202
  • 22
    Burton AW, Rodgerson RW. New perspectives on the assessment of movement skills and motor abilities. Adapt Phys Activ Q 2001;18: 347-365. Doi:10.1123/apaq.18.4.347
    » https://doi.org/10.1123/apaq.18.4.347
  • 23
    Yun J, Ulrich D. A. Estimating measurement validity: A tutorial. Adapt Phys Activ Q 2002;19:32-47.
  • 24
    Burton AW, Miller, D. Movement skill assessment. Champaign, Il: Human Kinetics;1998.
  • 25
    Clark JE, Whitall J, What Is Motor Development? The Lessons of History. Quest 1989;41(3):183- 202.
  • 26
    Logan SW, Barnett LM, Goodway JD, Stodden DF. Comparison of performance on process- and product-oriented assessments of fundamental motor skills across childhood. J Sports Sci.2016;35(7): 634-641. Doi: 10.1080/02640414.2016.1183803
    » https://doi.org/10.1080/02640414.2016.1183803
  • 27
    Lander N, Morgan PJ, Salmon J, Logan SW, Barnett LM.The reliability and validity of an authentic motor skill assessment tool for early adolescent girls in an Australian school setting. J Sci Med Sport. 2017; 20: 590-594. Doi: 10.1016/j.jsams.2016.11.007
    » https://doi.org/10.1016/j.jsams.2016.11.007
  • 28
    Haga M, Pedersen AV, Sigmundsson H. Interrelationship among selected measures of motor skills. Child Care Health Dev 2008;34:245-248. Doi.org/10.1111/j.1365-2214.2007.00793.x
    » https://doi.org/10.1111/j.1365-2214.2007.00793.x
  • 29
    Gallahue DL. Assessing motor development in young children studies in educational evaluation. Studies in Educational Evaluation 1983;8:247-252.
  • 30
    Burton AW, Miller, D. Movement skill assessment. Champaign, Il: Human Kinetics; 1998.
  • 31
    Clark JE, Metcalfe J. The mountain of motor development: A metaphor. In: Clark JE, Humphrey J. Motor development: research and reviews. Champaign: Human Kinetics; 2002, p. 163-190.
  • 32
    Gallahue DL, Ozmun JC, Goodway JD. Compreendendo o desenvolvimento motor: Bebês, crianças, adolescentes e adultos. 7. ed. São Paulo: Phorte Editora; 2013.
  • 33
    Ré AHN, Logan SW, Cattuzzo MT, Henrique RS, Tudela MC, Stodden DF. Comparison of motor competence levels on two assessments across childhood. J Sports Sci 2018;36(1):01-06. Doi: 10.1080/02640414.2016.1276294
    » https://doi.org/10.1080/02640414.2016.1276294
  • 34
    Utesch T, Bardid F, Hyuben F, Strauss B, Tietjens M, Martelaer KD, et al. Using rasch modeling to investigate the construct of motor competence in early childhood. Psychol Sport Exerc 2016;24:179-187. Doi: 10.1016/j.psychsport.2016.03.001
    » https://doi.org/10.1016/j.psychsport.2016.03.001

Publication Dates

  • Publication in this collection
    13 Nov 2020
  • Date of issue
    2020

History

  • Received
    10 Apr 2019
  • Reviewed
    30 Nov 2019
  • Accepted
    20 Apr 2020
Universidade Estadual de Maringá Avenida Colombo, 5790 - cep: 87020-900 - tel: 44 3011 4315 - Maringá - PR - Brazil
E-mail: revdef@uem.br