Introduction
Cerebral Palsy (CP) describes a group of permanent disorders of the development of movement and posture, causing activity limitation, that are attributed to nonprogressive disturbances that occurred in the developing fetal or infant brain. The motor disorders of cerebral palsy are often accompanied by disturbances of sensation, perception, cognition, communication, and behavior, by epilepsy, and by secondary musculoskeletal problems1. CP is divided into three groupings based on the predominat neuromotor abnormality: spastic (unilateral and bilateral), dyskinetic (dystonia and choreoathetosis) or ataxic1.
However, the functional consequences of involvement of the upper and lower extremities should therefore be separately classified using objective functional scales1 as the Gross Motor Function Classification System (GMFCS)2 .The GMFCS was developed in response to the need to have a standardized system for describing and classifying the severity of movement disability among children with cerebral palsy. The GMFCS is a 5 level classification system on the basis of their self-initiated movement with particular emphasis on sitting, walking, and wheeled mobility. Level I includes children and youth with CP who walk without limitations, and Level II includes limitations walking long distances and balancing. In Level III, the individual walks using a hand-held mobility device (canes, crutches, walkers). Children and youth in level IV are more likely to be transported in a manual wheelchair or use powered mobility. In Level V, individuals have severe limitations in head and trunk control and require extensive assisted technology and physical assistance2. The GMFCS includes four age bands (less than 2 years, 2 to 4 years, 4 to 6 years, and 6 to 12 years)2 and it is cross-culturally adapted to Brazilian Portuguese3.
The GMFCS Expanded and Revised4 (GMFCS E & R) includes age band for youth 12-18 years of age and its translation into the Portuguese language (Brazil) was conducted in 2010 by a group that included a neurologist and occupational therapists. The translation procedure was applied according to the guidelines of Canchild - Centre For Childhood Disability research website and the Portuguese version (Brazil) of GMFCS E & R form can be downloaded from this website ( http://www.canchild.ca ). The validity and reliability of the original GMFCS have been studied extensively and are well established2 , 5 , 6, and the reliability of the expanded version of the GMFCS has been examined in Canada4 and Turkey7.
The classification system is widely used among healthcare professionals to establish goals, give prognoses, and make decisions1 , 8. The GMFCS Family Report Questionnaire9 has been used by parents of children with CP to classify gross motor function and has been shown to be consistent with those of health professionals in studies conducted in both Canada9 and the UK10 , 11. Such classification may differ due to children's varying performance in relation to methods of mobility12 in different environments (home, school, hospital). Families will almost certainly know their children's ability across a broader range of settings11. However, it is important to determine the level of agreement between healthcare professionals and parents when classifying a child with CP using versions of the GMFCS13.
The aims of the present study were: (1) to determine the inter-rater and intra-rater reliability of the Portuguese version of the GMFCS E & R; (2) to examine reliability of parent report using the GMFCS Family Report Questionnaire in children with cerebral palsy aged 4 to 12 years in comparison with therapists; and (3) to find significant differences between the perception of parents and therapists in relation to children's motor limitation using the GMFCS E & R.
Method
This cross-sectional, non-experimental quantitative study was conducted to compare the classification of the gross motor function of individuals with CP according to parents and therapists. The study was approved by the Research Ethics Committee at Hospital das Clínicas at Faculdade de Medicina de Ribeirão Preto, Universidade de São Paulo (FMRP-USP), Ribeirão Preto, SP, Brazil. The parents provided written consent (HCRP no. 12469/2008).
Participants
For the assessment of inter-rater reliability, 90 individuals with CP participated, aged between 4 and 18 years old. For the assessment of reliability between therapists and parents, only 84 parents and their children with CP attended. Six youths between 12 and 18 years were excluded, since the GMFCS Family Report Questionnaire did not encompass this age at the time of data collection.
The participating children attended the Occupational Therapy Service and/or the Physical Therapy Service at the Rehabilitation Center or the Neurology service of Hospital das Clínicas of FMRP-USP between September 2010 and October 2011.
A convenience sample was used and the inclusion criteria were: having a diagnosis of CP regardless of the type or severity of motor impairment and being 4 to 18 years old. Exclusion criteria were children who were deaf or blind, who did not perform visual fixation or had epilepsy.
Data collection procedure
Two occupational therapists collected data simultaneously from separate places. The first evaluator (E1) remained with the parent or guardian, and the second evaluator (E2) remained with the child. E1 has nine years of professional experience in the rehabilitation of children with CP and is familiar with the GMFCS. E2 is an Occupational Therapy undergraduate and is not very familiar with the classification system. A research assistant collaborated in the study as a third occupational therapist (Evaluator 3 - E3) responsible for filming and selecting the videos for retest.
From the parents, E1 collected information concerning the children's age and the parents' education, profession, income, and age. The Brazilian Portuguese version of the GMFCS Family Report Questionnaire (available at http://www.canchild.ca ) was read to the parents so they could identify a single motor level. The parents were instructed to choose the closest level to the child's motor skill.
E2 observed the children in relation to trunk control, gait, and transfers and classified them according to the Brazilian Portuguese version of the GMFCS E & R (available at http://www.canchild.ca ). This procedure was filmed by E3 and subsequently used for intra- and inter-rater analysis. Data about locomotion at school, outdoors, and in the community was obtained from the parents.
In order to include all levels of the GMFCS E & R, both evaluators (E1 and E2) watched 30 videos selected by E3 to assess intra-rater reliability. E2 performed the first evaluation when the children were filmed, and E1 evaluated the children 2 weeks later to avoid memory bias (e.g., remembering the classification chosen by parents). The second evaluation (retest) took place one month after the first. Both E1 and E2 watched the videos again separately to classify the level of the children's motor impairment. The initial classifications performed by E1 (the occupational therapist with the most experience with children with CP) were taken as a reference to compare the classifications performed by the therapists and parents.
Statistical analysis
The GMFCS E & R is an ordinal scale with five levels. Descriptive statistics were used to characterize the participants. Ordinal data were analyzed using percentage agreement and Cohen's unweighted Kappa (k) to examine parent-therapist agreement and intra- and inter-rater agreement.
The following characterizations were used for the Kappa coefficient: values below zero (poor), between 0.00 and 0.20 (negligible), between 0.21 and 0.40 (mild), between 0.41 and 0.60 (moderate), between 0.61 and 0.80 (substantial), and between 0.81 and 1.0 (almost perfect agreement)14. The Chi-square test was used to find significant differences between the perception of parents and therapists in relation to motor limitation of child using the GMFCS E&R.
Results
The average age of children was 7.58 years (7 years and 7 months), ranging from 4 to 17.91 years old. Most were classified as children with spastic bilateral cerebral palsy (n=61), unilateral spastic (n=17), dyskinetic (n=9), and ataxic (n=3) CP. Regarding sex, the sample was equally distributed.
The children with unilateral CP were frequently classified by the occupational therapist (E1) as levels I and II of the GMFCS E & R (82.4% in level I and 17.6% in level II). Most of those with bilateral CP were classified as level IV (27.9 %), although the gross motor function of these children was distributed over the GMFCS E & R levels (Table 1). In relation to the parents, only one questionnaire (GMFCS Family Report Questionnaire) was answered by a father; all the remaining were answered by mothers, the primary caregiver. The children's characteristics and those of the parents are described in Table 1.
Table 1 Characteristics of children and their caregivers (obtained by the E 1).
CP type | Level I | Level II | Level III | Level IV | Level V | Total | |
---|---|---|---|---|---|---|---|
Bilateral spastic | 6 | 12 | 14 | 17 | 12 | 61 | |
Unilateral spastic | 14 | 3 | - | - | - | 17 | |
Dyskinetic | - | 2 | - | 3 | 4 | 9 | |
Ataxic | 1 | 1 | - | 1 | - | 3 | |
Caregivers' characteristics | Average | Standard deviation | Minimum | Maximum | |||
Age | 34.06 | 8.777 | 19 | 56 | |||
Years of schooling | 8.80 | 3.299 | 0 | 15 | |||
Income | 1,222.81 | 787.347 | 250.00 | 6,000 | |||
Occupation | (n) | ||||||
Does not work | 62 | ||||||
Works | 28 | ||||||
Inter-rater evaluation
Table 2 presents the results of inter-rater agreement, considered to be almost perfect (k=0.90, confidence interval [CI] 0.83-0.97), with 7 disagreements out of a total of 90 children.
Table 2 Classifications performed by evaluators 1 and 2 (occupational therapists) based on the GMFCS E & R.
Evaluator 1 | Evaluator 2 | |||||
---|---|---|---|---|---|---|
Level I | Level II | Level III | Level IV | Level V | Total | |
Level I | 19 | 1 | - | - | - | 20 |
Level II | - | 18 | - | - | - | 18 |
Level III | - | - | 13 | 1 | - | 14 |
Level IV | - | - | 1 | 17 | 3 | 21 |
Level V | - | - | - | 1 | 16 | 17 |
Total | 19 | 19 | 14 | 19 | 19 | 90 |
The table shows a high rate of agreement in all levels, with most disagreements (4 out of 7) found levels IV and V.
Intra-rater evaluation
One month after their initial evaluation, the evaluators (E1 and E2) repeated the classification of the gross motor function of the 30 children with CP (retest). Both evaluators obtained a near perfect intra-rater agreement (k=1.00, confidence interval [CI] 1.00-1.00, p<0.001), i.e. there was no disagreement between the classifications performed at different points in time.
Reliability between therapists and parents
Substantial agreement was observed between the classification performed by the therapist (E1) and that performed by parents (k=0.71, confidence interval [CI] 0.59-0.83, p<0.001). Table 3 presents the classifications according to the GMFCS E & R of both E1 and the parents.
Table 3 Classifications performed by evaluator 1 and parents according to the GMFCS E & R.
Evaluator 1 | GMFCS parents | |||||
---|---|---|---|---|---|---|
Level I | Level II | Level III | Level IV | Level V | Total | |
Level I | 15 | 3 | - | - | - | 18 |
Level II | - | 17 | - | - | - | 17 |
Level III | - | 1 | 8 | 2 | 1 | 12 |
Level IV | - | - | 1 | 11 | 8 | 20 |
Level V | - | - | - | 3 | 14 | 17 |
Total | 15 | 21 | 9 | 16 | 23 | 84 |
There were 19 discrepancies between the ratings of parents and therapists. There were three disagreements between levels I and II, one between levels II and III, three between III and IV, and 11 between levels IV and V. Furthermore, there was a discrepancy between levels III and V when the therapist classified the child in level III and the parents in level V.
Even though substantial agreement was reached between parents and therapists, a total of 19 cases of disagreement were observed. In 5 (26.3%) of these, the parents classified the children in levels below those classified by the therapist, indicating lower motor impairment (26.3%). In the 14 (73.7%) remaining cases, the parents classified the children at higher levels of motor impairment, showing significant difference according to the Chi-square test (p=0.04).
Discussion
The Gross Motor Function Classification System has been widely used in research and clinical practice, being a valid and reliable instrument to evaluate the gross motor function of children with cerebral palsy2 , 5. The results indicated near perfect agreement between the health professionals with different levels of experience with children with CP aged 4 to 18 years and classified by the Brazilian Portuguese version of the GMFCS E & R. The intra-rater agreement obtained in this study was higher than that reported in the initial study on GMFCS involving children aged 0 to 12 years and therapists who were familiar with the children (k=0.75) 2. However, our sample did not include children younger than 4 years because the inter-rater reliability for children under 2 years has been shown to be lower given the tendency of these children to be reclassified at lower levels (less functional limitation). In older children, however, there is greater stability of functional abilities13.
McDowell et al.10 found substantial agreement between two physical therapists, one familiar and the other unfamiliar with the children included in the study (k=0.64). Excellent agreement was obtained in the present study even though neither of the evaluators (E1 and E2) in this study were familiar with the children. Such a result was different from that found by Morris et al.11, who obtained much lower values. Kappa was equal to 0.65 when the classification was performed by physical therapists and pediatricians, and equal to 0.38 when the classification was performed by orthopedic surgeons and physical therapists and then between orthopedic surgeons and pediatricians. Classification in these cases could be based on direct observation, medical files or both. Kappa was equal to 0.6715 when the reliability among clinicians was verified and classification was based on medical files. The results concerning reliability differ depending on the different health professionals performing the classifications and on the methods used to collect information, but, in general, the GMFCS is very reliable for classifying the gross motor function of children with CP.
The classification in this study was repeated by the occupational therapists one month later, when near perfect agreement was reached between the evaluators. Few studies have evaluated intra-rater reliability performed by healthcare professionals. The study conducted by Gainsborough et al.16, which included 20 respondents who repeated the classification of 10 children using the GMFCS after 5 months through the study of written cases, obtained a Kappa equal to 0.72.
Substantial agreement was obtained between occupational therapists and parents and disagreement predominated in levels IV and V, unlike other studies2 , 9 , 17, in which disagreement was found in levels I and II (no walking aids). The children classified as levels IV and V require the use of assistive technology (manual or powered wheelchair), which depends on contextual factors12 such as accessibility to these resources, architectural barriers, as well as personal factors including acceptance of colleagues and family12. The cost of a wheelchair in Brazil is high, however, the Brazilian government has increased funding for the Health System to provide free wheelchairs at national, state, and municipal levels18.
Additionally, caregivers tend to classify children's motor impairment more severely than therapists9 - 11 , 13. Parents interact with children in different environments and situations while healthcare professionals generally evaluate children in a standardized environment such as a clinic or school9 , 13 and tend to overestimate the child's skills, that is, the child's maximum functional skill, minimizing any limiting effect of the environment13. There is great variability in the mobility of children with CP, which depends on environmental and personal factors12. Most of the mothers in this study did not work outside the home, but rather spent the entire day with their children and knew the child's performance in each environment (home, school, community).
Partnerships between families and healthcare professionals need to be established in clinical practice to provide effective collaborative family-centered care. Healthcare professionals should recognize the parents as experts in identifying their children's needs and skills across a broader range of settings, while parents also need the opinions of therapists and physicians to help them make decisions when necessary11. Therefore, it is recommended that the classifications regarding the GMFCS E & R are made independently by healthcare professionals and parents. In case of disagreements (which occur in a minority of cases) a consensus should be reached on a classification as a basis for making subsequent clinical decisions13.
Therefore, the Brazilian Portuguese version of the GMFCS E & R has proven reliable for use by healthcare professionals with different levels of experience and parents. It can be easily incorporated into clinical practice to define the prognosis and treatment goals that may involve the need for assistive technology, and into research to compare similar groups6.
This study's limitations include the age range (between 4 and 12 years old) of the studied children. Future studies are necessary to address children 0 to 4 years old and adolescents 12 to 18 years old and also to evaluate the classification or parents at different points in time to verify test-retest reliability in comparison to healthcare professionals. Additionally, the reliability of the classification among different professionals (physical therapists, pediatricians, neurologists, orthopedists) should be verified in Brazil.