Acessibilidade / Reportar erro

A computerized system for the application of Basso, Beattie and Bresnahan scale in Wistar rats

Abstract

OBJECTIVES:

To develop and test a computer program to assist researchers in assigning scores in the application of the Basso, Beattie and Bresnahan (BBB) scale and to compare these scores when doing so in free, targeted and automated computer-assisted modes.

METHOD:

To test the program, the participants used the Impactor methodology recommended by the New York University (USA), in which 12 Wistar rats submitted to spinal cord injury were filmed on the 28th day after the injury. Eight researchers from the Laboratory of Medical Investigation, Faculdade de Medicina da Universidade de São Paulo, SP, Brazil took part in the study. The two heads of the laboratory, with 15 years of experience in the application of the scale, were considered the gold standard.

RESULTS:

The results of the scale application were not significantly different in relation to the gold standard, considering the mean of the evaluators in each method: free, targeted and automated form (with the help of the computer).

CONCLUSIONS:

The application of the BBB scale in the automated mode, using the computer program, did not present any difference in relation to the gold standard for all the evaluators. Level of Evidence II, Diagnostic Studies.

Spine; Methods; Spinal cord compression; Evaluation; Diagnosis, computer-assisted; Rats


INTRODUCTION

Spinal cord injury is a serious public health issue and one of the most devastating and incapacitating neurological syndromes that affect human beings. It is characterized by severe motor alterations, alterations of superficial and deep sensitivity, and neurovegetative and psychosocial disorders.1Scheff SW, Saucier DA, Cain ME. A statistical method for analyzing rating scale data: the BBB locomotor score. J Neurotrauma. 2002;19(10):1251-60.

The understanding of the physiopathological mechanisms of spinal cord injury becomes essential, yet no consensus has yet been reached on the best method of analysis of functional recovery. Although some tests that evaluate functional recovery are easy to use, they present limited sensitivity to subjective observations.2Barros Filho TEP, Basile RJ coordenadores, Coluna vertebral diagnóstico e tratamento das principais patologias. São Paulo: Sarvier; 1995. , 3Tarlov IM. Spinal cord compression studies: III. Time limits for recovery after gradual compression in dogs. AMA Arch NeurPsych. 1954;71(5):588-97. Most spinal cord injury studies evaluate functional recovery through the analysis of sensory and locomotor reflexes, and use Wistar rats due to their practicability, cost and availability. These tests are also performed in other animals.4Fairholm DJ, Turnbull IM. Microangiographic study of experimental spinal cord injuries. J Neurosurg. 1971;35(3):277-86

Yeo JD, Payne W, Hinwood B, Kidman AD. The experimental contusion injury of the spinal cord in sheep. Paraplegia. 1975;12(4):279-98.
- 6Constantini S, Young W. The effects of methylprednisolone and the ganglioside GM1 on acute spinal cord injury in rats. J Neurosurg. 1994;80(1):97-111 One of the difficulties referred to in the studies is the establishment of a standardized evaluation system to assess motor function in spinal cord-injured animals.7Panjabi MM, Wrathall JR. Biomechanical analysis of experimental spinal cord injury and functional loss. Spine (Phila Pa 1976). 1988;13(12):1365-70.

Kuhn PL, Wrathall JR. A mouse model of graded contusive spinal cord injury. J Neurotrauma. 1998;15(2):125-40
- 9Vialle LRG, Fischer S, Marcon JC, Vialle E, Luzzi R, Bleggi-Torres LF. Estudo histológico da lesão medular experimental em ratos. Rev Bras Ortop. 1999;34(2):85-9.

The functional recovery evaluation scale of Basso, Beattie and Bresnahan (BBB)1010 Basso DM, Beattie MS, Bresnahan JC. A sensitive and reliable locomotor rating scale for open field testing in rats. J Neurotrauma. 1995;12(1):1-21. , 1111 Basso DM, Beattie MS, Bresnahan JC. Graded histological and locomotor outcomes after spinal cord contusion using the NYU weight-drop device versus transection. Exp Neurol. 1996;139(2):244-56. is the main scale used to quantify motor recovery in spinal cord-injured rats, which follows studies carried out by MASCIS (Multicenter Animal Spinal Cord Injury Study). Basso et al. 1010 Basso DM, Beattie MS, Bresnahan JC. A sensitive and reliable locomotor rating scale for open field testing in rats. J Neurotrauma. 1995;12(1):1-21. present a scale to evaluate locomotor recovery in rats with spinal cord injury at the levels of T VII, T VIII and T IX, based on the functional, sensory and motor responses, and that ranges from 0 to 21, and demonstrate that this scale is efficient and sensitive. We studied the frequency and the nature of errors in the interpretation of the BBB scale,1212 Koopmans GC, Deumens R, Honig WM, Hamers FP, Steinbusch HW, Joosten EA. The assessment of locomotor function in spinal cord injured rats: the importance of objective analysis of coordination. J Neurotrauma. 2005;22(2):214-25.and a combined method of evaluation was also suggested to reduce interpretation errors.

One of the difficulties referred to in experimental studies and in the use of the BBB scale is the lack of establishment of a standardized evaluation system to assess the degree of spinal cord injury, the determination of the most appropriate animal species,1313 Rodrigues NR. Padronização da lesão na medula espinhal em ratos Wistar [tese]. São Paulo: Faculdade de Medicina Universidade de São Paulo; 1999. and the comparison of inter-evaluator results that present discrepancies.1Scheff SW, Saucier DA, Cain ME. A statistical method for analyzing rating scale data: the BBB locomotor score. J Neurotrauma. 2002;19(10):1251-60. , 1414 Ferguson AR, Hook MA, Garcia G, Bresnahan JC, Beattie MS, Grau JW. A simple post hoc transformation that improves the metric properties of the BBB scale for rats with moderate to severe spinal cord injury. J Neurotrauma. 2004;21(11):1601-13. In this paper we propose a training facilitator approach, through an automated routine for interpretation of the Basso, Beattie and Bresnahan scale, through a computer program. The objective was to develop a computerized interpretative system that allows the BBB scale to be applied to rats with experimental spinal cord injury, aiming to reduce the discrepancies of scores given among researchers and to allow less experienced researchers, through the use of the scale, to achieve a performance similar to that of researchers with more experience in the application of this scale.

METHOD

This is an experimental prospective trial with Wistar rats. The trial was approved by the Ethics Research Committee of the University as it is in compliance with international ethical principles in animal research.

To test a computer program especially developed for this survey as an auxiliary tool in the issuance of scores from the BBB scale, 12 Wistar rats were submitted to a previous spinal cord injury, using Impactor methodology of the New York University - Impactor as standard in the production of spinal cord injuries.1313 Rodrigues NR. Padronização da lesão na medula espinhal em ratos Wistar [tese]. São Paulo: Faculdade de Medicina Universidade de São Paulo; 1999. Three types of spinal cord injury were produced in the rats, using different heights for weight falling: of mild intensity (rats marked green, weight falling from a 12.5 mm), moderate (rats marked blue, height of 25 mm) and intense (rats marked black, 50 mm). The mild injury was achieved with the impact of a rod on the spinal cord, falling from a 12.5 mm height. In the moderate injury, the height was 25 mm and, in the severe injury, it was 50 mm.

On the 28th post-injury day, all the rats were filmed in free movement. The images of the rats in movement were edited to form four-minute blocks. The video recording was performed using three digital cameras simultaneously, positioned at three different points, at a distance of 50 cm from the animals to avoid losing any details of their movements.

Eight researchers from the laboratory of the School of Medicine Universidade de São Paulo (FMUSP) took part in this survey, and analyzed the images of the 12 Wistar rats. The two heads of the laboratory (AFC and GBS), with 15 years of experience in the application of the scale, initially evaluated the images of the 12 rats and, in mutual agreement, assigned a single score to each animal, based on the side of greater motor deficit or the side with the lowest score. The results of the two more experienced evaluators, with papers published on the subject of spinal cord injury,1515 Cristante AF, Damasceno ML, Marcon RM, Oliveira RP, Barros Filho TEP. Viabilidade de células do sistema nervoso central fetal no tratamento da lesão medular em ratos. Acta Ortop Bras. 2010;18(5):284-90. , 1616 Santos GB, Cristante AF, Marcon RM, Souza FI, Barros Filho TEP, Damasceno ML. Modelo experimental de lesão medular e protocolo de avaliação motora em ratos wistar. Acta Ortop Bras. 2011;19(2):87-91. were considered the gold standard in the evaluation and used as a reference.

The gold standard evaluators assigned values from 0 to 21 according to the BBB scale (Table 1) to each rat, where zero corresponded to total absence of movements and 21, normal movements. The result of this evaluation is shown in Table 2. Afterwards, the six participating researchers received the same filmed images of the rats with the task of applying the BBB scale at three different times, with an interval of 15 days between them. Thus, each researcher evaluated the same rats at three different times.

Table 1.
21-point functional evaluation scale of Basso et al.10

Table 2.
Evaluations carried out by the researchers considered gold standard of reference for the others, according to the side.

These six evaluators carried out three analyses: a free application of the scale; a targeted application of the scale; and an automated application of the scale. The "free" evaluation" (FA) was based on the free classification of the motricity detected in the rat graded from 0 to 21, according to the intensity of the injury presented. The "targeted" evaluation" (TA) was based on 14 questions (especially formulated for this survey) about the normality of the selected segments, i.e., for every analysis segment, the evaluator is first asked to analyze the image, then to reply about the normality or non-normality of each segment, in sequential form. In the "automated" evaluation (AE), they used a computer program with the same questions as the TA. When these questions were answered, the computer program automatically issued a score from 0 to 21. (Table 3)

Table 3.
Computer program containing 14 questions

The order in the mode of application of the scale and the order of the rats in the filming analyses were altered to avoid memorization by the researchers. Thus, while the first researcher could evaluated the rats in the order of 1, 5 and 8 with AE, after 15 days he or she could evaluate rats 8, 1 and 5 in the TA and after 15 days could evaluate rats 8, 5 and 1 in the FA, while the other researchers could simultaneously evaluate other rats in another order of evaluation, for example.

The participants adopted as an analysis standard the lowest value between the sides or the highest motor deficit value according to the international guidelines of the Ohio State University1717 Jakeman LB, McTigue DM, Walters P, Stoke BT. The Ohio State University ESCID Spinal Cord Contusion Model. In: Chen J, Xu ZC, Xu XM, Zhang Jh. Animal models of acute neurological injuries. New York: Human Press; 2005. p. 433-47. and in compliance with the rules of MASCIS;1717 Jakeman LB, McTigue DM, Walters P, Stoke BT. The Ohio State University ESCID Spinal Cord Contusion Model. In: Chen J, Xu ZC, Xu XM, Zhang Jh. Animal models of acute neurological injuries. New York: Human Press; 2005. p. 433-47. accordingly, rat number 13 presented a difference of more than three points between the sides, hence this rat was disregarded in the analysis.

Statistical analysis

The repeated measures analysis of variance with transformation by posts was used to compare evaluators and methods, and the Student's t-test for paired tests to compare methods, while the paired Wilcoxon test was used when the test assumptions were not satisfied. A significance level of 5% (p ≤ 0.05) was used and the checking of normality of the distributions was executed using the Kolmogorov-Smirnov and Shapiro-Wilk tests, while the statistical program adopted was the Statistical Package for Social Sciences (SPSS) version 15.0.

Box-plot graphs containing descriptive information were used to present non-parametric data.

RESULTS

According to Table 4, there is no significant difference between the automated method and the gold standard for each evaluator, from 1 to 6, since in all the comparisons, p > 0.07.

Table 4.
Comparison of the scores obtained with the automated, targeted and free method with the gold standard values.

Considering the lower value between right and left sides, a significant difference was observed between the targeted method and the gold standard only for evaluator 6 (evaluator 6; p = 0.0145) as shown below in Table 4.

Significant difference was observed between the free method and the gold standard for evaluators 4 and 6 (evaluator 4; p = 0.0368; evaluator 6, p = 0.0115; Table 4).

The boxplot from Figure 1 shows that there was discrepancy of scores applied by evaluator 4 in relation to the gold standard when the latter applied the score freely; and discrepancy of scores applied by evaluator 6 in relation to the gold standard when the latter does so in free and targeted mode (FE, evaluator 4, p = 0.0368; evaluator 6, p = 0.0115; TE, evaluator 6, p = 0.0145).

Figure 1.
Boxplot showing the comparison os scores obtained by the evaluators 4 and 6 and the gold standard values.

According to the results of Table 5, there is no significant difference between the automated, targeted and free methods when compared with the gold standard for the mean of evaluators 1 to 6 (for AE, p = 0.5147, for TE, p = 0.0856 and for FE, p = 0.2132).

Table 5.
Comparison between the methods: mean of the evaluators.

The results of Table 4 show that, in the comparisons between free method and gold standard and targeted method and gold standard, the scores of evaluators 4 and 6 did not appear similar to the gold standard. The only method that obtained results similar to the gold standard for all the evaluators, from 1 to 6, was the automated analysis.

DISCUSSION

The development of surveys with reproducibility, accuracy and low cost leads to the acceptance and diffusion of various experimental models,1Scheff SW, Saucier DA, Cain ME. A statistical method for analyzing rating scale data: the BBB locomotor score. J Neurotrauma. 2002;19(10):1251-60. , 1414 Ferguson AR, Hook MA, Garcia G, Bresnahan JC, Beattie MS, Grau JW. A simple post hoc transformation that improves the metric properties of the BBB scale for rats with moderate to severe spinal cord injury. J Neurotrauma. 2004;21(11):1601-13. , 1818 Metz GA, Merkler D, Dietz V, Schwab ME, Fouad K. Efficient testing of motor function in spinal cord injured rats. Brain Res. 2000;883(2):165-77. yet some models that are used present problems in the production of spinal cord injuries3Tarlov IM. Spinal cord compression studies: III. Time limits for recovery after gradual compression in dogs. AMA Arch NeurPsych. 1954;71(5):588-97. for being low cost, controlled and standardized at all the injury levels.1919 Molina AEIS. Análise da sensibilidade e reprodutibilidade da escala de Basso, Beattie e Bresnahan (BBB) em ratos Wistar [dissertação]. São Paulo: Faculdade de Medicina Universidade de São Paulo; 2006. In 1995, Basso et al. 1010 Basso DM, Beattie MS, Bresnahan JC. A sensitive and reliable locomotor rating scale for open field testing in rats. J Neurotrauma. 1995;12(1):1-21. presented the scientific community with a scale for the evaluation of functional recovery of locomotor capacity in rats after spinal cord contusion, and they affirmed that the scale is a predictive measure based on specific observation criteria of the animal's movement, which assigned sequential and cumulative scores, corresponding to points from 0 to 21, called the BBB scale. This scale is currently the method of evaluation of functional recovery most commonly used in experimental research due to its simplicity, ease of application and practicality, having been adopted by MASCIS.1717 Jakeman LB, McTigue DM, Walters P, Stoke BT. The Ohio State University ESCID Spinal Cord Contusion Model. In: Chen J, Xu ZC, Xu XM, Zhang Jh. Animal models of acute neurological injuries. New York: Human Press; 2005. p. 433-47. Although widely used, it presents important discontinuities in its scaling: the levels of recovery from 0 to 6 are not of the same intensity as the levels of recovery from 7 to 14 and present different characteristics in their scores. Moreover, there is controversy regarding the best statistical methodology to be used.1Scheff SW, Saucier DA, Cain ME. A statistical method for analyzing rating scale data: the BBB locomotor score. J Neurotrauma. 2002;19(10):1251-60. The scores obtained in the upper or lower range of the scale present different characteristics, i.e., the improvement of two points in the low part of the scale is different from the improvement of two points in the high part, which hinders accurate comparisons of surveys between laboratories.1Scheff SW, Saucier DA, Cain ME. A statistical method for analyzing rating scale data: the BBB locomotor score. J Neurotrauma. 2002;19(10):1251-60. , 1414 Ferguson AR, Hook MA, Garcia G, Bresnahan JC, Beattie MS, Grau JW. A simple post hoc transformation that improves the metric properties of the BBB scale for rats with moderate to severe spinal cord injury. J Neurotrauma. 2004;21(11):1601-13. , 1818 Metz GA, Merkler D, Dietz V, Schwab ME, Fouad K. Efficient testing of motor function in spinal cord injured rats. Brain Res. 2000;883(2):165-77. As it presents such discontinuities, in the distribution of scores, its interpretation is difficult. For it to be used in a standardized manner, we observe the need for specific training, with specialized professionals and a detailed statistical study.

As there is no "gold standard" of direct or indirect evaluation to determine the efficacy of the scale, different complementary or combined methods are used with the BBB to improve its sensitivity and reproducibility. In this study, the two heads of the laboratory of FMUSP, with 15 years of experience in the application of the scale and who published sereval papers in this line of research, were considered the gold standard in the evaluation.1515 Cristante AF, Damasceno ML, Marcon RM, Oliveira RP, Barros Filho TEP. Viabilidade de células do sistema nervoso central fetal no tratamento da lesão medular em ratos. Acta Ortop Bras. 2010;18(5):284-90. , 1616 Santos GB, Cristante AF, Marcon RM, Souza FI, Barros Filho TEP, Damasceno ML. Modelo experimental de lesão medular e protocolo de avaliação motora em ratos wistar. Acta Ortop Bras. 2011;19(2):87-91. The BBB scale involves difficulty in the assignment of scores.1414 Ferguson AR, Hook MA, Garcia G, Bresnahan JC, Beattie MS, Grau JW. A simple post hoc transformation that improves the metric properties of the BBB scale for rats with moderate to severe spinal cord injury. J Neurotrauma. 2004;21(11):1601-13. A computer program was developed to help reduce the discrepancy of scores assigned to the same rat by different observers, in an attempt to bring the evaluation of a researcher with limited experience in the scale closer to that of researchers experienced in its application. The results of this study show that, in the comparisons between the "free" method and the reference of the gold standard measures and the "targeted" method and the gold standard, evaluators 4 and 6 did not appear similar to the gold standard. The only method that obtained results similar to the gold standard for all the evaluators was the automated computer-assisted analysis.

The elimination of discrepancies in relation to the gold standard, when the computer program was used, paves the way for its use as an auxiliary tool in the issuance of scores, especially for researchers who are either beginners or being trained, but does not eliminate the need for prior knowledge of the items analyzed in the BBB scale to enable the researcher to carry out a detailed analysis of the animal's movement.

CONCLUSIONS

The application of the BBB scale in the automated mode, using the computer program, did not present any difference in relation to the gold standard for all the evaluators.

ACKNOWLEDGEMENTS

The authors wish to thank Dr. Gustavo Bispo Santos for the first evaluation of the animals according to the BBB scale, used as a standard reference in data collection in this study.

REFERENCES

  • 1
    Scheff SW, Saucier DA, Cain ME. A statistical method for analyzing rating scale data: the BBB locomotor score. J Neurotrauma. 2002;19(10):1251-60.
  • 2
    Barros Filho TEP, Basile RJ coordenadores, Coluna vertebral diagnóstico e tratamento das principais patologias. São Paulo: Sarvier; 1995.
  • 3
    Tarlov IM. Spinal cord compression studies: III. Time limits for recovery after gradual compression in dogs. AMA Arch NeurPsych. 1954;71(5):588-97.
  • 4
    Fairholm DJ, Turnbull IM. Microangiographic study of experimental spinal cord injuries. J Neurosurg. 1971;35(3):277-86
  • 5
    Yeo JD, Payne W, Hinwood B, Kidman AD. The experimental contusion injury of the spinal cord in sheep. Paraplegia. 1975;12(4):279-98.
  • 6
    Constantini S, Young W. The effects of methylprednisolone and the ganglioside GM1 on acute spinal cord injury in rats. J Neurosurg. 1994;80(1):97-111
  • 7
    Panjabi MM, Wrathall JR. Biomechanical analysis of experimental spinal cord injury and functional loss. Spine (Phila Pa 1976). 1988;13(12):1365-70.
  • 8
    Kuhn PL, Wrathall JR. A mouse model of graded contusive spinal cord injury. J Neurotrauma. 1998;15(2):125-40
  • 9
    Vialle LRG, Fischer S, Marcon JC, Vialle E, Luzzi R, Bleggi-Torres LF. Estudo histológico da lesão medular experimental em ratos. Rev Bras Ortop. 1999;34(2):85-9.
  • 10
    Basso DM, Beattie MS, Bresnahan JC. A sensitive and reliable locomotor rating scale for open field testing in rats. J Neurotrauma. 1995;12(1):1-21.
  • 11
    Basso DM, Beattie MS, Bresnahan JC. Graded histological and locomotor outcomes after spinal cord contusion using the NYU weight-drop device versus transection. Exp Neurol. 1996;139(2):244-56.
  • 12
    Koopmans GC, Deumens R, Honig WM, Hamers FP, Steinbusch HW, Joosten EA. The assessment of locomotor function in spinal cord injured rats: the importance of objective analysis of coordination. J Neurotrauma. 2005;22(2):214-25.
  • 13
    Rodrigues NR. Padronização da lesão na medula espinhal em ratos Wistar [tese]. São Paulo: Faculdade de Medicina Universidade de São Paulo; 1999.
  • 14
    Ferguson AR, Hook MA, Garcia G, Bresnahan JC, Beattie MS, Grau JW. A simple post hoc transformation that improves the metric properties of the BBB scale for rats with moderate to severe spinal cord injury. J Neurotrauma. 2004;21(11):1601-13.
  • 15
    Cristante AF, Damasceno ML, Marcon RM, Oliveira RP, Barros Filho TEP. Viabilidade de células do sistema nervoso central fetal no tratamento da lesão medular em ratos. Acta Ortop Bras. 2010;18(5):284-90.
  • 16
    Santos GB, Cristante AF, Marcon RM, Souza FI, Barros Filho TEP, Damasceno ML. Modelo experimental de lesão medular e protocolo de avaliação motora em ratos wistar. Acta Ortop Bras. 2011;19(2):87-91.
  • 17
    Jakeman LB, McTigue DM, Walters P, Stoke BT. The Ohio State University ESCID Spinal Cord Contusion Model. In: Chen J, Xu ZC, Xu XM, Zhang Jh. Animal models of acute neurological injuries. New York: Human Press; 2005. p. 433-47.
  • 18
    Metz GA, Merkler D, Dietz V, Schwab ME, Fouad K. Efficient testing of motor function in spinal cord injured rats. Brain Res. 2000;883(2):165-77.
  • 19
    Molina AEIS. Análise da sensibilidade e reprodutibilidade da escala de Basso, Beattie e Bresnahan (BBB) em ratos Wistar [dissertação]. São Paulo: Faculdade de Medicina Universidade de São Paulo; 2006.
  • Work developed at the Universidade de São Paulo, Faculdade de Medicina, Departamento de Ortopedia e Traumatologia, Laboratório de Investigação Médica, São Paulo,SP, Brasil.

Publication Dates

  • Publication in this collection
    Jul-Aug 2015

History

  • Received
    24 July 2013
  • Accepted
    16 June 2014
ATHA EDITORA Rua: Machado Bittencourt, 190, 4º andar - Vila Mariana - São Paulo Capital - CEP 04044-000, Telefone: 55-11-5087-9502 - São Paulo - SP - Brazil
E-mail: actaortopedicabrasileira@uol.com.br