Assessment of the reproducibility of the Outerbridge and SFA classifications for chondral lesions of the knee

Abstracts

OBJETIVO: Avaliar a reprodutibilidade da classificação de Outerbridge e da Sociedade Francesa de Artroscopia entre diferentes observadores e estabelecer uma comparação entre elas. MÉTODO: Foram utilizados 30 vídeos de artroscopia de joelho selecionados aleatoriamente demonstrando lesões condrais que foram classificadas por seis observadores, dois residentes em ortopedia do terceiro ano e quatro ortopedistas, entre os quais dois especialistas em cirurgia de joelho. A avaliação da reprodutibilidade intra e interobservador foi feita através do índice estatístico de Kappa. RESULTADOS: Como resultado da avaliação completa da classificação de Outerbridge com a totalidade dos observadores, encontramos um índice Kappa de 0,434411. Quanto à classificação proposta pela Sociedade Francesa de Artroscopia, encontramos um índice Kappa de 0,45166. CONCLUSÃO: A classificação de Outerbridge e da Sociedade Francesa de Artroscopia para lesões condrais é moderadamente reprodutível entre observadores. Comparando as duas classificações, a proposta pela Sociedade Francesa de Artroscopia se mostrou mais reprodutível, e os autores sugerem o uso dessa classificação como de escolha para a prática clínica da avaliação das lesões condrais do joelho.

Traumatismos do Joelho; Traumatismos do Joelho; Artroscopia; Knee Injuries; Knee Injuries; Arthroscopy

ORIGINAL ARTICLE

^IHead of the Orthopedics and Traumatology Service, São José University Hospital, Minas Gerais School of Medical Sciences, Belo Horizonte (HUSJ-FCMMG-BH) and Titular Professor and Chair of Orthopedics and Traumatology, Minas Gerais School of Medical Sciences; Former President of SBOT

^IIMember of the Knee Surgery Service, São José University Hospital, Minas Gerais School of Medical Sciences, Belo Horizonte (HUSJ-FCMMG-BH) and Adjunct Professor of Orthopedics and Traumatology, Minas Gerais School of Medical Science

^IIIMember of the Knee Surgery Service, São José University Hospital, Minas Gerais School of Medical Sciences, Belo Horizonte (HUSJ-FCMMG-BH) and Head of the Medical Department of Clube Atlético Mineiro; Physician of the Brazilian National Soccer Team

^IVOrthopedist (R4) in the Knee Surgery Service, São José University Hospital, Minas Gerais School of Medical Sciences, Belo Horizonte (HUSJ-FCMMG-BH)

Correspondence

ABSTRACT

OBJECTIVE: To assess the reproducibility of the Outerbridge and the French Society of Arthroscopy classifications between different observers, and to establish a comparison between them.

METHOD: Thirty videos on randomly selected knee arthroscopy procedures demonstrating chondral lesions were used. These were classified by six observers: two third-year orthopedics residents and four orthopedic surgeons, of whom two were knee surgery specialists. The intraobserver and interobserver reliability was evaluated by means of the kappa index.

RESULTS: The result from the complete evaluation on the Outerbridge classification with all the observers gave a kappa index of 0.434411. For the classification proposed by the French Society of Arthroscopy, the kappa index was 0.45166.

CONCLUSION: The Outerbridge and French Society of Arthroscopy classifications for chondral lesions are moderately reproducible between observers. Comparing the two classifications, the proposal from the French Society of Arthroscopy was shown to be more reproducible, and the authors suggest that this classification should be used preferentially in clinical practice for evaluations on chondral lesions of the knee.

Keywords: Knee Injuries/classification; Knee Injuries/pathology; Arthroscopy

INTRODUCTION

A combination of mechanical factors and loss of the structural proteins that make up the cartilage is responsible for osteoarthrosis⁽¹⁾, which is a highly prevalent pathological condition of degenerative nature that is especially seen in the knee joint.

The joint cartilage is a type of tissue with the capacity to deal with large forces applied over many cycles, but it has a low capacity for regeneration after injury⁽¹⁾.

Traditionally, osteoarthrosis of the knee is diagnosed through clinical signs resulting from the inflammatory and/or mechanical process, accompanied by specific radiological abnormalities such as diminished joint space, subchondral sclerosis and osteophytes. However, there may be very little evidence of such abnormalities, particularly during the initial stages of the degenerative process, thus leading to delays in diagnosing this condition.

Studies have revealed the presence of advanced femorotibial and/or femoropatellar arthrosis through arthroscopy of the knee, in cases with normal radiological findings⁽²⁾.

There are some radiographic classifications for osteoarthrosis of the knee, but they have been shown to be imprecise, especially in the initial stages.

Arthroscopic evaluation of the knee presents the characteristic of direct viewing of the joint surface, thus enabling greater detailing of the chondropathy, such as size, depth, consistency and lesion location⁽³⁾.

Some arthroscopic classification systems for chondral lesions of the knee have been described in the literature. Among these is the Outerbridge system, which was originally described through direct viewing using arthrotomy, and the classification of the French Society of Arthroscopy⁽⁴⁾.

In 1961, Outerbridge classified patellar chondral lesions into four grades, such that grade I was softening; grade II was fragmentation/fissure of 1.25 cm or less; grade III was fragmentation/fissure greater than 1.25 cm; and grade IV was bone erosion⁽⁵⁾.

In 1994, the French Society of Arthroscopy proposed the classification: grade I, softening; grade II, superficial fissure; grade III, deep fissure; and grade IV, bone exposure⁽⁶⁾.

Reproducibility between observers is essential for any type of classification⁽⁶⁾, and arthroscopy should be considered to be an important measurement method for assessing osteoarthrosis of the knee⁽⁷⁾.

The purpose of this study was to assess the reproducibility of the Outerbridge and French Society of Arthroscopy classifications between observers.

MATERIALS AND METHODS

Between the months of October 2008 and May 2009, at the Orthopedics and Traumatology Service of São José University Hospital, 30 arthroscopy procedures on knees were performed in order to treat ligament or meniscal lesions, with inventories of the medial, lateral and femoropatellar compartments. All the procedures were recorded on DVD and edited to form 30 clips of five seconds each, totaling 30 images. These images were assessed and classified by six observers, of whom two were titular members of the Brazilian Society of Knee Surgery, two were titular members of the Brazilian Society of Orthopedics and Traumatology and two were third-year medical residents, using the Outerbridge and French Society of Arthroscopy classifications for chondral lesions of the knee.

These assessments were performed on a special form that was filled out by one of the researchers. In order to minimize any bias due to difficulty in interpretation or any possible forgetfulness, the classifications were described on the response sheets, together with schematic drawings of the respective classifications, which were handed over to each observer at the time of the image assessments. There was no time limit on making the image classifications.

The data obtained were analyzed by a statistician, using the chi-square test and kappa coefficient, which were first used by Fleiss and Cohen⁽⁸⁾. The kappa coefficient was used to assess the concordance between the observers within the same sample unit. This ranged from -1, when all the observers disagreed regarding all the assessments to +1, when there was complete agreement.

RESULTS

The series of images were analyzed using the Outerbridge classification (four types) and the French Society of Arthroscopy classification (four types).

The result from the complete evaluation of the Outerbridge classification with all of the observers was an inter-observer kappa index (k) of 0.434411, which produced a p-value = 0. Analysis on the two residents alone gave k = 0.395973. Analysis on the orthopedists alone gave k = 0.165379. Analysis on the knee specialists alone gave k = 0.140127 (Table 1).

The highest value for the intra-observer concordance index was for orthopedist 1, with k = 0.509002, and the lowest was for resident 2, with k = -0.064516, as presented in Table 2. The mean intra-observer concordance was k = 0.2955 (Table 2).

In relation to the classification proposed by the French Society of Arthroscopy, we found the following data. The inter-observer kappa was k = 0.45166, thus resulting in p = 0, among all the six observers. Among the different groups, the index was greatest for the orthopedists, with k = 0.339623, followed by the knee surgeons, with k = 0.338983. For the residents, the concordance coefficient was k = 0.22619. These results are presented in Table 3.

The highest value for the intra-observer concordance index was for orthopedist 1 (k = 0.540034), and the lowest value was for resident 2 (k = 0.033742), as shown in Table 4. The mean kappa index for the intra-observer evaluation was k = 0.3165.

DISCUSSION

Several authors have expressed the opinion that in assessing the reliability of inter-observer concordance, there is a need to incorporate concordance due to chance in the evaluation^(9-10). Kappa is a coefficient of concordance that corrects for the error due to chance and is used to determine the intra and inter- observer variation. It is used when two observers separately classify a sample of objects using the same category scale.

Landis classified concordance as: poor (less than 0), slight (0-0.2), weak (0.21-0.4), moderate (0.41-0.6), substantial (0.61-0.8), almost perfect (0.81-1.0).

We found some articles that assessed the reproducibility of the Outerbridge and French Society of Arthroscopy classification. Cameron et al⁽¹¹⁾ concluded that the Outerbridge classification is moderately accurate when used to grade chondral lesions arthroscopically.

In the present study on the Outerbridge and French Society of Arthroscopy classifications, we found kappa values of 0.434411 and 0.45166 respectively. According to Landis, this indicates that the classifications have moderate concordance.

In comparing the means within the groups, we could see that in the groups using the French Society of Arthroscopy classification, the means were higher than in the other groups.

CONCLUSION

On the basis of the present assessment, it can be concluded that the French Society of Arthroscopy and Outerbridge classifications have moderate concordance between observers.

Comparing the two classifications, the proposal from the French Society of Arthroscopy was shown to be more reproducible, and the present authors suggest that this classification should be used preferentially for assessing chondral lesions of the knee in clinical practice.

REFERENCES

• 1. Fife RS, Brandt KD, Braunstein EM, Katz BP, Shelbourne KD, Kalasinski LA, et al Relationship between arthroscopic evidence of cartilage damage and radiographic evidence of joint space narrowing in early osteoarthritis of the knee. Arthritis Rheum. 1991;34(4):377-82.
• 2. Brismar BH, Wredmark T, Movin T, Leandersson J, Svensson O. Observer reliability in the arthroscopic classification of osteoarthritis of the knee. J Bone Joint Surg BR. 2002;84(1):42-7.
• 3. Brandt KD, Fife RS, Braunstein EM, Katz B. Radiographic grading of the severity of knee osteoarthritis: relation of the Kellgren and Lawrence grade to a grade based on joint space narrowing, and correlation with arthroscopic evidence of articular cartilage degeneration. Arthritis Rheum. 1991;34(11):1381-6.
• 4. Collins DH. The pathology of articular and spinal diseases. London: Edward Arnold; 1949.
• 5. Outerbridge RE. The aetiology of chondromalacia patellae. J Bone Joint Surg BR. 1961;43:752-7.
• 6. Flikkilä T, Nikkola-Sihto A, Kaarela O, Pääkkö E, Raatikainen T. Poor interobserver reliability of AO classification of fractures of the distal radius. J Bone Joint Surg Br. 1998;80(4):670-2.
• 7. Dougados M, Ayral X, Listrat V, Gueguen A, Bahuaud J, Beaufils P, et al The SFA system for assessing articular cartilage lesions at arthroscopy of the knee. Arthroscopy. 1994;10(1):69-77.
• 8. Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973;33(3):613-9.
• 9. Felson DT, Naimark A, Anderson J, Kazis L, Castelli W, Meenan RF. The prevalence of knee osteoarthritis in the elderly. The Framingham Osteoarthritis Study. Arthritis Rheum. 1987;30(8):914-8.
• 10. Dillon CF, Rasch EK, Gu Q, Hirsch R. Prevalence of knee osteoarthritis in the United States: arthritis data from the Third National Health and Nutrition Examination Survey 1991-94. J Rheumatol. 2006;33(11):2110-2.
• 11. Cameron ML, Briggs KK, Steadman JR. Reproducibility and Reliability of the Outerbridge Classification for Grading Chondral Lesions of the Knee Arthroscopically. Am J Sports Med. 2003;31(1): 83-6.

Assessment of the reproducibility of the Outerbridge and FSA classifications for chondral lesions of the knee

Neylor Pace Lasmar^I; Rodrigo Campos Pace Lasmar^II; Rodrigo Barreiros Vieira^III; Juraci Rosa de Oliveira^III; André Campos Scarpa^IV

Publication Dates

• Publication in this collection
  08 Sept 2011
• Date of issue
  2011

History

• Received
  26 Apr 2010
• Accepted
  01 July 2010