Abstracts
OBJECTIVE:
To validate a new method of measuring the Cobb angle for scoliosis from the mobile app CobbMeter to facilitate the evaluation and measurement in clinical practice.
METHODS:
Five observers with minimum experience of two years in the field performed radiographic measurements of Cobb angle in 24 radiographs of patients with adolescent idiopathic scoliosis through the CobbMeter. Observers performed serial measures on the images with the application, which were repeated after one month. The most experienced appraiser of the group, after measurements were made through the application, determined the Cobb angle in each radiography by the traditional method.
RESULTS:
The mean standard deviation by comparing the angles electronically and manually measured had no clinical significance. Although 40% of electronic measurements are outside the confidence interval when compared to manual measurements, this difference was insignificant in clinical practice.
CONCLUSIONS:
The CobbMeter is another alternative for measuring Cobb angle in scoliosis.
Scoliosis/diagnosis; Spine/abnormalities; Software validation; Mobile applications
OBJETIVO:
Validar um novo método de medida do ângulo de Cobb para escoliose a partir do aplicativo para aparelho telefônico celular CobbMeter para facilitar a avaliação e medição na prática clínica.
MÉTODOS:
Cinco observadores com experiência mínima de dois anos na área realizaram medições radiográficas do ângulo em 24 radiografias de pacientes com escoliose idiopática do adolescente com o CobbMeter. Os observadores realizaram medidas em série nas imagens com o aplicativo, as quais foram repetidas após um mês. O avaliador mais experiente do grupo, após as medições feitas com o aplicativo, determinou em cada radiografia o ângulo pelo modo tradicional.
RESULTADOS:
A média do desvio padrão na comparação dos ângulos medidos eletrônica e manualmente não foi clinicamente significativa. Apesar de 40% das medições eletrônicas estarem fora do intervalo de confiança ao serem comparadas às medições manuais, essa diferença se mostrou insignificante na prática clínica.
CONCLUSÕES:
O CobbMeter é mais uma alternativa para a medição do ângulo de Cobb na escoliose.
Escoliose/diagnóstico; Coluna vertebral/anormalidades; Validação de programas de computador; Aplicativos móveis
OBJETIVO:
Validar un nuevo método de medición del ángulo de Cobb para la escoliosis a partir de la aplicación móvil CobbMeter, para facilitar la evaluación y la medición en la práctica clínica.
MÉTODOS:
Cinco observadores con experiencia mínima de dos años en el área llevaron a cabo mediciones radiográficas del ángulo en 24 radiografías de pacientes con escoliosis idiopática juvenil mediante la aplicación móvil CobbMeter. Los observadores realizaron mediciones seriadas en las imágenes con la aplicación, que se repitieron después de un mes. El observador más experimentado del grupo, después de las mediciones realizadas con la aplicación, determinó en cada radiografía el ángulo de Cobb de la manera tradicional.
RESULTADOS:
La desviación estándar de la media en la comparación de los ángulos medidos por el método electrónico y manual no fue clínicamente significativa. Aunque el 40% de las mediciones electrónicas están fuera del intervalo de confianza en comparación con las mediciones manuales, esta diferencia fue insignificante en la práctica clínica.
CONCLUSIONES:
La aplicación CobbMeter es otra alternativa para medir el ángulo de Cobb en la escoliosis.
Escoliosis/diagnóstico; Columna vertebral/anomalías; Validación de programas de computación; Aplicaciones móviles
INTRODUCTION
Adolescent idiopathic scoliosis (AIS)11 Hebert SK, Barros Filho EP, Xavier R, Pardini Junior AG. Ortopedia e traumatologia: princípios e práticas. 4a ed. Porto Alegre: Artmed; 2009. can be defined as lateral deviation of the spine in the frontal plane. In practice, however, it is observed that the deviation is three-dimensional. The patient presents unevenness of the shoulders, and asymmetry of the triangle-cut and rib deformity. AIS mainly affects female adolescents aged between 10 and 18 years, and its etiology is idiopathic. Radiographic evaluations of patients with scoliosis are based on the measurement of the Cobb angle,22 Cobb JR. Outline for the study of scoliosis. Instr Course Lect. 1948;5:261-75. which enables analysis of disease progression, and determination of prognosis and treatment.
This calculation is performed by delimiting, on full spine radiographs in the anterior posterior view, the most cranial and more caudal vertebrae in a determined curve. A parallel line is then drawn to the superior plateau of the most cranial vertebral, and another parallel line to the inferior plateau of the most caudal vertebra of the curve. The point where these two lines intersect is the Cobb angle. Traditionally, this measurement is done with a pencil and goniometer.
Adopted as standard by the Scoliosis Research Society since 1966, this is the most widely used method in medical practice, as it is simple and quick to perform, and enables analysis of the degree of the progression and severity of the disease. Kotwick33 Kotwicki T. Evaluation of scoliosis today: examination, X-rays and beyond. Disabil Rehabil. 2008;30(10):742-51. evaluates that radiographic measurement by the Cobb angle is still the most effective method for patients with scoliosis. Vrtovec et al. 44 Vrtovec T, Pernus F, Likar B. A review of methods for quantitative evaluation of spinal curvature. Eur Spine J. 2009;18(5):593-607. evaluated the curvature in more than one hundred 2D and 3D computerized radiographs, and concluded that many computerized methods were too complex, and were inappropriate for routine clinical evaluation due to their high cost, the difficulty of universal access to the technology, and their immobility, making their use difficult outside hospitals and medical centers.
With the emergence of smartphones,55 Shaw M, Adam CJ, Izatt MT, Licina P, Askin GN. Use of the iPhone for Cobb angle measurement in scoliosis. Eur Spine J. 2012;21(6):1062-8. software programs for cell phones, known as applications, or Apps, have contributed to various fields, assisting health professionals in calculations, measurement of angles, and doses of medications, among other functions. The CobbMeter is an app designed for professionals who have Iphones, and is a program that is sold freely, without the need for prior authorization by the manufacturer. The CobbMeter app was designed to facilitate measurement of the Cobb angle in patients with scoliosis, in order to optimize the clinical practice.
The objective of this work is to validate the Cobb angle calculation method using the CobbMeter Iphone app.
METHODS
Twenty-four preoperative panoramic teleradiographs in AP (anterior-posterior view) of patients diagnosed with AIS undergoing treatment in the spinal outpatient department of a university hospital were selected. The criteria for inclusion in the trial included orthopedic doctors and orthopedic residents with a minimum of two years and a maximum of ten years of experience. In regard to the radiographs, anterior-posterior panoramic teleradiographs or radiographs of the spine of patients diagnosed with AIS, authorized by the patients through a Voluntary and Informed Consent Form, were included in the evaluation. The work was accepted by the Ethics Committee of our Institution, under number 735.967.
Prior to the data collection, all the radiographs were analyzed by the group, which determined the levels of the curves to be measured. In the case of a patient with a double curve, it was preestablished that the curve with the greatest angle would be measured.
Five medical observers, including three orthopedic doctors who were members of the Sociedade Brasileira de Ortopedia e Traumatologia [Brazilian Society of Orthopedics and Traumatology] (SBOT), specialists in Spinal Surgery of the Sociedade Brasileira de Coluna [Brazilian Spine Society] with up to ten years of training, an orthopedic doctor of the SBOT with specialization in Spine Surgery (R4), and a resident doctor in Orthopedics and Traumatology with at least two years of experience, performed two data collections using the CobbMeter app.
The CobbMeter is able to calculate the Cobb angle on the radiographs using the angle sensor available on the IPhone (microelectromechanical system accelerometer - MEMS). First, the upper part of the app is aligned with the vertebral plateau of the most cranial vertebra of the curve to measured, and the position is validated by clicking on the screen. Next, the lower part of the app is aligned with the lower plateau of the most caudal vertebra of the curve to be measured, and validated again. The Cobb angle is then measured by the sensor on the app, and is shown on the IPhone screen. (Figure 1)
A single IPhone cell phone (model 4S) with the CobbMeter application installed, supplied by the person responsible for the research, was used by all the observers, who were taught in advance how to use the app to correctly measure the angles.
The radiographs were analyzed independently, without any collaboration between the evaluators, all using the app under identical conditions. There was no time limit to take the measurements.
After one month, the same observers evaluated the same radiographs using the app, without any knowledge of the responses signaled previously, or of the data obtained by the other evaluators.
After the measurements using the app, a single measurement of the Cobb angle was performed by the most qualified observer, using the traditional (manual) method.
This transversal study analyzed intra- and inter-observer variations through the Software SPSS 13.0, using the Kappa statistical method, which evaluates agreement between observers by paired analysis, comparing the inter-observer (Po) and intra-observer (Pe) agreement. The values can range from -1.0 (total disagreement) to +10 (total agreement).
RESULTS
In the intra-observer analyses, we did not identify any significant differences between the first and second measurements using the application, as shown in Table 1.
First and second measurements (A and B) with the application in degrees of Cobb angles performed by each observer (1 to 5).
Comparing the measurements using the app with the manual measurements, we identified significant differences at 95% confidence in three of the five evaluators. (Tables 2 and 3) These results are also shown in Table 4.
Measurements performed with the app in which 1A corresponds to observer 1 performing the first measurement (A), 1B being her second measurement, and so on (2A, 2B, 3A, 3B, 4A, 4B, 5A and 5B) and the values for the manual measurement (M).
Results of the paired tests between the two measurements with the app performed by each observer (1 A and B, 2 A and B, 3 A and B, 4 A and B, 5 A and B).
Results of the paired tests between each measurement performed with the app for each observer (1 A and B, 2 A and B, 3 A and B, 4 A and B, 5 A and B) compared with the manual measurements (M).
The standard deviation between the measurements of the angles performed manually, and the average of the measurements performed by all the observers using the app, is shown in Table 5.
Standard deviation Cobb (in degrees) between the manual measurements and the average of the measurements of all the observers with the app in each patient.
DISCUSSION
Technological advances have provided many resources that facilitate our routine practices. The growth of ultra-modern cell phones equipped with MEMS capable of performing angle calculations is just one such example. The development of apps that use this app, and their convenience for routine use, makes them an attractive option for daily clinical practice for tasks such as calculating angles in deformities of the vertebral spine.66 Langensiepen S, Semler O, Sobottke R, Fricke O, Franklin J, Schönau E, et al. Measuring procedures to determine the Cobb angle in idiopathic scoliosis: a systematic review. Eur Spine J. 2013;22(11):2360-71. , 77 Qiao J, Liu Z, Xu L, Wu T, Zheng X, Zhu Z, et al. Reliability analysis of a smartphone-aided measurement method for the Cobb angle of scoliosis. J Spinal Disord Tech. 2012;25(4):E88-92. But how reliable are these apps? In this study, we compare the performance of the CobbMeter app with the conventional calculation, in the measurement of Cobb angles in radiographs of patients with scoliosis.
Five experienced observers performed two evaluations of 24 radiographs, one month apart, using the CobbMeter, without any identification being shown in the exams that could compromise the measurement. The radiographs were then measured with a pencil and goniometer, by the most experienced evaluator of the group, who determined the Cobb angles to be interpreted as standard. These measurements were compiled and analyzed by the software SPSS 13.0, using the Kappa statistical method. The inter- and intra-observer measurements using the app were then compared with the standard manual measurements.
In this study, the differences between two intra-observer measurements using the CobbMeter app were not significant. However, when the electronic measurements were compared with the manual measurements, only the evaluations performed by two examiners showed 95% confidence in the paired test (Tables 1 to 4).
This indicates that the electronic measurement using the CobbMeter app was statistically reliable for all the evaluators. The deviations found do not, from a clinical point of view, hinder the diagnosis or the establishment of a prognosis and definition of the treatment in these cases. Even taking into account different examiners, the app is still accurate for the measurement of the Cobb angles in the radiographs.
However, when we compare the measurements of the CobbMeter with the manual measurement, 60% of them presented at least 95% confidence. It is therefore concluded that 40% of the measurements are outside the confidence interval established in the statistical analysis.
CONCLUSIONS
In practice, 2.08° of the difference, whether upwards or downwards (4.16° in absolute terms), in the measurement of a scoliosis curve is not of a level of significance that would cause errors of interpretation for the diagnosis, establishment of prognosis or definition of treatment. These deviations also found intra- and inter-observers in the routine manual calculation. Thus, the use of the CobbMeter app for calculating the Cobb angle on the radiographs adolescent idiopathic scoliosis used in this study is considered safe, and applicable for clinical practice.
REFERENCES
-
1Hebert SK, Barros Filho EP, Xavier R, Pardini Junior AG. Ortopedia e traumatologia: princípios e práticas. 4a ed. Porto Alegre: Artmed; 2009.
-
2Cobb JR. Outline for the study of scoliosis. Instr Course Lect. 1948;5:261-75.
-
3Kotwicki T. Evaluation of scoliosis today: examination, X-rays and beyond. Disabil Rehabil. 2008;30(10):742-51.
-
4Vrtovec T, Pernus F, Likar B. A review of methods for quantitative evaluation of spinal curvature. Eur Spine J. 2009;18(5):593-607.
-
5Shaw M, Adam CJ, Izatt MT, Licina P, Askin GN. Use of the iPhone for Cobb angle measurement in scoliosis. Eur Spine J. 2012;21(6):1062-8.
-
6Langensiepen S, Semler O, Sobottke R, Fricke O, Franklin J, Schönau E, et al. Measuring procedures to determine the Cobb angle in idiopathic scoliosis: a systematic review. Eur Spine J. 2013;22(11):2360-71.
-
7Qiao J, Liu Z, Xu L, Wu T, Zheng X, Zhu Z, et al. Reliability analysis of a smartphone-aided measurement method for the Cobb angle of scoliosis. J Spinal Disord Tech. 2012;25(4):E88-92.
-
Work conducted at the Orthopedics and Traumatology Service of Hospital e Maternidade Celso Pierro (PUC/Campinas), Campinas, SP, Brazil.
Publication Dates
-
Publication in this collection
June 2015
History
-
Received
27 Jan 2015 -
Accepted
29 Apr 2015