Validation of the Portuguese version of the RDC/TMD Axis II questionnaire

Validação do questionário RDC/TMD Eixo II em português

Abstracts

O presente trabalho objetivou avaliar a validade da versão em português do questionário Eixo II dos Critérios Diagnósticos de Pesquisa em Disfunção Temporomandibular (RDC/TMD). A amostra foi composta por 155 pacientes com sinais e sintomas de disfunção temporomandibular (DTM) atendidos no Centro de Controle da Dor Orofacial da Faculdade de Odontologia da Universidade de Pernambuco, Brasil, no período de julho de 2003 a fevereiro de 2004. Para a coleta de dados foram utilizados os seguintes instrumentos: RDC/TMD Eixo I, para avaliação clínica e classificação da DTM, Eixo II, para avaliação psicossocial, e os questionários específicos para avaliação da qualidade de vida relacionada à saúde bucal: Impacto da Saúde Bucal nas Atividades Diárias e Perfil do Impacto na Saúde Bucal-14, considerados padrões-ouro. A validação consistiu na avaliação da consistência interna pelo teste de confiabilidade alfa Cronbach, confiabilidade e reprodutibilidade estimadas pela estatística Kappa e correlação de Spearman e validação concorrente, mediante correlação de Spearman. A versão em português do questionário Eixo II do RDC/TMD foi considerada consistente (alfa Cronbach = 0,72), reprodutível (valores de Kappa entre 0,73 e 0,91; p < 0,01) e válida (p < 0,01). Conclui-se que o instrumento em estudo mostrou-se reprodutível e válido para a população brasileira, possibilitando, assim, a inclusão do Brasil em estudos epidemiológicos transculturais em disfunção temporomandibular.

Transtornos da articulação temporomandibular; Estudos de validação; Perfil de impacto da doença

ORIGINAL ARTICLES

TEMPOROMANDIBULAR DISORDERS

Validation of the Portuguese version of the RDC/TMD Axis II questionnaire

Validação do questionário RDC/TMD Eixo II em português

Luciana Barbosa Sousa de Lucena^I; Maurício Kosminsky^II; Lino João da Costa^III; Paulo Sávio Angeiras de Góes^IV

^IPhD, Professor, Discipline of Topographic Anatomy

^IIPhD, Professor, Discipline of Orofacial Pain and Temporomandibular Disorders

^IIIPhD, Professor, Discipline of Stomatology – Federal University of Paraíba

^IVPhD, Professor, Discipline of Public Health – School of Dentistry, University of Pernambuco

ABSTRACT

The present paper aimed at evaluating the validity of the Portuguese version of the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) Axis II Questionnaire. The sample was comprised of 155 patients with signs and symptoms of Temporomandibular Disorders (TMD), evaluated at the Orofacial Pain Control Center, School of Dentistry, University of Pernambuco, Brazil, between July 2003 and February 2004. Data collection was performed with the following tools: the RDC/TMD Axis I (clinical evaluation and TMD classification), and Axis II (psychosocial evaluation), as well as specific questionnaires for evaluation of Oral Health Related Quality of Life, namely, Oral Impacts on Daily Performances and the Oral Health Impact Profile-14, considered to be gold standard criteria. Validity evaluation consisted of internal consistency evaluation by the Cronbach alfa reliability test, reliability and reproducibility estimated by the Kappa test and the Spearman's correlation, and concurring validation through Spearman's correlation. The Portuguese version of the RDC/TMD Axis II questionnaire was considered consistent (Cronbach alfa = 0.72), reproducible (Kappa values from 0.73 to 0.91, p < 0.01), and valid (p < 0.01). It was concluded that this version showed valid and reproducible results for the Brazilian population, thus paving the way for including Brazil in transcultural epidemiological studies on TMD.

Descriptors: Temporomandibular joint disorders; Validation studies; Sickness impact profile.

RESUMO

O presente trabalho objetivou avaliar a validade da versão em português do questionário Eixo II dos Critérios Diagnósticos de Pesquisa em Disfunção Temporomandibular (RDC/TMD). A amostra foi composta por 155 pacientes com sinais e sintomas de disfunção temporomandibular (DTM) atendidos no Centro de Controle da Dor Orofacial da Faculdade de Odontologia da Universidade de Pernambuco, Brasil, no período de julho de 2003 a fevereiro de 2004. Para a coleta de dados foram utilizados os seguintes instrumentos: RDC/TMD Eixo I, para avaliação clínica e classificação da DTM, Eixo II, para avaliação psicossocial, e os questionários específicos para avaliação da qualidade de vida relacionada à saúde bucal: Impacto da Saúde Bucal nas Atividades Diárias e Perfil do Impacto na Saúde Bucal-14, considerados padrões-ouro. A validação consistiu na avaliação da consistência interna pelo teste de confiabilidade alfa Cronbach, confiabilidade e reprodutibilidade estimadas pela estatística Kappa e correlação de Spearman e validação concorrente, mediante correlação de Spearman. A versão em português do questionário Eixo II do RDC/TMD foi considerada consistente (a Cronbach = 0,72), reprodutível (valores de Kappa entre 0,73 e 0,91; p < 0,01) e válida (p < 0,01). Conclui-se que o instrumento em estudo mostrou-se reprodutível e válido para a população brasileira, possibilitando, assim, a inclusão do Brasil em estudos epidemiológicos transculturais em disfunção temporomandibular.

Descritores: Transtornos da articulação temporomandibular; Estudos de validação; Perfil de impacto da doença.

INTRODUCTION

Currently, several protocols are available in the literature for diagnosis and classification as well as clinical treatment and research strategies. However, most methods only emphasize findings obtained during clinical examination, requiring the inclusion of other instruments for evaluating psychosocial factors. In addition, the majority of instruments and questionnaires were created originally for English language speakers and their use for populations of non-English speakers could bias the results. This is because the translation process itself, without a cultural context, does not guarantee its success due to peculiarities in language and cultural behaviors.⁹

Therefore, we cannot expect to have equivalent results from the use of an instrument without submitting it to predefined rules established in the literature for translation, back-translation, face validation, cultural adaptation and psychometric properties equivalence measurement. In addition, reproducibility and validity must be tested.^2,8,9,11

For this purpose, Dworkin, LeResche⁴ (1992) developed a set of diagnostic tools for TMD, namely the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD). These represent a multiaxial approach, evaluating clinical aspects of TMD (Axis I), as well as psychological and psychosocial factors (Axis II). The RDC/TMD are an accepted and validated diagnostic tool for epidemiological and clinical research on TMD.^11,14,17

The term temporomandibular disorder (TMD) covers a group of clinical disturbances affecting the masticatory muscles, the temporomandibular joint (TMJ) or both.¹² Its clinical course varies, comprising concurrent or isolated muscular and articular pain, limited or asymmetric mandibular movements, as well as joint sounds.⁴ TMDs have multifactorial etiology, including trauma, bruxism, joint hypermobility, and appear to be strongly influenced by psychosocial factors.⁴

Epidemiological studies on TMDs have shown controversial results regarding prevalence and incidence. These findings could be attributed to different diagnostic criteria. Thus, a standardized methodology is necessary when comparing studies related to this disease.

Initially, the RDC/TMD were developed for the English language. Their translation and validation have been made for various non-English speaking populations, allowing the application of transcultural clinical studies.⁵

The translation of the RDC/TMD into Portuguese was conducted by Pereira et al.¹⁵ (2002), by means of the International RDC/TMD English-Portuguese Project. Furthermore, Kosminsky et al.¹¹ (2004) performed the face validation and cultural adaptation, resulting in the Portuguese version of the RDC/TMD Axis II. However, this version has not yet been submitted to a validation process, which prevents its use. The aim of this study was to evaluate the validity of the Portuguese version of the RDC/TMD Axis II.

MATERIAL AND METHODS

The study population consisted of male and female patients with orofacial pain from different social backgrounds seeking treatment at the Orofacial Pain Control Center, School of Dentistry, University of Pernambuco, Brazil, from July 2003 to February 2004. The sample comprised 155 individuals with ages ranging from 18 to 65 years (mean = 37.3 years), 89% of whom were females and 11% males. All patients had TMD. The study inclusion criteria were the following: no previous history of TMD treatment, positive diagnosis of TMD, using the Fonseca et al.⁶ (1994) Simplified Anamnestic Index (SAI), and inclusion in one of the three TMD groups according to the RDC/TMD Axis I questionnaire established by Dworkin, LeResche⁴ (1992).

Patient history/data collection

The following questionnaires were used:

a) Simplified Anamnestic Index:⁶ the SAI verified the presence of signs and symptoms of TMD providing a prompt diagnosis. All patients were classified as having TMD. b) RDC/TMD Axis II Questionnaire (Portuguese version)^*:¹¹ this consisted of 31 items, divided into socio-demographic, socio-economic, psychological (depression subscales and nonspecific physical symptoms – pain items included and pain items excluded), psychosocial (graded chronic pain severity – pain intensity and disability); patient-related signs and symptoms and the limitation scale on mandibular function (limitations related to mandibular functioning). c) Oral Impacts on Daily Performances (OIDP) and the Oral Health Impact Profile (OHIP-14): to evaluate oral health-related quality of life, both questionnaires were used. The OIDP consisted of nine questions related to how the mouth and teeth disrupt daily activities. The OHIP-14 comprised 14 questions for measuring the perception of the impact of orofacial pain on well-being related to TMD.

Clinical data collection

Items regarding clinical variables (Axis I) were filled out according to their order on the RDC/TMD Axis I Examination Form, whose findings correspond to the 10 items of the evaluation protocol for orofacial anatomic elements.

Validation process

The validation process consisted of:

a) Internal consistency (validity): this was estimated from the limitation scale on mandibular function, part of the RDC/TMD Axis II Questionnaire, evaluating whether the 12 items had the same conceptual domain and correlated with one another. The degree of correlation was tested between the several domains of the RDC/TMD Axis II, considering the three subscales for psychological factors, graded chronic pain severity and limitation scale on mandibular function. b) Reliability and reproducibility: this consisted of a test-retest study of the RDC/TMD Axis I and II Questionnaires, applied to 45 participants randomly selected two weeks after the first test by the same clinician, none of whom had received any previous treatment for any associated co-morbidity or pharmacological or physical therapy for TMD. c) Concurrent validity: the Portuguese version of the RDC/TMD Axis II, as well as the gold standard Oral Impacts on Daily Performances and the Oral Health Impact Profile-14 forms were tested in 155 sample individuals. The concurrent validity (convergent type) was determined by correlating results obtained from domains of the limitation scale on mandibular function (RDC/TMD Axis II) and Oral Impacts on Daily Performances and the Oral Health Impact Profile-14 scores. The assigned TMD scores from the Simplified Anamnestic Index⁶ were compared with scores from the graded chronic pain severity (RDC/TMD Axis II).

Divergent validity was demonstrated by correlating results obtained from the psychological subscale domains (RDC/TMD Axis II), the Oral Impacts on Daily Performances and the Oral Health Impact Profile-14 scores, testing their psychometric properties.^1,10,16

Statistical analysis

The data obtained were organized and processed with the aid of a statistical software program (Statistical Package for the Social Sciences - SPSS for Windows, version 10) for descriptive and inferential analysis. The level of statistical significance used was 5%. Internal consistency was estimated by the Cronbach alfa Test and considered satisfactory with values above 0.5.⁷ The test-retest reliability was estimated by the Cohen Kappa scale³ and Spearman's rank correlation test (µ > .05).^3,16 Concurrent, convergent and divergent validity were evaluated by Spearman's rank correlation test.^3,16

RESULTS

Internal consistency

The evaluation of the internal consistency on limitation related to mandibular functioning as a RDC/TMD Axis II criterion identified 12 items that correlated with one another and represented the whole scale (alpha= 0.72) and standardized item alpha 0.73, as shown in Table 1. Alpha values did not increase by removal of any tested item.

The degree of correlation between the different domains of the RDC/TMD Axis II was obtained by considering the three subscales for psychological factors, the graded chronic pain severity and the limitation scale on mandibular functioning (Table 2). The Spearman scores were higher (µ > 0.7) for the three subscales regarding psychological domain, with a statistically significant correlation (P < 0.001). Lower scores (µ < 0.2) were obtained for scales with a poor correlation with one another; this result could be interpreted as applying also to other domains, such as the limitation scale on mandibular functioning (physical) and the psychological factor scales. Correlation values between the psychosocial and psychological domains were µ < 0.3. Correlation values between the physical and psychosocial domains were µ = 0.4; however, this correlation is weak to moderate, indicating that, although these domains are part of the proposed domains measured by the scale, they add little to this study.^1,10,16

Evaluation of reliability and reproducibility

Comparing information obtained from 45 patients (test-retest study), a diagnostic agreement was statistically significant in Axis I and II, as shown in Table 3.

Concurrent validity

According to Table 4, scores from the Oral Impacts on Daily Performances and the Oral Health Impact Profile-14 produced a greater degree of correlation with the limitation scale on mandibular functioning (µ > 0.5), signifying convergent validity, i.e., a positive correlation between limitation scale on mandibular functioning and the Oral Impacts on Daily Performances and the Oral Health Impact Profile-14, measuring the same dimension.^1,10,16 Low correlation values were obtained for the Oral Impacts on Daily Performances and the Oral Health Impact Profile-14 with the other items, such as psychological factor subscales (µ < 0.3), signifying a divergent validity and presenting a different psychometric capacity.^1,10,16 Convergent validity was demonstrated by comparing the Simplified Anamnestic Index⁶ with the graded chronic pain scale, this comparison being statistically significant (µ = 0.5, P < 0.01).

DISCUSSION

The present study makes an important contribution to further research in the TMD area by validating the Portuguese version of the RDC/TMD Axis II Questionnaire. This instrument will allow the standardization of TMD diagnosis and the collection of psychosocial data on the Brazilian population, with a view to conducting transcultural epidemiologic studies on TMD.

The methodology used in this study judiciously follows the methodology already described in the literature, in accordance with similar criteria established by Ciconelli et al.² (1999), Dworkin et al.⁵ (2002), Góes⁸ (2001), Guillemin et al.⁹ (1993) and Mota Falcão et al.¹³ (2003). The methodological norms found in the literature related to transcultural adaptation of research questionnaires should not be restricted only to translation, but should also include the back-translation, face validation, cultural adaptation and validity.⁹ The failure to perform any of these stages may lead to errors in the idiomatic, semantic, cultural and conceptual equivalences of the instrument.⁹

Each society has its own characteristics that reflect the culture of a country, as well as what differentiates it from others. Likewise, health problems are expressed in different ways from one culture to another. Thus, when it is intended to apply an instrument of health-related data collection it should follow the methodology proposed in the literature and result in an instrument with clear, simple language and with equivalence with regard to cultural concepts.² In epidemiology, the validity of data collection is one of the most important aspects in the consistency of the study.

The instrument used in this study was composed of several scales with different psychometric capacities. However, for the limitation scale on mandibular functioning, based on a list of commonly used items in TMD clinical research, reliability and validity have not been evaluated yet.⁴

The internal consistency of a group of items can be evaluated by the Cronbach alpha test, where it is necessary to know whether these items could result in a measurement scale with the same domain.^1,10,16 This test indicates the degree of correlation of an item with a scale and an item with itself. To be considered relevant, the degree of correlation should be no less than 0.5.⁷ The lowest value used as reference in clinical studies is 0.7.^3,16 Thus, the internal consistency was valid, with a global alpha index of 0.72 which is in excess of recommended values in clinical studies.^3,16 In this paper, the 12-item integrating limitation scale on mandibular functioning presents the same conceptual domain and its items correlate with one another, resulting in a true scale.

With respect to the correlation scores regarding different domains of the RDC/TMD Axis II, the Spearman ranks revealed different psychometric properties for each scale studied, demonstrating that the proposed version of the instrument generally had a positive correlation, indicating that the validated version is really measuring what it was intended to measure.^1,16

Any evaluation instrument must be reproducible over time, that is, it must reproduce the same or similar results between two or more applications for the same patient, provided that his/her clinical status has not changed.² The intraexaminer reliability and reproducibility for the tested-retested instrument, in approximately 30% of the sample studied, was considered valid.

CONCLUSION

The process for validating the Portuguese version of the RDC/TMD Axis II Questionnaire followed the methodology proposed in the literature and resulted in a reproducible and applicable instrument, valid for the Brazilian population, making possible the inclusion of Brazil in transcultural epidemiological studies on temporomandibular disorders. However, the responsiveness over time of the present version validated for the Portuguese language needs to be evaluated in further clinical and epidemiological studies.

Received for publication on Sep 15, 2005

Sent for alterations on Oct 31, 2005

Accepted for publication on Feb 18, 2006

• 1. Bowling A. What things are important in people's lives? A survey of the public's judgements to inform scales of health related quality of life. Soc Sci Med. 1995;41:1447-62.
• 2. Ciconelli RM, Ferraz MB, Santos W, Meinão I, Quaresma MR. Tradução para a língua portuguesa e validação do questionário genérico de avaliação de qualidade de vida SF-36 (Brasil SF-36). Rev Bras Reumatol. 1999;39(3):143-50.
• 3. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Measurement. 1960;20:37-46.
• 4. Dworkin SF, LeResche L. Research diagnostic criteria for temporomandibular disorders: review, criteria, examinations and specifications, critique. J Craniomandib Disord. 1992;6:301-55.
• 5. Dworkin SF, Sherman J, Mancl L, Ohrbach R, LeResche L, Truelove E. Reliability, validity and clinical utility of the research diagnostic criteria for temporomandibular disorders axis II scales: depression, non-specific physical symptoms, and graded chronic pain. J Orofac Pain. 2002;16(3):207-20.
• 6. Fonseca DM, Bonfante G, Valle Al, Freitas SFT. Diagnóstico pela anamnese da disfunção craniomandibular. RGO. 1994;42(1):23-8.
• 7. Frankfort-Nachmias C, Nachmias D. Research methods in the social sciences. 4^th ed. London: Edward Arnald; 1992.
• 8. Góes PSA. The prevalence and impact of dental pain in Brazilian schoolchildren and their families [Dissertation]. London: Department of Epidemiology and Public Health, Royal Free and University College Medical School, University College London; 2001.
• 9. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417-32.
• 10. Guyatt GH, Feeny DH, Patrick DL. Measuring health-related quality of life. Ann Intern Med. 1993;118:622-9.
• 11. Kosminsky M, Lucena LBS, Siqueira JTT, Pereira FJ, Góes PSA. Adaptação cultural do questionário "Research diagnostic criteria for temporomandibular disorders: axis II" para o português. J Bras Clin Odontol Integr. 2004;8(43):51-61.
• 12. McNeill C. Temporomandibular disorders: guidelines for classification, assessment and management. The American Academy of Orofacial Pain. 2^nd ed. Chicago: Quintessence; 1993.
• 13. Mota Falcão D, Ciconelli RM, Ferraz MB. Translation and cultural adaptation of quality of life questionnaires: an evaluation of methodology. J Rheumatol. 2003;30(2):379-85.
• 14. Pehling J, Schiffman E, Look J, Shaefer J, Lenton P, Fricton J. Interexaminer reliability and clinical validity of the temporomandibular index: a new outcome measure for temporomandibular disorders. J Orofac Pain. 2002;16(4):296-304.
• 15. Pereira FJ, Favilla EE, Dworkin SF, Huggins KH. Critérios de diagnóstico para pesquisa das desordens temporomandibulares RDC/TMD. On line 2002 [citado 15 jul 2002]. Disponível em: http://www.rdc-tmdinternational.org/translations/frmtranslations.htm .
• 16. Streiner DL, Norman GR. Health measurement scales. 2^nd ed. New York: Oxford Press; 1995.
• 17. Svensson P. Orofacial musculoskeletal pain. In: Giamberardino MA, editor. Pain 2002  An updated review: refresher course syllabus. Seattle: IASP Press; 2002. p. 447-58.

*

Available access:

http://www.ccs.ufpb.br/morofologia;questionariordctmd.pdf.

Publication Dates

• Publication in this collection
  18 Jan 2007
• Date of issue
  Dec 2006

History

• Received
  15 Sept 2005
• Accepted
  18 Feb 2006