Acessibilidade / Reportar erro

Translation, cross-cultural adaptation and validation of the Finnish Diabetes Risk Score (FINDRISC) for use in Brazilian Portuguese: questionnaire validity study

ABSTRACT

BACKGROUND:

The Finnish Diabetes Risk Score (FINDRISC) is a questionnaire that was developed by Finnish researchers to track the risk of diabetes.

OBJECTIVE:

To translate, cross-culturally adapt and validate the FINDRISC for use in Brazilian Portuguese.

DESIGN AND SETTING:

Questionnaire validity study conducted at a private university.

METHODS:

The Brazilian version of the FINDRISC was developed through the processes of translation, back-translation, committee review and pre-testing. Test-retest reliability was measured using the intraclass correlation coefficient (ICC), kappa coefficient, standard error of measurement (SEM) and minimum detectable change (MDC). Internal consistency was measured using Cronbach’s alpha. For construct validity, the total score of the FINDRISC was correlated with the Diabetes Knowledge Scale (DKN-A) and Diabetes Mellitus Risk Questionnaire (QRDM). Ceiling and floor effects were also evaluated in the present study.

RESULTS:

For construct validity and floor and ceiling effect measurements, a total sample of 107 participants was used. For reliability, a subsample of 51 participants out of the total sample was used. We identified adequate values for reliability (kappa ≥ 0.79 and ICC = 0.98) and internal consistency (Cronbach’s alpha = 0.84). Regarding the error inherent in the FINDRISC, we found SEM = 8.02% and MDC = 22.44%. There were significant correlations between the FINDRISC and the QRDM (r = 0.686) and DKN-A (r = -0.216). No ceiling or floor effects were found.

CONCLUSION:

The Brazilian version of the FINDRISC has adequate psychometric properties that are in accordance with the best international recommendations.

KEY WORDS (MeSH terms):
Surveys and questionnaires; Reproducibility of results; Psychometrics; Public health

AUTHORS’ KEY WORDS:
Questionnaires; Diabetes; Questionnaire validity

INTRODUCTION

Recently, the International Diabetes Federation reported that the number of individuals with type 2 diabetes mellitus (T2DM) had increased worldwide, especially in Brazil, which placed this country in fifth place among the countries with the most people with diabetes mellitus.11. Brazil country report 2010 - 2045. Available from: Available from: https://www.diabetesatlas.org/data/en/country/27/br.html . Accessed in 2019 (Dec 19).
https://www.diabetesatlas.org/data/en/co...

Given this reality, strategies are being sought in an attempt to easily and cost-effectively screen individuals with high potential to develop T2DM, in order to implement preventive measures against the onset of the disease. In this context, use of questionnaires has been an ally in screening for several other diseases.22. Gallasch CH, Alexandre NMC, Esteves SCB. Propriedades psicométricas do questionário de avaliação de desempenho no trabalho em trabalhadores submetidos à radioterapia [Psychometric properties of the Brazilian version of the Work Role Functioning Questionnaire evaluating workers in radiotherapy]. Rev Enferm UERJ. 2015;23(6):817-25. doi: 10.12957/reuerj.2015.15791.
https://doi.org/10.12957/reuerj.2015.157...
,33. Cruz PA. Adaptação transcultural do questionário de risco para diabetes mellitus: Take the test. Know your score [dissertation]. São Paulo: Universidade de São Paulo; 2010. doi: 10.11606/D.6.2010.tde-13102010-144009.
https://doi.org/10.11606/D.6.2010.tde-13...
,44. Curcio R, Alexandre NMC, Torres H de C, Lima MHM. Tradução e adaptação do “Diabetes Distress Scale - DDS” na cultura brasileira. Acta Paul Enferm. 2012;25(5):762-7. doi: 10.1590/S0103-21002012005000025.
https://doi.org/10.1590/S0103-2100201200...
,55. Torres HC, Virginia AH, Schall VT. Validação dos questionários de conhecimento (DKN-A) e atitude (ATT-19) de Diabetes Mellitus [Validation of Diabetes Mellitus knowledge (DKN-A) and attitude (ATT-19) questionnaires]. Rev Saude Publica. 2005;39(6):906-11. PMID: 16341399; doi: 10.1590/s0034-89102005000600006.
https://doi.org/10.1590/s0034-8910200500...

A few questionnaires directed towards people with T2DM have been validated for Brazilian Portuguese, including the Diabetes Quality of Life Measure,66. Correr CJ, Pontarolo R, Melchiors AC, et al. Tradução para o português e validação do instrumento Diabetes Quality of Life Measure (DQOL-Brasil) [Translation to Portuguese and validation of the diabetes quality of life measure (DQOL-Brazil)]. Arq Bras Endocrinol Metabol. 2008;52(3):515-22. PMID: 18506277; doi: 10.1590/s0004-27302008000300012.
https://doi.org/10.1590/s0004-2730200800...
Diabetes Mellitus Knowledge and Attitude Questionnaire55. Torres HC, Virginia AH, Schall VT. Validação dos questionários de conhecimento (DKN-A) e atitude (ATT-19) de Diabetes Mellitus [Validation of Diabetes Mellitus knowledge (DKN-A) and attitude (ATT-19) questionnaires]. Rev Saude Publica. 2005;39(6):906-11. PMID: 16341399; doi: 10.1590/s0034-89102005000600006.
https://doi.org/10.1590/s0034-8910200500...
and Diabetes Self-Care Activities.77. Michels MJ, Coral MH, Sakae TM, Damas TB, Furlanetto LM. Questionário de Atividades de Autocuidado com o Diabetes: tradução, adaptação e avaliação das propriedades psicométricas [Questionnaire of Diabetes Self-Care Activities: translation, cross-cultural adaptation and evaluation of psychometric properties]. Arq Bras Endocrinol Metabol. 2010;54(7):644-51. PMID: 21085770; doi: 10.1590/s0004-27302010000700009.
https://doi.org/10.1590/s0004-2730201000...
With regard to the risk of developing T2DM, there is no validated questionnaire for use in Brazilian Portuguese for these purposes.

The Finnish Diabetes Risk Score (FINDRISC) is a questionnaire that was developed in Finnish and English in 2003 by Finnish researchers. It had the aims of tracking the risk of diabetes and stimulating the adoption of measures to prevent the onset of T2DM, especially for individuals who are at increased risk of the disease, but without the need for low-cost laboratory tests.88. Lindström J, Tuomilehto J. The diabetes risk score: a practical tool to predict type 2 diabetes risk. Diabetes Care. 2003;26(3):725-31. PMID: 12610029; doi: 10.2337/diacare.26.3.725.
https://doi.org/10.2337/diacare.26.3.725...
Some articles using the FINDRISC have already been published in Brazilian Portuguese,99. de Oliveira Araújo L, e Silva ES, de Oliveira Mariano J, et al. Risco para desenvolvimento do diabetes mellitus em usuários da atenção primária a saúde: um estudo transversal [Risk of developing diabetes mellitus in primary care health users: a cross-sectional study]. Rev Gaucha Enferm. 2015;36(4):77-83. PMID: 26735762; doi: 10.1590/1983-1447.2015.04.50195.
https://doi.org/10.1590/1983-1447.2015.0...
,1010. Cândido JAB, Torres GMC, Figueiredo IDT, et al. FINDRISK: estratificação do risco para Diabetes Mellitus na saúde coletiva. Rev Bras em Promoção da Saúde. 2017;30(3):1-8. doi: 10.5020/18061230.2017.6118.
https://doi.org/10.5020/18061230.2017.61...
even without proper translation, cross-cultural adaptation or validation of the questionnaire for this language. However, the FINDRISC has already been validated for other languages, including those spoken by the populations of Spain,1111. Soriguer F, Valdés S, Tapia MJ, et al. Validación del FINDRISC (FINnish Diabetes Risk SCore) para la predicción del riesgo de diabetes tipo 2 en una población del sur de España. Estudio Pizarra [Validation of the FINDRISC (FINnish Diabetes Risk SCore) for prediction of the risk of type 2 diabetes in a population of southern Spain. Pizarra Study). Med Clin (Barc). 2012;138(9):371-6. PMID: 21939990; doi: 10.1016/j.medcli.2011.05.025.
https://doi.org/10.1016/j.medcli.2011.05...
Greece,1212. Makrilakis K, Liatis S, Grammatikou S, et al. Validation du questionnaire finlandais calculant un score de risque de diabète (FINDRISC) pour le dépistage du diabète de type 2, des anomalies de la glycorégulation et du syndrome métabolique en Grèce [Validation of the Finnish diabetes risk score (FINDRISC) questionnaire for screening for undiagnosed type 2 diabetes, dysglycaemia and the metabolic syndrome in Greece]. Diabetes Metab. 2011;37(2):144-51. PMID: 21144787; doi: 10.1016/j.diabet.2010.09.006.
https://doi.org/10.1016/j.diabet.2010.09...
Venezuela,1313. Nieto-Martínez R, González-Rivas JP, Ugel E, et al. External validation of the Finnish diabetes risk score in Venezuela using a national sample: The EVESCAM. Prim Care Diabetes. 2019;13(6):574-82. PMID: 31202539; doi: 10.1016/j.pcd.2019.04.006.
https://doi.org/10.1016/j.pcd.2019.04.00...
Colombia,1414. Acosta T, Barengo NC, Arrieta A, Ricaurte C, Tuomilehto JO. A demonstration area for type 2 diabetes prevention in Barranquilla and Juan Mina (Colombia): Baseline characteristics of the study participants. Medicine (Baltimore). 2018;97(1):e9285. PMID: 29505512; doi: 10.1097/MD.0000000000009285.
https://doi.org/10.1097/MD.0000000000009...
Hungary,1515. Winkler G, Hídvégi T, Vándorfi G, Balogh S, Jermendy G. Prevalence of undiagnosed abnormal glucose tolerance in adult patients cared for by general practitioners in Hungary. Results of a risk-stratified screening based on FINDRISC questionnaire. Med Sci Monit. 2013;19:67-72. PMID: 23344680; doi: 10.12659/msm.883747.
https://doi.org/10.12659/msm.883747...
Germany,1616. Bergmann A, Li J, Wang L, et al. A simplified Finnish diabetes risk score to predict type 2 diabetes risk and disease evolution in a German population. Horm Metab Res. 2007;39(9):677-82. PMID: 17846976; doi: 10.1055/s-2007-985353.
https://doi.org/10.1055/s-2007-985353...
Jordan,1717. Al-Shudifat AE, Al-Shdaifat A, Al-Abdouh AA, et al. Diabetes Risk Score in a Young Student Population in Jordan: A Cross-Sectional Study. J Diabetes Res. 2017;2017:8290710. PMID: 28540309; doi: 10.1155/2017/8290710.
https://doi.org/10.1155/2017/8290710...
China,1818. Zhang M, Zhang H, Wang C, et al. Development and validation of a risk-score model for type 2 diabetes: A cohort study of a rural adult Chinese population. PLoS One. 2016;11(4):e0152054. PMID: 27070555; doi: 10.1371/journal.pone.0152054.
https://doi.org/10.1371/journal.pone.015...
Norway1919. Jølle A, Midthjell K, Holmen J, et al. Validity of the FINDRISC as a prediction tool for diabetes in a contemporary Norwegian population: a 10-year follow-up of the HUNT study. BMJ Open Diabetes Res Care. 2019;7(1):e000769. PMID: 31803483; doi: 10.1136/bmjdrc-2019-000769.
https://doi.org/10.1136/bmjdrc-2019-0007...
and Slovenia.2020. Štiglic G, Fijačko N, Stožer A, Sheikh A, Pajnkihar M. Validation of the Finnish Diabetes Risk Score (FINDRISC) questionnaire for undiagnosed type 2 diabetes screening in the Slovenian working population. Diabetes Res Clin Pract. 2016;120:194-7. PMID: 27592167; doi: 10.1016/j.diabres.2016.08.010.
https://doi.org/10.1016/j.diabres.2016.0...

OBJECTIVE

Considering the importance of instruments that track the risk of developing T2DM, for the context of public health, the aim of this study was to translate, cross-culturally adapt and validate the FINDRISC for use in Brazilian Portuguese.

METHODS

Study design and ethics

This was a cross-sectional study on the translation, cross-cultural adaptation and validation of a questionnaire. It was conducted in accordance with the Guidelines for the Process of Cross-Cultural Adaptation of Self-Report Measures2121. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. PMID: 11124735; doi: 10.1097/00007632-200012150-00014.
https://doi.org/10.1097/00007632-2000121...
and the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN).2222. Prinsen CAC, Mokkink LB, Bouter LM, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147-57. PMID: 29435801; doi: 10.1007/s11136-018-1798-3.
https://doi.org/10.1007/s11136-018-1798-...
Authorization for analysis of the psychometric properties of the FINDRISC in Brazilian Portuguese was granted via e-mail by the authors of the original version of the questionnaire (Dr. Jaana Lindstrom and Dr. Jaakko Tuomilehto).

This study was approved by the Research Ethics Committee of our institution, under number 2.853.570, on August 29, 2018. All the participants validated their participation by signing a free and informed consent statement. These participants were recruited from the university community in the city of São Luís (MA), Brazil, and from a community associated with this city. Announcements regarding this study were disseminated through pamphlets and social media.

FINDRISC translation and cross-cultural adaptation

The process of translation and cross-cultural adaptation of the FINDRISC for use in Brazilian Portuguese followed the criteria of Beaton et al.2121. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. PMID: 11124735; doi: 10.1097/00007632-200012150-00014.
https://doi.org/10.1097/00007632-2000121...
and was performed in five phases as described below:

  1. Translation: two independent translators, both with Brazilian Portuguese as their mother tongue and fluent in English, translated the original version of the questionnaire into Brazilian Portuguese;

  2. Synthesis of translations: after discussions and revisions, the two translators, under observation of one of the researchers, produced a synthesis from the two versions of the independently translated questionnaire, thus resulting in a combined version in a consensual manner;

  3. Back-translation: two independent translators (without technical knowledge of health issues), both with English as the mother tongue and fluent in Portuguese, translated the Portuguese version of the questionnaire back to English, without previous knowledge of the original version of the questionnaire;

  4. Expert committee review: six diabetes specialists, along with the four translators of this study, reviewed the original version and the translated, synthetized and back-translated versions, and defined the pre-final version of the FINDRISC;

  5. Pre-final version test: the pre-final version of the questionnaire was administered to 30 individuals without a diagnosis of diabetes and with Portuguese as their mother tongue. The respondents’ comprehension of the items and responses in the FINDRISC was evaluated.

Participants

The sample size for this validation study was based on COSMIN, and a minimum of 100 individuals was recommended.2323. Ramada JM, Serra C, Amick BC 3rd, et al. Reliability and validity of the work role functioning questionnaire (Spanish version). J Occup Rehabil. 2014;24(4):640-9. PMID: 24389721; doi: 10.1007/s10926-013-9495-0.
https://doi.org/10.1007/s10926-013-9495-...
The eligibility criteria that we used were that the participants could be of either sex, without any diagnosis of type 1 or type 2 diabetes mellitus, aged over 24 years and under 64 years, and without cognitive deficits or any other limitations that would make it impossible for them to respond to the questionnaire.

FINDRISC

The FINDRISC consists of eight items that investigate and rate the risk of developing T2DM within 10 years. The responses to each item are scored according to their influence on the development of the disease. The total score can range from 0 to 26 points and is classified as follows: ≤ 7 points, low risk (1 in 100 people will develop disease); 7 to 11 points, slightly elevated risk (1 in 25 people will develop the disease); 12 to 14 points, moderate risk (1 in 6 people will develop the disease); 15 to 20 points, high risk (1 in 3 people will develop the disease); and > 20 points, very high risk (1 in 2 people will develop the disease).

OTHER QUESTIONNAIRES

In addition to the FINDRISC, we applied two other questionnaires that had already been adapted and validated for use in Brazilian Portuguese, to ascertain the construct validity. These instruments were:

  1. Diabetes Knowledge Scale (DKN-A), a questionnaire that was validated for the Brazilian population by Torres et al.,55. Torres HC, Virginia AH, Schall VT. Validação dos questionários de conhecimento (DKN-A) e atitude (ATT-19) de Diabetes Mellitus [Validation of Diabetes Mellitus knowledge (DKN-A) and attitude (ATT-19) questionnaires]. Rev Saude Publica. 2005;39(6):906-11. PMID: 16341399; doi: 10.1590/s0034-89102005000600006.
    https://doi.org/10.1590/s0034-8910200500...
    which is composed of 15 multiple-choice questions on various aspects of general knowledge relating to T2DM. The total score is calculated by assigning one point to each correct answer, and it can range from 0 to 15. The higher the score is, the greater the respondent’s knowledge about T2DM is.

  2. Diabetes Mellitus Risk Questionnaire (QRDM), a questionnaire that was validated in the master’s degree dissertation of Cruz,33. Cruz PA. Adaptação transcultural do questionário de risco para diabetes mellitus: Take the test. Know your score [dissertation]. São Paulo: Universidade de São Paulo; 2010. doi: 10.11606/D.6.2010.tde-13102010-144009.
    https://doi.org/10.11606/D.6.2010.tde-13...
    which is composed of seven items, with a total score that can range from 0 to 27 points. The higher the score is, the higher the respondent’s risk of developing T2DM is.

Statistical analysis

Reliability was assessed based on a test-retest model by measuring the kappa coefficient, intraclass correlation coefficient (ICC), standard error of measurement (SEM) and minimum detectable change (MDC). Internal consistency was assessed using Cronbach’s alpha. The kappa values were interpreted based on the categories defined by Sim and Wright: < 0, poor; 0.01-0.20, slight; 0.21-0.40, fair; 0.41-0.60, moderate; 0.61-0.80, substantial; and 0.81-1, almost perfect.2424. Sim J, Wright CC. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther. 2005;85(3):257-68. PMID: 15733050. The ICC values were interpreted based on the study by Fleiss: for values below 0.40, reliability was considered low; between 0.40 and 0.75, moderate; between 0.75 and 0.90, substantial; and greater than 0.90, excellent.2525. Fleiss JL. The Design and Analysis of Clinical Experiments. Hoboken, USA: John Wiley & Sons, Inc.; 1999. ISBN: 978-0-471-34991-4. The SEM percentage was interpreted based on the definitions of Ostelo et al.: 5% or less, very good; greater than 5% and less than or equal to 10%, good; greater than 10% and less than or equal to 20%, doubtful; and greater than 20%, negative.2626. Ostelo RWJ, de Vet HC, Knol DL, van den Brandt PA. 24-item Roland-Morris Disability Questionnaire was preferred out of six functional status questionnaires for post-lumbar disc surgery. J Clin Epidemiol. 2004;57(3):268-76. PMID: 15066687; doi: 10.1016/j.jclinepi.2003.09.005.
https://doi.org/10.1016/j.jclinepi.2003....

To ascertain the validity of the construct, Pearson’s correlation coefficient (r) was used to determine the magnitude of the correlations between the FINDRISC and the QRDM, and between the FINDRISC and the DKN-A. The r values were interpreted in accordance with the COSMIN recommendations: correlations with instruments measuring similar constructs should be ≥ 0.50; correlations with instruments measuring related but dissimilar constructs should be 0.30-0.50; and correlations with instruments measuring unrelated constructs should be < 0.30.2222. Prinsen CAC, Mokkink LB, Bouter LM, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147-57. PMID: 29435801; doi: 10.1007/s11136-018-1798-3.
https://doi.org/10.1007/s11136-018-1798-...

Ceiling and floor effects were evaluated in the present study. By definition, these effects occurred when a number of study participants (set as over 15%) reached the minimum or maximum values of the total score of the questionnaire.

RESULTS

Sample characterization

The study consisted of three samples of different sizes. Initially, for the analysis on the pre-test version of the instrument, 30 participants were included. For the assessment of construct validity and measurement of the floor and ceiling effects, a total sample consisting of 107 participants who were evaluated at a single time was used. For determine the reliability of the FINDRISC, a subsample was used, comprising 51 participants from the total sample who were evaluated at two times (test and retest), seven days apart. The sample size used in this validation study was in accordance with international practices for cross-cultural adaptation and validation of questionnaires, as guided by the study of Beaton et al.2121. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. PMID: 11124735; doi: 10.1097/00007632-200012150-00014.
https://doi.org/10.1097/00007632-2000121...
and by COSMIN.2222. Prinsen CAC, Mokkink LB, Bouter LM, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147-57. PMID: 29435801; doi: 10.1007/s11136-018-1798-3.
https://doi.org/10.1007/s11136-018-1798-...

The participants’ characteristics are described in Table 1, along with the mean scores from the QRDM and DKN-A questionnaires.

Table 1.
Characteristics of study participants according to study phase

Translation and cross-cultural adaptation

The translation and back-translation processes are described in Table 2. After the two translations performed by Portuguese native speakers, the translations were synthetized, and the translators came to an agreement regarding the definitions for the eight items of the FINDRISC in Brazilian Portuguese. Next, back-translation was performed by two English native speakers. After this phase, there was a meeting involving the translators and a committee of experts, and the synthetized version was accepted unanimously, without any amendments proposed. In this manner, the pre-final version of the FINDRISC was defined.

Table 2.
Translation, consensus version and backtranslation of Finnish Diabetes Risk Score (FINDRISC)

The pre-final version of the FINDRISC was applied to 30 individuals (24 women, 80%) without a diagnosis of diabetes and with Brazilian Portuguese as their mother tongue. The average age of this sample was 49 years (standard deviation, SD = 10.82), and the average FINDRISC score was 11.56 points (SD = 4.70). There was 100% understanding of the questionnaire items, which thus defined the final version of the FINDRISC in Brazilian Portuguese (Appendices 1 and 2).

Reliability and internal consistency

Table 3 presents the reliability values item-by-item and the total score of the final version of the FINDRISC in Brazilian Portuguese. We found adequate values for reliability (kappa ≥ 0.66 and ICC = 0.98) and internal consistency (Cronbach’s alpha ≥ 0.82). In addition, in calculating the error inherent to the FINDRISC total score, we found that the values were sufficient, as follows: SEM (absolute) = 0.63; SEM (%) = 8.02; MDC (absolute) = 1.76; and MDC (%) = 22.44.

Table 3.
Finnish Diabetes Risk Score (FINDRISC) reliability and internal consistency with presentation of mean values, standard deviation (SD), kappa or intraclass correlation coefficient (ICC) with 95% confidence interval (CI) and Cronbach’s alpha

Construct validity

The construct validity was tested by correlating the total FINDRISC score with the scores from the other questionnaires of the present study. The following significant (P < 0.05) and adequate correlations with this validation criterion were observed: QRDM (r = 0.686) and DKN-A (r = -0.216). According to COSMIN, values ≥ 0.50 are expected for correlations of questionnaire scores with similar constructs (as in the case of QRDM) and values < 0.30 for correlations of questionnaire scores with unrelated constructs (as in the case of DKN-A).

Ceiling and floor effects

Two individuals (1.9%) achieved a FINDRISC minimum score of 0. No participant reached the maximum score of 26 points. Therefore, ceiling and floor effects were not observed.

DISCUSSION

We observed that the FINDRISC in Brazilian Portuguese presented an adequate level of comprehension in the study population and acceptable values for reliability, internal consistency and validity. Regarding reliability, our study found kappa values (when considered item-by-item) ranging from 0.66 to 1.00 and ICC values (when considering the total score) of 0.98. In addition, Cronbach’s alpha of 0.84 was found. Significant correlations were found between the FINDRISC and DKN-A and between the FINDRISC and QRDM.

The FINDRISC has also been considered to be a valid questionnaire in other countries. However, these validations did not have cross-cultural translation and adaptation, and only tested the accuracy of diagnosing the risk of developing diabetes based on FINDRISC cutoff points. All of these studies used the receiver operating characteristic (ROC) curve as a statistical method. Thus, the following findings were observed: area under the ROC curve of 0.77 in Norway,1919. Jølle A, Midthjell K, Holmen J, et al. Validity of the FINDRISC as a prediction tool for diabetes in a contemporary Norwegian population: a 10-year follow-up of the HUNT study. BMJ Open Diabetes Res Care. 2019;7(1):e000769. PMID: 31803483; doi: 10.1136/bmjdrc-2019-000769.
https://doi.org/10.1136/bmjdrc-2019-0007...
greater than 0.70 in Venezuela, of 0.78 in Slovenia,2020. Štiglic G, Fijačko N, Stožer A, Sheikh A, Pajnkihar M. Validation of the Finnish Diabetes Risk Score (FINDRISC) questionnaire for undiagnosed type 2 diabetes screening in the Slovenian working population. Diabetes Res Clin Pract. 2016;120:194-7. PMID: 27592167; doi: 10.1016/j.diabres.2016.08.010.
https://doi.org/10.1016/j.diabres.2016.0...
of 0.74 in Mexico,2727. Arellano-Campos O, Gómez-Velasco DV, Bello-Chavolla OY, et al. Development and validation of a predictive model for incident type 2 diabetes in middle-aged Mexican adults: the metabolic syndrome cohort. BMC Endocr Disord. 2019;19(1):41. PMID: 31030672; doi: 10.1186/s12902-019-0361-8.
https://doi.org/10.1186/s12902-019-0361-...
of 0.76 in China,1818. Zhang M, Zhang H, Wang C, et al. Development and validation of a risk-score model for type 2 diabetes: A cohort study of a rural adult Chinese population. PLoS One. 2016;11(4):e0152054. PMID: 27070555; doi: 10.1371/journal.pone.0152054.
https://doi.org/10.1371/journal.pone.015...
greater than 0.72 in Greece1212. Makrilakis K, Liatis S, Grammatikou S, et al. Validation du questionnaire finlandais calculant un score de risque de diabète (FINDRISC) pour le dépistage du diabète de type 2, des anomalies de la glycorégulation et du syndrome métabolique en Grèce [Validation of the Finnish diabetes risk score (FINDRISC) questionnaire for screening for undiagnosed type 2 diabetes, dysglycaemia and the metabolic syndrome in Greece]. Diabetes Metab. 2011;37(2):144-51. PMID: 21144787; doi: 10.1016/j.diabet.2010.09.006.
https://doi.org/10.1016/j.diabet.2010.09...
and greater than 0.74 in Spain.1111. Soriguer F, Valdés S, Tapia MJ, et al. Validación del FINDRISC (FINnish Diabetes Risk SCore) para la predicción del riesgo de diabetes tipo 2 en una población del sur de España. Estudio Pizarra [Validation of the FINDRISC (FINnish Diabetes Risk SCore) for prediction of the risk of type 2 diabetes in a population of southern Spain. Pizarra Study). Med Clin (Barc). 2012;138(9):371-6. PMID: 21939990; doi: 10.1016/j.medcli.2011.05.025.
https://doi.org/10.1016/j.medcli.2011.05...
It is noteworthy that the values for the area under the ROC curve that were identified in these various studies established that the degree of accuracy of the FINDRISC was adequate.

The international best practices for translation, cross-cultural adaptation and validation of questionnaires are centered on COSMIN.2222. Prinsen CAC, Mokkink LB, Bouter LM, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147-57. PMID: 29435801; doi: 10.1007/s11136-018-1798-3.
https://doi.org/10.1007/s11136-018-1798-...
These methodological guidelines indicate several psychometric properties that an instrument should present, with emphasis on i) reliability and ii) validity (composed of several subitems, such as face, content, construct, structural, cross-cultural and criterion validity) and responsiveness. Our validation study involved assessments of reliability (using kappa, ICC, SEM and MDC), cross-cultural adaptation (using translation, synthesis of translations, back-translation, expert committee and pre-final testing), construct validity (using the correlation between questionnaires) and structural validity (using Cronbach’s alpha). These properties ensured that the FINDRISC can be applied to the Brazilian population. Other questionnaire validation studies conducted in Brazil have also measured these psychometric properties.2828. da Cunha RA, Costa LO, Hespanhol Junior LC, et al. Translation, cross-cultural adaptation, and clinimetric testing of instruments used to assess patients with patellofemoral pain syndrome in the Brazilian population. J Orthop Sports Phys Ther. 2013;43(5):332-9. PMID: 23485881; doi: 10.2519/jospt.2013.4228.
https://doi.org/10.2519/jospt.2013.4228...
,2929. Wageck BB, de Noronha M, Lopes AD, et al. Cross-cultural adaptation and measurement properties of the Brazilian Portuguese Version of the Victorian Institute of Sport Assessment-Patella (VISA-P) scale. J Orthop Sports Phys Ther. 2013;43(3):163-71. PMID: 23321783; doi: 10.2519/jospt.2013.4287.
https://doi.org/10.2519/jospt.2013.4287...
,3030. Manzoni ACT, Fagundes FRC, Fuhro FF, Cabral CMN. Translation, Cross-cultural Adaptation to Brazilian Portuguese, and Analysis of Measurement Properties of the Consultation and Relational Empathy Measure. J Chiropr Med. 2019;18(2):106-14. PMID: 31367197; doi: 10.1016/j.jcm.2018.10.005.
https://doi.org/10.1016/j.jcm.2018.10.00...

Some limitations of this study and suggestions need to be noted. Firstly, we recommend that the cross-cultural adaptation of the FINDRISC to other languages should be tested based on COSMIN.2222. Prinsen CAC, Mokkink LB, Bouter LM, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147-57. PMID: 29435801; doi: 10.1007/s11136-018-1798-3.
https://doi.org/10.1007/s11136-018-1798-...
Lack of such testing greatly limited the discussion of the results. In addition, because of the need for specific methodology, our study did not investigate the accuracy or responsiveness of the FINDRISC. Thus, we suggest that future studies should measure these psychometric properties in Brazilian Portuguese.

CONCLUSION

The results from this study demonstrate that the Brazilian Portuguese version of the FINDRISC has adequate psychometric properties that are in accordance with the best international recommendations. Thus, its use within clinical routines and/or research can be supported.

REFERENCES

  • 1
    Brazil country report 2010 - 2045. Available from: Available from: https://www.diabetesatlas.org/data/en/country/27/br.html Accessed in 2019 (Dec 19).
    » https://www.diabetesatlas.org/data/en/country/27/br.html
  • 2
    Gallasch CH, Alexandre NMC, Esteves SCB. Propriedades psicométricas do questionário de avaliação de desempenho no trabalho em trabalhadores submetidos à radioterapia [Psychometric properties of the Brazilian version of the Work Role Functioning Questionnaire evaluating workers in radiotherapy]. Rev Enferm UERJ. 2015;23(6):817-25. doi: 10.12957/reuerj.2015.15791.
    » https://doi.org/10.12957/reuerj.2015.15791
  • 3
    Cruz PA. Adaptação transcultural do questionário de risco para diabetes mellitus: Take the test. Know your score [dissertation]. São Paulo: Universidade de São Paulo; 2010. doi: 10.11606/D.6.2010.tde-13102010-144009.
    » https://doi.org/10.11606/D.6.2010.tde-13102010-144009.
  • 4
    Curcio R, Alexandre NMC, Torres H de C, Lima MHM. Tradução e adaptação do “Diabetes Distress Scale - DDS” na cultura brasileira. Acta Paul Enferm. 2012;25(5):762-7. doi: 10.1590/S0103-21002012005000025.
    » https://doi.org/10.1590/S0103-21002012005000025
  • 5
    Torres HC, Virginia AH, Schall VT. Validação dos questionários de conhecimento (DKN-A) e atitude (ATT-19) de Diabetes Mellitus [Validation of Diabetes Mellitus knowledge (DKN-A) and attitude (ATT-19) questionnaires]. Rev Saude Publica. 2005;39(6):906-11. PMID: 16341399; doi: 10.1590/s0034-89102005000600006.
    » https://doi.org/10.1590/s0034-89102005000600006
  • 6
    Correr CJ, Pontarolo R, Melchiors AC, et al. Tradução para o português e validação do instrumento Diabetes Quality of Life Measure (DQOL-Brasil) [Translation to Portuguese and validation of the diabetes quality of life measure (DQOL-Brazil)]. Arq Bras Endocrinol Metabol. 2008;52(3):515-22. PMID: 18506277; doi: 10.1590/s0004-27302008000300012.
    » https://doi.org/10.1590/s0004-27302008000300012
  • 7
    Michels MJ, Coral MH, Sakae TM, Damas TB, Furlanetto LM. Questionário de Atividades de Autocuidado com o Diabetes: tradução, adaptação e avaliação das propriedades psicométricas [Questionnaire of Diabetes Self-Care Activities: translation, cross-cultural adaptation and evaluation of psychometric properties]. Arq Bras Endocrinol Metabol. 2010;54(7):644-51. PMID: 21085770; doi: 10.1590/s0004-27302010000700009.
    » https://doi.org/10.1590/s0004-27302010000700009
  • 8
    Lindström J, Tuomilehto J. The diabetes risk score: a practical tool to predict type 2 diabetes risk. Diabetes Care. 2003;26(3):725-31. PMID: 12610029; doi: 10.2337/diacare.26.3.725.
    » https://doi.org/10.2337/diacare.26.3.725
  • 9
    de Oliveira Araújo L, e Silva ES, de Oliveira Mariano J, et al. Risco para desenvolvimento do diabetes mellitus em usuários da atenção primária a saúde: um estudo transversal [Risk of developing diabetes mellitus in primary care health users: a cross-sectional study]. Rev Gaucha Enferm. 2015;36(4):77-83. PMID: 26735762; doi: 10.1590/1983-1447.2015.04.50195.
    » https://doi.org/10.1590/1983-1447.2015.04.50195
  • 10
    Cândido JAB, Torres GMC, Figueiredo IDT, et al. FINDRISK: estratificação do risco para Diabetes Mellitus na saúde coletiva. Rev Bras em Promoção da Saúde. 2017;30(3):1-8. doi: 10.5020/18061230.2017.6118.
    » https://doi.org/10.5020/18061230.2017.6118
  • 11
    Soriguer F, Valdés S, Tapia MJ, et al. Validación del FINDRISC (FINnish Diabetes Risk SCore) para la predicción del riesgo de diabetes tipo 2 en una población del sur de España. Estudio Pizarra [Validation of the FINDRISC (FINnish Diabetes Risk SCore) for prediction of the risk of type 2 diabetes in a population of southern Spain. Pizarra Study). Med Clin (Barc). 2012;138(9):371-6. PMID: 21939990; doi: 10.1016/j.medcli.2011.05.025.
    » https://doi.org/10.1016/j.medcli.2011.05.025
  • 12
    Makrilakis K, Liatis S, Grammatikou S, et al. Validation du questionnaire finlandais calculant un score de risque de diabète (FINDRISC) pour le dépistage du diabète de type 2, des anomalies de la glycorégulation et du syndrome métabolique en Grèce [Validation of the Finnish diabetes risk score (FINDRISC) questionnaire for screening for undiagnosed type 2 diabetes, dysglycaemia and the metabolic syndrome in Greece]. Diabetes Metab. 2011;37(2):144-51. PMID: 21144787; doi: 10.1016/j.diabet.2010.09.006.
    » https://doi.org/10.1016/j.diabet.2010.09.006
  • 13
    Nieto-Martínez R, González-Rivas JP, Ugel E, et al. External validation of the Finnish diabetes risk score in Venezuela using a national sample: The EVESCAM. Prim Care Diabetes. 2019;13(6):574-82. PMID: 31202539; doi: 10.1016/j.pcd.2019.04.006.
    » https://doi.org/10.1016/j.pcd.2019.04.006
  • 14
    Acosta T, Barengo NC, Arrieta A, Ricaurte C, Tuomilehto JO. A demonstration area for type 2 diabetes prevention in Barranquilla and Juan Mina (Colombia): Baseline characteristics of the study participants. Medicine (Baltimore). 2018;97(1):e9285. PMID: 29505512; doi: 10.1097/MD.0000000000009285.
    » https://doi.org/10.1097/MD.0000000000009285
  • 15
    Winkler G, Hídvégi T, Vándorfi G, Balogh S, Jermendy G. Prevalence of undiagnosed abnormal glucose tolerance in adult patients cared for by general practitioners in Hungary. Results of a risk-stratified screening based on FINDRISC questionnaire. Med Sci Monit. 2013;19:67-72. PMID: 23344680; doi: 10.12659/msm.883747.
    » https://doi.org/10.12659/msm.883747
  • 16
    Bergmann A, Li J, Wang L, et al. A simplified Finnish diabetes risk score to predict type 2 diabetes risk and disease evolution in a German population. Horm Metab Res. 2007;39(9):677-82. PMID: 17846976; doi: 10.1055/s-2007-985353.
    » https://doi.org/10.1055/s-2007-985353
  • 17
    Al-Shudifat AE, Al-Shdaifat A, Al-Abdouh AA, et al. Diabetes Risk Score in a Young Student Population in Jordan: A Cross-Sectional Study. J Diabetes Res. 2017;2017:8290710. PMID: 28540309; doi: 10.1155/2017/8290710.
    » https://doi.org/10.1155/2017/8290710
  • 18
    Zhang M, Zhang H, Wang C, et al. Development and validation of a risk-score model for type 2 diabetes: A cohort study of a rural adult Chinese population. PLoS One. 2016;11(4):e0152054. PMID: 27070555; doi: 10.1371/journal.pone.0152054.
    » https://doi.org/10.1371/journal.pone.0152054
  • 19
    Jølle A, Midthjell K, Holmen J, et al. Validity of the FINDRISC as a prediction tool for diabetes in a contemporary Norwegian population: a 10-year follow-up of the HUNT study. BMJ Open Diabetes Res Care. 2019;7(1):e000769. PMID: 31803483; doi: 10.1136/bmjdrc-2019-000769.
    » https://doi.org/10.1136/bmjdrc-2019-000769
  • 20
    Štiglic G, Fijačko N, Stožer A, Sheikh A, Pajnkihar M. Validation of the Finnish Diabetes Risk Score (FINDRISC) questionnaire for undiagnosed type 2 diabetes screening in the Slovenian working population. Diabetes Res Clin Pract. 2016;120:194-7. PMID: 27592167; doi: 10.1016/j.diabres.2016.08.010.
    » https://doi.org/10.1016/j.diabres.2016.08.010
  • 21
    Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. PMID: 11124735; doi: 10.1097/00007632-200012150-00014.
    » https://doi.org/10.1097/00007632-200012150-00014
  • 22
    Prinsen CAC, Mokkink LB, Bouter LM, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147-57. PMID: 29435801; doi: 10.1007/s11136-018-1798-3.
    » https://doi.org/10.1007/s11136-018-1798-3
  • 23
    Ramada JM, Serra C, Amick BC 3rd, et al. Reliability and validity of the work role functioning questionnaire (Spanish version). J Occup Rehabil. 2014;24(4):640-9. PMID: 24389721; doi: 10.1007/s10926-013-9495-0.
    » https://doi.org/10.1007/s10926-013-9495-0
  • 24
    Sim J, Wright CC. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther. 2005;85(3):257-68. PMID: 15733050.
  • 25
    Fleiss JL. The Design and Analysis of Clinical Experiments. Hoboken, USA: John Wiley & Sons, Inc.; 1999. ISBN: 978-0-471-34991-4.
  • 26
    Ostelo RWJ, de Vet HC, Knol DL, van den Brandt PA. 24-item Roland-Morris Disability Questionnaire was preferred out of six functional status questionnaires for post-lumbar disc surgery. J Clin Epidemiol. 2004;57(3):268-76. PMID: 15066687; doi: 10.1016/j.jclinepi.2003.09.005.
    » https://doi.org/10.1016/j.jclinepi.2003.09.005
  • 27
    Arellano-Campos O, Gómez-Velasco DV, Bello-Chavolla OY, et al. Development and validation of a predictive model for incident type 2 diabetes in middle-aged Mexican adults: the metabolic syndrome cohort. BMC Endocr Disord. 2019;19(1):41. PMID: 31030672; doi: 10.1186/s12902-019-0361-8.
    » https://doi.org/10.1186/s12902-019-0361-8
  • 28
    da Cunha RA, Costa LO, Hespanhol Junior LC, et al. Translation, cross-cultural adaptation, and clinimetric testing of instruments used to assess patients with patellofemoral pain syndrome in the Brazilian population. J Orthop Sports Phys Ther. 2013;43(5):332-9. PMID: 23485881; doi: 10.2519/jospt.2013.4228.
    » https://doi.org/10.2519/jospt.2013.4228
  • 29
    Wageck BB, de Noronha M, Lopes AD, et al. Cross-cultural adaptation and measurement properties of the Brazilian Portuguese Version of the Victorian Institute of Sport Assessment-Patella (VISA-P) scale. J Orthop Sports Phys Ther. 2013;43(3):163-71. PMID: 23321783; doi: 10.2519/jospt.2013.4287.
    » https://doi.org/10.2519/jospt.2013.4287
  • 30
    Manzoni ACT, Fagundes FRC, Fuhro FF, Cabral CMN. Translation, Cross-cultural Adaptation to Brazilian Portuguese, and Analysis of Measurement Properties of the Consultation and Relational Empathy Measure. J Chiropr Med. 2019;18(2):106-14. PMID: 31367197; doi: 10.1016/j.jcm.2018.10.005.
    » https://doi.org/10.1016/j.jcm.2018.10.005
  • Universidade Ceuma (UNICEUMA), São Luís (MA), Brazil
  • Sources of funding: No grants or funding sources

Appendix 1. Brazilian Portuguese version of Finnish Diabetes Risk Score (FINDRISC), initial page.

Appendix 2. Brazilian Portuguese version of Finnish Diabetes Risk Score (FINDRISC), final page.

Publication Dates

  • Publication in this collection
    15 June 2020
  • Date of issue
    May-Jun 2020

History

  • Reviewed
    21 Dec 2019
  • Received
    21 Dec 2019
  • Accepted
    05 Mar 2020
Associação Paulista de Medicina - APM APM / Publicações Científicas, Av. Brigadeiro Luís Antonio, 278 - 7º and., 01318-901 São Paulo SP - Brazil, Tel.: +55 11 3188-4310 / 3188-4311, Fax: +55 11 3188-4255 - São Paulo - SP - Brazil
E-mail: revistas@apm.org.br