Acessibilidade / Reportar erro

Validation in Brazil of a Questionnaire on Quality of Life in Chronic Venous Disease (Aberdeen Varicose Veins Questionnaire for Brazil/AVVQ-Brazil)

Abstract

Background

There is growing global interest in validated health assessment instruments. In order to use these instruments in different countries, it is necessary to conduct translation, cultural adaptation and validation in the target language. In Brazil, there are few instruments for assessment of the impact of chronic venous disease (CVD) on the quality of life (QoL) of patients.

Objective

To validate the AVVQ-Brazil.

Method

This was an analytical, observational study to validate the AVVQ questionnaire with 107 individuals with CVD. The version of the AVVQ adapted for Brazilian Portuguese was administered three times. The first two administrations were successive, with a 30-minute interval (interobserver reproducibility) and the third administration took place 7 to 15 days later (intraobserver reproducibility). Internal consistency and validity were also assessed.

Results

A total of 107 people took part, 87.9% were female, mean age was 50.1 years ± 14.7; the majority had spent long periods standing up (57.0%) throughout their lives and did not engage in physical exercise (96.3%). Many had not completed primary education (25.2%); were members of economic class C2 (36.4%); and had disease severity class C4 (22.4%) or C6 (23.3%) on the CEAP scale. Interobserver and intraobserver reliability of the AVVQ were excellent. Internal consistency was excellent to moderate for the majority of domains. Spearman correlations showed that total AVVQ score and its Pain and Dysfunction domains were negatively correlated with all SF-36 domains. The Mann-Whitney test showed that patients with CEAP 1, 2 or 3 exhibited differences that were statistically significant from those with CEAP 4, 5 or 6 for total AVVQ scores and for Complications domain scores.

Conclusions

The AVVQ has been validated for Brazil and can now be used.

Keywords:
venous insufficiency; quality of life; validation studies

Resumo

Contexto

Há crescente interesse por instrumentos de avaliação em saúde produzidos e validados no mundo. Para sua utilização, é necessário realizar a tradução, a adaptação cultural e a validação ao idioma-alvo. No Brasil, existem poucos instrumentos que avaliem o impacto da doença venosa crônica (DVC) na qualidade de vida (QV) do indivíduo.

Objetivo

Validar o AVVQ-Brasil.

Método

Estudo observacional, analítico, para validação de questionário, em que 107 indivíduos com DVC responderam três vezes à versão adaptada do AVVQ para o português brasileiro. As duas primeiras aplicações foram sucessivas, com intervalo de 30 minutos (reprodutibilidade interobservador), e a terceira, após 7 a 15 dias (reprodutibilidade intraobservador). Foram avaliadas também consistência interna e validade.

Resultados

Dos 107 participantes, 87,9% foram do sexo feminino, com idade média de 50,1 anos ± 14,7; assumiram postura em ortostatismo prolongado (57,0%) ao longo da vida e não realizam exercício físico (96,3%); observou-se Ensino Fundamental incompleto (25,2%) e pertencem à classe econômica C2 (36,4%); apresentam gravidade da doença C4 (22,4%) e C6 (23,3%) do CEAP. As reprodutibilidades inter e intraobservador do AVVQ mostraram-se excelentes. Sua consistência interna mostrou-se de excelente a moderada para a maioria dos seus domínios. As correlações de Spearman mostraram pontuação total do AVVQ, com domínio Dor e Disfunção se correlacionando negativamente com todos os domínios do SF-36. O teste de Mann-Whitney mostrou diferença estatística significante para a pontuação total do AVVQ e domínio Complicações entre o CEAP 1, 2, 3 e o CEAP 4, 5, 6.

Conclusão

O AVVQ está validado no Brasil e pode ser utilizado.

Palavras-chave:
insuficiência venosa; qualidade de vida; estudos de validação

INTRODUCTION

Use of health assessment measures, such as quality of life (QoL) assessments, originally published in other languages is becoming increasingly relevant in the international context.1Sardinha A, Levitan MN, Lopes FL, et al. Tradução e adaptação transcultural do questionário de atividade física habitual. Rev Psiq Clín. 2010;37(1):16-22. http://dx.doi.org/10.1590/S0101-60832010000100004.
http://dx.doi.org/10.1590/S0101-60832010...
However, in order for use of these measures to be appropriate and trustworthy, it is necessary to ensure cross-cultural equivalence, which consists of translation, cultural adaptation and validation of the proposed instrument.1Sardinha A, Levitan MN, Lopes FL, et al. Tradução e adaptação transcultural do questionário de atividade física habitual. Rev Psiq Clín. 2010;37(1):16-22. http://dx.doi.org/10.1590/S0101-60832010000100004.
http://dx.doi.org/10.1590/S0101-60832010...
,2Lopes AD, Stadniky SP, Masiero D, Carrera EF, Ciconelli RM, Griffin S. Tradução e adaptação cultural do WORC: um questionário de qualidade de vida para alterações do manguito rotador. Rev Bras Fisioter. 2006;10(3):309-15. http://dx.doi.org/10.1590/S1413-35552006000300010.
http://dx.doi.org/10.1590/S1413-35552006...

Translation and cultural adaptation are not simple procedures3Maher CG, Latimer J, Costa LOP. A relevância da adaptação transcultural e clinimétrica para instrumentos de fisioterapia. Rev Bras Fisioter. 2007;11(4):245-52. and the objective is to preserve the sense of the original version (meaning, ideas, format and values) in the new context.4Dewolf L, Koller M, Velikova G, Johnson CD, Scott N, Bottomley A. EORTC Quality of Life Group translation procedure. Bruxelas: EORTC Quality of Life Group; 2009.,5Corrêa MD, Panhoca L. Adaptação intercultural e validação do questionário para avaliação do desempenho ambiental corporativo. G & DR. 2010;6(1):222-30. In turn, validation assesses and measures specific (clinimetric) criteria, such as internal consistency (the capacity to measure a single concept using several items), reproducibility (the capacity to produce concordant results when the instrument is administered to a stable individual at different points in time, by the same observer –intraobserver reproducibility – or different observers – interobserver reproducibility) and validity, among others,3Maher CG, Latimer J, Costa LOP. A relevância da adaptação transcultural e clinimétrica para instrumentos de fisioterapia. Rev Bras Fisioter. 2007;11(4):245-52.,6Oliveira BG. Medida da qualidade de vida em portadores de marcapasso: tradução e validação de instrumento específico [tese]. Belo Horizonte: UFMG; 2003.,7Terwee CB, Bot SD, Boer MR, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. http://dx.doi.org/10.1016/j.jclinepi.2006.03.012. PMid:17161752.
http://dx.doi.org/10.1016/j.jclinepi.200...
which correlate with the scores of another instrument, considered the gold standard, or with other conceptual instruments in the absence of a gold standard.3Maher CG, Latimer J, Costa LOP. A relevância da adaptação transcultural e clinimétrica para instrumentos de fisioterapia. Rev Bras Fisioter. 2007;11(4):245-52.

Hand-in-hand with the technological advances related to chronic venous disease (CVD), the current tendency is to include investigation of QoL in clinical assessments, in order to capture the true reach and impact of these advances on patients' lives.6Oliveira BG. Medida da qualidade de vida em portadores de marcapasso: tradução e validação de instrumento específico [tese]. Belo Horizonte: UFMG; 2003. However, few studies have assessed the impact of CVD on QoL,8Santos RFFN, Porfírio GJM, Pitta GBB. A diferença na qualidade de vida de pacientes com doença venosa crônica leve e grave. J Vasc Bras. 2009;8(2):143-7. http://dx.doi.org/10.1590/S1677-54492009000200008.
http://dx.doi.org/10.1590/S1677-54492009...
,9van Korlaar I, Vossen C, Rosendaal F, Cameron L, Bovill E, Kaptein A. Quality of life in venous disease. Thromb Haemost. 2003;90(1):27-35. PMid:12876622. and it has been perceived that there is a growing need for promotion of this aspect in the lives of people who are affected8Santos RFFN, Porfírio GJM, Pitta GBB. A diferença na qualidade de vida de pacientes com doença venosa crônica leve e grave. J Vasc Bras. 2009;8(2):143-7. http://dx.doi.org/10.1590/S1677-54492009000200008.
http://dx.doi.org/10.1590/S1677-54492009...
and for in-depth analyses of the magnitude of this impact, since a more comprehensive view of this influence enables a better directed and more effective treatment approach.1010 Moura RMF, Gonçalves GS, Navarro TP, Britto RR, Dias RC. Correlação entre classificação clínica ceap e qualidade de vida na doença venosa crônica. Rev Bras Fisioter. 2010;14(2):99-105. http://dx.doi.org/10.1590/S1413-35552010005000007. PMid:20464164.
http://dx.doi.org/10.1590/S1413-35552010...

In general, instruments for assessment of QoL in CVD are written in English, as is the case of the CIVIQ (Chronic Venous Insufficiency Questionnaire), of the VEINES-QOL/Sym (Venous Insufficiency Epidemiological and Economic Study), of the AVVQ (Aberdeen Varicose Veins Questionnaire) and of the CCVUQ (Charing Cross Venous Ulcer Questionnaire).9van Korlaar I, Vossen C, Rosendaal F, Cameron L, Bovill E, Kaptein A. Quality of life in venous disease. Thromb Haemost. 2003;90(1):27-35. PMid:12876622.,1111 Leal JAR. Como avaliar o impacto da doença venosa crônica na qualidade de vida [tese]. Porto: Faculdade de Medicina, Universidade do Porto; 2010. The first two of these have already been validated for Brazil and they assess CVD as a whole, whereas the AVVQ observes people's perceptions of specific aspects of the disease and the CCVUQ is focused on venous ulcers, the most important complication of CVD.1212 Leal J, Mansilha A. Como avaliar o impacto da doença venosa crónica na qualidade de vida. Angiologia e Cirurgia Vascular. 2010;6(4):173-87.

The Aberdeen Varicose Veins Questionnaire (AVVQ) is a specific measure for assessment of QoL and severity of CVD that is sensitive to aspects inherent to the disease and focuses on signs and symptoms, evaluating dimensions that significantly compromise QoL.9van Korlaar I, Vossen C, Rosendaal F, Cameron L, Bovill E, Kaptein A. Quality of life in venous disease. Thromb Haemost. 2003;90(1):27-35. PMid:12876622. Its clinimetric properties have been shown to be good in its country of origin,1313 Smith JJ, Garratt AM, Guest M, Greenhalgh RM, Davies AH. Evaluating and improving health-related quality of life in patients with varicose veins. J Vasc Surg. 1999;30(4):710-9. http://dx.doi.org/10.1016/S0741-5214(99)70110-2. PMid:10514210.
http://dx.doi.org/10.1016/S0741-5214(99)...

14 Garratt AM, Macdonald LM, Ruta DA, Russell IT, Buckingham JK, Krukowski ZH. Towards measurement of outcome for patients with varicose veins. Qual Health Care. 1993;2(1):5-10. http://dx.doi.org/10.1136/qshc.2.1.5. PMid:10132081.
http://dx.doi.org/10.1136/qshc.2.1.5...
-1515 Garratt AM, Ruta DA, Abdalla MI, Russell IT. Responsiveness of the SF-36 and a condition-specific measure of health for patients with varicose veins. Qual Life Res. 1996;5(2):223-34. http://dx.doi.org/10.1007/BF00434744. PMid:8998491.
http://dx.doi.org/10.1007/BF00434744...
and it has been used in several different studies.1616 Figueiredo MAM, Filho AD, Cabral AL. Avaliação do efeito da meia elástica na hemodinâmica venosa dos membros inferiores de pacientes com insuficiência venosa crônica. J Vasc Bras. 2004;3(3):231-7.

No published or ongoing studies were identified in the literature that report on validation of the AVVQ for the Brazilian population.9van Korlaar I, Vossen C, Rosendaal F, Cameron L, Bovill E, Kaptein A. Quality of life in venous disease. Thromb Haemost. 2003;90(1):27-35. PMid:12876622.The nonexistence of a reliable and reproducible instrument validated for Brazil designed to assess QoL in CVD and which offers an overview of its details6Oliveira BG. Medida da qualidade de vida em portadores de marcapasso: tradução e validação de instrumento específico [tese]. Belo Horizonte: UFMG; 2003. is the motive for validating the AVVQ, in order to enable assessment of aspects affected by the disease and to make it possible to detect changes provoked by specific interventions, from the patients' perspective.

METHOD

This study was approved by the Research Ethics Committee at the Universidade Federal de São Paulo (UNIFESP), under protocol n.o 1108/10, and is an observational analytical study for validation of a questionnaire.

Participants were selected non-probabilistically at publicly-funded CVD treatment centers and a private center providing care and dressings, after direct approach by the researcher.

The sample size was based on internationally defined and recommended criteria for the processes of translation, cultural adaptation and validation of health-related questionnaires.5Corrêa MD, Panhoca L. Adaptação intercultural e validação do questionário para avaliação do desempenho ambiental corporativo. G & DR. 2010;6(1):222-30.,1717 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186-91. http://dx.doi.org/10.1097/00007632-200012150-00014. PMid:11124735.
http://dx.doi.org/10.1097/00007632-20001...

Recruitment of participants comprised two distinct stages: stage 1- Translation and Cultural Adaptation, for which 10 people were recruited, and stage 2- Validation, for which 107 people were recruited. The final data resulting from stage one have already been published in the Jornal Vascular Brasileiro, in an article entitled “Translation and cultural adaptation of Aberdeen Varicose Veins Questionnaire”,1818 Leal FJ, Couto RC, Pitta GBB, et al. Translation and cultural adaptation of Aberdeen Varicose Veins Questionnaire. J Vasc Bras. 2012;11(1):34-42. http://dx.doi.org/10.1590/S1677-54492012000100007.
http://dx.doi.org/10.1590/S1677-54492012...
and this article will only describe data relating to Validation of the AVVQ – stage 2.

For the Validation stage, participants of both sexes were recruited, with CVD confirmed by a vascular surgeon using the CEAP classification (clinical 1-6), by clinical examination of the lower limbs, considering the patient's class as that of the limb with the higher classification. Those classified as 4a (pigmentation or eczema) or 4b (lipodermatosclerosis or atrophy blanche) were grouped together under the heading Class 4. The CEAP system classifies clinical presentation of CVD and measures changes in its severity,1919 Kahn SR, M’lan CE, Lamping DL, Kurz X, Bérard A, Abenhaim LA. Relationship between clinical classification of chronic venous disease and patient-reported quality of life: results from an international cohort study. J Vasc Surg. 2004;39(4):823-8. http://dx.doi.org/10.1016/j.jvs.2003.12.007. PMid:15071450.
http://dx.doi.org/10.1016/j.jvs.2003.12....
,2020 Launois R, Mansilha A, Jantet G. International psychometric validation of the Chronic Venous Disease quality of life Questionnaire (CIVIQ-20). Eur J Vasc Endovasc Surg. 2010;40(6):783-9. http://dx.doi.org/10.1016/j.ejvs.2010.03.034. PMid:20920862.
http://dx.doi.org/10.1016/j.ejvs.2010.03...
as follows: C1- telangiectasias and/or reticular veins; C2- varicose veins; C3- edema; C4- hyperpigmentation and lipodermatosclerosis; C5- healed ulcer; C6- active ulcer.1010 Moura RMF, Gonçalves GS, Navarro TP, Britto RR, Dias RC. Correlação entre classificação clínica ceap e qualidade de vida na doença venosa crônica. Rev Bras Fisioter. 2010;14(2):99-105. http://dx.doi.org/10.1590/S1413-35552010005000007. PMid:20464164.
http://dx.doi.org/10.1590/S1413-35552010...
,2020 Launois R, Mansilha A, Jantet G. International psychometric validation of the Chronic Venous Disease quality of life Questionnaire (CIVIQ-20). Eur J Vasc Endovasc Surg. 2010;40(6):783-9. http://dx.doi.org/10.1016/j.ejvs.2010.03.034. PMid:20920862.
http://dx.doi.org/10.1016/j.ejvs.2010.03...
,2121 Porter JM, Moneta GL. Reporting standards in venous disease: an update. J Vasc Surg. 1995;21(4):635-45. http://dx.doi.org/10.1016/S0741-5214(95)70195-8. PMid:7707568.
http://dx.doi.org/10.1016/S0741-5214(95)...

Candidates were excluded if they were aged < 18 or ≥ 60 years; had cognitive disorders (Mini mental state examination); had associated conditions (arterial and lymphatic); were diabetic; had neuropathies; had erysipelas, lymphangitis, acute deep vein thrombosis or ulcers of a non-venous origin; had psychiatric disorders and/or dementia (physician diagnosed); could not speak or understand Portuguese, or if they exhibited factors that changed clinical stability during the period of investigation: taking antibiotic and/or phlebotropic medication; sclerotherapy of the lower limbs; surgical debridement and/or other surgical procedures; changes to dressing methods, such as adoption of an Unna boot, multi layered dressings or dressings with topical medications.

Patients who qualified according to the inclusion and exclusion criteria were invited to take part during first contact at the healthcare service and, after signature of a free and informed consent form, were interviewed.

The primary variable was validation of the AVVQ questionnaire by testing its clinimetric properties, and secondary variables were CEAP clinical classification and the domains of the AVVQ and of the SF-36. Complementary data investigated were age, sex, educational level and economic class. The statistical methods employed were Cronbach's Alpha (internal consistency), Intraclass Correlation Coefficient (ICC, reproducibility), Spearman's correlation coefficients and the Mann-Whitney test (validity) and the significance level was p< 0.05.

Validation method

Validation was conducted using three administration times (T1, T2 and T3) with 107 individuals with CVD who were invited to complete the questionnaires as follows:

1st Administration (T1) – data collection form, Mini Mental questionnaire, Brazilian Economic Classification Criteria, SF-36 questionnaire and Portuguese version of the AVVQ (AVVQ-Brazil), administered by observer 1.

2nd Administration (T2) – second administration of the Portuguese version of the AVVQ (AVVQ-Brazil), 30 minutes after the first, by observer 2.

3rd Administration (T3) – another administration of the Portuguese version of the AVVQ (AVVQ-Brazil), 7 to 15 days after the first, by observer 1. After this administration, patients were given instructions on CVD, prevention of exacerbation and exercises to do at home, in the form of a lecture and an educational pamphlet.

Responses were collected either by interview or by self-administration. For illiterate patients, the AVVQ-Brazil questionnaire was read out loud by the researcher, strictly adhering to the instructions prepared by the author of the original instrument and following a pre-established interview script, which was restricted to an exact reading of the instructions, of the questions and of the response options, with repetition of any of these elements when necessary, but without interference in the response process.

RESULTS

The sample comprised 165 patients with CVD. Ten of them only took part in the Translation and Cultural adaptation of the AVVQ, 107 of them only took part in the Validation of the AVVQ and 48 of them were excluded, because they did not complete the second or third administrations of the AVVQ-Brazil or did not meet the minimum cutoff on the Mini Mental State Examination.

Age varied from 18 to 82, with a mean age of 50.1 ± 14.7 years. The majority of respondents were female (87.9%); had spent long periods in an orthostatic position throughout their lives (57.0%); and did not engage in physical exercise (96.3%). Many had not completed primary education (25.2%); were members of economic class C2 (36.4%); and had disease severity class C6 (23.3%).

Excellent interobserver reproducibility and excellent to regular intraobserver reproducibility were observed for the domains of the AVVQ (Table 1).

Table 1
Intraclass Correlation Coefficients (ICC), 95% confidence intervals (95%CI) and p values for the AVVQ domains for the first administration (T1) against the second (T2), 30 minutes after the first, and for the first (T1) against the third (T3), 7 to 15 days after the first (n=107).

Internal consistency varied from excellent (α=0.767), through moderate (α=0.544/0.294) to weak (α=0.064) (Table 2).

Table 2
Cronbach's Alpha values for AVVQ domains (n=107).

Assessment of QoL in CVD showed that total AVVQ score and the domains Pain and Dysfunction of the AVVQ exhibited a negative correlation with all SF-36 domains. The domain Esthetic Appearance was negatively correlated with the SF-36 domains Pain, Vitality, Social Functioning and Mental Health. The domain Extent of Varicosities was only correlated with the SF-36 domain (Table 3).

Table 3
Correlations between SF-36 domains and AVVQ domains.

Analysis of CVD severity showed that there was a gradual increase in total score on the AVVQ as CEAP changed, with the exception of C4. There were statistically significant differences between different CEAP groups for total AVVQ score and the domain Complications (p<0.05), but there were no differences for other domains (Table 4).

Table 4
Mean scores for domains and total score of AVVQ by CEAP and means and standard deviations for total AVVQ score and domains Pain and Dysfunction, Esthetic Appearance, Extent of Varicosities and Complications by CEAP class (n=107).

DISCUSSION

It cannot be assumed that the properties revealed by the validation tests of the original version of an instrument will be applicable to adapted versions.3Maher CG, Latimer J, Costa LOP. A relevância da adaptação transcultural e clinimétrica para instrumentos de fisioterapia. Rev Bras Fisioter. 2007;11(4):245-52. Such an instrument, which would not be reproducible or valid for the target-population,3Maher CG, Latimer J, Costa LOP. A relevância da adaptação transcultural e clinimétrica para instrumentos de fisioterapia. Rev Bras Fisioter. 2007;11(4):245-52. will lack scientific recognition, indicating that the instrument is not precise and does not measure what it is intended to measure.2222 Paranhos ME, Argimon IIL, Werlang BSG. Propriedades psicométricas do Inventário de Depressão de Beck-II (BDI-II) em adolescentes. Anal Psicol. 2010;9(3):383-92. This study tested the reproducibility and validity of the AVVQ to enable its administration to the Brazilian population.

According to Meneses-Gaya et al.,2323 Meneses-Gaya IC, Zuardi AW, Loureiro SR, et al. As propriedades psicométricas do Teste de Fargerström para dependência de nicotina. J Bras Pneumol. 2009;35(1):73-82. http://dx.doi.org/10.1590/S1806-37132009000100011. PMid:19219334.
http://dx.doi.org/10.1590/S1806-37132009...
an appropriate interval of time between T1 and T2 is of fundamental importance in studies of reproducibility because if the interval is too short it will increase the influence of memory and if it is too long it allows time for individual changes in terms of what is being measured. In the present study a 30-minute interval was used to assess interobserver reproducibility and intervals of 7 to 15 days were used for intraobserver reproducibility, as recommended by Terwee et al.,7Terwee CB, Bot SD, Boer MR, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. http://dx.doi.org/10.1016/j.jclinepi.2006.03.012. PMid:17161752.
http://dx.doi.org/10.1016/j.jclinepi.200...
with the aim of ensuring the clinical stability of participants during the periods between administrations of the AVVQ.

Maher et al.3Maher CG, Latimer J, Costa LOP. A relevância da adaptação transcultural e clinimétrica para instrumentos de fisioterapia. Rev Bras Fisioter. 2007;11(4):245-52. state that tests of reproducibility verify the instrument on different occasions and with different examiners and that it is of fundamental importance that these administrations result in similar responses.2424 Leon V, Bosa C, Hugo C, et al. Propriedades psicométricas do Perfil Psicoeducacional Revisado: PEP-R. Anal Psicol. 2004;1(3):39-52. Following this guidance, two different observers were used (observers 1 and 2) and, after training, they administered the AVVQ at different points in time.

A study of seropositive people observed no significant differences between scores of QoL instruments administered in interviews and by self-administration.2525 Moura RMF, Gonçalves GS, Navarro TP, Britto RR, Dias RC. Adaptação transcultural do questionário VEINES/QOL-SYM: avaliação da qualidade de vida e sintomas na doença venosa crônica. J Vasc Bras. 2011;10(1):17-23. http://dx.doi.org/10.1590/S1677-54492011000100004.
http://dx.doi.org/10.1590/S1677-54492011...
The AVVQ is self-administrable according to Garrat et al.,1414 Garratt AM, Macdonald LM, Ruta DA, Russell IT, Buckingham JK, Krukowski ZH. Towards measurement of outcome for patients with varicose veins. Qual Health Care. 1993;2(1):5-10. http://dx.doi.org/10.1136/qshc.2.1.5. PMid:10132081.
http://dx.doi.org/10.1136/qshc.2.1.5...
but in view of the considerable illiteracy rates in the Brazilian population it was administered during interviews, after prior discussions with the author of the original, and was only self-administered by literate people.

There is no CVD-specific QoL questionnaire that has previously been validated for use in Brazil and so for the test of validity the AVVQ was compared with the SF-36, as was done by Soárez et al.2626 Soárez PC, Castelo A, Abrão P, Holmes WC, Ciconelli RM. Tradução e validação de um questionário de avaliação de qualidade de vida em AIDS no Brasil. Rev Panam Salud Publica. 2009;25(1):69-76. http://dx.doi.org/10.1590/S1020-49892009000100011. PMid:19341527.
http://dx.doi.org/10.1590/S1020-49892009...
when validating a QoL questionnaire in Brazil, and also by Garrat et al.,1414 Garratt AM, Macdonald LM, Ruta DA, Russell IT, Buckingham JK, Krukowski ZH. Towards measurement of outcome for patients with varicose veins. Qual Health Care. 1993;2(1):5-10. http://dx.doi.org/10.1136/qshc.2.1.5. PMid:10132081.
http://dx.doi.org/10.1136/qshc.2.1.5...
during the process of construction and validation of the original AVVQ.

Also as part of the tests of validity, the AVVQ, as a measure of CVD severity, was compared with the CEAP classification (clinical scale), which, according to Vasquez & Munschauer,2727 Vasquez MA, Munschauer CE. Venous Clinical Severity Score and quality-of-life assessment tools: application to vein practice. Phlebology. 2008;23(6):259-75. http://dx.doi.org/10.1258/phleb.2008.008018. PMid:19029007.
http://dx.doi.org/10.1258/phleb.2008.008...
consists of a description of information relating to diagnosis, indicating a reflection of the patients' perceptions of the severity of CVD.1919 Kahn SR, M’lan CE, Lamping DL, Kurz X, Bérard A, Abenhaim LA. Relationship between clinical classification of chronic venous disease and patient-reported quality of life: results from an international cohort study. J Vasc Surg. 2004;39(4):823-8. http://dx.doi.org/10.1016/j.jvs.2003.12.007. PMid:15071450.
http://dx.doi.org/10.1016/j.jvs.2003.12....

According to Hora et al.2828 Hora HRM, Monteiro GTR, Arica J. Confiabilidade em questionários para qualidade: um estudo com o coeficiente Alfa de Cronbach. Produto & Produção. 2010;11(2):85-103. in order to apply Cronbach's Alpha, the questionnaire must be made up of dimensions, must have been validated in at least one other language and must have been administered to a significant and heterogeneous sample. Cronbach's Alpha was therefore used to verify internal consistency, since they AVVQ is divided across four domains, has been validated in English and Dutch and was being administered to a significant and heterogeneous sample.

The results indicated excellent interobserver and intraobserver reproducibility, with a high degree of response agreement between different administrations, suggesting that the items are clear and reduce possible biases on the part of the observers, as demonstrated by Leon et al.2424 Leon V, Bosa C, Hugo C, et al. Propriedades psicométricas do Perfil Psicoeducacional Revisado: PEP-R. Anal Psicol. 2004;1(3):39-52. The lower intraobserver agreement for the domain Extent of Varicosities, at regular to good, was probably the result of random errors, such as the reactive effects of repeat administrations of the instrument, sensitizing patients and making them more aware of their condition, or of the effects of the time elapsed between administrations, during which time events that modified patients' clinical condition occurred, changing the questionnaire's scores, which facts were confirmed by Freitas2929 Freitas PJP. Adaptação transcultural e avaliação das propriedades psicométricas do Índice Auscan de osteoartrite na mão para o Brasil [tese]. Belo Horizonte: Universidade Federal de Minas Gerais; 2010. when validating an index for assessment of osteoarthritis.

The correlations between the AVVQ and the SF-36 indicate the validity of the total score of the AVVQ and its Pain and Dysfunction domain, with a significant negative relationship between these values and all SF-36 domains, considered of reasonable to good magnitude, and with their largest correlations with the SF-36 domains Functional Capacity (r=-0506, p<0.01), Role - Physical (r=-0.521; p<0.01) and Pain (r= -0.547; p<0.01), in common with results reported by Klem et al.3030 Klem TMAL, Sybrandy JEM, Wittens CHA, Bot MLE. Reliability and validity of the dutch translated Aberdeen Varicose Vein Questionnaire. Eur J Vasc Endovasc Surg. 2009;37(2):232-8. http://dx.doi.org/10.1016/j.ejvs.2008.08.025. PMid:18993090.
http://dx.doi.org/10.1016/j.ejvs.2008.08...
and confirmed by Garrat et al.1414 Garratt AM, Macdonald LM, Ruta DA, Russell IT, Buckingham JK, Krukowski ZH. Towards measurement of outcome for patients with varicose veins. Qual Health Care. 1993;2(1):5-10. http://dx.doi.org/10.1136/qshc.2.1.5. PMid:10132081.
http://dx.doi.org/10.1136/qshc.2.1.5...
in a study of the original version. These correlations suggest that the AVVQ captures the adverse effects of CVD in all SF-36 domains.

The domain Esthetic Appearance only had a significant correlation with the SF-36 domains Pain (r=-0.378; p<0.01); Vitality (r=-0.305; p<0.01); Social Functioning (r=-0.345; p<0.01), and Mental health (r=-0.307; p<0.01), in contrast with what was observed by Garrat et al.,1515 Garratt AM, Ruta DA, Abdalla MI, Russell IT. Responsiveness of the SF-36 and a condition-specific measure of health for patients with varicose veins. Qual Life Res. 1996;5(2):223-34. http://dx.doi.org/10.1007/BF00434744. PMid:8998491.
http://dx.doi.org/10.1007/BF00434744...
where the greatest correlation was with the Mental Health domain of the SF-36. According to Rosanova et al.,3131 Rosanova GCL, Gabriel BS, Camarini PMF, Gianini PES, Coelho DM, Oliveira AS. Validade concorrente da versão brasileira do SRS-22r com o BR-SF-36. Rev Bras Fisioter. 2010;14(2):121-6. http://dx.doi.org/10.1590/S1413-35552010005000012. PMid:20464160.
http://dx.doi.org/10.1590/S1413-35552010...
the absence or reduction of the correlation between this domain and other SF-36 domains may have occurred because the SF-36 is not a specific questionnaire for conditions that affect body esthetics, which is relevant in CVD-related QoL assessments.

The domain Extent of Varicosities only had a significant correlation with the SF-36 domain Pain (r=-0.246; p<0.05), in contrast with Garrat et al.1515 Garratt AM, Ruta DA, Abdalla MI, Russell IT. Responsiveness of the SF-36 and a condition-specific measure of health for patients with varicose veins. Qual Life Res. 1996;5(2):223-34. http://dx.doi.org/10.1007/BF00434744. PMid:8998491.
http://dx.doi.org/10.1007/BF00434744...
who reported the largest correlation with the SF-36 domain Role - Physical. This may have occurred because of the influence of factors such as age and educational level on the results, in view of the difficulty of understanding the questions in this domain. However, the domain Complications was correlated with almost all of the SF-36 domains, exhibiting its strongest correlation with the domain Functional Capacity (r=-0.423; p<0.01), the same as was reported by Garrat et al.1515 Garratt AM, Ruta DA, Abdalla MI, Russell IT. Responsiveness of the SF-36 and a condition-specific measure of health for patients with varicose veins. Qual Life Res. 1996;5(2):223-34. http://dx.doi.org/10.1007/BF00434744. PMid:8998491.
http://dx.doi.org/10.1007/BF00434744...

The correlations between the AVVQ and CEAP classes (clinical scale) revealed individual increases in the total score of the AVVQ as CEAP class increased, demonstrating measurement of the severity of CVD, and declining QoL, with exacerbation of the disease, and the capacity to discriminate between individuals, with the exception of C4. This possibly occurred because the participants were not classified separately by C4 subcategory (C4a and C4b), in order to reproduce the procedure used in validation of the original, and also because of the static nature of the CEAP in classes C4 and C5, interfering with assessment and complicating follow-up over time, as stated by Vasquez & Munschauer.2727 Vasquez MA, Munschauer CE. Venous Clinical Severity Score and quality-of-life assessment tools: application to vein practice. Phlebology. 2008;23(6):259-75. http://dx.doi.org/10.1258/phleb.2008.008018. PMid:19029007.
http://dx.doi.org/10.1258/phleb.2008.008...
Dezotti et al.3232 Dezotti NRA, Joviliano EE, Moriya T, Piccinato CE. Correlation between the hemodynamic gain obtained after operation of primary varicose veins and chronic venous disease classification. Acta Cir Bras. 2011;26(Supl 2):115-9. http://dx.doi.org/10.1590/S0102-86502011000800021. PMid:22030826.
http://dx.doi.org/10.1590/S0102-86502011...
consider class C4 individuals to have intermediate skin lesions and this class denotes a transition phase from absence to presence of skin changes, which may have interfered with discrimination of the QoL of these patients.

Scores in the Complications domain were highest for classes C5 and C6, indicating lower QoL among individuals most affected clinically, in common with data reported by Moura et al.1010 Moura RMF, Gonçalves GS, Navarro TP, Britto RR, Dias RC. Correlação entre classificação clínica ceap e qualidade de vida na doença venosa crônica. Rev Bras Fisioter. 2010;14(2):99-105. http://dx.doi.org/10.1590/S1413-35552010005000007. PMid:20464164.
http://dx.doi.org/10.1590/S1413-35552010...
who compared the SF-36 with the CEAP classification.

The total AVVQ score exhibited internal consistency with a lower result (α=0.544) than those reported in the validation studies for the English (α= 0.76) and Dutch (α=0.72) versions,1414 Garratt AM, Macdonald LM, Ruta DA, Russell IT, Buckingham JK, Krukowski ZH. Towards measurement of outcome for patients with varicose veins. Qual Health Care. 1993;2(1):5-10. http://dx.doi.org/10.1136/qshc.2.1.5. PMid:10132081.
http://dx.doi.org/10.1136/qshc.2.1.5...
,3030 Klem TMAL, Sybrandy JEM, Wittens CHA, Bot MLE. Reliability and validity of the dutch translated Aberdeen Varicose Vein Questionnaire. Eur J Vasc Endovasc Surg. 2009;37(2):232-8. http://dx.doi.org/10.1016/j.ejvs.2008.08.025. PMid:18993090.
http://dx.doi.org/10.1016/j.ejvs.2008.08...
but nonetheless indicating that the Brazilian AVVQ has moderate internal consistency, is reliable and has uniform items. It should be pointed out that the samples assessed in those studies were much larger, increasing the likelihood of a higher Cronbach's Alpha score, as was also observed by Gasparin et al.,3333 Gasparin M, Menegotto IH, Cunha CS. Propriedades psicométricas do questionário internacional - aparelho de amplificação sonora individual. Braz J Otorhinolaryngol. 2010;76(1):85-90. http://dx.doi.org/10.1590/S1808-86942010000100014. PMid:20339694.
http://dx.doi.org/10.1590/S1808-86942010...
in a study validating a different international questionnaire.

The results for the domains of the AVVQ indicated excellent internal consistency for the domains Pain and Dysfunction, and Esthetic Appearance, moderate for Complications and weak for Extent of Varicosities, all with Cronbach's Alpha values greater than 0.2; indicating that is not necessary to remove any domains or items, according to Garrat et al.,1414 Garratt AM, Macdonald LM, Ruta DA, Russell IT, Buckingham JK, Krukowski ZH. Towards measurement of outcome for patients with varicose veins. Qual Health Care. 1993;2(1):5-10. http://dx.doi.org/10.1136/qshc.2.1.5. PMid:10132081.
http://dx.doi.org/10.1136/qshc.2.1.5...
since the Cronbach's Alpha values recommended in the literature by several different authors serve as a guide and not as a definitive criterion for classification.3434 Maroco J, Garcia-Marques T. Qual a fiabilidade do alfa de Cronbach? Questões antigas e soluções modernas? Lab Psicol. 2006;4(1):65-90.

Some authors state that the negative impact of CVD on QoL is primarily related to the domains Pain, Physical Function and Mobility.1010 Moura RMF, Gonçalves GS, Navarro TP, Britto RR, Dias RC. Correlação entre classificação clínica ceap e qualidade de vida na doença venosa crônica. Rev Bras Fisioter. 2010;14(2):99-105. http://dx.doi.org/10.1590/S1413-35552010005000007. PMid:20464164.
http://dx.doi.org/10.1590/S1413-35552010...
In agreement with this, it was observed that all patients exhibited compromised general and specific QoL, with the greatest correlations between the AVVQ and the SF-36 occurring in the SF-36 domains Pain, Role - Physical and Functional Capacity, confirming what was reported by Garrat et al.,1414 Garratt AM, Macdonald LM, Ruta DA, Russell IT, Buckingham JK, Krukowski ZH. Towards measurement of outcome for patients with varicose veins. Qual Health Care. 1993;2(1):5-10. http://dx.doi.org/10.1136/qshc.2.1.5. PMid:10132081.
http://dx.doi.org/10.1136/qshc.2.1.5...
during construction of the AVVQ, and by Klem et al.3030 Klem TMAL, Sybrandy JEM, Wittens CHA, Bot MLE. Reliability and validity of the dutch translated Aberdeen Varicose Vein Questionnaire. Eur J Vasc Endovasc Surg. 2009;37(2):232-8. http://dx.doi.org/10.1016/j.ejvs.2008.08.025. PMid:18993090.
http://dx.doi.org/10.1016/j.ejvs.2008.08...
in a later study of the clinimetric properties of their Dutch version. This provides strong evidence of its validity as a measure of QoL.

Implications for research and for clinical practice

The design of this study followed the guidelines proposed in the "magic sextet", in terms of correct planning, execution and publication of research.3535 Pitta GBB, Roque FP, Pitta MR. O sexteto mágico da pesquisa clínica. Rev Bras Cir Cardiovasc. 2009;24(2):113-5. http://dx.doi.org/10.1590/S0102-76382009000200004. PMid:19768287.
http://dx.doi.org/10.1590/S0102-76382009...
It has indicated certain avenues for further investigations in presenting a valid and trustworthy scale for use in vascular research and the AVVQ-Brazil (AVVQ-Br) should contribute to use of data expressed as a reference in future research to review the clinimetric properties of the AVVQ and to elucidate the correlations between QoL and C4 severity of CVD, in view of its relevance to researchers in the area and to society in general.

The AVVQ-Br offers diagnostic support to assessments of CVD by providing measurable data on patients, identifying problems, facilitating therapeutic intervention and enabling new strategies for investigation of the disease. It will be possible to use it as a reference to record changes in the QoL of people with CVD, using it in the future as part of the assessment of CVD, raising QoL to the level of the essential principle for healthcare systems.

CONCLUSIONS

The AVVQ questionnaire is now validated for Brazil as a measure for assessment of QoL and the severity of CVD.

  • Financial support: None.
  • The study was carried out at public clinics treating chronic venous disease in Alagoas and at the CICATRIZA clinic in Campina Grande, PB, Brazil.

REFERÊNCIAS

  • 1
    Sardinha A, Levitan MN, Lopes FL, et al. Tradução e adaptação transcultural do questionário de atividade física habitual. Rev Psiq Clín. 2010;37(1):16-22. http://dx.doi.org/10.1590/S0101-60832010000100004.
    » http://dx.doi.org/10.1590/S0101-60832010000100004
  • 2
    Lopes AD, Stadniky SP, Masiero D, Carrera EF, Ciconelli RM, Griffin S. Tradução e adaptação cultural do WORC: um questionário de qualidade de vida para alterações do manguito rotador. Rev Bras Fisioter. 2006;10(3):309-15. http://dx.doi.org/10.1590/S1413-35552006000300010.
    » http://dx.doi.org/10.1590/S1413-35552006000300010
  • 3
    Maher CG, Latimer J, Costa LOP. A relevância da adaptação transcultural e clinimétrica para instrumentos de fisioterapia. Rev Bras Fisioter. 2007;11(4):245-52.
  • 4
    Dewolf L, Koller M, Velikova G, Johnson CD, Scott N, Bottomley A. EORTC Quality of Life Group translation procedure. Bruxelas: EORTC Quality of Life Group; 2009.
  • 5
    Corrêa MD, Panhoca L. Adaptação intercultural e validação do questionário para avaliação do desempenho ambiental corporativo. G & DR. 2010;6(1):222-30.
  • 6
    Oliveira BG. Medida da qualidade de vida em portadores de marcapasso: tradução e validação de instrumento específico [tese]. Belo Horizonte: UFMG; 2003.
  • 7
    Terwee CB, Bot SD, Boer MR, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. http://dx.doi.org/10.1016/j.jclinepi.2006.03.012. PMid:17161752.
    » http://dx.doi.org/10.1016/j.jclinepi.2006.03.012
  • 8
    Santos RFFN, Porfírio GJM, Pitta GBB. A diferença na qualidade de vida de pacientes com doença venosa crônica leve e grave. J Vasc Bras. 2009;8(2):143-7. http://dx.doi.org/10.1590/S1677-54492009000200008.
    » http://dx.doi.org/10.1590/S1677-54492009000200008
  • 9
    van Korlaar I, Vossen C, Rosendaal F, Cameron L, Bovill E, Kaptein A. Quality of life in venous disease. Thromb Haemost. 2003;90(1):27-35. PMid:12876622.
  • 10
    Moura RMF, Gonçalves GS, Navarro TP, Britto RR, Dias RC. Correlação entre classificação clínica ceap e qualidade de vida na doença venosa crônica. Rev Bras Fisioter. 2010;14(2):99-105. http://dx.doi.org/10.1590/S1413-35552010005000007. PMid:20464164.
    » http://dx.doi.org/10.1590/S1413-35552010005000007
  • 11
    Leal JAR. Como avaliar o impacto da doença venosa crônica na qualidade de vida [tese]. Porto: Faculdade de Medicina, Universidade do Porto; 2010.
  • 12
    Leal J, Mansilha A. Como avaliar o impacto da doença venosa crónica na qualidade de vida. Angiologia e Cirurgia Vascular. 2010;6(4):173-87.
  • 13
    Smith JJ, Garratt AM, Guest M, Greenhalgh RM, Davies AH. Evaluating and improving health-related quality of life in patients with varicose veins. J Vasc Surg. 1999;30(4):710-9. http://dx.doi.org/10.1016/S0741-5214(99)70110-2. PMid:10514210.
    » http://dx.doi.org/10.1016/S0741-5214(99)70110-2
  • 14
    Garratt AM, Macdonald LM, Ruta DA, Russell IT, Buckingham JK, Krukowski ZH. Towards measurement of outcome for patients with varicose veins. Qual Health Care. 1993;2(1):5-10. http://dx.doi.org/10.1136/qshc.2.1.5. PMid:10132081.
    » http://dx.doi.org/10.1136/qshc.2.1.5
  • 15
    Garratt AM, Ruta DA, Abdalla MI, Russell IT. Responsiveness of the SF-36 and a condition-specific measure of health for patients with varicose veins. Qual Life Res. 1996;5(2):223-34. http://dx.doi.org/10.1007/BF00434744. PMid:8998491.
    » http://dx.doi.org/10.1007/BF00434744
  • 16
    Figueiredo MAM, Filho AD, Cabral AL. Avaliação do efeito da meia elástica na hemodinâmica venosa dos membros inferiores de pacientes com insuficiência venosa crônica. J Vasc Bras. 2004;3(3):231-7.
  • 17
    Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186-91. http://dx.doi.org/10.1097/00007632-200012150-00014. PMid:11124735.
    » http://dx.doi.org/10.1097/00007632-200012150-00014
  • 18
    Leal FJ, Couto RC, Pitta GBB, et al. Translation and cultural adaptation of Aberdeen Varicose Veins Questionnaire. J Vasc Bras. 2012;11(1):34-42. http://dx.doi.org/10.1590/S1677-54492012000100007.
    » http://dx.doi.org/10.1590/S1677-54492012000100007
  • 19
    Kahn SR, M’lan CE, Lamping DL, Kurz X, Bérard A, Abenhaim LA. Relationship between clinical classification of chronic venous disease and patient-reported quality of life: results from an international cohort study. J Vasc Surg. 2004;39(4):823-8. http://dx.doi.org/10.1016/j.jvs.2003.12.007. PMid:15071450.
    » http://dx.doi.org/10.1016/j.jvs.2003.12.007
  • 20
    Launois R, Mansilha A, Jantet G. International psychometric validation of the Chronic Venous Disease quality of life Questionnaire (CIVIQ-20). Eur J Vasc Endovasc Surg. 2010;40(6):783-9. http://dx.doi.org/10.1016/j.ejvs.2010.03.034. PMid:20920862.
    » http://dx.doi.org/10.1016/j.ejvs.2010.03.034
  • 21
    Porter JM, Moneta GL. Reporting standards in venous disease: an update. J Vasc Surg. 1995;21(4):635-45. http://dx.doi.org/10.1016/S0741-5214(95)70195-8. PMid:7707568.
    » http://dx.doi.org/10.1016/S0741-5214(95)70195-8
  • 22
    Paranhos ME, Argimon IIL, Werlang BSG. Propriedades psicométricas do Inventário de Depressão de Beck-II (BDI-II) em adolescentes. Anal Psicol. 2010;9(3):383-92.
  • 23
    Meneses-Gaya IC, Zuardi AW, Loureiro SR, et al. As propriedades psicométricas do Teste de Fargerström para dependência de nicotina. J Bras Pneumol. 2009;35(1):73-82. http://dx.doi.org/10.1590/S1806-37132009000100011. PMid:19219334.
    » http://dx.doi.org/10.1590/S1806-37132009000100011
  • 24
    Leon V, Bosa C, Hugo C, et al. Propriedades psicométricas do Perfil Psicoeducacional Revisado: PEP-R. Anal Psicol. 2004;1(3):39-52.
  • 25
    Moura RMF, Gonçalves GS, Navarro TP, Britto RR, Dias RC. Adaptação transcultural do questionário VEINES/QOL-SYM: avaliação da qualidade de vida e sintomas na doença venosa crônica. J Vasc Bras. 2011;10(1):17-23. http://dx.doi.org/10.1590/S1677-54492011000100004.
    » http://dx.doi.org/10.1590/S1677-54492011000100004
  • 26
    Soárez PC, Castelo A, Abrão P, Holmes WC, Ciconelli RM. Tradução e validação de um questionário de avaliação de qualidade de vida em AIDS no Brasil. Rev Panam Salud Publica. 2009;25(1):69-76. http://dx.doi.org/10.1590/S1020-49892009000100011. PMid:19341527.
    » http://dx.doi.org/10.1590/S1020-49892009000100011
  • 27
    Vasquez MA, Munschauer CE. Venous Clinical Severity Score and quality-of-life assessment tools: application to vein practice. Phlebology. 2008;23(6):259-75. http://dx.doi.org/10.1258/phleb.2008.008018. PMid:19029007.
    » http://dx.doi.org/10.1258/phleb.2008.008018
  • 28
    Hora HRM, Monteiro GTR, Arica J. Confiabilidade em questionários para qualidade: um estudo com o coeficiente Alfa de Cronbach. Produto & Produção. 2010;11(2):85-103.
  • 29
    Freitas PJP. Adaptação transcultural e avaliação das propriedades psicométricas do Índice Auscan de osteoartrite na mão para o Brasil [tese]. Belo Horizonte: Universidade Federal de Minas Gerais; 2010.
  • 30
    Klem TMAL, Sybrandy JEM, Wittens CHA, Bot MLE. Reliability and validity of the dutch translated Aberdeen Varicose Vein Questionnaire. Eur J Vasc Endovasc Surg. 2009;37(2):232-8. http://dx.doi.org/10.1016/j.ejvs.2008.08.025. PMid:18993090.
    » http://dx.doi.org/10.1016/j.ejvs.2008.08.025
  • 31
    Rosanova GCL, Gabriel BS, Camarini PMF, Gianini PES, Coelho DM, Oliveira AS. Validade concorrente da versão brasileira do SRS-22r com o BR-SF-36. Rev Bras Fisioter. 2010;14(2):121-6. http://dx.doi.org/10.1590/S1413-35552010005000012. PMid:20464160.
    » http://dx.doi.org/10.1590/S1413-35552010005000012
  • 32
    Dezotti NRA, Joviliano EE, Moriya T, Piccinato CE. Correlation between the hemodynamic gain obtained after operation of primary varicose veins and chronic venous disease classification. Acta Cir Bras. 2011;26(Supl 2):115-9. http://dx.doi.org/10.1590/S0102-86502011000800021. PMid:22030826.
    » http://dx.doi.org/10.1590/S0102-86502011000800021
  • 33
    Gasparin M, Menegotto IH, Cunha CS. Propriedades psicométricas do questionário internacional - aparelho de amplificação sonora individual. Braz J Otorhinolaryngol. 2010;76(1):85-90. http://dx.doi.org/10.1590/S1808-86942010000100014. PMid:20339694.
    » http://dx.doi.org/10.1590/S1808-86942010000100014
  • 34
    Maroco J, Garcia-Marques T. Qual a fiabilidade do alfa de Cronbach? Questões antigas e soluções modernas? Lab Psicol. 2006;4(1):65-90.
  • 35
    Pitta GBB, Roque FP, Pitta MR. O sexteto mágico da pesquisa clínica. Rev Bras Cir Cardiovasc. 2009;24(2):113-5. http://dx.doi.org/10.1590/S0102-76382009000200004. PMid:19768287.
    » http://dx.doi.org/10.1590/S0102-76382009000200004

Publication Dates

  • Publication in this collection
    Jul-Sep 2015

History

  • Received
    07 May 2015
  • Accepted
    22 June 2015
Sociedade Brasileira de Angiologia e de Cirurgia Vascular (SBACV) Rua Estela, 515, bloco E, conj. 21, Vila Mariana, CEP04011-002 - São Paulo, SP, Tel.: (11) 5084.3482 / 5084.2853 - Porto Alegre - RS - Brazil
E-mail: secretaria@sbacv.org.br