Acessibilidade / Reportar erro

Translation, cross-cultural adaptation and validation of the EPOCH-RRT questionnaire “Empowering Patients On Choices For Renal Replacement Therapy” for the Brazilian context

Abstract

Introduction:

Chronic kidney disease (CKD) is a global public health problem. In Brazil, the incidence and prevalence rates of dialysis CKD progressively increase, but the transition process is a challenge for patients and caregivers in coping with the disease. Dialysis urgency, lack of planned access or prior knowledge of treatment is a reality for most. Guidelines recommend that treatment options should include the conscious preference of a fully informed patient. However, pre-dialysis educational information is an exception, leading to a large number of unplanned initial dialysis. The original study “Empowering Patients on Choices for Renal Replacement Therapy” (EPOCH-RRT) aimed to identify patient priorities and gaps in shared decision-making about dialysis, using structured interviews with questions about demographics, clinical history and patients' perception of their health. The goal of this study was to carry out the translation, cross-cultural adaptation and validation of the questionnaires used in the EPOCH-RRT Study for the Brazilian context.

Method:

This is a methodological study that consisted of the initial translation, synthesis of the translations, back translation, review by a committee of experts, pre-test and evaluation of the psychometric properties of the instrument. All ethical precepts were followed.

Results:

The questionnaires were translated, adapted and validated for the Brazilian context. Additionally, it was applied to 84 chronic renal patients on hemodialysis, peritoneal dialysis and outpatients.

Discussion:

There is a lack of an educational-therapeutic approach aimed at patients with CKD, and the EPOCH-RRT questionnaire can be a tool for Brazilian dialysis services to change this paradigm.

Keywords:
Surveys and Questionnaires; Translations; Validation Study; Nephrology; Renal Replacement Therapy; Hemodialysis Units; Hospital

Resumo

Introdução:

A doença renal crônica (DRC) é um problema de saúde pública mundial. No Brasil, as taxas de incidência e prevalência da DRC dialítica aumentam progressivamente, mas o processo de transição apresenta-se como desafio para pacientes e cuidadores no enfrentamento da doença. Urgência dialítica, ausência de acesso planejado ou conhecimento prévio do tratamento é uma realidade para a maioria. Diretrizes recomendam que opções de tratamento devam incluir a preferência consciente de um paciente totalmente informado. No entanto, informação educacional pré-diálise é exceção, acarretando grande número de diálises iniciais não planejadas. O estudo original “Empowering Patients on Choices for Renal Replacement Therapy” (EPOCH-RRT) teve por objetivo identificar as prioridades do paciente e as lacunas na tomada de decisões compartilhadas sobre a diálise, utilizando entrevistas estruturadas, com questões sobre dados demográficos, história clínica e percepção dos pacientes sobre sua saúde. O objetivo desta pesquisa foi realizar a tradução, adaptação transcultural e validação dos questionários utilizados no Estudo EPOCH-RRT para o contexto brasileiro.

Método:

Trata-se de estudo metodológico que consistiu na tradução inicial, síntese das traduções, retro tradução, revisão por um comitê de especialistas, pré-teste e avaliação das propriedades psicométricas do instrumento. Todos os preceitos éticos foram seguidos.

Resultados:

Os questionários foram traduzidos, adaptados e validados para o contexto brasileiro. Adicionalmente, foi aplicado em 84 pacientes renais crônicos em hemodiálise, diálise peritoneal e ambulatoriais.

Discussão:

Há carência de enfoque educativo-terapêutico dirigido aos pacientes com DRC, e o questionário EPOCH-RRT pode ser uma ferramenta para serviços de diálise brasileiros mudarem esse paradigma.

Descritores:
Inquéritos e Questionários; Traduções; Estudo de Validação; Negrologia; Terapia de Substituição Renal; Unidades Hospitalares de Hemodiálise

Introduction

Chronic kidney disease (CKD) is a worrying public health problem worldwide that affects 10% to 15% of the adult population11 Hu JR, Coresh J. The public health dimension of chronic kidney disease: what we have learnt over the past decade. Nephrol Dial Transplant. 2017 Apr 1;32(suppl_2):ii113-ii120. doi: 10.1093/ndt/gfw416. PMID: 28206632.
https://doi.org/10.1093/ndt/gfw416...
. In the United States, between 1988 and 2002, the prevalence of reduced filtration rate (< 60 mL/min/ 1.73 m2 or stages 3 to 5) increased from 4.7% to 6.5%. From 2003 to 2012, the prevalence stabilized at 6.4 to 6.922 Hill NR, Fatoba ST, Oke JL, Hirst JA, O’Callaghan CA, Lasserson DS, et al. Global prevalence of chronic kidney disease: a systematic review and meta-analysis. PLoS One [Internet]. 2016;11(7):e0158765. Available from: https://dx.plos.org/10.1371/journal.pone.0158765.
https://dx.plos.org/10.1371/journal.pone...
.

In Brazil, according to the Brazilian Dialysis Census of the Brazilian Society of Nephrology, in the period of 2009-2018 there was a progressive increase in the number of prevalent patients in a chronic dialysis program, with an average annual increase of 5,58733 Sociedade Brasileira de Nefrologia. Censo Brasileiro de Diálise Crônica 2018 [Internet]. 2018 [cited 2019 Apr 20]. Available from: http://www.censo-sbn.org.br/censosAnteriores.
http://www.censo-sbn.org.br/censosAnteri...
. The 2020 census shows consistency in the increase in the number of dialyzed patients to 144,779, representing 44,264,000 new patients that year44 Sociedade Brasileira de Nefrologia. Censo de Diálise SBN 2020 [Internet]. 2020 [cited 2021 Jun 8]. Available from: https://www.censo-sbn.org.br/
https://www.censo-sbn.org.br/...
.

At stage 5, the patient is indicated to a program or to start renal replacement therapy (RRT), and this process of transition from CKD to end-stage renal disease presents itself as a significant challenge for patients and caregivers in coping with the disease and its unpredictable consequences55 Amedia CA, Perazella MA. Transition of patients from chronic kidney disease to end-stage renal disease: better practices for better outcomes. Dis Manag. 2006;9(6):311-5..

Although RRT enables us to prolong life, it triggers unexpected and conflicting situations, compromising daily life and quality of life of the patient, their families and caregivers, imposing adaptations and changes to their lifestyles, so it is necessary to share this confrontation with the family or with other people to seek help.

Changes in patients’ lives are uncomfortable and continuous. They may feel different, excluded or stigmatized by dietary and water restrictions; having vascular access; needing multiple medications; and undergoing dialysis, determining a high prevalence of psychological disorders and a perception of a definitive and negative impact on their lives.

However, family structures are not always able to support these situations. They need the support of healthcare professionals, able to meet the emotional demands of these individuals, as well as support and collaborate with other people in the community66 Silva LF, Guedes MVC, Moreira RP, Souza ACC. Doença crônica: o enfrentamento pela família. Acta Paul Enferm. 2002;15(1):40-7.. A study with specialist nurses in Nephrology from Sweden showed that emotional support to the patient during the transition to dialysis may be lacking, so education, local and national, is necessary for nurses to be able to provide this emotional support77 Sturesson A, Ziegert K. Prepare the patient for future challenges when facing hemodialysis: nurses’ experiences. Int J Qual Stud Health Well-being. 2014;9(1):1-14..

We understand the importance of socio-educational activities for these patients so that they have greater knowledge about their CKD, acquire security and greater subsidies for self-care and, in addition to better adhere to treatment, indispensable for improving the quantity and quality of life88 Roberti J, Cummings A, Myall M, Harvey J, Lippiett K, Hunt K, et al. Work of being an adult patient with chronic kidney disease: A systematic review of qualitative studies. BMJ Open. 2018;8(9):1-29..

In Brazil, most individuals initiate RRT under urgent or emergency dialysis basis, without planned access and without information. The study by Peixoto et al., in Belo Horizonte, showed that 70% of patients started dialysis in an unplanned way99 Peixoto ERM, Reis IA, Machado EL, Andrade EIG, Acurcio FA, Cherchiglia ML. Diálise planejada e a utilização regular da atenção primária à saúde entre os pacientes diabéticos do Município de Belo Horizonte, Minas Gerais, Brasil. Cad Saúde Pública. 2013;29(6):1241-50..

A systematic review of qualitative studies pointed out that studies and Guidelines from different continents recommend that the choice between treatment options for CKD should respect the conscious preference of a fully informed patient1010 Morton RL, Tong A, Howard K, Snelling P, Webster AC. The views of patients and carers in treatment decision making for chronic kidney disease: systematic review and thematic synthesis of qualitative studies. BMJ. 2010;340(7742):350..

We believe that encouraging patients to take a more active role in their own healthcare may increase the time to start dialysis; provide fewer hospitalizations; improve the quality of life and the efficiency of treatment, as well as its results; with lower costs to the healthcare system1111 Mundy PD. Effectiveness of strategies for informing, educating, and involving patients. BMJ. 2007;335(19):24-7.,1212 Devins G, Mendelssohn D, Barré P, Binik Y. Predialysis psychoeducational intervention and coping styles influence time to dialysis in chronic kidney disease. Am J Kidney Dis [Internet]. 2003; [cited 2016 Feb 2]; 42(4):693-703. Available from: http://onlinelibrary.wiley.com/o/cochrane/clcentral/articles/022/CN-00458022/frame.html.
http://onlinelibrary.wiley.com/o/cochran...
.

However, only a minority of CKD patients receive pre-dialysis education and initiate RRT on a planned basis. An international integrative review study showed that between 24% and 49% of patients start dialysis unplanned, without access to minimal knowledge1313 Mendelssohn DC, Malmberg C, Hamandi B. An integrated review of “unplanned” dialysis initiation: Reframing the terminology to “suboptimal” initiation. BMC Nephrol. 2009;10(1):1-8..

Knowledge about the factors associated with the decision to choose the treatment modality for CKD can provide evidence to the multidisciplinary team involved, to improve the way of educating patients and their families, favoring adequate communication, patient and family/caregiver involvement in shared decision making1414 Combes G, Sein K, Allen K. How does pre-dialysis education need to change? Findings from a qualitative study with staff and patients. BMC Nephrol. 2017;18(1):1-11..

In the Empowering Patients on Choices for Renal Replacement Therapy (EPOCH-RRT) study1515 Dahlerus C, Quinn M, Messersmith E, Lachance L, Subramanian L, Perry E, et al. Patient perspectives on the choice of dialysis modality: results from the Empowering Patients on Choices for Renal Replacement Therapy (EPOCH-RRT) Study. Am J Kidney Dis [Internet]. 2016;68(6):901-10. Available from: http://dx.doi.org/10.1053/j.ajkd.2016.05.010.
http://dx.doi.org/10.1053/j.ajkd.2016.05...
, with the aim of identifying patient priorities and gaps in shared decision-making, three different interview protocols for non-dialysis CKD (CKD-ND) were developed for HD and PD patients. The protocols used a mixed methods approach, with open and closed questions. The protocols were tested in interviews with 179 patients with stage 5 CKD in the beginning1616 Subramanian L, Quinn M, Zhao J, Lachance L, Zee J, Tentori F. Coping with kidney disease - qualitative findings from the Empowering Patients on Choices for Renal Replacement Therapy (EPOCH-RRT) study. BMC Nephrol. 2017;18(1):119..

Afterwards, a retrospective quantitative study was carried out to evaluate the decision-making process of the dialysis modality and the impact on the daily lives of 1963 people undergoing HD or PD. Based on the interviews and the study, the DA (“Decision Aid”) was developed and then its effectiveness was measured with pre- and post-evaluation.

The multidimensional instrument developed subsequently proved to be effective in increasing knowledge and reducing decision-making conflicts1717 Subramanian L, Zhao J, Zee J, Knaus M, Fagerlin A, Perry E, et al. Use of a decision aid for patients considering peritoneal dialysis and in-center hemodialysis: a randomized controlled trial. Am J Kidney Dis [Internet]. 2019;74(3):351-60. Available from: https://doi.org/10.1053/j.ajkd.2019.01.030.
https://doi.org/10.1053/j.ajkd.2019.01.0...
.

The lack of an educational-therapeutic approach, built with the participation of interested parties, is also observed in Brazilian dialysis services, added to the fact that there are still few studies on the subject, led us to carry out this research1818 Queiroz MVO, Dantas MCQ, Ramos IC, Jorge MSB. Tecnologia do cuidado ao paciente renal crônico: enfoque educativo-terapêutico a partir das necessidades dos sujeitos. Texto Context Enferm. 2008;17(1):55-63., to translate the protocols used in the EPOCH-RRT Study and verify if the results are reproduced in a Brazilian study.

The objectives of the present study were to translate, cross-culturally adapt and validate the interview protocols “Interview Protocol for Hemodialysis Patients”, “Interview Protocol for Peritoneal Dialysis Patients” and “Interview Protocol for Chronic Kidney Disease Patients Not on Dialysis” used in the study “Empowering Patients on Choices for Renal Replacement Therapy (EPOCH - RRT)” for the Brazilian context.

Methods

This is a methodological study of translation, cross-cultural adaptation and validation for the Portuguese-speaking population of Brazil1616 Subramanian L, Quinn M, Zhao J, Lachance L, Zee J, Tentori F. Coping with kidney disease - qualitative findings from the Empowering Patients on Choices for Renal Replacement Therapy (EPOCH-RRT) study. BMC Nephrol. 2017;18(1):119..

Figure 1 depicts the synthesis of the methodological steps followed.

Figure 1
Methodology.

So far, there is no similar protocol in our language and the current trend proposes the use of validated instruments as opposed to the development of new scales, allowing further comparisons between different countries, in a safe and reliable way.

The protocols included questions for sociodemographic characterization, clinical history and patients’ perception of their health. Permission was obtained from PCORI - Patient-Centered Outcomes Research Institute and lead author Francesca Tentori, MD., PhD.

The process of cross-cultural adaptation of an instrument consists of 2 basic components: literal translation of words and sentences from one language to another and adaptation to the cultural context of the population in the target culture1919 Dortas Junior SD, Lupi O, Dias GAC, Guimarães MBS, Valle SOR. Adaptação transcultural e validação de questionários na área da saúde. Braz J Allergy Immunol [BJAI]. 2016;4(1):26-30.. It usually comprises six types of equivalences: conceptual, of items, semantics, operational, measurement and functional2020 Herdman M, Rushby F, Badia X. A model of equivalence in the cultural adaptation of HRQol Instruments: the universalist approach. Qual Life Res. 1998;7:323-35..

Initial Translation

Two translations of the instrument were made from the original language (English) to the target language (Brazilian Portuguese). The two translations were performed independently by a nephrologist professor fluent in the language and with a postdoctoral degree from New York (USA) and an experienced English professor, of Brazilian nationality. The translators independently produced a translated version of the questionnaires2121 Beaton DE, Bombardier C, Guillemin F, Ferraz MB, Borsa JC, Wamser GH, et al. Guidelines for the Process of Cross-Cultural Adaptation of Self Report Measures. Spine (Phila Pa 1976) [Internet]. 2000;25(24):3186-91. Available from: http://dx.doi.org/10.1016/j.rboe.2014.03.011.
http://dx.doi.org/10.1016/j.rboe.2014.03...
.

Translator 1 (T1). This translator was aware of the concepts to be examined in the questionnaire. Its adaptations are intended to provide equivalence in a more clinical and more reliable way from a measurement perspective.

Translator 2 (T2). This translator not informed of the concepts to be translated and was unfamiliar with the topic. This is the naive translator, more likely to detect different meanings from the original. It is less influenced by an academic objective and offers a translation that reflects the language used by the lay population2121 Beaton DE, Bombardier C, Guillemin F, Ferraz MB, Borsa JC, Wamser GH, et al. Guidelines for the Process of Cross-Cultural Adaptation of Self Report Measures. Spine (Phila Pa 1976) [Internet]. 2000;25(24):3186-91. Available from: http://dx.doi.org/10.1016/j.rboe.2014.03.011.
http://dx.doi.org/10.1016/j.rboe.2014.03...
.

Synthesis of Translations

The two translators and a recording observer (the researcher, also fluent in English) met to synthesize the results of the translations. They made a synthesis of the two translations, producing a common translation, called T1+2, with a written report documenting the entire process.

Back Translation

Process used for the cross-cultural adaptation of research instruments, particularly questionnaires. A first version is translated back into its source language and this back-translation is compared with the original. Differences between back-translation and the source text may indicate problems to be overcome in relation to the first translation, considered equivalence failures2222 Prieto-Velasco M, Bagnis CI, Dean J, Goovaerts T, Melander S, Mooney A, et al. Predialysis education in practice: A questionnaire survey of centres with established programmes. BMC Res Notes. 2014;7(1):1-8..

Thus, from the synthesis of the questionnaire translation, and blinded to the original version, two translators (B1 and B2), who did not participate in the first stage, made the version of the questionnaire back into English. This is a validity checking process to ensure that the translated version reflects the content of the original version consistently and reliably. The back-translations were produced by two sworn translators accredited by JUCESP (B1 and B2), avoiding information bias and increasing the probability of finding imperfections2121 Beaton DE, Bombardier C, Guillemin F, Ferraz MB, Borsa JC, Wamser GH, et al. Guidelines for the Process of Cross-Cultural Adaptation of Self Report Measures. Spine (Phila Pa 1976) [Internet]. 2000;25(24):3186-91. Available from: http://dx.doi.org/10.1016/j.rboe.2014.03.011.
http://dx.doi.org/10.1016/j.rboe.2014.03...
.

Expert Committee Review

The composition of a committee aims to achieve cross-cultural equivalence. Its role is to consolidate all versions of the questionnaire and develop the preliminary version of the questionnaire for field testing. The committee should review all translations and reach consensus on discrepancies. The material made available to committee members included the original questionnaire and all translations (T1, T2, T1+2, RT1, RT2), with the corresponding reports. It is incumbent upon the committee to provide written documentation of the issues and the reasons used to reach the final decision on them. Decisions were made to achieve equivalence between the source and target version in four areas: semantic, idiomatic, experiential and conceptual, whose concepts are well established in the literature1919 Dortas Junior SD, Lupi O, Dias GAC, Guimarães MBS, Valle SOR. Adaptação transcultural e validação de questionários na área da saúde. Braz J Allergy Immunol [BJAI]. 2016;4(1):26-30..

In this study, the committee was composed of the two translators (T1 and T2), the researcher and the advisor, a professor of Bioethics at the graduate level and a nephrologist. After acceptance, the original questionnaires, the consensual version translated into Portuguese and the back-translations were sent individually via e-mail. This committee, in a meeting, produced the final version of the questionnaires.

Validation

To have international quality, the instrument, after translation and back-translation, and application of the pilot project, underwent a psychometric study, in which its reliability and validity were investigated1919 Dortas Junior SD, Lupi O, Dias GAC, Guimarães MBS, Valle SOR. Adaptação transcultural e validação de questionários na área da saúde. Braz J Allergy Immunol [BJAI]. 2016;4(1):26-30.,2323 Ware JE, Sherbourne CD. The MOS 36-Item Short-Form Health Survey (SF-36): I. conceptual framework and item selection. Med Care [Internet]. 1992; [cited 2016 May 11]; 30(6):473-83. Available from: http://www.jstor.org/stable/3765916
http://www.jstor.org/stable/3765916...
.

Adequate instruments have properties established by the principles of psychometry, a science that measures responses to phenomena that are not easily quantifiable. Good tools are those that are reliable and have appropriate acceptance by the interviewees; developed and validated for the purpose proposed in the investigation, they are capable of distinguishing patients with and without the problem and of measuring minimal significant changes. We use the following concepts2424 Bland JM, Altman DG. Statistics notes: validating scales and indexes. BMJ [Internet]. 2002; [cited 2010 Jun 16]; 324(7337):606-7. Available from: http://www.jstor.org/stable/25227678.
http://www.jstor.org/stable/25227678....
.

Reliability, Reproducibility or Precision

Reliability is the degree of consistency, coherence or precision with which the instrument measures an attribute2525 Pasquali L. Psicometria: teoria dos testes na psicologia e na educação. Petrópolis (RJ): Vozes; 2009.. It can be evaluated through internal consistency and reproducibility.

Internal consistency represents the average of the correlations between all its items. It can be measured by Cronbach’s alpha coefficient, measuring the homogeneity of items within the same domain2626 Aires M. Adaptação transcultural do “Vécu et Santé Perçue de l’adolescent”, um instrumento utilizado para a avaliação da qualidade de vida relacionada à saúde dos adolescentes [tese]. [Rio de Janeiro]: Universidade do Estado do Rio de Janeiro; 2009..

Reproducibility assesses the degree to which an instrument achieves stable results in a short time interval between measurements, assuming that there has been no clinical change (test - retest). It can be obtained by evaluating the agreement between two or more observers (inter-observer reliability) and through the agreement between observations made by an observer (intra-observer reliability) on different occasions or by an instrument in different scenarios. For analysis, the evaluation by Kappa and intraclass correlation coefficients was used2020 Herdman M, Rushby F, Badia X. A model of equivalence in the cultural adaptation of HRQol Instruments: the universalist approach. Qual Life Res. 1998;7:323-35.,2727 Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull [Internet]. 1968; [cited 2021 Jul 8]; 70(4):213-20. Available from: http://europepmc.org/abstract/MED/19673146.
http://europepmc.org/abstract/MED/196731...

28 Toutenburg H. Fleiss, J. L.: Statistical methods for rates and proportions. John Wiley & Sons, New York-London-Sydney-Toronto 1973. XIII, 233 S. Biom Z [Internet]. 1974;16(8):539. Available from: http://doi.wiley.com/10.1002/bimj.19740160814.
http://doi.wiley.com/10.1002/bimj.197401...

29 Donner A, Eliasziw M. A goodness-of-fit approach to inference procedures for the kappa statistic: confidence interval construction, significance-testing and sample size estimation. Stat Med [Internet]. 1992;11(11):1511-9 Available from: http://doi.wiley.com/10.1002/sim.4780130809.
http://doi.wiley.com/10.1002/sim.4780130...
-3030 Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420-8..

Validity or Accuracy

Refers to the degree of accuracy of the result of a measurement. There are three types: content, criterion and construct2020 Herdman M, Rushby F, Badia X. A model of equivalence in the cultural adaptation of HRQol Instruments: the universalist approach. Qual Life Res. 1998;7:323-35.,3131 Polit DF, Beck CT, Hungler BP, Thorell A. Fundamentos de pesquisa em enfermagem: métodos, avaliação e utilização. Porto Alegre: Artmed; 2004..

Content Validity

Validity is the degree to which the contents included in the questionnaire or scale are adequate to what one wishes to measure3232 Fletcher R, Fletcher S. Epidemiologia clínica: elementos essenciais. Porto Alegre: Artmed; 2006..

We used the Content Validity Index (CVI) or agreement between judges, which assesses the representativeness of the measure in relation to the content addressed, by dividing the number of judges who judged the item with a score of extreme relevance or relevant by the total number of judges (CVI for each item), which resulted in the proportion of judges who judged the item to be valid. The Committee of Judges was composed of 10 bilingual healthcare professionals who agreed to voluntarily fill out the questionnaire3333 Rubio DMG, Berg-Weger M, Tebb SS, Lee ES, Rauch S. Objectifyng content validity: conducting a content validity study in social work research. Soc Work Res. 2003;27(2):94-104..

Criterion Validity

There is criterion validity if it is coherently related to other different measures that assesses the same phenomenon.

It confirms the correlation between the scores of the instrument to be tested and some external criterion. There are two types: concurrent validity, which is obtained by applying two similar instruments, at the same time to the same individuals for later comparison, and predictive validity, which refers to the accuracy of the instrument in predicting future events2525 Pasquali L. Psicometria: teoria dos testes na psicologia e na educação. Petrópolis (RJ): Vozes; 2009..

In this study, criterion validity was not used because there is no other questionnaire that assesses the same phenomenon.

Construct Validity

Construct validity is the fundamental form of validity of psychological instruments. It can be measured through internal analysis (exploratory, confirmatory factorial) and external analysis, based on clinical and demographic criteria derived from clinical experience and medical practice, and also by correlating with other existing instruments, ideally the gold standard2020 Herdman M, Rushby F, Badia X. A model of equivalence in the cultural adaptation of HRQol Instruments: the universalist approach. Qual Life Res. 1998;7:323-35..

As there are no questionnaires or similar scales for correlation, we chose to analyze internal consistency using Cronback’s Alpha coefficient, which is consistent when exceeding 0.70 for each questionnaire3232 Fletcher R, Fletcher S. Epidemiologia clínica: elementos essenciais. Porto Alegre: Artmed; 2006.,3434 Cronbach LJ, Meehl PE. Construct validity in psychological tests. Psychol Bull. 1955;52(4):281-302..

Questionnaires Application

To apply the questionnaires the questionnaires, we received authorization from: the Institutional and from the author; from the dialysis units involved (A, B and C), and from the Research Ethics Committee of the Faculty of Medical and Healthcare Sciences of the Pontifical Catholic University of São Paulo (CAAE: 19647119.0.0000.5373).

The period of application of the questionnaires was from the second half of 2019 to the first half of 2021, in three of the four TRS units in the municipality of Sorocaba.

A total of 84 volunteers were included in the pilot project, 30 on HD, 26 on PD and 28 on conservative treatment. The inclusion criteria were adults with CKD (> 18 years), on HD or PD for at least 90 days, without restrictions on gender, race or underlying disease, in a possible universe of 657 individuals, who had no functional problem that prevented them from participating.

Statistical Analysis

In order to validate the three EPOCH-RRT questionnaires, we estimated the Cronbach’s Alpha and Kappa coefficients for each one.

For Cronbach’s Alpha, the calculation was performed only for the specific questions about kidney disease and treatment, as the general questions are not numerically standardized to represent a quantitative profile of the issue studied. We assessed the Cronbach’s Alpha only for the questionnaires for HD and PD patients, as the more qualitative questionnaire for patients without dialysis did not enable this analysis to be reliably performed.

We assessed all the questions in the Kappa coefficient. This is the analysis of the responses to the questionnaires using the selected evaluators described above.

The total sample of individuals was considered satisfactory and sufficient to perform exploratory analysis, statistical tests of hypotheses, comparison and association between the groups.

Kappa Coefficient

According to the reference by Fonseca et al.3535 Fonseca R., Silva P., Silva R. Acordo inter-juízes: O caso do coeficiente kappa. Laboratório de Psicologia, 5(1), p.81-90, 2007, the Kappa coefficient is used to estimate the agreement between examiners to answer a questionnaire. For this calculation, several examiners need to assign scores to the questionnaire as an experiment, and then the difference between the answers of each one is estimated to test if everyone’s interpretation is consistent.

In the present study, 10 judges evaluated all the questions of the three questionnaires according to the patients who had answered the questions. The Kappa coefficient classification reference is that of Landis and Koch3636 Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics [Internet]. 1977 Mar; [citado 2000 May 20]; 33(1):159-74. Disponível em: https://www.jstor.org/stable/2529310?origin=crossref
https://www.jstor.org/stable/2529310?ori...
. To obtain substantial agreement, the result must be > 0.60 to 0.80, and perfect agreement is considered between 0.81 and 1.0.

Cronbach’s Alpha

It aims to validate instruments by evaluating whether all items measure the same construct. It is a reliability index best applicable to scales that are not dichotomous, working most accurately for questions with more than three possible numerical answer choices.

Questions with numerical answers can be standardized to obtain a corrected index, because if the scales are very different, this fact directly interferes with the calculation, making it a questionnaire with less reliability because of the large variations in answers. When the scale is: the higher the score, the more positive the answer, the other questions need to follow the same logic. Otherwise, we must change the coding so that the higher the scale value, the more positive the response.

In the non-dialysis questionnaire, general health originally had a scale in which the higher the number, the worse the patient’s health, while the stage of choice showed that the higher the number, the more decided the patient was about treatment. Therefore, we inverted the overall health variable so that the higher the number, the better the health. Cronbach’s Alpha based on standardized items was used in the study to smooth out differences in scale.

Reference values to estimate whether the reliability index is acceptable are: > 0.7 is acceptable for a validated questionnaire, the value between 0.6 and 0.7 has low reliability. If the Alpha is > 0.95, it may indicate that the questions are redundant rather than reliable3737 Johnson MC, Guilford JP. Psychometric methods. J Am Stat Assoc. 1956;51(274):413..

We used Microsoft Excel 2016 to organize the data, and the IBM SPSS (Statistical Package for the Social Sciences) version 22 to calculate percentages, mean values, standard deviation and statistical tests.

Results

Calculation of Cronbach’s Alpha and Kappa’s Coefficient

Cronbach’s Alpha measures the reliability of the three questionnaires on the specific questions regarding kidney disease. The Alpha value was also presented in case the researcher removed a question from the questionnaire. We applied the Kappa coefficient to all questions.

Those patients under conservative treatment (n = 28) answered two specific questions about CKD, reporting how they felt about their general health and at what level of decision they were about the choice of treatment. It makes no sense to use Cronbach’s Alpha for these qualitative questions.

There are only two questions with little variability in the choice stage answers (variance < 1) and greater variation in the answers about general health; therefore, reliability is little because it is estimated that the result could be different if applied to another group of patients under conservative treatment.

If only one question remains, the Alpha coefficient cannot be calculated.

The Kappa coefficient showed agreement in question 1 (p-value: 0.149), question 7 (p-value: 0.086), question B3 (p-value: 0.086), question B7 (p-value: 0.018) and question B9 (p-value: 0.140). In the other questions, the agreement was classified as perfect, as it reached a p-value = 1; or there was no calculation possible because all the scores were identical, indicating total agreement among the judges.

Peritoneal Dialysis

The 26 PD patients answered eight questions regarding CKD and obtained Cronbach’s Alpha equal to 0.791, which can be classified as concordant, and very close to 0.8. The summary of how much Cronbach’s Alpha would be, if we removed a single question (item), follows in Table 1.

Table 1
Cronbach’s alpha for epoch-rrt “interview protocol for patients with chronic kidney diseases on peritoneal dialysis”

That is, if you remove the question about stomach pain, the Cronbach’s Alpha of the questionnaire would be 0.799. The remaining items would form another table like this one, in which it would be possible to check if the index would increase with the removal of some variable or decrease, showing that the previous combination of items reached the highest possible Alpha.

The Kappa coefficient showed minimal agreement in question 1 (p-value: 0.149), question 5 (p-value: 0.018), question 9 (p-value: 0.018), question B3 (p-value: 0.140), question B7 (p-value: 0.086) and question B9 (p-value: 0.140). In the other questions, the agreement was classified as perfect, as it reached p-value = 1 or there was no calculation possible because all the scores were identical, indicating total agreement between the judges.

Hemodialysis

The 30 HD patients answered ten questions on the CKD questionnaire, and the measured Cronbach’s Alpha was 0.746; a result classified as adequate (> 0.7). That is, the questionnaire has minimum appropriate validation to be applied in other studies, as shown in Table 2.

Table 2
Cronbach’s alpha for epoch-rrt “interview protocol for patients with chronic kidney diseases on hemodialysis”

The calculated Kappa coefficient showed minimal agreement in question 1 (p-value: 0.189), question 9 (p-value: 0.086), question B3 (p-value: 0.018), question B7 (p-value: 0.086 )and question B9 (p-value: 0.140). In the other questions, the agreement was classified as perfect, as it reached a p-value equal to 1, or there was no calculation possible because all the scores were identical, indicating total agreement among the judges.

Conclusions About Cronbach’s Alpha, Kappa Coefficient and CVI

The EPOCH-RRT questionnaires for PD and HD patients have an acceptable estimate to be replicated in other studies.

In patients without dialysis, the Cronbach’s Alpha was lower than 0.6, but, as previously mentioned, it would be inappropriate to use it due to its qualitative nature. It is therefore recommended that the EPOCH-RRT for non-dialysis patients be tested in other studies to see if adequate validation is possible or, alternatively, to include more discrete quantitative multiple-choice questions for patients to objectively answer on the impact of dialysis, chronic kidney disease and treatment. In the way it is presented, it does not seem to us that this questionnaire should be applied in studies that demand reliability. It is feasible to carry out a descriptive analysis of a group of patients undergoing conservative treatment, but it is not recommended to apply statistical tests or present it as a statistically validated instrument, because it is a questionnaire aimed at a qualitative analysis. The summary of Cronbach’s Alpha findings for the conservative treatment, HD and PD groups is shown in Table 3.

Table 3
Cronbach's alpha for epoch-rrt of the three groups of patients

For the 10 judges who evaluated the questionnaires, the Kappa coefficient showed perfect agreement in the vast majority of specific and general questions. Questions 1, B3, B7 and B9 generated minimal agreement in all questionnaires. Questions 5, 7 and 9 showed minimal agreement in some questionnaires. Disagreement occurred in the PD group questionnaire in question 5; in the conservative treatment group, in question 7; and in the DP and HD groups, in question 9.

The CVI obtained for the 3 questionnaires was 0.98, with an index > 0.8 being considered valid and an ideal > 0.9.

Discussion

CKD has gained importance and been a matter of concern in Public Health in Brazil and around the world due to the increasing incidence and prevalence, the negative impact on health-related quality of life, that is high morbidity and mortality, in addition to personal, physical, emotional, spiritual, social and financial issues3838 Alosaimi FD, Alshahrani SM, Aladhayani MH, Alwethenani ZK, Alsahil MJ, Fadhul HA. Psychosocial predictors of quality of life among chronic hemodialysis patients. Saudi Med J. 2020 Set;41(9):990-8..

In the last decades, technological advances have been observed in dialysis procedures, but the reality is that clinicians who work in primary care and other specialists who care for patients with impaired renal function are not always prepared to assist chronic kidney patients and refer them appropriately, enabling the necessary preparation for the stage where dialysis will be necessary3939 Davison SN, Moss AH. Supportive care: meeting the needs of patients with advanced chronic kidney disease. Clin J Am Soc Nephrol. 2016 Out;11(10):1879-80..

As highlighted earlier, there is a lack of national data on the participation of chronic kidney patients in their treatment choices. Generally, they start dialysis on an unscheduled basis, arriving at urgent or emergency services without knowledge of their disease and without any preparation for this new life-threatening situation1919 Dortas Junior SD, Lupi O, Dias GAC, Guimarães MBS, Valle SOR. Adaptação transcultural e validação de questionários na área da saúde. Braz J Allergy Immunol [BJAI]. 2016;4(1):26-30..

The lack of data and professional training cannot be a justification for inaction, and the current state must be recognized and overcome with strategies that allow an improvement in this dismal scenario.

There is no way to explain the importance of this study without placing the bioethical principle of autonomy, which is increasingly discussed in healthcare literature. This principle recommends that healthcare professionals or researchers, during their care or research practices, encourage and respect free will, values and preferences of each individual. Thus, the well-informed patient, interacting with the doctor and other healthcare professionals can decide about himself and his life condition4040 Beauchamp TL, Childress JF. The capacity for autonomous choice. In: Beauchamp TL, Childress JF, eds. Principles of biomedical ethics. 4ª ed. New York: Oxford University Press; 1994. p. 120-42..

The principlism bioethics became better known in Brazil from the first regulations in 1996, which approved guidelines and regulatory norms for research involving human beings in the country, and in its preamble, it deals with the four principles presented as four basic references of bioethics.

An autonomous choice of patients involves educational and awareness processes, so much so that Guidelines/Guidelines and Opinions recommend that the choice between all treatment options for CKD should be planned and respect the conscious preference of patients, weighing risks and benefits1010 Morton RL, Tong A, Howard K, Snelling P, Webster AC. The views of patients and carers in treatment decision making for chronic kidney disease: systematic review and thematic synthesis of qualitative studies. BMJ. 2010;340(7742):350..

In our study, we achieved the main objective of translating and transculturally adapting the three questionnaires to the Brazilian context, and the instruments for PD and HD patients were also validated and reached reliable rates for their use.

A good questionnaire, whether qualitative or quantitative, should generate valid responses, be clear and easy to understand, well accepted by respondents and encourage participation and the provision of the desired information. As cultural differences may be present, these measures can be developed in two ways: developing a new measure or translating and culturally adapting a previously validated measure in another language1919 Dortas Junior SD, Lupi O, Dias GAC, Guimarães MBS, Valle SOR. Adaptação transcultural e validação de questionários na área da saúde. Braz J Allergy Immunol [BJAI]. 2016;4(1):26-30..

Thus, the option for choosing an instrument1414 Combes G, Sein K, Allen K. How does pre-dialysis education need to change? Findings from a qualitative study with staff and patients. BMC Nephrol. 2017;18(1):1-11. (questionnaires from the EPOCH-RRT study) that could be widely used in the national territory, once translated and validated, and already applied in another country, was precisely because of this scientific gap. Using them will be a unique opportunity to compare the results found with the original research developed in the United States of America.

Again, we must mention the fact that, for the most part, the questionnaires are essentially qualitative, with transcribed answers, in which qualitative analyzes are more coherent approaches than quantitative ones, as they assume a universe of senses, meanings, beliefs, values and attitudes, which dispense with numerical indicators4141 Mussi RFF, Mussi LMPT, Assunção ETC, Nunes CP. Pesquisa quantitativa e/ou qualitativa: distanciamentos, aproximações e possibilidades. Rev Sustinere. 2019;7(2):414-30..

Study Limitations

The main limitation of this study involving the translation and cross-cultural adaptation was the fact that the instruments were not exclusively quantitative, which, on the other hand, can be considered a strong point, since the two dialysis questionnaires were considered adequate, despite the more qualitative approach. The conservative treatment questionnaire may need more adaptations.

In the application of the instrument in the pilot project, the main limiting factor was the number of patients in the subgroups, which did not reach a total of at least 30 on PD and on conservative treatment. Another point is that HD patients undergo HD routine three times a week, which facilitates meetings and interviews. On the other hand, patients on PD had a longer time interval between consultations, which ended up extending in the covid-19 pandemic, so as not to expose them to greater risk. The same can be said of patients undergoing conservative treatment, whose elective consultations were suspended for a period and spaced at longer intervals.

Clinical Implications

An innovative point of the study was to be based on questionnaires prepared with the collaboration of patients, family members and healthcare professionals in English and that could be reproduced in Brazil, after this study of translation and cross-cultural adaptation. Its application, even by fully viable means, such as digital media or telephone - means not tested by us -, which can result in increased knowledge and acquisition of new perspectives for all involved.

As far as we are aware, there are no similar questionnaires in Brazilian Portuguese that have the same purpose, whether original and developed here, or translated from another language.

Conclusions

It was possible to translate, cross-culturally adapt and validate a tool suitable for hemodialysis and peritoneal dialysis patients that will help to identify and respect the patient’s priorities in their autonomous choice of the best treatment for themselves, and the gaps in shared decision-making.

Acknowledgments

We appreciate the help of Prof. Dr. Roberto Pecoits Filho, by the lead author, Francesca Tentori, MD., PhD., from PCORI - Patient-Centered Outcomes Research Institute and, in particular, the dedication of Marina Nucci Theodoro, in the translation process.

Supplementary Material

The following online material is available for this article:

Supplementary Material - Questionnaires used in the interview protocol of patients with chronic kidney disease.

References

  • 1
    Hu JR, Coresh J. The public health dimension of chronic kidney disease: what we have learnt over the past decade. Nephrol Dial Transplant. 2017 Apr 1;32(suppl_2):ii113-ii120. doi: 10.1093/ndt/gfw416. PMID: 28206632.
    » https://doi.org/10.1093/ndt/gfw416
  • 2
    Hill NR, Fatoba ST, Oke JL, Hirst JA, O’Callaghan CA, Lasserson DS, et al. Global prevalence of chronic kidney disease: a systematic review and meta-analysis. PLoS One [Internet]. 2016;11(7):e0158765. Available from: https://dx.plos.org/10.1371/journal.pone.0158765.
    » https://dx.plos.org/10.1371/journal.pone.0158765
  • 3
    Sociedade Brasileira de Nefrologia. Censo Brasileiro de Diálise Crônica 2018 [Internet]. 2018 [cited 2019 Apr 20]. Available from: http://www.censo-sbn.org.br/censosAnteriores.
    » http://www.censo-sbn.org.br/censosAnteriores
  • 4
    Sociedade Brasileira de Nefrologia. Censo de Diálise SBN 2020 [Internet]. 2020 [cited 2021 Jun 8]. Available from: https://www.censo-sbn.org.br/
    » https://www.censo-sbn.org.br/
  • 5
    Amedia CA, Perazella MA. Transition of patients from chronic kidney disease to end-stage renal disease: better practices for better outcomes. Dis Manag. 2006;9(6):311-5.
  • 6
    Silva LF, Guedes MVC, Moreira RP, Souza ACC. Doença crônica: o enfrentamento pela família. Acta Paul Enferm. 2002;15(1):40-7.
  • 7
    Sturesson A, Ziegert K. Prepare the patient for future challenges when facing hemodialysis: nurses’ experiences. Int J Qual Stud Health Well-being. 2014;9(1):1-14.
  • 8
    Roberti J, Cummings A, Myall M, Harvey J, Lippiett K, Hunt K, et al. Work of being an adult patient with chronic kidney disease: A systematic review of qualitative studies. BMJ Open. 2018;8(9):1-29.
  • 9
    Peixoto ERM, Reis IA, Machado EL, Andrade EIG, Acurcio FA, Cherchiglia ML. Diálise planejada e a utilização regular da atenção primária à saúde entre os pacientes diabéticos do Município de Belo Horizonte, Minas Gerais, Brasil. Cad Saúde Pública. 2013;29(6):1241-50.
  • 10
    Morton RL, Tong A, Howard K, Snelling P, Webster AC. The views of patients and carers in treatment decision making for chronic kidney disease: systematic review and thematic synthesis of qualitative studies. BMJ. 2010;340(7742):350.
  • 11
    Mundy PD. Effectiveness of strategies for informing, educating, and involving patients. BMJ. 2007;335(19):24-7.
  • 12
    Devins G, Mendelssohn D, Barré P, Binik Y. Predialysis psychoeducational intervention and coping styles influence time to dialysis in chronic kidney disease. Am J Kidney Dis [Internet]. 2003; [cited 2016 Feb 2]; 42(4):693-703. Available from: http://onlinelibrary.wiley.com/o/cochrane/clcentral/articles/022/CN-00458022/frame.html.
    » http://onlinelibrary.wiley.com/o/cochrane/clcentral/articles/022/CN-00458022/frame.html
  • 13
    Mendelssohn DC, Malmberg C, Hamandi B. An integrated review of “unplanned” dialysis initiation: Reframing the terminology to “suboptimal” initiation. BMC Nephrol. 2009;10(1):1-8.
  • 14
    Combes G, Sein K, Allen K. How does pre-dialysis education need to change? Findings from a qualitative study with staff and patients. BMC Nephrol. 2017;18(1):1-11.
  • 15
    Dahlerus C, Quinn M, Messersmith E, Lachance L, Subramanian L, Perry E, et al. Patient perspectives on the choice of dialysis modality: results from the Empowering Patients on Choices for Renal Replacement Therapy (EPOCH-RRT) Study. Am J Kidney Dis [Internet]. 2016;68(6):901-10. Available from: http://dx.doi.org/10.1053/j.ajkd.2016.05.010.
    » http://dx.doi.org/10.1053/j.ajkd.2016.05.010
  • 16
    Subramanian L, Quinn M, Zhao J, Lachance L, Zee J, Tentori F. Coping with kidney disease - qualitative findings from the Empowering Patients on Choices for Renal Replacement Therapy (EPOCH-RRT) study. BMC Nephrol. 2017;18(1):119.
  • 17
    Subramanian L, Zhao J, Zee J, Knaus M, Fagerlin A, Perry E, et al. Use of a decision aid for patients considering peritoneal dialysis and in-center hemodialysis: a randomized controlled trial. Am J Kidney Dis [Internet]. 2019;74(3):351-60. Available from: https://doi.org/10.1053/j.ajkd.2019.01.030.
    » https://doi.org/10.1053/j.ajkd.2019.01.030
  • 18
    Queiroz MVO, Dantas MCQ, Ramos IC, Jorge MSB. Tecnologia do cuidado ao paciente renal crônico: enfoque educativo-terapêutico a partir das necessidades dos sujeitos. Texto Context Enferm. 2008;17(1):55-63.
  • 19
    Dortas Junior SD, Lupi O, Dias GAC, Guimarães MBS, Valle SOR. Adaptação transcultural e validação de questionários na área da saúde. Braz J Allergy Immunol [BJAI]. 2016;4(1):26-30.
  • 20
    Herdman M, Rushby F, Badia X. A model of equivalence in the cultural adaptation of HRQol Instruments: the universalist approach. Qual Life Res. 1998;7:323-35.
  • 21
    Beaton DE, Bombardier C, Guillemin F, Ferraz MB, Borsa JC, Wamser GH, et al. Guidelines for the Process of Cross-Cultural Adaptation of Self Report Measures. Spine (Phila Pa 1976) [Internet]. 2000;25(24):3186-91. Available from: http://dx.doi.org/10.1016/j.rboe.2014.03.011.
    » http://dx.doi.org/10.1016/j.rboe.2014.03.011
  • 22
    Prieto-Velasco M, Bagnis CI, Dean J, Goovaerts T, Melander S, Mooney A, et al. Predialysis education in practice: A questionnaire survey of centres with established programmes. BMC Res Notes. 2014;7(1):1-8.
  • 23
    Ware JE, Sherbourne CD. The MOS 36-Item Short-Form Health Survey (SF-36): I. conceptual framework and item selection. Med Care [Internet]. 1992; [cited 2016 May 11]; 30(6):473-83. Available from: http://www.jstor.org/stable/3765916
    » http://www.jstor.org/stable/3765916
  • 24
    Bland JM, Altman DG. Statistics notes: validating scales and indexes. BMJ [Internet]. 2002; [cited 2010 Jun 16]; 324(7337):606-7. Available from: http://www.jstor.org/stable/25227678.
    » http://www.jstor.org/stable/25227678
  • 25
    Pasquali L. Psicometria: teoria dos testes na psicologia e na educação. Petrópolis (RJ): Vozes; 2009.
  • 26
    Aires M. Adaptação transcultural do “Vécu et Santé Perçue de l’adolescent”, um instrumento utilizado para a avaliação da qualidade de vida relacionada à saúde dos adolescentes [tese]. [Rio de Janeiro]: Universidade do Estado do Rio de Janeiro; 2009.
  • 27
    Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull [Internet]. 1968; [cited 2021 Jul 8]; 70(4):213-20. Available from: http://europepmc.org/abstract/MED/19673146.
    » http://europepmc.org/abstract/MED/19673146
  • 28
    Toutenburg H. Fleiss, J. L.: Statistical methods for rates and proportions. John Wiley & Sons, New York-London-Sydney-Toronto 1973. XIII, 233 S. Biom Z [Internet]. 1974;16(8):539. Available from: http://doi.wiley.com/10.1002/bimj.19740160814.
    » http://doi.wiley.com/10.1002/bimj.19740160814
  • 29
    Donner A, Eliasziw M. A goodness-of-fit approach to inference procedures for the kappa statistic: confidence interval construction, significance-testing and sample size estimation. Stat Med [Internet]. 1992;11(11):1511-9 Available from: http://doi.wiley.com/10.1002/sim.4780130809.
    » http://doi.wiley.com/10.1002/sim.4780130809
  • 30
    Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420-8.
  • 31
    Polit DF, Beck CT, Hungler BP, Thorell A. Fundamentos de pesquisa em enfermagem: métodos, avaliação e utilização. Porto Alegre: Artmed; 2004.
  • 32
    Fletcher R, Fletcher S. Epidemiologia clínica: elementos essenciais. Porto Alegre: Artmed; 2006.
  • 33
    Rubio DMG, Berg-Weger M, Tebb SS, Lee ES, Rauch S. Objectifyng content validity: conducting a content validity study in social work research. Soc Work Res. 2003;27(2):94-104.
  • 34
    Cronbach LJ, Meehl PE. Construct validity in psychological tests. Psychol Bull. 1955;52(4):281-302.
  • 35
    Fonseca R., Silva P., Silva R. Acordo inter-juízes: O caso do coeficiente kappa. Laboratório de Psicologia, 5(1), p.81-90, 2007
  • 36
    Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics [Internet]. 1977 Mar; [citado 2000 May 20]; 33(1):159-74. Disponível em: https://www.jstor.org/stable/2529310?origin=crossref
    » https://www.jstor.org/stable/2529310?origin=crossref
  • 37
    Johnson MC, Guilford JP. Psychometric methods. J Am Stat Assoc. 1956;51(274):413.
  • 38
    Alosaimi FD, Alshahrani SM, Aladhayani MH, Alwethenani ZK, Alsahil MJ, Fadhul HA. Psychosocial predictors of quality of life among chronic hemodialysis patients. Saudi Med J. 2020 Set;41(9):990-8.
  • 39
    Davison SN, Moss AH. Supportive care: meeting the needs of patients with advanced chronic kidney disease. Clin J Am Soc Nephrol. 2016 Out;11(10):1879-80.
  • 40
    Beauchamp TL, Childress JF. The capacity for autonomous choice. In: Beauchamp TL, Childress JF, eds. Principles of biomedical ethics. 4ª ed. New York: Oxford University Press; 1994. p. 120-42.
  • 41
    Mussi RFF, Mussi LMPT, Assunção ETC, Nunes CP. Pesquisa quantitativa e/ou qualitativa: distanciamentos, aproximações e possibilidades. Rev Sustinere. 2019;7(2):414-30.

Publication Dates

  • Publication in this collection
    27 June 2022
  • Date of issue
    Jan-Mar 2023

History

  • Received
    14 Sept 2021
  • Accepted
    23 Feb 2022
Sociedade Brasileira de Nefrologia Rua Machado Bittencourt, 205 - 5ºandar - conj. 53 - Vila Clementino - CEP:04044-000 - São Paulo SP, Telefones: (11) 5579-1242/5579-6937, Fax (11) 5573-6000 - São Paulo - SP - Brazil
E-mail: bjnephrology@gmail.com