Acessibilidade / Reportar erro

Validation of the Informal Caregiver Burden Assessment Questionnaire for Brazil – short version

Validación del Cuestionario de Evaluación de la Sobrecarga del Cuidador Informal de Brasil – versión corta

ABSTRACT

Objectives:

to cross-culturally adapt the short version of the Informal Caregiver Burden Assessment Questionnaire to the Brazilian culture and test its psychometric properties.

Methods:

the questionnaire was translated, adapted, and applied to a sample of 280 informal caregivers. The psychometric assessment was verified by estimating psychometric sensitivity and internal structure validity.

Results:

inter-rater agreement was satisfactory among specialists. In the seven-factor model, item (Q9) of the domain “Perception of Efficacy and Control Mechanisms” showed a factor loading less than 0.40 (ʎ = 0.26), and an alternative six-factor model was evaluated. However, both models showed excellent fit indices, and it was decided to keep the seven-factor reference model. Reliability was satisfactory for the seven subscales (α > 0.70).

Conclusions:

the questionnaire was adapted and showed adequate psychometric indices in the Brazilian context in which it was evaluated, preserving its original essence.

Descriptors:
Psychometrics; Surveys and Questionnaires; Nursing; Caregivers; Caregiver Overload

RESUMEN

Objetivos:

adaptar transculturalmente la versión corta del Cuestionario de Evaluación de la Sobrecarga del Cuidador Informal para cultura brasileña y probar sus propriedades psicométricas.

Métodos:

cuestionario traducido, adaptado y aplicado para 280 cuidadores informales. Evaluación psicométrica verificada por la estimativa de la sensibilidad psicométrica y validez de la estructura interna.

Resultados:

la concordancia interevaluadores fue satisfactoria entre los especialistas. En el modelo de siete factores, el ítem (Q9) del dominio “Percepción de los mecanismos de eficacia y control” presentó carga factorial menor que 0,40 (ʎ = 0,26), y un modelo alternativo de seis factores fue evaluado. Sin embargo, los dos modelos evidenciaron óptimos índices de ajustamiento, y se optó por mantener el modelo-referencia de siete factores. La confiabilidad se mostró satisfactoria para las siete subescalas (α > 0,70).

Conclusiones:

el cuestionario fue adaptado y demostró indicadores psicométricos satisfactorios en el contexto brasileño en que fue evaluado, preservando su esencia original.

Descriptores:
Psicometría; Encuestas y Cuestionarios; Enfermería; Cuidadores; Sobrecarga del Cuidador

RESUMO

Objetivos:

adaptar transculturalmente a versão curta do Questionário de Avaliação da Sobrecarga do Cuidador Informal para cultura brasileira e testar suas propriedades psicométricas.

Métodos:

o questionário foi traduzido, adaptado e aplicado em uma amostra de 280 cuidadores informais. A avaliação psicométrica foi verificada pela estimativa da sensibilidade psicométrica e validade da estrutura interna.

Resultados:

a concordância interavaliadores foi satisfatória entre os especialistas. No modelo de sete fatores, o item (Q9) do domínio “Percepção dos Mecanismos de Eficácia e Controle” apresentou carga fatorial menor do que 0,40 (ʎ = 0,26), e um modelo alternativo de seis fatores foi avaliado. No entanto, os dois modelos evidenciaram ótimos índices de ajustamento, e optou-se por manter o modelo-referência de sete fatores. A confiabilidade mostrou-se satisfatória para as sete subescalas (α > 0,70).

Conclusões:

o questionário foi adaptado e demonstrou índices psicométricos satisfatórios no contexto brasileiro em que foi avaliado, preservando sua essência original.

Descritores:
Psicometria; Inquéritos e Questionários; Enfermagem; Cuidadores; Sobrecarga do Cuidador

INTRODUCTION

Faced with the responsibility of care, the figure of the caregiver assumes a fundamental role in the life of the care-dependent person and begins to provide continuity of care in the home environment. The formal caregiver is defined as a professional academically prepared to meet the patient’s specific needs. The informal caregiver is conceived as a family member or friend who is solicited to ensure most of the care related to the patient’s daily life in the family context and usually has no specific training to perform this role(11 Machado RS, Fernandes ADBF, Oliveira ALCB, Soares LS, Gouveia MTO, Silva GRF. Métodos de adaptação transcultural de instrumentos na área da enfermagem. Rev Gaúcha Enferm 2018;39:e2017-0164. https://doi.org/10.1590/1983-1447.2018.2017-0164
https://doi.org/10.1590/1983-1447.2018.2...
).

The experience of caring for a sick family member can represent a huge burden for caregivers and brings about deprivations and changes in the family dynamics(22 Oliveira F, Kuznier T P, Souza CC, Chianca TCM. Aspectos teóricos e metodológicos para adaptação cultural e validação de instrumentos na enfermagem. Texto Contexto Enferm 2018;27. https://doi.org/10.1590/0104-070720180004900016
https://doi.org/10.1590/0104-07072018000...
). The burden is defined as a disorder that results from caring for an individual with physical dependence or mental incapacity. It refers to the subjective perception of threats related to the caregivers’ physiological, social, and psychological needs, affecting cognitive and moral issues, which increase the burden on caregivers of people dependent on care in the home environment(33 Silva YC, Silva KL. Constituição do sujeito cuidador na atenção domiciliar: dimensões psicoafetiva, cognitiva e moral. Esc Anna Nery 2020;24:e20190335. https://doi.org/10.1590/2177-9465-ean-2019-0335
https://doi.org/10.1590/2177-9465-ean-20...
).

Studies report that caregiving involves activities that demand full-time and exclusive dedication. These activities compromise social interaction and commitment to oneself. Thus, informal caregivers are exposed to a daily burden and may present anxiety, depression, stress, tension, sleep deprivation, reduced quality of life, feeling of powerlessness, sadness, helplessness, and financial difficulties resulting from the impossibility of working outside. Those factors contribute to making them sick anonymously due to the many hours spent on home care(33 Silva YC, Silva KL. Constituição do sujeito cuidador na atenção domiciliar: dimensões psicoafetiva, cognitiva e moral. Esc Anna Nery 2020;24:e20190335. https://doi.org/10.1590/2177-9465-ean-2019-0335
https://doi.org/10.1590/2177-9465-ean-20...
, 44 Silva JK, Boery RNSO. Cuidadores familiares dos sobreviventes de acidente vascular cerebral: sobrecarga e fatores relacionados. Cienc Enferm. 2021;27. https://doi.org/10.29393/CE27-11CFJR20011
https://doi.org/10.29393/CE27-11CFJR2001...
, 55 Wu Y, Liu Y, Cao X, Ying Z, Park J, Feng Q, et al. Burden of caregivers who care for oldest-old parents with disability: a cross-sectional study. Geriatric Nurs. 2021;42:792–8. https://doi.org/10.1016/j.gerinurse.2021.04.013
https://doi.org/10.1016/j.gerinurse.2021...
, 66 Lou VW, Tang JYM, Lau GKK, Lum TYS, Fong K, Ko RWT, et al. Effectiveness of a two-tier family-oriented intervention in enhancing the family functioning and care capacity of the family caregivers of stroke survivors: protocol for a randomized controlled trial. JMIR Res Protoc 2021;10:e16703. https://doi.org/10.2196/16703
https://doi.org/10.2196/16703...
).

Thus, evaluating the burden of informal caregivers becomes relevant for detecting factors that can contribute to the illness of these individuals. In this context, the Informal Caregiver Burden Assessment Questionnaire (QASCI) has been a structurally balanced instrument and has demonstrated adequate validity and accuracy in the populations of caregivers to which it was applied(77 Martins T, Ribeiro J P, Garret C. Questionário de avaliação da sobrecarga do cuidador informal (QASCI): reavaliação das propriedades psicométricas. Rev Enf Ref [Internet]. 2004[cited 2021 Dec 01];11:17-31. Available from: https://rr.esenfc.pt/rr/index.php?module=rr⌖=publicationDetails&pesquisa=dor&id_artigo=35
https://rr.esenfc.pt/rr/index.php?module...
, 88 Martins T, Garrett C, Pais-Ribeiro J. Estudo de Validação do Questionário de Avaliação da Sobrecarga para Cuidadores Informais. Psicol Saúde Doenças [Internet]. 2003[cited 2021 Dec 01];4(1):131–48. Available from: https://sigarra.up.pt/fpceup/pt/pub_geral.pub_view?pi_pub_base_id=83237
https://sigarra.up.pt/fpceup/pt/pub_gera...
). In addition, the questionnaire seeks to assess not only the physical burden but also the emotional and social burden factors(99 Martins T, Peixoto MJ, Araújo F, Rodrigues M, Pires F. Development of the short version of the informal caregiver burden assessment questionnaire. Rev Esc Enferm USP 2015;49:0236–44. https://doi.org/10.1590/S0080-623420150000200008
https://doi.org/10.1590/S0080-6234201500...
).

Initially, the QASCI was developed to assess, in the medium and long term, the quality of life outcomes of informal caregivers of people after a stroke(88 Martins T, Garrett C, Pais-Ribeiro J. Estudo de Validação do Questionário de Avaliação da Sobrecarga para Cuidadores Informais. Psicol Saúde Doenças [Internet]. 2003[cited 2021 Dec 01];4(1):131–48. Available from: https://sigarra.up.pt/fpceup/pt/pub_geral.pub_view?pi_pub_base_id=83237
https://sigarra.up.pt/fpceup/pt/pub_gera...
) and, later, adapted for family caregivers of dependent people with chronic diseases(77 Martins T, Ribeiro J P, Garret C. Questionário de avaliação da sobrecarga do cuidador informal (QASCI): reavaliação das propriedades psicométricas. Rev Enf Ref [Internet]. 2004[cited 2021 Dec 01];11:17-31. Available from: https://rr.esenfc.pt/rr/index.php?module=rr⌖=publicationDetails&pesquisa=dor&id_artigo=35
https://rr.esenfc.pt/rr/index.php?module...
). The questionnaire, created by Portuguese researchers, has two versions, one long and another short. The extended version was developed in 2003(88 Martins T, Garrett C, Pais-Ribeiro J. Estudo de Validação do Questionário de Avaliação da Sobrecarga para Cuidadores Informais. Psicol Saúde Doenças [Internet]. 2003[cited 2021 Dec 01];4(1):131–48. Available from: https://sigarra.up.pt/fpceup/pt/pub_geral.pub_view?pi_pub_base_id=83237
https://sigarra.up.pt/fpceup/pt/pub_gera...
), consisting of 32 items divided into seven dimensions, as follows: Implications in the Caregiver’s Personal Life (11 items); Satisfaction with the Role and with the Family Member (five items); Reactions and Demands (five items); Emotional Burden (four items); Family Support (two items); Financial Burden (two items); and Perception of Efficiency and Control Mechanisms (three items). This version was adapted to the Brazilian culture and tested in 2015, for its psychometric properties(1010 Monteiro EA, Mazin SC, Dantas RAS. Questionário de Avaliação da Sobrecarga do Cuidador Informal: validação para o Brasil. Rev Bras Enferm 2015;68:421–8. https://doi.org/10.1590/0034-7167.2015680307i
https://doi.org/10.1590/0034-7167.201568...
).

Following recommendations about the need for more concise instruments that involve less time spent in their completion(99 Martins T, Peixoto MJ, Araújo F, Rodrigues M, Pires F. Development of the short version of the informal caregiver burden assessment questionnaire. Rev Esc Enferm USP 2015;49:0236–44. https://doi.org/10.1590/S0080-623420150000200008
https://doi.org/10.1590/S0080-6234201500...
,1111 Chou P-L, Rau K-M, Lin C-C. Development and psychometric testing of a short version of the Barriers Questionnaire-Taiwan form for cancer patients. Int J Nurs Stud. 2011;48:1071–9. https://doi.org/10.1016/j.ijnurstu.2011.02.006
https://doi.org/10.1016/j.ijnurstu.2011....
, 1212 Kimura M, Carandina DM. Desenvolvimento e validação de uma versão reduzida do instrumento para avaliação da Qualidade de Vida no Trabalho de enfermeiros em hospitais. Rev Esc Enferm USP 2009;43:1044–54. https://doi.org/10.1590/S0080-62342009000500008
https://doi.org/10.1590/S0080-6234200900...
, 1313 Raes F, Pommier E, Neff KD, Van Gucht D. Construction and factorial validation of a short form of the Self-Compassion Scale. Clin Psychol Psychother. 2011;18:250–5. https://doi.org/10.1002/cpp.702
https://doi.org/10.1002/cpp.702...
, 1414 Ribeiro JLP. Metodologia de investigação em psicologia e saúde. 3ª ed. Porto: Legis; 2010.), the Portuguese authors developed a short version of the QASCI in 2016(99 Martins T, Peixoto MJ, Araújo F, Rodrigues M, Pires F. Development of the short version of the informal caregiver burden assessment questionnaire. Rev Esc Enferm USP 2015;49:0236–44. https://doi.org/10.1590/S0080-623420150000200008
https://doi.org/10.1590/S0080-6234201500...
). This version consists of 14 items also arranged in the same seven dimensions, and it showed adequate values in the psychometric assessment in the context in which it was evaluated(99 Martins T, Peixoto MJ, Araújo F, Rodrigues M, Pires F. Development of the short version of the informal caregiver burden assessment questionnaire. Rev Esc Enferm USP 2015;49:0236–44. https://doi.org/10.1590/S0080-623420150000200008
https://doi.org/10.1590/S0080-6234201500...
).

OBJECTIVES

To cross-culturally adapt the short version of the QASCI to the Brazilian culture and test its psychometric properties in a sample of informal Brazilian caregivers.

METHODS

Ethical aspects

The development of this research was carried out in compliance with Resolution 466/2012. The Permanent Committee for Ethics in Research with Human Beings (Comitê Permanente de Ética em Pesquisa com Seres Humanos - COPEP) approved the study. All individuals who agreed to participate in the study signed the Informed Consent Form in two copies.

Design, participants, and procedures of study

This study is a methodological, cross-cultural adaptation and psychometric assessment of the short version of the QASCI, conducted between June 2020 and January 2021, in a medium-sized city located in northwestern of the state of Paraná, Brazil. The main author of the QASCI was contacted and authorized the cultural adaptation and use of the instrument in the Brazilian context.

The cross-cultural adaptation procedure was carried out following Beaton’s methodological reference(1515 Beaton D, Bombardier C, Guillemin F, Ferraz MB. Recommendations for the cross-cultural adaptation of the DASH &Quick DASH outcome measures [Internet]. American Academy of Orthopaedic Surgeons and Institute for Work & Health; 2007[cited 2021 Nov 07]. Available from: http://www.dash.iwh.on.ca/translate2.htm
http://www.dash.iwh.on.ca/translate2.htm...
), whose stages are: translation, translation synthesis, back-translation, a committee of judges, and pre-test. The original version of the questionnaire was adapted into Brazilian Portuguese by two bilingual translators. The two translated versions (T1 and T2) reached a consensus between the translators and the researchers, forming the T3 version. This version was forwarded to three bilingual, fluent, native Portuguese speakers living in Portugal for back-translation, generating the versions RT1, RT2, and RT3.

When the back-translation stage was completed, the committee of specialists was organized to prepare the pre-test version of the adapted instrument. This committee was composed of 13 judges with the following characteristics: a Brazilian master’s degree student in health, and resident in Portugal; a PhD in linguistics; two PhD professors and nurses with experience in the method; three PhD candidates in Nursing with experience in the subject; a PhD professor in Nursing with experience in-home care; two informal caregivers; and three nurses working in-home care.

Each member received a letter of invitation by e-mail explaining the purpose of the study, the role, and functions of the judge on the committee, specific instructions regarding the completion of the instrument and assessment of the items, scoring description, and form of response. The judges were asked to assess the instrument’s semantic, idiomatic, cultural, and conceptual equivalences. After evaluation by the specialists committee, the version of the QASCI was subjected to pre-testing with 40 informal caregivers. Figure 1 presents all the phases of the study.

Figure 1
Stages of translation, adaptation, and validation, Paranavaí, Paraná, Brazil, 2021

Population and sample: criteria of inclusion and exclusion

For the psychometric assessment stage, the sample size followed that recommended by Pasquali(1616 Pasquali, L. Instrumentação Psicológica: fundamentos e práticas. Porto Alegre (RS): Artmed; 2010.). The data collection was performed by telephone with 280 informal caregivers, and the inclusion criteria were: 18 years of age or older, be the primary caregiver of the care-dependent person in that residence, not receiving a salary for this service, exercising the role of caregiver for a period longer than 60 days. The immigrant caregivers who had lived in Brazil for less than a year due to communication and language interpretation difficulties were excluded. A list of the care-dependent patients and their informal caregivers was requested from the Municipal Health Department to compose the sample. The Family Health Units (FHU) nurses provided a list of 570 care-dependent patients and their respective informal caregivers. This list contained the name, phone number, and the community health agent (CHA) responsible for that family’s coverage area.

Study protocol

Data collection and analysis

For data collection, it was used the QASCI short version adapted for Brazil (14 items)(99 Martins T, Peixoto MJ, Araújo F, Rodrigues M, Pires F. Development of the short version of the informal caregiver burden assessment questionnaire. Rev Esc Enferm USP 2015;49:0236–44. https://doi.org/10.1590/S0080-623420150000200008
https://doi.org/10.1590/S0080-6234201500...
) and a sociodemographic questionnaire with the following items: age, gender, schooling, degree of kinship, number of hours per day dedicated to caring, and how long they acted as caregivers for that person. The QASCI items are distributed in seven domains: Emotional Burden (BE) - two items; Implications in Personal Life (IPL) - two items; Financial Burden (FB) - two items; Reactions and Demands (RD) - two items; Perception of Efficiency and Control Mechanisms (PECM) - two items; Family Support (FSup) - two items; Satisfaction with the Role and Family Member (SFR) - two items. The response scales to the items are of the Likert type of five points: 1 = Not or never; 2 = Rarely; 3 = Sometimes; 4 = Almost always; 5 = Always. Regarding the scores, the authors proposed two forms of rating: the total score, which evaluates the global burden, and the score of each dimension. The positive dimensions’ items must be inverted to calculate the global burden, and the result can vary from 14 to 70. For each dimension score, the average score is calculated, i.e., the response of each subscale is added and divided by the number of items applicable to the respective subscale(99 Martins T, Peixoto MJ, Araújo F, Rodrigues M, Pires F. Development of the short version of the informal caregiver burden assessment questionnaire. Rev Esc Enferm USP 2015;49:0236–44. https://doi.org/10.1590/S0080-623420150000200008
https://doi.org/10.1590/S0080-6234201500...
).

Committee of judges

It was applied Fleiss’ Kappa index of agreement (KF) to evaluate the inter-rater agreement. The classification of the index ranges from “insignificant” to “perfect,” as suggested by Landis and Kock(1717 Landis JR, Koch GG. An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics 1977;33:363. https://doi.org/10.2307/2529786
https://doi.org/10.2307/2529786...
). It was considered three categories of item classification: not equivalent, partially equivalent, and equivalent(1717 Landis JR, Koch GG. An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics 1977;33:363. https://doi.org/10.2307/2529786
https://doi.org/10.2307/2529786...
).

Psychometric Assessment

The psychometric performance assessment of the data from the QASCI short Brazilian version was carried out by estimating the psychometric sensitivity and validity of the internal structure(1818 American Educational Research Association, American Psychological Association & National Council on Measurement in Education. Standards for Educational and Psychological Testing. New York: American Educational Research Association; 2014.). The psychometric sensitivity was verified employing summary measures (mean and standard deviation) and distribution shape (skewness and kurtosis), which were considered adequate when the absolute value of skewness was lower than 3 and kurtosis was lower than 7(1919 Marôco J. Análise de equações estruturais: fundamentos teóricos, software e aplicações. 3ª Ed. Pêro Pinheiro: ReportNumber; 2021.,2020 Kline, RB. Principles and practice of structural equation modeling. New York: Guilford, 4ed, 2015.). In order to verify whether the QASCI short Brazilian version satisfied the same seven-factor structure of the original Portuguese version and assess the degree of evidence of validity based on the internal structure of the instrument, the following analyses were performed: confirmatory factor analysis (CFA), verification of internal consistency by the convergence of items - mean extracted variance (MEV), composite reliability (CR) and Cronbach’s alpha coefficient (α).

Regarding the conduction of the CFA, the Maximum Likelihood Estimation method was used; and as for the indices to evaluate the quality of adjustment, the following were verified: chi-square ratio by degrees of freedom (χ2/gl), p-value, Goodness of Fit Index (GFI); Comparative Fit Index (CFI), Tucker-Lewis Index (TLI) Parsimony Goodness of Fit Index (PGFI), Parsimony Comparative Fit Index (PCFI) and Root Mean Square Error of Approximation (RMSEA), with 90% confidence interval (CI 90%). Such parameters were considered adequate when χ2/gl ≤ 2.0; p < 0.05; CFI ≥ 0.90; TLI ≥ 0.90, PGFI and PCFI ≥ 0.60; RMSEA [90% CI] < 0.10(1919 Marôco J. Análise de equações estruturais: fundamentos teóricos, software e aplicações. 3ª Ed. Pêro Pinheiro: ReportNumber; 2021.,2121 Guenther WC. Desk calculation of probabilities for the distribution of the sample correlation coefficient. Am Stat. 1977;31(1):45-48.). Items’ factor loadings (λ) were also evaluated and considered adequate when greater than or equal to 0.40, and items with factor loadings below this cutoff point were considered to be removed from the model(2222 Hair JF, Hult GTM, Ringle CM, Sarstedt M. A primer on Partial Least Squares Structural Equation Modeling (PLS-SEM). California: Sage Publications, 2014.).

The internal consistency by the convergence of items was considered using the items’ factor loadings and the Mean Extracted

Variance (MEV) evaluation. The value of MEV ≥ 0.50 indicates that, on average, the construct explains more than half of the variability of the items. On the other hand, one MEV ≤ 0.50 suggests that, on average, there are more errors present in the items than the variability explained by the construct(2222 Hair JF, Hult GTM, Ringle CM, Sarstedt M. A primer on Partial Least Squares Structural Equation Modeling (PLS-SEM). California: Sage Publications, 2014., 2323 Fornell C, Larcker DF. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. J Market Res. 1981;18:39. https://doi.org/10.2307/3151312.
https://doi.org/10.2307/3151312...
). Cronbach’s alpha coefficient (α) standardized and Composite Reliability (CR) calculation were also used as internal consistency parameters. These criteria were considered adequate when α ≥ 0.70 and CR ≥ 0.70(1919 Marôco J. Análise de equações estruturais: fundamentos teóricos, software e aplicações. 3ª Ed. Pêro Pinheiro: ReportNumber; 2021.,2121 Guenther WC. Desk calculation of probabilities for the distribution of the sample correlation coefficient. Am Stat. 1977;31(1):45-48.,2323 Fornell C, Larcker DF. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. J Market Res. 1981;18:39. https://doi.org/10.2307/3151312.
https://doi.org/10.2307/3151312...
). Composite reliability defined by Fornell and Larcker(2323 Fornell C, Larcker DF. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. J Market Res. 1981;18:39. https://doi.org/10.2307/3151312.
https://doi.org/10.2307/3151312...
) was calculated based on the confirmatory factor analysis results. This parameter estimates the internal consistency of the items reflecting the construct and indicates the degree to which those items are consistent manifestations of that construct(1919 Marôco J. Análise de equações estruturais: fundamentos teóricos, software e aplicações. 3ª Ed. Pêro Pinheiro: ReportNumber; 2021.,2121 Guenther WC. Desk calculation of probabilities for the distribution of the sample correlation coefficient. Am Stat. 1977;31(1):45-48.).

Since the Portuguese authors also report the possibility of the QASCI providing a global score for caregiver burden, a second-order hierarchical model was evaluated to calculate that global score in the Brazilian informal caregivers’ sample to preserve the theoretical difference between the items.

For all tests, a 5% significance level was adopted. The statistical analyses were performed in the statistical program SPSS version 20.0 and AMOS version 20.0 (SPSS, IBM Company, Chicago/IL).

RESULTS

Among the participants of the specialist committee, the majority (38.5%) had a master’s degree, were between 25 and 55 years old, were female (92.3%), and were nurses (69.3%). The time of training was between 5 and 30 years. The informal caregivers participating in the pre-test were between 31 and 40 years old, and 77.5% were female. In the analysis of psychometric properties, among the 280 informal caregivers, 66.8% were female, 66.8% were between 41 and 50 years old, and 19.3% were between 61 and 70 years old.

In the assessment of semantic, idiomatic, conceptual, and cultural equivalence, the relevance of each item and the interrater agreement were satisfactory among the specialists. In total, there were 43 suggestions. All domains had good agreement: conceptual equivalence (81.14%; CI 0.60-0.84) - moderate and perfect agreement; cultural equivalence (75.73%; CI 0.51-0.76) - substantial agreement; idiomatic equivalence (87.55%; CI 0.72-0.90) - almost perfect agreement; and semantic equivalence (69.51%; CI 0.39-0.69) - moderate agreement. After the pre-test evaluation, all prompts were adequate.

Table 1 presents the descriptive characteristics of the items of the QASCI short version and the frequency of the distribution of responses to the questionnaire items assessed by psychometric sensitivity. We observed absolute asymmetry values lower than 3 and kurtosis lower than 7. That indicates the adequacy of the distribution form and demonstrates that the factor analysis could be performed. The means ranged from 2.6 to 4.1, and the standard deviation (SD) was 1.2 to 1.5.

Table 1
Descriptive characteristics and distribution of responses to Informal Caregiver Burden Assessment Questionnaire items, Paranavaí, Paraná, Brazil, 2021

The results indicating the degree of validity of evidence based on the internal structure of the instrument are displayed in Figure 2 and Table 2. It is observed that in the seven-factor model, one of the items of the PECM domain (item Q9) had a factor loading lower than 0.40 (ʎ = 0.26), so it was considered its exclusion. Thus, an alternative six-factor model was evaluated without the PECM domain since it only had two items.

Figure 2
Heptadimensional Structure of the Informal Caregiver Burden Assessment Questionnaire - short version, Paranavaí, Paraná, Brazil, 2021

Table 2
Confirmatory Factor Analysis (CFA) of the Informal Caregiver Burden Assessment Questionnaire (Model fit index, convergent validity); and internal consistency - seven-factor model (Portuguese version), seven-factor unmodified model (Brazilian version) and alternative six-factor model, Paranavaí, Paraná, Brazil, 2021

However, even with domain exclusion, both the seven-factor model [χ2/gl=1.64; CFI = 0.98; TLI = 0.97; GFI = 0.96; RMSEA = 0.048 (CI = 0.029-0.066)] and the six-factor model [χ2/gl = 1.47; CFI = 0.99; TLI = 0.98; GFI = 0.97; RMSEA = 0.041 (CI = 0.014-0.063)] showed optimal fit indices. Regarding the internal consistency by the convergence of the items, all domains had adequate MEV values (> 0.5), with the exception of the PECM domain (MEV = 0.33).

Regarding the internal consistency parameters in the different models, Cronbach’s alpha, and Composite Reliability, relative to the domains, showed adequate values (> 0.7), except for the PECM domain (α = 0.33).

As for the empirical test of a model with a second-order hierarchical structure (Figure 3), this was not confirmed and showed poor fit indices: [χ2/gl = 4.23; CFI = 0.89; TLI = 0.86; GFI = 0.86; RMSEA = 0.108 (CI = 0.096-0.121)].

Figure 3
Structure of the second-order hierarchical model of the Informal Caregiver Burden Assessment Questionnaire - short version, Paranavaí, Paraná, Brazil, 2021

DISCUSSION

The present study evaluated the cross-cultural adaptation process and tested the validity evidence of the internal structure of the short version of the QASCI in a population of informal caregivers living in a city northwest of Paraná. The QASCI has already been applied to caregivers of people with stroke(88 Martins T, Garrett C, Pais-Ribeiro J. Estudo de Validação do Questionário de Avaliação da Sobrecarga para Cuidadores Informais. Psicol Saúde Doenças [Internet]. 2003[cited 2021 Dec 01];4(1):131–48. Available from: https://sigarra.up.pt/fpceup/pt/pub_geral.pub_view?pi_pub_base_id=83237
https://sigarra.up.pt/fpceup/pt/pub_gera...
), to caregivers of dependent people affected by chronic diseases(77 Martins T, Ribeiro J P, Garret C. Questionário de avaliação da sobrecarga do cuidador informal (QASCI): reavaliação das propriedades psicométricas. Rev Enf Ref [Internet]. 2004[cited 2021 Dec 01];11:17-31. Available from: https://rr.esenfc.pt/rr/index.php?module=rr⌖=publicationDetails&pesquisa=dor&id_artigo=35
https://rr.esenfc.pt/rr/index.php?module...
), informal caregivers of the elderly(1010 Monteiro EA, Mazin SC, Dantas RAS. Questionário de Avaliação da Sobrecarga do Cuidador Informal: validação para o Brasil. Rev Bras Enferm 2015;68:421–8. https://doi.org/10.1590/0034-7167.2015680307i
https://doi.org/10.1590/0034-7167.201568...
), and, in the present study, to informal caregivers of people with a dependence on care.

In the evaluation process of semantic, idiomatic, conceptual, and cultural equivalence, the relevance of each item and the inter-rater agreement showed satisfactory results among the specialists. It was possible to identify that, between the QASCI short Portuguese version and its short Brazilian version, the instrument’s items showed more divergence as to agreement. Item 14 had a reasonable agreement for three domains: Conceptual, Cultural, and Semantic in the adapted short version. The agreement on the extended version of the QASCI adapted for Brazil was above 85% between the judges(1010 Monteiro EA, Mazin SC, Dantas RAS. Questionário de Avaliação da Sobrecarga do Cuidador Informal: validação para o Brasil. Rev Bras Enferm 2015;68:421–8. https://doi.org/10.1590/0034-7167.2015680307i
https://doi.org/10.1590/0034-7167.201568...
).

Based on the confirmatory factor analysis results and internal consistency, it could be observed that the domain that diverged the most among the other studies that also used the QASCI was the Perceptions of Efficiency and Control Mechanisms (Percepção dos Mecanismos de Eficácia e Controle). In the Portuguese research that developed the original short version, the items’ factor loadings (λ) ranged from 0.57 to 0.75(99 Martins T, Peixoto MJ, Araújo F, Rodrigues M, Pires F. Development of the short version of the informal caregiver burden assessment questionnaire. Rev Esc Enferm USP 2015;49:0236–44. https://doi.org/10.1590/S0080-623420150000200008
https://doi.org/10.1590/S0080-6234201500...
). In the adapted version, the factor loadings ranged from 0.26 to 0.77. Literature indicates that items with factor loadings below 0.5 should be removed from the model(1919 Marôco J. Análise de equações estruturais: fundamentos teóricos, software e aplicações. 3ª Ed. Pêro Pinheiro: ReportNumber; 2021.,2222 Hair JF, Hult GTM, Ringle CM, Sarstedt M. A primer on Partial Least Squares Structural Equation Modeling (PLS-SEM). California: Sage Publications, 2014.). Thus, we analyzed an alternative six-factor model. Since the PECM domain had only two items, it was necessary to exclude not only item Q9, but also the PECM domain(1919 Marôco J. Análise de equações estruturais: fundamentos teóricos, software e aplicações. 3ª Ed. Pêro Pinheiro: ReportNumber; 2021.,2222 Hair JF, Hult GTM, Ringle CM, Sarstedt M. A primer on Partial Least Squares Structural Equation Modeling (PLS-SEM). California: Sage Publications, 2014.). However, there was minimal difference between the seven and the six-factor models when comparing the adjustment indexes.

Since the QASCI short version instrument was used for the first time in the Brazilian context, and there are still no studies in other cultures using the QASCI besides Portugal, we opted to be cautious. So, we maintained the seven-factor reference model as proposed by the author. More studies are needed to review item Q9 and the PECM domain. It is necessary to evaluate if the item is, in fact, not valid or reliable and thus not applicable to the Brazilian population or if it has some issue related to equivalence or construction problems.

The psychometric analysis using Cronbach’s alpha showed good fit for all domains of the adapted version for both the seven-factor model and the alternative six-factor model except for the PECM (α = 0.33). The original short Portuguese version showed internal consistency values from “acceptable” to “good” for all domains: BE (α = 0.66), IPL (α = 0.7); FB (α = 0.82); RD (α = 0.67); PECM (α = 0.67); FSup (α = 0.77) and SFR (0.59)(99 Martins T, Peixoto MJ, Araújo F, Rodrigues M, Pires F. Development of the short version of the informal caregiver burden assessment questionnaire. Rev Esc Enferm USP 2015;49:0236–44. https://doi.org/10.1590/S0080-623420150000200008
https://doi.org/10.1590/S0080-6234201500...
).

In the extended version adapted to Brazil, the alpha values for the respective domains ranged from 0.88 (Implications in Personal Life) to 0.51 (Perception of Efficiency and control mechanisms), but a Cronbach’s alpha of 0.92 was obtained for the scale as a whole(1010 Monteiro EA, Mazin SC, Dantas RAS. Questionário de Avaliação da Sobrecarga do Cuidador Informal: validação para o Brasil. Rev Bras Enferm 2015;68:421–8. https://doi.org/10.1590/0034-7167.2015680307i
https://doi.org/10.1590/0034-7167.201568...
).

It is known that some factors can affect the results of factor loadings, such as the number of items per domain. Thus, in the short version, all domains were composed of only two items, but the literature recommends having at least three to five measured variables representing each common factor. Additionally, item Q9 may have obtained a low factorial result because it appears to be response-inducing and/or redundant compared to other items in the reader’s comprehension. Therefore, the construction criteria may influence the final result when analyzing the factorial loadings of a measurement instrument. Consequently, further research is needed to evaluate the adjustment of the item mentioned above or its exclusion(2424 Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factor analysis in psychological research. Psychol Methods. 1999;4(3):272–99. https://doi.org/10.1037/1082-989X.4.3.272
https://doi.org/10.1037/1082-989X.4.3.27...
).

Thus, it is recommended that the instrument be submitted to new populations to verify if the item presenting divergence in the present study will need adjustments so that its factorial load becomes representative and will be maintained as part of the model or need to be removed. New studies with informal caregivers who use the QASCI will increase the credibility of the questionnaire and disseminate it to those interested in this subject.

It is worth noting that the study also checked the QASCI empirical model for the plausibility that a second-order hierarchical model could represent it. That assumption was raised because the instrument’s authors employed Cronbach’s overall alpha coefficient in all of their studies and addressed the possibility that the QASCI could provide a global score for caregiver burden. In those studies, the alpha parameters had the following values: (α = 0.71)(99 Martins T, Peixoto MJ, Araújo F, Rodrigues M, Pires F. Development of the short version of the informal caregiver burden assessment questionnaire. Rev Esc Enferm USP 2015;49:0236–44. https://doi.org/10.1590/S0080-623420150000200008
https://doi.org/10.1590/S0080-6234201500...
) and (α = 0.90)(88 Martins T, Garrett C, Pais-Ribeiro J. Estudo de Validação do Questionário de Avaliação da Sobrecarga para Cuidadores Informais. Psicol Saúde Doenças [Internet]. 2003[cited 2021 Dec 01];4(1):131–48. Available from: https://sigarra.up.pt/fpceup/pt/pub_geral.pub_view?pi_pub_base_id=83237
https://sigarra.up.pt/fpceup/pt/pub_gera...
). Even the Brazilian study reporting the adaptation of the long version also evidenced a global alpha (α = 0.92)(1010 Monteiro EA, Mazin SC, Dantas RAS. Questionário de Avaliação da Sobrecarga do Cuidador Informal: validação para o Brasil. Rev Bras Enferm 2015;68:421–8. https://doi.org/10.1590/0034-7167.2015680307i
https://doi.org/10.1590/0034-7167.201568...
). However, none of the studies mentioned discussed the possibility that a second-order hierarchical model could better represent the QASCI to obtain a global score for caregiver burden.

The present study pointed out that an empirical model represented by a second-order hierarchical structure was not corroborated and showed very poor adjustment indexes. That refutes the possibility of generating a representative global score for the sample, besides rendering the presentation of the global Cronbach’s alpha without a psychometric basis.

Study limitations

This study has some limitations, such as using a population from only one city with characteristics that prevent generalizing the conclusions to other groups of Brazilians with distinct profiles. The absence of results from different countries/cultures that used the QASCI also makes it difficult to compare the outcomes, so we did not find it pertinent to address the relations of the scores obtained with the respective sample characteristics. The issue of the QASCI global score itself needs further evidence since, in this study, the second-order hierarchical structure did not obtain a good fit. Other limitations are related to the inherence of cross-sectional studies and reliance on self-reported data, which are often subject to social desirability effects and some other response biases.

Contributions to the field of Nursing

This study performed the cross-cultural adaptation and assessment of the QASCI psychometric properties. It proved to be reliable for use in the field of health, contributing to new studies that evaluate the informal caregiver’s burden or even for adaptation to other populations.

This study considered the contribution to the nursing practice and intended to help nurses assess and identify the informal caregiver’s burden, lead them to a differentiated perspective, and enable interventions to reduce the burden and improve the quality of life of informal caregivers.

CONCLUSIONS

The short version of the adapted QASCI proved to be satisfactory and maintained all the factors and items of the questionnaire, preserving its original essence. The questionnaire can be used to assess the burden of informal caregivers since, for the sample studied, this version presented adequate evidence of content validity and internal structure validity. Only one item of a domain revealed questionable parameters as to validity; thus, it is suggested that these (item and domain) be cautiously evaluated/interpreted and improved in future studies.

  • FUNDING
    The author would like to thank the Coordination for the Improvement of Higher Education Personnel - Brazil (CAPES) for its support - Funding Code 001.

REFERENCES

  • 1
    Machado RS, Fernandes ADBF, Oliveira ALCB, Soares LS, Gouveia MTO, Silva GRF. Métodos de adaptação transcultural de instrumentos na área da enfermagem. Rev Gaúcha Enferm 2018;39:e2017-0164. https://doi.org/10.1590/1983-1447.2018.2017-0164
    » https://doi.org/10.1590/1983-1447.2018.2017-0164
  • 2
    Oliveira F, Kuznier T P, Souza CC, Chianca TCM. Aspectos teóricos e metodológicos para adaptação cultural e validação de instrumentos na enfermagem. Texto Contexto Enferm 2018;27. https://doi.org/10.1590/0104-070720180004900016
    » https://doi.org/10.1590/0104-070720180004900016
  • 3
    Silva YC, Silva KL. Constituição do sujeito cuidador na atenção domiciliar: dimensões psicoafetiva, cognitiva e moral. Esc Anna Nery 2020;24:e20190335. https://doi.org/10.1590/2177-9465-ean-2019-0335
    » https://doi.org/10.1590/2177-9465-ean-2019-0335
  • 4
    Silva JK, Boery RNSO. Cuidadores familiares dos sobreviventes de acidente vascular cerebral: sobrecarga e fatores relacionados. Cienc Enferm. 2021;27. https://doi.org/10.29393/CE27-11CFJR20011
    » https://doi.org/10.29393/CE27-11CFJR20011
  • 5
    Wu Y, Liu Y, Cao X, Ying Z, Park J, Feng Q, et al. Burden of caregivers who care for oldest-old parents with disability: a cross-sectional study. Geriatric Nurs. 2021;42:792–8. https://doi.org/10.1016/j.gerinurse.2021.04.013
    » https://doi.org/10.1016/j.gerinurse.2021.04.013
  • 6
    Lou VW, Tang JYM, Lau GKK, Lum TYS, Fong K, Ko RWT, et al. Effectiveness of a two-tier family-oriented intervention in enhancing the family functioning and care capacity of the family caregivers of stroke survivors: protocol for a randomized controlled trial. JMIR Res Protoc 2021;10:e16703. https://doi.org/10.2196/16703
    » https://doi.org/10.2196/16703
  • 7
    Martins T, Ribeiro J P, Garret C. Questionário de avaliação da sobrecarga do cuidador informal (QASCI): reavaliação das propriedades psicométricas. Rev Enf Ref [Internet]. 2004[cited 2021 Dec 01];11:17-31. Available from: https://rr.esenfc.pt/rr/index.php?module=rr⌖=publicationDetails&pesquisa=dor&id_artigo=35
    » https://rr.esenfc.pt/rr/index.php?module=rr⌖=publicationDetails&pesquisa=dor&id_artigo=35
  • 8
    Martins T, Garrett C, Pais-Ribeiro J. Estudo de Validação do Questionário de Avaliação da Sobrecarga para Cuidadores Informais. Psicol Saúde Doenças [Internet]. 2003[cited 2021 Dec 01];4(1):131–48. Available from: https://sigarra.up.pt/fpceup/pt/pub_geral.pub_view?pi_pub_base_id=83237
    » https://sigarra.up.pt/fpceup/pt/pub_geral.pub_view?pi_pub_base_id=83237
  • 9
    Martins T, Peixoto MJ, Araújo F, Rodrigues M, Pires F. Development of the short version of the informal caregiver burden assessment questionnaire. Rev Esc Enferm USP 2015;49:0236–44. https://doi.org/10.1590/S0080-623420150000200008
    » https://doi.org/10.1590/S0080-623420150000200008
  • 10
    Monteiro EA, Mazin SC, Dantas RAS. Questionário de Avaliação da Sobrecarga do Cuidador Informal: validação para o Brasil. Rev Bras Enferm 2015;68:421–8. https://doi.org/10.1590/0034-7167.2015680307i
    » https://doi.org/10.1590/0034-7167.2015680307i
  • 11
    Chou P-L, Rau K-M, Lin C-C. Development and psychometric testing of a short version of the Barriers Questionnaire-Taiwan form for cancer patients. Int J Nurs Stud. 2011;48:1071–9. https://doi.org/10.1016/j.ijnurstu.2011.02.006
    » https://doi.org/10.1016/j.ijnurstu.2011.02.006
  • 12
    Kimura M, Carandina DM. Desenvolvimento e validação de uma versão reduzida do instrumento para avaliação da Qualidade de Vida no Trabalho de enfermeiros em hospitais. Rev Esc Enferm USP 2009;43:1044–54. https://doi.org/10.1590/S0080-62342009000500008
    » https://doi.org/10.1590/S0080-62342009000500008
  • 13
    Raes F, Pommier E, Neff KD, Van Gucht D. Construction and factorial validation of a short form of the Self-Compassion Scale. Clin Psychol Psychother. 2011;18:250–5. https://doi.org/10.1002/cpp.702
    » https://doi.org/10.1002/cpp.702
  • 14
    Ribeiro JLP. Metodologia de investigação em psicologia e saúde. 3ª ed. Porto: Legis; 2010.
  • 15
    Beaton D, Bombardier C, Guillemin F, Ferraz MB. Recommendations for the cross-cultural adaptation of the DASH &Quick DASH outcome measures [Internet]. American Academy of Orthopaedic Surgeons and Institute for Work & Health; 2007[cited 2021 Nov 07]. Available from: http://www.dash.iwh.on.ca/translate2.htm
    » http://www.dash.iwh.on.ca/translate2.htm
  • 16
    Pasquali, L. Instrumentação Psicológica: fundamentos e práticas. Porto Alegre (RS): Artmed; 2010.
  • 17
    Landis JR, Koch GG. An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics 1977;33:363. https://doi.org/10.2307/2529786
    » https://doi.org/10.2307/2529786
  • 18
    American Educational Research Association, American Psychological Association & National Council on Measurement in Education. Standards for Educational and Psychological Testing. New York: American Educational Research Association; 2014.
  • 19
    Marôco J. Análise de equações estruturais: fundamentos teóricos, software e aplicações. 3ª Ed. Pêro Pinheiro: ReportNumber; 2021.
  • 20
    Kline, RB. Principles and practice of structural equation modeling. New York: Guilford, 4ed, 2015.
  • 21
    Guenther WC. Desk calculation of probabilities for the distribution of the sample correlation coefficient. Am Stat. 1977;31(1):45-48.
  • 22
    Hair JF, Hult GTM, Ringle CM, Sarstedt M. A primer on Partial Least Squares Structural Equation Modeling (PLS-SEM). California: Sage Publications, 2014.
  • 23
    Fornell C, Larcker DF. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. J Market Res. 1981;18:39. https://doi.org/10.2307/3151312
    » https://doi.org/10.2307/3151312
  • 24
    Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factor analysis in psychological research. Psychol Methods. 1999;4(3):272–99. https://doi.org/10.1037/1082-989X.4.3.272
    » https://doi.org/10.1037/1082-989X.4.3.272

Edited by

EDITOR IN CHIEF: Álvaro Sousa
ASSOCIATE EDITOR: Alexandre Balsanelli

Publication Dates

  • Publication in this collection
    23 Sept 2022
  • Date of issue
    2022

History

  • Received
    01 Dec 2021
  • Accepted
    18 May 2022
Associação Brasileira de Enfermagem SGA Norte Quadra 603 Conj. "B" - Av. L2 Norte 70830-102 Brasília, DF, Brasil, Tel.: (55 61) 3226-0653, Fax: (55 61) 3225-4473 - Brasília - DF - Brazil
E-mail: reben@abennacional.org.br