Acessibilidade / Reportar erro

PSYCHOMETRIC PROPERTIES OF INSTRUMENT ASSESSING NURSING CARE PROVIDED TO INDIVIDUALS WITH HIV/AIDS

PROPIEDADES PSICOMÉTRICAS DE INSTRUMENTO QUE EVALÚA LA ASISTENCIA DE LA ENFERMERÍA PRESTADA A PERSONAS CON HIV/SIDA

ABSTRACT

Objective:

to assess the psychometric properties of the Brazilian version of Quality of Care Through the Patient’s Eyes - HIV (QUOTE-HIV).

Method:

this methodological study consisted of verifying and assessing convergent and structural validity and estimating the reliability of the instrument’s translated and culturally adapted version. It was conducted in an HIV/AIDS referral center between August and November 2016 and included 141 participants. Confirmatory factor analysis was performed to assess structural construct validity, while Cronbach’s alpha and composite reliability were performed to assess the internal consistency of each domain and estimate the instrument’s reliability. Convergent construct validity was verified using Spearman’s coefficient correlation.

Results:

QUOTE-HIV is structured on two components, Importance and Performance; hence, two models were generated at the end of the factor analysis, one for each component. Both models were statistically validated and presented satisfactory reliability parameters. Regarding convergent validity, positive and significant correlations were found between the scores obtained by the QUOTE-HIV domains and the Newcastle Satisfaction with Nursing Scales (NSNS), except for the performance domain in the importance component.

Conclusion:

QUOTE-HIV Brazilian version presented evidence of reliability, adequate internal consistency, and validity according to the convergent and structural construct validity methods adopted.

DESCRIPTORS:
Validation study; Nursing care; HIV; Factor analysis; statistical; Quality of health care

RESUMEN

Objetivo:

evaluar las propiedades de medida de la versión brasileña del Quality of Care Through the Patient’s Eyes - HIV (QUOTE-HIV).

Método:

estudio metodológico que consistió en la verificación y evaluación de la validez de constructo convergente y estructural y en la estimativa de la confiabilidad del instrumento traducido y adaptado culturalmente. Fue realizado en un centro de referencia para HIV/SIDA en el período de agosto a noviembre de 2016 y contó con la participación de 141 sujetos. Para evaluar la validez de constructo estructural, se aplicó análisis factorial confirmatorio. Para estimar la confiabilidad, fue evaluada la consistencia interna de cada dominio del instrumento por medio del Alpha de Cronbach y de la confiabilidad compuesta. La validez de constructo convergente fue verificada por medio del coeficiente de correlación de Spearman.

Resultados:

como el instrumento QUOTE-HIV está estructurado en dos partes, importancia y desempeño, fueron generados dos modelos al final del análisis factorial, un para cada parte, ambos validados estadísticamente. En las dos partes fueron observados valores de confiabilidad satisfactorios. En relación a la validez convergente, fueron observadas correlaciones positivas significativas entre los puntajes de los dominios del QUOTE-HIV y el puntaje total del Newcastle Satisfaction with Nursing Scales (NSNS), excepto para el dominio desempeño del profesional en el componente importancia.

Conclusión:

la versión brasileña del QUOTE-HIV presentó evidencias de confiabilidad, con adecuada consistencia interna y validez, de acuerdo con los métodos de validez de constructo convergente y estructural empleados.

DESCRIPTORS:
Estudio de validación; Atención de enfermería; HIV; Análisis factorial; Calidad de atención de saúde

RESUMO

Objetivo:

avaliar as propriedades de medida da versão brasileira do Quality of Care Through the Patient’s Eyes - HIV (QUOTE-HIV).

Método:

estudo metodológico que consistiu na verificação e avaliação da validade de construto convergente e estrutural e na estimativa da confiabilidade de instrumento traduzido e adaptado culturalmente. Foi realizado em um centro de referência para HIV/AIDS no período de agosto a novembro de 2016 e contou com a participação de 141 sujeitos. Para avaliar a validade de construto estrutural, aplicou-se análise fatorial confirmatória. Para estimar a confiabilidade, foi avaliada a consistência interna de cada domínio do instrumento por meio do Alpha de Cronbach e da confiabilidade composta. A validade de construto convergente foi verificada por meio do coeficiente de correlação de Spearman.

Resultados:

como o instrumento QUOTE-HIV está estruturado em duas partes, importância e desempenho, foram gerados dois modelos ao final da análise fatorial, um para cada parte, ambos validados estatisticamente. Em ambas as partes foram observados valores de confiabilidade satisfatórios. Em relação à validade convergente, foram observadas correlações positivas significativas entre os escores dos domínios do QUOTE-HIV e o escore total do Newcastle Satisfaction with Nursing Scales (NSNS), exceto para o domínio desempenho do profissional no componente importância.

Conclusão:

a versão brasileira do QUOTE-HIV apresentou evidências de confiabilidade, com adequada consistência interna e validade, de acordo com os métodos de validade de construto convergente e estrutural empregados.

DESCRITORES:
Estudos de validação; Cuidados de enfermagem; HIV; Análise fatorial; Qualidade dos cuidados de saúde

INTRODUCTION

The acquired immunodeficiency syndrome (AIDS) caused by the human immunodeficiency virus (HIV) stands out among infectious diseases due to its magnitude and extent of the damage caused.11. Greco DB. Thirty years of confronting the Aids epidemic in Brazil, 1985-2015. Ciênc Saúde Colet [Internet]. 2016 [cited 2017 Jan 14];21(5):1553-64. Available from: https://doi.org/10.1590/1413-81232015215.04402016
https://doi.org/10.1590/1413-81232015215...
Adequate care and early diagnosis are essential to decrease disease-related morbidities and mortality. However, one of the biggest challenges for services and professionals providing care to people with HIV is to ensure patients access the services and maintain pharmacological adherence, a worldwide quest. 22. Freitas JP, Sousa LRM, Cruz MCMA, Caldeira NMVP, Gir E. Antiretroviral therapy: compliance level and the perception of HIV/Aids patients. Acta Paul Enferm [Internet]. 2018 [cited 2020 Nov 20];31(3):327-33. Available from: https://doi.org/10.1590/1982-0194201800046
https://doi.org/10.1590/1982-01942018000...
-33. Carvalho PP, Barrosos SM, Coelho HC, Penaforte FRO. Factors associated with antiretroviral therapy adherence in adults: an integrative review of literature. Ciênc Saúde Colet [Internet]. 2019 [cited 2022 Jun 01];24(7):2543-55. Available from: https://doi.org/10.1590/1413-81232018247.22312017
https://doi.org/10.1590/1413-81232018247...
Assessing and understanding the patients’ specific difficulties and needs as well as the quality of care provided by health workers can guide the actions implemented in health services.44. Loch AP, Nemes MIB, Santos MA, Alves AM, Melchior R, Basso CR, et al. Evaluation of outpatient services in the Brazilian Unified National Health System for persons living with HIV: a comparison of 2007 and 2010. Cad Saude Publica [Internet]. 2018 [cited 2022 Jun 06];34(2):e00047217. Available from: http://doi.org/10.1590/0102-311X00047217
http://doi.org/10.1590/0102-311X00047217...

There is a lack of instruments in the Brazilian context to assess such needs. For this reason, a questionnaire developed to identify the perspective of individuals with HIV infection regarding care delivery was sought in the international literature. This search resulted in the QUOTE-HIV,55. Hekkink CF, Sixma HJ, Wigersma L, Yzermans CJ, Van Der Meer JTM, Bindels PJE, et al. QUOTE-HIV: an instrument for assessing quality of HIV care from the patients' perspective. Qual Saf Health Care [Internet]. 2003 [cited 2016 Oct 02];12:188-93. Available from: https://doi.org/10.1136/qhc.12.3.188
https://doi.org/10.1136/qhc.12.3.188...
an instrument assessing the quality of care from the perspective of individuals with HIV infection. Before this study, the QUOTE-HIV was translated and culturally adapted for Brazilian HIV-infected individuas,66. Lima TC, Freitas MIP. Cultural adaptation of Quality of Care Through the Patient’s Eyes -QUOTE-HIV. Rev Bras Enferm [Internet]. 2018 [cited 2020 Nov 20];71(1):47-56. Available from: https://doi.org/10.1590/0034-7167-2016-0113
https://doi.org/10.1590/0034-7167-2016-0...
according to the guidelines provided in the literature for the cultural adaptation and content validation of instruments.77. Beaton D, Bombardier C, Guillemin F, Ferraz MB. Recommendations for the Cross-Cultural Adaptation of the DASH & Quick DASH Outcome Measures. Institute for Work & Health [Internet]. 2007 [cited 2016 Oct 02]. Available from: https://www.researchgate.net/publication/265000941_Recommendations_for_the_Cross-Cultural_Adaptation_of_the_DASH_QuickDASH_Outcome_Measures_Contributors_to_this_Document
https://www.researchgate.net/publication...
The literature also emphasizes the importance of assessing the measurement properties of culturally adapted instruments to ensure the safety and reliability of data collected in investigations and used in clinical practice.88. Oliveira F, Kuznier TP, Souza CC, Chianca TCM. Theoretical and methodological aspects for the cultural adaptation and validation of instruments in nursing. Texto Contexto Enferm [Internet]. 2018 [cited 2022 Jun 03];27(2):e4900016. Available from: https://doi.org/10.1590/0104-070720180004900016
https://doi.org/10.1590/0104-07072018000...
-99. Boateng GO, Neilands TB, Frongillo EA, Melgar-Quiñonez HR, Young SL. Best practices for developing and validating scales for health, social, and behavioral research: a Primer. Front Public Health [Internet]. 2018 [cited 2022 Jun 03];6:149. Available from: https://doi.org/10.3389/fpubh.2018.00149
https://doi.org/10.3389/fpubh.2018.00149...

The method used to assess the measurement properties of an instrument depends on the type of study and information needed, considering the statistical analyzes adopted.88. Oliveira F, Kuznier TP, Souza CC, Chianca TCM. Theoretical and methodological aspects for the cultural adaptation and validation of instruments in nursing. Texto Contexto Enferm [Internet]. 2018 [cited 2022 Jun 03];27(2):e4900016. Available from: https://doi.org/10.1590/0104-070720180004900016
https://doi.org/10.1590/0104-07072018000...
There are tools currently available in the literature based on analyses and expert consensus to help clarify and standardize the terminology and definitions related to measurement properties.1010. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res [Internet]. 2010 [cited 2016 Oct 02];19(4):539-49. Available from: https://doi.org/10.1007/s11136-010-9606-8
https://doi.org/10.1007/s11136-010-9606-...
This study’s objective was to assess the measurement properties of the QUOTE-HIV version adapted to the Brazilian population with HIV infection by identifying its structural and convergent validity and reliability.

METHOD

This methodological study verified and assessed structural and convergent construct validity of the adapted instrument and estimated its reliability. It was developed in the teaching health facility of an HIV/AIDS referral center located in the interior of São Paulo, Brazil. The institution is characterized by the care provided by a multidisciplinary team under the Brazilian Health System (SUS).

The following inclusion criteria were adopted: a) being HIV positive; b) receiving HIV/AIDS specialized outpatient care for at least one year; c) being 18 years old or older, and d) being able to understand and answer the instrument's questions.

All those who attended a previously scheduled medical appointment during the data collection period and met the inclusion criteria were included in this study. A proportion of five to ten participants was considered for each instrument’s items to determine the sample size and enable the confirmatory factor analysis. Therefore, at least 115 subjects would be needed;1111. Hair JF, Anderson RE, Tathan RL, Black WC. Análise multivariada de dados. Porto Alegre, RS(BR): Bookman; 2009. a sample of 141 participants was established.

One of the authors and the nurse in the referral center applied the instruments and collected data from August to November 2016. The training was provided to standardize how the patients would be approached, and the questionnaires applied. The participants received clarification regarding the study’s objectives and signed free and informed consent forms. Data were collected individually in a private room.

The participants answered questions concerning the demographic and clinical characterization, the QUOTE-HIV adapted version, and the Brazilian version of the Newcastle Satisfaction with Nursing Scales (NSNS).

Socio-demographic and clinical characterization form

A socio-demographic and clinical form was developed to address the following information: sex, marital status, religion, age, education, profession, monthly family income, viral load, CD4 count, and disease staging.

QUOTE-HIV adapted version

This instrument was developed to measure the quality of nursing care from the patients’ perspective. Its items are rated on a Likert scale: Not important = 1; Little important = 2; Important = 3; and Very important = 4. The workers’ performance is rated according to the following: Never = 1; Sometimes = 2; Often = 3; and Always = 4. It comprises 23 items distributed into three domains: professional performance (seven items), professional attitude (seven items), and care organization (nine items). These items are assessed for two reasons: first, to obtain data regarding the importance assigned to each item, and second, to assess the performance of care providers. Data can be assessed by considering each item individually or the score obtained in each domain, dividing the score assigned to the professional performance by the importance assigned by the patients. Scores higher than or equal to 1 indicate that care was deemed adequate. Lower scores ​​suggest a need for improvements according to the patients’ perspective.55. Hekkink CF, Sixma HJ, Wigersma L, Yzermans CJ, Van Der Meer JTM, Bindels PJE, et al. QUOTE-HIV: an instrument for assessing quality of HIV care from the patients' perspective. Qual Saf Health Care [Internet]. 2003 [cited 2016 Oct 02];12:188-93. Available from: https://doi.org/10.1136/qhc.12.3.188
https://doi.org/10.1136/qhc.12.3.188...
,1212. Hekkink CF, Wigersma L, Yzermans CJ, Bindels PJ. HIV nursing consultants: patients' preferences and experiences about the quality of care. J Clin Nurs [Internet]. 2005 [cited 2016 Oct 02];14(3):327-33. Available from: https://doi.org/10.1111/j.1365-2702.2004.01061.x
https://doi.org/10.1111/j.1365-2702.2004...

Newcastle Satisfaction with Nursing Scales (NSNS): Brazilian version

This scale assesses the experiences and satisfaction of patients with nursing care. It is composed of two scales that can be assessed independently: the scale of patient's experiences with nursing care and the scale of patient satisfaction with nursing care, with 26 and 19 items, respectively. The items are rated on a 7-point and 5-point Likert scale, respectively, with the scores for each subscale ranging from 0 to 100. The higher the score, the more positive a patient's experiences are, and the more satisfied s/he is with nursing care. In this study, we used the Brazilian version of the scale measuring patient satisfaction with nursing care.1313. Dorigan GH, Guirardello EB, Silva D, McColl E. Validation of the Brazilian version of the Newcastle Satisfaction with Nursing Scales: a partial least squares path modeling approach. J Nurs Meas [Internet]. 2014 [cited 2016 Oct 02];22(3):451-60. Available from: https://doi.org/10.1891/1061-3749.22.3.451
https://doi.org/10.1891/1061-3749.22.3.4...

Data were initially typed in a Microsoft Office Excel 2010 spreadsheet and later submitted to statistical analysis using the Statistical Analysis System (SAS) software, version 9.4 and Smart PLS 3.2.1.

A descriptive analysis to characterize the participants was performed for the continuous variables, and a frequency table was created with absolute values (n) and percentages (%) for the categorical variables.

Structural construct validity

A confirmatory factor analysis was performed to assess structural construct validity, considering the partial least squares estimation method (PLS). The factor analysis comprised two steps: analysis of convergent validity and discriminant validity of the models proposed.

The Average Variance Extracted (AVE) results were first assessed for each of the model’s domains to analyze convergent validity. AVE values higher than 0.5 indicate that the model converges to a satisfactory result.1414. Ringle CM, Silva D, Bido D. Structural equation modeling with the SMARTPLS. Rev Bras Mark [Internet]. 2014 [cited 2016 Oct 02];13(2):56-73. Available from: https://doi.org/10.5585/remark.v13i2.2717
https://doi.org/10.5585/remark.v13i2.271...
The factor loadings between the items and their respective domains were assessed, and items with loadings below 0.5 were candidates to leave the factor model. Factor loadings should be at least greater than 0.5; ideally higher than 0.7.1414. Ringle CM, Silva D, Bido D. Structural equation modeling with the SMARTPLS. Rev Bras Mark [Internet]. 2014 [cited 2016 Oct 02];13(2):56-73. Available from: https://doi.org/10.5585/remark.v13i2.2717
https://doi.org/10.5585/remark.v13i2.271...

The discriminant validity was first assessed using the Fornell-Larcker criterion.1515. Fornell C, Larcker DF. Evaluating structural equation models with unobservable variable and measurement error. J Mark Res [Internet]. 1981 [cited 2016 Oct 02];18(1):39-50. https://doi.org/10.2307/3151312
https://doi.org/10.2307/3151312...
This method compares the AVE’s square roots with the correlations between the domains. The model presents discriminant validity if the AVE’s square roots are higher than the correlations between the domains. Discriminant validity was also assessed by cross-loading analysis. An instrument has discriminant validity if its items present a higher factor loading in the domain in which they were previously assigned than in the others.

As the QUOTE-HIV comprises the importance and performance components in its structure, analyses were performed for both, although the original instrument 55. Hekkink CF, Sixma HJ, Wigersma L, Yzermans CJ, Van Der Meer JTM, Bindels PJE, et al. QUOTE-HIV: an instrument for assessing quality of HIV care from the patients' perspective. Qual Saf Health Care [Internet]. 2003 [cited 2016 Oct 02];12:188-93. Available from: https://doi.org/10.1136/qhc.12.3.188
https://doi.org/10.1136/qhc.12.3.188...
only uses the importance component in its analyses. Thus, two validated models remained at the end of the study, one for each part, both statistically validated.

In order to establish which version would better assess the nursing care provided to HIV-infected individuals, we first gathered and exhaustively evaluated each of the instrument’s versions without knowing the values obtained in the statistical analyses to avoid choice bias. Next, the confirmatory factor analysis results and convergent construct validity were compared. Therefore, the best version of the QUOTE-HIV instrument was determined based on these qualitative and quantitative assessments.

Convergent construct validity

Convergent construct validity was verified considering the correlation between the scores obtained in the instrument’s three domains and the total score of the NSNS Brazilian version; the Spearman correlation coefficient was used. Coefficients between 0.1 and 0.29 were considered weak; between 0.30 and 0.49 moderate; and above than or equal to 0.50 corresponded to strong correlations.1616. Cohen J. A power primer. Psychol Bull [Internet]. 1992 [cited 2016 Oct 02];112(1):155-9. Available from: https://psycnet.apa.org/doi/10.1037/0033-2909.112.1.155
https://psycnet.apa.org/doi/10.1037/0033...
A significance level of 5% was adopted in these analyses.

Reliability

Reliability was estimated by verifying the internal consistency of the instrument’s domains using Cronbach’s Alpha and composite reliability to check if the instrument’s items were homogeneous. Values above 0.70 were considered evidence of satisfactory internal consistency.1111. Hair JF, Anderson RE, Tathan RL, Black WC. Análise multivariada de dados. Porto Alegre, RS(BR): Bookman; 2009.

This study complied with the ethical guidelines provided by Resolution 466/2012, Brazilian National Health Council/Ministry of Health - CNS/MS.

RESULTS

A total of 141 volunteers, aged 41 years on average, attending the HIV/AIDS referral service for 9.45 years, with approximately 10 years of schooling and a monthly income of 2 to 4 times the minimum wage (31.91%) participated in the study. The other characteristics of the participants can be seen in Table 1.

Table 1 -
Participants’ characterization. Campinas, SP, Brazil, 2016. (n=141).

Structural construct validity

Confirmatory factor analysis was performed based on the domains of the instrument's original model, considering both the importance and performance components.

Initially, the model's convergent validity was assessed, verifying the factor loadings and the AVE values obtained for the domains. Items with factor loadings or AVE lower than 0.5 were deleted from the structural model. Then, the models were re-estimated, with the factor loadings and AVE reassessed whenever a new item was eliminated. Items 1, 2, 3, 5, 6, 7, 14, 17, 18, 21, 22 from the Importance component and 5, 16, 21, and 23 from the Performance component were eliminated according to convergent validity criteria.

Next, the model’s discriminant validity was assessed by comparing the AVE’s square roots with the correlations between the domains and by assessing the items’ cross-loadings to determine the final structural model. Finally, items 10 from the Importance component and 2, 7, 8, 12, 13, and 15 from the Performance component were eliminated.

After assessing discriminant validity criteria, the final models of importance (Figure 1) and performance (Figure 2) were obtained.

Figure 1 -
QUOTE-HIV final factorial model for the Importance component. Campinas, SP, Brazil, 2016.

Figure 2 -
QUOTE-HIV final factorial model for the Performance component. Campinas, SP, Brazil, 2016.

Reliability

After the factor analysis, the QUOTE-HIV internal consistency, assessed through composite reliability and Cronbach's alpha, was considered adequate in all domains concerning Performance (Cronbach's alpha and Composite Reliability >0.70). On the other hand, regarding the Importance component, the care organization domain presented a Cronbach's alpha <0.70. Table 2 presents the reliability and AVE values for the final models of each of the components and their respective domains.

Table 2
AVE, Cronbach’s alpha, and Competitive Reliability for the final structural models of QUOTE-HIV. Campinas, SP, Brazil, 2016.

Convergent construct validity

Convergent construct validity, assessed by the correlation of the scores obtained in the QUOTE-HIV domains and the NSNS’ total score, was significant in all the correlations in the instrument’s performance component. Regarding the importance component, the domain “professional performance” did not present a significant correlation (p-value = 0.0662) (Table 3).

Table 3 -
Spearman’s correlation coefficients between the scores obtained in the QUOTE-HIV domains and the NSNS total score. Campinas, SP, Brazil, 2016.

Regarding the magnitude of correlations, all the Performance’s domains presented moderate positive correlation. Regarding the Importance component, the correlations were also of moderate positive magnitude for the domains with significant correlation.

DISCUSSION

Regarding the participants’ characteristics, the mean age was 41 (SD=10.54) and 9.45 years (SD=7.14) was how long the participants attended the service, a period that ranged from 1 to 33 years, showing the sample’s heterogeneity; an aspect observed in other Brazilian HIV/AIDS referral services, given the epidemic’s dynamic profile.1717. Menezes AMF, Almeida KT, Nascimento AKA, Dias GCM, Nascimento JC. Epidemiological profile of seropositive individuals for HIV/aids. J Nurs UFPE on line [Internet]. 2018 [cited 2022 Mar 03];12(5):1225-32. Available from: https://periodicos.ufpe.br/revistas/revistaenfermagem/article/view/230907
https://periodicos.ufpe.br/revistas/revi...
-1818. Gonçales LFR, Montanha RM, Rodrigues R, Kerbauy G, Furuya RK, Ferreira NMA, et al. Caracterização epidemiológica e clínica do HIV/Aids: associações com a mortalidade. REAS [Internet]. 2021 [cited 2022 Jun 8];13(1):e5293. Available from: https://acervomais.com.br/index.php/saude/article/view/5293
https://acervomais.com.br/index.php/saud...

At the end of the confirmatory factor analysis process, two culturally adapted final versions of the QUOTE-HIV instrument were obtained, one for the Importance component and one for Performance. A qualitative and quantitative assessment was performed to determine which of the versions would be considered the definitive Brazilian version.19

The instruments’ composition was assessed item by item in the qualitative analysis to ensure greater specificity and verify each item’s representativeness in the nursing care provided to individuals with HIV infection. The qualitative assessment’s objective was to seek the meaning of each item, focusing on the specificities of the group being assessed.1919. Kaur N, Pluye P, Vedel I. Practical mixed methods strategies used to integrate qualitative and quantitative methods in community-based primary health care research. Fam Pract [Internet]. 2019 [cited 2022 Apr 25];36(5):666-71. Available from: https://doi.org/10.1093/fampra/cmz010
https://doi.org/10.1093/fampra/cmz010...
-2020. Almeida ACG, Maciel RFA, Santos RR, Araújo SG. HIV: from primary care to antiretroviral therapies in current days, a bibliographic study on ART and patient adhesion. Braz J Dev [Internet]. 2021 [cited 2022 Jun 8];7(11):108771-82. Available from: https://doi.org/10.34117/bjdv7n11-483
https://doi.org/10.34117/bjdv7n11-483...

As part of this assessment, the number of items that composed each version was verified, with the version based on the Performance domain containing 13 items and the version based on the Importance domain containing 11 items. Next, coincident questions were identified, with five identical items in both instruments.

The next step was to verify if the questionnaires had different questions but with a certain similarity regarding the topic under study. Two questions of the performance model - “The nursing staff informs me about the pros and cons of a treatment” and “The nursing staff gives me information about possible side effects of drugs” - and a question of the Importance model. - “The nursing staff explains my medications clearly” - were essentially concerned with the treatment provided to individuals with HIV infection and, therefore, choosing one model or the other would not harm an investigation of the quality of nursing care regarding the guidelines established for the treatment provided to these individuals.44. Loch AP, Nemes MIB, Santos MA, Alves AM, Melchior R, Basso CR, et al. Evaluation of outpatient services in the Brazilian Unified National Health System for persons living with HIV: a comparison of 2007 and 2010. Cad Saude Publica [Internet]. 2018 [cited 2022 Jun 06];34(2):e00047217. Available from: http://doi.org/10.1590/0102-311X00047217
http://doi.org/10.1590/0102-311X00047217...
,2020. Almeida ACG, Maciel RFA, Santos RR, Araújo SG. HIV: from primary care to antiretroviral therapies in current days, a bibliographic study on ART and patient adhesion. Braz J Dev [Internet]. 2021 [cited 2022 Jun 8];7(11):108771-82. Available from: https://doi.org/10.34117/bjdv7n11-483
https://doi.org/10.34117/bjdv7n11-483...

Antiretroviral therapy’s effectiveness in treating people with HIV infection is already well established in the scientific literature, but such effectiveness depends mainly on patients’ adherence to the antiretrovirals.2020. Almeida ACG, Maciel RFA, Santos RR, Araújo SG. HIV: from primary care to antiretroviral therapies in current days, a bibliographic study on ART and patient adhesion. Braz J Dev [Internet]. 2021 [cited 2022 Jun 8];7(11):108771-82. Available from: https://doi.org/10.34117/bjdv7n11-483
https://doi.org/10.34117/bjdv7n11-483...
The factors that influence adherence to antiretroviral therapy are related to the individuals, the presence of comorbidities, the drugs prescribed, and the quality of care provided in the health services where an individual is assisted. Providing opportunities for patients and health workers to discuss the main problems faced in HIV treatment can be an essential strategy for improving adherence.2121. Dalmida SG, McCoy K, Koenig HG, Miller A, Holstad MM, Thomas TL, et al. Correlates and predictors of medication adherence in outpatients living with HIV/AIDS. J HIV AIDS Soc Serv [Internet]. 2018 [cited 2022 Jun 8];17(4):402-20. Available from: https://doi.org/10.1080/15381501.2018.1502709
https://doi.org/10.1080/15381501.2018.15...

Once identical and similar items were identified in the instrument’s versions, we carefully assessed and compared the remaining questions in both questionnaires. Therefore, relevant aspects in the nursing care provided to individuals with HIV infection, which the instrument was supposed to assess, were considered.2222. Brooks Carthon JM, Hatfield L, Plover C, Dierkes A, Davis L, Hedgeland T, et al. Association of nurse engagement and nurse staffing on patient safety. J Nurs Care Qual [Internet]. 2019 [cited 2022 May 05];34(1):40-6. Available from: https://doi.org/10.1097/NCQ.0000000000000334
https://doi.org/10.1097/NCQ.000000000000...
-2323. Ferreira NCLQ, Menegueti MG, Almeida CL, Gabriel CS, Laus AM. Evaluation of nursing care quality standards using process indicators. Cogitare Enferm [Internet]. 2019 [cited 2022 Jun 11];24:e62411. Available from: http://doi.org/10.5380/ce.v24i0.62411
http://doi.org/10.5380/ce.v24i0.62411...
Thus, considering the domains composing the original instrument, we assessed which of the instrument's versions had a set of questions that best investigated “care organization,” “nursing professional’s attitude,” and “professional performance.” The conclusion is that the questions of the model based on the Performance component met the study’s demands - both in quantity and quality terms.1919. Kaur N, Pluye P, Vedel I. Practical mixed methods strategies used to integrate qualitative and quantitative methods in community-based primary health care research. Fam Pract [Internet]. 2019 [cited 2022 Apr 25];36(5):666-71. Available from: https://doi.org/10.1093/fampra/cmz010
https://doi.org/10.1093/fampra/cmz010...

There is evidence in the literature that the results of the care provided to patients, as well as their satisfaction with care delivery, are directly related to the way in which nursing professionals organize care.2222. Brooks Carthon JM, Hatfield L, Plover C, Dierkes A, Davis L, Hedgeland T, et al. Association of nurse engagement and nurse staffing on patient safety. J Nurs Care Qual [Internet]. 2019 [cited 2022 May 05];34(1):40-6. Available from: https://doi.org/10.1097/NCQ.0000000000000334
https://doi.org/10.1097/NCQ.000000000000...

Therefore, the care provided by nursing professionals cannot be restricted to its technical aspect but also be expressed through attitudes and by the relationship established with the Therefore, the care provided by nursing professionals cannot be restricted to its technical aspect but also be expressed through attitudes and by the relationship established with the care receiver. Nursing professionals should allow patients to talk about their feelings and doubts so that they can obtain the necessary guidelines and information and be able to understand information.2323. Ferreira NCLQ, Menegueti MG, Almeida CL, Gabriel CS, Laus AM. Evaluation of nursing care quality standards using process indicators. Cogitare Enferm [Internet]. 2019 [cited 2022 Jun 11];24:e62411. Available from: http://doi.org/10.5380/ce.v24i0.62411
http://doi.org/10.5380/ce.v24i0.62411...

The quantitative assessment was the next step, and the statistical analyses were considered in the decision-making process. The factor analyses for the Importance and Performance components showed satisfactory convergent and discriminant validity.

As for the reliability of the instrument’s versions, the model based on the Performance component showed adequate internal consistency (at the end) for all its domains, while Cronbach’s alpha was not adequate (<0.70) for the domain “care organization” from the version based on the Importance component.

The model based on the Performance component showed significant results in convergent construct validity analysis for all correlations performed with the NSNS. On the other hand, the version based on the Importance component did not present a significant correlation between professional performance and the NSNS instrument.

Considering both qualitative and quantitative analyses of the QUOTE-HIV final versions, based on the structural modeling in the confirmatory factor analysis, the decision was that the instrument that would best assess the quality of care provided to individuals with HIV infection was the one based on the Performance component. This instrument comprises 13 items distributed in the exact three domains as the original version, namely: professional’s attitude (items 1, 8, 11, and 12), professional performance (items 4, 5, 6, and 7), and care organization (2, 3, 9, 10 and 13).

The QUOTE-HIV Brazilian version was sent to the authors of the original instrument, who approved its structure and final composition and its use to assess the nursing care provided to HIV-infected individuals in Brazil.

This study's limitation concerns the fact that an instrument's reliability and validity are not fixed properties and, therefore, vary according to the circumstances, population, and objective. A reliable instrument for several situations may not present the same reliability in different circumstances; hence, its measurement characteristics should constantly be tested.2424. Souza AC, Alexandre NMC, Guirardello EB. Psychometric properties in instruments evaluation of reliability and validity. Epidemiol Serv Saude [Internet]. 2017 [cited 2022 Apr 02];26(3):649-59. Available from: https://doi.org/10.5123/S1679-49742017000300022
https://doi.org/10.5123/S1679-4974201700...
-2525. Ferreira AG, Barlem ELD, Rocha LP, Tomaschewski Barlem JG, Dalmolin GL, Figueira AB. Cultural adaptation and validation of the Moral Sensitivity Questionnaire among Brazilian nurses. Texto Contexto Enferm [Internet]. 2021 [cited 2022 Jan 03];30:e20190266. Available from: https://doi.org/10.1590/1980-265X-TCE-2019-0266
https://doi.org/10.1590/1980-265X-TCE-20...

CONCLUSION

According to the convergent and structural construct validity methods performed here, the QUOTE-HIV Brazilian version presented evidence of reliability, with adequate consistency and internal validity.

The final QUOTE-HIV model showed significant results in the convergent construct validity analysis for all the correlations performed with the Newcastle Satisfaction with Nursing Scales (NSNS). In addition, all the domains showed a moderate positive correlation regarding the magnitude of correlations.

Regarding the reliability verification, the QUOTE-HIV internal consistency, assessed through composite reliability and Cronbach's alpha, was considered adequate in all domains.

This study can contribute to the Brazilian literature as it presents an instrument with evidence of reliability and validity to assess the perspective of individuals with HIV infection concerning the quality of nursing care delivery.

REFERENCES

  • 1. Greco DB. Thirty years of confronting the Aids epidemic in Brazil, 1985-2015. Ciênc Saúde Colet [Internet]. 2016 [cited 2017 Jan 14];21(5):1553-64. Available from: https://doi.org/10.1590/1413-81232015215.04402016
    » https://doi.org/10.1590/1413-81232015215.04402016
  • 2. Freitas JP, Sousa LRM, Cruz MCMA, Caldeira NMVP, Gir E. Antiretroviral therapy: compliance level and the perception of HIV/Aids patients. Acta Paul Enferm [Internet]. 2018 [cited 2020 Nov 20];31(3):327-33. Available from: https://doi.org/10.1590/1982-0194201800046
    » https://doi.org/10.1590/1982-0194201800046
  • 3. Carvalho PP, Barrosos SM, Coelho HC, Penaforte FRO. Factors associated with antiretroviral therapy adherence in adults: an integrative review of literature. Ciênc Saúde Colet [Internet]. 2019 [cited 2022 Jun 01];24(7):2543-55. Available from: https://doi.org/10.1590/1413-81232018247.22312017
    » https://doi.org/10.1590/1413-81232018247.22312017
  • 4. Loch AP, Nemes MIB, Santos MA, Alves AM, Melchior R, Basso CR, et al. Evaluation of outpatient services in the Brazilian Unified National Health System for persons living with HIV: a comparison of 2007 and 2010. Cad Saude Publica [Internet]. 2018 [cited 2022 Jun 06];34(2):e00047217. Available from: http://doi.org/10.1590/0102-311X00047217
    » http://doi.org/10.1590/0102-311X00047217
  • 5. Hekkink CF, Sixma HJ, Wigersma L, Yzermans CJ, Van Der Meer JTM, Bindels PJE, et al. QUOTE-HIV: an instrument for assessing quality of HIV care from the patients' perspective. Qual Saf Health Care [Internet]. 2003 [cited 2016 Oct 02];12:188-93. Available from: https://doi.org/10.1136/qhc.12.3.188
    » https://doi.org/10.1136/qhc.12.3.188
  • 6. Lima TC, Freitas MIP. Cultural adaptation of Quality of Care Through the Patient’s Eyes -QUOTE-HIV. Rev Bras Enferm [Internet]. 2018 [cited 2020 Nov 20];71(1):47-56. Available from: https://doi.org/10.1590/0034-7167-2016-0113
    » https://doi.org/10.1590/0034-7167-2016-0113
  • 7. Beaton D, Bombardier C, Guillemin F, Ferraz MB. Recommendations for the Cross-Cultural Adaptation of the DASH & Quick DASH Outcome Measures. Institute for Work & Health [Internet]. 2007 [cited 2016 Oct 02]. Available from: https://www.researchgate.net/publication/265000941_Recommendations_for_the_Cross-Cultural_Adaptation_of_the_DASH_QuickDASH_Outcome_Measures_Contributors_to_this_Document
    » https://www.researchgate.net/publication/265000941_Recommendations_for_the_Cross-Cultural_Adaptation_of_the_DASH_QuickDASH_Outcome_Measures_Contributors_to_this_Document
  • 8. Oliveira F, Kuznier TP, Souza CC, Chianca TCM. Theoretical and methodological aspects for the cultural adaptation and validation of instruments in nursing. Texto Contexto Enferm [Internet]. 2018 [cited 2022 Jun 03];27(2):e4900016. Available from: https://doi.org/10.1590/0104-070720180004900016
    » https://doi.org/10.1590/0104-070720180004900016
  • 9. Boateng GO, Neilands TB, Frongillo EA, Melgar-Quiñonez HR, Young SL. Best practices for developing and validating scales for health, social, and behavioral research: a Primer. Front Public Health [Internet]. 2018 [cited 2022 Jun 03];6:149. Available from: https://doi.org/10.3389/fpubh.2018.00149
    » https://doi.org/10.3389/fpubh.2018.00149
  • 10. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res [Internet]. 2010 [cited 2016 Oct 02];19(4):539-49. Available from: https://doi.org/10.1007/s11136-010-9606-8
    » https://doi.org/10.1007/s11136-010-9606-8
  • 11. Hair JF, Anderson RE, Tathan RL, Black WC. Análise multivariada de dados. Porto Alegre, RS(BR): Bookman; 2009.
  • 12. Hekkink CF, Wigersma L, Yzermans CJ, Bindels PJ. HIV nursing consultants: patients' preferences and experiences about the quality of care. J Clin Nurs [Internet]. 2005 [cited 2016 Oct 02];14(3):327-33. Available from: https://doi.org/10.1111/j.1365-2702.2004.01061.x
    » https://doi.org/10.1111/j.1365-2702.2004.01061.x
  • 13. Dorigan GH, Guirardello EB, Silva D, McColl E. Validation of the Brazilian version of the Newcastle Satisfaction with Nursing Scales: a partial least squares path modeling approach. J Nurs Meas [Internet]. 2014 [cited 2016 Oct 02];22(3):451-60. Available from: https://doi.org/10.1891/1061-3749.22.3.451
    » https://doi.org/10.1891/1061-3749.22.3.451
  • 14. Ringle CM, Silva D, Bido D. Structural equation modeling with the SMARTPLS. Rev Bras Mark [Internet]. 2014 [cited 2016 Oct 02];13(2):56-73. Available from: https://doi.org/10.5585/remark.v13i2.2717
    » https://doi.org/10.5585/remark.v13i2.2717
  • 15. Fornell C, Larcker DF. Evaluating structural equation models with unobservable variable and measurement error. J Mark Res [Internet]. 1981 [cited 2016 Oct 02];18(1):39-50. https://doi.org/10.2307/3151312
    » https://doi.org/10.2307/3151312
  • 16. Cohen J. A power primer. Psychol Bull [Internet]. 1992 [cited 2016 Oct 02];112(1):155-9. Available from: https://psycnet.apa.org/doi/10.1037/0033-2909.112.1.155
    » https://psycnet.apa.org/doi/10.1037/0033-2909.112.1.155
  • 17. Menezes AMF, Almeida KT, Nascimento AKA, Dias GCM, Nascimento JC. Epidemiological profile of seropositive individuals for HIV/aids. J Nurs UFPE on line [Internet]. 2018 [cited 2022 Mar 03];12(5):1225-32. Available from: https://periodicos.ufpe.br/revistas/revistaenfermagem/article/view/230907
    » https://periodicos.ufpe.br/revistas/revistaenfermagem/article/view/230907
  • 18. Gonçales LFR, Montanha RM, Rodrigues R, Kerbauy G, Furuya RK, Ferreira NMA, et al. Caracterização epidemiológica e clínica do HIV/Aids: associações com a mortalidade. REAS [Internet]. 2021 [cited 2022 Jun 8];13(1):e5293. Available from: https://acervomais.com.br/index.php/saude/article/view/5293
    » https://acervomais.com.br/index.php/saude/article/view/5293
  • 19. Kaur N, Pluye P, Vedel I. Practical mixed methods strategies used to integrate qualitative and quantitative methods in community-based primary health care research. Fam Pract [Internet]. 2019 [cited 2022 Apr 25];36(5):666-71. Available from: https://doi.org/10.1093/fampra/cmz010
    » https://doi.org/10.1093/fampra/cmz010
  • 20. Almeida ACG, Maciel RFA, Santos RR, Araújo SG. HIV: from primary care to antiretroviral therapies in current days, a bibliographic study on ART and patient adhesion. Braz J Dev [Internet]. 2021 [cited 2022 Jun 8];7(11):108771-82. Available from: https://doi.org/10.34117/bjdv7n11-483
    » https://doi.org/10.34117/bjdv7n11-483
  • 21. Dalmida SG, McCoy K, Koenig HG, Miller A, Holstad MM, Thomas TL, et al. Correlates and predictors of medication adherence in outpatients living with HIV/AIDS. J HIV AIDS Soc Serv [Internet]. 2018 [cited 2022 Jun 8];17(4):402-20. Available from: https://doi.org/10.1080/15381501.2018.1502709
    » https://doi.org/10.1080/15381501.2018.1502709
  • 22. Brooks Carthon JM, Hatfield L, Plover C, Dierkes A, Davis L, Hedgeland T, et al. Association of nurse engagement and nurse staffing on patient safety. J Nurs Care Qual [Internet]. 2019 [cited 2022 May 05];34(1):40-6. Available from: https://doi.org/10.1097/NCQ.0000000000000334
    » https://doi.org/10.1097/NCQ.0000000000000334
  • 23. Ferreira NCLQ, Menegueti MG, Almeida CL, Gabriel CS, Laus AM. Evaluation of nursing care quality standards using process indicators. Cogitare Enferm [Internet]. 2019 [cited 2022 Jun 11];24:e62411. Available from: http://doi.org/10.5380/ce.v24i0.62411
    » http://doi.org/10.5380/ce.v24i0.62411
  • 24. Souza AC, Alexandre NMC, Guirardello EB. Psychometric properties in instruments evaluation of reliability and validity. Epidemiol Serv Saude [Internet]. 2017 [cited 2022 Apr 02];26(3):649-59. Available from: https://doi.org/10.5123/S1679-49742017000300022
    » https://doi.org/10.5123/S1679-49742017000300022
  • 25. Ferreira AG, Barlem ELD, Rocha LP, Tomaschewski Barlem JG, Dalmolin GL, Figueira AB. Cultural adaptation and validation of the Moral Sensitivity Questionnaire among Brazilian nurses. Texto Contexto Enferm [Internet]. 2021 [cited 2022 Jan 03];30:e20190266. Available from: https://doi.org/10.1590/1980-265X-TCE-2019-0266
    » https://doi.org/10.1590/1980-265X-TCE-2019-0266

NOTES

  • ORIGIN OF THE ARTICLE

    Article extracted from the the thesis - Adaptação cultural e validação do quality of care through the patient’s eyes - HIV (QUOTE-HIV) para população brasileira que vive com HIV/AIDS, presente to the Programa de Pós-Graduação em Enfermagem, Faculdade de Enfermagem, Universidade Estadual de Campinas, in 2016.
  • APPROVAL OF ETHICS COMMITTEE IN RESEARCH

    Approved by the Ethics Committee in Research of the Faculdade de Ciências Médicas da Universidade Estadual de Campinas, opinion. 694.222/2014, CCertificate of Presentation for Ethical Appreciation (CAAE) 30211714.8.0000.5404.

SUPPLEMENTARY MATERIAL

The following online material is available for this article:

QUOTE-HIV - versão brasileira.

Edited by

EDITORS

Associated Editors: Glilciane Morceli, Ana Izabel Jatobá de Souza. Editor-in-chief: Roberta Costa.

Publication Dates

  • Publication in this collection
    14 Oct 2022
  • Date of issue
    2022

History

  • Received
    18 Feb 2022
  • Accepted
    20 June 2022
Universidade Federal de Santa Catarina, Programa de Pós Graduação em Enfermagem Campus Universitário Trindade, 88040-970 Florianópolis - Santa Catarina - Brasil, Tel.: (55 48) 3721-4915 / (55 48) 3721-9043 - Florianópolis - SC - Brazil
E-mail: textoecontexto@contato.ufsc.br