Acessibilidade / Reportar erro

Construction and validity of the Interprofessional Communication in Health Scale

Construcción y validación de la Escala de Comunicación Interprofesional en Salud

ABSTRACT

Objectives:

to construct and validate the Interprofessional Communication Scale in Health.

Methods:

a psychometric study was carried out on a sample of 360 nurses from a hospital and university center in central Portugal. Reliability was assessed through internal consistency and construct validity through exploratory and confirmatory factor analysis.

Results:

the Interprofessional Communication in Health Scale, consisting of 27 items, is organized into 3 factors: “Teamwork”, “Conflict management” and “Leadership”, with a total variance of 51.1%. Good internal consistency was obtained, with a Cronbach’s alpha of 0.842, and adequate Goodness of Fit Index model.

Conclusions:

the Interprofessional Communication in Health Scale presents a factorial structure with adequate validity and reliability results, and may constitute a useful self-report instrument in assessing interprofessional communication in health.

Descriptors:
Communication; Patient Care Team; Nursing; Validation Study; Psychometrics.

RESUMEN

Objetivos:

construir y validar la Escala de Comunicación Interprofesional en Salud.

Métodos:

el estudio psicométrico se realizó sobre una muestra de 360 enfermeras de un centro hospitalario y universitario del centro de Portugal. La confiabilidad se evaluó a través de la consistencia interna y la validez de constructo mediante análisis factorial exploratorio y confirmatorio.

Resultados:

la Escala de Comunicación Interprofesional en Salud, compuesta por 27 ítems, se organiza en 3 factores: “Trabajo en equipo”, “Gestión de conflictos” y “Liderazgo”, con una varianza total del 51,1%. Se obtuvo una buena consistencia interna, con un alfa de Cronbach de 0,842, y adecuados índices de bondad de ajuste del modelo.

Conclusiones:

la Escala de Comunicación Interprofesional en Salud presenta una estructura factorial con resultados adecuados de validez y confiabilidad, pudiendo constituir un instrumento de autoinforme útil en la evaluación de la comunicación interprofesional en salud.

Descriptores:
Comunicación; Grupo de Atención al Paciente; Enfermería; Estudio de Validación; Psicometría.

RESUMO

Objetivos:

construir e validar a Escala de Comunicação Interprofissional em Saúde.

Métodos:

o estudo psicométrico foi realizado em uma amostra com 360 enfermeiros de um centro hospitalar e universitário da região centro de Portugal. A confiabilidade foi avaliada através da consistência interna e a validade do construto pela análise fatorial exploratória e confirmatória.

Resultados:

a Escala de Comunicação Interprofissional em Saúde, constituída por 27 itens, está organizada em 3 fatores: “Trabalho em equipe”, “Gestão de conflitos” e “Liderança”, com uma variância total de 51,1%. Obtiveram-se boa consistência interna, com alfa de Cronbach de 0,842, e índices adequados de qualidade de ajustamento do modelo.

Conclusões:

a Escala de Comunicação Interprofissional em Saúde apresenta uma estrutura fatorial com resultados adequados de validade e de confiabilidade, podendo constituir-se um instrumento de autorresposta útil na avaliação da comunicação interprofissional em saúde.

Descritores:
Comunicação; Equipe de Assistência ao Paciente; Enfermagem; Estudo de Validação; Psicometria.

INTRODUCTION

Communication processes in the hospital environment are complex and dynamic, due to the enormous flow of information, the different teams of professionals and numerous highly complex interventions(11 Petry L, Diniz MBC. Communication between teams and the care transfer of critical patients. Rev Rene. 2020;21:e43080. https://doi.org/10.15253/2175-6783.20202143080
https://doi.org/10.15253/2175-6783.20202...
). We continue to witness work overload due to lack of human resources, lack of standardization of conduct, inexperience of professionals and lack of leadership, factors that can lead to failures in communication and jeopardize the care provided to patient(22 Previato GF, Baldissera VDA. Communication in the dialogical perspective of collaborative interprofessional practice in primary health care. Interface: Commun, Health, Educ. 2018;22:1535-47. https://doi.org/10.1590/1807-57622017.0647
https://doi.org/10.1590/1807-57622017.06...

3 Noce LGA, Oliveira TS, Melo LC, Silva KFB, Parreira BDM, Goulart BF. Interprofessional relationships of a patient assistance team in critical care. Rev Bras Enferm. 2020;73(4): e20190420. https://doi.org/10.1590/0034-7167-2019-0420
https://doi.org/10.1590/0034-7167-2019-0...
-44 Coifman AHM, Pedreira LC, Jesus APS, Batista REA. Interprofessional communication in an emergency care unit: a case study. Rev Esc Enferm. 2021;55: e03781. https://doi.org/10.1590/S1980-220X2020047303781
https://doi.org/10.1590/S1980-220X202004...
). The persistence of hierarchical practices among different professionals, conflicts at work, difficulties in understanding the other’s role, do not favor teamwork and influence the way interprofessional communication is established(11 Petry L, Diniz MBC. Communication between teams and the care transfer of critical patients. Rev Rene. 2020;21:e43080. https://doi.org/10.15253/2175-6783.20202143080
https://doi.org/10.15253/2175-6783.20202...
,44 Coifman AHM, Pedreira LC, Jesus APS, Batista REA. Interprofessional communication in an emergency care unit: a case study. Rev Esc Enferm. 2021;55: e03781. https://doi.org/10.1590/S1980-220X2020047303781
https://doi.org/10.1590/S1980-220X202004...

5 Freire Filho JR, Silva CBG, Costa MV, Forster AC. Educação Interprofissional nas políticas de reorientação da formação profissional em saúde no Brasil. Saúde Debate. 2019;43(spe1):86-96. https://doi.org/10.1590/0103-11042019S107
https://doi.org/10.1590/0103-11042019S10...
-66 Claramita M, Riskiyana R, Susilo AP, Huriyati E, Wahyuningsih MSH, Norcini JJ. Interprofessional communication in a socio-hierarchical culture: development of the TRI-O guide. J Multidiscip Healthc. 2019;12:191-204. https://doi.org/10.2147/JMDH.S196873
https://doi.org/10.2147/JMDH.S196873...
).

Health professionals inevitably work together, but are trained to work separately, which constitutes a barrier to the development of collaborative practices and effective teamwork(55 Freire Filho JR, Silva CBG, Costa MV, Forster AC. Educação Interprofissional nas políticas de reorientação da formação profissional em saúde no Brasil. Saúde Debate. 2019;43(spe1):86-96. https://doi.org/10.1590/0103-11042019S107
https://doi.org/10.1590/0103-11042019S10...
). It is imperative to break with the uniprofessional culture, with a stereotyped view of what a professional team is, which does not automatically translate into collaboration between professionals(77 Diniz ALTM, Melo RHV, Vilar RLA. Análise de uma Prática Interprofissional Colaborativa na Estratégia Saúde da Família. Rev Ciênc Plural. 2021;7(3):137-57. https://doi.org/10.21680/2446-7286.2021v7n3ID23953
https://doi.org/10.21680/2446-7286.2021v...
).

Effective interprofessional communication favors continuous care, minimizing the occurrence of errors and contributing to patient safety(88 Olino L, Gonçalves AC, Karine J, Strada R, Becker Vieira L, Luiza M, et al. Effective communication for patient safety: transfer note and Modified Early Warning Score. Rev Gaúcha Enferm. 2019;40(esp):e2:20180341. https://doi.org/10.1590/1983-1447.2019.20180341
https://doi.org/10.1590/1983-1447.2019.2...
). However, it is essential that professionals, regardless of the category to which they belong, make shared decisions, build knowledge in a dialogical way, taking into account the vision and mission of hospital organization(22 Previato GF, Baldissera VDA. Communication in the dialogical perspective of collaborative interprofessional practice in primary health care. Interface: Commun, Health, Educ. 2018;22:1535-47. https://doi.org/10.1590/1807-57622017.0647
https://doi.org/10.1590/1807-57622017.06...
,66 Claramita M, Riskiyana R, Susilo AP, Huriyati E, Wahyuningsih MSH, Norcini JJ. Interprofessional communication in a socio-hierarchical culture: development of the TRI-O guide. J Multidiscip Healthc. 2019;12:191-204. https://doi.org/10.2147/JMDH.S196873
https://doi.org/10.2147/JMDH.S196873...
,99 Moreira FTLDS, Callou RCM, Albuquerque GA, Oliveira RM. Estratégias de comunicação efetiva no gerenciamento de comportamentos destrutivos e promoção da segurança do paciente. Rev Gaucha Enferm. 2019;40(spe):e20180308. https://doi.org/10.1590/1983-1447.2019.20180308
https://doi.org/10.1590/1983-1447.2019.2...
). Dialogue should be understood as a tool to consolidate interprofessional communication, which is recognized as the capacity for effective communication between people, especially from different professions, and considered essential to achieve collaborative interprofessional practice in health(22 Previato GF, Baldissera VDA. Communication in the dialogical perspective of collaborative interprofessional practice in primary health care. Interface: Commun, Health, Educ. 2018;22:1535-47. https://doi.org/10.1590/1807-57622017.0647
https://doi.org/10.1590/1807-57622017.06...
,1010 Canadian Interprofessional Health Collaborative. A National Interprofessional Competency Framework [Internet]. Canada: University of British Columbia; 2010 [cited 2022 Jan 20].11-23 p. Available from: https://phabc.org/wp-content/uploads/2015/07/CIHC-National-Interprofessional-Competency-Framework.pdf
https://phabc.org/wp-content/uploads/201...
).

Teamwork, interprofessional conflict resolution and collaborative leadership are essential domains for promoting effective interprofessional collaboration(1010 Canadian Interprofessional Health Collaborative. A National Interprofessional Competency Framework [Internet]. Canada: University of British Columbia; 2010 [cited 2022 Jan 20].11-23 p. Available from: https://phabc.org/wp-content/uploads/2015/07/CIHC-National-Interprofessional-Competency-Framework.pdf
https://phabc.org/wp-content/uploads/201...
). In this perspective, it becomes relevant to invest in training models in health proposed by the World Health Organization, pointing to integrated and interactive learning, with structured information systems and processes, effective communication strategies, policies for conflict resolution and frequent dialogues between the teams(55 Freire Filho JR, Silva CBG, Costa MV, Forster AC. Educação Interprofissional nas políticas de reorientação da formação profissional em saúde no Brasil. Saúde Debate. 2019;43(spe1):86-96. https://doi.org/10.1590/0103-11042019S107
https://doi.org/10.1590/0103-11042019S10...
,1111 World Health Organization (WHO). Framework for Action on Interprofessional Education & Collaborative Practice [Internet]. Geneva: World Health Organization, Department of Human Resources for Health; 2010[cited 2022 Jan 22].12-31p. Available from: https://apps.who.int/iris/bitstream/handle/10665/70185/WHO_HRH_HPN_10.3_eng.pdf?sequence=1&isAllowed=y
https://apps.who.int/iris/bitstream/hand...
-1212 Belarmino AC, Rodrigues MENG, Anjos SJSB, Ferreira Júnior AR. Collaborative practices from health care teams to face the covid-19 pandemic. Rev Bras Enferm. 2020;73(Suppl 6):e20200470. https://doi.org/10.1590/0034-7167-2020-0470
https://doi.org/10.1590/0034-7167-2020-0...
), where differences of opinion should be assumed as constructive interactions(99 Moreira FTLDS, Callou RCM, Albuquerque GA, Oliveira RM. Estratégias de comunicação efetiva no gerenciamento de comportamentos destrutivos e promoção da segurança do paciente. Rev Gaucha Enferm. 2019;40(spe):e20180308. https://doi.org/10.1590/1983-1447.2019.20180308
https://doi.org/10.1590/1983-1447.2019.2...
).

The role of leading nurses is essential in the development of teamwork, capable of influencing collective work and multidisciplinary interaction for better health outcomes(1313 Valentim LV, Luz RA, Santos LSC, Silva Noca CR. Perception of nursing professionals regarding teamwork. Rev Baiana Enferm. 2020;34:1-8. https://doi.org/10.18471/rbe.v34.37510
https://doi.org/10.18471/rbe.v34.37510...
). This leader’s commitment presupposes an authentic leadership process, implying self-knowledge about their strengths, limitations, coherence in its actions, transparency in the sharing of information and a role of influencing others through its proactive, ethical and responsible behavior in order to build an environment of trust and integrity in health services(1414 Maziero V, Bernardes Gomes A, Vendas Righetti EA, Spiri WC, Gabriel CS. Aspectos positivos da liderança autêntica no trabalho do enfermeiro: enfermeiro: revisão integrativa Positive. Rev Bras Enferm. 2020;73(6): e20190118. https://doi.org/10.1590/0034-7167-2019-0118
https://doi.org/10.1590/0034-7167-2019-0...
-1515 Mondini CCSD, Cunha ICKO, Trettene ADS, Fontes CMB, Bachega MI, Cintra FMR. Authentic leadership among nursing professionals: knowledge and profile. Rev Bras Enferm. 2020;73(4):e20180888. https://doi.org/10.1590/0034-7167-2018-0888
https://doi.org/10.1590/0034-7167-2018-0...
).

Effective communication with assertive behavior when sharing information, an interpersonal relationship anchored in collaboration, respect and mutual help, has an impact not only on patient safety, but also on professionals’ professional and personal scope(33 Noce LGA, Oliveira TS, Melo LC, Silva KFB, Parreira BDM, Goulart BF. Interprofessional relationships of a patient assistance team in critical care. Rev Bras Enferm. 2020;73(4): e20190420. https://doi.org/10.1590/0034-7167-2019-0420
https://doi.org/10.1590/0034-7167-2019-0...
,99 Moreira FTLDS, Callou RCM, Albuquerque GA, Oliveira RM. Estratégias de comunicação efetiva no gerenciamento de comportamentos destrutivos e promoção da segurança do paciente. Rev Gaucha Enferm. 2019;40(spe):e20180308. https://doi.org/10.1590/1983-1447.2019.20180308
https://doi.org/10.1590/1983-1447.2019.2...
), being considered one of the international goals of patient safety, established by the Joint Commission International in partnership with the World Health Organization.

Communication skills cannot be improved only with clinical experience; they must be trained, improved, validated, to promote changes in health professionals’ attitude and behavior, with a beneficial effect on their self-efficacy and with the aim of improving health service quality(1616 Mata ÁNS, Azevedo KPM, Braga LP, Medeiros GCBS, Segundo VHO, Bezerra INM, et al. Training in communication skills for self-efficacy of health professionals: a systematic review. Hum Resour Health. 2021;19(1):30. https://doi.org/10.1186/s12960-021-00574-3
https://doi.org/10.1186/s12960-021-00574...
).

In the literature review, no instruments were found that would allow an assessment of interprofessional communication in health, in some of the competence domains referenced by the Canadian Interprofessional Health Collaborative. Thus, it is understood the importance of developing a self-completion instrument that will allow data on interprofessional communication skills to be obtained. Thus, the study aimed to build and validate the Interprofessional Communication in Health Scale (ECIpS - Escala de Comunicação Interprofissional em Saúde).

OBJECTIVES

To construct and validate the Interprofessional Communication in Health Scale.

METHODS

Ethical aspects

The study was conducted in accordance with international ethics guidelines and approved by the ethics committee integrated in the innovation and development unit -clinical trials center and by the board of directors of the hospital and university center in the central region of Portugal, obtaining formal authorization for study continuation. Carrying out the study safeguarded, at different times of the process, the ethical and deontological principles enshrined in the Declaration of Helsinki and in the Portuguese legislation in force that governs research with human beings (Decree Law 80/2018). Free and informed consent was obtained from all participants involved in the study, expressed in writing.

Study design, period, and place

This is a psychometric study with nurses from a hospital and university center in central Portugal. The research took place from September 2018 to May 2019. The COSMIN (consensus-based standards for the selection of health measurement instruments) protocol was used for the research design, in accordance with the EQUATOR network(1717 Mokkink LB, Prinsen CA, Patrick D, Alonso J, Bouter LM, Vet HC, et al. COSMIN Study Design checklist for Patient-reported outcome measurement instruments [Internet]. Amsterdam: Department of Epidemiology and Biostatistics; 2019[cited 2022 Feb 22]. 4-28 p. Available from: https://www.cosmin.nl/wp-content/uploads/COSMIN-study-designing-checklist_final.pdf
https://www.cosmin.nl/wp-content/uploads...
).

Population or sample; inclusion and exclusion criteria

The sample of this study is non-probabilistic for convenience, consisting of 360 nurses. The sample calculation was performed taking into account the criteria for carrying out the factor analysis, respecting the ratio of 10:1 (number of respondents for each item of the questionnaire), to obtain stable factor solutions(1818 Hill MM. Investigação por questionário. 2a edição. Lisboa: Edições Sílabo; 2016. 52-58 p.). As inclusion criteria, all nurses who provided direct care to users at the hospital and university center in the central region of Portugal were considered. The exclusion criteria established were performing functions as a nurse manager and being temporarily absent from the service during the data collection period, due to a medical certificate, vacation leave or other leave.

Study protocol

The construction of this scale was supported by an exhaustive literature review, the competence domains highlighted by the National Interprofessional Competency Framework(1010 Canadian Interprofessional Health Collaborative. A National Interprofessional Competency Framework [Internet]. Canada: University of British Columbia; 2010 [cited 2022 Jan 20].11-23 p. Available from: https://phabc.org/wp-content/uploads/2015/07/CIHC-National-Interprofessional-Competency-Framework.pdf
https://phabc.org/wp-content/uploads/201...
) and the teaching-learning objectives identified in the Health Professions Core Communication Curriculum (HPCCC) of the European Association for Communication in Health Care (EACH)(1919 Bachmann C, Abramovitch H, Barbu CG, Cavaco AM, Elorza RD, Haak R, et al. A European consensus on learning objectives for a core communication curriculum in health care professions. Patient Educ Couns. 2013;93(1):18-26. https://doi.org/10.1016/j.pec.2012.10.016
https://doi.org/10.1016/j.pec.2012.10.01...
), which can allow assessing clinical communication according to the institutional needs and specificities and/or professional groups.

In an initial phase, the items that allowed measuring the construct under study were defined, obtaining a provisional version of an instrument consisting of 40 items. Next, we proceeded to content validity, using two procedures: judges’ analysis and semantic analysis. The panel of judges consisted of a psychometrist, two professors and a clinical practice nurse, experts in the area of communication, who assessed language clarity, item practical and theoretical pertinence(2020 Supo J. Cómo validar un instrumento: aprende a crear y validar instrumentos como un experto. [Internet]. Arequipa [Perú] : Bioestadístico; 2013 [cited 2021 Dec 18]. Available from: http://www.cua.uam.mx/pdfs/coplavi/s_p/doc_ng/validacion-de-instrumentos-de-medicion.pdf
http://www.cua.uam.mx/pdfs/coplavi/s_p/d...
), having defined as a criterion to incorporate the items with agreement between judges above 75%(2121 Polit DF, Beck CT. Fundamentos de pesquisa em enfermagem: avaliação de evidências para a prática de Enfermagem. 9a ed. Porto Alegre: Artmed; 2019. 174-179 p.). Regarding the Content Validity Coefficient (CVC) per judge, this was between 0.777 and 0.883. The final calculation of CVC with polarization factor was 0.830. The validity ratio coefficient was determined using the Lawshe model adjusted by Tristan(2222 Tristán-López A. Modificación al Modelo de Lawshe para el Dictamen Cuantitativo de la Validez de Contenido de un Instrumento Objetivo. Av Medición [Internet]. 2008 [cited 2022 Oct 27];6:37-48. Available from: https://www.humanas.unal.edu.co/lab_psicometria/application/files/9716/0463/3548/VOL_6._Articulo4_Indice_de_validez_de_contenido_37-48.pdf
https://www.humanas.unal.edu.co/lab_psic...
), for content validity quantitative verification, given that the number of panelists is less than 5. The minimum acceptable for the adjusted validity ratio is 0.582. In this study, six of the items were eliminated, as they presented values below the acceptable value for the validity ratio in all measured criteria, there was no inter-judge agreement. We also found that three items on the scale had values of 0.5 in the theoretical relevance criterion. However, the value close to the minimum acceptable for theoretical relevance, adequate values in the other two criteria and the intention to subsequently carry out an exploratory and confirmatory analysis, allowed us to assume these three items for the final scale.

The consensus version consisted of 34 items, being submitted to a pre-test with 17 nurses from clinical practice, where the study would take place, in order to analyze item understanding, clarity and applicability. All modifications and suggestions presented were incorporated into the final version of the scale. Participants were asked to respond to each item on a 5-point scale, between “never” (1) and “always” (5), intending to assess the theoretical dimensions of communication in health teams, with higher values revealing better interprofessional communication skills in health. The final instrument, called the Interprofessional Communication in Health Scale (ECIpS - Escala de Comunicação Interprofissional em Saúde), also included a questionnaire that allowed the sociodemographic characterization.

Analysis of results, and statistics

Data analysis was performed using the software IBM® SPSS® Statistics for Windows, version 27.0 (IBM Corp., Armonk, N.Y., USA), and the AMOS® 27 software (Analysis of Moment Structures)(2323 Arbuckle JL. Amos (Version 27.0) [Computer Program]. Chicago: IBM SPSS; 2014.).

Reliability studies configured the determination of item internal consistency or homogeneity through Pearson’s correlation coefficient (correlations greater than 0.20), determination of Cronbach’s alpha coefficient, considering good internal consistency values greater than 0.80(2424 Marôco J. Análise estatística com o SPSS Statistics. 8a ed. Pêro Pinheiro: Pêro Pinheiro: ReportNumber; 2021. 459-470 p.) and determination of McDonald’s omega coefficient, which considers acceptable values of 0.70 and 0.90 and good internal consistency values greater than 0.90(2525 Ventura-León JL, Caycho-Rodríguez T. El coeficiente Omega: un método alternativo para la estimación de la confiabilidad. Rev Latinoam Cienc Soc, Niñ Juv. 2017;15(1):625-7. https://doi.org/10.20882/adicciones.962
https://doi.org/10.20882/adicciones.962...
).

To extract common factors from item interpretation, an exploratory factor analysis (EFA) was applied. EFA applicability was verified through: (i) the Kaiser-Mayer-Olkin coefficient (KMO> 0.5); (ii) Bartlett’s sphericity test (p< 0.05); and (iii) the main diagonal values of the anti-image matrix of correlations with a measure of sample adequacy greater than 0.5. The principal components (PC) method was used to reduce the original items to a lower number of common factors, based on three aspects: Kaiser criterion (eigenvalues greater than 1); scree plot criterion; and total extracted variance (50% is the minimum acceptable value). The process of interpreting the extracted factors was optimized using orthogonal rotation (Varimax) of the axes.

In the confirmatory factor analysis (CFA), the model was estimated using the maximum likelihood method, previously assessing the assumptions of normality through the coefficients of asymmetry (Sk<=3), kurtosis (Ku<= 7) and Mardia’s multivariate coefficient (< 5)(2626 Kline RB. Principles and Practice of Structural Equation Modeling. 4th ed. New York : The Guilford Press; 2016. 262-277 p.). Overall Goodness of Fit Indexes were taken into account, such as the ratio between chi-square and degrees of freedom (x22 Previato GF, Baldissera VDA. Communication in the dialogical perspective of collaborative interprofessional practice in primary health care. Interface: Commun, Health, Educ. 2018;22:1535-47. https://doi.org/10.1590/1807-57622017.0647
https://doi.org/10.1590/1807-57622017.06...
/df), considering a good fit values lower than 2-3, acceptable, if lower than 5, and unacceptable, if higher than 5(2727 Wheaton B. Assessment of fit in overidentified models with latent variables. Sociol Methods Res. 1987;16:118-54. https://doi.org/10.1177/0049124187016001005
https://doi.org/10.1177/0049124187016001...
). Goodness of Fit Index (GFI) and Comparative Fit Index (CFI) values equal to 1 are indicators of a model with perfect fit to the data; values greater than 0.95 indicate an optimal fit; values between 0.90 and 0.95 point to a good fit; and values below 0.9 indicate a poor fit(2828 Tanaka JS, Huba GJ. A fit index for covariance structure models under arbitrary GLS estimation. British J Math Statist Psychol. 1985;38:197-201. https://doi.org/10.1111/j.2044-8317.1985.tb00834.x
https://doi.org/10.1111/j.2044-8317.1985...
). However, we can consider values between 0.8 and 0.9 indicating a model with a poor fit to the data(2929 Marôco J. Análise de equações estruturais : fundamentos teóricos, software & aplicações. 3a ed. Pêro Pinheiro: Pêro Pinheiro: ReportNumber; 2021.). Regarding the Root Mean Square Error of Approximation (RMSEA), optimal adjustments are considered when values are considered lower than 0.05, good, for values between 0.05 and 0.08, and unacceptable, for values greater than 0, 08(3030 Browne MW, Cudeck R. Alternative Ways of Assessing Model Fit. Sociol Methods Res. 1992;21(2). https://doi.org/10.1177/0049124192021002005
https://doi.org/10.1177/0049124192021002...
). A 90% confidence interval (CI) is calculated for the RMSEA, considering that an upper limit of 90% CI of less than 0.1 is indicative of a good fit(2929 Marôco J. Análise de equações estruturais : fundamentos teóricos, software & aplicações. 3a ed. Pêro Pinheiro: Pêro Pinheiro: ReportNumber; 2021.). Standardized Root Mean Square Residual (SRMR) values are considered good when less than 0.08, considering a perfect fit when root mean (RMR)=0(3131 Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equat Model. 1999;6(1):1-55. https://doi.org/10.1080/10705519909540118
https://doi.org/10.1080/1070551990954011...
). In the model adjustment, modification indices greater than 11, proposed by AMOS, were considered(2323 Arbuckle JL. Amos (Version 27.0) [Computer Program]. Chicago: IBM SPSS; 2014.).

The local adjustment quality was carried out through factorial weights (λ) greater than 0.50, which may be relaxed to 0.40 in exploratory psychometric studies, due to individual item reliability (r2) with coefficients equal to or greater than 0.25 and the composite reliability (CR), which considers good internal consistency factors with values above 0.70(2929 Marôco J. Análise de equações estruturais : fundamentos teóricos, software & aplicações. 3a ed. Pêro Pinheiro: Pêro Pinheiro: ReportNumber; 2021.,3232 Hair JF, Babin BJ, Anderson RE, Black WC. Multivariate Data Analysis. 8th ed. UK: Cengage; 2018.). One of the conditions for considering the existence of a higher-order hierarchical factor is the existence of strong correlations (correlation values close to 1) and statistically significant between first-order factors, the existence of at least three first-order factors and a conceptual support that support the existence of the factors(3333 Bollen KA. Structural Equations with Latent Variables. New York: Wiley; 1989.).

Convergent validity was assessed by average variance extracted (AVE), discriminant validity by comparing AVE with Pearson’s correlation square, and construct reliability assessed by CR. Reference values were considered to be AVE>0.5, CR≥0.7 and existence of discriminant validity when the squared correlation between the factors is lower than the AVE for each factor(2626 Kline RB. Principles and Practice of Structural Equation Modeling. 4th ed. New York : The Guilford Press; 2016. 262-277 p.,2929 Marôco J. Análise de equações estruturais : fundamentos teóricos, software & aplicações. 3a ed. Pêro Pinheiro: Pêro Pinheiro: ReportNumber; 2021.).

RESULTS

Sample characteristics

The sample under study consists mostly of female nurses (82.8%), with an average age of 42 years. Most nurses are married or living in a stable relationship (63.6%). Predominantly, 78.6% of nurses hold a degree in nursing as academic qualifications, and 38.3%, as specialist nurse. On average, nurses have 19 years of professional experience. Of the participants, 5.3% participated in training courses on communication techniques and communication in health teams.

Interprofessional Communication in Health Scale psychometric property analysis

To validate the ECIpS psychometric quality, reliability and validity studies were carried out. In an initial phase, the reliability value was calculated for the total of the 34 items that make up the scale. With regard to item-total correlation coefficients, most items showed good correlation rates, with the exception of items 7.30 and 31, which are below the critical value of 0.20 defined as the minimum limit. Cronbach’s alpha coefficients per item were analyzed again, and were found to be above 0.8, with an overall Cronbach’s alpha of 0.876 after eliminating the three items(3434 Pestana MH, Gageiro JN. Análise de dados para ciências sociais: a complementariedade do SPSS. 6a ed. Lisboa: Edições Silabo; 2014. 528 p.) and a McDonald’s omega value of 0.928(2525 Ventura-León JL, Caycho-Rodríguez T. El coeficiente Omega: un método alternativo para la estimación de la confiabilidad. Rev Latinoam Cienc Soc, Niñ Juv. 2017;15(1):625-7. https://doi.org/10.20882/adicciones.962
https://doi.org/10.20882/adicciones.962...
). Thus, the EFA proceeded based on this structure of items that meet the initial criteria to remain in the statistical procedure. The average values and respective standard deviations of the different items, as a whole, are well centered, being above the expected average index according to Table 1.

Table 1
Internal consistency of the Interprofessional Communication in Health Scale items (N=360), Coimbra, Beira Litoral, Portugal, 2018-2019

The factor analysis applicability was verified using the Kaiser-Mayer-Olkin coefficients (KMO = 0.930), which allows classifying it as excellent by Bartlett’s sphericity test (p < 0.000) and by the values of the main diagonal of the anti-image matrix of correlations with measures of sampling adequacy greater than 0.5, which allows proceeding with the factor analysis(2424 Marôco J. Análise estatística com o SPSS Statistics. 8a ed. Pêro Pinheiro: Pêro Pinheiro: ReportNumber; 2021. 459-470 p.).

The initial factorial solution presented a structure with 7 factors that together explained 59.67% of the total variance. The proportion of the variance of each variable explained by the factors (commonality) is within the reference values (0.40) when they oscillate between 0.43 and 0.76. However, the scree plots graph configured the existence of three factors, so a new factorial analysis was carried out, forcing three factors. All factors have factor loadings in items greater than 0.40, except items 11, 14, 18 and 21, so these items were excluded and a new extraction was performed. The final factorial solution explains 51.1% of the total variance after rotation. Factor 1 was called “Teamwork” and explains 37.9% of the total variance, consisting of items 1, 2, 3, 4, 5, 6, 8, 9, 10 and 12. Factor 2, “Conflict management”, comprises items 13, 15, 16, 17, 23, 24, 25, 27 and 28 and explains 8.4% of the total variance. Factor 3 was called “Leadership” and consists of items 19, 20, 22, 26, 29, 32, 33 and 34 and explains 4.8% of the total variance, as shown in Table 2.

Table 2
Matrix of principal components after Varimax rotation of the 27 items (N=360), Coimbra, Beira Litoral, Portugal, 2018-2019

After analyzing item sensitivity, it was observed that, in general, the values of asymmetry and kurtosis do not compromise the CFA’s performance(2626 Kline RB. Principles and Practice of Structural Equation Modeling. 4th ed. New York : The Guilford Press; 2016. 262-277 p.), since in absolute values they oscillate between 0.04 and 0.94 for asymmetry and between 0.03 and 2.46 for kurtosis. Mardia’s multivariate coefficient is 4.17. These values fall short of the reference values. The critical ratios of the paths between latent and manifest variables are statistically significant, leading to item maintenance. Figure 1 presents the four-factor model, where the 27 items distributed by the corresponding factors are observed as well as the respective factor weights and their individual reliability. It is visible that item IIIC15 of factor 2 and items IIIC33 and IIIC34 of factor 3 have saturations and individual reliability lower than recommended, which is why they will be eliminated. In the initial model (Figure 1), most of GFI were adequate, x2/df=2.85, for RMR=0.02, SRMR= 0.06 and RMSEA=0.07 (with upper limit of 90%CI of 0.077), with the exception of GFI=0.83, CFI=0.87, which revealed a poor fit.

Figure 1
Initial model with 27 items, Coimbra, Beira Litoral, Portugal, 2018-2019

The model was refined using the modification indices (MI), as shown in Figure 2. After assessing the theoretical plausibility of modifications, the measurement errors that led to the improvement of the measurement adjustment were correlated, with the exception of the GFI index =0.87, which remains in a poor fit.

Figure 2
Model with deleted items and modification indexes, Coimbra, Beira Litoral, 2018-2019

All factors considered to be 1st order are positively and significantly correlated (“Teamwork” and “Conflict management” (r=0.70; p<0.01), “Conflict management” and “Leadership” (r= 0.93; p<0.01) and “Teamwork” and “Leadership” (r=0.70; p<0.01)). These correlations suggest the existence of a hierarchical structure with a second-order factor called Interprofessional Communication in Health (CIpS). Figure 3 illustrates the obtained model, noting that the highest correlational intensity of the CIpS construct is verified with the “Leadership” dimension (r=0.99; p<0.01) followed by the “Conflict management” dimension (r=0.99; p<0.01). =0.94; p<0.01) and “Teamwork” (r=0.74; p<0.01).

Figure 3
2nd order model, Coimbra, Beira Litoral, Portugal, 2018-2019

The following overall GFI were obtained for the second-order model: x2/df=2.48; RMR=0.02; SRMR=0.05; RMSEA=0.06 (90%CI upper limit of 0.071); GFI=0.87; and CFI=0.91. The CR of the factors proved to be adequate, being 0.9 for the factor “Teamwork” and “Conflict management” and 0.8 for the factor “Leadership”(3232 Hair JF, Babin BJ, Anderson RE, Black WC. Multivariate Data Analysis. 8th ed. UK: Cengage; 2018.). Convergent validity, obtained through AVE, was not confirmed, since all factors had indexes below 0.50. The discriminant validity is only evident between the factors F1Teamwork vs F3Leadership=0.55(2929 Marôco J. Análise de equações estruturais : fundamentos teóricos, software & aplicações. 3a ed. Pêro Pinheiro: Pêro Pinheiro: ReportNumber; 2021.). The study of this scale is concluded, verifying that the correlations are positive and statistically significant (p<0.01), with all factors being strongly associated with its overall dimension (2nd order factor). On the other hand, it appears that the factors are significantly associated with each other in a reasonable to moderate way, with values ranging between r=0.61 and r=0.77. The relationship between F2Conflict Management and F3Leadership with r(358)=0.77, p<0.01, and F1Teamwork with F3Leadership r(358)=0.67, p<0.01 stands out.

DISCUSSION

The use of self-completion instruments allows the development of understanding, reflective, critical and creative thinking(3535 Cotta RMM, Costa GD. Instrumento de avaliação e autoavaliação do portfólio reflexivo: uma construção teórico-conceitual. Interface Comun, Saúde, Educ. 2016;20(56):171-83. https://doi.org/10.1590/1807-57622014.1303
https://doi.org/10.1590/1807-57622014.13...
). The construction and validity of instruments that measure communication skills in health teams are of great interest, as they are fundamental tools for health professionals who strive for excellent care.

The ECIpS generally presented good indicators of reliability and validity, as verified by the results obtained. The sample with 360 participants has a ratio of 10.58 respondents per item, giving robustness to the results obtained(1818 Hill MM. Investigação por questionário. 2a edição. Lisboa: Edições Sílabo; 2016. 52-58 p.). Regarding the scale reliability, the results show good item internal consistency and homogeneity. An overall Cronbach’s alpha coefficient of 0.876 was found, which is classified as adequate(2626 Kline RB. Principles and Practice of Structural Equation Modeling. 4th ed. New York : The Guilford Press; 2016. 262-277 p.) and a McDonald’s omega of 0.928(2525 Ventura-León JL, Caycho-Rodríguez T. El coeficiente Omega: un método alternativo para la estimación de la confiabilidad. Rev Latinoam Cienc Soc, Niñ Juv. 2017;15(1):625-7. https://doi.org/10.20882/adicciones.962
https://doi.org/10.20882/adicciones.962...
). The KMO of 0.930 and Bartlett’s sphericity test with a statistically significant probability (p=0.000) were indicative of continuing with the exploratory factor analysis(3636 Gärtner FR, Bomhof-Roordink H, Smith IP, Scholl I, Stiggelbout AM, Pieterse AH. The quality of instruments to assess the process of shared decision making: a systematic review. PLoS ONE. 2018;13(2):e0191747. https://doi.org/10.1371/journal.pone.0191747
https://doi.org/10.1371/journal.pone.019...
). Carrying out the factorial analysis, using the PC method, with Varimax-type orthogonal rotation and eigenvalues greater than 1, allowed explaining 51.1% of total variance, involving a theoretically acceptable number of factors and constituting the best solution in relation to the interpretation and meaning of dimensions(3737 Cunha CM, Almeida Neto OP, Stackfleth R. Main psychometric evaluation methods of the validity of measuring instruments. Rev Atenç Saúde. 2016;14(47):75-83. https://doi.org/10.13037/ras.vol14n47.3391
https://doi.org/10.13037/ras.vol14n47.33...
).

Submitting this four-factor structure to CFA, using the maximum likelihood method, led to the elimination of some items, after the respecification of the model, because they present multicollinearity problems and saturations below 0.40, considered the minimum coefficient, since this is a preliminary study of the scale(2929 Marôco J. Análise de equações estruturais : fundamentos teóricos, software & aplicações. 3a ed. Pêro Pinheiro: Pêro Pinheiro: ReportNumber; 2021.).

The final second-order model revealed adequate composite reliability indices and overall GFI, with the exception of GFI index=0.87, which remains in a poor fit(2929 Marôco J. Análise de equações estruturais : fundamentos teóricos, software & aplicações. 3a ed. Pêro Pinheiro: Pêro Pinheiro: ReportNumber; 2021.). In this regard, it is recommended in the future to replicate the psychometric study in larger samples to obtain greater sensitivity and also to carry out parallel analyzes to confirm this factorial structure in a more in-depth way using other types of software such as FACTOR® or statistical program R®.

Overall, the scale consisting of 24 items organized into three factors, “Teamwork”, “Conflict management”, and “Leadership”, demonstrates to be able to assess interprofessional communication in health.

Study limitations

The study limitations are related to the fact that the sampling technique is non-probabilistic for convenience, limiting the generalization of results. An assessment was not carried out through direct observation, which would avoid the influence of the critical and reflective capacity of those who assess themselves.

Contributions to nursing and health

This multidimensional assessment instrument will allow obtaining data on interprofessional communication skills in health, which support training interventions, in order to encourage collaborative interprofessional practice. This instrument, which assesses key dimensions for communication in health teams, will contribute to improving health team practices, anchored in effective, cohesive and consolidated communication.

CONCLUSIONS

Health organizations are spaces of strong interaction between different professionals. In this regard, interprofessional communication in a clinical context is fundamental, considering the need for safe and effective responses in health care provision. It was in this sense that the ECIpS was created and the present psychometric study is justified. This scale consists of 24 items organized into three dimensions: Teamwork; Conflict management; and Leadership.

The study of ECIpS psychometric characteristics makes it possible to state that it is a robust instrument and certifies its quality and the theoretical relevance of each item included in the three dimensions that constitute it. ECIpS constitutes a valuable resource for assessing interprofessional communication skills in health, sensitizing nurses and other health professionals to this topic, in order to build the necessary collaborative interfaces to better converge in response to health challenges.

We suggested that more studies be carried out at a national level with the scale replication, obtaining increasingly better model adjustment indices.

AVAILABILITY OF DATA AND MATERIAL

https://doi.org/10.48331/scielodata.JAZSA3

REFERENCES

  • 1
    Petry L, Diniz MBC. Communication between teams and the care transfer of critical patients. Rev Rene. 2020;21:e43080. https://doi.org/10.15253/2175-6783.20202143080
    » https://doi.org/10.15253/2175-6783.20202143080
  • 2
    Previato GF, Baldissera VDA. Communication in the dialogical perspective of collaborative interprofessional practice in primary health care. Interface: Commun, Health, Educ. 2018;22:1535-47. https://doi.org/10.1590/1807-57622017.0647
    » https://doi.org/10.1590/1807-57622017.0647
  • 3
    Noce LGA, Oliveira TS, Melo LC, Silva KFB, Parreira BDM, Goulart BF. Interprofessional relationships of a patient assistance team in critical care. Rev Bras Enferm. 2020;73(4): e20190420. https://doi.org/10.1590/0034-7167-2019-0420
    » https://doi.org/10.1590/0034-7167-2019-0420
  • 4
    Coifman AHM, Pedreira LC, Jesus APS, Batista REA. Interprofessional communication in an emergency care unit: a case study. Rev Esc Enferm. 2021;55: e03781. https://doi.org/10.1590/S1980-220X2020047303781
    » https://doi.org/10.1590/S1980-220X2020047303781
  • 5
    Freire Filho JR, Silva CBG, Costa MV, Forster AC. Educação Interprofissional nas políticas de reorientação da formação profissional em saúde no Brasil. Saúde Debate. 2019;43(spe1):86-96. https://doi.org/10.1590/0103-11042019S107
    » https://doi.org/10.1590/0103-11042019S107
  • 6
    Claramita M, Riskiyana R, Susilo AP, Huriyati E, Wahyuningsih MSH, Norcini JJ. Interprofessional communication in a socio-hierarchical culture: development of the TRI-O guide. J Multidiscip Healthc. 2019;12:191-204. https://doi.org/10.2147/JMDH.S196873
    » https://doi.org/10.2147/JMDH.S196873
  • 7
    Diniz ALTM, Melo RHV, Vilar RLA. Análise de uma Prática Interprofissional Colaborativa na Estratégia Saúde da Família. Rev Ciênc Plural. 2021;7(3):137-57. https://doi.org/10.21680/2446-7286.2021v7n3ID23953
    » https://doi.org/10.21680/2446-7286.2021v7n3ID23953
  • 8
    Olino L, Gonçalves AC, Karine J, Strada R, Becker Vieira L, Luiza M, et al. Effective communication for patient safety: transfer note and Modified Early Warning Score. Rev Gaúcha Enferm. 2019;40(esp):e2:20180341. https://doi.org/10.1590/1983-1447.2019.20180341
    » https://doi.org/10.1590/1983-1447.2019.20180341
  • 9
    Moreira FTLDS, Callou RCM, Albuquerque GA, Oliveira RM. Estratégias de comunicação efetiva no gerenciamento de comportamentos destrutivos e promoção da segurança do paciente. Rev Gaucha Enferm. 2019;40(spe):e20180308. https://doi.org/10.1590/1983-1447.2019.20180308
    » https://doi.org/10.1590/1983-1447.2019.20180308
  • 10
    Canadian Interprofessional Health Collaborative. A National Interprofessional Competency Framework [Internet]. Canada: University of British Columbia; 2010 [cited 2022 Jan 20].11-23 p. Available from: https://phabc.org/wp-content/uploads/2015/07/CIHC-National-Interprofessional-Competency-Framework.pdf
    » https://phabc.org/wp-content/uploads/2015/07/CIHC-National-Interprofessional-Competency-Framework.pdf
  • 11
    World Health Organization (WHO). Framework for Action on Interprofessional Education & Collaborative Practice [Internet]. Geneva: World Health Organization, Department of Human Resources for Health; 2010[cited 2022 Jan 22].12-31p. Available from: https://apps.who.int/iris/bitstream/handle/10665/70185/WHO_HRH_HPN_10.3_eng.pdf?sequence=1&isAllowed=y
    » https://apps.who.int/iris/bitstream/handle/10665/70185/WHO_HRH_HPN_10.3_eng.pdf?sequence=1&isAllowed=y
  • 12
    Belarmino AC, Rodrigues MENG, Anjos SJSB, Ferreira Júnior AR. Collaborative practices from health care teams to face the covid-19 pandemic. Rev Bras Enferm. 2020;73(Suppl 6):e20200470. https://doi.org/10.1590/0034-7167-2020-0470
    » https://doi.org/10.1590/0034-7167-2020-0470
  • 13
    Valentim LV, Luz RA, Santos LSC, Silva Noca CR. Perception of nursing professionals regarding teamwork. Rev Baiana Enferm. 2020;34:1-8. https://doi.org/10.18471/rbe.v34.37510
    » https://doi.org/10.18471/rbe.v34.37510
  • 14
    Maziero V, Bernardes Gomes A, Vendas Righetti EA, Spiri WC, Gabriel CS. Aspectos positivos da liderança autêntica no trabalho do enfermeiro: enfermeiro: revisão integrativa Positive. Rev Bras Enferm. 2020;73(6): e20190118. https://doi.org/10.1590/0034-7167-2019-0118
    » https://doi.org/10.1590/0034-7167-2019-0118
  • 15
    Mondini CCSD, Cunha ICKO, Trettene ADS, Fontes CMB, Bachega MI, Cintra FMR. Authentic leadership among nursing professionals: knowledge and profile. Rev Bras Enferm. 2020;73(4):e20180888. https://doi.org/10.1590/0034-7167-2018-0888
    » https://doi.org/10.1590/0034-7167-2018-0888
  • 16
    Mata ÁNS, Azevedo KPM, Braga LP, Medeiros GCBS, Segundo VHO, Bezerra INM, et al. Training in communication skills for self-efficacy of health professionals: a systematic review. Hum Resour Health. 2021;19(1):30. https://doi.org/10.1186/s12960-021-00574-3
    » https://doi.org/10.1186/s12960-021-00574-3
  • 17
    Mokkink LB, Prinsen CA, Patrick D, Alonso J, Bouter LM, Vet HC, et al. COSMIN Study Design checklist for Patient-reported outcome measurement instruments [Internet]. Amsterdam: Department of Epidemiology and Biostatistics; 2019[cited 2022 Feb 22]. 4-28 p. Available from: https://www.cosmin.nl/wp-content/uploads/COSMIN-study-designing-checklist_final.pdf
    » https://www.cosmin.nl/wp-content/uploads/COSMIN-study-designing-checklist_final.pdf
  • 18
    Hill MM. Investigação por questionário. 2a edição. Lisboa: Edições Sílabo; 2016. 52-58 p.
  • 19
    Bachmann C, Abramovitch H, Barbu CG, Cavaco AM, Elorza RD, Haak R, et al. A European consensus on learning objectives for a core communication curriculum in health care professions. Patient Educ Couns. 2013;93(1):18-26. https://doi.org/10.1016/j.pec.2012.10.016
    » https://doi.org/10.1016/j.pec.2012.10.016
  • 20
    Supo J. Cómo validar un instrumento: aprende a crear y validar instrumentos como un experto. [Internet]. Arequipa [Perú] : Bioestadístico; 2013 [cited 2021 Dec 18]. Available from: http://www.cua.uam.mx/pdfs/coplavi/s_p/doc_ng/validacion-de-instrumentos-de-medicion.pdf
    » http://www.cua.uam.mx/pdfs/coplavi/s_p/doc_ng/validacion-de-instrumentos-de-medicion.pdf
  • 21
    Polit DF, Beck CT. Fundamentos de pesquisa em enfermagem: avaliação de evidências para a prática de Enfermagem. 9a ed. Porto Alegre: Artmed; 2019. 174-179 p.
  • 22
    Tristán-López A. Modificación al Modelo de Lawshe para el Dictamen Cuantitativo de la Validez de Contenido de un Instrumento Objetivo. Av Medición [Internet]. 2008 [cited 2022 Oct 27];6:37-48. Available from: https://www.humanas.unal.edu.co/lab_psicometria/application/files/9716/0463/3548/VOL_6._Articulo4_Indice_de_validez_de_contenido_37-48.pdf
    » https://www.humanas.unal.edu.co/lab_psicometria/application/files/9716/0463/3548/VOL_6._Articulo4_Indice_de_validez_de_contenido_37-48.pdf
  • 23
    Arbuckle JL. Amos (Version 27.0) [Computer Program]. Chicago: IBM SPSS; 2014.
  • 24
    Marôco J. Análise estatística com o SPSS Statistics. 8a ed. Pêro Pinheiro: Pêro Pinheiro: ReportNumber; 2021. 459-470 p.
  • 25
    Ventura-León JL, Caycho-Rodríguez T. El coeficiente Omega: un método alternativo para la estimación de la confiabilidad. Rev Latinoam Cienc Soc, Niñ Juv. 2017;15(1):625-7. https://doi.org/10.20882/adicciones.962
    » https://doi.org/10.20882/adicciones.962
  • 26
    Kline RB. Principles and Practice of Structural Equation Modeling. 4th ed. New York : The Guilford Press; 2016. 262-277 p.
  • 27
    Wheaton B. Assessment of fit in overidentified models with latent variables. Sociol Methods Res. 1987;16:118-54. https://doi.org/10.1177/0049124187016001005
    » https://doi.org/10.1177/0049124187016001005
  • 28
    Tanaka JS, Huba GJ. A fit index for covariance structure models under arbitrary GLS estimation. British J Math Statist Psychol. 1985;38:197-201. https://doi.org/10.1111/j.2044-8317.1985.tb00834.x
    » https://doi.org/10.1111/j.2044-8317.1985.tb00834.x
  • 29
    Marôco J. Análise de equações estruturais : fundamentos teóricos, software & aplicações. 3a ed. Pêro Pinheiro: Pêro Pinheiro: ReportNumber; 2021.
  • 30
    Browne MW, Cudeck R. Alternative Ways of Assessing Model Fit. Sociol Methods Res. 1992;21(2). https://doi.org/10.1177/0049124192021002005
    » https://doi.org/10.1177/0049124192021002005
  • 31
    Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equat Model. 1999;6(1):1-55. https://doi.org/10.1080/10705519909540118
    » https://doi.org/10.1080/10705519909540118
  • 32
    Hair JF, Babin BJ, Anderson RE, Black WC. Multivariate Data Analysis. 8th ed. UK: Cengage; 2018.
  • 33
    Bollen KA. Structural Equations with Latent Variables. New York: Wiley; 1989.
  • 34
    Pestana MH, Gageiro JN. Análise de dados para ciências sociais: a complementariedade do SPSS. 6a ed. Lisboa: Edições Silabo; 2014. 528 p.
  • 35
    Cotta RMM, Costa GD. Instrumento de avaliação e autoavaliação do portfólio reflexivo: uma construção teórico-conceitual. Interface Comun, Saúde, Educ. 2016;20(56):171-83. https://doi.org/10.1590/1807-57622014.1303
    » https://doi.org/10.1590/1807-57622014.1303
  • 36
    Gärtner FR, Bomhof-Roordink H, Smith IP, Scholl I, Stiggelbout AM, Pieterse AH. The quality of instruments to assess the process of shared decision making: a systematic review. PLoS ONE. 2018;13(2):e0191747. https://doi.org/10.1371/journal.pone.0191747
    » https://doi.org/10.1371/journal.pone.0191747
  • 37
    Cunha CM, Almeida Neto OP, Stackfleth R. Main psychometric evaluation methods of the validity of measuring instruments. Rev Atenç Saúde. 2016;14(47):75-83. https://doi.org/10.13037/ras.vol14n47.3391
    » https://doi.org/10.13037/ras.vol14n47.3391

Edited by

EDITOR IN CHIEF: Álvaro Sousa
ASSOCIATE EDITOR: Jules Teixeira

Publication Dates

  • Publication in this collection
    07 Aug 2023
  • Date of issue
    2023

History

  • Received
    23 Sept 2022
  • Accepted
    20 Jan 2023
Associação Brasileira de Enfermagem SGA Norte Quadra 603 Conj. "B" - Av. L2 Norte 70830-102 Brasília, DF, Brasil, Tel.: (55 61) 3226-0653, Fax: (55 61) 3225-4473 - Brasília - DF - Brazil
E-mail: reben@abennacional.org.br