Open-access Validity evidence of the Brazilian version of the Assessment Interprofessional Collaborative Leadership Scale*

Objective: to seek evidence of validity of the Assessment Interprofessional Collaborative Leadership Scale for Brazilians, in Portuguese, and to analyze evidence of content, response process and internal structure.

Method: psychometric evaluation study, with translation, back-translation, and evaluation by a committee of experts regarding linguistic and content equivalence. The pre-test was carried out with 40 participants and, subsequently, the final version was applied to 318 health workers. Exploratory factor analysis and reliability testing were performed using Cronbach’s alpha and McDonald’s omega.

Results: in the content validation, four items presented scores below the critical value. Of the participants, the majority were nurses (81%) and physiotherapists (10%), and were female (79%). The factorability obtained was Kaiser-Meyer-Olkin = 0.94 and Bartlett’s sphericity = 2991.4 with p < 0.05. Parallel analysis indicated a one-dimensional model, with variance explained by 63.71%. The model’s adequacy indices showed satisfactory levels. And adequate reliability indices (Cronbach’s alpha = 0.97 and McDonald’s omega = 0.97).

Conclusion: the Interprofessional Collaborative Leadership Assessment Scale, with a unidimensional structure and 28 items, presented good evidence of content validity, response process and internal structure, considered adequate to measure interprofessional collaborative leadership.

Descriptors:
Leadership; Patient Care Team; Interprofessional Relations; Validation Study; Health Personnel; Healthcare Crew Resource Management


Highlights:

(1) Instrument to measure interprofessional collaborative leadership. (2) Instrument to implement an interprofessional care model. (3) Diagnosis to support interprofessional development programs. (4) Evidence of validity of an interprofessional collaborative leadership instrument.

Objetivo: buscar evidências de validade da Assessment Interprofessional Collaborative Leadership Scale para o português – Brasil e analisar evidências de conteúdo, processo de resposta e estrutura interna.

Método: estudo de avaliação psicométrica, com tradução, retrotradução e avaliação por comitê de especialistas acerca da equivalência linguística e de conteúdo. O pré-teste foi realizado com 40 participantes e, posteriormente, a versão final foi aplicada com 318 trabalhadores da saúde. Realizou-se a análise fatorial exploratória e o teste de confiabilidade por meio do alfa de Cronbach e ômega de McDonald.

Resultados: na validação de conteúdo, quatro itens apresentaram pontuações abaixo do valor crítico. Dos participantes, a maioria era da enfermagem (81%) e fisioterapeutas (10%), do sexo feminino (79%). A fatorabilidade obtida foi Kaiser-Meyer-Olkin = 0,94 e Esfericidade de Bartlett = 2991,4 com p < 0,05. A análise paralela indicou modelo unidimensional, com variância explicada por 63,71%. Índices de adequação do modelo apresentaram níveis satisfatórios e índices de confiabilidade adequados (alfa de Cronbach = 0,97 e ômega de McDonald = 0,97).

Conclusão: a Escala de Avaliação da Liderança Colaborativa Interprofissional, de estrutura unidimensional, com 28 itens, apresentou boas evidências de validade de conteúdo, processo de resposta e estrutura interna considerada adequada para mensurar liderança colaborativa interprofissional.

Descritores:
Liderança; Equipe de Assistência ao Paciente; Relações Interprofissionais; Estudo de Validação; Profissionais de Saúde; Gestão de Recursos da Equipe de Assistência à Saúde


Destaques:

(1) Instrumento para medir liderança colaborativa interprofissional. (2) Instrumento para implementar modelo assistencial de cuidado interprofissional. (3) Diagnóstico para fundamentar programas de desenvolvimento interprofissional. (4) Evidências de validade de instrumento de liderança colaborativa interprofissional.

Objetivo: buscar evidencias de validez de la versión en portugués de Brasil de la Assessment Interprofessional Collaborative Leadership Scale y analizar evidencias de contenido, proceso de respuesta y estructura interna.

Método: estudio de evaluación psicométrica que incluyó traducción, retrotraducción y evaluación por un comité de especialistas acerca de la equivalencia lingüística y de contenido. Se realizó una prueba piloto con 40 participantes y, posteriormente, la versión final se aplicó a 318 trabajadores de la salud. Se efectuó un análisis factorial exploratorio y una prueba de confiabilidad mediante el alfa de Cronbach y el omega de McDonald.

Resultados: en la validación de contenido, cuatro ítems presentaron puntuaciones por debajo del valor crítico. La mayoría de los participantes eran profesionales de enfermería (81%) y fisioterapeutas (10%), y del sexo femenino (79%). La factorabilidad obtenida fue Kaiser-Meyer-Olkin = 0,94 y Esfericidad de Bartlett = 2991,4 con p < 0,05. El análisis paralelo indicó un modelo unidimensional con una varianza explicada del 63,71%. Los índices de ajuste del modelo mostraron niveles satisfactorios y los índices de confiabilidad fueron adecuados (alfa de Cronbach = 0,97 y omega de McDonald = 0,97).

Conclusión: la Escala de Evaluación del Liderazgo Colaborativo Interprofesional, con estructura unidimensional y 28 ítems, presentó buenas evidencias de validez de contenido, proceso de respuesta y estructura interna, y se considera adecuada para medir el liderazgo colaborativo interprofesional.

Descriptores:
Liderazgo; Grupo de Atención al Paciente; Relaciones Interprofesionales; Estudio de Validación; Personal de Salud; Gestión de Recursos de Personal em Salud


Destacados:

(1) Instrumento para medir el liderazgo colaborativo interprofesional. (2) Instrumento para implementar un modelo asistencial de cuidado interprofesional. (3) Diagnóstico para fundamentar programas de desarrollo interprofesional. (4) Evidencias de validez de un instrumento de liderazgo colaborativo interprofesional.

Introduction

Collaborative interprofessional practice is a form of work organization that is essential for addressing complex health issues and providing comprehensive care ( 1 ). It requires coordinated efforts to ensure the sharing of information and decisions so that the expertise of each team member is made viable in the implementation of care and in meeting health needs ( 2 ).

Among the competencies of collaborative interprofessional practice is collaborative leadership, in which professionals work together with patients and families to promote shared decision-making and produce co-responsibilities within the team ( 2 ).

Unlike traditional, hierarchical and centralized leadership, interprofessional collaborative leadership is established in the sharing of responsibilities, collective and articulated construction of solutions from multiple perspectives, of professionals and patients, in clinical decisions to improve the quality of care ( 3 ). Also described in the literature as collective or distributive leadership, it is considered a strategy to implement complex interventions, promote safe communication and participation, and involve stakeholders, in an environment in which equity is sought ( 4 ). However, its practical application in the daily routine of services remains little explored.

In this scenario, the Assessment Interprofessional Collaborative Leadership Scale (AICLS) ( 5 ) instrument was developed and published in the Canadian context in 2019, with the proposal of measuring interprofessional collaborative leadership in health institutions, through the individual perceptions of the health professionals who make up the teams ( 5 ). The genesis of its construction is the theoretical model that explores the interrelationship between vertical and formal structures in the institution and collaborative teams, as new possibilities for the exercise of leadership ( 6 ).

Although the contexts of training and practice in health in Brazil and Canada present local specificities, the literature on interprofessional teamwork has broadly established the interprofessional competencies necessary for these to occur, such as communication, collaboration and collaborative leadership, in various health settings ( 7 ). Specific studies on interprofessional collaborative leadership are scarce, and a gap has been identified in the measurement instruments. The Clinical Shared Leadership Scale (CSLS) ( 8 ) is recognized; however, it does not assess shared decision-making with direct involvement of patients and caregivers, a fundamental characteristic identified in this competency, as found in research with the significant participation of young people in the proposal and development of integrated care, based on interprofessional collaborative leadership ( 9 ). Thus, interprofessional collaborative leadership requires the active participation of patients and family (service users), which is why the translation of the AICLS ( 5 ) was chosen, given its advancement and theoretical relevance to the reality and context of the Brazilian health system.

The AICLS instrument, in Canada, underwent content validity analysis and was considered highly relevant in its preliminary version, its reliability evidence was 0.96, and its dimensions ranged from 0.85 to 0.92 [Symbiotic relationship = 0.87; Mindfulness = 0.92; Shared resources = 0.92 and Capacity to lead = 0.85] ( 5 ).

Therefore, it is important to translate and validate this instrument, with the premise that it is an effective measure for analyzing collaborative leadership in interprofessional teams and that it can impact the understanding of this competence to achieve improvements in the quality and safety of care offered by the teams. In this sense, the objective of this study was to seek evidence of validity of the Assessment Interprofessional Collaborative Leadership Scale (AICLS) for Brazilian Portuguese and to analyze evidence of content, response process and internal structure.

Method

Study design

This is a psychometric evaluation study, of validity evidence and cross-cultural adaptation (CCA) ( 10 ) through the following phases: translation; synthesis, back-translation, evaluation by a committee of experts, pre-testing of the instrument and, finally, analysis of the evidence of validity of the instrument ( 10 - 11 ). The study followed the guidelines set out in the Test Adaptation Reporting Standards (TARES) ( 12 ).

The translation was carried out by two independent translators, with a single synthesis version prepared by a third translator ( 10 ), evaluated and approved by the author of the instrument.

The equivalence of the Portuguese version was established based on four dimensions: semantic, idiomatic, cultural and conceptual by 17 experts in collaborative interprofessional practice and/or translations of measurement instruments. After approval by this committee of experts, the pilot test was carried out with 40 care or management workers, who made up teams in hospital inpatient units.

To assess the psychometric properties, the use and adoption of the AICLS ( 5 ) instrument in Brazil, we sought to gather evidence of validity based on content, response process, internal structure and reliability verification.

Content validation consists of a qualitative assessment (expert committee) and a quantitative assessment of each item, considering the individual importance of the item in the composition of the instrument and representation of the construct ( 13 ), by calculating the Content Validity Ratio (CVR) ( 14 ).

In the validation of the response process, we verify how the item is interpreted and its relationship with the measured construct ( 11 ). Participants in the pilot test analyzed the viability, comprehensibility and ease of use of the instrument. Response time was recorded, as this data may provide evidence of the complexity of the response processes ( 11 , 15 - 16 ).

The analysis of the internal structure of the construct was performed by Exploratory Factor Analysis (EFA), which assesses, through factor loadings, the relevance of each item to the factor ( 16 ). Factor retention substantially influences EFA results, and also has strong theoretical implications, as it predetermines the assumed dimensionality of a latent construct. Due to its exploratory nature, EFA is used in cases where understanding of the factorial structure of the latent concept is still incipient ( 17 ), as is the case of AICLS, recently described in the literature ( 5 ). Adjustment indices of the factorial solution were used to support the determination of the number of retained factors ( 17 ), and the adequacy of the factorial structure found ( 18 ).

Reliability was also verified, using two indicators, as recommended in the literature, to increase the reliability of the interpretation ( 19 ).

Setting

The study was developed in a large, private, tertiary-level general hospital located in the city of São Paulo (SP), Brazil, considered an international reference center in health.

Study population and sample

The study population consisted of healthcare workers in management and care positions who were part of interprofessional teams in critical care units and inpatient, clinical and surgical units. The sample size was calculated based on the recommendations for verifying the internal structure of instruments, which indicate a minimum number of 300 participants ( 13 ). In this study, a convenience sample of 318 healthcare workers was obtained, comprising nurses, nursing technicians, physiotherapists, doctors, pharmacists, psychologists and nutritionists. The inclusion criterion was workers who had worked at the institution for at least one year, in management or care positions, and shared activities with at least one worker from another area of training. The exclusion criterion used was workers who were on leave at the time of data collection.

Study variables

The AICLS includes 28 items, divided into four dimensions: Symbiotic relationship; Mindfulness; Shared resources; and Ability to lead ( 5 ).

The Symbiotic relationship dimension, composed of five items, is defined by a collaboration in which all team members have their roles well established and adapt reciprocally to the demands that arise ( 5 ).

The Mindfulness dimension is composed of nine items, characterized by attentive and extended focus, with attention to immediate situations and experiences as they arise ( 5 ).

The Shared resources dimension is composed of seven items, defined by an environment that encourages openness among professionals to share knowledge, skills, and expertise within a team ( 5 ).

The Ability to lead dimension, composed of seven items, is defined by a willingness to lead and accept responsibility for the leadership role ( 5 ).

Respondents indicate their general level of agreement with the occurrence of each item on a five-point Likert-type rating scale: 1 - Never; 2 - Rarely; 3 - Occasionally; 4 - Most of the time; and, 5 - Always. The ratings produce scores from 28 to 140 ( 5 ).

Data collection

The version produced after the content validation and response process stages was transformed into an electronic questionnaire, along with questions to characterize the sample. Data were collected through the Research Electronic Data Capture (RedCap) platform ( 20 ). The invitation to participate was sent via email to the area coordinators, who forwarded it to the health professionals/workers in their respective teams.

Duration

The data collection period took place between July 15th and September 15th, 2023.

Data processing and analysis

To start the EFA and verify the factorability of the data, the Kaiser-Meyer-Olkin (KMO) index was calculated and the Bartlett Sphericity Test (TEB) was performed ( 13 ).

To extract factors, the Unweighted Least Squares (ULS) was used, with oblimin rotation, from a polychoric correlation matrix ( 13 ). Subsequently, the dimensionality of the instrument was explored, through the parallel analysis technique, Optimal Implementation of Parallel Analysis (PA), an approach recommended for a set of ordered variables with polytomous scoring ( 21 ), Hull method with Comparative Fit Index ( 22 ) and application of Closeness of dimensionality ( 23 ), composed of three indicators: Item Unidimensional Congruence (I-UniCo), Item Explained Common Variance (I-ECV) and Mean of Item Residual Absolute Loadings (MIREAL). Values of I-UNICO > 0.95, I-ECV > 0.85 and MIREAL < 0.30 suggest that the data can be treated as essentially one-dimensional ( 23 ).

The factor solution was applied via structural equation modeling and to verify the need for adjustments the following indices were calculated: Root Mean Square Error of Approximation (RMSEA); Non-Normed Fit Index (NNFI); CFI (Comparative Fit Index); Goodness of Fit Index (GFI); Adjusted Goodness of Fit Index without diagonal values (AGFI) ( 24 ). Reliability was verified using Cronbach’s alpha and McDonald’s omega indices ( 19 ).

All analyses were performed using the Factor software.

Ethical aspects

The ethical aspects of the research were followed according to Resolution no. 466 of 2012 ( 25 ), both in the evaluation phase of the expert committee and in the application of the pilot test and pre-test. These steps took place after approval by the Research Ethics Committee (CEP) of the Federal University of São Paulo and the co-participating institution, the hospital where the research was conducted, under Opinions no. 5,533,152 and no. 5,571,337, respectively.

Results

Cross-cultural adaptation and content validation

The equivalence analysis resulted in 62.5% of the 28 items having an agreement rate greater than 80%. After the first round of analysis by the expert committee, 12 items that had an agreement rate lower than 0.80 were revised, besides that, the name of the instrument was also altered, the first two explanatory sentences of the introduction and the final paragraph.

The suggestions were accepted and, after the modifications, a new round was held with the expert committee to review these items and choose, between two options, the best alternative, taking into account its concepts and meanings within Brazilian culture. The final definition of the 12 items is described in Figure 1.

Figure 1-
Modifications made by the authors to the items after suggestions and the second round of the expert committee. São Paulo, SP, Brazil, 2022

In the quantitative content validation, the critical value of the CVR acceptable to 17 experts was 0.529 ( 26 ) and indicated the item’s adherence in this study. Four items obtained scores below 0.529 in some of the evaluation categories: theoretically relevant, practically pertinent, sufficiently comprehensive and understandable in the set and dimensionality.

Item 2, in section 1, “Encourages team members to focus beyond the status quo (i.e., the usual way of doing things) on relevant and essential issues of care”, presented a score below 0.529 when its theoretical relevance, practical relevance and scope were evaluated.

Item 19, in section 3, “The decision-making process focuses on shared goals of all team members”, presented a lower score in the scope evaluation.

In section 4, two items obtained lower scores than 0.529. Item 22 “Team members support patients/clients as collaborative leaders” was rated with lower scores in practical relevance, comprehensiveness and dimensionality, and item 23 “Team members are willing to take on team leadership roles when asked” in comprehensiveness and dimensionality. All items were kept in the instrument at this time, since they presented values below the ratio considered in some of the categories evaluated and not in their entirety.

Validation of the response process

The validity of the response process, carried out through interviews in the pilot test, confirmed the viability of the instrument for use. Participants spent an average of nine minutes and 27 seconds responding to the instrument. The standard deviation was three minutes and fifteen seconds, and the maximum response time was 15 minutes and 51 seconds.

Respondents had difficulty with the term “status quo” in item 7, in section 2, despite the explanation being in parentheses within the item itself, as indicated by the expert committee. As a suggestion, the term “status quo” was removed, and this item was defined as “Encourages team members to develop processes that lead to the creation of an environment where decision-making is shared”.

The understanding of the response options for the items was adequate for 100% of participants, as was the general organization of the items. In the assessment of the scope of the items, 87.5% of participants considered it adequate, and one of them suggested removing items that he considered similar.

Regarding the difficulty in completing the instrument, 62.5% of the participants reported no difficulties and 20 suggestions were reported and considered. Thus, eight items were adjusted (items 1 and 3 in section 1; items 7, 9 and 10 in section 2; items 19 and 21 in section 3; and item 25 in section 4).

The final version of the instrument after the suggested changes was answered by 318 participants, of which six indicated the option of having been at the institution for less than a year, which would have constituted their exclusion, after data collection. However, due to the small percentage (1.8%) in relation to the total sample, it was decided to maintain this in the presentation of the results.

As for the sociodemographic characteristics, it is noteworthy that the sample was mostly composed of females (79%) and in the age range of 31-40 years (44%). A weekly workload of 30-40 hours was prevalent (67%). Regarding the highest qualification, 53% of participants had a specialization. Nurses (44%), followed by nursing technicians (37%) and physiotherapists (10%), were the professionals with the highest participation. Regarding the time of professional experience, the range of 11 to 15 years was predominant (24%) and the time of experience in the unit was one to three (31% of participants). Regarding the type of unit where they worked, the participants worked in the Semi-Intensive Unit (26%), followed by the Intensive Care Unit (21%).

Validation of the internal structure

The EFA was performed based on the polychoric matrix and it was verified whether the items were factorizable using the Measure of Sample Adequacy (MSA). In the initial modeling using the 28 items of the instrument, good adequacy indices were found, being TEB: 2991.4 (gl = 378; P = 0.000010) and KMO: 0.94977 with bootstrap 95% Confidence Interval (CI) of KMO = (0.573 - 1.204).

The first analysis in the study of the dimensionality/factors of the instrument was performed by parallel analysis (PA), which indicated the existence of only one dimension, with explained variance of 63.71% of the latent variable. Due to the divergence between the original model and that obtained by the PA, additional dimensionality tests were chosen.

The second technique used was the Hull with the CFI, shown in Table 1.

Again, the result indicated only one dimension. The third test adopted was the unidimensionality/multidimensionality technique, with the UniCo, ECV and REAL indexes shown below in Table 2.

Table 1-
Dimensionality by Hull with Comparative Fit Index. São Paulo, SP, Brazil, 2023
Table 2-
Closeness of dimensionality. São Paulo, SP, Brazil, 2023

Based on the results presented, the general model can once again be considered unidimensional, with index values for items 23, 24, 25 and 26 not supporting unidimensionality (REAL-I above 0.30).

After dimensionality testing, the factor solution was applied to seek evidence of the theoretical model. The first test was performed with the configuration for four domains, according to the original version of the instrument.

Table 3 presents the factor loadings and commonality of the model with four domains. Values equal to or greater than 0.40 for the items were adopted as substantial factor loadings. Acceptable commonality is close to 0.40 ( 13 ).

Table 3-
Factor loadings and commonalities in a model with four domains. São Paulo, SP, Brazil, 2023

There is no adjustment of the model with four domains, there is a concentration of 20 items in the first domain, and items 11, 13, 14, 21 and 23 have double saturation (measures two factors, considered a technical violation). Item 22 does not present a minimum factor loading of 0.30 and the commonality below 0.40. Therefore, there is no evidence of an adjusted configuration with four domains for the study sample.

Since the exploratory adjustment principle allows and recommends testing different configurations of the instruments, the factor solution was applied with the parameterization with only one dimension. The values of the factor loadings and commonalities are presented in Table 4.

All items presented adequate factor loadings with values above 0.50. Items 22, 25 and 28 presented commonalities below 0.40, but close to the cutoffs. Since the factor loadings of these items were adequate, it was decided to maintain them.

Fitness indexes can be considered to assess the adequacy and quality of a factor solution in EFA. The results presented by the one-dimensional model were considered good, whose indexes: CFI (0.996; 95%CI = 0.994 - 0.998) and NNFI (0.996; 95%CI = 0.994 - 0.998) indicated excellent fit of the model. The RMSEA (RMSEA = 0.040; 95%CI = 0.0275 - 0.0460), GFI (0.991, 95%CI = 0.990 - 0.994) and AGFI (0.991, 95%CI = 0.989 - 0.993) measures were adequate.

The reliability indices presented were: Cronbach’s alpha = 0.97 and McDonald’s omega = 0.97, both above 0.70, indicating adequate reliability ( 13 ).

Table 4-
Factor loadings and commonalities in a one-dimensional model. São Paulo, SP, Brazil, 2023

Discussion

This study reported the process of translating and adapting the AICLS from English to the Brazilian context. Although it is recognized that this is a new scale, only one Japanese study was identified that translated and cross-culturally adapted the AICLS, in order to enable comparison of the scale in question ( 27 ).

The CCA was guided by recommendations for cross-cultural adaptation of measurement instruments ( 10 ), which are widely used in this type of study, with international acceptance of this methodology ( 28 ). CCA requires great methodological rigor, and it is essential that the values reflected in each item are equivalent between one culture and another ( 29 ).

Semantic and cultural equivalences must be considered in the CCA process. The discrepancies found in the versions presented by the translators were resolved in the synthesis of the translations and subsequently sent to the back-translation phase, which is recommended as an indicator of the quality of psychometric evidence, and allows the identification of possible discrepancies ( 28 ) and the highlighting of inconsistencies or conceptual errors in the translation ( 30 ). The reconciled version did not present misinterpretations of the items, as confirmed by the author of the original instrument.

In this context, the quality of the translation/adaptation process is crucial to ensure the validity and usefulness of the adapted test, through a rigorous process whose objective is to maintain the equivalence of content and cultural meaning between the original and the translated/adapted test and to promote the comparability of scores among participants from different cultural groups ( 31 ).

The analysis of the validity evidence related to the content of the Brazilian version of the EALCI was carried out in stages. For content validation, a committee of interprofessional experts, with expertise in leadership and collaborative interprofessional practice, clarified the discrepancies and suggested adjustments for better understanding. In designing a coherent instrument for the population it will be aimed at, this phase is essential ( 32 ).

Unlike the original instrument, in which the authors reported that only one item was revised in terms of its wording, the Brazilian version had 12 items that required revision and required a second round with the committee of experts. After this second assessment, the items had their content validated. In the original version, the authors used the Content Validity Index (CVI), however, this can inflate the results by combining responses with scores of 3 and 4 from the experts’ analysis ( 33 ). In this study, the CVR calculation was used, a more robust method for establishing and quantifying content validity ( 14 ) and which adapts the agreement to the number of experts, ensuring the quality of the assessment ( 26 ).

During the pilot test, which followed the recommendations in the literature ( 10 ) and aimed to verify whether the items, instructions and response scale were understandable, especially by those for whom the instrument was intended ( 30 ), it was identified that item 7 was the least understood by the respondents, due to an expression that can be considered common in the academic environment, but which did not have any relevance to the target audience and which had to be removed (status quo).

In the validation of the internal structure, necessary to verify whether the measurement attributes correspond to the theoretical attributes ( 21 ) and to adjust the model, multiple tests were used, in accordance with contemporary recommendations for evidence of validity ( 12 ).

It was also analyzed whether the factor structure was adequately represented by its dimensionality ( 21 ). In the Brazilian version, the four-dimensional model was not reproduced. The divergence found in the parallel analysis indicated additional testing of dimensionality, due to recommendations in the literature that dimensionality analysis should not be limited to one technique ( 34 ). Unidimensionality remained and in the EFA, the unidimensional model was the most appropriate, and did not indicate the maintenance of the dimensions in the population of this study. It is worth mentioning that in the analyses of this study, robust standards were followed, described in contemporary psychometrics, analyses considered to be of excellence in the development and adaptation of instruments ( 11 - 12 ).

In the analysis of the original instrument ( 5 ), the authors preliminarily indicated that the Leadership Ability dimension would probably not be maintained in the final model, since several items indicated that they assessed a small aspect of the construct. The sample of the original study did not reach the minimum number indicated in the literature, with only 101 professionals, an aspect that may have impacted the results of the analyses performed and that explains the differences between the two studies. Another difference is that they did not perform dimensionality analyses, EFA and CFA tests, and opted for Cronbach’s alpha testing, considered in this study to be insufficient for analyzing the adequacy of the original model.

Therefore, in this study, different analysis techniques were chosen from those used in the original model, since it recognizes the existence of more modern techniques indicated in the specialized literature, and that despite the choice to follow analysis processes different from the original instrument, the EALCI was considered a fundamental instrument, with contributions to reality and to the Brazilian context considering its theoretical framework, broad tradition and application in the practice of interprofessionality constructs ( 2 ).

It is important to highlight that the Japanese version ( 27 ) did not have the same dimensionality as the original AICLS instrument. After exploratory factor analysis using the 28 items, divided into four factors, the instrument was reduced to ten items, distributed in three dimensions. The final instrument, called AICLS-J, was applied to a sample of 675 participants.

Different cultures may understand, experience or express the same construct in different ways, and this implies grouping items in dimensions different from those observed in the original version. Regarding interprofessionality, two instruments did not reproduce the dimensionality of the original instrument in the Brazilian context. In the adaptation of the Readiness for Interprofessional Learning Scale (RIPLS) instrument, the original four-factor structure was not reproduced equally to the original model, and the factor analysis indicated a version with 27 items distributed in three dimensions: teamwork and collaboration, professional identity and patient-centered health care ( 35 ). The other instrument for translation and cross-cultural adaptation, the Interprofessional Collaboration Measurement Scale (IPC), did not replicate the three factors of the original version in the exploratory and confirmatory factor analyses in the Brazilian sample, and indicated that it was a one-dimensional instrument ( 36 ), similar to that found in this study.

In both cases, the difficulty in reproducing the same dimensions of the original version can be attributed to cultural differences, educational contexts and distinct practices, since they are constructs with multiple interdependent aspects. Given this assumption, this can occur not only between countries, but also between regions of the same country, between different types of health services. There is agreement that differences in dimensionality should not be considered a limitation, but may reflect that in the research application scenario the construct was perceived as a holistic construct, or even indicate gaps in interprofessional training and practice in health ( 36 ). Therefore, the guidelines of the area are reinforced and corroborated, that there must be an analysis of the equivalences of internal structure and the measurement of the scale considering regional differences ( 12 ) and that this analysis must be carried out when choosing to use a measurement scale.

Thus, it can be inferred that interprofessional collaborative leadership can be influenced by aspects of the organizational structure, power relations, professional training and institutional culture that vary significantly between countries, regions and types of services. The adaptation process allows the instrument to be sensitive to the linguistic, cultural and social specificities of its context, maintain the conceptual and theoretical foundations of the original instrument, and contribute to the advancement of research and the applicability of new management models, based on the interprofessional organization of teams.

In the analysis of evidence of reliability of the Brazilian unidimensional version of the EALCI, McDonald’s omega coefficient and Cronbach’s alpha were higher than 0.70. The Japanese version used only Cronbach’s alpha, with a value = 0.987 ( 27 ). In the present study, it was decided to demonstrate two indicators to increase the accuracy of the interpretation.

When comparing the context of the items of the CSLS instrument ( 8 ) with the Brazilian version of the EALCI, although the hierarchical structure is not assessed, there is a similarity between the theoretical contributions of the two instruments and between the items referring to collaboration between team members, with their well-established roles, encouraging creativity and discussions in care planning, as well as sharing of knowledge, skills and expertise, according to the needs of each situation.

Thus, the instrument translated and validated into Portuguese corroborates the idea that collaborative leadership is fundamental and prepares leaders of interprofessional teams to coordinate and collaborate in teams, respecting the patient and family regarding their own care decisions, as the path to offering quality and safe health care. Working in an interprofessional and collaborative manner requires everyone to be jointly responsible for the results produced ( 5 ).

Having an instrument available in national and international literature capable of adequately measuring the construct of interprofessional collaborative leadership is an advance in the field of interprofessionality. It can even be used in training and professional development programs that aim to address the development of this skill, especially from the perspective of involving patients and caregivers in decision-making processes, with a view to improving the patient experience and the quality and safety of care, a practice that is not yet fully consolidated in health services ( 37 ).

The limitations of this study include the fact that there are few analyses of the instrument translated into other languages and that the Canadian version itself had a smaller sample than indicated in the literature. Only the Japanese study was identified ( 27 ), and this study attempts to fill the gap identified, with future indications of new applications and analyses of the EALCI. There are no other instruments that measure interprofessional collaborative leadership or other similar scales validated in Brazil, which does not allow comparisons.

Although the dimensionality of the original scale was not replicated, an aspect that can be considered a limitation, it is worth noting that more contemporary and different analysis tests were used, as they were considered more relevant in the present study for this type of scale. It is worth noting that among the responsibilities of the researchers is to present the results with respect to transparency and the ethical principles that govern scientific practice, even if they were not in line with those of the original studies. These results also contribute to the advancement of knowledge and to the improvement of the scale that measures interprofessional collaborative leadership. Thus, the limitations found should be considered in future research and in the improvement of the EALCI.

Another limitation is that the interactions between the professionals who made up the teams in the areas of activity in the study were not analyzed, an aspect that could configure an analysis of the criterion validity. Thus, there are indications for further research, both on the application of the translated and validated instrument in other contexts of interprofessional practice, as well as convergent validity ( 38 ), to establish correlation of the instrument with instruments that assess similar constructs, especially with already validated and widely used scales of interprofessional collaborative practice.

As implications for practice, it is indicated that the EALCI can be used in the Brazilian context for the global measurement of interprofessional collaborative leadership, and contemporary analysis procedures are indicated in different contexts of health care, to strengthen its applicability.

Conclusion

The EALCI, composed of 28 items, has proven to be an instrument for measuring interprofessional collaborative leadership, with a unidimensional structure and has presented adequate evidence of content validity, response process, internal structure and reliability. It is a valid scale for making situational diagnoses, supporting institutional intervention policies and the impact of educational programs from the perspective of interprofessional practice.

Collaborative leadership is an indispensable skill in interprofessional teamwork, considered essential in health care to ensure the centrality of the patient and family. The provision of this scale will contribute to the understanding of the processes involved in this form of leadership, its occurrence in interprofessional teams, and can assist health institutions in professional development programs and contribute to the implementation of this care model.

References

  • 1. Hampton O, Xyrichis A. Love, Shout, Bribe: towards a theory of change for delivering interprofessional workforce transformation. J Interprof Care. 2025;39(2):141-5. https://doi.org/10.1080/13561820.2025.2476270
    » https://doi.org/10.1080/13561820.2025.2476270
  • 2. Canadian Interprofessional Health Collaborative. Competency Framework for Advancing Collaboration [Internet]. [s.l.]: CIHC; 2024 [cited 2025 Jan 27]. Available from: https://cihc-cpis.com/wp-content/uploads/2024/06/CIHC-Competency-Framework.pdf
    » https://cihc-cpis.com/wp-content/uploads/2024/06/CIHC-Competency-Framework.pdf
  • 3. Silva JAM, Mininel VA, Agreli HF, Peduzzi M, Harrison R, Xyrichis A. Collective leadership to improve professional practice, healthcare outcomes and staff well-being. Cochrane Database Syst Rev. 2022;10(10):CD013850. https://doi.org/10.1002/14651858.CD013850.pub2
    » https://doi.org/10.1002/14651858.CD013850.pub2
  • 4. Hudon C, Lambert M, Aubrey-Bassler K, Chouinard MC, Doucet S, Ramsden VR, et al. Fostering collective leadership to improve integrated primary care: lessons learned from the PriCARE program. Arch Public Health. 2024;82:24. https://doi.org/10.1186/s13690-024-01258-9
    » https://doi.org/10.1186/s13690-024-01258-9
  • 5. Orchard C, Sinclair E, Rykhoff M. The new leadership in health care teams: progress report of development on a promising measure. Arch Health Care [Internet]. 2019 [cited 2025 Jan 27];1(1)20-6. Available from: https://www.researchgate.net/publication/341411604_The_New_Leadership_in_Healh_Care_Teams_Progress_Report_of_Development_on_a_Promising_Measure
    » https://www.researchgate.net/publication/341411604_The_New_Leadership_in_Healh_Care_Teams_Progress_Report_of_Development_on_a_Promising_Measure
  • 6. Orchard C, Rykoff M. Collaborative leadership within interprofessional practice. In: Forman D, Jones M, Thistlethwaite J, editors. Leadership and Collaboration: Further development for interprofessional education. London: Palgrave Macmillan; 2015. p. 71-94.
  • 7. Morian H, Creutzfeldt J, Hultin M, Härgestam M. Mapping leadership, communication and collaboration in short-term distributed teams across various contexts: a scoping review. BMJ Open. 2024;14(10):e081878. https://doi.org/10.1136/bmjopen-2023-081878
    » https://doi.org/10.1136/bmjopen-2023-081878
  • 8. Ong YH, Lim I, Tan KT, Chan M, Lim WS. Assessing shared leadership in interprofessional team meetings: A validation study. Asia Pac Sch. 2016;1(1):9-19. https://doi.org/10.29060/TAPS.2016-1-1%2FOA1003
    » https://doi.org/10.29060/TAPS.2016-1-1%2FOA1003
  • 9. Melro CM, Brook C, Martin RA, Roberts RA, Young S, Zalik SJR, et al. ‘For Youth by Youth’: Distributive Leadership in Action With a Youth Codesign Team. Health Expect. 2024;27(6):e70080. https://doi.org/10.1111/hex.70080
    » https://doi.org/10.1111/hex.70080
  • 10. Beaton D, Bombardier C, Guillemin F, Ferraz MB. Recommendations for the cross-cultural adaptation of the DASH & Quick DASH outcome measures [Internet]. Toronto: Institute for Work & Health; 2007 [cited 2025 Jan 27]. Available from: https://dash.iwh.on.ca/sites/dash/files/downloads/cross_cultural_adaptation_2007.pd
    » https://dash.iwh.on.ca/sites/dash/files/downloads/cross_cultural_adaptation_2007.pd
  • 11. American Educational Research Association; American Psychological Association; National Council on Measurement in Education. Standards for educational and psychological testing [Internet]. Washington, DC: American Educational Research Association; 2014 [cited 2025 Jan 27]. Available from: https://www.testingstandards.net/uploads/7/6/6/4/76643089/standards_2014edition.pdf
    » https://www.testingstandards.net/uploads/7/6/6/4/76643089/standards_2014edition.pdf
  • 12. Iliescu D, Bartram D, Zeinoun P, Ziegler M, Elosua P, Sireci S, et al. The Test Adaptation Reporting Standards (TARES): reporting test adaptations. Int J Test. 2024;24(1):80-102. https://doi.org/10.1080/15305058.2023.2294266
    » https://doi.org/10.1080/15305058.2023.2294266
  • 13. Hair JF Jr, Black WC, Babin BJ, Anderson RE. Multivariate Data Analysis. 8. ed. Andover: Cengage Learning; 2019. 832 p.
  • 14. Almanasreh E, Moles R, Chen TF. Evaluation of methods used for estimating content validity. Res Social Adm Pharm. 2019;15(2):214-21. https://doi.org/10.1016/j.sapharm.2018.03.066
    » https://doi.org/10.1016/j.sapharm.2018.03.066
  • 15. Bandalos DL. Measurement Theory and application for social sciences. New York, NY: Gilford Press; 2018. 661 p.
  • 16. Furr RM. Psychometrics: an introduction. 4th ed. Thousand Oaks, CA: SAGE Publications; 2021. 704 p.
  • 17. Goretzko D, Pahm TTH, Buhner M. Exploratory factor analysis: Current use, methodological developments and recommendations for good practice. Curr Psychol. 2021;40:3510-21. https://doi.org/10.1007/s12144-019-00300-2
    » https://doi.org/10.1007/s12144-019-00300-2
  • 18. Watkins MW. Exploratory Factor Analysis: A Guide to Best Practice. J Black Psychol. 2018;44(3):219-46. https://doi.org/10.1177/0095798418771807
    » https://doi.org/10.1177/0095798418771807
  • 19. Hoekstra R, Vugteveen J, Warrens MJ, Kruyen PM. An empirical analysis of alleged misunderstandings of coefficient alpha. Int J Soc Res Methodol. 2019;22(4):351-64. https://doi.org/10.1080/13645579.2018.1547523
    » https://doi.org/10.1080/13645579.2018.1547523
  • 20. Consórcio REDCap Brasil. Research Electronic Data Capture [Homepage]. [s.l.]: Consórcio REDCap Brasil; c2025 [cited 2025 Jan 27]. Available from: https://redcapbrasil.com.br
    » https://redcapbrasil.com.br
  • 21. Timmerman ME, Lorenzo-Seva U. Dimensionality Assessment of Ordered Polytomous Items with Parallel Analysis. Psychol Methods. 2011;16(2):209-20. https://doi.org/10.1037/a0023353
    » https://doi.org/10.1037/a0023353
  • 22. Lorenzo-Seva U, Timmerman ME, Kiers HAL. The Hull Method for selecting the number of common factors. Multivariate Behav Res. 2011;46(2):340-64. https://doi.org/10.1080/00273171.2011.564527
    » https://doi.org/10.1080/00273171.2011.564527
  • 23. Ferrando PJ, Lorenzo-Seva U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educ Psychol Meas. 2018;78(5):762-80. https://doi.org/10.1177/0013164417719308
    » https://doi.org/10.1177/0013164417719308
  • 24. Kline RB. Principles and practice of structural equation modeling. 4. ed. New York, NY: Guilford Press; 2016. 534 p.
  • 25. Brasil. Resolução nº 466, de 12 de dezembro de 2012. Dispõe sobre diretrizes e normas regulamentadoras de pesquisas envolvendo seres humanos. Diário Oficial da União [Internet]. 2013 Jun 13 [cited 2023 Mar 06]; seção 1:59. Available from: https://conselho.saude.gov.br/resolucoes/2012/Reso466.pdf
    » https://conselho.saude.gov.br/resolucoes/2012/Reso466.pdf
  • 26. Ayre C, Scally AJ. Critical Values for Lawshe’s Content Validity Ratio: Revisiting the Original Methods of Calculation. Meas Eval Couns Dev. 2014;47(1):79-86. https://doi.org/10.1177/0748175613513808
    » https://doi.org/10.1177/0748175613513808
  • 27. Fujitani K, Suzuki R, Tamura Y, Murata Y, Matsushita H. Verification of Reability and Validity of Collaborative Leadership Scale Evaluation Scale in Multidisciplinary Collaboration. Bunkyo J Health Sci Technol. 2022;15:37-42.
  • 28. Machado RS, Fernandes ADBF, Oliveira ALCB, Soares LS, Gouveia MTO, Silva GRG. Cross-cultural adaptation methods of instruments in the nursing area. Rev Gaucha Enferm. 2018;39:1-11. https://doi.org/10.1590/1983-1447.2018.2017-0164
    » https://doi.org/10.1590/1983-1447.2018.2017-0164
  • 29. Khalaila R. Translation of questionnaires into Arabic in cross- cultural research: techniques and equivalence issues. J Transcult Nurs. 2015;24(4):363-70. https://doi.org/10.1177/1043659613493440
    » https://doi.org/10.1177/1043659613493440
  • 30. Nina KCF, Silva SSC, Pontes FAR. Transcultural adaptation of The Teacher Efficacy for Inclusive Practices (TEIP): Brazilian version. Cien Psicol. 2020;14(1):e-2175. https://doi.org/10.22235/cp.v14i1.2175
    » https://doi.org/10.22235/cp.v14i1.2175
  • 31. Hernandez A, Hidalgo MD, Hambleton RK, Gómez-Benito J. International Test Commission guidelines for test adaptation: A criterion checklist. Psicothema. 2020;32(3):390-8. https://doi.org/10.7334/psicothema2019.306
    » https://doi.org/10.7334/psicothema2019.306
  • 32. Coluci MZO, Alexandre NMC, Milani D. Construção de instrumentos de medida na área da saúde. Cien Saude Colet. 2015;20(3):925-36. https://doi.org/10.1590/1413-81232015203.04332013
    » https://doi.org/10.1590/1413-81232015203.04332013
  • 33. Yusoff MSB. ABC of content validation and content validity index calculator. Educ Med J. 2019;11(2):49-54. https://doi.org/10.21315/eimj2019.11.2.6
    » https://doi.org/10.21315/eimj2019.11.2.6
  • 34. Auerswald M, Moshagen M. How to determine the number of factors to retain in exploratory factor analysis: A comparison of extraction methods under realistic conditions. Psychol Methods. 2019;24(4):468-91. https://doi.org/10.1037/met0000200
    » https://doi.org/10.1037/met0000200
  • 35. Peduzzi M, Norman I, Coster S, Meireles E. Cross-cultural adaptation of the Readiness for Interprofessional Learning Scale in Brazil. Rev Esc Enferm USP. 2015;49(2):7-14. https://doi.org/10.1590/S0080-623420150000800002
    » https://doi.org/10.1590/S0080-623420150000800002
  • 36. Trigueiro JG, Costa MV, Barreto MAF, Zwarenstein M, Carvalho REFL. Cross-cultural adaptation and evidence of validity of the interprofessional collaboration scale (IPC-BR) for Brazil. J Interprof Care. 2025;39(2):257-66. https://doi.org/10.1080/13561820.2025.2451957
    » https://doi.org/10.1080/13561820.2025.2451957
  • 37. Galletta M, Piazza MF, Meloni SL, Chessa E, Piras I, Arnetz JE, et al. Patient Involvement in Shared Decision-Making: Do Patients Rate Physicians and Nurses Differently? Int J Environ Res Public Health. 2022;19(21):14229. https://doi.org/10.3390/ijerph192114229
    » https://doi.org/10.3390/ijerph192114229
  • 38. Polit DF. Assessing measurement in health: beyond reliability and validity. Int J Nurs Stud. 2015;52(11):1746-53. https://doi.org/10.1016/j.ijnurstu.2015.07.002
    » https://doi.org/10.1016/j.ijnurstu.2015.07.002
  • *
    Paper extracted from master’s thesis “Adaptation and validity of the Assessment Interprofessional Collaborative Leadership Scale (AICLS), Brazilian_Portuguese version”, presented to Universidade Federal de São Paulo, Escola Paulista de Enfermagem, São Paulo, SP, Brazil.
  • Data Availability Statement
    Datasets related to this article will be available upon request to the corresponding author.
  • How to cite this article
    Silva ND, Gonçalves GCS, Silva JAM, Rebustini F, Balsanelli AP. Validity evidence of the Brazilian version of the Assessment Interprofessional Collaborative Leadership Scale. Rev. Latino-Am. Enfermagem. [cited]. Available from: https://doi.org/10.1590/1518-8345.7894.4719

Edited by

  • Associate Editor:
    Rosana Aparecida Spadoti Dantas

Data availability

Datasets related to this article will be available upon request to the corresponding author.

Publication Dates

  • Publication in this collection
    17 Nov 2025
  • Date of issue
    2025

History

  • Received
    27 Jan 2025
  • Accepted
    24 June 2025
location_on
Escola de Enfermagem de Ribeirão Preto / Universidade de São Paulo Av. Bandeirantes, 3900, 14040-902 Ribeirão Preto SP Brazil, Tel.: +55 (16) 3315-3387 / 3315-4407 - Ribeirão Preto - SP - Brazil
E-mail: rlae@eerp.usp.br
rss_feed Acompanhe os números deste periódico no seu leitor de RSS
Reportar erro