Acessibilidade / Reportar erro

Development of a measurement instrument to assess patient safe transition at hospital discharge

Elaboración de un instrumento para evaluarlatransición segura del paciente al alta hospitalaria

ABSTRACT

Objective:

To develop and validate the content of a measurement instrument to assess the quality of care transitions and patient safety at hospital discharge from the nurses' perspective.

Methods:

A methodological study developed in southern Brazil between April 2019 and January 2022, in three stages: integrative review and semi-structured interviews with six nurses for construction of the instrument; content validation with a committee of 14 experts; and a pre-test with 20 nurses. A Content Validity Index above 0.80 was employed.

Results:

A measurement instrument with 37 items organized into six domains was developed, as follows: structure; discharge planning; care education; referral for continuity of care; safety culture, and care transitions results. The general Content Validity Index reached 0.93.

Conclusions:

The measurement instrument presented content validation and will contribute to understanding transitional care in the Brazilian context, proposing changes to qualify and strengthen patient safety at hospital discharge.

Keywords:
Patient discharge; Continuity of patient care.; Patient safety; Patient transfer; Quality of health care; Nursing

RESUMEN

Objetivo:

Construir y validar el contenido de un instrumento de evaluación de la calidad de la transición de la atención y la seguridad del paciente en alta hospitalaria desde la perspectiva de los enfermeros.

Métodos:

Estudio metodológico, desarrollado en el sur de Brasil entre abril de 2019 y enero de 2022, en tres etapas: revisión integradora y entrevistas semiestructuradas con seis enfermeras para construir el instrumento; validación de contenido por un comité de 14 expertos; y pre-test con 20 enfermeras. Se empleó un Índice de Validez del Contenido superior a 0,80.

Resultados:

Instrumento desarrollado con 37 ítems organizados en seis dominios: estructura; planificación del alta; pautas de atención; derivación a la continuidad asistencial; cultura de seguridad, y resultado de la transición asistencial. El Índice de Validez de Conocimiento general fue de 0,93.

Conclusiones:

El instrumento presentó un valor de contenido y contribuyó a la comprensión de la transición del cuidado en el contexto nacional, proponiendo cambios para calificar y fortalecer la seguridad del paciente en el hospital de alta.

Palabras clave:
Alta del paciente; Continuidad de laatención al paciente; Seguridad del paciente; Transferencia de pacientes; Calidad de laatención de salud; Enfermería

RESUMO

Objetivo:

Construir e validar o conteúdo de um instrumento de avaliação da qualidade da transição do cuidado e da segurança do paciente na alta hospitalar na perspectiva de enfermeiros.

Métodos:

Estudo metodológico, desenvolvido no Sul do Brasil entre abril de 2019 e janeiro de 2022, em três etapas: revisão integrativa e entrevistas semiestruturadas com seis enfermeiros para construção do instrumento; validação de conteúdo por comitê de 14 especialistas; e pré-teste com 20 enfermeiros. Empregou-se Índice de Validade de Conteúdo acima de 0,80.

Resultados:

Desenvolvido instrumento com 37 itens organizados em seis domínios: estrutura; planejamento de alta; orientações sobre cuidados; encaminhamento para continuidade de cuidados; cultura de segurança, e resultado da transição do cuidado. O Índice de Validade de Conteúdo geral foi 0,93.

Conclusões:

o instrumento apresentou validação de conteúdo e contribui para a compreensão da transição do cuidado no contexto nacional, propondo mudanças para qualificar e fortalecer a segurança do paciente na alta hospitalar.

Palavras-chave:
Alta do paciente; Continuidade da assistência ao paciente; Segurança do paciente; Transferência de pacientes; Qualidade da assistência à saúde; Enfermagem

INTRODUCTION

The search for quality of health services has been a focus of worldwide interest, motivating the development of health policies and actions aimed at minimizing the occurrence of unnecessary harms to patients and that improve the care provided11. Carneiro AS, Dalmolin GL, Magnago TSBS, Moreira LP, Costa ED, Andolhe R. atient safety culture in critical and non-critical areas: a comparative study. Rev Esc Enferm USP. 2021;55:e20210141. doi: https://doi.org/10.1590/1980-220X-REEUSP-2021-0141.
https://doi.org/10.1590/1980-220X-REEUSP...
-22. World Health Organization. Global patient safety action plan 2021-2030: towards eliminating avoidable harm in health care [Internet]. Geneva: WHO; 2021 [cited 2022 Jul 15]. Available from: Available from: https://www.who.int/teams/integrated-health-services/patient-safety/policy/global-patient-safety-action-plan .
https://www.who.int/teams/integrated-hea...
. Among the global strategic objectives established by the World Health Organization for 2021-2030, care transition is identified as an important strategy to ensure safety in the care process11. Carneiro AS, Dalmolin GL, Magnago TSBS, Moreira LP, Costa ED, Andolhe R. atient safety culture in critical and non-critical areas: a comparative study. Rev Esc Enferm USP. 2021;55:e20210141. doi: https://doi.org/10.1590/1980-220X-REEUSP-2021-0141.
https://doi.org/10.1590/1980-220X-REEUSP...
-22. World Health Organization. Global patient safety action plan 2021-2030: towards eliminating avoidable harm in health care [Internet]. Geneva: WHO; 2021 [cited 2022 Jul 15]. Available from: Available from: https://www.who.int/teams/integrated-health-services/patient-safety/policy/global-patient-safety-action-plan .
https://www.who.int/teams/integrated-hea...
.

Hospital discharge is considered a vulnerable period, as nearly 30% of the patients develop an adverse event after discharge, including mild (e.g., nausea, diarrhea or skin rash) and even severe (such as gastrointestinal bleeding, delirium or respiratory failure) harms33. Costello WG, Zhang L, Schnipper J, Tsilimingras D. Post-discharge adverse events among African American and Caucasian patients of an urban community hospital. J Racial Ethn Health Disparities. 2021;8(2):439-47. https://doi.org/10.1007/s40615-020-00800-z.
https://doi.org/10.1007/s40615-020-00800...
. These adverse events can result in worsening of symptoms, longer rehabilitation times, use of emergency services, or even hospital readmissions33. Costello WG, Zhang L, Schnipper J, Tsilimingras D. Post-discharge adverse events among African American and Caucasian patients of an urban community hospital. J Racial Ethn Health Disparities. 2021;8(2):439-47. https://doi.org/10.1007/s40615-020-00800-z.
https://doi.org/10.1007/s40615-020-00800...
-44. Zwart DLM, Schnipper JL, Vermond D, Bates DW. How do care transitions work? unraveling the working mechanisms of care transition interventions. Med Care. 2021;59(Suppl 4):S387-97. doi: https://doi.org/10.1097/MLR.0000000000001581.
https://doi.org/10.1097/MLR.000000000000...
.

In addition, actions in care transitions contribute to continuity of the assistance provided and minimize risk of complications after hospitalization55. Costa MFBNA, Andrade SR, Soares CF, Pérez EIB, Tomás SC, Bernardino E. The continuity of hospital nursing care for Primary Health Care in Spain. Rev Esc Enferm USP. 2019;53:e03477. doi: https://doi.org/10.1590/S1980-220X2018017803477.
https://doi.org/10.1590/S1980-220X201801...
-66. Aued GK, Bernardino E, Silva OBM, Martins MM, Peres AM, Lima LS. Liaison nurse competences at hospital discharge. Rev Gaúcha Enferm. 2021;42(spe):e20200211. doi: https://doi.org/10.1590/1983-1447.2021.20200211.
https://doi.org/10.1590/1983-1447.2021.2...
. When successful, they result in quality care and in appropriate return of the patients to their homes77. Weber LAF, Lima MADS, Acosta AM, Marques GQ. Care transition from hospital to home: integrative review. Cogitare Enferm. 2017;22(3):e47615. doi: https://doi.org/10.5380/ce.v22i3.47615.
https://doi.org/10.5380/ce.v22i3.47615...
. Present in the Brazilian legislation, transitional care at hospital discharge provides for the participation and development of autonomy in patients and families, for the articulation between the different points of the health care network, and for the adoption of dehospitalization mechanisms88. Ministério da Saúde (BR). Gabinete do Ministro. Portaria no 3.390, de 30 de dezembro de 2013. Institui a Política Nacional de Atenção Hospitalar (PNHOSP) no âmbito do Sistema Único de Saúde (SUS), estabelecendo-se as diretrizes para a organização do componente hospitalar da Rede de Atenção à Saúde (RAS). Diário Oficial União. 2013 dez 31 [citado 2022 jun17];150(253 Seção 1):54-6. Disponível em: Disponível em: https://pesquisa.in.gov.br/imprensa/jsp/visualiza/index.jsp?data=31/12/2013&jornal=1&pagina=54&totalArquivos=176 .
https://pesquisa.in.gov.br/imprensa/jsp/...
.

The following strategies have been used for better transitions: discharge planning, health education for the patients and promotion of self-management, safety in medication use, full communication of diverse information and post-discharge follow-up99. Lima MADS, Magalhães AMM, Oelke ND, Marques GQ, Lorenzini E, Weber LAF, Fan I.Care transition strategies in Latin American countries: an integrative review. Rev Gaúcha Enferm. 2018;39:e20180119. doi: https://doi.org/10.1590/1983-1447.2018.20180119.
https://doi.org/10.1590/1983-1447.2018.2...
-1010. Gheno J, Weis AH. Care transtion in hospital discharge for adult patients: integrative literature review. Texto Contexto Enferm. 2021;30:e20210030. doi: https://doi.org/10.1590/1980-265X-TCE-2021-0030.
https://doi.org/10.1590/1980-265X-TCE-20...
. Some hospitals in countries such as Canada, Spain and Portugal direct nurses to work exclusively in care transitions, with the function of improving communication and care coordination at hospital discharge66. Aued GK, Bernardino E, Silva OBM, Martins MM, Peres AM, Lima LS. Liaison nurse competences at hospital discharge. Rev Gaúcha Enferm. 2021;42(spe):e20200211. doi: https://doi.org/10.1590/1983-1447.2021.20200211.
https://doi.org/10.1590/1983-1447.2021.2...
.

In Brazil, deployment of nurses or teams devoted to care transition is still emerging66. Aued GK, Bernardino E, Silva OBM, Martins MM, Peres AM, Lima LS. Liaison nurse competences at hospital discharge. Rev Gaúcha Enferm. 2021;42(spe):e20200211. doi: https://doi.org/10.1590/1983-1447.2021.20200211.
https://doi.org/10.1590/1983-1447.2021.2...
. Often times, post-discharge continuity of care is hampered by the limitations in involvement of health teams, work overload, limited time spent on educating and guiding patients and their families, as well as unplanned discharges, difficulties scheduling appointments and lack of in-home monitoring1010. Gheno J, Weis AH. Care transtion in hospital discharge for adult patients: integrative literature review. Texto Contexto Enferm. 2021;30:e20210030. doi: https://doi.org/10.1590/1980-265X-TCE-2021-0030.
https://doi.org/10.1590/1980-265X-TCE-20...
-1111. Acosta AM, Câmara CE, Weber LAF, Fontenele RM. Atividades do enfermeiro na transição do cuidado: realidades e desafios. J Nurs UFPE online. 2018;12(12):3190-7. doi: https://doi.org/10.5205/1981-8963-v12i12a231432p3190-3197-2018.
https://doi.org/10.5205/1981-8963-v12i12...
.

Aligned with transitional care, safety culture has been disseminated in hospital environments, seeking providers' compliance in a positive way and making them co-participants in safe care11. Carneiro AS, Dalmolin GL, Magnago TSBS, Moreira LP, Costa ED, Andolhe R. atient safety culture in critical and non-critical areas: a comparative study. Rev Esc Enferm USP. 2021;55:e20210141. doi: https://doi.org/10.1590/1980-220X-REEUSP-2021-0141.
https://doi.org/10.1590/1980-220X-REEUSP...
, which stimulates safety behaviors and outcomes for patients, providers and healthcare institutions1212. Prieto MMN, Fonseca REP, Zem-Mascarenhas SH. Assessment of patient safety culture in Brazilian hospitals through HSOPSC: a scoping review. Rev Bras Enferm. 2021;74(6):e20201315. doi: https://doi.org/10.1590/0034-7167-2020-1315.
https://doi.org/10.1590/0034-7167-2020-1...
. Therefore, evaluating patient safety aspects in the hospital-home transition can contribute to the use of diverse scientific evidence for health practice, management and policies, scientifically supporting decision-making and management interventions and modifying unsafe practices. Assessing this construct by means of valid, reliable and easy-to-apply indicators is a necessity for managers, providers and researchers.

The following instruments are available to assess transitional care in Brazil: the Care Transitions Measure (CTM), developed in the United States and validated in Brazil1313. Acosta AM, Lima MADS, Marques GQ, Levandovski PF, Weber LAF. Brazilian version of the care transitions measure: translation and validation. Int Nurs Rev. 2017;64(3):379-87. doi: https://doi.org/10.1111/inr.12326.
https://doi.org/10.1111/inr.12326...
, which assesses quality of the care transition from the patients' perspective; the PREPARED questionnaire, which assesses discharge planning quality1414. Ferreira PL, Mendes AP, Fernandes IR, Ferreira RR. Tradução e validação para a língua portuguesa do questionário de planeamento da alta (PREPARED). Ver EnfRef. 2011;3(5):121-33. doi: https://doi.org/10.12707/RIII1032.
https://doi.org/10.12707/RIII1032...
; and the Readiness For Hospital Discharge Scale (RHDS), which assesses readiness for hospital discharge from the patient's perspective1515. Siqueira TH, Vila VSC, Weiss ME. Cross-cultural adaptation of the instrument Readiness for Hospital Discharge Scale - Adult Form. Rev Bras Enferm. 2018;71(3):983-91. doi: https://doi.org/10.1590/0034-7167-2017-0241.
https://doi.org/10.1590/0034-7167-2017-0...
. No instruments were identified that address patient safety during care transition from the perspective of providers who develop actions for hospital discharge, which is the rationale for conducting this study.

This research provides providers and managers with a valid instrument that allows an understanding of transitional care from the nurses' perspective, as well as identify barriers to patient safety during hospital discharge and achieve improvements in the providers' care regarding care transition from hospital to home. Considering the various difficulties in using research evidence in practice, knowledge translation strategies are necessary. In this case, the availability of an assessment tool enhances the incorporation of new interventions in healthcare and nursing, specifically. In addition, the tool will contribute to the visibility of nurses' work and expanding nursing positions in transitional care.

In view of the above, the objective of this study is to develop and validate the content of a measurement instrument to assess the quality of care transitions and patient safety at hospital discharge from the nurses' perspective.

METHODS

A methodological study that followed the process to develop instruments described in the literature1616. Coluci MZO, Alexandre NMC, Milani D. Construção de instrumentos de medida na área da saúde. Cien Saude Colet. 2015;20(3):925-36. doi: https://doi.org/10.1590/1413-81232015203.04332013.
https://doi.org/10.1590/1413-81232015203...
was organized in three stages: 1) Development of the instrument, which included a phase of an integrative review and a phase of semi-structured interviews to establish the conceptual framework, definition of the instrument objectives and of the population involved, construction of the items and answer scales, selection and organization of the items, and structuring of the instrument; 2) Content validation, with review by an expert committee; and 3) Pre-test with the target population. The study was conducted in two hospitals from the South of Brazil, referred to as A and B. Hospital A is a large-size public institution that provides general care, except for trauma care. Hospital B is a large-size, public, university hospital.

The first stage of the study consisted of the development of the instrument. Initially, an integrative review was carried out in the Medical Literature Analysis and Retrieval System online (MEDLINE via PubMed) and Latin American and Caribbean Health Sciences (LILACS) databases, to analyze the diverse evidence available in the scientific literature on the health interventions used to reduce hospital readmissions 30 days following discharge from the hospital to home. The search of the databases took place in January 2019 and was updated in April 2020. The final sample consisted of 71 articles. This integrative review that sustained Stage 1 is published elsewhere1717. Acosta AM, Lima MADS, Marques GQ, Abreu AP, Sanseverino AX, Oelke N. Health interventions for the reduction of hospital readmission within 30 days in clinical patients: An integrative review. Res Soc Dev. 2022;11(2):e2011225273. doi: https://doi.org/10.33448/rsd-v11i2.25273.
https://doi.org/10.33448/rsd-v11i2.25273...
.

Also in the first stage, semi-structured interviews were conducted with nurses from Hospital A, selected according to the inclusion criteria, namely: being a nurse, working in clinical inpatient units for adults, working on day shifts, and being involved in care transitions activities or management of hospital discharge processes. Nurses on vacation or leave during data collection were excluded. Nurses were selected intentionally according to their involvement in discharge processes and availability to respond to the interview. A total of six nurses participated based on data saturation, when no new elements emerged in the analysis1818. Minayo MCS. Amostragem e saturação em pesquisa qualitativa: consensos e controvérsias. Rev Pesq Qual. 2017 [citado 2022 jun 17];5(7):1-12. Disponível em: Disponível em: https://editora.sepq.org.br/rpq/article/view/82/59 .
https://editora.sepq.org.br/rpq/article/...
. Using a script with open-ended questions, perspectives were elicited about activities to ensure patient safety in transitional care and how the quality of care transitions and patient safety at discharge could be assessed. The interviews were audio-recorded and transcribed. Thematic analysis, facilitated by NVivo® software, was used for analyzing the data, following the stages of pre-analysis, exploration of the material, and analysis and interpretation of the material1919. Minayo MCS, Deslandes SF, Gomes R. Pesquisa social: teoria, método e criatividade. 29. ed. Petrópolis: Vozes; 2010.. The interviews were conducted in November and December 2019.

From the synthesis of the main contents of the integrative review and the interviews, the items of the measurement instrument were developed, classified as structure, process and results indicators, considering the Donabedian Triad2020. Donabedian A. Basic approaches to assessment: structure, process and outcome. In: Donabedian A. Explorations in Quality Assessment and Monitoring. Michigan: Health Administration Press; 1980. p. 77-125.. In addition, the objectives and the target population were defined, with the aim of evaluating the quality of transitional care and patient safety at hospital discharge, and the target audience being nurses working in hospital inpatient units. For selection and organization of the items and the response scale, the measurement instrument was presented and widely discussed at a meeting of the research group of this study and authors of this paper. The last step was structuring the measurement tool, where the items were organized in a logical presentation order.

In Stage 2, a content validation process of the measurement tool was completed by a committee of experts. Specialists were intentionally selected considering the criteria: providers with clinical experience, managers, professors and/or researchers that focused on the theme of care transitions and patient safety. Selection was performed based on the search for Curriculum Vitae in the Lattes Platform from the National Council for Scientific and Technological Development using descriptors "care transitions" or "deinstitutionalization". A total of 42 specialists were invited via email, 28 were excluded after not responding following three email contact attempts. The Expert Committee included 14 respondents. It is important to note that authors indicate a minimum of five and a maximum of 10 to 20 experts to review a measurement1616. Coluci MZO, Alexandre NMC, Milani D. Construção de instrumentos de medida na área da saúde. Cien Saude Colet. 2015;20(3):925-36. doi: https://doi.org/10.1590/1413-81232015203.04332013.
https://doi.org/10.1590/1413-81232015203...
,2121. Vieira TW, Sakamoto VTM,Moraes LC, Blatt CR, Caregnato RCA. Validation methods of nursing care protocols: an integrative review. Rev Bras Enferm. 2020;73(Suppl 5):e20200050. doi: https://doi.org/10.1590/0034-7167-2020-0050.
https://doi.org/10.1590/0034-7167-2020-0...
.

Through Google Forms®, the experts evaluated each item of the measurement instrument prepared individually, considering their clarity and representativeness on a Likert-type scale, with the criteria classified as follows: 1=Unclear/Not representative; 2=Unclear/Needs major revision to be representative; 3=Quite clear/Needs little revision to be representative; 4=Very clear/Representative. Suggestions regarding inclusion, removal or merging of items and comments were allowed. Data collection was conducted from December 2020 to February 2021.

For data analysis in this stage, the Content Validity Index (CVI) was used, in which the answers “3” and “4” were summed and divided by the total number of answers. A CVI value of 0.8 was considered as the criterion to decide on relevance of the measurement item or on the need to modify it1616. Coluci MZO, Alexandre NMC, Milani D. Construção de instrumentos de medida na área da saúde. Cien Saude Colet. 2015;20(3):925-36. doi: https://doi.org/10.1590/1413-81232015203.04332013.
https://doi.org/10.1590/1413-81232015203...
.

In Stage 3, the new version of the instrument was submitted for pre-test with the target population, in which the instrument was applied in person to assess its structure and understanding of all items. The sample for the pre-test consisted of nurses from both hospitals, randomly selected according to the inclusion and exclusion criteria: being a nurse and working on clinical inpatient units for adults, while nurses on vacation or leave during data collection were excluded. The final sample totaled 20 participants (nine from Hospital A and 11 from Hospital B), which corresponds to the recommended number of 15 to 30 subjects in the pretesting stage2222. Gunawan J, Marzilli C, Aungsuroch Y. Establishing appropriate sample size for developing and validating a questionnaire in nursing research [editorial]. Belitung Nurs J. 2021;7(5):356-60. doi: https://doi.org/10.33546/bnj.1927.
https://doi.org/10.33546/bnj.1927...
.

The participants in this stage were asked about their understanding of the measurement items and their ability to complete the items in the instrument. A scale that ranged from 1 to 5 was used as follows: 1=I didn't understand to 5=I understood a lot. Data collection took place between June 2021 and January 2022. The data were analyzed using the same calculation for CVI as described in the previous stage, considering CVI values above 0.8 as satisfactory1616. Coluci MZO, Alexandre NMC, Milani D. Construção de instrumentos de medida na área da saúde. Cien Saude Colet. 2015;20(3):925-36. doi: https://doi.org/10.1590/1413-81232015203.04332013.
https://doi.org/10.1590/1413-81232015203...
. The final version of the measurement instrument was completed in this stage.

The study was approved by the Research Ethics Committees of the Federal University of Rio Grande do Sul (Certificate number 3357454) and of the hospital institutions involved (Certificate numbers 3505549 and 3562026), as set forth in Brazilian Resolution No. 466/2012. All the participants signed the Free and Informed Consent Form. The Standards for Quality Improvement Reporting Excellence 2.0 (SQUIRE) instrument from the Enhancing the Quality and Transparency of Health Research (EQUATOR) network was used to guide the writing of the article.

RESULTS

Development of the instrument

The following components were listed in the integrative review: identification of readmission risk, discharge planning, health education at hospital admission, health education after discharge, medication reconciliation, communication with the health services, outpatient follow-up after discharge, telephone contact after discharge, and home visit after discharge1717. Acosta AM, Lima MADS, Marques GQ, Abreu AP, Sanseverino AX, Oelke N. Health interventions for the reduction of hospital readmission within 30 days in clinical patients: An integrative review. Res Soc Dev. 2022;11(2):e2011225273. doi: https://doi.org/10.33448/rsd-v11i2.25273.
https://doi.org/10.33448/rsd-v11i2.25273...
. Analysis of the interviews resulted in three thematic categories supported by 10 subcategories (Chart 1).

Chart 1 -
Presentation of the study categories and subcategories. Porto Alegre, Rio Grande do Sul, Brazil, 2019

The measurement instrument developed in Stage 1 contained 43 items, organized into six domains: structure; discharge planning; care education; referral for continuity of care; safety culture, and care transitions results.

Content validation

A total of 14 experts took part in Stage 2: eight nurses, three physicians, two pharmacists and a physiotherapist. Of them, four (28.57%) were post-PhDs, four (28.57%) had Master's degrees, four (28.57%) had post-graduate certificate, and two (14.29%) were PhDs. Regarding the Region of Brazil, six (42,85%) were from the State of Rio Grande do Sul, two (14.29%) from Santa Catarina, and one (7,14%) from each State of Paraná, São Paulo, Mato Grosso, Goiás, Pará, and Distrito Federal.

It was verified that the measurement instrument title and format were clear and understandable from the participants' perspective. It was recommended to include the definition of care transition in the measurement instructions, which was accepted. Ten items were modified to reflect the suggestions made by the experts. Five items were excluded for not obtaining clarity or representativeness CVI values above 0.8 (Table 1).

Pre-test

In Stage 3, the final version of the measurement instrument was evaluated by the target audience represented by nurses from both hospitals, most of whom were female (95%), had post-graduate certificate (80%) and had worked at the institution for more than five years (90%). The overall CVI of the instrument was 0.93. All the items had CVI values above 0.8 (Table 1).

Table 1 -
Presentation of the Content Validity Index corresponding to the measurement instrument in the content validation and pre-test phases, by domains. Porto Alegre, Rio Grande do Sul, Brazil, 2020-2022

In its final version, the instrument called “Assessment of care transition and patient safety at hospital discharge (TranSPAH)” consisted of 37 items, classified in the six domains, as shown in Figure 1. The measurement is in Brazilian Portuguese. The items are presented in the form of statements, in which the respondents must indicate whether they agree or disagree according to a five-point Likert scale, as follows: I totally disagree=0; I partially disagree=1; I neither agree nor disagree=2; I partially agree=3; and I Totally agree=4. The items presented as negative statements (21, 31, 33, 34, 35) will have their scores reversed, namely: I totally disagree=4 and I totally agree=0. The “Not applicable/I don't know” option will not be computed towards the final score. The means of the total scale answers will be calculated, as well as those corresponding to each item and to the domains. To ease disclosing of the results, a formula that transforms the means obtained into scores from 0 to 100 will be used, as shown below:

(Mean/4) x 100

Zero will be considered as corresponding to the worst patient safety quality in transitional care during hospital discharge, while 100 will represent the best quality.

Figure 1 -
Assessment of care transition and patient safety at hospital discharge (TranSPAH) measurement. Porto Alegre, Rio Grande do Sul, Brazil, 2022

DISCUSSION

Nursing research studies seek to incorporate diverse evidence into the practice and the use of measurement instruments facilitates the nurses' work, provides greater safety to the team and facilitates introduction of new technologies and rational use of resources, in addition to providing monitoring of process indicators and results and contributing to care quality and safety2121. Vieira TW, Sakamoto VTM,Moraes LC, Blatt CR, Caregnato RCA. Validation methods of nursing care protocols: an integrative review. Rev Bras Enferm. 2020;73(Suppl 5):e20200050. doi: https://doi.org/10.1590/0034-7167-2020-0050.
https://doi.org/10.1590/0034-7167-2020-0...
. Regarding the transitional care theme, the use of measurement instruments is still limited and, therefore, development of TranSPAHmay help to measure the quality of the patient's safety during care transition at hospital discharge in Brazil.

The instrument available in the Brazilian literature to assess transitional care quality portray the patients' and caregivers' experience1313. Acosta AM, Lima MADS, Marques GQ, Levandovski PF, Weber LAF. Brazilian version of the care transitions measure: translation and validation. Int Nurs Rev. 2017;64(3):379-87. doi: https://doi.org/10.1111/inr.12326.
https://doi.org/10.1111/inr.12326...
. However, a number of authors who used this instrument report the influence of the patients' feelings of gratitude for the care received in the research results as a limitation, with a tendency to produce more auspicious data than reality2323. Cechinel-Peiter C, Lanzoni GMM, Mello ALSF, Acosta AM, Pina JC, Andrade SR et al. Quality of transitional care of children with chronic diseases: a cross-sectional study. Rev Esc Enferm USP. 2022;56:e20210535. doi: https://doi.org/10.1590/1980-220X-REEUSP-2021-0535.
https://doi.org/10.1590/1980-220X-REEUSP...
-2424. Weber LAF, Lima MADS, Acosta AM. Quality of care transition and its association with hospital readmission. Aquichan. 2019;19(4):e1945. doi: https://doi.org/10.5294/aqui.2019.19.4.5.
https://doi.org/10.5294/aqui.2019.19.4.5...
. Therefore, an assessment from the health providers' perspective contributes to the construction of knowledge about the theme.

Nurses play a pivotal role in care transitions, identifying patients' needs for post-discharge care, coordinating discharge planning, educating patients and families, communicating with health providers and other health services to ensure quality in patient healthcare trajectory77. Weber LAF, Lima MADS, Acosta AM, Marques GQ. Care transition from hospital to home: integrative review. Cogitare Enferm. 2017;22(3):e47615. doi: https://doi.org/10.5380/ce.v22i3.47615.
https://doi.org/10.5380/ce.v22i3.47615...
,1010. Gheno J, Weis AH. Care transtion in hospital discharge for adult patients: integrative literature review. Texto Contexto Enferm. 2021;30:e20210030. doi: https://doi.org/10.1590/1980-265X-TCE-2021-0030.
https://doi.org/10.1590/1980-265X-TCE-20...
. The TranSPAH instrument could be used by nurses and institutions to identify strengths and weaknesses in care transitions and provide feedback for devising intervention proposals for nursing practice and management. The measurement might be a guiding resource for providers and decision-makers, as it provides data related to patient care, healthcare teams work and institutions' processes. Considering that the evaluation process leads to continuous reflection and learning, the use of the instrument may help to promote care transitions as an organizational culture, taking in part of the values, beliefs, and norms that influence processes of the institution.

It should be noted that, in addition to following the knowledge construction method1616. Coluci MZO, Alexandre NMC, Milani D. Construção de instrumentos de medida na área da saúde. Cien Saude Colet. 2015;20(3):925-36. doi: https://doi.org/10.1590/1413-81232015203.04332013.
https://doi.org/10.1590/1413-81232015203...
, this study was concerned with developing knowledge translation for the application of new technology in management and care practice. For this purpose, knowledge users (nurses) and stakeholders (research group members who work in the health network) participated throughout the development process of the TranSPAH, from initiation through completion, in line with knowledge translation. Involving the knowledge users from the beginning of the research facilitates using the research results in the practice, as they can provide diverse information about the context that researchers often lack2525. Oelke ND, Lima MADS, Acosta AM. Knowledge translation: translating research into policy and practice. Rev Gaúcha Enferm. 2015;36(3):113-7. doi: https://doi.org/10.1590/1983-1447.2015.03.55036.
https://doi.org/10.1590/1983-1447.2015.0...
.

The nurses' reality in the field and the review of the literature, supported the conceptual structure for preparing the measurement instrument items in the six domains. A number of authors have suggested that an extensive literature review and the inclusion of the researcher in the social context of the target population are indispensable for the development of the content of measurement instruments in health care1616. Coluci MZO, Alexandre NMC, Milani D. Construção de instrumentos de medida na área da saúde. Cien Saude Colet. 2015;20(3):925-36. doi: https://doi.org/10.1590/1413-81232015203.04332013.
https://doi.org/10.1590/1413-81232015203...
,2626. Leite SS, Áfio ACE, Carvalho LV, Silva JM, Almeida PC, Pagliuca LMF. Construction and validation of an educational content validation instrument in health. Rev Bras Enferm. 2018;71(Suppl 4):1635-41. doi: https://doi.org/10.1590/0034-7167-2017-0648.
https://doi.org/10.1590/0034-7167-2017-0...
. In addition, the TranSPAH items and domains were intensely debated by the authors' research group, whose members include researchers and stakeholders, seeking collective elaboration on the content of the items and the terminology used. The interactive process between the authors and the research group was fundamental to clarify initial points in the development of the instrument and planning its application in health services.

As for measurement instrument structure, there is no consensus in the literature regarding the number of items and domains to represent a construct; however, the starting point is the premise that they follow a logical order, from the most general to the most specific, and that they should be brief or moderately long, not requiring a large amount of time to complete1616. Coluci MZO, Alexandre NMC, Milani D. Construção de instrumentos de medida na área da saúde. Cien Saude Colet. 2015;20(3):925-36. doi: https://doi.org/10.1590/1413-81232015203.04332013.
https://doi.org/10.1590/1413-81232015203...
. TranSPAH has 37 items; however, they are short easy-to-answer statements.

The items are organized in relevant domains for the assessment of patient safety in transitional care. The "Structure" domain deals with the perception of the quality of the human and organizational conditions for the development of effective care transitions including aspects related to a better number of providers and having a specific program or team to coordinate transitional care at hospital discharge that denote higher quality66. Aued GK, Bernardino E, Silva OBM, Martins MM, Peres AM, Lima LS. Liaison nurse competences at hospital discharge. Rev Gaúcha Enferm. 2021;42(spe):e20200211. doi: https://doi.org/10.1590/1983-1447.2021.20200211.
https://doi.org/10.1590/1983-1447.2021.2...
,1010. Gheno J, Weis AH. Care transtion in hospital discharge for adult patients: integrative literature review. Texto Contexto Enferm. 2021;30:e20210030. doi: https://doi.org/10.1590/1980-265X-TCE-2021-0030.
https://doi.org/10.1590/1980-265X-TCE-20...
.

The "Discharge planning" domain focuses on the recognition of the activities developed by the team to plan hospital discharge. These include such items as the identification of readmission risk, the development of a discharge plan in advance, and considering the patients' and/or caregivers' values and preferences. These items are all corroborated by the literature77. Weber LAF, Lima MADS, Acosta AM, Marques GQ. Care transition from hospital to home: integrative review. Cogitare Enferm. 2017;22(3):e47615. doi: https://doi.org/10.5380/ce.v22i3.47615.
https://doi.org/10.5380/ce.v22i3.47615...
,1717. Acosta AM, Lima MADS, Marques GQ, Abreu AP, Sanseverino AX, Oelke N. Health interventions for the reduction of hospital readmission within 30 days in clinical patients: An integrative review. Res Soc Dev. 2022;11(2):e2011225273. doi: https://doi.org/10.33448/rsd-v11i2.25273.
https://doi.org/10.33448/rsd-v11i2.25273...
.

The "Care education" domain addresses the perception about health education activities to prepare the patient and caregiver for hospital discharge, including aspects related to care after discharge, such as personal hygiene, diet, therapeutic devices, medication use and warning signs, among others described in the literature99. Lima MADS, Magalhães AMM, Oelke ND, Marques GQ, Lorenzini E, Weber LAF, Fan I.Care transition strategies in Latin American countries: an integrative review. Rev Gaúcha Enferm. 2018;39:e20180119. doi: https://doi.org/10.1590/1983-1447.2018.20180119.
https://doi.org/10.1590/1983-1447.2018.2...
-1010. Gheno J, Weis AH. Care transtion in hospital discharge for adult patients: integrative literature review. Texto Contexto Enferm. 2021;30:e20210030. doi: https://doi.org/10.1590/1980-265X-TCE-2021-0030.
https://doi.org/10.1590/1980-265X-TCE-20...
. In addition, the domain addresses some health education strategies that contribute to transitional care, such as clarifying questions and using educational materials1717. Acosta AM, Lima MADS, Marques GQ, Abreu AP, Sanseverino AX, Oelke N. Health interventions for the reduction of hospital readmission within 30 days in clinical patients: An integrative review. Res Soc Dev. 2022;11(2):e2011225273. doi: https://doi.org/10.33448/rsd-v11i2.25273.
https://doi.org/10.33448/rsd-v11i2.25273...
.

The "Referral for continuity of care" domain deals with activities to ensure access to health services for care continuity after discharge including referral to primary care, services that provide necessary materials to the patient, and follow-up after discharge1717. Acosta AM, Lima MADS, Marques GQ, Abreu AP, Sanseverino AX, Oelke N. Health interventions for the reduction of hospital readmission within 30 days in clinical patients: An integrative review. Res Soc Dev. 2022;11(2):e2011225273. doi: https://doi.org/10.33448/rsd-v11i2.25273.
https://doi.org/10.33448/rsd-v11i2.25273...
.

Considering that care transitions must be recognized as institutional priorities and be introduced into the organizational culture, the "Safety culture" domain addresses the perception about the organizational commitment to safety at patient discharge, from recognition of the responsibilities and actions by the interprofessional team to encouraging leadership and ongoing education.

Finally, the "Care transitions results" domain focuses on perceptions on the impact of the actions developed for patient safety in hospital discharge. These include aspects related to delays in the discharge procedures for avoidable reasons, occurrence of hospital readmissions, search for emergency services after discharge, and provider satisfaction with the quality of transitional care1717. Acosta AM, Lima MADS, Marques GQ, Abreu AP, Sanseverino AX, Oelke N. Health interventions for the reduction of hospital readmission within 30 days in clinical patients: An integrative review. Res Soc Dev. 2022;11(2):e2011225273. doi: https://doi.org/10.33448/rsd-v11i2.25273.
https://doi.org/10.33448/rsd-v11i2.25273...
.

The TranSPAH domains are comprehensive and include aspects investigated in the Care Transitions Measure, whose factors refer to preparation for self-management, understanding of medications, assured preferences and the development of a care plan1313. Acosta AM, Lima MADS, Marques GQ, Levandovski PF, Weber LAF. Brazilian version of the care transitions measure: translation and validation. Int Nurs Rev. 2017;64(3):379-87. doi: https://doi.org/10.1111/inr.12326.
https://doi.org/10.1111/inr.12326...
. The domains are also aligned with those in the PREPARED instrument such as diverse information about support structures, information about medications, preparation for reintegration and control over the circumstances1414. Ferreira PL, Mendes AP, Fernandes IR, Ferreira RR. Tradução e validação para a língua portuguesa do questionário de planeamento da alta (PREPARED). Ver EnfRef. 2011;3(5):121-33. doi: https://doi.org/10.12707/RIII1032.
https://doi.org/10.12707/RIII1032...
.

The newly developed TranSPAH instrument showed content validity with 90.5% of the items presenting CVI values above 0.8 for the clarity criteria and 95.2% for relevance when reviewed by the Expert Committee. Ten items were modified according to the suggestions made by the experts and five were excluded for not reaching the minimum agreement level required. The main changes were related to wording of the items, such as replacing the term "shared electronic medical chart system" by "integrated electronic medical chart system". Other items were excluded based on not reaching CVI values greater than 0.8 as experts found them broad and very subjective that would hinder filling out the instrument. In the pre-test with nurses from large-size hospitals, representative of the measurement instrument's target population, good clarity of the measurement items was shown.

However, authors do note that evaluating the psychometric properties of an instrument, verifying validity of the construct, criterion, reliability, practicability, sensitivity, responsiveness and interpretability are strongly recommended1616. Coluci MZO, Alexandre NMC, Milani D. Construção de instrumentos de medida na área da saúde. Cien Saude Colet. 2015;20(3):925-36. doi: https://doi.org/10.1590/1413-81232015203.04332013.
https://doi.org/10.1590/1413-81232015203...
. The fact that the measurement instrument developed was only assessed for content validity is identified as a limitation of this study. Other psychometric properties will be evaluated in future stages of the instrument’s testing.

In addition, the pre-test process with the target population was based on the opinion of nurses working in clinical inpatient units of hospitals from a municipality in the Brazilian South region, which may not correspond to other locations and health contexts. Even though validation by specialists from other areas of Brazil would reduce this problem, further studies are recommended to evaluate a broader use of this instrument in the country.

CONCLUSION

The measurement instrument to assess the quality of care transition and patient safety at hospital discharge from the nurses' perspective proved to be valid and easy to apply in the Brazilian context, reaching satisfactory indices both in the validation by the expert committee and in the pre-test by the target population. The final version consists of structure, process and result evaluation items that affect transitional care quality.

It is expected that future studies will evaluate the instrument's psychometric properties to apply it to obtain a better understanding of patient safety in transitional care at hospital discharge from the nurses' perspective in Brazil. It is understood that TranSPAH can be a viable tool to be considered by managers and nurses in the situational diagnosis of the strengths and weaknesses in their health services. In this way, it can support health providers in decision-making and in evidence-based management interventions, modifying care practices, facilitating the application of evidence into practice and promoting institutional culture for improving care transitions.

Acknowledgements:

This study was funded by the Foundation for Research Support of the State of Rio Grande do Sul (Fundação de Amparo à Pesquisa do Estado do Rio Grande do Sul- FAPERGS) (Process n. 19/2551-0001213-6) and by Brazilian National Council for Scientific and Technological Development (CNPq) (Process n. 433997/2018-4).

REFERENCES

  • 1. Carneiro AS, Dalmolin GL, Magnago TSBS, Moreira LP, Costa ED, Andolhe R. atient safety culture in critical and non-critical areas: a comparative study. Rev Esc Enferm USP. 2021;55:e20210141. doi: https://doi.org/10.1590/1980-220X-REEUSP-2021-0141
    » https://doi.org/10.1590/1980-220X-REEUSP-2021-0141
  • 2. World Health Organization. Global patient safety action plan 2021-2030: towards eliminating avoidable harm in health care [Internet]. Geneva: WHO; 2021 [cited 2022 Jul 15]. Available from: Available from: https://www.who.int/teams/integrated-health-services/patient-safety/policy/global-patient-safety-action-plan
    » https://www.who.int/teams/integrated-health-services/patient-safety/policy/global-patient-safety-action-plan
  • 3. Costello WG, Zhang L, Schnipper J, Tsilimingras D. Post-discharge adverse events among African American and Caucasian patients of an urban community hospital. J Racial Ethn Health Disparities. 2021;8(2):439-47. https://doi.org/10.1007/s40615-020-00800-z
    » https://doi.org/10.1007/s40615-020-00800-z
  • 4. Zwart DLM, Schnipper JL, Vermond D, Bates DW. How do care transitions work? unraveling the working mechanisms of care transition interventions. Med Care. 2021;59(Suppl 4):S387-97. doi: https://doi.org/10.1097/MLR.0000000000001581
    » https://doi.org/10.1097/MLR.0000000000001581
  • 5. Costa MFBNA, Andrade SR, Soares CF, Pérez EIB, Tomás SC, Bernardino E. The continuity of hospital nursing care for Primary Health Care in Spain. Rev Esc Enferm USP. 2019;53:e03477. doi: https://doi.org/10.1590/S1980-220X2018017803477
    » https://doi.org/10.1590/S1980-220X2018017803477
  • 6. Aued GK, Bernardino E, Silva OBM, Martins MM, Peres AM, Lima LS. Liaison nurse competences at hospital discharge. Rev Gaúcha Enferm. 2021;42(spe):e20200211. doi: https://doi.org/10.1590/1983-1447.2021.20200211
    » https://doi.org/10.1590/1983-1447.2021.20200211
  • 7. Weber LAF, Lima MADS, Acosta AM, Marques GQ. Care transition from hospital to home: integrative review. Cogitare Enferm. 2017;22(3):e47615. doi: https://doi.org/10.5380/ce.v22i3.47615
    » https://doi.org/10.5380/ce.v22i3.47615
  • 8. Ministério da Saúde (BR). Gabinete do Ministro. Portaria no 3.390, de 30 de dezembro de 2013. Institui a Política Nacional de Atenção Hospitalar (PNHOSP) no âmbito do Sistema Único de Saúde (SUS), estabelecendo-se as diretrizes para a organização do componente hospitalar da Rede de Atenção à Saúde (RAS). Diário Oficial União. 2013 dez 31 [citado 2022 jun17];150(253 Seção 1):54-6. Disponível em: Disponível em: https://pesquisa.in.gov.br/imprensa/jsp/visualiza/index.jsp?data=31/12/2013&jornal=1&pagina=54&totalArquivos=176
    » https://pesquisa.in.gov.br/imprensa/jsp/visualiza/index.jsp?data=31/12/2013&jornal=1&pagina=54&totalArquivos=176
  • 9. Lima MADS, Magalhães AMM, Oelke ND, Marques GQ, Lorenzini E, Weber LAF, Fan I.Care transition strategies in Latin American countries: an integrative review. Rev Gaúcha Enferm. 2018;39:e20180119. doi: https://doi.org/10.1590/1983-1447.2018.20180119
    » https://doi.org/10.1590/1983-1447.2018.20180119
  • 10. Gheno J, Weis AH. Care transtion in hospital discharge for adult patients: integrative literature review. Texto Contexto Enferm. 2021;30:e20210030. doi: https://doi.org/10.1590/1980-265X-TCE-2021-0030
    » https://doi.org/10.1590/1980-265X-TCE-2021-0030
  • 11. Acosta AM, Câmara CE, Weber LAF, Fontenele RM. Atividades do enfermeiro na transição do cuidado: realidades e desafios. J Nurs UFPE online. 2018;12(12):3190-7. doi: https://doi.org/10.5205/1981-8963-v12i12a231432p3190-3197-2018
    » https://doi.org/10.5205/1981-8963-v12i12a231432p3190-3197-2018
  • 12. Prieto MMN, Fonseca REP, Zem-Mascarenhas SH. Assessment of patient safety culture in Brazilian hospitals through HSOPSC: a scoping review. Rev Bras Enferm. 2021;74(6):e20201315. doi: https://doi.org/10.1590/0034-7167-2020-1315
    » https://doi.org/10.1590/0034-7167-2020-1315
  • 13. Acosta AM, Lima MADS, Marques GQ, Levandovski PF, Weber LAF. Brazilian version of the care transitions measure: translation and validation. Int Nurs Rev. 2017;64(3):379-87. doi: https://doi.org/10.1111/inr.12326
    » https://doi.org/10.1111/inr.12326
  • 14. Ferreira PL, Mendes AP, Fernandes IR, Ferreira RR. Tradução e validação para a língua portuguesa do questionário de planeamento da alta (PREPARED). Ver EnfRef. 2011;3(5):121-33. doi: https://doi.org/10.12707/RIII1032
    » https://doi.org/10.12707/RIII1032
  • 15. Siqueira TH, Vila VSC, Weiss ME. Cross-cultural adaptation of the instrument Readiness for Hospital Discharge Scale - Adult Form. Rev Bras Enferm. 2018;71(3):983-91. doi: https://doi.org/10.1590/0034-7167-2017-0241
    » https://doi.org/10.1590/0034-7167-2017-0241
  • 16. Coluci MZO, Alexandre NMC, Milani D. Construção de instrumentos de medida na área da saúde. Cien Saude Colet. 2015;20(3):925-36. doi: https://doi.org/10.1590/1413-81232015203.04332013
    » https://doi.org/10.1590/1413-81232015203.04332013
  • 17. Acosta AM, Lima MADS, Marques GQ, Abreu AP, Sanseverino AX, Oelke N. Health interventions for the reduction of hospital readmission within 30 days in clinical patients: An integrative review. Res Soc Dev. 2022;11(2):e2011225273. doi: https://doi.org/10.33448/rsd-v11i2.25273
    » https://doi.org/10.33448/rsd-v11i2.25273
  • 18. Minayo MCS. Amostragem e saturação em pesquisa qualitativa: consensos e controvérsias. Rev Pesq Qual. 2017 [citado 2022 jun 17];5(7):1-12. Disponível em: Disponível em: https://editora.sepq.org.br/rpq/article/view/82/59
    » https://editora.sepq.org.br/rpq/article/view/82/59
  • 19. Minayo MCS, Deslandes SF, Gomes R. Pesquisa social: teoria, método e criatividade. 29. ed. Petrópolis: Vozes; 2010.
  • 20. Donabedian A. Basic approaches to assessment: structure, process and outcome. In: Donabedian A. Explorations in Quality Assessment and Monitoring. Michigan: Health Administration Press; 1980. p. 77-125.
  • 21. Vieira TW, Sakamoto VTM,Moraes LC, Blatt CR, Caregnato RCA. Validation methods of nursing care protocols: an integrative review. Rev Bras Enferm. 2020;73(Suppl 5):e20200050. doi: https://doi.org/10.1590/0034-7167-2020-0050
    » https://doi.org/10.1590/0034-7167-2020-0050
  • 22. Gunawan J, Marzilli C, Aungsuroch Y. Establishing appropriate sample size for developing and validating a questionnaire in nursing research [editorial]. Belitung Nurs J. 2021;7(5):356-60. doi: https://doi.org/10.33546/bnj.1927
    » https://doi.org/10.33546/bnj.1927
  • 23. Cechinel-Peiter C, Lanzoni GMM, Mello ALSF, Acosta AM, Pina JC, Andrade SR et al. Quality of transitional care of children with chronic diseases: a cross-sectional study. Rev Esc Enferm USP. 2022;56:e20210535. doi: https://doi.org/10.1590/1980-220X-REEUSP-2021-0535
    » https://doi.org/10.1590/1980-220X-REEUSP-2021-0535
  • 24. Weber LAF, Lima MADS, Acosta AM. Quality of care transition and its association with hospital readmission. Aquichan. 2019;19(4):e1945. doi: https://doi.org/10.5294/aqui.2019.19.4.5
    » https://doi.org/10.5294/aqui.2019.19.4.5
  • 25. Oelke ND, Lima MADS, Acosta AM. Knowledge translation: translating research into policy and practice. Rev Gaúcha Enferm. 2015;36(3):113-7. doi: https://doi.org/10.1590/1983-1447.2015.03.55036
    » https://doi.org/10.1590/1983-1447.2015.03.55036
  • 26. Leite SS, Áfio ACE, Carvalho LV, Silva JM, Almeida PC, Pagliuca LMF. Construction and validation of an educational content validation instrument in health. Rev Bras Enferm. 2018;71(Suppl 4):1635-41. doi: https://doi.org/10.1590/0034-7167-2017-0648
    » https://doi.org/10.1590/0034-7167-2017-0648

Edited by

Associate editor:

Luccas Melo de Souza

Editor-in-chief:

Maria da Graça Oliveira Crossetti

Publication Dates

  • Publication in this collection
    03 Mar 2023
  • Date of issue
    2022

History

  • Received
    18 July 2022
  • Accepted
    18 Nov 2022
Universidade Federal do Rio Grande do Sul. Escola de Enfermagem Rua São Manoel, 963 -Campus da Saúde , 90.620-110 - Porto Alegre - RS - Brasil, Fone: (55 51) 3308-5242 / Fax: (55 51) 3308-5436 - Porto Alegre - RS - Brazil
E-mail: revista@enf.ufrgs.br