Indicators of effectiveness of nursing care in the dimension of patient safety

Indicadores de efectividad de la asistencia de enfermería en la dimensión seguridad del paciente

ABSTRACT

Objectives:

to validate nursing care effectiveness indicators of patient safety dimension.

Methods:

quantitative survey, using the electronic Delphi sampli, with 52 participants selected by the Snowball sampling. Eight indicators were evaluated regarding the attributes: availability, reliability, simplicity, representativeness, sensitivity, comprehensiveness, objectivity, cost, utility, stability and timeliness. For validation, the minimum agreement criterion was 70%.

Results:

Cronbach’s alpha (0.942) evidenced the high internal consistency among the attributes. The indicators fall with damage, hip fracture, and postoperative hip fracture, incidents related to equipment, incidents due to failures in patient identification, and pressure injury were validated in all attributes, and those of medication error and hand Hygiene were not validated.

Conclusions:

the validated indicators allow assessment of the effectiveness of hospital nursing care. Unavailability of data is an obstacle to monitoring patient safety.

Descriptors:
Quality Indicators, Health Care; Effectiveness; Nursing Care; Patient Safety; Quality Management

RESUMEN

Objetivos:

validar los indicadores de efectividad de la asistencia de enfermería hospitalaria en la dimensión seguridad del paciente.

Métodos:

estudio quantitativo, tipo survey, mediante la técnica Delphi electrónica, en el cual participaron 52 individuos seleccionados por la técnica Bola de Nieve. Se evaluaron ocho indicadores en los atributos disponibilidad, confiabilidad, sencillez, representatividad, sensibilidad, alcance, objetividad, costo, utilidad, estabilidad y tempestividad. El criterio mínimo de concordancia para validación fue del 70%.

Resultados:

el Alfa de Cronbach (0,942) evidenció la alta consistencia interna entre los atributos. Los indicadores caída con daño, fractura de cadera y fractura de cadera postoperatoria, incidentes relacionados con herramientas, incidentes debido a fallas en la identificación del paciente, y lesión por presión fueron validados en todos los atributos, y los de error de medicación y la higiene de las manos no han sido validados.

Conclusiones:

los indicadores validados permiten evaluar la efectividad asistencial de la enfermería. La indisponibilidad de datos es un obstáculo al monitoreo de la seguridad del paciente.

Descriptores:
Indicadores de Calidad de la Atención de Salud; Efectividad; Atención de Enfermería; Seguridad del Paciente; Gestión de la Calidad

RESUMO

Objetivos:

validar indicadores de efetividade da assistência de enfermagem hospitalar na dimensão segurança do paciente.

Métodos:

estudo quantitativo, tipo survey, mediante a técnica Delphi eletrônica, com 52 participantes selecionados pela técnica Bola de Neve. Oito indicadores foram avaliados quanto aos atributos disponibilidade, confiabilidade, simplicidade, representatividade, sensibilidade, abrangência, objetividade, custo, utilidade, estabilidade e tempestividade. Para validação o critério mínimo de concordância foi de 70%.

Resultados:

o alfa de Cronbach (0,942) evidenciou a alta consistência interna entre os atributos. Os indicadores queda com dano, fratura de quadril, e fratura de quadril pós-operatória, incidentes relacionados a equipamentos, incidentes devido a falhas na identificação do paciente, e lesão por pressão foram validados em todos os atributos, e os de erro de medicação e higiene de mãos não foram validados.

Conclusões:

os indicadores validados permitem avaliação da efetividade assistencial da enfermagem hospitalar. A indisponibilidade de dados é um óbice ao monitoramento da segurança do paciente.

Descritores:
Indicadores de Qualidade em Assistência à Saúde; Efetividade; Cuidado de Enfermagem; Segurança do Paciente; Gestão da Qualidade em Saúde

INTRODUCTION

Patient safety has been part of the global health priority agenda since 2000, when an American report revealed the magnitude of errors in hospital care⁽¹⁾.^.This is a relevant dimension of quality and, through indicators, measures risks of patient care⁽²⁾.

Indicators are quantifiable representations of structure, processes and results, and provide information expressed by events, rates or indices^(3-5). Even relevant, they are underutilized. The systematic effectiveness measurement of in-Hospital programs is not perceived⁽⁴⁾, with more frequent measurements related to the structure or processes.

Indicators of results or effectiveness refer to desirable or undesirable changes attributed to health care provided⁽⁶⁾. Although the results indicators are influenced by many factors, they are concrete and indispensable elements to measure the impact of health care⁽⁷⁾. Effectiveness is the degree level to which attainable improvements in health are achieved⁽⁸⁾. Thus, assistance is expected to be effective and safe, providing good results and good life quality to the individual and the community, and is based on the best evidence.

Nursing is highlighted as the largest workforce in Brazilian health area, answering for the majority of hospital care, with direct involvement in the conception, operationalization and evaluation of strategies to improve patient’s safety⁽⁹⁾. Therefore, indicators for measuring nursing care effectiveness must correlate to the main dimensions of quality, such as safety and patient-centered care; and organizations should provide mechanisms to facilitate health professionals directly involved in assistance and managers to understand the concepts related to these indicators and their use in the hospital routine.

From the perspective of contributing to the quality and safety of health care, the Sistema de Notificações à Vigilância Sanitária (NOTIVISA - notification system for sanitary surveillance) was created. According to NOTIVISA, between 2014 and 2016, there were 63,933 incidents related to assistance, 417 (0.6%) fatal⁽¹⁰⁾. All public and private services, through its patient Safety Center, are responsible for notifications of incidents in Notivisa. Nursing adherence to internal notification is emphasized, although the safety culture in hospitals still requires maturity for professionals to feel safe when informing occurrences⁽⁹⁾.

It is found in the literature^(1,11-25) nursing care effectiveness indicators not validated by specialists with expertise in the study and/or use of indicators in health practice. This study focuses on the following indicators: Fall with damage^{(1,11-12,14-15,21,23-24)}, hip fracture ^(15,22) and postoperative hip fracturing⁽¹⁵⁾, equipment-related incidents⁽¹⁵⁾, incidents due to failures in patient Identification⁽²¹⁾, pressure injury^(11-15), medication error^{(1,13-14,18-20,26)} and hand hygiene^(16-17).

The content validation of indicators of effectiveness of nursing care in the patient safety dimension demonstrates the extent to which these indicators express the planned results for a given nursing care. Thus, this validation can contribute to evidence indicators sensitive to nursing care, qualify assistance planning, and explain to patients the nursing team’s contribution to the results of hospital care⁽¹³⁾.

As criteria to assess whether the indicators measure the nursing care effectiveness, attributes recognized in the literature can be used as desirable for a good indicator, such as: availability, reliability, simplicity, representativeness, sensitivity, comprehensiveness, objectivity, low cost, usefulness, stability and timeliness^{(11-12,27-28)}.

OBJETIVES

To validate nursing care effectiveness indicators in the patient safety dimension, considering their correspondence to the attributes availability, reliability, simplicity, representativeness, sensitivity, comprehensiveness, objectivity, low cost, usefulness, stability and timeliness.

METHODS

Ethical aspects

The study incorporated in its design the basic references of the resolution of National Health Council N º 466/2012, respecting the rights of participants, who agreed with the free and informed consent form (ICF). Their identities remain anonymous, and their identification is given by alphanumeric code, not causing harm or monetary and moral damage. Approval from the Research Ethics Committee of the Department of Health Sciences of the Federal University of Paraná.

Study design, location, and period

This is a cross-sectional, descriptive study, as a survey with a quantitative approach. The Delphi electronic technique was used, a method for systematic collection and aggregation of judgments informed by experts or specialists⁽²⁹⁾, which desired the minimum consensus of 70% in answers in two rounds. Data collection was carried out from May 10 to September 19, 2017, Brazil.

Population or sample

The sample selection was intentional. All those who fulfilled the inclusion criteria were invited to participate in the research: being Brazilian and having professional experience or scientific production related to health indicators in hospitals. The exclusion criterion was the non-completeness of 90% of the answers.

Study protocol

We used snowball sampling for recruitment of participants⁽³⁰⁾. From a list of 20 authors of articles related to health indicators and 20 individuals with experience in the use of indicators in their professional practice, we identified those that corresponded to one or more inclusion criteria, which was confirmed by analyzing their Lattes curricula. The preliminary contact occurred via electronic messages. With each contact, a possible participant recommended others, and so on. We obtained 176 possible participants.

Each one received an invite to participate. To those who accepted it, we sent an access link to the electronic platform Survey Monkey and the questionnaire, after consent to the electronic ICF. Participated in the first round 52 specialists, 43 in the second, all identified by the letter P, followed by a cardinal number, respecting the order of submission of completed instrument to the researcher.

Authors^(27-28) recommend that, to verify the content validity, a panel of experts is used to assess how much the indicator satisfies certain requirements. Thus, with an approach based on objectivity and scientific neutrality, it is possible to evaluate whether the indicator or a group of indicators represent the situation or the phenomenon studied.

Participants were asked to evaluate the indicators of effectiveness raised in the literature^(1,11-25), based on the indicator’s technical data sheet of the elaborated by Seiffert⁽³¹⁾ for the present study. Each indicator sheet contained its name, definitions, purpose/use, estimate method, measure type/unit of , assessment method, including collection and origin of data, frequency which it would be measured with and references. The patterns for indicators’ content validation were specified in the attributes shown in Chart 1, which were backed up by the literature^{(27-28,32-33)}.

Chart 1
Desirable attributes used as a standard for content validation of nursing care effectiveness indicators

Attribute	Specification
Availability	Easy obtainment of data for its structuring.
Reliability	Original sources and reliable data collection and processing methods.
Simplicity	Easy estimative from basic information, understanding or interpretation.
Representativeness	It faithfully represents what it proposes to measure.
Sensitivity	It distinguishes occasional variations in the trend of situation, in a given area, with reflections on its result.
Scope	It synthesizes as many conditions or factors as possible that affect the situation to be measured.
Objectivity	Clarity in measuring objective.
Low cost	Favorable relationship between costs of obtaining data and benefits arising from its use.
Utility	Provides decision-making.
Stability	The measurement series allows for consistent monitoring and comparisons.
Timeliness	Structured with current and timely information to use.

^{(27)(28)(32)(33)}

The survey consisted of 96 questions with five-level Likert-scale answer options: “I totally disagree”; “I partially disagree”; “I do not disagree or agree”; “I partially agree”; “I totally agree”. A minimum of 70% of agreement was stipulated between the answers in relation to all attributes (Chart 1) for the validation of each indicator, per round, estimated by the sum of percentages of answers “totally agree” and “partially agree”.

Analysis of results and statistics

Data analysis was performed using uni and bivariate descriptive statistics. The Survey Monkey provided agreement percentages between first round answers. All answers were inserted in the Statistical Package for the Social Sciences (SPSS), version 22, to assess the validation after the two rounds. Cronbach’s alpha coefficient was used to analyze the internal consistency and the difference of panelists’ opinion in both rounds, in addition to the Spearman’s C-ratio for correlation analysis between the attributes.

Among the specialists, 65.38% were nurses; 15.38% doctors; 9.62% pharmacists; 5.77% administrators; and 3.85% were other professionals. Regarding the degree, 36.64% were graduated; 36.64% Masters; 26.92% Doctors; and 5.77% studied post-doctorate.

The Cronbach’s alpha was 0.942, demonstrating that, in the set, the answers to the attributes for each indicator have high internal consistency. The Spearman’s ratio, used to obtain the evaluation of the relationship intensity between the attributes of each indicator, showed a positive correlation of all attributes among each other. This result allows to infer that the validated indicators are adequate to measure the impact of nursing care in hospital assistance in patient safety dimension.

Chart 2 presents the agreement rates between the attributes for each indicator evaluated and, in Chart 3, participants main comments and suggestions for the non-validated indicators.

Chart 2
Hospital nursing care effectiveness Indicators in patient safety dimension: Agreement rates of experts ‘ answers and validation

Indicators	Agreement rates of experts ' responses regarding the correspondence of indicators to the attributes surveyed	Validation
Incidents due to patient identification failures	Timeliness (88.47%); objectivity and usefulness (88.46%); Other attributes above 75%	Yes
Pressure injury	Timeliness (98.09%); usefulness (98.08%); objectivity and representativeness (96.15%); Other attributes above 82.69%	Yes
Hip fracture in hospitalized patients	Simplicity regarding the ease of calculation (90.38%); Simplicity in the interpretation of the indicator (88.46%); objectivity (88.46%); Other attributes above 73.07%	Yes
Hip fracture postoperatively	Simplicity related to the ease of estimative (75.00%); stability and sensitivity (74.74%); Other attributes above 70.59%	Yes
Falls with damage	Usefulness and stability (94.23%); Simplicity regarding the ease to estimate (92.31%); simplicity in understanding (92.16%); Other attributes above 76.92%	Yes
Serious equipment- related incidents	Timeliness (82.64%); objectivity and usefulness (78.85%); Other attributes above 78.84%	Yes
Multimodal hand hygiene strategy	Usefulness (92.31%); representativeness and timeliness (82.70%); stability (80.77%); availability (53.68%); Other attributes above 71.58%	No
Medication error.	Objectivity (90.40%); usefulness (88.46%); availability (67.37%); other attributes above 74.74%	No

Chart 3
Comments and suggestions from experts on non-validated hospital nursing care effectiveness indicators attributes in patient safety dimension

Indicators	Comments and Suggestions
Multimodal hand hygiene strategy	Comments: Techniques for obtaining data require time (P02, P51); it s difficult to execute (P06, P31, P16); measuring missed opportunities requires specific surveillance (P06, P31).
	Suggestions: studying different ways of collecting lost opportunities for hand cleaning (P44); Help of multimers - sectors audited with checklist (P30); Using of sampling stratified by sectors and professionals, non-identifiable observers, registering professionals behavior(P17).
Medication error.	Comments: This type of error is difficult to detect when it does not cause damage, (P16, P17, P32, P36).
	Suggestions (to improve detection): Improvement of notes in medical records and reports of pharmacy production (P45); Computerization of medical records, management, logistics and medication administration (P08, P37, P48, P51); Institutional stimulus to increase incident notifications (P10, P16, P27, P35); especially near-miss and undamaged incidents (P10, P35, P45); patient inclusion(P08); perform pharmaceutical technical analysis of prescriptions (P26, P33).

DISCUSSION

The present study provides managers with information to select indicators validated by specialists, aimed at capturing how much the results of nursing care processes in the hospital meet the improvement of patient’s safety.

We highlight the participants’ distrust in relation to the sources of data collection since, in Brazilian reality, medical records are incomplete or omit International Classification of Diseases’ diagnoses⁽³⁴⁾.

Two out of eight indicators were not validated: “institutional adherence to the multimodal strategy of hand hygiene” and “medication errors”. The non-validation resulted from consensus lower than 70% in the availability attribute, denoting that the data to structure these indicators are not easy to obtain.

In relation to the indicator “institutional adherence to the multimodal strategy of hand hygiene”, hospitals often use the measurement of liquid soap and alcohol, which enables the indirect evaluation of adherence - constituting, therefore, as an indicator of process, and not of effectiveness⁽¹⁶⁾. However, the multimodal strategy is more extensive than just measuring the consumption of products, because it implies changes in the system, with infrastructure provision, professionals education, evaluation and feedback on performance and results, workplace reminders, and institutional security climate dimensioning⁽¹⁷⁾. These multiple approaches add complexity to the indicator and make data obtaining more laborious and costly, which may explain why it was not validated by the specialists. After analyzing the suggestions of panelists (Chart 3), a composite indicator was elaborated addressing these various practices to measure adherence to the multimodal strategy in the institution.

Medication errors are relevant because they result in longer patient permanence in the hospital, increased risk of death and hospital costs. Low notification and absence of incident records related to dispensation, prescription and administration steps are still common^(18-20).

Although the medication error indicator was not validated because it did not reach the minimum consensus regarding the availability attribute in the two rounds, the other attributes reached such consensus among panelists, ranging from 76.92% to 90.40%. The attributes that obtained higher agreement were objectivity (90.40%), usefulness (88.46%) and representativeness (86.55%), showing that this indicator corresponds to its objective and subsidizes a coherent decision-making with what should be measured.

Appropriately, the participants suggested reinforcement of medication error reporting systems due to low detection when there is no harm to the patient; and patient inclusion, since notifications can be originated by communication of errors detected by the patient or relatives to the health team⁽¹⁹⁾.

Incidents with medication-related damage are those that occur most frequently in hospitalized patients, and about 25% of them are preventable. Medicament therapy chain is extensive, involves logistics focused on supply, prescription, dispensing, preparation and administration, which makes the identification of errors even more complex. It is possible that errors in this chain are related to systemic latent conditions⁽³⁵⁾.

However, the management of this indicator is closely related to nursing, since most medication errors occur in the administration phase, whose attribution is almost exclusive to this professional⁽¹⁸⁾. The absence of records in incidents related to dispensation and prescription stages is also common^(19-20). Therefore, strategies to increase data availability for this indicator aims the reinforcement of safety culture, implementation and stimulus to adherence to protocols to prevent medication errors, and incentive to notify Incidents.

Regarding the nurses, the obstacles to report medication errors and almost incidents in hospital environments were explored in a systematic review covering the period from 1981 to 2015. Organizational barriers, such as culture, non-friendly notification system, managerial behavior and emotional factors, such as fear of consequences and burden of responsibility, were associated with low notification⁽³⁶⁾.

As contributors of patient safety, nurses need education and qualification in error management.The organization is responsible for developing a culture of learning with errors, without blaming and punishing, as well as adopting anonymous, effective, uncomplicated and efficient reporting systems, besides providing support by managers, providing open feedback to Nurses⁽³⁶⁾.

Additionally, “automated methods to identify incidents through electronic registers” enhance the overcoming of methodological biases related to retrospective studies in medical records, for more accurate data obtaining that favors the use of validated indicators to measure the incidence of failures, errors and omissions related to medications⁽³⁷⁾.

Other indicators were validated. Patient’s identification is fundamental to prevention of errors in the actions of nursing care, such as medication and procedures in general. This indicator aims to account for the number of incidents due to patient’s identification failures. The results indicate that, although the patient’s identification aims to safely determine the legitimacy of the procedure’s receptor, in practice this receives little attention⁽²¹⁾ - It highlights this indicator as one of the priorities for measuring patient safety.

In relation to the “pressure injury indicator”, the use of scales to determine the risk level for the development of this lesion is recommended. Various scales are available, such as Braden, Norton, Waterlow, and Assessment scale of risk for surgical positioning injuries^(38-40), scales that can be selected for systematic application at the discretion of each hospital.

Regarding the monitoring of hip fracture between hospitalized and postoperative patients, the simplicity in estimating (Chart 2) favors the viability of these indicators. Victims of these events are fragile, limited and physically incapable; present clinical condition worsening; they face long time of hospitalization and readmissions period; increase hospital costs; and these indicator’s mortality increases in 50% after one year of fall^(22-23). Systematic evaluation of risk by nursing using validated scales is also indispensable, implantation, monitoring and evaluation of adherence to the Protocol for the prevention of falls, the main factor associated with fractures.

The indicator of falls is recommended worldwide. In the present study, the indicator of falls with damage identification was shown to the participants, because it is sensitive to the measurement of nursing care effectiveness. Due to the low incidence, the California Nursing Outcomes Coalition accounts for the number of falls with damage for every thousand patients per day ⁽²⁴⁾. Given the importance of notification of hip fracture between hospitalized and postoperative patients, and also of falls with damage, hospitals can use an indicator consisting of the three indicators instead of a simple indicator, extending their comprehensiveness⁽³¹⁾.

Regarding the indicator of serious equipment-related incidents, the interaction with the clinical engineering service can intensify the technovigilance and favor the identification of causes and prevention of incidents, resulting in training programs to avoid such incidents and in opportunity for producers to make their products safer⁽²⁵⁾. The usefulness of this indicator is backed by the frequency of these incidents and the expressive use of devices in nursing care.

Of the incidents considered critical occurring in 90 months in an intensive care unit (ICU) for adults in England, 30% were caused by equipment^(25,41). In the United Kingdom, 564 critical incidents were reported in the ICU in 13 years, involving 94 types of equipment; 12.41% were related to the use of beds, mattresses and chairs, and 12.05% to equipment and devices needed for the procedure, such as intravenous infusion and monitoring, mechanical ventilation and tracheostomy, renal therapy and bronchoscopy⁽²²⁾.

Results indicate dependence of obtaining data to estimate the indicators and the need for complete and correct assistance records, as well as the use of effective systems of direct and indirect identification and notification of incidents. However, the legislation that obliges the systematic notification of events by hospitals arose only in 2013⁽²⁶⁾, demanding changes in safety culture, strongly linked to managerial actions, and requiring time to become routine in professional practice.

The fragility in obtaining reliable data in health is also related to absence of integration between management information systems, the poor quality of administrative records, the partially computerized records or with handwritten records, and limited scope in the coding of diagnoses related to iatrogenisis⁽⁴²⁾.

In addition to the computational infrastructure, there is the user interface with the system. Nurses are users of hospital systems, data feeders and collectors for assistance and managerial indicators. Some factors interfere with the effectiveness of nurse-computer interaction, such as software configuration errors, inadequate workflow, lack of time, inadequate number of professionals and lack of knowledge about indicators⁽¹²⁾. Strategies such as use of algorithms and configuration of warnings for alarming data can minimize the unavailability of data needed to estimate indicators, allowing nurses to act in timely, performing effective and safe care for the patient.

Study limitations

The study was based on experts ‘ judgement on indicators attributes approached and, due to the peculiar subjectivity peculiar of survey, it is considered possible to have some bias in results. However, the minimum criterion of 70% of agreement between the specialists for indicator validation and the very high internal consistency confer reliability to results. As additional elements to results’ reliability we consider the careful selection of specialists, according to their experience in studies and/or use of health indicators, and self-analysis as to their contribution to the present study.

Contributions to nursing field

The validated indicators allow the evaluation of the health effectiveness care.in hospital nursing.The adaptation of these indicators to hospital practice facilitates the monitoring of nursing efforts aimed at patient safety, with reduction of harmful incidents.

CONCLUSIONS

Validate nursing care effectiveness indicators in patient safety dimension, were evaluated considering their correspondence to the attributes availability, reliability, simplicity, representativeness, sensitivity, approach, objectivity, low cost, usefulness, stability and timeliness. Indicators were validated in relation to all attributes: “Fall with damage”; “Hip fracture”; “Postoperative hip fracture”; “Equipment-related incidents”; “Incidents due to failures in patient identification”; and “pressure injury”.

“Medication error” indicator and the one related to the multimodal hand hygiene strategy were not validated because of the availability of data to be structured. However, given its relevance to measure nursing care effectiveness in patient safety dimension , strategies that reinforce the safety culture, identification and reporting systems of incidents, and the computerization of records assistance, among others, are measures that should be implemented by hospitals so these indicators can be used systematically.

• FUNDING
  Funding Source: Leila Soares Seiffert - Coordination of Improvement of Higher Education Personnel (Capes; Scholarship of the sandwich doctoral program abroad).

REFERENCES

• ¹
  Carlesi KC, Padilha KG, Toffoletto MC, Henriquez-Roldán C, Canales MAJ. Patient safety incidents and nursing workload. Rev Latino-Am Enfermagem [Internet]. 2017 [cited 2018 Oct 9];25(e2841):1-8. Available from: http://www.scielo.br/pdf/rlae/v25/0104-1169-rlae-25-e2841.pdf
  » http://www.scielo.br/pdf/rlae/v25/0104-1169-rlae-25-e2841.pdf
• ²
  Reis CT, Martins M, Laguardia J. Patient safety as a dimension of the quality of health care: a look at the literature. Ciênc Saúde Coletiva [Internet]. 2013 [cited 2018 Oct 9];18(7):2029-36. Available from: https://www.scielosp.org/pdf/csc/2013.v18n7/2029-2036/pt
  » https://www.scielosp.org/pdf/csc/2013.v18n7/2029-2036/pt
• ³
  Donabedian A. Evaluating the quality of medical care. Milbank Q [Internet]. 2005 [cited 2018 Oct 9];83(4):691-729. Available from: https://onlinelibrary.wiley.com/doi/full/10.1111/j.1468-0009.2005.00397.x
  » https://onlinelibrary.wiley.com/doi/full/10.1111/j.1468-0009.2005.00397.x
• ⁴
  Viacava F, Ugá M, Porto S, Laguardia J, Moreira RS. Evaluation of performance of health systems: a model for analysis. Ciênc Saúde Coletiva [Internet]. 2012 [cited 2018 Oct 9];17(4):921-34. Available from: http://www.scielo.br/pdf/csc/v17n4/v17n4a14.pdf
  » http://www.scielo.br/pdf/csc/v17n4/v17n4a14.pdf
• ⁵
  Secanell M, Groene O, Arah OA, Lopez MA, Kutryba B, Pfaff H, et al. Deepening our understanding of quality improvement in Europe (DUQuE): overview of a study of hospital quality management in seven countries. Int J Qual Health Care [Internet]. 2014 [cited 2018 Oct 9];26(Suppl):5-15. Available from: https://academic.oup.com/intqhc/article/26/suppl_1/5/2886557
  » https://academic.oup.com/intqhc/article/26/suppl_1/5/2886557
• ⁶
  Lima KWS, Antunes JLF, Silva ZP. Perception of managers on the use of indicators in health services. Saúde Soc [Internet]. 2015 [cited 2018 Oct 9];24(1):61-71. Available from: http://www.scielo.br/pdf/sausoc/v24n1/0104-1290-sausoc-24-1-0061.pdf
  » http://www.scielo.br/pdf/sausoc/v24n1/0104-1290-sausoc-24-1-0061.pdf
• ⁷
  Donabedian A. The quality of care: how can it be assessed? JAMA [Internet]. 1988 [cited 2018 Oct 9]; 260(12):1743-48. Available from: https://jamanetwork.com/journals/jama/article-abstract/374139
  » https://jamanetwork.com/journals/jama/article-abstract/374139
• ⁸
  Donabedian A. The seven pillars of quality. Arch Pathol Lab Med [Internet]. 1990 [cited 2018 Oct 9];114(11):1115-8. Available from: https://www.ncbi.nlm.nih.gov/pubmed/2241519
  » https://www.ncbi.nlm.nih.gov/pubmed/2241519
• ⁹
  Duarte SCM, Stipp MAC, Silva MM, Oliveira FT. Adverse events and safety in nursing care. Rev Bras Enferm [Internet]. 2015 [cited 2018 Oct 9];68(1):144-54. Available from: http://www.scielo.br/pdf/reben/v68n1/en_0034-7167-reben-68-01-0144.pdf
  » http://www.scielo.br/pdf/reben/v68n1/en_0034-7167-reben-68-01-0144.pdf
• ¹⁰
  Maia CS, Freitas DRC, Gallo LG, Araújo WN. Registry of adverse events related to health care that results in deaths in Brazil, 2014-2016. Epidemiol Serv Saúde [Internet]. 2018 [cited 2018 Oct 9];27(2):e2017320. Available from: http://www.scielo.br/pdf/ress/v27n2/en_2237-9622-ress-27-02-e2017320.pdf
  » http://www.scielo.br/pdf/ress/v27n2/en_2237-9622-ress-27-02-e2017320.pdf
• ¹¹
  Galhardi NM, Escobar EMA. Indicators of quality of nursing care. Rev Ciênc Méd [Internet]. 2015 [cited 2018 Oct 9];24(2):75-83. Available from: https://seer.sis.puc-campinas.edu.br/seer/index.php/cienciasmedicas/article/viewFile/2639/2251
  » https://seer.sis.puc-campinas.edu.br/seer/index.php/cienciasmedicas/article/viewFile/2639/2251
• ¹²
  Silveira TVL, Prado Junior PP, Pedro P, Siman AG, Amaro MOF. The importance of using quality indicators in nursing care. Rev Gaúcha Enferm [Internet]. 2015 [cited 2018 Oct 9];36(2):82-8. Available from: http://www.scielo.br/pdf/rgenf/v36n2/1983-1447-rgenf-36-02-00082.pdf
  » http://www.scielo.br/pdf/rgenf/v36n2/1983-1447-rgenf-36-02-00082.pdf
• ¹³
  Burston S, Chaboyer W, Gillespie B. Nurse-sensitive indicators suitable to reflect nursing care quality: a review and discussion of issues. J Clin Nurs [Internet]. 2013 [cited 2018 Oct 9];23:1785-95. Available from: https://onlinelibrary.wiley.com/doi/abs/10.1111/jocn.12337
  » https://onlinelibrary.wiley.com/doi/abs/10.1111/jocn.12337
• ¹⁴
  Dubois CA, D'Amour D, Brault I, Dallaire C, Déry J, Duhoux A, et al. Which priority indicators to use to evaluate nursing care performance? a discussion paper. J Adv Nurs [Internet]. 2017 [cited 2018 Dec 4];73(12):3154-67. Available from: https://onlinelibrary.wiley.com/doi/abs/10.1111/jan.13373
  » https://onlinelibrary.wiley.com/doi/abs/10.1111/jan.13373
• ¹⁵
  McDonald K, Romano P, Geppert J, Romano PS, Geppert J, Davies SM, et al. Measures of patient safety based on hospital administrative data: the patient safety indicators [Internet]. Rockville (MD): AHRQ; 2002 [cited 2019 Mar 13]. (Technical Reviews, no. 5). Available from: https://www.ncbi.nlm.nih.gov/books/NBK43854/
  » https://www.ncbi.nlm.nih.gov/books/NBK43854/
• ¹⁶
  Oliveira AC, Paula AO, Gama CS, Oliveira JR, Rodrigues CD. Hand hygiene compliance among nursing technicians at a university hospital. Rev Enferm UERJ [Internet]. 2016 [cited 2018 Aug 9];24(2):e9945. Available from: http://www.facenf.uerj.br/v24n2/v24n2a15.pdf
  » http://www.facenf.uerj.br/v24n2/v24n2a15.pdf
• ¹⁷
  Stewardson AJ, Sax H, Gayet-Ageron A, Touveneau S, Longtin Y, Zingg W, et al. Enhanced performance feedback and patient participation to improve hand hygiene compliance of health-care workers in the setting of established multimodal promotion: a single-centre, cluster randomised controlled trial. Lancet Infect Dis [Internet]. 2016 [cited 2018 Aug 10];16(12):1345-55. Available from: http://www.omedit-idf.fr/wp-content/uploads/2017/01/Lancet-2016.-Enhanced-performance-feeback-and-patient-participation-to-improve-hand-hygiene-compliance.pdf
  » http://www.omedit-idf.fr/wp-content/uploads/2017/01/Lancet-2016.-Enhanced-performance-feeback-and-patient-participation-to-improve-hand-hygiene-compliance.pdf
• ¹⁸
  Armstrong GE, Dietrich M, Norman L, Barnsteiner J, Mion L. Nurses' perceived skills and attitudes about updated safety concepts: impact on medication administration errors and practices. J Nurs Care Qual [Internet]. 2017 [cited 2018 Oct 9];32(3):226-33. Available from: https://www.ncbi.nlm.nih.gov/pubmed/27607849
  » https://www.ncbi.nlm.nih.gov/pubmed/27607849
• ¹⁹
  Borges MC, Faria JIL, Jabur MRL, Oliveira KA, Zborowski IP, Beccaria LM. Medication errors and degree of patient damage at a teaching hospital. Cogitare Enferm [Internet]. 2016 [cited 2018 Oct 9];21(4):1-9. Available from: https://revistas.ufpr.br/cogitare/article/view/45397
  » https://revistas.ufpr.br/cogitare/article/view/45397
• ²⁰
  Yamamoto MS, Peterlini MAS, Bohomol E. Spontaneous reporting of medication errors in pediatric university hospital. Acta Paul Enferm [Internet]. 2011 [cited 2018 Oct 9];24(6):766-71. Available from: http://www.scielo.br/pdf/ape/v24n6/en_a06v24n6.pdf
  » http://www.scielo.br/pdf/ape/v24n6/en_a06v24n6.pdf
• ²¹
  Hoffmeister LV, Moura GMSS. Use of identification wristbands among patients receiving inpatient treatment in a teaching hospital. Rev Latino-Am Enfermagem [Internet]. 2015 [cited 2018 Oct 9];23(1):36-43. Available from: http://www.scielo.br/pdf/rlae/v23n1/0104-1169-rlae-23-01-00036.pdf
  » http://www.scielo.br/pdf/rlae/v23n1/0104-1169-rlae-23-01-00036.pdf
• ²²
  Johal KS, Boulton C, Moran CG. Hip fractures after falls in hospital: a retrospective observational cohort study. Injury [Internet]. 2009 [cited 2018 Oct 9];40(2):201-4. Available from: https://www.sciencedirect.com/science/article/pii/S0020138308002696
  » https://www.sciencedirect.com/science/article/pii/S0020138308002696
• ²³
  Luzia MF, Cassola TP, Suzuki LM, Dias VLM, Pinho LB, Lucena AF. Incidence of falls and preventive actions in a University Hospital. Rev Esc Enferm USP [Internet]. 2018 [cited 2018 Oct 9];52(e03308):1-7. Available from: https://www.ncbi.nlm.nih.gov/pubmed/29668783
  » https://www.ncbi.nlm.nih.gov/pubmed/29668783
• ²⁴
  Heslop L, Lu S. Nursing-sensitive indicators: a concept analysis. J Adv Nurs [Internet]. 2014 [cited 2018 Oct 9];70(11):2469-82. Available from: https://onlinelibrary.wiley.com/doi/pdf/10.1111/jan.12503
  » https://onlinelibrary.wiley.com/doi/pdf/10.1111/jan.12503
• ²⁵
  King AT, Wenstone R, Morrison J, Cloherty L, Welters ID. Equipment-related critical incidents in a general intensive care unit. Intensive Care Med Exp [Internet]. 2015 [cited 2018 Oct 9];3(1):A70. Available from: https://icm-experimental.springeropen.com/articles/10.1186/2197-425X-3-S1-A70
  » https://icm-experimental.springeropen.com/articles/10.1186/2197-425X-3-S1-A70
• ²⁶
  Dias JD, Mekaro KS, Tibes CMS, Mascarenhas SHZ. The nurses' understanding about patient safety and medication errors. Rev Min Enferm [Internet]. 2014 [cited 2018 Aug 10];18(4):866-73. Available from: http://www.dx.doi.org/10.5935/1415-2762.20140064
  » http://www.dx.doi.org/10.5935/1415-2762.20140064
• ²⁷
  D'Innocenzo M, Adami NP, Cunha ICK. The movement for quality in healthcare and nursing services. Rev Bras Enferm [Internet]. 2006 [cited 2019 Mar 13];59(1):84-8. Available from: http://www.scielo.br/pdf/reben/v59n1/a16v59n1.pdf
  » http://www.scielo.br/pdf/reben/v59n1/a16v59n1.pdf
• ²⁸
  Escola Nacional de Administração Pública. Elaboração de indicadores de desempenho institucional [Internet]. Brasília, DF: ENAP/DDG; 2013 [cited 2019 Mar 13]. Available from: http://repositorio.enap.gov.br/bitstream/1/2403/1/Elabora%C3%A7%C3%A3o%20de%20indicadores%20de%20desempenho_apostila%20exerc%C3%ADcios.pdf
  » http://repositorio.enap.gov.br/bitstream/1/2403/1/Elabora%C3%A7%C3%A3o%20de%20indicadores%20de%20desempenho_apostila%20exerc%C3%ADcios.pdf
• ²⁹
  Scarparo AF, Laus AM, Azevedo ALCS, Freitas MRI, Gabriel CS, Chaves LDP. Reflections on the use of Delphi technique in research in nursing. Rev Rene [Internet]. 2012 [cited 2018 Oct 9];13(1):242-51. Available from: http://www.redalyc.org/pdf/3240/324027980026.pdf
  » http://www.redalyc.org/pdf/3240/324027980026.pdf
• ³⁰
  Dusek GA, Yurova YV, Ruppel CP. Using social media and targeted snowball sampling to survey a hard-to-reach population: a case study. Int J Doctoral Stud [Internet]. 2015 [cited 2018 Oct 9];10:279-99. Available from: http://ijds.org/Volume10/IJDSv10p279-299Dusek0717.pdf
  » http://ijds.org/Volume10/IJDSv10p279-299Dusek0717.pdf
• ³¹
  Seiffert LS. Indicadores para avaliação da efetividade assistencial de hospitais [tese]. Curitiba: Universidade Federal do Paraná; 2019. 391 f.
• ³²
  Programa Compromisso com a Qualidade Hospitalar. 3º Caderno de Indicadores CQH - 2009 [Internet]. São Paulo: APM/Cremesp; 2009 [cited 2019 Mar 13]. Available from: http://www.cqh.org.br/portal/pag/doc.php?p_ndoc=127
  » http://www.cqh.org.br/portal/pag/doc.php?p_ndoc=127
• ³³
  Agency for Healthcare Research and Quality, AHRQ Quality Indicators. Patient safety indicators: technical specifications [Internet]. 2003 [cited 2018 Dec 13]. Available from: http://www.qualityindicators.ahrq.gov/downloads/modules/psi/v32/psi_technical_specs_v32.pdf
  » http://www.qualityindicators.ahrq.gov/downloads/modules/psi/v32/psi_technical_specs_v32.pdf
• ³⁴
  Graciano MMC, Lago VC, Samartine Júnior H, Marcos VC. Epidemiological and assistance care profile of patients with heart failure in a regional reference municipality. Rev Med Minas Gerais [Internet]. 2015 [cited 2018 Oct 9];25(2):199-207. Available from: http://www.rmmg.org/artigo/detalhes/1775
  » http://www.rmmg.org/artigo/detalhes/1775
• ³⁵
  Duarte SCM, Stipp MAC, Cardoso MMVN, Büscher A. Patient safety: understanding human error in intensive nursing care. Rev Esc Enferm USP. 2018;52:(e03406):1-8. doi: 10.1590/S1980-220X2017042203406
  » https://doi.org/10.1590/S1980-220X2017042203406
• ³⁶
  Vrbnjak D, Denieffe S, O'Gorman C, Pajnkihar M. Barriers to reporting medication errors and near misses among nurses: a systematic review. Int J Nurs Stud [Internet]. 2016 [cited 2018 Oct 31];63(2016):162-78. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0020-7489(16)30145-6
  » https://linkinghub.elsevier.com/retrieve/pii/S0020-7489(16)30145-6
• ³⁷
  Schwendimann R, Blatter C, Dhaini S, Simon M, Ausserhofer D. The occurrence, types, consequences and preventability of in-hospital adverse events: a scoping review. BMC Health Serv Res [Internet]. 2018 [cited 2019 Mar 13];18:521. Available from: https://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-018-3335-z
  » https://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-018-3335-z
• ³⁸
  Lopes CMM, Haas VJ, Dantas RAS, Oliveira CG, Galvão CM. Assessment scale of risk for surgical positioning injuries. Rev Lat Am Enfermagem [Internet]. 2016 [cited 2018 Oct 9];24:e2704. Available from: http://www.scielo.br/pdf/rlae/v24/0104-1169-rlae-24-02704.pdf
  » http://www.scielo.br/pdf/rlae/v24/0104-1169-rlae-24-02704.pdf
• ³⁹
  Rocha SCG, Oselame GB, Mello MGS, Neves EB. Comparison of pressure injury risk assessment scales. Rev Bras Pesq Saúde [Internet]. 2016 [cited 2018 Oct 9];18(4):143-51. Available from: http://www.periodicos.ufes.br/RBPS/article/view/16742/11573
  » http://www.periodicos.ufes.br/RBPS/article/view/16742/11573
• ⁴⁰
  Zimmermann GS, Cremasco MF, Zanei SSV, Takahashi SM, Cohrs CR, Whitaker IY. Pressure injury risk prediction in critical care patients: an integrative review. Texto Contexto Enferm [Internet]. 2018 [cited 2018 Oct 9];27(3):e3250017. Available from: http://www.scielo.br/pdf/tce/v27n3/0104-0707-tce-27-03-e3250017.pdf
  » http://www.scielo.br/pdf/tce/v27n3/0104-0707-tce-27-03-e3250017.pdf
• ⁴¹
  Welters ID, Gibson J, Mogk, M, Wenstone R. Major sources of critical incidents in intensive care. Crit Care [Internet]. 2011 [cited 2018 Aug 10];15(5):1-8. Available from: https://ccforum.biomedcentral.com/articles/10.1186/cc10474
  » https://ccforum.biomedcentral.com/articles/10.1186/cc10474
• ⁴²
  Santos TO, Pereira LP, Silveira DT. Implementation of health information systems: a systematic review. Rev Eletron Comun Inf Inov Saúde [Internet]. 2017 [cited 2018 Oct 9];11(3):1-11. Available from: https://www.reciis.icict.fiocruz.br/index.php/reciis/article/view/1064
  » https://www.reciis.icict.fiocruz.br/index.php/reciis/article/view/1064

Edited by

EDITOR IN CHIEF: Dulce Aparecida Barbosa

ASSOCIATE EDITOR: Alexandre Balsanelli

Publication Dates

• Publication in this collection
  22 Apr 2020
• Date of issue
  2020

History

• Received
  31 Oct 2018
• Accepted
  08 June 2019