Acessibilidade / Reportar erro

Coverage, completeness and reliability of the data in the Information System on Live Births in public maternity wards in the municipality in São Paulo, Brazil, 2011* * The 'Study of the mother-child binomium: an imperious necessity to reach the Millennium Development Goals' was funded by Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP): Process No. 09/53253-8, public call Research Program of Brazilian National Health System (PPSUS).

Abstract

Objective:

to assess the coverage, completeness and reliability of data on live births in public maternity wards in São Paulo, Brazil.

Methods:

data recorded in the Information System on Live Births (Sinasc) were compared with data collected in a field study (gold standard) during three months in 2011 in four maternity wards in hospital from the SUS network; kappa coefficient was calculated to assess agreement.

Results:

5,785 birth records were analyzed; Sinasc coverage was 99.8% and completeness was 96.2%; kappa values showed excellent and good agreement for maternal age (0.99), type of pregnancy, sex and newborn sex and birth weight (0.98), type of delivery (0.97), 1 minute (0.96) and 5th (0.95) minutes, previous live births (0.87) and education level (0.62); regular agreement for prenatal care visits (0.60) and gestational age (0.56); and weak agreement for previous stillbirths (0.09).

Conclusion:

in the assessed hospitals, Sinasc presented high coverage, completeness and reliability.

Keywords:
Vital Statistics; Data Accuracy; Information System; Birth Certificate; Live Births

Resumo

Objetivo:

avaliar a cobertura, completude e confiabilidade das informações sobre nascidos vivos em maternidades da rede pública de São Paulo-SP, Brasil.

Métodos:

comparou-se o Sistema de Informações sobre Nascidos Vivos (Sinasc), ao estudo de avaliação, considerado padrão ouro, realizado por três meses em 2011, cujos dados foram coletados em quatro maternidades/SUS; calculou-se o coeficiente kappa para avaliar concordância.

Resultados:

analisaram-se 5.785 registros de nascimentos; a cobertura do Sinasc foi de 99,8% sobre o total de nascimentos e a completude, 96,2%; os valores kappa mostraram concordâncias excelente e boa para idade materna (0,99), tipo de gravidez, sexo e peso (0,98), tipo de parto (0,97), Apgar no 1º (0,96) e 5º minutos (0,95), filhos tidos vivos (0,87) e escolaridade (0,62), concordância moderada para consultas de pré-natal (0,60) e duração de gestação (0,56), e concordância fraca para filhos tidos mortos (0,09).

Conclusão:

nos hospitais avaliados, o Sinasc apresentou elevadas cobertura, completude e confiabilidade.

Palavras-chave:
Estatísticas Vitais; Confiabilidade dos Dados; Sistema de Informação; Declaração de Nascido Vivo; Nascido Vivo

Resumen

Objetivo:

evaluar la cobertura, conformidad documental y confiabilidad de informaciones sobre nacidos vivos en maternidades de la red pública de la ciudad de São Paulo-SP, Brasil.

Métodos:

se comparó el sistema de informaciones de nacidos vivos al estudio de evaluación, considerado padrón oro, realizado por tres meses en 2011, cuyos datos fueron colectados en cuatro maternidades/SUS; se calculó el coeficiente kappa para evaluar la concordancia.

Resultados:

se analizaron 5.785 registros de nacimientos; la cobertura Sinasc fue 99,8% del total de nacimientos, y la conformidad documental, 96,2%; las estadísticas de kappa mostraron concordancia excelente y buena para edad materna (0,99), tipo de embarazo, sexo y peso (0,98), tipo de parto (0,97), Apgar en el 1º (0,96) y 5º minutos (0,95), hijos vivos (0,87) y escolaridad (0,62), concordancia moderada para consultas de prenatal (0,60) y duración de gestación (0,56), y concordancia débil para hijos muertos (0,09).

Conclusión:

en los hospitales analizados, el Sinasc presentó alto grado de cobertura, conformidad documental y confiabilidad.

Palabras-clave:
Estadísticas Vitales; Exactitud de los Datos; Sistemas de Información; Nacido Vivo; Certificado de Nacido Vivo

Introduction

The implementation of the Information System on Live Births (Sinasc) in Brazil happened gradually in the federation units, since the early 1990s.11. Ministério da Saúde (BR). Secretaria de Vigilância em Saúde. Departamento de Análise de Situação em Saúde. Manual de instruções para o preenchimento da Declaração de Nascido Vivo [Internet]. Brasília: Ministério da Saúde; 2011 [citado 2017 out 19]. 29 p. Disponível em: Disponível em: http://uff.br/epidemiologia2/blog/wp-content/uploads/2012/10/Manual-de-DNV-4ed-2011.pdf
http://uff.br/epidemiologia2/blog/wp-con...
The main objective of the system is to subsidize the plan for maternal and child health care based on the epidemiologic profile, according to the information inserted into the Certificate of Live Birth (CLB).22. Rede Interagencial de Informações para a Saúde (RIPSA). Indicadores básicos para a saúde no Brasil: conceitos e aplicações [Internet]. 2. ed. Brasília: Organização Pan-Americana da Saúde; 2008 [citado 2017 out 19]. 349 p. Disponível em: Disponível em: http://tabnet.datasus.gov.br/tabdata/livroidb/2ed/indicadores.pdf
http://tabnet.datasus.gov.br/tabdata/liv...

Such information is the basis for the calculation of important health indicators, such as child and maternal mortality rate, birth rate and vaccine coverage, besides allowing health diagnosis, surveillance and monitoring of newborn at risk, identify the availability of services that perform childbirth and analyze the territorial and time distribution of these events, besides supporting public health policies in the field of maternal and child health.33. National Research Council (US). Committee on National Statistics. Vital statistics: summary of a workshop [Internet]. Washington (DC): National Academies Press (US); 2009 [cited 2017 Oct 19]. Available in: Available in: https://www.ncbi.nlm.nih.gov/books/NBK219884/
https://www.ncbi.nlm.nih.gov/books/NBK21...
,44. Mello Jorge MHP, Gotlieb SLD, Soboll MLMS, Almeida MF, Latorre MRDO. Avaliação do sistema de informação sobre nascidos vivos e o uso de seus dados em epidemiologia e estatísticas de saúde. Rev Saúde Pública. 1993;27(Suppl):1-46.

In this context, it is essential to assess the attributes of Sinasc and several studies have analyzed the quality of its data (completeness and validity of the records), its acceptability (the willingness of people and institutions to participate and contribute to the system), representativeness (precision of the data), opportunity (punctuality), stability (coverage) and usefulness(data source for indicators).55. Romero DE, Cunha CB. Avaliação da qualidade das variáveis epidemiológicas e demográficas do Sistema de Informações sobre Nascidos Vivos, 2002. Cad Saúde Pública. 2007 mar;23(3):701-14.

6. Oliveira MM, Andrade SSCA, Dimech GS, Oliveira JCG, Malta DC, Rabello Neto DL, et al. Avaliação do Sistema de Informações sobre Nascidos Vivos. Brasil, 2006 a 2010. Epidemiol Serv Saúde. 2015 out-dez;24(4):629-40.

7. Almeida MF, Alencar GP, França Jr I, Novaes HMD, Siqueira AAF, Schoeps D, et al. Validade das informações das declarações de nascidos vivos com base em estudo de caso-controle. Cad Saúde Pública. 2006 mar;22(3):643-52.

8. Pedraza DF. Qualidade do Sistema de Informações sobre Nascidos Vivos (Sinasc): análise crítica da literatura. Ciênc Saúde Coletiva. 2012 out;17(10):2729-37.

9. Nhoncanse GC, Melo DG. Confiabilidade da Declaração de Nascido Vivo como fonte de informação sobre os defeitos congênitos no Município de São Carlos, São Paulo, Brasil. Ciênc Saúde Coletiva. 2012 abr;17(4):955-63.

10. Schoeps D, Almeida MF, Raspantini PR, Novaes HMD, Silva ZP, Lefevre F. SIM e SINASC: representação social de enfermeiros e profissionais de setores administrativos que atuam em hospitais no município de São Paulo. Ciênc Saúde Coletiva. 2013 maio;18(5):1483-92.
-1111. Silva RS, Oliveira CM, Ferreira DKS, Bonfim CV. Avaliação da completitude das variáveis do Sistema de Informações sobre Nascidos Vivos - Sinasc - nos estados da região Nordeste do Brasil, 2000 e 2009. Epidemiol Serv Saúde. 2013 abr-jun;22(2):347-52.

To assess the reliability of the information in SINASC, we can compare it to other databases, such as the National Hospital Information System (SIH/SUS) and the Mortality Information System (SIM), to information in hospital records or to data collected in field studies.1212. Almeida MF, Alencar GP, Novaes HMD, Ortiz LP. Sistemas de informação e mortalidade perinatal conceitos e condições de uso em estudos epidemiológicos. Rev Bras Epidemiol. 2006 mar;9(1):56-68.,1313. Drumond EF, Machado CJ, Vasconcelos MR, França E. Utilização de dados secundários do SIM, Sinasc e SIH na produção científica brasileira de 1990 a 2006. R Bras Est Pop. 2009 jan-jun;26(1):7-19.

Incomplete or absent data in the CLB records is one of the greatest challenges to overcome in order to achieve a high quality information system.1414. Silva AAM, Ribeiro VS, Borba Júnior AF, Coimbra LC, Silva RA. Avaliação da qualidade dos dados do Sistema de Informações sobre Nascidos Vivos em 1997-1998. Rev Saúde Pública. 2001 dez;35(6):508-14. A literature review on the use of Sinasc described that studies conducted between 1996 to 2002 reported a common problem: the high rate of incompleteness of CLB fields.1515. Paiva NS, Coeli CM, Moreno AB, Guimarães RM, Camargo Júnior KR. Brazilian live birth information system: a review study. Ciênc Saúde Coletiva. 2011; 16(Suppl1):1211-20. Other studies evaluated the characteristics of the system, focusing in analyses of its coverage, quality and reliability.44. Mello Jorge MHP, Gotlieb SLD, Soboll MLMS, Almeida MF, Latorre MRDO. Avaliação do sistema de informação sobre nascidos vivos e o uso de seus dados em epidemiologia e estatísticas de saúde. Rev Saúde Pública. 1993;27(Suppl):1-46.

5. Romero DE, Cunha CB. Avaliação da qualidade das variáveis epidemiológicas e demográficas do Sistema de Informações sobre Nascidos Vivos, 2002. Cad Saúde Pública. 2007 mar;23(3):701-14.
-66. Oliveira MM, Andrade SSCA, Dimech GS, Oliveira JCG, Malta DC, Rabello Neto DL, et al. Avaliação do Sistema de Informações sobre Nascidos Vivos. Brasil, 2006 a 2010. Epidemiol Serv Saúde. 2015 out-dez;24(4):629-40.

Considering the complex nature of the processes involved in collecting the data entered into the CLB, it is essential to assess the quality of the information recorded in the system, to then develop interventions to improve it to evaluate the quality of the information recorded in the system, aiming to the adoption of measures to improve it.

The objective of this study was to evaluate the coverage, completeness and the reliability of the information about live births (Sinasc) in maternity wards of the public health network in the municipality of São Paulo, Brazil.

Methods

This cross sectional study was conducted in four public maternity wards of hospitals from the Brazilian National Health System (SUS) in the municipality of São Paulo. This is a sub-project of a previously published study ("The study of the mother-child binomium").1616. Laurenti R, Mello Jorge MHP, Gotlieb SLD, Oliveira BZ, Pimentel EC. Estudo do binômio mãe-filho: descrição e resultados gerais. Rev Bras Epidemiol. 2015 jun;18(2):398-412

São Paulo is the largest municipality of Brazil and in 2011 it had approximately 11 million inhabitants, according to estimates of the Brazilian Institute of Geography and Statistics (IBGE).1717. Programa das Nações Unidas para o Desenvolvimento. Instituto de Pesquisa Econômica Aplicada. Fundação João Pinheiro. Atlas do desenvolvimento humano no Brasil - São Paulo, SP [Internet] 2017 [citado 2017 out 19]. Disponível em: Disponível em: http://www.atlasbrasil.org.br/2013/pt/perfil_m/sao-paulo_sp
http://www.atlasbrasil.org.br/2013/pt/pe...
In that same year, 193,383 live births occurred in the municipality, according to the SINASC records. Amongst these births, 169,492 were from mothers who lived in São Paulo.1818. Secretaria Municipal da Saúde (SP). Coordenação de Epidemiologia e Informação (CEInfo): informações de saúde (Tabnet). Estatísticas vitais [Internet]. 2017 [citado 2017 out 19]. Disponível em Disponível em http://tabnet.saude.prefeitura.sp.gov.br/cgi/deftohtm3.exe?secretarias/saude/TABNET/sinasc/nascido.def
http://tabnet.saude.prefeitura.sp.gov.br...
The Municipal Human Development Coefficient (MHDI) was 0.805 in 2010, occupying the 28th position among the 5,565 Brazilian municipalities.1717. Programa das Nações Unidas para o Desenvolvimento. Instituto de Pesquisa Econômica Aplicada. Fundação João Pinheiro. Atlas do desenvolvimento humano no Brasil - São Paulo, SP [Internet] 2017 [citado 2017 out 19]. Disponível em: Disponível em: http://www.atlasbrasil.org.br/2013/pt/perfil_m/sao-paulo_sp
http://www.atlasbrasil.org.br/2013/pt/pe...

Since Sinasc was implemented in the municipality of São Paulo, the hospitals that have deliveries fill and type the CLB directly into an electronic database, which facilitates data collection, minimizes sub-notification and especially the recording delay. The information used to fill the CLB and feed the SINASC system are obtained by nurses and/or administrative personnel by checking medical records and through interviews with the mothers.1919. Secretaria Municipal da Saúde (SP). Coordenação de Epidemiologia e Informação (CEInfo). Bonilha EA, Vico ESR, Freitas M, Okamura MN. Selo Sinasc no Município de São Paulo. Boletim CEInfo Análise. 2017 maio;12(14). 30 p. Disponível em: http://www.prefeitura.sp.gov.br/cidade/secretarias/upload/saude/arquivos/publicacoes/Boletim_CEInfo_Analise_14.pdf
http://www.prefeitura.sp.gov.br/cidade/s...

In the 'The study of the mother-child binomium: an imperious necessity to reach the Millennium Development Goals', the data were collected in four maternity wards: Amparo Maternal Hospital, Maternity School Municipal Hospital Vila Nova Cachoeirinha Dr. Mário de Moraes Altenfelder Silva and Leonor Mendes de Barros Maternity Hospital, in the period from August 1st to October 31st, 2011; and São Paulo University Hospital, from September 1st to November 30th, 2011. The four maternity wards participating in the study, selected by convenience, are part of the SUS network: two are under municipal management and two are under state management. They contributed with 12.6% (24,357) of the total number of live births that occurred in the municipality of São Paulo in 2011 (Table 1).

Table 1
- Characteristics of four hospitals from the Brazilian National Health System's network, according to type of management, region in the municipality and average monthly and total annual number of live births, São Paulo, SP, 2011

Characteristics of women in the immediate pregnancy/postpartum cycle and the product of their pregnancy were analyzed. The data collection was made through interviews with the postpartum women, by nurses, and through searches in the medical records, prenatal care cards and other hospital records to complement the information, later typed in appropriate forms that contained open and closed questions.1616. Laurenti R, Mello Jorge MHP, Gotlieb SLD, Oliveira BZ, Pimentel EC. Estudo do binômio mãe-filho: descrição e resultados gerais. Rev Bras Epidemiol. 2015 jun;18(2):398-412

Since several maternals and newborn variables collected for the "Study of the mother-child binomium" are also part of the CLB, we compared the data entered into the SINASC database with the data collected for the study. We considered the information collected in the "Study of the mother-child binomium" as the gold standard.

Our study had three separate phases: standardization of the variables, data pairing and evaluation of the agreement, described below:

  • 1. Standardization of the variables

  • The studied variables and their respective categories are presented in Figure 1. The unfilled fields or informed as 'Ignored' in both databases were considered fields without information.

Figure 1
- Variables and categories in the evaluation of coverage, completeness and reliability of the data of the Information System on Live Births (Sinasc) in comparison to the Study of the mother-child binomium,a in four hospitals from the Brazilian National Health System's (SUS) network, São Paulo, SP, 2011

  • 2. Pairing

  • Using the mother’s name and the date of birth of the live birth, the coincident CLB (98.5%) were identified with the Access® software. To identify the remaining CLB, we searched manually the name and age of the mother, and the newborn´s birth date and sex, in the hospital where the delivery occurred. The non-coincident registers were excluded from the analysis. In this stage, a single database was created. However, the identification in the source-base was preserved.

  • 3. Evaluation of the agreement

  • The kappa coefficient was calculated to evaluate the level of agreement between the data recorded in Sinasc and the gold standard adopted, the ‘Study of the mother-child binomium’, considering 1.00 (one) as perfect agreement. The agreement classification was based in the following criteria: from 0.81 to 1.00 -excellent -, from 0.61 to 0.80 -good -, from 0.41 to 0.60 -moderate -, from 0.21 to 0.40 -acceptable -, and from -1.00 to 0.20 -poor or weak.2020. Altman DG. Practical statistics for medical research. London: Chapman and Hall; 1991. 624 p.

The quality evaluation was based in three aspects -coverage, completeness and reliability -, defined below:

  • a) Coverage

  • Number of live births recorded in SINASC in the four maternity wards included in the study divided by the total number of live births (sum of Sinasc with the ‘Study of the mother-child binomium’).

  • b) Completeness

  • Proportion of ignored and unfilled information in Sinasc database. The criterion adopted for completeness was: excellent (less than 5%), good (5 to 9%), average (10 to 19%), poor (20 to 49%), and very poor (50% or more).55. Romero DE, Cunha CB. Avaliação da qualidade das variáveis epidemiológicas e demográficas do Sistema de Informações sobre Nascidos Vivos, 2002. Cad Saúde Pública. 2007 mar;23(3):701-14.

  • c) Reliability

  • Reliability of the Sinasc database was assessed by the agreement between the data recorded in Sinasc and the data collected for the "Study of the mother-child binomium" (gold standard). The level of agreement of the qualitative variables was evaluated by the kappa coefficient.2020. Altman DG. Practical statistics for medical research. London: Chapman and Hall; 1991. 624 p.,2121. Theme Filha MM, Gama SGN, Cunha CB, Leal MC. Confiabilidade do Sistema de Informações sobre Nascidos Vivos Hospitalares no Município do Rio de Janeiro. Cad Saúde Pública. 2004;20(Suppl 1):S83-91.

For data organization and treating process, the software Excel® was used, and for kappa coefficient calculation, the PASW Statistics 17.0.

The ‘Study of the mother-child binomium: an imperious necessity to reach the Millennium Development Goals’ was conducted by the Epidemiology Department of the Public Health School of São Paulo University (FSP/USP) in 2011, after being approved by the FSP/USP Ethics Research Committee on August 24th, 2011, under the No.253/2011 (ID of the project in the Brazilian National Commission of Ethics in Research [Conep]: 0002.0.220.207-11). All participating mothers gave written informed consent.

Results

During the study period, 5,772 live births were recorded in Sinasc in the partipating hospitals while the ‘Study of the mother-child binomium’accounted 5,579 interviews (excluding nine mothers who refused to participate), distributed as follows: 1,626 in Amparo Maternal, 1,603 in Cachoeirinha Maternity Ward Hospital, 1,597 in Leonor Mendes de Barros Hospital and Maternity Ward and 753 in São Paulo University Hospital.

A total of 5,566 registers were paired between Sinasc and the ‘Study of the mother-child binomium’. To calculate the coverage, the paired registers were added to the remaining registers of each database, for a total of 5,785 LB. Sinasc had a coverage of 99.8% (5,772) and "The study of the mother-child binomium" had a covrage of 96.5% (5,579) (Figure 2).

Figure 2
Coverage of the Information System on Live Births (Sinasc) and from the Study of the mother-child binomiuma (N and %) in four hospitals from the Brazilian National Health System's (SUS) network, São Paulo, SP, 2011

To calculate the completeness of information, the 5,566 matching registers were considered, representing to 96.2% of the total. In the CLB, the percentage of absent information in the variables studied was very low compared to the corresponding percentages found by the ‘Study of the mother-child binomium’, specially for: number of prenatal care visits(0.02% versus 3.72%), pregnancy duration (0.05% versus 0.52%), mother's education level(0.04% versus 0.31%), Apgar escore at 1 minute (0.16% versus 0.49%) and at 5 minutes (0.16% versus 0.34%) of the newborn's life. The following variables had 100% of completeness in Sinasc: mother's age, previous live birth or stillborn children, types of pregnancy and delivery, weight at birth and sex (Table 2).

Table 2
- Number and incompleteness ratea of data from of the variables available in the Information System on Live Births(Sinasc) and in the Study of the mother-child binomium,b in four hospitals from the Brazilian National Health System (SUS), São Paulo, SP, 2011

To calculate agreement, the ignored or unfilled data were excluded. According to the kappa coefficient, the agreement between the existing information in Sinasc and in the ‘Study of the mother-child binomium’ was classified, in accordance to kappa coefficient, as excellent for the mother's age (0.99), type of pregnancy (0.98), weight at birth (0.98), sex (0.98), Apgar at 1st (0.96) and at 5 minutes (0.95) and previous live births (0.87). Agreement for maternal educational level was good (0.62) while prenatal care visits (0.60) and duration of pregnancy (0.56) had a moderate agreement. The agreement was weak for stillborn children (0.09) (Table 3).

Table 3
Agreement between data in the Information System on Live Births (Sinasc) and in The Study of the mother-child binomium in four hospitals from the Brazilian National Health System's (SUS) network, São Paulo, SP, 2011

Discussion

In the evaluated hospitals, Sinasc proved to be reliable and had a high coverage (99.8%), confirming the low under-registration of deliveries and the excellent completeness of the variables, in the comparison with the ‘Study of the mother-child binomium’. The Ministry of Health recommends that all CLB fields should be filled -some are mandatory, others are not-to avoid CLB with incomplete data in the system. This condition justifies the relevance of the measurement of this ocurrence.66. Oliveira MM, Andrade SSCA, Dimech GS, Oliveira JCG, Malta DC, Rabello Neto DL, et al. Avaliação do Sistema de Informações sobre Nascidos Vivos. Brasil, 2006 a 2010. Epidemiol Serv Saúde. 2015 out-dez;24(4):629-40.

A study conducted in 2002, analyzed Sinasc in eight Brazilian states, including São Paulo and reported excellent completeness (99%) for the selected variables, especially birth weight, type of pregnancy and mother's age, with values similar to those found in this study, while duration of pregnancy and maternal educational level had the largest percentages of incomplete data.1212. Almeida MF, Alencar GP, Novaes HMD, Ortiz LP. Sistemas de informação e mortalidade perinatal conceitos e condições de uso em estudos epidemiológicos. Rev Bras Epidemiol. 2006 mar;9(1):56-68.

A nationwide study evaluating the quality of Sinasc epidemiologic and demographic variables for the year 2002 revealed that in most of the Brazilian states, completeness was excellent (>95%) for mother's age, sex of the live born and mother's marital status, and good (from 90 to 95%) for education level, birth weight and number of prenatal care visits.55. Romero DE, Cunha CB. Avaliação da qualidade das variáveis epidemiológicas e demográficas do Sistema de Informações sobre Nascidos Vivos, 2002. Cad Saúde Pública. 2007 mar;23(3):701-14.

Ignored or non-filled variables can be caused by a series of isolated and/or simultaneous problems: unintelligible writing, lack of information or difficulties in finding it in the medical record; a deficient flow of information between the hospital sectors (admission, obstetric center, maternity ward, neonatology, medical archives); lack of knowledge about certain information by the mother or her companions. On the other hand, unfilled variables can also be due to lack of attention, reckless and/or lack of knowledge -of the person who fills the CLB-about its epidemiologic and legal meaning.88. Pedraza DF. Qualidade do Sistema de Informações sobre Nascidos Vivos (Sinasc): análise crítica da literatura. Ciênc Saúde Coletiva. 2012 out;17(10):2729-37.

The reliability of, the variables pregnancy duration (0.56) and number of prenatal care visits (0.60) had moderate agreement, which may be attributed, in part, to the less accurate way to collect information in Sinasc, since they were collected in predefined group categories. The CLB form was modified in 2011, but the older version was still used in the evaluated hospitals during the study period. The CLB form currently used collects information on gestational age and the number of prenatal visits as continuous variables (in weeks and the exact number of visits) instead of collecting this infomation in categorical intervals, which was used in the older CLB version.2222. Silveira MF, Matijasevich A, Horta BL, Bettiol H, Barbieri MA, Silva AA, et al. Prevalência de nascimentos pré-termo por peso ao nascer: revisão sistemática. Rev Saúde Pública. 2013 out;47(5):992-1003.

It is difficult to establish the accuracy of the gestational age to be informed in the CLB, because there are three different possible ways of reporting it: LMP (last menstrual period), obstetric ultrasound or clinical examination of the newborn (Dubowitz, New Ballard, Cappurro). This may lead to inconsistent information that can compromise the acuracy of an important indicator for prematurity.2020. Altman DG. Practical statistics for medical research. London: Chapman and Hall; 1991. 624 p.,2222. Silveira MF, Matijasevich A, Horta BL, Bettiol H, Barbieri MA, Silva AA, et al. Prevalência de nascimentos pré-termo por peso ao nascer: revisão sistemática. Rev Saúde Pública. 2013 out;47(5):992-1003.,2323. Silveira MF, Santos IS, Barros AJD, Matijasevich A, Barros FC, Victora CG. Aumento da prematuridade no Brasil: revisão de estudos de base populacional. Rev Saúde Pública. 2008 out;42(5):957-64.

The agreement for the variable number of previous stillborn infants was weak (0.09). The lack of of a clear definition of the meaning of this field does not contribute to the correct collection of this information in the CLB, causing confusion between the terms miscarriage and stillborn or even about live births who shortly died, informed in this field destined to stillborn children, generating misinterpretation or even reckless in this variable's filling.44. Mello Jorge MHP, Gotlieb SLD, Soboll MLMS, Almeida MF, Latorre MRDO. Avaliação do sistema de informação sobre nascidos vivos e o uso de seus dados em epidemiologia e estatísticas de saúde. Rev Saúde Pública. 1993;27(Suppl):1-46. With the CLB model change in 2011 the terms: 'fetal losses/miscarriages' were added to the pregnancy's history.11. Ministério da Saúde (BR). Secretaria de Vigilância em Saúde. Departamento de Análise de Situação em Saúde. Manual de instruções para o preenchimento da Declaração de Nascido Vivo [Internet]. Brasília: Ministério da Saúde; 2011 [citado 2017 out 19]. 29 p. Disponível em: Disponível em: http://uff.br/epidemiologia2/blog/wp-content/uploads/2012/10/Manual-de-DNV-4ed-2011.pdf
http://uff.br/epidemiologia2/blog/wp-con...

The high level of agreement (over 0.61) in eight of the twelve evaluated variables demonstrates the data reliability and its adequacy for use, reflecting the compromise of these hospitals with the inclusion of the data in the system.

A qualitative study aimed at understanding the mechanisms and contexts involved in the CLB data production in the municipality of São Paulo, which used the collective discourse method to analyze the social representation of the health professionals responsible for filling these forms, revealed that they recognize themselves as part of Sinasc's information generation process, not only committed in the search for solutions before eventual filling difficulties, but also valuing the monitoring and support they receive from a higher level of the system. The aforementioned research also verified that the periodic qualification promoted, which have as target the team responsible for the municipality's Sinasc management, under a permanent education perspective, were considered space for devolution, essential to solve doubts and understand the meaning of the task made in their everyday work, the purpose and the uses of the information produced by them.1010. Schoeps D, Almeida MF, Raspantini PR, Novaes HMD, Silva ZP, Lefevre F. SIM e SINASC: representação social de enfermeiros e profissionais de setores administrativos que atuam em hospitais no município de São Paulo. Ciênc Saúde Coletiva. 2013 maio;18(5):1483-92.

There is a consensus that continuous education is essential to ensure the completeness and reliability of the data recorded in the system, especially because of the high turnover and the different types of professionals involved in filling the LBC. Responsible for filling the Live Birth Certificate. Periodic evaluation and monitoring also must be part of the health information systems management routine.66. Oliveira MM, Andrade SSCA, Dimech GS, Oliveira JCG, Malta DC, Rabello Neto DL, et al. Avaliação do Sistema de Informações sobre Nascidos Vivos. Brasil, 2006 a 2010. Epidemiol Serv Saúde. 2015 out-dez;24(4):629-40.,99. Nhoncanse GC, Melo DG. Confiabilidade da Declaração de Nascido Vivo como fonte de informação sobre os defeitos congênitos no Município de São Carlos, São Paulo, Brasil. Ciênc Saúde Coletiva. 2012 abr;17(4):955-63.,2222. Silveira MF, Matijasevich A, Horta BL, Bettiol H, Barbieri MA, Silva AA, et al. Prevalência de nascimentos pré-termo por peso ao nascer: revisão sistemática. Rev Saúde Pública. 2013 out;47(5):992-1003.,2424. Dombrowski JG, Ataide R, Marchesini P, Souza RM, Marinho CRF. Effectiveness of the live births information system in the Far-Western Brazilian Amazon. Ciênc Saúde Coletiva. 2015 Apr;20(4):1245-54.

The Sinasc Label, introduced in the municipality of São Paulo in 2009, was a strategy created to conciliate evaluation, monitoring and encouragement, recognized through an annual certification bestowed upon health establishments that fulfill a pre-established coverage threshold (total of live birth deliveries), punctuality (inclusion of all the deliveries of the month in the system in at least 15 days after the delivery) and completeness of the variables (95 to 100%).1818. Secretaria Municipal da Saúde (SP). Coordenação de Epidemiologia e Informação (CEInfo): informações de saúde (Tabnet). Estatísticas vitais [Internet]. 2017 [citado 2017 out 19]. Disponível em Disponível em http://tabnet.saude.prefeitura.sp.gov.br/cgi/deftohtm3.exe?secretarias/saude/TABNET/sinasc/nascido.def
http://tabnet.saude.prefeitura.sp.gov.br...
,2525. Secretaria Municipal da Saúde (SP). Coordenação de Epidemiologia e Informação (CEInfo). Manual do selo Sinasc 2010 [Internet]. São Paulo: Secretaria Municipal da Saúde; 2010 [citado 2017 out 19]. 12 p. Disponível em: Disponível em: http://www.prefeitura.sp.gov.br/cidade/secretarias/upload/saude/arquivos/sinasc/SeloSINASC_manual2010.PDF
http://www.prefeitura.sp.gov.br/cidade/s...

However, some challenges still exist: (i) improve the information with weak to moderate agreement and (ii) maintain the quality of the information rated as good. This evaluation is useful, because it contributes to guide the efforts and subsidize the review and to develop interventions to improve the completeness of the fields 'gestational age' (pregnancy duration), 'number of prenatal care visits' and 'number of previous stillborn children'.

Other evaluations of reliability would be opportune and enriching in the sense of overcoming the limitations of this study, possibly with the expansion of the period and number of included hospitals, allowing a more representative of the municipality or even matching Sinasc records in a regular and systematic way with the hospitals systems of information.

This study results, focused in four hospitals from the SUS network in the municipality of São Paulo, pointed to a high coverage, completeness and agreement of the researched variables, confirming the ability from the Information System on Live Births-Sinasc -to fulfill its aim: to provide objective analyses of the health situation and through it to subsidize the health care plans for pregnant women, mothers and children.

Acknowledgement

We are grateful to the colleague from the São Paulo Municipal Department of Epidemiology and Information, Marcos Drumond Júnior, for the support and collaboration in the study's statistical design.

To the professors from the Brazilian Center of International Statistics Classifications of Disease and Health Related Problems, of the Public Health Faculty of the São Paulo University, doctors. Ruy Laurenti (in memoriam), Maria Helena Prado de Mello Jorge and Sabina Léa Davidson Gotlieb, for their participation in 'The study of the mother-child binomium: an imperious necessity to reach the Millennium Development Goals' and for helping us to access their study´s database and for allowing us to conduct this study.

Referências

  • 1
    Ministério da Saúde (BR). Secretaria de Vigilância em Saúde. Departamento de Análise de Situação em Saúde. Manual de instruções para o preenchimento da Declaração de Nascido Vivo [Internet]. Brasília: Ministério da Saúde; 2011 [citado 2017 out 19]. 29 p. Disponível em: Disponível em: http://uff.br/epidemiologia2/blog/wp-content/uploads/2012/10/Manual-de-DNV-4ed-2011.pdf
    » http://uff.br/epidemiologia2/blog/wp-content/uploads/2012/10/Manual-de-DNV-4ed-2011.pdf
  • 2
    Rede Interagencial de Informações para a Saúde (RIPSA). Indicadores básicos para a saúde no Brasil: conceitos e aplicações [Internet]. 2. ed. Brasília: Organização Pan-Americana da Saúde; 2008 [citado 2017 out 19]. 349 p. Disponível em: Disponível em: http://tabnet.datasus.gov.br/tabdata/livroidb/2ed/indicadores.pdf
    » http://tabnet.datasus.gov.br/tabdata/livroidb/2ed/indicadores.pdf
  • 3
    National Research Council (US). Committee on National Statistics. Vital statistics: summary of a workshop [Internet]. Washington (DC): National Academies Press (US); 2009 [cited 2017 Oct 19]. Available in: Available in: https://www.ncbi.nlm.nih.gov/books/NBK219884/
    » https://www.ncbi.nlm.nih.gov/books/NBK219884/
  • 4
    Mello Jorge MHP, Gotlieb SLD, Soboll MLMS, Almeida MF, Latorre MRDO. Avaliação do sistema de informação sobre nascidos vivos e o uso de seus dados em epidemiologia e estatísticas de saúde. Rev Saúde Pública. 1993;27(Suppl):1-46.
  • 5
    Romero DE, Cunha CB. Avaliação da qualidade das variáveis epidemiológicas e demográficas do Sistema de Informações sobre Nascidos Vivos, 2002. Cad Saúde Pública. 2007 mar;23(3):701-14.
  • 6
    Oliveira MM, Andrade SSCA, Dimech GS, Oliveira JCG, Malta DC, Rabello Neto DL, et al. Avaliação do Sistema de Informações sobre Nascidos Vivos. Brasil, 2006 a 2010. Epidemiol Serv Saúde. 2015 out-dez;24(4):629-40.
  • 7
    Almeida MF, Alencar GP, França Jr I, Novaes HMD, Siqueira AAF, Schoeps D, et al. Validade das informações das declarações de nascidos vivos com base em estudo de caso-controle. Cad Saúde Pública. 2006 mar;22(3):643-52.
  • 8
    Pedraza DF. Qualidade do Sistema de Informações sobre Nascidos Vivos (Sinasc): análise crítica da literatura. Ciênc Saúde Coletiva. 2012 out;17(10):2729-37.
  • 9
    Nhoncanse GC, Melo DG. Confiabilidade da Declaração de Nascido Vivo como fonte de informação sobre os defeitos congênitos no Município de São Carlos, São Paulo, Brasil. Ciênc Saúde Coletiva. 2012 abr;17(4):955-63.
  • 10
    Schoeps D, Almeida MF, Raspantini PR, Novaes HMD, Silva ZP, Lefevre F. SIM e SINASC: representação social de enfermeiros e profissionais de setores administrativos que atuam em hospitais no município de São Paulo. Ciênc Saúde Coletiva. 2013 maio;18(5):1483-92.
  • 11
    Silva RS, Oliveira CM, Ferreira DKS, Bonfim CV. Avaliação da completitude das variáveis do Sistema de Informações sobre Nascidos Vivos - Sinasc - nos estados da região Nordeste do Brasil, 2000 e 2009. Epidemiol Serv Saúde. 2013 abr-jun;22(2):347-52.
  • 12
    Almeida MF, Alencar GP, Novaes HMD, Ortiz LP. Sistemas de informação e mortalidade perinatal conceitos e condições de uso em estudos epidemiológicos. Rev Bras Epidemiol. 2006 mar;9(1):56-68.
  • 13
    Drumond EF, Machado CJ, Vasconcelos MR, França E. Utilização de dados secundários do SIM, Sinasc e SIH na produção científica brasileira de 1990 a 2006. R Bras Est Pop. 2009 jan-jun;26(1):7-19.
  • 14
    Silva AAM, Ribeiro VS, Borba Júnior AF, Coimbra LC, Silva RA. Avaliação da qualidade dos dados do Sistema de Informações sobre Nascidos Vivos em 1997-1998. Rev Saúde Pública. 2001 dez;35(6):508-14.
  • 15
    Paiva NS, Coeli CM, Moreno AB, Guimarães RM, Camargo Júnior KR. Brazilian live birth information system: a review study. Ciênc Saúde Coletiva. 2011; 16(Suppl1):1211-20.
  • 16
    Laurenti R, Mello Jorge MHP, Gotlieb SLD, Oliveira BZ, Pimentel EC. Estudo do binômio mãe-filho: descrição e resultados gerais. Rev Bras Epidemiol. 2015 jun;18(2):398-412
  • 17
    Programa das Nações Unidas para o Desenvolvimento. Instituto de Pesquisa Econômica Aplicada. Fundação João Pinheiro. Atlas do desenvolvimento humano no Brasil - São Paulo, SP [Internet] 2017 [citado 2017 out 19]. Disponível em: Disponível em: http://www.atlasbrasil.org.br/2013/pt/perfil_m/sao-paulo_sp
    » http://www.atlasbrasil.org.br/2013/pt/perfil_m/sao-paulo_sp
  • 18
    Secretaria Municipal da Saúde (SP). Coordenação de Epidemiologia e Informação (CEInfo): informações de saúde (Tabnet). Estatísticas vitais [Internet]. 2017 [citado 2017 out 19]. Disponível em Disponível em http://tabnet.saude.prefeitura.sp.gov.br/cgi/deftohtm3.exe?secretarias/saude/TABNET/sinasc/nascido.def
    » http://tabnet.saude.prefeitura.sp.gov.br/cgi/deftohtm3.exe?secretarias/saude/TABNET/sinasc/nascido.def
  • 19
    Secretaria Municipal da Saúde (SP). Coordenação de Epidemiologia e Informação (CEInfo). Bonilha EA, Vico ESR, Freitas M, Okamura MN. Selo Sinasc no Município de São Paulo. Boletim CEInfo Análise. 2017 maio;12(14). 30 p. Disponível em: http://www.prefeitura.sp.gov.br/cidade/secretarias/upload/saude/arquivos/publicacoes/Boletim_CEInfo_Analise_14.pdf
    » http://www.prefeitura.sp.gov.br/cidade/secretarias/upload/saude/arquivos/publicacoes/Boletim_CEInfo_Analise_14.pdf
  • 20
    Altman DG. Practical statistics for medical research. London: Chapman and Hall; 1991. 624 p.
  • 21
    Theme Filha MM, Gama SGN, Cunha CB, Leal MC. Confiabilidade do Sistema de Informações sobre Nascidos Vivos Hospitalares no Município do Rio de Janeiro. Cad Saúde Pública. 2004;20(Suppl 1):S83-91.
  • 22
    Silveira MF, Matijasevich A, Horta BL, Bettiol H, Barbieri MA, Silva AA, et al. Prevalência de nascimentos pré-termo por peso ao nascer: revisão sistemática. Rev Saúde Pública. 2013 out;47(5):992-1003.
  • 23
    Silveira MF, Santos IS, Barros AJD, Matijasevich A, Barros FC, Victora CG. Aumento da prematuridade no Brasil: revisão de estudos de base populacional. Rev Saúde Pública. 2008 out;42(5):957-64.
  • 24
    Dombrowski JG, Ataide R, Marchesini P, Souza RM, Marinho CRF. Effectiveness of the live births information system in the Far-Western Brazilian Amazon. Ciênc Saúde Coletiva. 2015 Apr;20(4):1245-54.
  • 25
    Secretaria Municipal da Saúde (SP). Coordenação de Epidemiologia e Informação (CEInfo). Manual do selo Sinasc 2010 [Internet]. São Paulo: Secretaria Municipal da Saúde; 2010 [citado 2017 out 19]. 12 p. Disponível em: Disponível em: http://www.prefeitura.sp.gov.br/cidade/secretarias/upload/saude/arquivos/sinasc/SeloSINASC_manual2010.PDF
    » http://www.prefeitura.sp.gov.br/cidade/secretarias/upload/saude/arquivos/sinasc/SeloSINASC_manual2010.PDF
  • *
    The 'Study of the mother-child binomium: an imperious necessity to reach the Millennium Development Goals' was funded by Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP): Process No. 09/53253-8, public call Research Program of Brazilian National Health System (PPSUS).

Publication Dates

  • Publication in this collection
    2018

History

  • Received
    21 June 2017
  • Accepted
    29 Sept 2017
Secretaria de Vigilância em Saúde e Ambiente - Ministério da Saúde do Brasil SRTVN Quadra 701, Via W5 Norte, Lote D, Edifício P0700, CEP: 70719-040, +55 61 3315-3464, Fax: +55 61 3315-3464 - Brasília - DF - Brazil
E-mail: ress.svs@gmail.com