Age, Creatinine and Ejection Fraction Score in Brazil: Comparison with InsCor and the EuroSCORE

Abstract

Background:

Risk scores for cardiac surgery cannot continue to be neglected.

Objective:

To assess the performance of “Age, Creatinine and Ejection Fraction Score” (ACEF Score) to predict mortality in patients submitted to elective coronary artery bypass graft and/or heart valve surgery, and to compare it to other scores.

Methods:

A prospective cohort study was carried out with the database of a Brazilian tertiary care center. A total of 2,565 patients submitted to elective surgeries between May 2007 and July 2009 were assessed. For a more detailed analysis, the ACEF Score performance was compared to the InsCor’s and EuroSCORE’s performance through correlation, calibration and discrimination tests.

Results:

Patients were stratified into mild, moderate and severe for all models. Calibration was inadequate for ACEF Score (p = 0.046) and adequate for InsCor (p = 0.460) and EuroSCORE (p = 0.750). As for discrimination, the area under the ROC curve was questionable for the ACEF Score (0.625) and adequate for InsCor (0.744) and EuroSCORE (0.763).

Conclusion:

Although simple to use and practical, the ACEF Score, unlike InsCor and EuroSCORE, was not accurate for predicting mortality in patients submitted to elective coronary artery bypass graft and/or heart valve surgery in a Brazilian tertiary care center. (Arq Bras Cardiol. 2015; [online].ahead print, PP.0-0)

Keywords:
Cardiac Surgical Procedures / mortality; Myocardial Revascularization; Probability; Heart Valve Diseases / surgery; Cohort Studies

Resumo

Fundamento:

Escores de risco para cirurgia cardíaca não podem continuar sendo neglicenciados.

Objetivo:

Avaliar o desempenho do Age, Creatinine and Ejection Fraction Score (ACEF Score) na predição de mortalidade dos pacientes submetidos à cirurgia de revascularização miocárdica e/ou valvar eletiva, e compará-lo a outros escores.

Métodos:

Estudo de coorte prospectivo no banco de um centro terciário brasileiro. Foram avaliados 2.565 pacientes operados de maneira eletiva entre maio de 2007 e julho de 2009. Para uma análise mais detalhada, o desempenho do ACEF Score foi comparado ao do InsCor e ao do EuroSCORE por meio de testes de correlação, calibração e discriminação.

Resultados:

Os pacientes foram estratificados em leve, moderado e grave para todos os modelos. A calibração foi inadequada para o ACEF Score (p = 0,046) e adequada para o InsCor (p = 0,460) e o EuroSCORE (p = 0,750). Na discriminação, a área abaixo da curva ROC apresentou-se questionável para o ACEF Score (0,625) e apropriada para o InsCor (0,744) e o EuroSCORE (0,763).

Conclusão:

Embora simples e prático, o ACEF Score, ao contrário do InsCor e do EuroSCORE, não se mostrou acurado para predizer mortalidade nos pacientes submetidos à cirurgia de revascularização miocárdica e/ou valvar eletiva em centro terciário brasileiro. (Arq Bras Cardiol. 2015; [online].ahead print, PP.0-0)

Palavras-chave
Procedimentos Cirúrgicos Cardíacos / mortalidade; Revascularização Miocárdica; Probabilidade; Doenças das Valvas Cardíacas / cirurgia; Estudos de Coortes

Introduction

Cardiac surgery represents a big impact on the health system due to its significant use of human and financial resources. Therefore, risk stratification becomes increasingly important ¹.

Regarding clinical practice, there are three ways to use a risk score in a specific population. The simplest, but also the less optimal, is the immediate use of an external score, without any model adaptation. Recalibration, which maintains the same model variables, has its weights adjusted based on its own data. Remodeling is the choice of new variables based on local risk factors. Undoubtedly, this last option offers the best accuracy and the best performance².

In Brazil, the InsCor³ model with ten variables, a product of the remodeling of two international models^4,5, provides information on the impact of local risk factors. However, the EuroSCORE, with 17 variables, remains the most widely used in the country^6-8. Over time, controversies related to the overestimation of the EuroSCORE led to the development of the EuroSCORE II⁹. This model, which is even more complex, had problems related to its external validation, including in Brazil¹⁰, which led us to rethink about the choice of international scores and the preference for increasingly simple models.

The “Age, Creatinine and Ejection Fraction” (ACEF) score was proposed in 2009 to predict mortality in adult patients submitted to elective heart surgery¹¹. The main characteristic of this score is the fact that it is a practical one, as the ratio between age and ejection fraction is the basis of calculation, added by an additional point when preoperative creatinine is > 2.0 mg/dL. The ACEF Score was developed and validated in Italy¹² only, where it attained good accuracy, excellent calibration and parsimony in clinical application. This model, which attained a similar performance to that of EuroSCORE, was never validated outside Italy or compared to a Brazilian model.

The objective of this study was to evaluate the performance of ACEF Score and compare its performance with the InsCor and the EuroSCORE for predicting mortality in patients undergoing coronary artery bypass graft (CABG) and/or elective heart valve surgery in a Brazilian tertiary care center.

Methods

Sample

A retrospective, observational study was carried out based on a prospective database of Instituto do Coração (InCor) of Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo (HC-FMUSP).

The hypothesis that the records included data for all variables of the chosen models had to be confirmed before the start of the analysis. Thus, to carry out the statistical validation, the sample size should include at least a hundred deaths. Data published by InCor showed a mortality of 4.8% for elective CABG and 8.4% for elective heart valve surgery¹³; thereby, the minimum number of patients would be 2,084. We then chose the number of consecutive patients consecutively submitted to elective surgeries between May 2007 and July 2009, which amounted to a total of 2,565 patients.

Inclusion Criteria

The inclusion criteria were the following: age ≥ 18 years old and having undergone heart valve surgery (replacement or plastic), Coronary Artery Bypass Graft (CABG; with or without the use of cardiopulmonary bypass) or associated surgery (CABG and valve surgery), electively, in the established period.

Data collection, definition and organization

The collection of data from patients included in this registry was performed by a graduate student supervised by two assistant physicians of the Department of Cardiovascular Surgery of InCor. At the time, a spreadsheet was created to cover all the variables described by the 2000 Bernstein-Parsonnet and EuroSCORE¹⁴ models. In this analysis, 60 preoperative variables were collected per patient and placed in an interface created in Excel. After the registry evaluation, we observed that it could also provide information to validate the ACEF Score − and, moreover, it could compare its performance to that of the InsCor and EuroSCORE.

The ACEF Score value was calculated by the following equation, available in the model publication:

Age (y) /EF (%) + 1 (if preoperative serum creatinine value > 2.0 mg/dL

The additive value of InsCor was calculated from a graph with its own scoring system and the EuroSCORE, from the site: http://www.euroscore.org/calc.html. All settings attributed to the model variables (Chart 1) were taken into account, together with their respective values and classified according to their importance regarding the death event. The follow-up was limited to the hospital phase, having hospital mortality as the primary outcome, which covered the period between surgery and hospital discharge. For optimization and completeness of the data, all information recorded in the Department of Cardiovascular Surgery were confined to the Incor Data Processing Service.

Chart 1
Models and their variables

ACEF Score	InsCor	EuroSCORE
Age, ejection fraction and creatinine = 2 mg/dL	Age > 70 years, female gender, associated coronary surgery + valve, recent infarction, reoperation, aortic valve surgery, tricuspid valve surgery, creatinine > 2mg/dL, ejection fraction < 30%, preoperative events (use of preoperative inotropics, cardiogenic shock, cardiac resuscitation, use of intra-aortic balloon, acute renal failure, heart massage, orotracheal intubation, tachycardia or ventricular fibrillation)	Age, gender, COPD, peripheral vascular disease, neurological dysfunction, creatinine, endocarditis, previous cardiac surgery, critical preoperative status (use of preoperative inotropics, cardiogenic shock, cardiac resuscitation and use of intra-aortic balloon), unstable angina, recent myocardial infarction, left ventricular ejection fraction, pulmonary hypertension (sPAP > 60 mmHg), emergency, associated surgery surgery on the aorta and VSD post-infarction

• ACEF Score: Age, Creatinine and Ejection Fraction Score; COPD: chronic obstructive pulmonary disease; sPAP: Systolic Pulmonary Artery Pressure; VSD: Ventricular Septal Defect

Statistical analysis

To evaluate the performance of the ACEF score, the EuroSCORE and InsCor in mortality prediction, the models predictive validation was carried out in 2,565 patients. The validation was performed through calibration and discrimination tests. The calibration was calculated using the Hosmer-Lemeshow test (H-L), which shows the degree to which the model fits the data. Therefore, it has a different interpretation; if the H-L test is not significant (p> 0.05), the model has a proper fit. Models with good fit show no significance at the test, indicating that the model’s prediction is not significantly different from the observed values.

The discrimination, which differentiates high-risk patients from low-risk ones was measured by the area under the Receiver Operating Characteristics (ROC) curve. Continuous variables were expressed as mean ± standard deviation and categorical variables as percentages. The models’ performance was measured by comparing the observed and expected mortality in the risk groups established by the models. Fisher’s exact test was used for contingency tables. A p value <0.05 was considered significant. Statistical analysis was performed with the Statistical Package for Social Sciences (SPSS) software, Statistics Desktop, version 22.0 for Windows (IBM Corporation Armonk, New York, United States).

Ethics and Informed Consent

The Free and Informed Consent was waived, as the study includes only data without identification.

Results

Sample

Of the 2,565 analyzed patients, 167 patients (6.5%) died. The mean age was 59.62 ± 13.35 years, and 913 (35.59%) patients were females. The mean ejection fraction was 56.62% ± 12.99%. The mean score values in the sample was 1.18 ± 0.54, 3.48 ± 3.31 and 3.78 ± 2.87 for the ACEF Score, InsCor and EuroSCORE, respectively. The following surgeries were performed: 1,130 (44.1%) isolated CABG; 679 (26.5%) mitral valve surgeries; 580 (22.6%) aortic valve surgeries and 176 (6.86%) CABG + valve surgeries. Nevertheless, there were 449 (17.5%) reoperation cases and 100 (3.9%) patients with creatinine > 2 mg/dL.

Adequacy of the models

There was a high positive correlation between EuroSCORE and InsCor (Spearman, r = 0.770; p < 0.0001), a moderate one between EuroSCORE and ACEF Score (Spearman, r = 0.527; p < 0.0001) and a low one between InsCor and ACEF Score (Spearman, r = 0.301; p < 0.0001) to predict mortality in the assessed sample.

Calibration

The ACEF score showed association with death (p < 0.0001). However, the H-L test did not show a good model fit (p = 0.046) (Table 1). For a better analysis, the ACEF score was divided into three categories (Table 2). On the other hand, the InsCor, in addition to demonstrating an association with death (p <0.0001), showed good fit (p = 0.460) in the H-L test (Table 3). In Table 4, the InsCor was divided into three categories. Still, the EuroSCORE showed association with death (p <0.0001) and a good fit (p = 0.750) in the H-L test (Table 5). In Table 6, the EuroSCORE was divided into three categories.

Table 1
Association between the ACEF Score, death and the Hosmer-Lemeshow test

Group	Total	Death
		Yes		No
		Observed	Expected	Observed	Expected
1	256	14	10.26	242	245.74
2	256	9	11.81	247	244.19
3	257	11	12.72	246	244.28
4	257	7	13.38	250	243.62
5	259	11	14.20	248	244.80
6	255	21	14.73	234	240.27
7	257	10	15.76	247	241.24
8	257	25	17.39	232	239.61
9	257	25	21.35	232	235.65
10	254	34	35.42	220	218.58

Table 2
ACEF Score divided into mild, moderate and severe risk

Risk	n	Observed percentage	95%CI		Expected percentage	LL	95%CI
			LL	UL			UL	p value
Mild	769	4.4	3.0	5.9	4.6	3.1	6.0
Moderate	1,028	4.8	3.5	6.1	5.6	4.2	7.1	0.046
Severe	768	10.9	8.7	13.1	9.6	7.5	11.7

• 95% CI: 95% confidence interval; LL: lower limit; UL: upper limit.

Table 3
Association between InsCor, death and the Hosmer-Lemeshow test

Group	Total	Death
		Yes		No
		Observed	Expected	Observed	Expected
1	641	14	15.76	627	625.24
2	601	17	22.54	584	578.46
3	287	11	13.26	276	273.74
4	162	7	9.20	155	152.80
5	402	33	28.00	369	374.00
6	293	37	31.54	256	261.46
7	179	48	46.69	131	132.31

Table 4
InsCor divided into mild, moderate and severe risk

Risk	n	Observed percentage	95%CI		Expected percentage	LL	95%CI
			LL	UL			UL	p value
Mild	1.242	2.5	1.6	3.4	3.1	2.2	4.1
Moderate	851	6.0	4.4	7.6	5.9	4.3	7.5	0.460
Severe	472	18.0	14.5	21.5	16.5	13.2	19.9

• 95% CI: 95% confidence interval; LL: lower limit; UL: upper limit.

Table 5
Association between the EuroSCORE, death and the Hosmer-Lemeshow test

Group	Total	Death
		Yes		No
		Observed	Expected	Observed	Expected
1	294	5	3.83	289	290.17
2	377	10	6.79	367	370.21
3	280	6	6.96	274	273.04
4	383	11	13.11	372	369.89
5	332	15	15.60	317	316.40
6	228	11	14.63	217	213.37
7	232	18	20.19	214	211.81
8	268	40	35.73	228	232.27
9	171	51	50.18	120	120.82

Table 6
EuroSCORE divided into mild, moderate and severe risk

Risk	n	Observed percentage	95%CI		Expected percentage	LL	95%CI
			LL	UL			UL	p value
Mild	951	2.2	1.3	3.1	1.9	1.0	2.8
Moderate	943	3.9	2.7	5.2	4.6	3.2	5.9	0.750
Severe	671	16.2	13.5	19.0	15.8	13.0	18.6

• 95% CI: 95% confidence interval; LL: lower limit; UL: upper limit.

Discrimination

The area under the ROC curve was 0.625 (95% CI: from 0.58 to 0.67; p < 0.0001) for the ACEF score, of 0.744 (95% CI: 0.70-0.79; p < 0.0001) for InsCor and 0.763 (95%CI: 0.72-0.80; p < 0.0001) for the EuroSCORE (Figure 1). There was an overlap between the ROC curve of the EuroSCORE and that of InsCor. However, the ACEF score showed the lowest area and it did not overlap with that of the other models.

Figure 1
ROC curve for the ACEF score, InsCor and EuroSCORE in assessing the power of discrimination performed in 2565 patients. EURO: EuroSCORE; ACEF Score: Age, Creatinine and Ejection Fraction Score;

Discussion

Risk scores should be linear and simplified formulas for predicting mortality or morbidity at the bedside and without the need for calculators or other personal assistants¹⁵.

These instruments are usually evaluated in terms of accuracy (discriminative power), calibration and clinical performance. Many authors have emphasized that the level of precision rarely exceeds an area under the ROC curve of 0.75 (value that is inappropriate for clinical purposes), and that calibration may be inaccurate for low and high risk groups¹⁶. Risk scores are developed through statistical methods and subsequently validated in other populations to assess its clinical applicability. They are developed to be used in large populations, such as the EuroSCORE, constructed from 19,030 patients with nearly 450 events. This evidently allows the inclusion of a large number of independent predictors into the model (ten events are considered per predictor)¹⁷. However, the publication of the ACEF Score confirms the experimental hypothesis that a risk score can be developed based on a very limited number of risk factors. The evidence that the risk of mortality in elective cardiac surgery can be predicted with only three risk factors seems to be in conflict with the general hypothesis that the higher the number of considered risk factors, the more accurate and better calibrated the model will be. However, a number of clinical, practical and mathematical considerations may explain this apparent paradox.

Wells et al¹⁸ concluded that “less is more” in the multivariate analysis. Thus, instead of including many variables, the models could be more consistent and effective when confined to a few variables (good predictors). In this study, however, the three risk factors used in the ACEF Score were also included in the InsCor and EuroSCORE. Perhaps one advantage of the ACEF Score, in addition to its simplicity, is that the variables age and ejection fraction are used in their continuous form instead of categorical, as in the other two models. The inclusion of a large number of independent variables increases the risk of multicollinearity, which, in practice, would be the risk of redundant information in the model¹⁹. However, for individual cases, and especially in complex ones, greatly simplifying a model can be risky.

The question would be: national or international score; simple, intermediate or complex one - which one will be easier, cheaper and more appropriate?

After the publication of the administrative database of the Brazilian Unified Health System [Sistema Único de Saúde (SUS)], showing a mortality in cardiac surgery of 8% in Brazil²⁰, efforts were made related to the validation of international risk models²¹ and the formulation of national models²².

Comparing raw results of an administrative database with a clinical database, and also a voluntary one, such as the Society of Thoracic Surgery (STS), in the United States, is unacceptable. It should be emphasized that the STS registry represents 10% of the total surgeries performed annually in referral hospitals of the United States²³.

In this context, the data from the Italian public health service are important. In the capital, Rome, CABG mortality in the same period during which the Brazilian analysis was carried out was 5.4%. When mortality was divided by socioeconomic status (at the same hospitals), mortality in the higher socioeconomic group (economically more favored and more educated) was 4.8%. In the most disadvantaged group (the poorest and least educated), mortality was 8.2% ²⁴.

There is no doubt that SUS includes the range of poorer patients undergoing cardiac surgery in Brazil, where less than 30% of procedures are performed by the private sector²⁵. The current scenario is extremely timely, as it provides space for the search of risk scores that are more accurate for our reality, knowing that the simpler and more effective a model is, the better cost-effectiveness of the system.

For all these reasons, the ACEF Score, validated in Italy, was chosen to be validated in Brazil, following all the recommendations of the authors (on label). However, although the ACEF Score has shown to be comparable to the EuroSCORE, it showed to inferior to the InsCor and EuroSCORE and moreover, it was inadequate for our reality.

On the other hand, the EuroSCORE confirmed its good performance in Brazil^6,7. However, as it is more complex and has the same accuracy of the InsCor (areas of overlapping ROC curves), it should be preferred exclusively for individual evaluation.

The EuroSCORE was recently remodeled⁹ and is now called “EuroSCORE II”. However, this version was not chosen for this study because, in addition to being more complex, it has brought to Brazil¹⁰ the same difficulties it showed in several centers worldwide^26-28.

In this study, we observed that the ACEF score, even applied on label, showed its deficiency for a population with hypothetically similar characteristics to those of the population that originated it.

Thus, the accuracy of InsCor of ten variables was better than that of the ACEF score of three variables, and similar to the EuroSCORE of 17 variables, showing that intermediate complexity models may be preferred.

Limitations

First, as there was no record of patients, the calculation of ACEF score was carried out retrospectively. However, those in charge of the calculations were not aware of the outcomes. Second, although the registry includes patients from different regions of Brazil, data were collected from a single tertiary center, characterizing it as a single-center study.

Conclusion

The ACEF Score, although simple and practical, failed to predict mortality in patients submitted to coronary artery bypass graft and/or elective heart valve surgery in a Brazilian tertiary care center.

• Sources of Funding
  There were no external funding sources for this study.
• Study Association
  This study is not associated with any thesis or dissertation work.

References

• ¹
  Mejía OA, Lisboa LA, Dallan LA, Pomerantzeff PM, Trindade EM, Jatene FB, et al. Estratificação de risco cirúrgico como instrumento de inovação em programas de cirurgia cardíaca no Sistema Único de Saúde do Estado de São Paulo: Estudo SP-Score-SUS. Rev Bras Cir Cardiovasc. 2013;28(2):263-9.
• ²
  Ivanov J, Tu JV, Naylor CD. Ready-made, recalibrated, or remodeled? Issues in the use of risk indexes for assessing mortality after coronary artery bypass graft surgery. Circulation. 1999;99(16):2098-104.
• ³
  Mejía OA, Lisboa LA, Puig LB, Moreira LF, Dallan LA, Pomerantzeff PM, et al. InsCor: a simple and accurate method for risk assessment in heart surgery. Arq Bras Cardiol. 2013;100(3):246-54.
• ⁴
  Nashef SA, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R; the EuroSCORE study group. European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardiothorac Surg. 1999;16(1):9-13.
• ⁵
  Bernstein AD, Parsonnet V. Bedside estimation of risk as an aid for decision-making in cardiac surgery. Ann Thorac Surg. 2000;69(3):823-8.
• ⁶
  Moraes F, Duarte C, Cardoso E, Tenório E, Pereira V, Lampreia D, et al. Avaliação do EuroSCORE como preditor de mortalidade em cirurgia de revascularização miocárdica no Instituto do Coração de Pernambuco. Rev Bras Cir Cardiovasc. 2006;21(1):29-34.
• ⁷
  Andrade IN, Moraes Neto FR, Oliveira JP, Silva IT, Andrade TG, Moraes CR. Assessment of the EuroSCORE as a predictor for mortality in valve cardiac surgery at the Heart Institute of Pernambuco. Rev Bras Cir Cardiovasc. 2010;25(1):11-8.
• ⁸
  Mejía OA, Lisboa LA, Puig LB, Dias RR, Dallan LA, Pomerantzeff PM, et al. The 2000 Bernstein-Parsonnet score and EuroSCORE are similar in predicting mortality at the Heart Institute, USP. Rev Bras Cir Cardiovasc. 2011;26(1):1-6.
• ⁹
  Nashef SA, Roques F, Sharples LD, Nilsson J, Smith C, Goldstone AR, et al. EuroSCORE II. Eur J Cardiothorac Surg. 2012;41(4):734-44.
• ¹⁰
  Lisboa LA, Mejia OA, Moreira LF, Dallan LA, Pomerantzeff PM, Dallan LR, et al. EuroSCORE II and the importance of a local model, InsCor and the future SP-SCORE. Rev Bras Cir Cardiovasc. 2014;29(1):1-8.
• ¹¹
  Ranucci M, Castelvecchio S, Menicanti L, Frigiola A, Pelissero G. Risk of assessing mortality risk in elective cardiac operations. Age, creatinine, ejection fraction and the law of parsimony. Circulation. 2009;119(24):3053-61.
• ¹²
  Ranucci M, Castelvecchio S, Conte M, Megliola G, Speziale G, Fiore F, et al. The easier, the better: age, creatinine, ejection fraction score for operative mortality risk stratification in a series of 29,659 patients undergoing elective cardiac surgery. J Thorac Cardiovasc Surg. 2011;142(3):581-6.
• ¹³
  Lisboa LA, Moreira LF, Mejia OV, Dallan LA, Pomerantzeff PM, Costa R, et al. Evolution of cardiovascular surgery at the Instituto do Coração: analysis of 71,305 surgeries. Arq Bras Cardiol. 2010;94(2):162-8.
• ¹⁴
  Mejía OA, Lisboa LA, Dallan LA, Pomerantzeff PM, Moreira LF, Jatene FB, et al. Validation of the 2000 Bernstein-Parsonnet and EuroSCORE at the Heart Institute - USP. Rev Bras Cir Cardiovasc. 2012;27(2):187-94.
• ¹⁵
  Hannan EL, Racz M, Culliford AT, Lahey SJ, Wechsler A, Jordan D, et al. Risk score for predicting in-hospital/30-day mortality for patients undergoing valve and valve/coronary artery bypass graft surgery. Ann Thorac Surg. 2013;95(4):1282-90.
• ¹⁶
  Mejía OA, Lisboa LA. The risk of risk scores and the dream of BraSCORE. Rev Bras Cir Cardiovasc. 2012;27(2):xii-xiii.
• ¹⁷
  Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49(12):1373-9.
• ¹⁸
  Wells CK, Feinstein AR, Walter SD. A comparison of multivariable mathematical methods for predicting survival - III. Accuracy of predictions in generating and challenge sets. J Clin Epidemiol. 1990;43(4):361-72.
• ¹⁹
  Tu JV, Sykora K, Naylor CD. Assessing the outcomes of coronary artery bypass graft surgery: how many risk factors are enough? Steering Committee of the Cardiac Care Network of Ontario. J Am Coll Cardiol. 1997;30(5):1317-23.
• ²⁰
  Ribeiro AL, Gagliardi SP, Nogueira JL, Silveira LM, Colosimo EA, Nascimento CA. Mortality related to cardiac surgery in Brazil, 2000-2003. J Thorac Cardiovasc Surg. 2006;131(4):907-9.
• ²¹
  Ikeoka DT, Fernandes VA, Gebara O, Garcia JC, Barros e Silva PG, Rodrigues MJ, et al. Evaluation of the Society of Thoracic Surgeons score system for isolated coronary bypass graft surgery in a Brazilian population. Rev Bras Cir Cardiovasc. 2014;29(1):51-8
• ²²
  Cadore MP, Guaragna JC, Anacker JF, Albuquerque LC, Bodanese LC, Piccoli JC, et al. Proposição de um escore de risco cirúrgico em pacientes submetidos à cirurgia de revascularização miocárdica. Rev Bras Cir Cardiovasc. 2010;25(4):447-56.
• ²³
  Gomes WJ, Mendonça JT, Braile DM. Cardiovascular surgery outcomes opportunity to rediscuss medical and cardiological care in the Brazilian public health system. Rev Bras Cir Cardiovasc. 2007;22(4):III-VI.
• ²⁴
  Ancona C, Agabiti N, Forastiere F, Arca M, Fusco D, Ferro S, et al. Coronary artery bypass graft surgery: socioeconomic inequalities in access and in 30 day mortality. A population-based study in Rome, Italy. J Epidemiol Community Health. 2000;54(12):930-5.
• ²⁵
  Piegas LS, Bittar OJ, Haddad N. Myocardial revascularization surgery (MRS): results from national health system (SUS). Arq Bras Cardiol. 2009;93(5):555-60.
• ²⁶
  Chalmers J, Pullan M, Fabri B, McShane J, Shaw M, Mediratta N, et al. Validation of EuroSCORE II in a modern cohort of patients undergoing cardiac surgery. Eur J Cardiothorac Surg. 2013;43(4):688-94.
• ²⁷
  Carnero-Alcázar M, Silva Guisasola JA, Reguillo Lacruz FJ, Maroto Castellanos LC, Cobiella Carnicer J, Villagrán Medinilla E, et al. Validation of EuroSCORE II on a single-center 3800 patient cohort. Interact Cardiovasc Thorac Surg. 2013;16(3):293-300.
• ²⁸
  Kunt AG, Kurtcephe M, Hidiroglu M, Cetin L, Kucuker A, Bakuy V, et al. Comparison of original EuroSCORE, EuroSCORE II and STS risk models in a Turkish cardiac surgical cohort. Interact Cardiovasc Thorac Surg. 2013;16(5):625-9.

Publication Dates

• Publication in this collection
  25 Aug 2015
• Date of issue
  Nov 2015

History

• Received
  30 Oct 2014
• Reviewed
  14 Feb 2015
• Accepted
  19 Feb 2015