Acessibilidade / Reportar erro

Dynamic Changes in Perioperative Cellular Inflammation and Acute Kidney Injury after Coronary Artery Bypass Grafting

Abstract

Introduction:

This study investigated the role of the neutrophil-lymphocyte ratio (NLR), the perioperative changes in NLR (delta-NLR), the platelet-lymphocyte ratio (PLR), and the platelet count in predicting acute kidney injury (AKI) following coronary artery bypass grafting (CABG) during hospital stay.

Methods:

The records of 396 patients with preoperative creatinine < 1.5 mg/dl undergoing isolated CABG between October 2015 and October 2019 were reviewed retrospectively. Diagnosis of AKI was based on the Kidney Disease Improving Global Outcomes definition. Demographic data, operative data, in-hospital mortality, preoperative NLR, PLR, and platelet counts were compared between patients with (AKI group) and without (non-AKI group) postoperative AKI. Additionally, NLR, delta-NLR, and PLR values were calculated daily for the first four postoperative days. A “subsequent AKI group” was formed for the first four postoperative days by excluding patients diagnosed with AKI. The daily and overall predictivity of the markers for AKI are investigated.

Results:

AKI was present in 86 patients during the postoperative period, while 310 patients had normal postoperative renal functions. NLR, delta-NLR, and PLR on the first four postoperative days (P<0.001 for all) were significantly associated with the development of AKI in subsequent days. Multivariate analysis identified postoperative NLR (odds ratio 1.17, 95% confidence interval 1.11-1.23; P<0.001) as an independent predictor of AKI. PLR lost its significant association with AKI at the values measured at discharge from hospital (P>0.05).

Conclusion:

NLR values measured on the first four days postoperatively are a useful tool in predicting AKI during hospital stay following CABG.

Keywords:
Coronary Artery Bypass; Acute Kidney Injury; Neutrophils; Lymphocytes; Platelet Count; Length of Stay; Patient Discharge.

Abbreviations, acronyms & symbols       AKI = Acute kidney injury   KDIGO = Kidney Disease Improving Global Outcomes AUC = Area under the curve LDL = Low-density lipoprotein BMI = Body mass index LVEF = Left ventricular ejection fraction BUN = Blood urea nitrogen MI = Myocardial infarction CABG = Coronary artery bypass grafting NLR = Neutrophil-lymphocyte ratio CI = Confidence interval OR = Odds ratio CPB = Cardiopulmonary bypass PLR = Platelet-lymphocyte ratio CRP = C-reactive protein Preop. = Preoperative CVA = Cerebrovascular accident ROC = Receiver operating curve EF = Ejection fraction SD = Standard deviation Hgb = Hemoglobin Sens. = Sensitivity IL = Interleukin Spec. = Specificity

INTRODUCTION

Acute kidney injury (AKI) following cardiac surgery is a common complication which increases costs, morbidity, and mortality, even in cases in which renal failure does not occur11 Kim WH, Park JY, Ok SH, Shin IW, Sohn JT. Association between the neutrophil/lymphocyte ratio and acute kidney injury after cardiovascular surgery: a retrospective observational study. Medicine (Baltimore). 2015;94(43):e1867. doi:10.1097/MD.0000000000001867.
https://doi.org/10.1097/MD.0000000000001...
,22 Parlar H, Saskin H. Are pre and postoperative platelet to lymphocyte ratio and neutrophil to lymphocyte ratio associated with early postoperative AKI following CABG? Braz J Cardiovasc Surg. 2018;33(3):233-41. doi:10.21470/1678-9741-2017-0164.
https://doi.org/10.21470/1678-9741-2017-...
. The reported incidence of AKI following cardiac surgery is 5-30%, and cardiac surgery is the second most common cause of AKI in intensive care units33 Takaki S, Shehabi Y, Pickering JW, Endre Z, Miyashita T, Goto T. Perioperative change in creatinine following cardiac surgery with cardiopulmonary bypass is useful in predicting acute kidney injury: a single-centre retrospective cohort study. Interact Cardiovasc Thorac Surg. 2015;21(4):465-9. doi:10.1093/icvts/ivv184.
https://doi.org/10.1093/icvts/ivv184...
,44 Harky A, Joshi M, Gupta S, Teoh WY, Gatta F, Snosi M. Acute kidney injury associated with cardiac surgery: a comprehensive literature review. Braz J Cardiovasc Surg. 2020;35(2):211-24. doi:10.21470/1678-9741-2019-0122.
https://doi.org/10.21470/1678-9741-2019-...
. The exact pathogenesis of post-cardiac surgery AKI is unclear. However, multiple factors, including systemic inflammation that may occur in the preoperative, intraoperative, and postoperative periods, will result in postoperative renal injury55 Gaffney AM, Sladen RN. Acute kidney injury in cardiac surgery. Curr Opin Anaesthesiol. 2015;28(1):50-9. doi:10.1097/ACO.0000000000000154.
https://doi.org/10.1097/ACO.000000000000...
. The early diagnosis of AKI can serve as a guide to treatment and improve prognosis. Neutrophil-lymphocyte ratio (NLR) and platelet-lymphocyte ratio (PLR) measured before surgery have been identified as simple markers for predicting AKI following cardiac surgery22 Parlar H, Saskin H. Are pre and postoperative platelet to lymphocyte ratio and neutrophil to lymphocyte ratio associated with early postoperative AKI following CABG? Braz J Cardiovasc Surg. 2018;33(3):233-41. doi:10.21470/1678-9741-2017-0164.
https://doi.org/10.21470/1678-9741-2017-...
,66 Gameiro J, Lopes JA. Complete blood count in acute kidney injury prediction: a narrative review. Ann Intensive Care. 2019;9(1):87. doi:10.1186/s13613-019-0561-4.
https://doi.org/10.1186/s13613-019-0561-...
,77 Chen D, Xiao D, Guo J, Chahan B, Wang Z. Neutrophil-lymphocyte count ratio as a diagnostic marker for acute kidney injury: a systematic review and meta-analysis. Clin Exp Nephrol. 2020;24(2):126-35. doi:10.1007/s10157-019-01800-y.
https://doi.org/10.1007/s10157-019-01800...
. Urea or creatinine values measured in the first 48-72 hours after cardiac surgery are insufficient for demonstrating kidney damage44 Harky A, Joshi M, Gupta S, Teoh WY, Gatta F, Snosi M. Acute kidney injury associated with cardiac surgery: a comprehensive literature review. Braz J Cardiovasc Surg. 2020;35(2):211-24. doi:10.21470/1678-9741-2019-0122.
https://doi.org/10.21470/1678-9741-2019-...
,88 Koyner JL. Role of Biomarkers in Predicting AKI in the CT ICU. Difficult Decisions in Cardiothoracic Critical Care Surgery: Springer; 2019. p. 525-45.. Therefore, a reliable predictor of AKI is needed in the first few postoperative days.

An increase in neutrophil numbers and a decrease in lymphocyte and platelet counts occur immediately following cardiac surgery, and it may take months for all blood parameters to fully recover99 Lako S, Dedej T, Nurka T, Ostreni V, Demiraj A, Xhaxho R, et al. Hematological changes in patients undergoing coronary artery bypass surgery: a prospective study. Med Arch. 2015;69(3):181-6. doi:10.5455/medarh.2015.69.181-186.
https://doi.org/10.5455/medarh.2015.69.1...
. These dynamic changes are attributed to systemic inflammation, which is also a risk factor for AKI. The changes in NLR in the early postoperative period from preoperative values (delta-NLR) are reported to be a prognostic factor in predicting outcomes of surgery in cases of malignancy due to their association with systemic inflammation1010 Seong YW, Han SJ, Jung W, Jeon JH, Cho S, Jheon S, et al. Perioperative change in neutrophil-to-lymphocyte ratio (NLR) is a prognostic factor in patients with completely resected primary pulmonary sarcomatoid carcinoma. J Thorac Dis. 2019;11(3):819-26. doi:10.21037/jtd.2019.02.02.
https://doi.org/10.21037/jtd.2019.02.02...

11 Li Z, Zhao R, Cui Y, Zhou Y, Wu X. The dynamic change of neutrophil to lymphocyte ratio can predict clinical outcome in stage I-III colon cancer. Sci Rep. 2018;8(1):9453. doi:10.1038/s41598-018-27896-y.
https://doi.org/10.1038/s41598-018-27896...
-1212 Guo D, Han A, Jing W, Chen D, Jin F, Li M, et al. Preoperative to postoperative change in neutrophil-to-lymphocyte ratio predict survival in colorectal cancer patients. Future Oncol. 2018;14(12):1187-96. doi:10.2217/fon-2017-0659.
https://doi.org/10.2217/fon-2017-0659...
. Earlier studies revealed an association between baseline and postoperative hematological indices and postoperative adverse outcomes, rather than the effect of acute changes in these parameters. The relationship between AKI and the delta-NLR in patients undergoing isolated coronary artery bypass grafting (CABG) has not been studied to date.

The fall of platelet count was related with development of AKI following CABG1313 Kertai MD, Zhou S, Karhausen JA, Cooter M, Jooste E, Li YJ, et al. Platelet counts, acute kidney injury, and mortality after coronary artery bypass grafting surgery. Anesthesiology. 2016;124(2):339-52. doi:10.1097/ALN.0000000000000959.
https://doi.org/10.1097/ALN.000000000000...
. Paradoxically, higher PLR values on postoperative day one were also found to be related with AKI22 Parlar H, Saskin H. Are pre and postoperative platelet to lymphocyte ratio and neutrophil to lymphocyte ratio associated with early postoperative AKI following CABG? Braz J Cardiovasc Surg. 2018;33(3):233-41. doi:10.21470/1678-9741-2017-0164.
https://doi.org/10.21470/1678-9741-2017-...
. This caused suspicion about the predictive power of PLR in the postoperative days of CABG.

The aim of this study was to investigate the relationships between NLR, PLR, delta-NLR, platelet counts, and AKI during hospital stay of patients undergoing isolated CABG.

METHODS

Study Population

Approval for this study was granted by the local ethical committee, and all procedures were conducted in accordance with the principles set out in the Declaration of Helsinki. The medical records of 631 patients undergoing CABG between October 2015 and October 2019 were reviewed retrospectively.

Patients with low hemoglobin (Hgb) levels (≤ 10 g/dL), renal impairment (serum creatinine levels > 1.5 mg/dl or patients on dialysis), with active infection or active or chronic autoimmune disease, taking steroids or chemotherapeutic drugs, with moderate or severe valvular heart disease, scheduled for concomitant surgery, in a critical preoperative condition (requiring inotropic drug support or intra-aortic balloon pumping), with a left ventricular ejection fraction (LVEF) ≤ 30%, requiring respiratory support, individuals who were reoperated because of hemodynamic instability or bleeding, patients who were operated on a beating heart, and patients undergoing repeat CABG were excluded. Three hundred ninety-six patients aged between 38 and 79 years and who underwent isolated CABG with cardiopulmonary bypass (CPB) were finally enrolled. Patients’ demographic and clinical data were retrieved from the electronic hospital records and archives.

Definitions

Characteristics such as age, gender, smoking history, diabetes, hypertension, hyperlipidemia, LVEF, pre- and postoperative laboratory parameters (Hgb levels, and leukocyte, neutrophil, lymphocyte, and platelet counts), serum creatinine, blood urea nitrogen (BUN), albumin, operative findings including duration of CPB and aortic cross-clamping, number of revascularized vessels, and in-hospital mortality were recorded. Hypertension was defined as blood pressure ≥ 140/90 mmHg or antihypertensive drug use, while smoking status was defined as positive if the individual concerned had not quit for at least the previous year. Diabetes was defined as a fasting blood glucose value ≥ 126 mg/dl or the use of antidiabetic medications, while hyperlipidemia was defined as a total cholesterol level > 220 mg/dl and low-density lipoprotein-cholesterol > 130 mg/dl or receipt of antihyperlipidemic drugs. Distal anastomoses were grouped as 1-3 and > 3 in number.

Diagnosis of AKI was based on the Kidney Disease Improving Global Outcomes (KDIGO) definition (serum creatinine rising by ≥ 0.3 mg/dl within 48 hours of surgery or rising to ≥ 1.5 times baseline values, or renal replacement therapy being required). Baseline serum creatinine was defined as the final concentration measured in the last week before surgery, while postoperative serum creatinine levels were measured daily following surgery88 Koyner JL. Role of Biomarkers in Predicting AKI in the CT ICU. Difficult Decisions in Cardiothoracic Critical Care Surgery: Springer; 2019. p. 525-45.. Urine output was not employed since this can be affected by diuretics and/or intravenous fluids administered during and after surgery22 Parlar H, Saskin H. Are pre and postoperative platelet to lymphocyte ratio and neutrophil to lymphocyte ratio associated with early postoperative AKI following CABG? Braz J Cardiovasc Surg. 2018;33(3):233-41. doi:10.21470/1678-9741-2017-0164.
https://doi.org/10.21470/1678-9741-2017-...
,88 Koyner JL. Role of Biomarkers in Predicting AKI in the CT ICU. Difficult Decisions in Cardiothoracic Critical Care Surgery: Springer; 2019. p. 525-45.. Patients who developed AKI following surgery during hospital stay were classified as the AKI group, and the day when AKI developed was noted. Those with normal postoperative renal functions were classified as the non-AKI group.

NLR and PLR values were first calculated. In order to show dynamic changes in NLR, delta-NLR was calculated by subtracting the preoperative NLR from the postoperative NLR (postoperative NLR-preoperative NLR)1010 Seong YW, Han SJ, Jung W, Jeon JH, Cho S, Jheon S, et al. Perioperative change in neutrophil-to-lymphocyte ratio (NLR) is a prognostic factor in patients with completely resected primary pulmonary sarcomatoid carcinoma. J Thorac Dis. 2019;11(3):819-26. doi:10.21037/jtd.2019.02.02.
https://doi.org/10.21037/jtd.2019.02.02...
. In order to analyze the daily predictivity of the parameters for the development of AKI in the first four postoperative days, patients who were diagnosed with AKI on or before the studied day were excluded from the AKI group and the “subsequent AKI group” was formed for postoperative days one, two, three, and four. The leukocyte, neutrophil, lymphocyte, platelet counts, NLR, delta-NLR, and PLR values were compared for every day between the “subsequent AKI group” and the “non-AKI group”. Additionally, to investigate the predictive value of the postoperative parameters for the occurrence of AKI, the method used by Kertai et al.1313 Kertai MD, Zhou S, Karhausen JA, Cooter M, Jooste E, Li YJ, et al. Platelet counts, acute kidney injury, and mortality after coronary artery bypass grafting surgery. Anesthesiology. 2016;124(2):339-52. doi:10.1097/ALN.0000000000000959.
https://doi.org/10.1097/ALN.000000000000...
was applied by calculating the nadir platelet and peak NLR, delta-NLR, and PLR values from the results obtained on the first four postoperative days. The minimum (nadir) platelet count was defined as the lowest in-hospital value measured in the first four postoperative days. Similarly, the maximum NLR, delta-NLR, and PLR values in the first four postoperative days were defined as peak NLR, delta-NLR or PLR. Patients preoperative demographic characteristics, laboratory parameters, and preoperative NLR, PLR, peak NLR, peak PLR, and nadir platelet values are compared between AKI and non-AKI groups.

The leukocyte, neutrophil, lymphocyte, platelet counts, NLR, delta-NLR, and PLR values were calculated for the first, second, third, and fourth postoperative days (NLR 1, 2, 3, and 4, delta-NLR 1, 2, 3, and 4, PLR 1, 2, 3, and 4) and on the day of discharge from hospital. Approximately 5 to 7 ml of venous blood samples were added to a sterile tube with ethylenediaminetetraacetic acid. An automated blood count device (Abbott CELL-DYN 3700; Abbott Laboratory, Abbott Park, Illinois, United States of America) was employed to calculate hematological parameters following a one-hour waiting period.

Operative Technique

All procedures were performed by the same surgical team. Following induction of general anesthesia, median sternotomy was performed, and left internal thoracic artery and saphenous venous grafts were prepared. Following systemic heparin administration (300 IU/kg), aortic and venous cannulations were performed and CPB was instituted. The activated clotting time was maintained over 450 seconds during the procedures, moderate hypothermia (28-32 °C) is used. CPB flow was maintained at 2.2-2.5 l/min/m2, and mean blood pressure was held at between 50 and 80 mmHg. Hematocrit levels of 20-25% were maintained during CPB. Cross-clamping was applied to the ascending aorta, followed by antegrade hypothermic and hyperkalemic blood cardioplegia. Distal anastomoses were performed during aortic cross-clamping, while proximal anastomoses were performed on beating heart over the ascending aorta with a lateral clamp.

After surgery, all patients were moved to the intensive care unit. Patients were extubated following the restoration of normal orientation and cooperation if their hemodynamic and respiratory functions were recovered. If no contraindication was determined, all patients were started on 50 mg/day oral metoprolol after the first postoperative day.

Statistics

Statistical analysis was performed on IBM Corp. Released 2013, IBM SPSS Statistics for Windows, Version 22.0, Armonk, NY: IBM Corp. Data exhibiting normal distribution were expressed as mean ± standard deviation, and those without normal distribution as median values (minimum-maximum). Data obtained by counting were expressed as percentages (%). Normality of distribution was assessed using a histogram or the Kolmogorov-Smirnov test, while homogeneity of distribution was assessed using Levene’s test for equality of variance. Intergroup comparisons were performed using Student’s t-test in the event of normal and homogenous distribution, or with the Mann-Whitney U test if distribution was not normal and homogeneous. Differences between the groups were evaluated by parametric or non-parametric Pearson’s Chi-Square test or Fisher’s exact test, depending on whether or not the distribution was parametric. The effects of the preoperative risk factors thought to affect the development of AKI (including peak NLR, delta-NLR, PLR, and nadir platelet counts) were investigated using univariate logistic regression analysis. The multiple effects of the risk factors identified as being effective or possibly effective in the prediction of AKI at univariate statistical analysis were then investigated using multivariate logistic regression analysis. The development of AKI on subsequent days was investigated using univariate regression analysis in terms of NLR, delta-NLR, and PLR on the first, second, third, and fourth postoperative days. Odds ratio, 95% confidence interval, and level of significance were determined for each risk factor. P-values < 0.05 were regarded as statistically significant. Receiver operating curve (ROC) analysis was used to compute the sensitivity and the specificity of preoperative NLR, PLR, peak NLR, peak delta-NLR, and peak PLR in predicting in-hospital AKI. The sensitivity and specificity of NLR, delta-NLR, and PLR in the first, second, third, and fourth postoperative days to predict AKI on the subsequent days were computed using ROC analysis.

Results were considered statistically significant at P<0.05.

RESULTS

Three hundred ninety-six patients (mean age 62.2±9 years, 78.7% men) were included into the study. Mean hospitalization time was 7.27±1.73 days. AKI, diagnosed based on the KDIGO classification, was present in 86 patients (Group 1, AKI 22%), while 310 patients had normal postoperative renal functions (Group 2, non-AKI, 78%). Seventeen patients were diagnosed with AKI on postoperative day one. Sixty-nine patients developed AKI after postoperative day one, 21 after day two, nine after day three, and four after day four, and these patients’ values were used to analyze development of subsequent AKI for any specific postoperative day. None of these patients required renal replacement therapy. Demographic characteristics and preoperative results and operative data are summarized in Table 1. Age (P=0.014), preoperative creatinine (P<0.001), BUN (P=0.002), albumin (P=0.016), lymphocyte count (P<0.001), preoperative NLR (P<0.001), and preoperative PLR (P<0.001) levels differed significantly between the groups.

Table 1
Demographics, preoperative laboratory results, NLR and PLR values, and operative data.

Comparisons of the subsequent AKI group with the non-AKI group revealed significantly higher leukocyte counts on postoperative days two, three, and four (P<0.001 all), significantly higher neutrophil counts on postoperative days one, two, three, and four (P=0.008, P<0.001, P<0.001, and P<0.001, respectively), significantly lower lymphocyte counts on postoperative days one, two, and three (P<0.001, P<0.001, and P=0.001, respectively), and significantly lower platelet counts on postoperative days one, two, three, and four (P<0.001, P<0.001, P<0.001, and P=0.006, respectively). NLR, delta-NLR, and PLR values on postoperative days one, two, three, and four were significantly higher (P<0.001, P<0.001, P<0.001, and P=0.001, respectively; all) in the subsequent AKI group. This indicates that the profile of cellular inflammation changes in the first four postoperative days, and that an increase in NLR, delta-NLR, and PLR values occurs at least one day prior to diagnosis of AKI (Table 2).

Peak NLR and peak PLR values on the first four postoperative days were significantly higher (P<0.001 for both) among patients who developed AKI compared to the non-AKI group. Nadir platelet counts were significantly lower (P=0.001) among patients who developed AKI (Table 2).

Table 2
Hematological parameters for the prediction of AKI for each postoperative day.

Leukocyte, neutrophil, lymphocyte, and platelet counts, and NLR, delta-NLR, and PLR values on the day of discharge were compared among patients with and without occurrence of AKI during their hospital stays. The relations between leukocyte count and PLR values and the presence of AKI had lost their significance by the day of discharge from hospital (Table 3).

Table 3
The relation between the parameters and AKI at the day of discharge.

Multivariate analysis of those variables found to be statistically significant at univariate analysis identified preoperative creatinine (P=0.001), preoperative albumin (P=0.03), preoperative leukocyte (P=0.018), preoperative NLR (P=0.007), and postoperative peak NLR (P<0.001) as independent predictors of postoperative AKI (Table 4).

Table 4
Univariate and multivariate regression analyses of risk factors for postoperative AKI.

Univariate analysis results for NLR, delta-NLR, and PLR values on postoperative days one, two, three, and four in terms of prediction of subsequent AKI for each postoperative day are summarized in Table 5.

Table 5
Univariate regression analyses of the hematological indices for the prediction of AKI for each postoperative day.

ROC curves were calculated to analyze the predictivity of preoperative NLR and PLR (Figure 1). Also, ROC curves were calculated for NLR, delta-NLR, and PLR on postoperative days one and two to determine their predictivity of AKI on subsequent days (Figure 2).

Fig. 1
Receiver operating curve analysis for preoperative (preop.) neutrophil-lymphocyte ratio (NLR), delta-NLR, and plateletlymphocyte ratio (PLR) values regarding occurrence of postoperative acute kidney injury during hospital stay.

AUC=area under the curve; CI=confidence interval; Sens.=sensitivity; Spec.=specificity


Fig. 2
Receiver operating curve analysis for postoperative neutrophil-lymphocyte ratio (NLR), delta(Δ)-NLR, and platelet-lymphocyte ratio (PLR) values for postoperative days one and two, regarding occurrence of acute kidney injury on the subsequent days of hospital stay. AUC=area under the curve; CI=confidence interval; Sens.=sensitivity; Spec.=specificity

ROC curve analysis results for NLR 3, delta-NLR 3, PLR 3, NLR 4, delta-NLR 4, and PLR 4 in terms of prediction of AKI on subsequent days are summarized in Table 6. The results of ROC curve analysis in predicting postoperative AKI for peak NLR, peak delta-NLR, and peak PLR are shown in Figure 3.

Fig. 3
Receiver operating curve analysis of the peak neutrophil-lymphocyte ratio (NLR), peak delta(Δ)-NLR, and nadir platelet-lymphocyte ratio (PLR) values for the first four postoperative days regarding the occurrence of postoperative acute kidney injury during hospital stay. AUC=area under the curve; CI=confidence interval; Sens.=sensitivity; Spec.=specificity

DISCUSSION

This study shows the value of NLR, delta-NLR, and PLR measured on the first four days after CABG in terms of prediction of in-hospital AKI on subsequent days. Postoperative NLR values on the first four days following CABG emerged as the most reliable and independent predictors of in-hospital AKI.

The pathophysiology of AKI following cardiac surgery is multifactorial and includes inflammation, ischemia-reperfusion injury, operative trauma, blood exposed to the artificial surface of the CPB circuit, neurohormonal activation, metabolic factors, and oxidative stress33 Takaki S, Shehabi Y, Pickering JW, Endre Z, Miyashita T, Goto T. Perioperative change in creatinine following cardiac surgery with cardiopulmonary bypass is useful in predicting acute kidney injury: a single-centre retrospective cohort study. Interact Cardiovasc Thorac Surg. 2015;21(4):465-9. doi:10.1093/icvts/ivv184.
https://doi.org/10.1093/icvts/ivv184...
,44 Harky A, Joshi M, Gupta S, Teoh WY, Gatta F, Snosi M. Acute kidney injury associated with cardiac surgery: a comprehensive literature review. Braz J Cardiovasc Surg. 2020;35(2):211-24. doi:10.21470/1678-9741-2019-0122.
https://doi.org/10.21470/1678-9741-2019-...
,1414 Kramer RS, Herron CR, Groom RC, Brown JR. Acute kidney injury subsequent to cardiac surgery. J Extra Corpor Technol. 2015;47(1):16-28.. Neutrophil activation plays a crucial role in the initiation and progression of inflammation and is implicated in reperfusion injury, and CPB itself is associated with neutrophil activation and an augmented neutrophil count99 Lako S, Dedej T, Nurka T, Ostreni V, Demiraj A, Xhaxho R, et al. Hematological changes in patients undergoing coronary artery bypass surgery: a prospective study. Med Arch. 2015;69(3):181-6. doi:10.5455/medarh.2015.69.181-186.
https://doi.org/10.5455/medarh.2015.69.1...
,1515 Gibson PH, Croal BL, Cuthbertson BH, Small GR, Ifezulike AI, Gibson G, et al. Preoperative neutrophil-lymphocyte ratio and outcome from coronary artery bypass grafting. Am Heart J. 2007;154(5):995-1002. doi:10.1016/j.ahj.2007.06.043.
https://doi.org/10.1016/j.ahj.2007.06.04...
. Neutrophils play a limited role in atherogenesis, but lymphocytes are involved in the development and progression of atherosclerosis and are inversely associated with inflammation. A reduced lymphocyte count reflects physiological stress, and an increased cardiovascular risk and mortality1515 Gibson PH, Croal BL, Cuthbertson BH, Small GR, Ifezulike AI, Gibson G, et al. Preoperative neutrophil-lymphocyte ratio and outcome from coronary artery bypass grafting. Am Heart J. 2007;154(5):995-1002. doi:10.1016/j.ahj.2007.06.043.
https://doi.org/10.1016/j.ahj.2007.06.04...
,1616 Kurtul A, Ornek E. Platelet to lymphocyte ratio in cardiovascular diseases: a systematic review. Angiology. 2019;70(9):802-18. doi:10.1177/0003319719845186.
https://doi.org/10.1177/0003319719845186...
. CPB-induced inflammation increases average neutrophil values, which rapidly reach their peak on the second day after surgery, while lymphocytes decrease and achieve their lowest value on the first day after surgery99 Lako S, Dedej T, Nurka T, Ostreni V, Demiraj A, Xhaxho R, et al. Hematological changes in patients undergoing coronary artery bypass surgery: a prospective study. Med Arch. 2015;69(3):181-6. doi:10.5455/medarh.2015.69.181-186.
https://doi.org/10.5455/medarh.2015.69.1...
. Thrombocytosis is an important factor in the pathophysiology of atherosclerosis, and a reduction in platelet counts is observed following CPB1515 Gibson PH, Croal BL, Cuthbertson BH, Small GR, Ifezulike AI, Gibson G, et al. Preoperative neutrophil-lymphocyte ratio and outcome from coronary artery bypass grafting. Am Heart J. 2007;154(5):995-1002. doi:10.1016/j.ahj.2007.06.043.
https://doi.org/10.1016/j.ahj.2007.06.04...
,1616 Kurtul A, Ornek E. Platelet to lymphocyte ratio in cardiovascular diseases: a systematic review. Angiology. 2019;70(9):802-18. doi:10.1177/0003319719845186.
https://doi.org/10.1177/0003319719845186...
. NLR and PLR are easily available, inexpensive markers and are positively correlated with such inflammatory markers as tumor necrosis factor-α and interleukin (IL)-61717 Turkmen K, Erdur FM, Ozcicek F, Ozcicek A, Akbas EM, Ozbicer A, et al. Platelet-to-lymphocyte ratio better predicts inflammation than neutrophil-to-lymphocyte ratio in end-stage renal disease patients. Hemodial Int. 2013;17(3):391-6. doi:10.1111/hdi.12040.
https://doi.org/10.1111/hdi.12040...
.

NLR and PLR values measured at the preoperative period have been reported to predict AKI following cardiac surgery11 Kim WH, Park JY, Ok SH, Shin IW, Sohn JT. Association between the neutrophil/lymphocyte ratio and acute kidney injury after cardiovascular surgery: a retrospective observational study. Medicine (Baltimore). 2015;94(43):e1867. doi:10.1097/MD.0000000000001867.
https://doi.org/10.1097/MD.0000000000001...
,22 Parlar H, Saskin H. Are pre and postoperative platelet to lymphocyte ratio and neutrophil to lymphocyte ratio associated with early postoperative AKI following CABG? Braz J Cardiovasc Surg. 2018;33(3):233-41. doi:10.21470/1678-9741-2017-0164.
https://doi.org/10.21470/1678-9741-2017-...
The present study provides additional evidence that postoperative AKI is associated with elevated preoperative NLR and PLR values. One meta-analysis investigating NLR for the prediction of AKI estimated an area under the curve (AUC) of 0.65 in a cardiac surgery subgroup77 Chen D, Xiao D, Guo J, Chahan B, Wang Z. Neutrophil-lymphocyte count ratio as a diagnostic marker for acute kidney injury: a systematic review and meta-analysis. Clin Exp Nephrol. 2020;24(2):126-35. doi:10.1007/s10157-019-01800-y.
https://doi.org/10.1007/s10157-019-01800...
. Similarly, a cutoff value of 2.65 (sensitivity 66.1%, specificity 64.7%) with an AUC of 0.69 has been reported for the predictivity of preoperative NLR22 Parlar H, Saskin H. Are pre and postoperative platelet to lymphocyte ratio and neutrophil to lymphocyte ratio associated with early postoperative AKI following CABG? Braz J Cardiovasc Surg. 2018;33(3):233-41. doi:10.21470/1678-9741-2017-0164.
https://doi.org/10.21470/1678-9741-2017-...
.

In the present study, ROC analysis yielded a similar result for preoperative NLR (AUC: 0.67) with a similar cutoff value of 2.51 (65% sensitivity, 61%specificity) (Figure 1). Additionally, preoperative NLR emerged as an independent predictor of postoperative AKI (Table 4).

Increased NLR can be related to the complexity of atherosclerosis or lower creatinine clearance levels, as previously reported. Preoperative NLR has been identified as a predictor for mortality and cardiovascular events following CABG1515 Gibson PH, Croal BL, Cuthbertson BH, Small GR, Ifezulike AI, Gibson G, et al. Preoperative neutrophil-lymphocyte ratio and outcome from coronary artery bypass grafting. Am Heart J. 2007;154(5):995-1002. doi:10.1016/j.ahj.2007.06.043.
https://doi.org/10.1016/j.ahj.2007.06.04...
,1818 Gurbuz O, Kumtepe G, Ozkan H, Karal IH, Velioglu Y, Ercan A, et al. Predictive value of neutrophil-lymphocyte ratio for long-term cardiovascular event following coronary artery bypass grafting. Braz J Cardiovasc Surg. 2020;35(3):274-84. doi:10.21470/1678-9741-2018-0362.
https://doi.org/10.21470/1678-9741-2018-...
. However, the body is subject to an emerging postoperative inflammatory response as well as to the existing inflammatory burden of the preoperative period.

The postoperative NLR, delta-NLR, and PLR values were analyzed for their daily predictivity as well as the predictivity of their peak values. The later AKI developed, the higher were the NLR, delta-NLR, and PLR values prior to development of AKI (Table 2). These results suggest that a greater inflammatory response is triggered in patients who will develop AKI in later days after surgery. NLR and delta-NLR were significant for all four postoperative days at univariate logistic regression analysis (P<0.001 all). Meanwhile, the significance of P-values of PLR in predicting AKI diminished during the first four days (P<0.001, P<0.001, P=0.037, P=0.041, respectively) (Table 5). Daily postoperative NLR exhibited the highest predictivity for postoperative AKI at univariate analysis and ROC analysis (Table 5, Table 6, and Figure 2). In ROC analysis of daily NLR, delta-NLR, and PLR values for the occurrence of AKI, the AUC values augmented with the advance of days (Table 6). These values show that a high risk of AKI exists in patients with high cellular inflammation levels after the second day of surgery. However, the number of patients developing AKI after the third and fourth days were decreased (nine and four, respectively), this might have affected the very high AUC, sensitivity, and specificity of the measured parameters.

The peak NLR, delta-NLR, and PLR as well as nadir platelet counts of the first four postoperative days were compared in terms of the occurrence of AKI until discharge from hospital. Peak NLR emerged as an independent predictor of AKI (Table 4). ROC analysis revealed the highest AUC for NLR, a cutoff value of 19.5 exhibiting 80% sensitivity and 81% specificity. This threshold could be used to predict overall risk of AKI in the first four postoperative days.

Delta-NLR is used to demonstrate the dynamic change in NLR from its initial values to post-treatment values. This new marker is directly related to the effect of the treatment applied. The relationship between inflammation and delta-NLR has previously been studied in other surgical patient groups1010 Seong YW, Han SJ, Jung W, Jeon JH, Cho S, Jheon S, et al. Perioperative change in neutrophil-to-lymphocyte ratio (NLR) is a prognostic factor in patients with completely resected primary pulmonary sarcomatoid carcinoma. J Thorac Dis. 2019;11(3):819-26. doi:10.21037/jtd.2019.02.02.
https://doi.org/10.21037/jtd.2019.02.02...

11 Li Z, Zhao R, Cui Y, Zhou Y, Wu X. The dynamic change of neutrophil to lymphocyte ratio can predict clinical outcome in stage I-III colon cancer. Sci Rep. 2018;8(1):9453. doi:10.1038/s41598-018-27896-y.
https://doi.org/10.1038/s41598-018-27896...
-1212 Guo D, Han A, Jing W, Chen D, Jin F, Li M, et al. Preoperative to postoperative change in neutrophil-to-lymphocyte ratio predict survival in colorectal cancer patients. Future Oncol. 2018;14(12):1187-96. doi:10.2217/fon-2017-0659.
https://doi.org/10.2217/fon-2017-0659...
. This study shows that delta-NLR is strongly related with AKI and delta-NLR values were significantly augmented prior the development of AKI. However, NLR values were superior to delta-NLR in predicting AKI as an independent predictor following CABG.

Surgery triggered an inflammatory response among all patients, which was measured with augmented postoperative NLR values comparing to preoperative baseline values (Table 1 vs. Table 2). By considering the NLR and delta-NLR values of patients who developed AKI during the postoperative days, the measured values were augmented for every day. The NLR and delta-NLR values obtained in the later days of the postoperative course as well as calculated cutoff values were higher than in the previous days. These results show that other factors than surgery alone might be involved in the development of AKI with the ongoing days. Additionally, in patients who did not developed AKI, the NLR and delta-NLR values decreased constantly with the course of time (Table 2, Table 6, and Figure 2). The difference in the parameters of cellular inflammation among patients with and without AKI cannot be attributed to the operation itself, since the CPB and cross-clamping times were similar among the groups. It was due to the augmented response of the body.

Platelet counts have previously been analyzed in order to evaluate their predictivity for the development of AKI following CABG, using nadir platelet counts1313 Kertai MD, Zhou S, Karhausen JA, Cooter M, Jooste E, Li YJ, et al. Platelet counts, acute kidney injury, and mortality after coronary artery bypass grafting surgery. Anesthesiology. 2016;124(2):339-52. doi:10.1097/ALN.0000000000000959.
https://doi.org/10.1097/ALN.000000000000...
. Fall in platelet counts was also associated with AKI in the present study. However, platelet counts were not superior to NLR in terms of prediction of AKI based on AUC in the ROC (Table 4 and Figure 3).

While preoperative platelet counts were higher in patients with AKI, this was not statistically significant (Table 1). In contrast, as reported previously, platelet counts decreased progressively during the first four postoperative days and were significantly lower prior to the development of AKI compared to the non-AKI patients99 Lako S, Dedej T, Nurka T, Ostreni V, Demiraj A, Xhaxho R, et al. Hematological changes in patients undergoing coronary artery bypass surgery: a prospective study. Med Arch. 2015;69(3):181-6. doi:10.5455/medarh.2015.69.181-186.
https://doi.org/10.5455/medarh.2015.69.1...
. Additionally, platelet counts were significantly lower in patients with AKI on the day of discharge in accordance with previous reports1313 Kertai MD, Zhou S, Karhausen JA, Cooter M, Jooste E, Li YJ, et al. Platelet counts, acute kidney injury, and mortality after coronary artery bypass grafting surgery. Anesthesiology. 2016;124(2):339-52. doi:10.1097/ALN.0000000000000959.
https://doi.org/10.1097/ALN.000000000000...
.

PLR values measured at the preoperative period and on the postoperative day one have been reported to predict AKI following cardiac surgery22 Parlar H, Saskin H. Are pre and postoperative platelet to lymphocyte ratio and neutrophil to lymphocyte ratio associated with early postoperative AKI following CABG? Braz J Cardiovasc Surg. 2018;33(3):233-41. doi:10.21470/1678-9741-2017-0164.
https://doi.org/10.21470/1678-9741-2017-...
. Concerns about the predictivity of PLR as an inflammatory marker following CABG exist due to an expected fall in platelet levels following surgery1919 Engin M. Are pre and postoperative platelet to lymphocyte ratio and neutrophil to lymphocyte ratio associated with early postoperative AKI following CABG? Braz J Cardiovasc Surg. 2020;35(2):239. doi:10.21470/1678-9741-2019-0482.
https://doi.org/10.21470/1678-9741-2019-...
. Additionally, an increased risk for AKI has been reported with a decrease in platelet counts1313 Kertai MD, Zhou S, Karhausen JA, Cooter M, Jooste E, Li YJ, et al. Platelet counts, acute kidney injury, and mortality after coronary artery bypass grafting surgery. Anesthesiology. 2016;124(2):339-52. doi:10.1097/ALN.0000000000000959.
https://doi.org/10.1097/ALN.000000000000...
. However, due to a greater fall in lymphocyte levels, PLR was correlated with the presence or absence of AKI for each of the first four postoperative days (Table 2). PLR values on the day of discharge from hospital exhibited no association with the occurrence of AKI (Table 3). This shows that PLR values lost their significance beyond the first four days. Additionally, PLR exhibited the lowest AUC at ROC compared with NLR and delta-NLR, which restricts the use of PLR as a predictor of AKI (Table 6 and Figures 1, 2, and 3)

Lymphocyte counts were significantly lower in patients who developed AKI, they reached a nadir on postoperative day two (Table 2). Therefore, the predictive value of PLR 3 and 4 was reduced at univariate analysis (Table 5). Recent results show that PLR has a limited role as a predictor.

AKI is a complex entity, in which various injury mechanisms and injury sites may be present. The prediction of AKI in patients with normal preoperative creatinine values is important for treatment planning and to avoid further complications. Any novel biomarker should be able to show AKI in the first 72 hours after CABG, when creatinine levels are often nondiagnostic for AKI88 Koyner JL. Role of Biomarkers in Predicting AKI in the CT ICU. Difficult Decisions in Cardiothoracic Critical Care Surgery: Springer; 2019. p. 525-45.. Various biomarkers have been proposed for predicting the occurrence and development of AKI in recent years. However, markers such as neutrophil gelatinase-associated lipocalin, cystatin C, IL-18, tissue inhibitor of matrix metalloproteinase-2, and insulin-like growth factor-binding protein 7 are expensive and not available in all hospitals44 Harky A, Joshi M, Gupta S, Teoh WY, Gatta F, Snosi M. Acute kidney injury associated with cardiac surgery: a comprehensive literature review. Braz J Cardiovasc Surg. 2020;35(2):211-24. doi:10.21470/1678-9741-2019-0122.
https://doi.org/10.21470/1678-9741-2019-...
,77 Chen D, Xiao D, Guo J, Chahan B, Wang Z. Neutrophil-lymphocyte count ratio as a diagnostic marker for acute kidney injury: a systematic review and meta-analysis. Clin Exp Nephrol. 2020;24(2):126-35. doi:10.1007/s10157-019-01800-y.
https://doi.org/10.1007/s10157-019-01800...
. NLR is, therefore, a useful tool in the prediction of AKI.

To the best of our knowledge, this is the first study demonstrating the use of dynamic changes in NLR in AKI prediction in patients undergoing CABG.

Limitations

This is a retrospective study of a single center. The study was based on a relatively small sample size, especially the number of patients with AKI after postoperative day two diminished dramatically. The high NLR and PLR values obtained on days four and five may be associated with different postoperative factors either than the surgical stress itself. Due to the retrospective nature of the study, a causal relation could not be drawn. We employed the method used by Kertai et al.1313 Kertai MD, Zhou S, Karhausen JA, Cooter M, Jooste E, Li YJ, et al. Platelet counts, acute kidney injury, and mortality after coronary artery bypass grafting surgery. Anesthesiology. 2016;124(2):339-52. doi:10.1097/ALN.0000000000000959.
https://doi.org/10.1097/ALN.000000000000...
only to assess the relation between the continuous postoperative parameters with postoperative AKI. Instead of choosing a cutoff value for dichromatous analysis as originally described, we performed a ROC analysis to evaluate the predictivity and demonstrate the cutoff values of nadir and peak values as well as daily obtained parameters. We think this method provided a more detailed analysis.

CONCLUSION

Augmented NLR and delta-NLR values were predictive for subsequent development of AKI on each of the first four postoperative days. NLR was the strongest and only independent predictor of in-hospital AKI. PLR lost its significant association with presence of AKI during hospital stay; therefore, we do not recommend its use beyond the first postoperative days. The detection of elevated NLR in the preoperative period as well as in postoperative days should serve as a warning for measures to be taken to treat kidney damage.

Authors' roles & responsibilities HP Substantial contributions to the conception or design of the work; and the acquisition, analysis or interpretation of data for the work; drafted the work or revised it critically for important intellectual content; agree to be accountable for all aspects of the work in ensuring that issues related to the accuracy or integrity of any part of the work are appropriately investigated and resolved; final approval of the version to be published AAA Substantial contributions to the conception or design of the work; and the acquisition, analysis or interpretation of data for the work; drafted the work or revised it critically for important intellectual content; agree to be accountable for all aspects of the work in ensuring that issues related to the accuracy or integrity of any part of the work are appropriately investigated and resolved; final approval of the version to be published AÖ Substantial contributions to the conception or design of the work; and the acquisition, analysis or interpretation of data for the work; drafted the work or revised it critically for important intellectual content; agree to be accountable for all aspects of the work in ensuring that issues related to the accuracy or integrity of any part of the work are appropriately investigated and resolved; final approval of the version to be published
  • 1
    This study was carried out at the Department of Cardiovascular Surgery, Derince Research and Training Hospital, Kocaeli, Turkey.
  • No financial support.

REFERENCES

  • 1
    Kim WH, Park JY, Ok SH, Shin IW, Sohn JT. Association between the neutrophil/lymphocyte ratio and acute kidney injury after cardiovascular surgery: a retrospective observational study. Medicine (Baltimore). 2015;94(43):e1867. doi:10.1097/MD.0000000000001867.
    » https://doi.org/10.1097/MD.0000000000001867
  • 2
    Parlar H, Saskin H. Are pre and postoperative platelet to lymphocyte ratio and neutrophil to lymphocyte ratio associated with early postoperative AKI following CABG? Braz J Cardiovasc Surg. 2018;33(3):233-41. doi:10.21470/1678-9741-2017-0164.
    » https://doi.org/10.21470/1678-9741-2017-0164
  • 3
    Takaki S, Shehabi Y, Pickering JW, Endre Z, Miyashita T, Goto T. Perioperative change in creatinine following cardiac surgery with cardiopulmonary bypass is useful in predicting acute kidney injury: a single-centre retrospective cohort study. Interact Cardiovasc Thorac Surg. 2015;21(4):465-9. doi:10.1093/icvts/ivv184.
    » https://doi.org/10.1093/icvts/ivv184
  • 4
    Harky A, Joshi M, Gupta S, Teoh WY, Gatta F, Snosi M. Acute kidney injury associated with cardiac surgery: a comprehensive literature review. Braz J Cardiovasc Surg. 2020;35(2):211-24. doi:10.21470/1678-9741-2019-0122.
    » https://doi.org/10.21470/1678-9741-2019-0122
  • 5
    Gaffney AM, Sladen RN. Acute kidney injury in cardiac surgery. Curr Opin Anaesthesiol. 2015;28(1):50-9. doi:10.1097/ACO.0000000000000154.
    » https://doi.org/10.1097/ACO.0000000000000154
  • 6
    Gameiro J, Lopes JA. Complete blood count in acute kidney injury prediction: a narrative review. Ann Intensive Care. 2019;9(1):87. doi:10.1186/s13613-019-0561-4.
    » https://doi.org/10.1186/s13613-019-0561-4
  • 7
    Chen D, Xiao D, Guo J, Chahan B, Wang Z. Neutrophil-lymphocyte count ratio as a diagnostic marker for acute kidney injury: a systematic review and meta-analysis. Clin Exp Nephrol. 2020;24(2):126-35. doi:10.1007/s10157-019-01800-y.
    » https://doi.org/10.1007/s10157-019-01800-y
  • 8
    Koyner JL. Role of Biomarkers in Predicting AKI in the CT ICU. Difficult Decisions in Cardiothoracic Critical Care Surgery: Springer; 2019. p. 525-45.
  • 9
    Lako S, Dedej T, Nurka T, Ostreni V, Demiraj A, Xhaxho R, et al. Hematological changes in patients undergoing coronary artery bypass surgery: a prospective study. Med Arch. 2015;69(3):181-6. doi:10.5455/medarh.2015.69.181-186.
    » https://doi.org/10.5455/medarh.2015.69.181-186
  • 10
    Seong YW, Han SJ, Jung W, Jeon JH, Cho S, Jheon S, et al. Perioperative change in neutrophil-to-lymphocyte ratio (NLR) is a prognostic factor in patients with completely resected primary pulmonary sarcomatoid carcinoma. J Thorac Dis. 2019;11(3):819-26. doi:10.21037/jtd.2019.02.02.
    » https://doi.org/10.21037/jtd.2019.02.02
  • 11
    Li Z, Zhao R, Cui Y, Zhou Y, Wu X. The dynamic change of neutrophil to lymphocyte ratio can predict clinical outcome in stage I-III colon cancer. Sci Rep. 2018;8(1):9453. doi:10.1038/s41598-018-27896-y.
    » https://doi.org/10.1038/s41598-018-27896-y
  • 12
    Guo D, Han A, Jing W, Chen D, Jin F, Li M, et al. Preoperative to postoperative change in neutrophil-to-lymphocyte ratio predict survival in colorectal cancer patients. Future Oncol. 2018;14(12):1187-96. doi:10.2217/fon-2017-0659.
    » https://doi.org/10.2217/fon-2017-0659
  • 13
    Kertai MD, Zhou S, Karhausen JA, Cooter M, Jooste E, Li YJ, et al. Platelet counts, acute kidney injury, and mortality after coronary artery bypass grafting surgery. Anesthesiology. 2016;124(2):339-52. doi:10.1097/ALN.0000000000000959.
    » https://doi.org/10.1097/ALN.0000000000000959
  • 14
    Kramer RS, Herron CR, Groom RC, Brown JR. Acute kidney injury subsequent to cardiac surgery. J Extra Corpor Technol. 2015;47(1):16-28.
  • 15
    Gibson PH, Croal BL, Cuthbertson BH, Small GR, Ifezulike AI, Gibson G, et al. Preoperative neutrophil-lymphocyte ratio and outcome from coronary artery bypass grafting. Am Heart J. 2007;154(5):995-1002. doi:10.1016/j.ahj.2007.06.043.
    » https://doi.org/10.1016/j.ahj.2007.06.043
  • 16
    Kurtul A, Ornek E. Platelet to lymphocyte ratio in cardiovascular diseases: a systematic review. Angiology. 2019;70(9):802-18. doi:10.1177/0003319719845186.
    » https://doi.org/10.1177/0003319719845186
  • 17
    Turkmen K, Erdur FM, Ozcicek F, Ozcicek A, Akbas EM, Ozbicer A, et al. Platelet-to-lymphocyte ratio better predicts inflammation than neutrophil-to-lymphocyte ratio in end-stage renal disease patients. Hemodial Int. 2013;17(3):391-6. doi:10.1111/hdi.12040.
    » https://doi.org/10.1111/hdi.12040
  • 18
    Gurbuz O, Kumtepe G, Ozkan H, Karal IH, Velioglu Y, Ercan A, et al. Predictive value of neutrophil-lymphocyte ratio for long-term cardiovascular event following coronary artery bypass grafting. Braz J Cardiovasc Surg. 2020;35(3):274-84. doi:10.21470/1678-9741-2018-0362.
    » https://doi.org/10.21470/1678-9741-2018-0362
  • 19
    Engin M. Are pre and postoperative platelet to lymphocyte ratio and neutrophil to lymphocyte ratio associated with early postoperative AKI following CABG? Braz J Cardiovasc Surg. 2020;35(2):239. doi:10.21470/1678-9741-2019-0482.
    » https://doi.org/10.21470/1678-9741-2019-0482

Publication Dates

  • Publication in this collection
    11 Dec 2020
  • Date of issue
    May-Jun 2021

History

  • Received
    11 Apr 2020
  • Accepted
    28 June 2020
Sociedade Brasileira de Cirurgia Cardiovascular Rua Afonso Celso, 1178 Vila Mariana, CEP: 04119-061 - São Paulo/SP Brazil, Tel +55 (11) 3849-0341, Tel +55 (11) 5096-0079 - São Paulo - SP - Brazil
E-mail: bjcvs@sbccv.org.br