Prognostic Accuracy of the GRACE Score in Octogenarians and Nonagenarians with Acute Coronary Syndromes

Abstract

Background:

The GRACE Score was derived and validated from a cohort in which octogenarians and nonagenarians were poorly represented.

Objective:

To test the accuracy of the GRACE score in predicting in-hospital mortality of very elderly individuals with acute coronary syndromes (ACS).

Methods:

Prospective observational study conducted in the intensive coronary care unit of a tertiary center from September 2011 to August 2016. Patients consecutively admitted due to ACS were selected, and the very elderly group was defined by age ≥ 80 years. The GRACE Score was based on admission data and its accuracy was tested regarding prediction of in-hospital death. Statistical significance was defined by p value < 0,05.

Results:

A total of 994 individuals was studied, 57% male, 77% with non-ST elevation myocardial infarction and 173 (17%) very elderly patients. The mean age of the sample was 65 ± 13 years, and the mean age of very elderly patients subgroup was 85 ± 3.7 years. The C-statistics of the GRACE Score in very elderly patients was 0.86 (95% CI = 0.78 - 0.93), with no difference when compared to the value for younger individuals 0.83 (95% CI = 0.75 - 0.91), with p = 0.69. The calibration of the score in very elderly patients was described by χ² test of Hosmer-Lemeshow = 2.2 (p = 0.98), while the remaining patients presented χ² = 9.0 (p = 0.35). Logistic regression analysis for death prediction did not show interaction between GRACE Score and variable of very elderly patients (p = 0.25).

Conclusion:

The GRACE Score in very elderly patients is accurate in predicting in-hospital ACS mortality, similarly to younger patients.

Keywords:
Acute Coronary Syndrome / mortality; Aged 80 years and over; Prognosis; Risk Assessment; Data Reliability

Resumo

Fundamento:

O Escore GRACE foi derivado e validado por coorte de questionável representatividade de indivíduos octogenários e nonagenários.

Objetivo:

Testar a acurácia do Escore GRACE na predição de óbito hospitalar em indivíduos muito idosos com síndromes coronarianas agudas (SCAs).

Métodos:

Coleta prospectiva realizada em unidade coronariana de hospital terciário, durante o período de setembro de 2011 a agosto de 2016. Indivíduos consecutivamente internados com SCA foram selecionados e o grupo muito idoso definido por idade ≥ 80 anos. A acurácia do Escore GRACE foi testada quanto à predição de óbito hospitalar. A significância estatística foi definida por valor p < 0,05.

Resultados:

Foram estudados 994 indivíduos, sendo 57% do sexo masculino, 77% com SCA sem supradesnível do segmento ST e 173 pacientes muito idosos. A média geral de idade foi 65 ± 13 anos, e a média de idade dos pacientes muito idosos, 85 ± 3,7 anos. A estatística-C do Escore GRACE em indivíduos muito idosos foi de 0,86 (95% IC = 0,78 - 0,93), sem diferença em relação aos indivíduos mais jovens (0,83; 95% IC = 0,75 - 0,91), com p = 0,69. A calibração do escore em muito idosos foi descrita por Teste χ² de Hosmer-Lemeshow = 2,2 (p = 0,98), enquanto os demais pacientes apresentaram χ² = 9,0 (p = 0,35). A análise de regressão logística para predição de óbito não revelou interação entre Escore GRACE e a variável muito idoso (p = 0,25).

Conclusão:

O Escore GRACE em indivíduos muito idosos é acurado para predição de mortalidade hospitalar em SCA, semelhante para indivíduos mais jovens.

Palavras-chave:
Síndrome Coronariana Aguda / mortalidade; Idoso de 80 anos ou mais; Prognóstico; Medição de Risco; Confiabilidade dos Dados

Introduction

Acute coronary syndromes (ACS) are an important cause of in-hospital death in the Western world.^1,2 Due to the great heterogeneity of clinical and prognostic presentation of ACS, risk stratification is essential so that more aggressive actions can be adopted toward patients at higher risk. In this context, the GRACE Score is the most accurate predictor of hospital death in ACS.^3-6

However, the derivation and validation of the GRACE Score were conducted in a low representative cohort of octogenarians or nonagenarians.^3,4 Provided that old age is an important risk indicator, which accumulates aspects of constitutional fragility and higher prevalence of comorbidities, there are reasons to question whether the GRACE Score has modified accuracy in very elderly people.

The present study aimed to test the hypothesis that the GRACE Score has a satisfactory accuracy in predicting in-hospital death when applied to octogenarian and nonagenarian individuals with ACS. The cohort of Prospective Registry of Acute Coronary Syndromes was used in order to answer this question, comparing the discriminatory capacity and calibration of GRACE among individuals aged ≥ 80 years old versus < 80 years old.

Methods

Sample selection

Patients consecutively admitted to the coronary unit of the tertiary hospital between September 2011 and August 2016, due to suspected ACS (unstable angina and myocardial infarction) were screened for the study. The inclusion criteria were precordial discomfort within 48 hours prior to admission associated with at least one of the following criteria:

1. Positive myocardial necrosis marker, defined by troponin T ≥ 0.01 ug/L or troponin I > 0.034 g/L, which corresponds to values above 99 percent;⁷

2. Ischemic electrocardiographic alteration, consisting of inversion of the T wave (≥ 0.1 mV) or alterations of the ST segment (≥ 0.05 mV); and

3. Previously documented coronary artery disease, defined by a history of myocardial infarction with Q wave or previous angiography demonstrating coronary obstruction ≥ 70%.

The protocol is in compliance with the Declaration of Helsinki, released by the Research Ethic Committee of the institution and all patients evaluated signed the Informed Consent.

GRACE Score

The clinical data of each patient’s admission in the emergency unit, electrocardiograms performed within the first 6 hours of treatment, troponin T and troponin I dosage in the first 12 hours of treatment and the value of the first plasma creatinine were used to calculate the GRACE Score. The increased myocardial necrosis marker as a component of the scores was defined as troponin over 99 percent. The GRACE Score consists of eight variables: five semi-quantitative ones, i.e., different weight for each age range (systolic blood pressure, heart rate, plasma creatinine and Killip class); and three dichotomic ones (ST segment depression, elevation of myocardial necrosis marker and cardiac arrest at the moment of admission). The final score can range from 0 to 372.⁴

Data analysis

The accuracy of the GRACE Score was evaluated by discrimination and calibration analyses, which were compared between two groups: one referred to as “very elderly” and the other as “not very elderly”; the first one defined by individuals ≥ 80 years old. The GRACE Score has its performance evaluated by the ability to predict death by any given cause during the hospitalization period.

Statistical analysis

Numerical variables were expressed as mean and standard deviation when presenting normal distribution or a small deviation from normality, whilst median and interquartile interval were preferable in the presence of at least a moderate deviation from normality. The analysis of normality was performed through combined visualization of the histogram and Q-Q plots, description of skewness and kurtosis with confidence intervals, and normality tests (Shapiro-Wilk and Kolmogorov-Smirnov). Continuous variables were compared by the Student’s t-test or Wilcoxon test when they presented normal and non-normal distribution, respectively. Categorical variables were expressed in proportion and compared through the χ² test .

The discriminatory capacity of the GRACE Score for mortality was evaluated by the area below the curve of receiver operator characteristics - ROC (statistic-C), which was compared between the two groups by the unpaired Hanley-McNeil test.⁸ The calibration of the scores had a hypothesis test carried out by the Hosmer-Lemeshow technique and was described by the comparison between mortality predicted by GRACE and the one observed in each prediction quartile. The influence of age in the performance of GRACE was tested by the p-value of the interaction by logistic regression analysis.

The SPSS software, version 21, was used. The statistical significance was defined by two-tailed p-value lower than 0.05.

Results

Characteristics of the sample

A total of 994 individuals were studied, of which 57% were male and 77% had non-ST elevation ACS. The mean age of the sample was 65 ± 13 years old, of which 173 (17%) were classified as very elderly for being 80 years old or older. The mean age of the very elderly was 85 ± 3.7 years old, compared to 61 ± 11 years of age in the rest of the sample (p < 0.001). The GRACE Score for very elderly patients was 162 ± 34, significantly higher than the one of other patients (115 ± 35; p < 0.001). This higher score in GRACE for very elderly people is due to the difference not only in age, but also in the variables troponin, non-ST elevation, Killip and blood pressure. Percutaneous revascularization during hospitalization was similar in both groups, while surgical revascularization was less frequent in the group of the very elderly. During hospitalization, in-hospital mortality was 5.8% of the total sample, being significantly higher in the group of very elderly people in relation to patients with less than 80 years of age (16% versus 3.7%; p < 0.001) (Table 1).

Table 1
Comparison of clinical characteristics, laboratory characteristics, GRACE Score and mortality between very elderly versus not very elderly

	Age ≥ 80	Age < 80	p-value
Sample size	173 (17%)	821 (83%)	-
Age (years)	85 ± 3.7	61 ± 11	< 0.001‡
Male	82 (47.0%)	487 (59.0%)	0.004§
Non-ST elevation ACS	23 (13.0%)	205 (25.0%)	0.001§
Diabetes	60 (35.0%)	300 (37.0%)	0.613§
Non-ST elevation	55 (32.0%)	308 (37.5%)	0.155§
Positive troponin	123 (71.0%)	557 (68.0%)	0.403§
Classification of Killip			< 0.001
Killip I	127 (73.0%)	724 (88.0%)
Killip II	21 (12.0%)	49 (6.0%)
Killip III	23 (13.0%)	41 (5.0%)
Killip IV	2 (1.2%)	7 (0.9%)
Systolic pressure (mmHg)	151 ± 32	155 ± 30	0.098‡
Heart rate	80 ± 17	80 ± 18	0.519‡
Serum Creatinine (mg/dl)	1.1 ± 0.5	1.1 ± 0.9	0.669‡
Hemoglobin at admission	13 ± 1.8	14 ± 1.9	< 0.001‡
Triarterial or LMD*	38 (30.0%)	126 (18.0%)	< 0.001§
Percutaneous Coronary Intervention†	66 (39.0%)	368 (45.0%)	0.129§
Revascularization surgery†	4 (2.0%)	92 (11.0%)	< 0.001§
GRACE Score	162 ± 34	115 ± 35	< 0.001‡
In-hospital death	28 (16.0%)	30 (4.0%)	< 0.001§

• ACS: acute coronary syndrome;
• ^*
  Coronariography performed during hospitalization; LMD: left main disease;
• ^†
  Myocardial revascularization treatments during hospitalization;
• ^‡
  Compared through Student's t-test;
• ^§
  Compared through χ² test.

Discriminatory ability of the GRACE Score

In the total sample, the GRACE Score had statistic-C of 0.87 (95% CI = 0.82 - 0.92) in predicting hospital death. GRACE’s statistic-C among the very elderly was 0.86 (95% CI = 0.78 - 0.93), without difference in relation to the value found in patients aged less than 80 years old (statistic-C = 0.83; 95% CI = 0.75 - 0.91), with p = 0.69 in the comparison of both curves (Figure 1). In the logistic regression in which GRACE and very elderly people were simultaneously inserted in the prediction model, there was no interaction between these two variables (p = 0.25). In addition, GRACE remained an independent predictor of age (p < 0.001).

Figure 1
ROC curves of the GRACE Score for the prediction of in-hospital mortality in patients aged ≥ 80 years old versus < 80 years old with acute coronary syndromes. Area below the curve in very elderly was 0.86 (95% CI = 0.78 - 0.93), with no difference in relation to the value found in patients aged < 80 years old (statistic-C = 0.83; 95% CI = 0.75 - 0.91), with p = 0.69 in the comparison between both curves.

According to the ROC curve, the cutoff score in GRACE with best performance in the group of not very elderly was 134, with sensitivity of 83% and specificity of 76%. Among the very elderly, the cutoff point is displaced upward, with a value of 184, corresponding to the sensitivity of 77% and specificity of 87%.

Calibration of the GRACE Score

In the prediction of the incidence of death during hospitalization, the Hosmer-Lemeshow test showed satisfactory calibration in both groups, very elderly (χ² = 2.2; p = 0.98) and not very elderly (χ² = 9.0; p = 0.35). Figure 2presents the stratified analysis per quartile of the probability predicted by GRACE for hospital death, comparing the predicted and the observed within both age groups. Only the fourth quartile had an underestimated predicted mortality compared to the one observed, in both groups.

Figure 2
Calibration of the GRACE Score in the prediction of in-hospital mortality in patients aged ≥ 80 years old versus < 80 years old with acute coronary syndromes. The graphics represent the comparison between predicted and observed mortality, in quartiles of probability predicted by the GRACE Score.

Discussion

The present study demonstrates that the GRACE Score presents satisfactory accuracy in predicting hospital death of very elderly individuals with ACS (octogenarian and nonagenarian ones). The comparison with individuals aged less than 80 years old did not show loss of discriminatory capacity or GRACE’s calibration as the age progressed. Statistic-C values above 0.80 with narrow confidence intervals, in addition to linear growth of mortality observed in the different quartiles of mortality predicted by GRACE, are clear evidence of maintenance of the performance of this score in very elderly. Although the fourth quartile of predicted mortality has underestimated the risk in relation to what was observed, this difference did not compromise the categorization of the fourth larger groups of risk, once that both the observed and the predicted were in mortality ranges considered high for ACS.⁴ There was no interaction between the adequacy of GRACE’s model and the age range group defined by the cutoff point of 80 years of age, confirming GRACE’s accuracy among elderly.

Age is the marker of greater influence on the probability of hospital death in patients hospitalized with ACS, with exponential risk growth as the value of this variable increases.^6,9,10 The uncertainty of GRACE’s accuracy among very elderly individuals comes from the possibility that there could be less variability of important predicting values within a very advanced age range. For instance, the uniformity of advanced age in this sample may deprive this variable of its discriminatory power, which would not depict great contrast among the individuals. The inclination of this risk function may be lower when there are only very elderly patients. The same may occur with other variables which may be systematically altered in a very elderly sample. Also, the calibration of the score in estimating the numerical risk of death may be different for these patients, once the alpha constant (intercept) tends to be greater in samples with the highest risk. This could explain the need for recalibration of the score.

This uncertainty becomes greater when realized that octogenarian patients were not well represented by the sample which derived and validated the GRACE Score as a hospital death predictor.^4,11,12 The median age of that sample was 66 years old, with upper limit of 75 years of age for the interquartile interval, indicating that 3/4 of patients were less than 75 years old, with no description as to who were the octogenarian or the nonagenarian ones. Due to the uncertainty of this age range, “very elderly” was defined in our method as people from 80 years of age on, when the occurrence of fragility and comorbidities become more prevalent. Our findings are in agreement with preliminary studies which evaluated the GRACE Score in very elderly, respectively, two European works (Portugal and Spain), and two Chinese ones.^12-15 Therefore, our results support the literature, being the first to compare the sample of very elderly with individuals aged less than 80 years old. That is, not only do we present an accurate score, but also the suggestion that there is no loss of accuracy.

A risk-treatment paradox depending on age has been described in ACS,^11,12,16-19 that is, individuals with higher risk being treated in a more conservative way due to the fear of complications, while lower-risk and young individuals receive more aggressive treatment. The use of risk scores in elderly will potentially prevent this paradox, once it allows estimating greater magnitude of the benefit when more aggressive strategies are applied in patients with higher absolute risk derived from GRACE.

On the other hand, it should be recognized that provided the mortality is an outcome resulting from cardiovascular protection versus complications in procedures, the greatest benefit in very elderly may be antagonized by greater incidence of complications. Therefore, we emphasize this age range needs validation of the GRACE Score as for the prediction of benefits of more aggressive therapeutic strategies. This is a gap to be filled by future studies.

Conclusion

In conclusion, the present study represents a favorable evidence to the accurate use of the GRACE Score in the prediction of in-hospital death among octogenarian and nonagenarian patients hospitalized with ACS.

• Sources of Funding
  This study was partially funded by FAPESB.
• Study Association
  This article is part of the thesis of master submitted by Antonio Mauricio dos Santos Cerqueira Junior, from Escola Bahiana de Medicina e Saúde Pública.
• Ethics approval and consent to participate
  This study was approved by the Ethics Committee of the Hospital São Rafael under the protocol number 35/11. All the procedures in this study were in accordance with the 1975 Helsinki Declaration, updated in 2013. Informed consent was obtained from all participants included in the study.

References

• ¹
  Tunstall-Pedoe H, Kuulasmaa K, Amouyel P, Arveiler D, Rajakangas AM, Pajak A. Myocardial infarction and coronary deaths in the World Health Organization MONICA Project. Registration procedures, event rates, and case-fatality rates in 38 populations from 21 countries in four continents. Circulation. 1994;90(1):583-612. PMID: 8026046.
• ²
  Roe MT, Messenger JC, Weintraub WS, Cannon CP, Fonarow GC, Dai D, et al. Treatments, trends, and outcomes of acute myocardial infarction and percutaneous coronary intervention. J Am Coll Cardiol. 2010;56(4):254-63. doi: 10.1016/j.jacc.2010.05.008.
  » https://doi.org/10.1016/j.jacc.2010.05.008
• ³
  Pieper KS, Gore JM, FitzGerald G, Granger CB, Goldberg RJ, Steg G, et al; Global Registry of Acute Coronary Events (GRACE) Investigators. Validity of a risk-prediction tool for hospital mortality: the Global Registry of Acute Coronary Events. Am Heart J. 2009;157(6):1097-105. doi: 10.1016/j.ahj.2009.04.004.
  » https://doi.org/10.1016/j.ahj.2009.04.004
• ⁴
  Granger CB, Goldberg RJ, Dabbous O, Pieper KS, Eagle KA, Cannon CP, et al; Global Registry of Acute Coronary Events Investigators. Predictors of hospital mortality in the global registry of acute coronary events. Arch Intern Med. 2003;163(19):2345-53. doi: 10.1001/archinte.163.19.2345.
  » https://doi.org/10.1001/archinte.163.19.2345
• ⁵
  Goodman SG, Yan AT, Budaj A, Kennelly BB, Gore JM, Fox KA, et al; Expanded Global Registry of Acute Coronary Events (GRACE2) Investigators. The Expanded Global Registry of Acute Coronary Events: Baseline characteristics, Management Practices, and Hospital Outcomes of Patients with Acute Coronary Syndromes. Am Heart J. 2009;158(2):193-201. e1-5. doi: 10.1016/j.ahj.2009.06.003.
  » https://doi.org/10.1016/j.ahj.2009.06.003
• ⁶
  Correia LC, Freitas R, Bittencourt AP, Souza AC, Almeida MC, Leal J, et al. Prognostic Value of GRACE Scores versus TIMI Score in acute coronary syndromes. Arq Bras Cardiol. 2010;94(5):613-9. doi: http://dx.doi.org/10.1590/S0066-782X2010005000036.
  » http://dx.doi.org/10.1590/S0066-782X2010005000036.
• ⁷
  Apple FS, Quist HE, Doyle PJ, Otto AP, Murakami MM. Plasma 99th percentile reference limits for cardiac troponin and creatine kinase MB mass for use with european society of cardiology/american college of cardiology consensus recommendations. Clin Chem. 2003;49(8):1331-6. PMID: 12881449.
• ⁸
  Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143(1):29-36. doi: 10.1148/radiology.143.1.7063747.
  » https://doi.org/10.1148/radiology.143.1.7063747
• ⁹
  Batchelor WB, Anstrom KJ, Muhlbaier LH, Grosswald R, Weintraub WS, O'Neill WW, et al. Contemporary outcome trends in the elderly undergoing percutaneous coronary interventions: results in 7,472 octogenarians. J Am Coll Cardiol. 2000;36(3):723-30. PMID: 10987591.
• ¹⁰
  Pena FM, Peixoto RS, Soares JS, Júnior HR, Pena GS, Netto MV, et al. Perfil clínico e angiográfico de pacientes idosos com síndrome coronariana aguda admitidos em hospital terciário. Rev SOCERJ. 2009;22(3):176-80. ID: [i]-538301.
• ¹¹
  Martin AC, Dumas F, Spaulding C, Silberman SM. Management and decision-making process leading to coronary angiography and revascularization in octogenarians with coronary artery disease: insights from a large single-center registry. Geriatr Gerontol Int. 2015;15(5):544-52. doi: 10.1111/ggi.12308.
  » https://doi.org/10.1111/ggi.12308
• ¹²
  Faustino A, Mota P, Silva J; researchers from the National Registry of Acute Coronary Syndromes, Portuguese Cardiology Society. Non-ST-elevation acute coronary syndromes in octogenarians: applicability of the GRACE and CRUSADE scores. Rev Port Cardiol. 2014;33(10):617-27. doi: 10.1016/j.repc.2014.01.025.
  » https://doi.org/10.1016/j.repc.2014.01.025
• ¹³
  Gómez-Talavera S, Núñez-Gil I, Vivas D, Ruiz-Mateos B, Viana-Tejedor A, Martín-García A, et al. [Acute coronary syndrome in nonagenarians: clinical evolution and validation of the main risk scores]. Rev Esp Geriatr Gerontol. 2014;49(1):5-9. doi: 10.1016/j.regg.2013.05.002.
  » https://doi.org/10.1016/j.regg.2013.05.002
• ¹⁴
  Luo J, Yang M, Han L, Jia X, Chen L, Zhao Y. Validity of the GRACE score for 6-month death or reinfarction after presentation with acute myocardial infarction in patients 80 years of age and older. Coron Artery Dis. 2013;24(7):537-41. doi: 10.1097/MCA.0000000000000023.
  » https://doi.org/10.1097/MCA.0000000000000023
• ¹⁵
  Luo JG, Yang M, Han L, Chen LW, Chen X, Gao K, et al. Validity of the Global Registry of Acute Coronary Events risk score in prediction of acute myocardial infarction mortality in hospitalised Chinese patients aged 80 and over. Australas J Ageing. 2014;33(4):E1-5. doi: 10.1111/ajag.12044.
  » https://doi.org/10.1111/ajag.12044
• ¹⁶
  Costa PM, Vieira JL. Impacto da idade no tratamento da síndrome coronariana aguda em dois hospitais de Porto Alegre [Tese]. Porto Alegre: Pontifícia Universidade Católica do Rio Grande do Sul; 2007.
• ¹⁷
  Buber J, Goldenberg I, Kimron I, Guetta V. One-year outcome following coronary angiography in elderly patients with non-ST elevation myocardial infarction: real-world data from the Acute Coronary Syndromes Israeli Survey (ACSIS). Coron Artery Dis. 2013;24(2):102-9. doi: 10.1097/MCA.0b013e32835c8f53.
  » https://doi.org/10.1097/MCA.0b013e32835c8f53
• ¹⁸
  Mattos LA, Zago A, Chaves A, Pinto I, Tanajura L, Staico R, et al. Acute myocardial infarction in progressively elderly patients. a comparative analysis of immediate results in patients who underwent primary percutaneous coronary intervention. Arq Bras Cardiol. 2001;76(1):53-62. doi: http://dx.doi.org/10.1590/S0066-782X2001000100006.
  » http://dx.doi.org/10.1590/S0066-782X2001000100006.
• ¹⁹
  Yan RT, Yan AT, Tan M, Chow CM, Fitchett DH, Ervin FL, et al; Canadian Acute Coronary Syndromes (ACS) Registry Investigators. Age-related differences in the management and outcome of patients with acute coronary syndromes. Am Heart J. 2006;151(2):352-9. doi: 10.1016/j.ahj.2005.03.039.
  » https://doi.org/10.1016/j.ahj.2005.03.039

Publication Dates

• Publication in this collection
  01 Feb 2018
• Date of issue
  Jan 2018

History

• Received
  06 Mar 2017
• Reviewed
  07 July 2017
• Accepted
  07 July 2017