Acessibilidade / Reportar erro

Comparison of Novel Martin/Hopkins and Sampson Equations for Calculation of Low-Density Lipoprotein Cholesterol in Diabetic Patients

Abstract

Background

The accurate determination of low-density lipoprotein cholesterol (LDL-C) is important to reach guideline-recommended LDL-C concentrations and to reduce adverse cardiovascular outcomes in diabetic patients. The commonly used Friedewald equation (LDL-Cf), gives inaccurate results in diabetic patients due to accompanying diabetic dyslipidemia. Recently two new equations – Martin/Hopkins (LDL-Cmh) and Sampson (LDL-Cs) – were developed to improve the accuracy of LDL-C estimation, but data are insufficient to suggest the superiority of one equation over the other one.

Objective

The present study compared the accuracy and clinical usefulness of novel Martin/Hopkins and Sampson equations in diabetic patients.

Methods

This study included 402 patients with diabetes. Patients’ cardiovascular risk and LDL-C targets were calculated per European guidelines. Calculated LDL-Cmh, LDL-Cs, and LDL-Cf concentrations were compared with direct LDL-C concentration (LDL-Cd) to test agreement between these equations and LDL-Cd. A p-value <0.05 was accepted as statistically significant.

Results

Both LDL-Cmh and LDL-Cs had a better agreement with LDL-Cd as compared to LDL-Cf, but no statistical differences were found among novel equations for agreement with LDL-Cd (Cronbach’s alpha 0.955 for both, p=1). Likewise, LDL-Cmh and LDL-Cs showed a similar degree of agreement with LDL-Cd in determining whether a patient was in a guideline-recommended LDL-C target (96.3% for LDL-Cmh and 96.0% for LDL-Cs), which were marginally better than LDL-Cf (94.6%). In patients with a triglyceride concentration >400 mg/dl, agreement with LDL-Cd was poor, regardless of the method used.

Conclusion

Martin/Hopkins and Sampson’s equations show a similar accuracy for calculating LDL-C concentrations in patients with diabetes, and both equations were marginally better than the Friedewald equation.

Metabolic Diseases; Atherosclerosis, Dyslipidemias; Coronary Artery Disease; Diabetes Mellitus; Lipoproteins, LDL; Cholesterol, LDL

Resumo

Fundamentos

A determinação precisa do colesterol de lipoproteína de baixa densidade (LDL-C) é importante para se alcançar concentrações de LDL-C recomendadas por diretrizes e para reduzir resultados cardiovasculares adversos em pacientes diabéticos. A equação de Friedewald comumente usada (LDL-Cf) produz resultados imprecisos em pacientes diabéticos devido a dislipidemia diabética associada. Recentemente, duas novas equações – Martin/Hopkins (LDL-CMH) e Sampson (LDL-Cs) – foram desenvolvidas para melhorar a precisão da estimativa de LDL-C, mas os dados são insuficientes para sugerir a superioridade de uma equação sobre a outra.

Objetivos

O presente estudo comparou a precisão e a utilidade clínica das novas equações de Martin/Hopkins e Sampson em pacientes diabéticos.

Método

Foram incluídos no estudo quatrocentos e dois (402) pacientes com diabetes. O risco cardiovascular dos pacientes e as metas de LDL-C foram calculadas por diretrizes europeias. As concentrações de LDL-Cmh, LDL-Cs, e LDL-Cf calculadas foram comparadas à concentração de LDL-C direto (LDL-Cd) para testar a concordância entre essas equações e LDL-Cd. Um P valor <0,05 foi aceito como estatisticamente significativo.

Resultados

A LDL-CMH e a LDL-Cs tiveram concordância melhor com o LDL-Cd em comparação com a LDL-Cf, mas não houve diferenças estatísticas entre as novas equações para concordância com o LDL-Cd (Alfa de Cronbach de 0,955 para ambos, p=1). Da mesma forma, a LDL-CMH e a LDL-Cs tinham um grau semelhante de concordância com o LDL-Cd para determinar se o paciente estava dentro da meta de LDL-C (96,3% para LDL-Cmh e 96,0% para LDL-Cs), que eram ligeiramente melhores que a LDL-Cf (94,6%). Em pacientes com uma concentração de triglicérides >400 mg/dl, a concordância com o LDL-Cd foi ruim, independentemente do método usado.

Conclusão

As equações de Martin/Hopkins e Sampson mostram uma precisão similar para o cálculo de concentrações de LDL-C nos pacientes com diabetes, e ambas as equações são ligeiramente melhores que a equação de Friedewald.

Doenças Metabólicas; Aterosclerose; Dislipidemias; Doença da Artéria Coronariana; Diabetes Mellitus; Lipoproteína de Baixa Intensidade; LDL-Colesterol

Introduction

There is a well-known relationship between low-density lipoprotein cholesterol (LDL-C) and atherosclerotic coronary artery disease (CAD).11. Ference BA, Ginsberg HN, Graham I, Ray KK, Packard CJ, Bruckert E, et al. Low-density lipoproteins cause atherosclerotic cardiovascular disease. 1. Evidence from genetic, epidemiologic, and clinical studies. A consensus statement from the European Atherosclerosis Society Consensus Panel. Eur Heart J. 2017;38(32): 2459–72. doi: 10.1093/eurheartj/ehx144. Patients with diabetes are not only more likely to have CAD but are also more prone to dyslipidemias, including elevated triglycerides (TG), low high-density lipoprotein cholesterol (HDL-C), and increased concentrations of small, dense LDL-C particles.22. Whiteley L, Padmanabhan S, Hole D, Isles C. Should diabetes be considered a coronary heart disease risk equivalent? Results from 25 years of follow-up in the Renfrew and Paisley survey. Diabetes Care. 2005; 28:1588-93. doi: 10.2337/diacare.28.7.1588.

3. American Diabetes Association; 10. Cardiovascular Disease and Risk Management; Standards of Medical Care in Diabetes-2021. Diabetes Care. 2021 Jan;44: S125-S150. doi: 10.2337/dc21-S010. PMID: 33298421.
- 44. Saely CH, Drexel H. Is type 2 diabetes really a coronary heart disease risk equivalent? Vascul Pharmacol. 2013; 59(1-2):11–8. doi: 10.1016/j.vph.2013.05.003. There is strong evidence suggesting improved cardiovascular outcomes with cholesterol-lowering treatment in Diabetes Mellitus (DM) patients with dyslipidemias, and although the relationship between LDL-C and CAD is less certain in patients with DM, available international guidelines recommend using LDL-C as the primary target for management decisions.55. Preiss D, Seshasai SR, Welsh P, Murphy SA, Ho JE, Waters DD, et al. Risk of incident diabetes with intensive dose compared with moderate-dose statin therapy: a meta-analysis. JAMA. 2011;305(24):2556-64. doi: 10.1001/jama.2011.860.

6. Almdal T, Scharling H, Jensen JS, Vestergaard H. The independent effect of type 2 diabetes mellitus on ischemic heart disease, stroke, and death: a population-based study of 13,000 men and women with 20 years of followup. Arch Intern Med. 2004; 164(13:1422–6. doi: 10.1001/archinte.164.13.1422.

7. Mach F, Baigent C, Catapano AL, Koskinas KC, Casula M, Badimon L, et al. ESC Scientific Document Group; 2019 ESC/EAS Guidelines for the management of dyslipidaemias: lipid modification to reduce cardiovascular risk. Eur Heart J. 2020; 41(1):111-88. doi: 10.1093/eurheartj/ehz455.
https://doi.org/10.1093/eurheartj/ehz455...
- 88. Arnett DK, Blumenthal RS, Albert MA, Buroker AB, Goldberger ZD, Hahn EJ, et al. 2019 ACC/AHA Guideline on the Primary Prevention of Cardiovascular Disease; A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines. Circulation. 2019 Sep 10;140(11): e596-e646. doi: 10.1161/CIR.0000000000000678.
https://doi.org/10.1161/CIR.000000000000...
Thus, accurate measurement of LDL-C is of paramount importance in patients with DM.

The gold standard for measuring LDL-C is β-quantification, but this technique is technically demanding and resource-intensive, so it is not routinely employed in practice.99. Bairaktari ET, Seferiadis KI, Elisaf MS. Evaluation of methods for the measurement of low-density lipoproteincholesterol. J Cardiovasc Pharmacol Ther. 2005;10(1):45-54. doi: 10.1177/107424840501000106. While direct LDL-C (LDL-Cd) assays are now commercially available, these are not widely adopted, and many laboratories still report calculated LDL-C concentrations instead.1010. Miller WG, Myers GL, Sakurabayashi I, Bachmann LM, Caudill SP, Dziekonski A, et al. Seven direct methods for measuring HDL and LDL cholesterol compared with ultracentrifugation reference measurement procedures. Clin Chem. 2010; 56(6):977-86. doi: 10.1373/clinchem.2009.142810. Friedewald equation (LDL-Cf), which is the most common method employed in practice, is unreliable when triglyceride concentration exceeds 150 mg/dl and LDL-C is below 70 mg/dl.1111. Martin SS, Blaha MJ, Elshazly MB, Brinton EA, Toth PP, McEvoy JW, et al. Friedewald-estimated versus directly measured low-density lipoprotein cholesterol and treatment implications. J Am Coll Cardiol. 2013 Aug 20;62(8):732-9. doi: 10.1016/j.jacc.2013.01.079. - 1212. Friedewald WT, Levy RI, Fredrickson DS. Estimation of the concentration of low-density lipoprotein cholesterol in plasma, without use of the preparative ultracentrifuge. Clin Chem. 1972 Jun;18(6):499-502. PMID 4337382. This is a particular concern for patients with DM, as hypertriglyceridemia is a common component of diabetic dyslipidemia. Recently, Martin/Hopkins (LDL-Cmh) and Sampson (LDL-Cs) equations were developed to provide a better estimate of LDL-C concentration, especially when TG is elevated.1313. Sampson M, Ling C, Sun Q, Harb R, Ashmaig M, Warnick R, et al. A new equation for calculation of low-density lipoprotein cholesterol in patients with normolipidemia and/or hypertriglyceridemia. JAMA Cardiol. 2020;5(5):540-8. doi: 10.1001/jamacardio.2020.0013. - 1414. Martin SS, Blaha MJ, Elshazly MB, Toth PP, Kwiterovich PO, Blumenthal RS, et al. Comparison of a novel method vs the Friedewald equation for estimating low-density lipoprotein cholesterol levels from the standard lipid profile. JAMA 2013 Nov 20; 310(19):2061-8. doi: 10.1001/jama.2013.280532. However, few studies have provided a head-to-head comparison of these two equations, and there are no data in patients with DM.1515. Zafrir B, Saliba W, Flugelman MY. Comparison of novel equations for estimating low-density lipoprotein cholesterol in patients undergoing coronary angiography. J Atheroscler Thromb. 2020; 27(12):1359-73. doi: 10.5551/jat.57133.

16. Dinç Asarcıklı L, Kış M, Güvenç TS, Tosun V, Acar B, Avcı Demir F, et al. Usefulness of novel Martin/Hopkins and Sampson equations over Friedewald equation in cardiology outpatients: A CVSCORE-TR substudy. Int J Clin Pract. 2021 Feb 11;75(6):e14090. doi: 10.1111/ijcp.14090.
- 1717. Ćwiklińska A, Wieczorek E, Gliwińska A, Marcinkowska M, Czaplińska M, Mickiewicz A, et al. Non-HDL-C/TG ratio indicates significant underestimation of calculated low-density lipoprotein cholesterol (LDL-C) better than TG level: a study on the reliability of mathematical formulas used for LDL-C estimation. Clin Chem Lab Med. 2020;59(5):857-67. doi: 10.1515/cclm-2020-1366.

The present study aimed to compare LDL-Cmh, LDL-Cs, and LDL-Cf equations with LDL-Cd to understand which equation had a better agreement with LDL-Cd in diabetic patients and to what degree these novel equations could change clinical decision-making as compared to LDL-Cf.

Materials and Methods

Patient selection

For the present investigation, cardiology outpatient records were reviewed retrospectively for the years 2019 and 2020. Patients who were 18 years of age or older and had diabetes at the time of admission were included in the study. Patients with incomplete records were excluded. No other inclusion or exclusion criteria were used. Diabetes was defined as having one of the following: i) being on antidiabetic treatment with a previous diagnosis of diabetes or ii) a hemoglobin A1c% concentration equal to or greater than 6.5%. Patients’ demographic, clinical, and laboratory data were retrospectively collected from an institutional electronic database. Glomerular filtration rate was calculated using Modified Diet in Renal Disease – Glomerular Filtration Rate equation, and patients with a glomerular filtration rate <60 ml/min/1.73 m2were accepted as having chronic renal disease. Patients were classified into intermediate, high, and very-high cardiovascular risk according to the 2019 European guidelines on the management of dyslipidemias.77. Mach F, Baigent C, Catapano AL, Koskinas KC, Casula M, Badimon L, et al. ESC Scientific Document Group; 2019 ESC/EAS Guidelines for the management of dyslipidaemias: lipid modification to reduce cardiovascular risk. Eur Heart J. 2020; 41(1):111-88. doi: 10.1093/eurheartj/ehz455.
https://doi.org/10.1093/eurheartj/ehz455...
LDL-C targets for each individual patient were determined using the same guidelines. The study was conducted according to the principles of the 1975 Declaration of Helsinki and its subsequent revisions, and ethical approval was obtained from a local ethics committee.

Measurement of direct LDL-C and calculation of estimated LDL-C

Blood samples were collected using standard methods, and samples were sent to the laboratory within 30 minutes after collection. LDL-Cd was measured by a colorimetric method using the Abbott Architect Plus ci8200 integrated analysis system (Abbott Labs, Chicago, IL, USA) and Archem LDL-Cd test reagents (Archem Health Ind, Turkey).

Other blood chemistry analyses, including lipid parameters, were carried out using standard methods, and the same blood sample was used for all analyses. LDL-Cf was calculated as:

Eq1. L D L C = T C H D L C ( T G / 5 )

as previously described. To calculate LDL-Cs, the second equation reported in the work of Sampson et al. was used,1313. Sampson M, Ling C, Sun Q, Harb R, Ashmaig M, Warnick R, et al. A new equation for calculation of low-density lipoprotein cholesterol in patients with normolipidemia and/or hypertriglyceridemia. JAMA Cardiol. 2020;5(5):540-8. doi: 10.1001/jamacardio.2020.0013. which is as follows:

Eq2. ( T C / 0 . 948 ) ( H D L C / 0 . 971 ) ( T G / 8 . 56 ) + [ ( T G Non-HDL-C / 2140) - (TG2 / 16100)] 9 . 44

LDL-Cmh needs different VLDL: TG “factors” for calculation and a single mathematical equation could not be used to derive LDL-Cmh.1414. Martin SS, Blaha MJ, Elshazly MB, Toth PP, Kwiterovich PO, Blumenthal RS, et al. Comparison of a novel method vs the Friedewald equation for estimating low-density lipoprotein cholesterol levels from the standard lipid profile. JAMA 2013 Nov 20; 310(19):2061-8. doi: 10.1001/jama.2013.280532. Instead, LDL-Cmh was calculated using spreadsheets provided by a supported and maintained website by Johns Hopkins University School of Medicine.1818. Johns Hopkins-Medicine. LDL-Cholesterol Calculator. [Accessed in 2021 April 21] Available from: hopkinsmedicine.org/apps/all-apps/ldl-cholesterol-calculator.
hopkinsmedicine.org/apps/all-apps/ldl-ch...

Statistical analyses

Continuous variables were given as mean ± standard deviation, while categorical variables were presented as percentages. For continuous variables, distribution patterns were analyzed with the Shapiro-Wilk test and visual inspection of the histograms. Correlation analyses were conducted by applying the Pearson test, and correlation coefficients were provided to give an overall measure of strength of relationship between different methods. Bland-Altman plots were drawn to visually assess the agreement between LDL-Cd and calculated LDL-C concentrations. Similarly, Cronbach’s alpha and intraclass correlation coefficients were calculated for a quantitative assessment of the agreement. Cronbach’s alpha values were compared using Feldt’s method.1919. Feldt LS, Woodruff DJ, Salih FA. Statistical inference for coefficient alpha. Appl Psychol Meas. 1987:11:93–103. doi:10.1177/014662168701100107.
https://doi.org/10.1177/0146621687011001...
Correct classification for being within the guideline-recommended LDL-C target, as well as reclassification rates relative to LDL-Cd was given as percentages. Kappa coefficients for the agreement were calculated for each pair. Patients were stratified per TG concentrations (TG<150 mg/dl, TG 150-400 mg/dl, and TG>400 mg/dl) and separate subgroup analyses were done for each stratum. Finally, patients on anticholesterolemic medications were analyzed to understand the agreement between LDL-Cd and calculated LDL-C concentrations in terms of reaching the target LDL-C concentration. A p-value <0.05 was accepted as statistically significant for all comparisons. Statistical analyses were performed with Jamovi (The jamovi project (2020). Jamovi (Version 1.2) for Windows, retrieved from (https://www.jamovi.org) and SPSS 25.0 (IBM Corp, Armonk, NY, USA) statistical packages.

Results

The demographic and clinical characteristics of the study group were presented in Table 1 . More than four-fifths of the study cohort had either high or very high risk, while only a quarter of the patients were on at least one anticholesterolemic drug. Mean LDL-C calculated with all three equations were lower than LDL-Cd, while the largest difference was between LDL-Cd and LDL-Cf.

Table 1
Demographic. clinical. and laboratory characteristics of the study sample

Correlation and agreement between LDL-Cd and calculated LDL-C

All three equations presented a strong correlation with LDL-Cd, but LDL-Cf showed the lowest value (r=0.915) compared to LDL-Cmh (r=0.932) and LDL-Cs (r=0.929) ( Figure 1 ). Data on the agreement between LDL-Cd and calculated LDL-C concentrations were presented in Table 2 . LDL-Cmh and LDL-Cs had a virtually similar agreement with LDL-Cd, while both equations had a significantly better agreement compared to LDL-Cf (p<0.001 for both). On Bland-Altman plots, the number of cases that exceeded upper and lower limits of agreement was 12 (2.98%) for LDL-Cmh, 15 (3.73%) for LDL-Cs, and 16 (3.98%) for LDL-Cf ( Figure 2 ).

Figure 1
Scatter plots showing the correlation of direct LDL-cholesterol concentrations with LDL-cholesterol concentrations calculated with (A) Martin/Hopkins equation, (B) Sampson equation, and (C) Friedewald equation. Plots were color-coded to reflect LDL-cholesterol concentrations at different triglyceride concentrations.

Table 2
Agreement between direct LDL-cholesterol concentration and calculated LDL-cholesterol concentrations

Figure 2
Bland-Altman plots showing the agreement between direct LDL-cholesterol concentrations with LDL-choleserol concentrations calculated with (A) Martin/Hopkins equation, (B) Sampson equation, and (C) Friedewald equation. Colored regions at the upper and lower parts of the plots show 95% confidence intervals (CI) of upper and lower agreement limits.

Concordance and reclassification

Data on agreement with LDL-Cd for “being in LDL-C target”, as well as reclassification rates, were provided in Table 3 . Concordances were similar for LDL-Cmh and LDL-Cs, and 3.7% - 3.9% of cases can be reclassified with LDL-Cd, respectively. Reclassification rates were lower with both equations as compared to LDL-Cf, as LDL-Cd reclassified 5.5% of the cases that were proved to be within or out of LDL-C target with LDL-Cf.

Table 3
Agreement between direct LDL-cholesterol method and other methods for reaching guideline-recommended LDL-cholesterol target

Agreement and reclassification per TG strata

In patients with a TG <400 mg/dl, all three equations had a good agreement with LDL-Cd, but the agreement was slightly better with both LDL-Cmh and LDL-Cs as compared with LDL-Cf (Supplementary Tables 1 and 2). The agreement was somewhat better with LDL-Cmh in patients within the TG <150 mg/dl strata and with LDL-Cs in patients with a TG 150-400 mg/dl, but the differences were minimal. Reclassification rates were also similar, although concordance with LDL-Cd was somewhat better with LDL-Cmh than LDL-Cs in patients with a TG 150-400 mg/dl. To note, the reclassification rate was similar with LDL-Cf when compared to novel equations in those with a TG <150 mg/dl, but not in those with a TG >150 mg/dl.

Concordance between LDL-Cd and novel equations was poor in those with a TG concentration above 400 mg/dl. Agreement for “being in target” was somewhat better for LDL-Cs as compared to LDL-Cmh, though the difference was rather trivial (Supplementary Table 2).

Patients on anticholesterolemic treatment

Similar to the whole study cohort, the performance of LDL-Cmh and LDL-Cs were similar in the subgroup of patients on anticholesterolemic drugs. To note, both equations had a small but significantly better agreement with LDL-Cd as compared to LDL-Cf, and reclassification rates were somewhat lower when either LDL-Cmh or LDL-Cs were used instead of LDL-Cf (Supplementary Tables 3 and 4).

Patients with an LDL-C <70 mg/dl

In the present study, 20 patients (4.9%) presented an LDL-Cd <70 mg/dl, while 33 (8.2%), 28 (7.0%), and 44 (10.9%) presented an LDL-C <70 mg/dl when Sampson, Martin/Hopkins, and Friedewald equations were used. The number of patients incorrectly classified as having an LDL-C were 15 (3.7%), 12 (3.0%), and 26 (6.4%) when LDL-Cs, LDL-Cmh, and LDL-Cf were used, respectively. Supplemental Table 5 summarizes reclassification rates with LDL-Cd for patients with a calculated LDL-C below 70 mg/dl. Reclassification rates were comparable for LDL-Cmh and LDL-Cs, but proportionally more patients with a LDL-Cf <70 mg/dl can be reclassified with LDL-Cd as compared to patients with LDL-Cmh or LDL-Cs <70 mg/dl.

Discussion

The present study compared calculated LDL-C concentrations with LDL-Cd in diabetic patients, with a particular focus on comparing LDL-Cmh and LDL-Cs to understand which novel equation would be the most clinically useful. The main takeaways from the present study are: i) both LDL-Cmh and LDL-Cs had a strong relationship and a good agreement with LDL-Cd, and there are no major differences between equations in terms of reclassification; ii) both equations were better than LDL-Cf - especially in patients with a TG>150 mg/dl; however, the benefits of using either equation were marginal; iii) LDL-Cmh had a near-excellent concordance with LDL-Cd in those with a TG concentration between 150-400 mg/dl, with only 1.5% of the patients being misclassified when LDL-Cmh was used, iv) all equations performed poorly when TG concentration exceeded 400 mg/dl, with less than 90% of the patients being classified correctly even with the best-performing LDL-Cs equation; and v) agreement between LDL-Cd and calculated LDL-C was poor in those with a calculated LDL-C below 70 mg/dl, with more than a quarter of the patients being reclassified with LDL-Cd, regardless of the equation used. Nevertheless, in this latter subgroup, LDL-Cs and LDL-Cmh performed better than LDL-Cf.

With the possible exception of younger patients with a short exposure to hyperglycemia, diabetic patients are at high risk for myocardial infarction and coronary mortality.2020. Haffner SM, Lehto S, Rönnemaa T, Pyörälä K, Laakso M. Mortality from coronary heart disease in subjects with type 2 diabetes and in nondiabetic subjects with and without prior myocardial infarction. N Engl J Med. 1998;339(4): 229-34. doi: 10.1056/NEJM199807233390404. As dyslipidemia is also common in these patients, multiple lines of evidence suggest that diabetic patients benefit from intensive LDL-C lowering with lifestyle modifications and antihypercholesterolemic drugs.33. American Diabetes Association; 10. Cardiovascular Disease and Risk Management; Standards of Medical Care in Diabetes-2021. Diabetes Care. 2021 Jan;44: S125-S150. doi: 10.2337/dc21-S010. PMID: 33298421. , 2121. Treatment Trialists’ (CTT) Collaboration, Baigent C, Blackwell L, Emberson J, Holland LE, Reith C, et al. Efficacy and safety of more intensive lowering of LDL cholesterol: a meta-analysis of data from 170,000 participants in 26 randomised trials. Lancet. 2010.36(9753):1670-81. doi: 10.1016/S0140-6736-61350-5. Epub 2010 Nov 8. PMID: 21067804; PMCID: PMC2988224.
https://doi.org/10.1016/S0140-6736-61350...
, 2222. Knopp RH, d’Emden M, Smilde JG, Pocock SJ. Efficacy and safety of atorvastatin in the prevention of cardiovascular end points in subjects with type 2 diabetes: The Atorvastatin Study for Prevention of Coronary Heart Disease Endpoints in non-insulin-dependent diabetes mellitus (ASPEN). Diabetes Care. 2006 Jul; 29:1478-85. doi: 10.2337/dc05-2415. PMID: 16801565. However, an accurate calculation of LDL-C is more problematic in diabetic patients, given that elevated TGs are common in diabetic patients and high TG concentrations cause an inaccurate estimation of LDL-C. This is especially true for calculations done with the Friedewald equation, which gives inadequate LDL-C estimates when TG concentrations are above 150 mg/dl.1111. Martin SS, Blaha MJ, Elshazly MB, Brinton EA, Toth PP, McEvoy JW, et al. Friedewald-estimated versus directly measured low-density lipoprotein cholesterol and treatment implications. J Am Coll Cardiol. 2013 Aug 20;62(8):732-9. doi: 10.1016/j.jacc.2013.01.079. Martin/Hopkins equations give more robust LDL-C estimates and are less sensitive to changes in TG, as long as TG concentrations are below 400 mg/dl.1414. Martin SS, Blaha MJ, Elshazly MB, Toth PP, Kwiterovich PO, Blumenthal RS, et al. Comparison of a novel method vs the Friedewald equation for estimating low-density lipoprotein cholesterol levels from the standard lipid profile. JAMA 2013 Nov 20; 310(19):2061-8. doi: 10.1001/jama.2013.280532. More recently, Sampson et al. defined a new equation, and their initial findings suggest that this equation gives correct LDL-C estimates as long as TG concentrations are below 800 mg/dl.1313. Sampson M, Ling C, Sun Q, Harb R, Ashmaig M, Warnick R, et al. A new equation for calculation of low-density lipoprotein cholesterol in patients with normolipidemia and/or hypertriglyceridemia. JAMA Cardiol. 2020;5(5):540-8. doi: 10.1001/jamacardio.2020.0013. However, to what extent were these initial findings applicable for diabetic patients, or whether these new equations could have any impact on patient management, were less certain. A recent study that included 1,828 Japanese patients with diabetes has found that Martin/Hopkins equations have a better agreement with LDL-Cd and as compared to LDL-Cf, especially when TG was above 150 mg/dl.2323. Chaen H, Kinchiku S, Miyata M, Kajiya S, Uenomachi H, Yuasa T, et al. Validity of a Novel Method for Estimation of Low-Density Lipoprotein Cholesterol Levels in Diabetic Patients. J Atheroscler Thromb. 2016 Dec 1; 23:1355-64. doi: 10.5551/jat.35972. However, this study used Japanese guidelines to determine whether patients were within guideline-recommended targets, and as Japanese guidelines were not widely used outside Japan, the applicability of their results for other populations was uncertain.2323. Chaen H, Kinchiku S, Miyata M, Kajiya S, Uenomachi H, Yuasa T, et al. Validity of a Novel Method for Estimation of Low-Density Lipoprotein Cholesterol Levels in Diabetic Patients. J Atheroscler Thromb. 2016 Dec 1; 23:1355-64. doi: 10.5551/jat.35972. While our results are largely confirmatory of this previous work, the present findings also indicate that the concordance between calculated LDL-C and LDL-Cd is above 90% regardless of the equation used; therefore, the clinical benefits of using novel Martin/Hopkins or Sampson equations over Friedewald equation is much less apparent than initially claimed. However, given that both equations allow correct classification of a significantly higher proportion of cases with virtually no additional costs (perhaps with the exception of incorporating more complex equations to the existing automation systems), using either equation could be advisable in diabetic patients.

Since both Martin/Hopkins and Sampson equations were defined in the last ten years, studies directly comparing these equations with each other are scarce. Two studies that compared Martin/Hopkins and Sampson equations with the Friedewald equation have found that their ability to reclassify cases was roughly similar.1515. Zafrir B, Saliba W, Flugelman MY. Comparison of novel equations for estimating low-density lipoprotein cholesterol in patients undergoing coronary angiography. J Atheroscler Thromb. 2020; 27(12):1359-73. doi: 10.5551/jat.57133. , 1616. Dinç Asarcıklı L, Kış M, Güvenç TS, Tosun V, Acar B, Avcı Demir F, et al. Usefulness of novel Martin/Hopkins and Sampson equations over Friedewald equation in cardiology outpatients: A CVSCORE-TR substudy. Int J Clin Pract. 2021 Feb 11;75(6):e14090. doi: 10.1111/ijcp.14090. However, these studies did not compare the accuracy of these equations against a benchmark method. More recently, Cwiklinska et al.1717. Ćwiklińska A, Wieczorek E, Gliwińska A, Marcinkowska M, Czaplińska M, Mickiewicz A, et al. Non-HDL-C/TG ratio indicates significant underestimation of calculated low-density lipoprotein cholesterol (LDL-C) better than TG level: a study on the reliability of mathematical formulas used for LDL-C estimation. Clin Chem Lab Med. 2020;59(5):857-67. doi: 10.1515/cclm-2020-1366. used both β-quantification and a direct LDL-assay to compare Martin/Hopkins and Sampson equations, and they reported that both methods were more accurate than the Friedewald equation.1717. Ćwiklińska A, Wieczorek E, Gliwińska A, Marcinkowska M, Czaplińska M, Mickiewicz A, et al. Non-HDL-C/TG ratio indicates significant underestimation of calculated low-density lipoprotein cholesterol (LDL-C) better than TG level: a study on the reliability of mathematical formulas used for LDL-C estimation. Clin Chem Lab Med. 2020;59(5):857-67. doi: 10.1515/cclm-2020-1366. While this study did not provide a head-to-head comparison between two novel equations, their numbers indicate that the number of cases exceeding the total error goal of 12% was smaller with Martin/Hopkins equations (134 vs. 157 cases).1717. Ćwiklińska A, Wieczorek E, Gliwińska A, Marcinkowska M, Czaplińska M, Mickiewicz A, et al. Non-HDL-C/TG ratio indicates significant underestimation of calculated low-density lipoprotein cholesterol (LDL-C) better than TG level: a study on the reliability of mathematical formulas used for LDL-C estimation. Clin Chem Lab Med. 2020;59(5):857-67. doi: 10.1515/cclm-2020-1366. Nonetheless, this study did not report the possible clinical importance of these findings, and their findings were not specific to patients with diabetes. Our results indicate that both equations had a very similar agreement with LDL-Cd and the clinical decision-making should be similar in the vast majority of patients regardless of which equation was used. Taking this into account, in the subgroup of patients with a TG 150-400 mg/dl, LDL-Cmh had a near-perfect agreement with LDL-Cd, thus making it preferable for diabetic patients in this TG strata.

Estimating LDL-C becomes even more difficult when TG concentrations exceed 400 mg/dl, not only because very-low-density lipoprotein concentrations are underestimated, but also because LDL-C is suppressed by increasing TGs beyond this point.1313. Sampson M, Ling C, Sun Q, Harb R, Ashmaig M, Warnick R, et al. A new equation for calculation of low-density lipoprotein cholesterol in patients with normolipidemia and/or hypertriglyceridemia. JAMA Cardiol. 2020;5(5):540-8. doi: 10.1001/jamacardio.2020.0013. Neither the Friedewald nor the Martin/Hopkins equations gave a reliable estimate of LDL-C beyond that cut-off value.1010. Miller WG, Myers GL, Sakurabayashi I, Bachmann LM, Caudill SP, Dziekonski A, et al. Seven direct methods for measuring HDL and LDL cholesterol compared with ultracentrifugation reference measurement procedures. Clin Chem. 2010; 56(6):977-86. doi: 10.1373/clinchem.2009.142810. , 2424. Langlois MR, Chapman MJ, Cobbaert C, Mora S, Remaley AT, Ros E, et al. European Atherosclerosis Society (EAS) and the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Joint Consensus Initiative. Quantifying Atherogenic Lipoproteins: Current and Future Challenges in the Era of Personalized Medicine and Very Low Concentrations of LDL Cholesterol. A Consensus Statement from EAS and EFLM. Clin Chem. 2018 Jul; 64(7):1006-33. doi: 10.1373/clinchem.2018.287037. The Sampson equation enabled a better estimation of LDL-C for patients with hypertriglyceridemia for TG concentrations up to 800 mg/dl, and in the original study, the misclassification rate was comparable to the misclassification rate of LDL-Cf equation for those with a TG <400 mg/dl.1313. Sampson M, Ling C, Sun Q, Harb R, Ashmaig M, Warnick R, et al. A new equation for calculation of low-density lipoprotein cholesterol in patients with normolipidemia and/or hypertriglyceridemia. JAMA Cardiol. 2020;5(5):540-8. doi: 10.1001/jamacardio.2020.0013. A promising new equation, which was not included in this analysis, was also recently introduced for patients with chronic kidney disease, in whom hypertriglyceridemia is also common.2525. Bauer F, Seibert FS, Rohn B, Babel N, Westhoff TH. Estimation of LDL cholesterol in chronic kidney disease. Eur J Prev Cardiol. 2021;28(12):1402-8. doi: 10.1093/eurjpc/zwaa003. This latter equation appears to be as accurate as LDL-Cmh in this patient subset, but it was not validated beyond those with kidney disease.2626. Izar MC. Can we improve accuracy in LDL-cholesterol estimation in chronic kidney disease? Eur J Prev Cardiol. 2021 Oct 13;28(12):1409-10. doi: 10.1093/eurjpc/zwaa048. Indeed, present findings were not suggestive of the superiority of one novel equation to another. Our results have indicated that while LDL-Cs had the best agreement with LDL-Cd, misclassification rates were unacceptable, as more than 10% of the cases were misclassified regardless of the equation used. Indeed, only one extra patient could be correctly classified when LDL-Cs were used instead of LDL-Cmh (Supplementary Table 2). Therefore, using LDL-Cd or an alternative method, such as non-HDL-C cholesterol or apolipoprotein B concentrations, should be preferred over estimated LDL-Cd in these patients, until a more reliable equation is available.

Finally, it has been suggested that LDL-Cf performs poorly in patients with an LDL-C <70 mg/dl due to its “fixed factor”, and this can be improved with novel equations.1313. Sampson M, Ling C, Sun Q, Harb R, Ashmaig M, Warnick R, et al. A new equation for calculation of low-density lipoprotein cholesterol in patients with normolipidemia and/or hypertriglyceridemia. JAMA Cardiol. 2020;5(5):540-8. doi: 10.1001/jamacardio.2020.0013. , 1414. Martin SS, Blaha MJ, Elshazly MB, Toth PP, Kwiterovich PO, Blumenthal RS, et al. Comparison of a novel method vs the Friedewald equation for estimating low-density lipoprotein cholesterol levels from the standard lipid profile. JAMA 2013 Nov 20; 310(19):2061-8. doi: 10.1001/jama.2013.280532. Our findings indicate that LDL-Cf misclassifies up to one-third of the diabetic patients with a LDL-Cf less than 70 mg/dl, and this figure can be lowered by applying novel equations, but up to one quarter of these patients are still misclassified as being within treatment targets even when using these equations, with no major difference between LDL-Cs and LDL-Cmh. Although this finding supports the use of novel equations rather than LDL-Cf in this subgroup, they nonetheless suggest that none of the available equations have adequate reliability for diabetic patients with an LDL-C below 70 mg/dl.

Study Limitations

Direct enzymatic LDL-C assays have been criticized for a lack of reliability and standardization, and β-quantification remains as the gold standard method for quantifying LDL-C.1010. Miller WG, Myers GL, Sakurabayashi I, Bachmann LM, Caudill SP, Dziekonski A, et al. Seven direct methods for measuring HDL and LDL cholesterol compared with ultracentrifugation reference measurement procedures. Clin Chem. 2010; 56(6):977-86. doi: 10.1373/clinchem.2009.142810. However, next-generation assays are much more reliable and are endorsed by relevant international guidelines, and enzymatic LDL-C assays have already served as the reference method in several studies.77. Mach F, Baigent C, Catapano AL, Koskinas KC, Casula M, Badimon L, et al. ESC Scientific Document Group; 2019 ESC/EAS Guidelines for the management of dyslipidaemias: lipid modification to reduce cardiovascular risk. Eur Heart J. 2020; 41(1):111-88. doi: 10.1093/eurheartj/ehz455.
https://doi.org/10.1093/eurheartj/ehz455...
, 2323. Chaen H, Kinchiku S, Miyata M, Kajiya S, Uenomachi H, Yuasa T, et al. Validity of a Novel Method for Estimation of Low-Density Lipoprotein Cholesterol Levels in Diabetic Patients. J Atheroscler Thromb. 2016 Dec 1; 23:1355-64. doi: 10.5551/jat.35972. , 2727. Grundy SM, Stone NJ, Bailey AL, Beam C, Birtcher KK, Blumenthal RS, et al. (2018) AHA/ACC/AACVPR/AAPA/ABC/ACPM/ADA/AGS/APhA/ASPC/NLA/PCNA Guideline on the Management of Blood Cholesterol: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines. Circulation. 2019 Jun 18;139(25): e1082-e1143. doi: 10.1161/CIR.0000000000000625.
https://doi.org/10.1161/CIR.000000000000...
, 2828. Rim JH, Lee YH, Lee MH, Kim HY, Choi J, Lee BW, et al. Comparison and Validation of 10 Equations Including a Novel Method for Estimation of LDL-cholesterol in a 168,212 Asian Population. Medicine (Baltimore). 2016;95(14): e3230. doi: 10.1097/MD.0000000000003230. β-quantification is too labor intensive to be used in routine practice, and even β-quantification of LDL-C is not devoid of errors, as it can include cholesterol from other lipoproteins.1313. Sampson M, Ling C, Sun Q, Harb R, Ashmaig M, Warnick R, et al. A new equation for calculation of low-density lipoprotein cholesterol in patients with normolipidemia and/or hypertriglyceridemia. JAMA Cardiol. 2020;5(5):540-8. doi: 10.1001/jamacardio.2020.0013. The study population was rather small (402 cases), and the number of cases with a TG >400 mg/dl was only 24, a condition that might have affected the reliability of the subgroup analysis in this stratum.

Conclusions

In diabetic patients, Martin/Hopkins and Sampson’s equations have similar reliability to estimate LDL-C, with no obvious advantage of preferring one equation over another. However, both equations were superior to the Friedewald equation in terms of agreement with LDL-Cd, and both had lower reclassification rates when compared to LDL-Cf, especially in patients with TG>150 mg/dl. Since the difference between the two equations was trivial, either equation could be preferred over the Friedewald equation in diabetic patients. In the small subset of patients with a TG concentration above 400 mg/dl, none of the equations had adequate accuracy and as such, direct measurement of LDL-C should be considered in these patients.

Referências

  • 1
    Ference BA, Ginsberg HN, Graham I, Ray KK, Packard CJ, Bruckert E, et al. Low-density lipoproteins cause atherosclerotic cardiovascular disease. 1. Evidence from genetic, epidemiologic, and clinical studies. A consensus statement from the European Atherosclerosis Society Consensus Panel. Eur Heart J. 2017;38(32): 2459–72. doi: 10.1093/eurheartj/ehx144.
  • 2
    Whiteley L, Padmanabhan S, Hole D, Isles C. Should diabetes be considered a coronary heart disease risk equivalent? Results from 25 years of follow-up in the Renfrew and Paisley survey. Diabetes Care. 2005; 28:1588-93. doi: 10.2337/diacare.28.7.1588.
  • 3
    American Diabetes Association; 10. Cardiovascular Disease and Risk Management; Standards of Medical Care in Diabetes-2021. Diabetes Care. 2021 Jan;44: S125-S150. doi: 10.2337/dc21-S010. PMID: 33298421.
  • 4
    Saely CH, Drexel H. Is type 2 diabetes really a coronary heart disease risk equivalent? Vascul Pharmacol. 2013; 59(1-2):11–8. doi: 10.1016/j.vph.2013.05.003.
  • 5
    Preiss D, Seshasai SR, Welsh P, Murphy SA, Ho JE, Waters DD, et al. Risk of incident diabetes with intensive dose compared with moderate-dose statin therapy: a meta-analysis. JAMA. 2011;305(24):2556-64. doi: 10.1001/jama.2011.860.
  • 6
    Almdal T, Scharling H, Jensen JS, Vestergaard H. The independent effect of type 2 diabetes mellitus on ischemic heart disease, stroke, and death: a population-based study of 13,000 men and women with 20 years of followup. Arch Intern Med. 2004; 164(13:1422–6. doi: 10.1001/archinte.164.13.1422.
  • 7
    Mach F, Baigent C, Catapano AL, Koskinas KC, Casula M, Badimon L, et al. ESC Scientific Document Group; 2019 ESC/EAS Guidelines for the management of dyslipidaemias: lipid modification to reduce cardiovascular risk. Eur Heart J. 2020; 41(1):111-88. doi: 10.1093/eurheartj/ehz455.
    » https://doi.org/10.1093/eurheartj/ehz455
  • 8
    Arnett DK, Blumenthal RS, Albert MA, Buroker AB, Goldberger ZD, Hahn EJ, et al. 2019 ACC/AHA Guideline on the Primary Prevention of Cardiovascular Disease; A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines. Circulation. 2019 Sep 10;140(11): e596-e646. doi: 10.1161/CIR.0000000000000678.
    » https://doi.org/10.1161/CIR.0000000000000678
  • 9
    Bairaktari ET, Seferiadis KI, Elisaf MS. Evaluation of methods for the measurement of low-density lipoproteincholesterol. J Cardiovasc Pharmacol Ther. 2005;10(1):45-54. doi: 10.1177/107424840501000106.
  • 10
    Miller WG, Myers GL, Sakurabayashi I, Bachmann LM, Caudill SP, Dziekonski A, et al. Seven direct methods for measuring HDL and LDL cholesterol compared with ultracentrifugation reference measurement procedures. Clin Chem. 2010; 56(6):977-86. doi: 10.1373/clinchem.2009.142810.
  • 11
    Martin SS, Blaha MJ, Elshazly MB, Brinton EA, Toth PP, McEvoy JW, et al. Friedewald-estimated versus directly measured low-density lipoprotein cholesterol and treatment implications. J Am Coll Cardiol. 2013 Aug 20;62(8):732-9. doi: 10.1016/j.jacc.2013.01.079.
  • 12
    Friedewald WT, Levy RI, Fredrickson DS. Estimation of the concentration of low-density lipoprotein cholesterol in plasma, without use of the preparative ultracentrifuge. Clin Chem. 1972 Jun;18(6):499-502. PMID 4337382.
  • 13
    Sampson M, Ling C, Sun Q, Harb R, Ashmaig M, Warnick R, et al. A new equation for calculation of low-density lipoprotein cholesterol in patients with normolipidemia and/or hypertriglyceridemia. JAMA Cardiol. 2020;5(5):540-8. doi: 10.1001/jamacardio.2020.0013.
  • 14
    Martin SS, Blaha MJ, Elshazly MB, Toth PP, Kwiterovich PO, Blumenthal RS, et al. Comparison of a novel method vs the Friedewald equation for estimating low-density lipoprotein cholesterol levels from the standard lipid profile. JAMA 2013 Nov 20; 310(19):2061-8. doi: 10.1001/jama.2013.280532.
  • 15
    Zafrir B, Saliba W, Flugelman MY. Comparison of novel equations for estimating low-density lipoprotein cholesterol in patients undergoing coronary angiography. J Atheroscler Thromb. 2020; 27(12):1359-73. doi: 10.5551/jat.57133.
  • 16
    Dinç Asarcıklı L, Kış M, Güvenç TS, Tosun V, Acar B, Avcı Demir F, et al. Usefulness of novel Martin/Hopkins and Sampson equations over Friedewald equation in cardiology outpatients: A CVSCORE-TR substudy. Int J Clin Pract. 2021 Feb 11;75(6):e14090. doi: 10.1111/ijcp.14090.
  • 17
    Ćwiklińska A, Wieczorek E, Gliwińska A, Marcinkowska M, Czaplińska M, Mickiewicz A, et al. Non-HDL-C/TG ratio indicates significant underestimation of calculated low-density lipoprotein cholesterol (LDL-C) better than TG level: a study on the reliability of mathematical formulas used for LDL-C estimation. Clin Chem Lab Med. 2020;59(5):857-67. doi: 10.1515/cclm-2020-1366.
  • 18
    Johns Hopkins-Medicine. LDL-Cholesterol Calculator. [Accessed in 2021 April 21] Available from: hopkinsmedicine.org/apps/all-apps/ldl-cholesterol-calculator
    » hopkinsmedicine.org/apps/all-apps/ldl-cholesterol-calculator
  • 19
    Feldt LS, Woodruff DJ, Salih FA. Statistical inference for coefficient alpha. Appl Psychol Meas. 1987:11:93–103. doi:10.1177/014662168701100107.
    » https://doi.org/10.1177/014662168701100107
  • 20
    Haffner SM, Lehto S, Rönnemaa T, Pyörälä K, Laakso M. Mortality from coronary heart disease in subjects with type 2 diabetes and in nondiabetic subjects with and without prior myocardial infarction. N Engl J Med. 1998;339(4): 229-34. doi: 10.1056/NEJM199807233390404.
  • 21
    Treatment Trialists’ (CTT) Collaboration, Baigent C, Blackwell L, Emberson J, Holland LE, Reith C, et al. Efficacy and safety of more intensive lowering of LDL cholesterol: a meta-analysis of data from 170,000 participants in 26 randomised trials. Lancet. 2010.36(9753):1670-81. doi: 10.1016/S0140-6736-61350-5. Epub 2010 Nov 8. PMID: 21067804; PMCID: PMC2988224.
    » https://doi.org/10.1016/S0140-6736-61350-5
  • 22
    Knopp RH, d’Emden M, Smilde JG, Pocock SJ. Efficacy and safety of atorvastatin in the prevention of cardiovascular end points in subjects with type 2 diabetes: The Atorvastatin Study for Prevention of Coronary Heart Disease Endpoints in non-insulin-dependent diabetes mellitus (ASPEN). Diabetes Care. 2006 Jul; 29:1478-85. doi: 10.2337/dc05-2415. PMID: 16801565.
  • 23
    Chaen H, Kinchiku S, Miyata M, Kajiya S, Uenomachi H, Yuasa T, et al. Validity of a Novel Method for Estimation of Low-Density Lipoprotein Cholesterol Levels in Diabetic Patients. J Atheroscler Thromb. 2016 Dec 1; 23:1355-64. doi: 10.5551/jat.35972.
  • 24
    Langlois MR, Chapman MJ, Cobbaert C, Mora S, Remaley AT, Ros E, et al. European Atherosclerosis Society (EAS) and the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Joint Consensus Initiative. Quantifying Atherogenic Lipoproteins: Current and Future Challenges in the Era of Personalized Medicine and Very Low Concentrations of LDL Cholesterol. A Consensus Statement from EAS and EFLM. Clin Chem. 2018 Jul; 64(7):1006-33. doi: 10.1373/clinchem.2018.287037.
  • 25
    Bauer F, Seibert FS, Rohn B, Babel N, Westhoff TH. Estimation of LDL cholesterol in chronic kidney disease. Eur J Prev Cardiol. 2021;28(12):1402-8. doi: 10.1093/eurjpc/zwaa003.
  • 26
    Izar MC. Can we improve accuracy in LDL-cholesterol estimation in chronic kidney disease? Eur J Prev Cardiol. 2021 Oct 13;28(12):1409-10. doi: 10.1093/eurjpc/zwaa048.
  • 27
    Grundy SM, Stone NJ, Bailey AL, Beam C, Birtcher KK, Blumenthal RS, et al. (2018) AHA/ACC/AACVPR/AAPA/ABC/ACPM/ADA/AGS/APhA/ASPC/NLA/PCNA Guideline on the Management of Blood Cholesterol: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines. Circulation. 2019 Jun 18;139(25): e1082-e1143. doi: 10.1161/CIR.0000000000000625.
    » https://doi.org/10.1161/CIR.0000000000000625
  • 28
    Rim JH, Lee YH, Lee MH, Kim HY, Choi J, Lee BW, et al. Comparison and Validation of 10 Equations Including a Novel Method for Estimation of LDL-cholesterol in a 168,212 Asian Population. Medicine (Baltimore). 2016;95(14): e3230. doi: 10.1097/MD.0000000000003230.
  • Study Association
    This study is not associated with any thesis or dissertation work.
  • Ethics approval and consent to participate
    This study was approved by the Istinye University Ethics Office on Human Research under the protocol number (2017-KAEK-120) / 2/2020.G-080. Desion number: 2/2020.K-057.
  • Sources of Funding: There were no external funding sources for this study.

* Supplemental Materials

For additional information, please click here.

Publication Dates

  • Publication in this collection
    27 June 2022
  • Date of issue
    Aug 2022

History

  • Received
    29 July 2021
  • Received
    23 Oct 2021
  • Accepted
    08 Dec 2021
Sociedade Brasileira de Cardiologia - SBC Avenida Marechal Câmara, 160, sala: 330, Centro, CEP: 20020-907, (21) 3478-2700 - Rio de Janeiro - RJ - Brazil, Fax: +55 21 3478-2770 - São Paulo - SP - Brazil
E-mail: revista@cardiol.br