Acessibilidade / Reportar erro

BAR, SOFT AND DRI POST-HEPATIC TRANSPLANTATION: WHAT IS THE BEST FOR SURVIVAL ANALYSIS?

ABSTRACT

Background:

Liver transplantation is the treatment of choice for patients with terminal liver disease. The Balance of Risk Score (BAR), Survival Outcomes Following Liver Transplantation (SOFT) and Donor Risk Index (DRI) scores are predictive systems for post-transplant survival.

Aim:

To evaluate the most accurate score and the best cutoff point for each predictor in the brazilian population.

Method:

Retrospective cross-sectional study of 177 patients. Data on the recipient, donor and transplant were analyzed and the prognostic scores BAR, SOFT and DRI were calculated for each transplant. To determine the BAR and SOFT cutoff points associated with death in three months, ROC curves were adjusted. Results: The best cutoff point for BAR was 9 points with an area under the ROC curve=0.69 and for SOFT it was 12 points with an area under the ROC curve=0.73. The DRI score did not discriminate survival (p = 0.139).

Conclusion:

The SOFT score proved to be better than BAR for survival analysis post-hepatic transplantation and the DRI was not effective.

HEADINGS:
Organ Dysfunction Scores; Liver Transplantation; Liver Cirrhosis; Survival Analysis; Severity of Illness Index

RESUMO

Racional:

Transplante hepático é tratamento de escolha para pacientes com doença hepática terminal. Os escores Balance of Risk Score (BAR), Survival Outcomes Following Liver Transplantation (SOFT) e o Donor Risk Index (DRI) são sistemas preditores de sobrevida após o transplante.

Objetivo

: Avaliar o escore de maior acurácia e o melhor ponto de corte de cada preditor na população brasileira.

Método

: Estudo retrospectivo transversal de 177 pacientes. Foram analisados dados sobre o receptor, doador e o transplante e calculados os escores prognósticos BAR, SOFT e DRI para cada transplante. Para a determinar os pontos de corte de BAR e SOFT, associados a óbito em três meses, foram ajustadas curvas ROC.

Resultados

: O melhor ponto corte para BAR foi 9 pontos com área sob a curva ROC=0,69 e para SOFT foi 12 pontos com área sob a curva ROC=0,73. O escore DRI não discriminou a sobrevida (p=0,139).

Conclusão:

O escore SOFT mostrou-se melhor do que o BAR para análise de sobrevida pós-transplante hepático, e o DRI não foi efetivo.

DESCRITORES:
Escores de disfunção orgânica; Transplante de fígado; Cirrose hepática; Análise de sobrevida; Índice de gravidade de doença

INTRODUCTION

The liver transplantation is the chosen treatment to patients that have end stage liver disease 11 Fox AN, Brown RS. Is the Patient a Candidate for Liver Transplantation? Clin Liver Dis [Internet]. 2012;16(2):435-48. Available from: http://dx.doi.org/10.1016/j.cld.2012.03.014
http://dx.doi.org/10.1016/j.cld.2012.03....
. In the last couple of decades, there has been an expressive increase of these procedures. Between the years of 2008 and 2018, in Brazil, the number of cadaveric transplants has increased in 91.1% 22 Associação Brasileira de Transplante de Órgãos (ABTO). Registro Brasileiro de Transplantes - Dimensionamento dos Transplantes no Brasil e em cada estado (2011-2018) [Internet]. São Paulo; 2018 [cited 2019 Apr 20]. Available from: http://www.abto.org.br/abtov03/Upload/file/RBT/2018/Lv_RBT-2018.pdf
http://www.abto.org.br/abtov03/Upload/fi...
. In the American population, based on the United Network for Organ Sharing (UNOS), the survival of one year after the transplant can reach 89.7% 33 Meirelles Júnior RF, Salvalaggio P, Bruno de Rezende M, Silva Evangelista A, Della Guardia B, Eduardo Lourenço Matielo C, et al. Liver transplantation: history, outcomes and perspectives. Einstein. 2015;13(1):149-52., while in Brazil it reaches 75% 44 Associação Brasileira de Transplante de Órgãos (ABTO). Registro Brasileiro de Transplantes - Dimensionamento dos Transplantes no Brasil e em cada estado (2010-2017) [Internet]. São Paulo; 2017 [cited 2018 Jun 20]. Available from: http://www.abto.org.br/abtov03/Upload/file/RBT/2017/rbt-imprensa-leitura-compressed.pdf
http://www.abto.org.br/abtov03/Upload/fi...
.

The greatest obstacle for healing of end stage liver disease patients is the shortage of organs number. There is huge discrepancy between the demand and the number of transplants that are actually done 22 Associação Brasileira de Transplante de Órgãos (ABTO). Registro Brasileiro de Transplantes - Dimensionamento dos Transplantes no Brasil e em cada estado (2011-2018) [Internet]. São Paulo; 2018 [cited 2019 Apr 20]. Available from: http://www.abto.org.br/abtov03/Upload/file/RBT/2018/Lv_RBT-2018.pdf
http://www.abto.org.br/abtov03/Upload/fi...
. In Brazil in 2018 the mortality rate on waitlists was 45.7% 22 Associação Brasileira de Transplante de Órgãos (ABTO). Registro Brasileiro de Transplantes - Dimensionamento dos Transplantes no Brasil e em cada estado (2011-2018) [Internet]. São Paulo; 2018 [cited 2019 Apr 20]. Available from: http://www.abto.org.br/abtov03/Upload/file/RBT/2018/Lv_RBT-2018.pdf
http://www.abto.org.br/abtov03/Upload/fi...
. Due to that, one of the strategies has been the use of donors known as non - ideals, adjacent, with expanded criteria or bordering, in search of increasing the number of transplants and decreasing the time spent on waitlists 55 Rocha MB, Boin IFSF, Escanhoela CAF, Leonardi LS. Can the use of marginal liver donors change recipient survival rate? Transplant Proc. 2004;36(4):914-5.,66 Freitas ACT de, Coelho JCU, Watanabe MR, Lima RL das C. Relationship between donor quality and recipient gravity in liver transplant. Arq Bras Cir Dig. 2020 Jul 8;33(1):e1499.. Yet, the rate of mortality on this list is high 2,7.

In Brazil, until 2006, the base to allocating cadaveric livers was the time on waitlist, except for patients who had fulminant hepatitis or needed an emergency retransplatation 88 Secretaria de Assistência à Saúde do Ministério da Saúde do Brasil. Portaria GM no 3.407 de 5 de agosto de 1998. Diário Oficial da União;. Nowadays, more consistent criteria are available. Using the score Model for End-Stage Liver Disease (MELD) we can estimate the severity of the cirrhotic patient and the mortality rate on waitlist, and recently this has been the base for the organ allocating system 99 Wiesner R, Edwards E, Freeman R, Harper A, Kim R, Kamath P, et al. Model for end-stage liver disease (MELD) and allocation of donor livers. Gastroenterology [Internet]. 2003 Jan 1 [cited 2019 Feb 13];124(1):91-6. Available from: http://www.ncbi.nlm.nih.gov/pubmed/12512033
http://www.ncbi.nlm.nih.gov/pubmed/12512...
,1010 Manduca Palmiero HO, Kajikawa P, Boin IFSF, Coria S, Pereira LA. Liver recipient survival rate before and after model for end-stage liver disease implementation and use of donor risk index. In: Transplantation Proceedings. Elsevier; 2010. p. 4113-5..

Hoping to enhance even more the standards the prognosis scores Balance of Risk Score (BAR), Survival Outcomes Following Liver Transplantation (SOFT) and Donor Risk Index (DRI) were created, estimating survivability after transplant individually, according to the characteristics of the graft and the receiver 1111 Rana A, Hardy MA, Halazun KJ, Woodland DC, Ratner LE, Samstein B, et al. Survival Outcomes Following Liver Transplantation (SOFT) Score: A Novel Method to Predict Patient Survival Following Liver Transplantation. Am J Transplant [Internet]. 2008 Dec [cited 2018 Dec 20];8(12):2537-46. Available from: http://doi.wiley.com/10.1111/j.1600-6143.2008.02400.x
http://doi.wiley.com/10.1111/j.1600-6143...

12 Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
http://content.wkhealth.com/linkback/ope...

13 Feng S, Goodrich NP, Bragg-Gresham JL, Dykstra DM, Punch JD, DebRoy MA, et al. Characteristics associated with liver graft failure: the concept of a donor risk index. Am J Transplant [Internet]. 2006 Apr [cited 2018 Oct 10];6(4):783-90. Available from: http://www.ncbi.nlm.nih.gov/pubmed/16539636
http://www.ncbi.nlm.nih.gov/pubmed/16539...
-1414 Assis BS de, Coelho FF, Jeismann VB, Kruger JAP, Fonseca GM, Cecconello I, et al. Total laparoscopic vs. open liver resection: comparative study with propensity score matching analysis. Arq Bras Cir Dig. 2020;33(1):e1494.. The literature related to these predictors is scarce and not widespread, which leads to big medical centers, sometimes, not knowing these scores which could be of great importance for a better indication of transplant. Not only would the patient’s case severity be decisive 15, but also the survivability estimated after the procedure, which directly depends on the organ available.

The BAR, SOFT and DRI scores were developed based on american and european populations 1111 Rana A, Hardy MA, Halazun KJ, Woodland DC, Ratner LE, Samstein B, et al. Survival Outcomes Following Liver Transplantation (SOFT) Score: A Novel Method to Predict Patient Survival Following Liver Transplantation. Am J Transplant [Internet]. 2008 Dec [cited 2018 Dec 20];8(12):2537-46. Available from: http://doi.wiley.com/10.1111/j.1600-6143.2008.02400.x
http://doi.wiley.com/10.1111/j.1600-6143...

12 Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
http://content.wkhealth.com/linkback/ope...
-1313 Feng S, Goodrich NP, Bragg-Gresham JL, Dykstra DM, Punch JD, DebRoy MA, et al. Characteristics associated with liver graft failure: the concept of a donor risk index. Am J Transplant [Internet]. 2006 Apr [cited 2018 Oct 10];6(4):783-90. Available from: http://www.ncbi.nlm.nih.gov/pubmed/16539636
http://www.ncbi.nlm.nih.gov/pubmed/16539...
. In Brazil, particularly, transplant centers that use these scores prognosis’ system are yet unknown. So, studies that enable a better evaluation when used on the brazilian population become highly necessary.

The main goal of this presented study was to evaluate among the three scores which is more accurate and the better cut point for the brazilian population.

METHODS

This is a retrospective and cross-sectional observational study, based on prospective data, done in one center, with 177 cadaveric liver transplants, done in the Liver Transplantation Unit of Hospital São Vicente, in the city of Curitiba PR, Brazil, in the period between June 16th , 2016 and August 9th , 2018.

All of the patients that underwent the liver transplant who were 18 or more years old were included and obtained from the service database. The exclusion criteria were patients who were under 18 years old, multiple organ transplant cases, and the ones which the information on the database was not enough to fulfill the Liver Transplant Report, which were not observed on the studied sample universe. Data was collected from the hospital charts, and information from the donors were supplied by the National Center of Transplants (CNT).

The pre-surgical variables studied for the receivers were: diagnoses, weight (kg), height (m), BMI (body mass index), gender, age, race, the number of previous transplants, life support, previous abdominal operation in the upper abdomen, pre-transplant dialyses, pre-transplant ICU hospitalization, pre - transplant infirmary hospitalization, hepatic encephalopathy, ascites, upper gastrointestinal bleeding 48 hours pre - transplant, pre - transplant portal-vein thrombosis, albumin, laboratory MELD and adjusted MELD.

The data concerning the donor were: age, height (cm), cause of death, race, creatinine (mg/dl), days in the ICU and if it was donation after cardiac death. The data that referred to the transplant were: date of the procedure, date of death, location of the donation, split liver, surgical mortality (30 days after the procedure), time of cold ischemia (hours), post-operation complications in 30 days (Clavien-Dindo classification), BAR, SOFT and DRI scores.

Based on the data collected in each transplant, the scores prognosis BAR, SOFT and DRI were calculated, for each one of them. The calculation of BAR and DRI were done on October 2nd, 2018, through the use of online calculators available on https://www.assessurgery.com/bar-score/bar-score-calculator/ and https://gastro.cchmc.org/calculators/donor-risk-index/, respectively 1616 AssesSurgery GmbH. Online BAR Score Calculation [Internet]. 2019 [cited 2018 Oct 2]. Available from: https://www.assessurgery.com/bar-score/bar-score-calculator/
https://www.assessurgery.com/bar-score/b...
,1717 Feng, S; Goodrich, N P; Bragg-Gresham, J L; Dykstra, D M; Punch, J D; DebRoy, M A; Greenstein, S M; Merion R. Donor Risk Index for Liver Transplantation Calculator [Internet]. Cincinnati Children’s Hospital Medical Center. 2007 [cited 2018 Oct 2]. Available from: https://gastro.cchmc.org/calculators/donor-risk-index/
https://gastro.cchmc.org/calculators/don...
. The SOFT score was calculated according to the “Table 4: PSOFT and SOFT scores” elaborated by Rena et al. 1111 Rana A, Hardy MA, Halazun KJ, Woodland DC, Ratner LE, Samstein B, et al. Survival Outcomes Following Liver Transplantation (SOFT) Score: A Novel Method to Predict Patient Survival Following Liver Transplantation. Am J Transplant [Internet]. 2008 Dec [cited 2018 Dec 20];8(12):2537-46. Available from: http://doi.wiley.com/10.1111/j.1600-6143.2008.02400.x
http://doi.wiley.com/10.1111/j.1600-6143...
.

To calculate the survival of each patient the date of the transplant was considered and, in case of death, when it happened. To the patients that did not have reported death, it was considered the date of the last follow up on March 21st, 2019. All of the transplanted patients on the service do routine post-operation follow ups

Statistical analysis

The results were described by averages, standard deviation, minimum and maximum values (quantitative variables) or by frequencies and percentages (categorical variables). The association amongst quantitative variables was analyzed, estimating the Spearman correlation coefficient. In order to describe the time of survival, the Kaplan-Meier survival curves were used. The estimated measurement of association was hazard ratio (HR) to which were presented a confidence interval of 95%. To determine the BAR and SOFT cutoff points, associated to death in three months, the Reciver Operating Characteristic (ROC) curves were adjusted. Values of p<0,05 indicate statistic significance. The data was analyzed using the computational program Stata/SE v.14.1. StataCorpLP, USA.

RESULTS

Among the 177 transplant patients, 128 (72.3%) were men and 49 (27.7%) were women. The age of the receivers was 56±11.1 (19-77) years old. The patients’ laboratory MELD was 22.5±8.4 (7-53) points. It was verified that six (3.4%) of the patients required retransplant. From the total, 21 (11.9%) presented pre-transplant portal vein thrombosis (Table 1).

The location of capture of most of the grafts (57.6%) was inside of the state itself; 28.2% was in local origin (up to 40 km from the transplant center) and 14.1% were captured out of the state. The average of cold ischemia time of the graft was 5.7±1.6 (2.5-14) hours, from which 144 (64.4%) had a time less or equal to 6 hours (Table 1)

The average of the BAR score of the studied population was 9.0±4.6 (1-24), and the SOFT score was 11.3±9.4 (0-42). The average found to DRI was 1.5±0.4 (0.9-2.6, Table 1).

TABLE 1
Descriptive characteristics of the receiver, operative factors and the BAR, SOFT and DRI scores.

The cutoff points defined for BAR and SOFT scores were 9 and 12 points, respectively. The sensibility, specificity and area under the ROC curve in the best cutoff point of each score, to the population sample, are represented in Figure 1, and both are statistically significant (p<0.001) in foretelling three month mortality. An area under the curve ROC>0.7 indicates an useful test and if >0.8 an excellent test 1818 Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143(1):29-36.,1919 Jacob M, Lewsey JD, Sharpin C, Gimson A, Rela M, van der Meulen JHP, et al. Systematic review and validation of prognostic models in liver transplantation. Liver Transplant. 2004;11(7):814-25.. The SOFT score was the only one able to reach the area under the curve of ROC >0.7 to foretell the mortality in three months, meaning it is a clinically useful test. A cutoff point to foretell three month mortality for the DRI score could not be defined, because it did not discriminate the post-transplant mortality (p=0.139).

FIGURE 1
ROC curves applied to the BAR and SOFT scores’ abilities of predicting death in three months.

The survival analysis estimated for patients with BAR ≤9 was, at the end of three months’ time, of 82.9% vs. 59.1% with BAR >9 (p=0.001). At the end of twelve months to patients with BAR ≤9 was of 73.9% vs. 51.6% with BAR >9 (p=0.001, Figure 2). The estimated survival of patients with SOFT ≤12 was, at the end of three months, of 85.2% vs. 53.2% with SOFT >12 (p<0.001). At the end of 12 months to patients with SOFT ≤12 was of 79.7% vs. 50% with SOFT >12 (p<0.001, Figure 2).

FIGURE 2
Estimated survival through the Kaplan-Meier curves of the patients who had BAR ≤9 and BAR >9, and SOFT ≤12 and SOFT >12

Analyzing the correlation of the three scores with the patients’ laboratory MELD, BAR (p<0.001), SOFT (p<0.001) and DRI (p=0.006) were significantly correlated; however, the coefficient of the Spearman correlation showed a better association between laboratory MELD and BAR (r=0.74, Table 2).

TABLE 2
Spearman correlation and values of p from statistical tests among MELD and BAR, SOFT e DRI prognosis scores.

The evaluation of the association between the variables and general survival after transplant is presented on Table 3. Variables, which had more than two classifications, had one defined as reference (ref) and the other ones were compared to that one. Determinants to survival after transplant were the following variables: BAR score >9 (HR 2.58; CI 95% 1.50-4.41; p=0.001), SOFT score >12 (HR 3.22; CI 95% 1.97-5.53; p <0.001), woman (HR 2.00; CI 95% 1.16-3.46; p=0.013), laboratory MELD >35 points (HR 7.56; CI 95% 2.58-22.2; p<0.001) and retransplanted patients (HR 4.75; CI 95% 1.71-13.2; p=0.003, Table 3).

TABLE 3
Association between demographic variables, clinical variables and scores and the after transplant survival.

DISCUSSION

The high number of deaths of patients who are on the waitlist in Brazil is 22 Associação Brasileira de Transplante de Órgãos (ABTO). Registro Brasileiro de Transplantes - Dimensionamento dos Transplantes no Brasil e em cada estado (2011-2018) [Internet]. São Paulo; 2018 [cited 2019 Apr 20]. Available from: http://www.abto.org.br/abtov03/Upload/file/RBT/2018/Lv_RBT-2018.pdf
http://www.abto.org.br/abtov03/Upload/fi...
, in some parts, a reflex of the low rates of organ donation, around 16.6 per million population (pmp) 44 Associação Brasileira de Transplante de Órgãos (ABTO). Registro Brasileiro de Transplantes - Dimensionamento dos Transplantes no Brasil e em cada estado (2010-2017) [Internet]. São Paulo; 2017 [cited 2018 Jun 20]. Available from: http://www.abto.org.br/abtov03/Upload/file/RBT/2017/rbt-imprensa-leitura-compressed.pdf
http://www.abto.org.br/abtov03/Upload/fi...
, while in the USA and other european countries the rates go up to 25 and 30 pmp, respectively 2020 Pacheco L. Transplante de fígado no Brasil. Revista do Colégio Brasileiro de Cirurgiões. 2016 Jul 1;43(4):223-4.. Clearly, that increases the time and mortality of patients on the waitlist, and because of that, surgeons end up using expanded criteria livers 77 Silveira F, Silveira FP, Macri MM, Nicoluzzi JEL. Análise da mortalidade na lista de espera de fígado no Paraná, Brasil. O que devemos fazer para enfrentar a escassez de órgãos? ABCD Arq Bras Cir Dig. 2012;25(2):110-3.. The survival of one year reached in American services is 89.7% 33 Meirelles Júnior RF, Salvalaggio P, Bruno de Rezende M, Silva Evangelista A, Della Guardia B, Eduardo Lourenço Matielo C, et al. Liver transplantation: history, outcomes and perspectives. Einstein. 2015;13(1):149-52., while in brazilian reaches 75% 44 Associação Brasileira de Transplante de Órgãos (ABTO). Registro Brasileiro de Transplantes - Dimensionamento dos Transplantes no Brasil e em cada estado (2010-2017) [Internet]. São Paulo; 2017 [cited 2018 Jun 20]. Available from: http://www.abto.org.br/abtov03/Upload/file/RBT/2017/rbt-imprensa-leitura-compressed.pdf
http://www.abto.org.br/abtov03/Upload/fi...
. On the studied sample the average laboratory MELD of patients was 22.5±8.4 (7-53) points, which sets a high degree of gravity of the patients and consequently, a shorter survivability 10,21,22 . Beyond that, in the study the average DRI of grafts was 1.5±0.4 (0.9-2.6), which may indicate quality of grafts beneath the ideal 99 Wiesner R, Edwards E, Freeman R, Harper A, Kim R, Kamath P, et al. Model for end-stage liver disease (MELD) and allocation of donor livers. Gastroenterology [Internet]. 2003 Jan 1 [cited 2019 Feb 13];124(1):91-6. Available from: http://www.ncbi.nlm.nih.gov/pubmed/12512033
http://www.ncbi.nlm.nih.gov/pubmed/12512...
,2121 Boin IDFSF, Leonardi MI, Udo EY, Sevá-Pereira T, Stucchi RSB, Leonardi LS. Aplicação do escore MELD em pacientes submetidos a transplante de fígado: Análise retrospectiva da sobrevida e dos fatores preditivos a curto e longo prazo. Arq Gastroenterol. 2008 Oct;45(4):275-83.,2323 Schlitt HJ, Loss M, Scherer MN, Becker T, Jauch KW, Nashan B, et al. Current developments in liver transplantation in Germany: MELD-based organ allocation and incentives for transplant centres. Z Gastroenterol [Internet]. 2011 Jan [cited 2019 Jan 24];49(1):30-8. Available from: http://www.ncbi.nlm.nih.gov/pubmed/21225535
http://www.ncbi.nlm.nih.gov/pubmed/21225...
. It is clear the difficulty faced by brazilian surgeons on the current scenario. Having a foretelling survival score after transplant would be of great help, since the conditions faced are difficult.

Several studies referring to new survival foretellers are being developed to help on the decision making process of liver transplantion 1111 Rana A, Hardy MA, Halazun KJ, Woodland DC, Ratner LE, Samstein B, et al. Survival Outcomes Following Liver Transplantation (SOFT) Score: A Novel Method to Predict Patient Survival Following Liver Transplantation. Am J Transplant [Internet]. 2008 Dec [cited 2018 Dec 20];8(12):2537-46. Available from: http://doi.wiley.com/10.1111/j.1600-6143.2008.02400.x
http://doi.wiley.com/10.1111/j.1600-6143...

12 Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
http://content.wkhealth.com/linkback/ope...
-1313 Feng S, Goodrich NP, Bragg-Gresham JL, Dykstra DM, Punch JD, DebRoy MA, et al. Characteristics associated with liver graft failure: the concept of a donor risk index. Am J Transplant [Internet]. 2006 Apr [cited 2018 Oct 10];6(4):783-90. Available from: http://www.ncbi.nlm.nih.gov/pubmed/16539636
http://www.ncbi.nlm.nih.gov/pubmed/16539...
,1919 Jacob M, Lewsey JD, Sharpin C, Gimson A, Rela M, van der Meulen JHP, et al. Systematic review and validation of prognostic models in liver transplantation. Liver Transplant. 2004;11(7):814-25.,2424 Anastácio LR, Ferreira LG, Ribeiro HS, Diniz KGD, Lima AS, Correia MITD, et al. Sarcopenia, obesity and sarcopenic obesity in liver transplantation: A body composition prospective study. Arq Bras Cir Dig. 2019;32(2):e1434.. However, up to now the big centres use and recognize only the foreteller MELD as clinically useful, northing all of the allocation process of the grafts. The MELD score is able to predict the mortality in a three months period of the patient on the waitlist 99 Wiesner R, Edwards E, Freeman R, Harper A, Kim R, Kamath P, et al. Model for end-stage liver disease (MELD) and allocation of donor livers. Gastroenterology [Internet]. 2003 Jan 1 [cited 2019 Feb 13];124(1):91-6. Available from: http://www.ncbi.nlm.nih.gov/pubmed/12512033
http://www.ncbi.nlm.nih.gov/pubmed/12512...
,1010 Manduca Palmiero HO, Kajikawa P, Boin IFSF, Coria S, Pereira LA. Liver recipient survival rate before and after model for end-stage liver disease implementation and use of donor risk index. In: Transplantation Proceedings. Elsevier; 2010. p. 4113-5.,2525 Bernardi M, Gitto S, Biselli M. The MELD score in patients awaiting liver transplant: Strengths and weaknesses. Vol. 54, Journal of Hepatology. Elsevier B.V.; 2011. p. 1297-306.,2626 Freitas ACT de, Itikawa WM, Kurogi AS, Stadnik LG, Parolin MB, Coelho JCU. The impact of the model for end-stage liver disease (MELD) on liver transplantation in one center in Brazil. Arq Gastroenterol. 2010 Jul;47(3):233-7.. However, while trying to use it as a survival foreteller three months after the transplant, it reveals to be inefficient 1111 Rana A, Hardy MA, Halazun KJ, Woodland DC, Ratner LE, Samstein B, et al. Survival Outcomes Following Liver Transplantation (SOFT) Score: A Novel Method to Predict Patient Survival Following Liver Transplantation. Am J Transplant [Internet]. 2008 Dec [cited 2018 Dec 20];8(12):2537-46. Available from: http://doi.wiley.com/10.1111/j.1600-6143.2008.02400.x
http://doi.wiley.com/10.1111/j.1600-6143...
,1212 Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
http://content.wkhealth.com/linkback/ope...
,2222 Brandão A, Fuchs SL, Gleisner AL, Marroni C, Zanotelli ML, Cantisani G, et al. MELD and other predictors of survival after liver transplantation. Clin Transplant [Internet]. 2009 [cited 2019 May 14];23(2):220-7. Available from: http://www.ncbi.nlm.nih.gov/pubmed/19210688
http://www.ncbi.nlm.nih.gov/pubmed/19210...
.

Dutkowski et al. 1212 Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
http://content.wkhealth.com/linkback/ope...
developed a survival foreteller after transplant BAR that analyses six variables in total, from both the receiver and the donor, and it presented a good accuracy in foretelling the three month-after transplant-survival. They obtained an area under the ROC curve of 0.7 with a cutoff of 18 points, since they noticed that from it, the survival started to deteriorate exponentially. When applying the BAR score on the studied sample, the test also revealed itself useful to foretell the death in a three-month period (p<0.001). The best cutoff point determined to the sample was of 9 points (sensibility =58.7% and specificity =70.2%), with an area under the ROC curve of 0.69, not reaching the parameters established by international consensus to be considered as a clinically useful trial.

In a brazilian study, Campos Junior et al. 27 used the BAR score in 402 transplanted patients samples and got to the conclusion that it is a good foreteller of the survival in a three and twelve months period. The best cutoff point was of 11 points (sensibility =39% and specificity =87%) and the area beneath the ROC curve of 0.65, also being under international consensus as clinically useful. It was verified in the present study an area under the ROC curve superior to the ones found by Campos Junior et al. 2727 Campos Junior ID de, Stucchi RSB, Udo EY, Boin I de FSF. Application of the BAR score as a predictor of short- and long-term survival in liver transplantation patients. Hepatol Int. 2015;9(1):113-9. and Åberg et al. 2828 Åberg F, Nordin A, Mäkisalo H, Isoniemi H. Who is too healthy and who is too sick for liver transplantation: External validation of prognostic scores and survival-benefit estimation. Scand J Gastroenterol. 2015;50(9):1144-51. who had similar results, which suggests a superior performance of the score on the studied sample.

The different cutoff points found in the literature for the BAR foreteller showed that it varies depending on the population it is applied on. There is the need of a bigger number of studies in order to achieve a consensus on what is necessary to change and also the best cutoff point, before implementing them on the brazilian services. Dutkowski et al. 12 initially developed the score based on american and european populations, and it is noticeable that when it was applied on the brazilian population, there was a difference in the results, this fact was also observed by Campos Junior et al. 2727 Campos Junior ID de, Stucchi RSB, Udo EY, Boin I de FSF. Application of the BAR score as a predictor of short- and long-term survival in liver transplantation patients. Hepatol Int. 2015;9(1):113-9.. It is demonstrated that the score must go through adaptations before being applied onto the brazilian reality.

The SOFT score also used to estimate the survival after transplant, developed by Rana et al. 11 establishes 22 relevant variables. They found an area under the ROC curve of 0.7 when analyzing the survival in three months. A cutoff point was established, by another author, as 15 points, which also verified in his sample an area beneath the ROC curve of 0.7 1212 Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
http://content.wkhealth.com/linkback/ope...
.

On this present study the SOFT score had satisfactory results when discriminating the three months death (p<0.001). The area under the ROC curve was of 0.73, even superior to the one found in other studies 1111 Rana A, Hardy MA, Halazun KJ, Woodland DC, Ratner LE, Samstein B, et al. Survival Outcomes Following Liver Transplantation (SOFT) Score: A Novel Method to Predict Patient Survival Following Liver Transplantation. Am J Transplant [Internet]. 2008 Dec [cited 2018 Dec 20];8(12):2537-46. Available from: http://doi.wiley.com/10.1111/j.1600-6143.2008.02400.x
http://doi.wiley.com/10.1111/j.1600-6143...
,1212 Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
http://content.wkhealth.com/linkback/ope...
. The best cutoff point verified on the analyzed sample was of 12 points (sensibility = 63.0% and specificity =74.8%), inferior when compared to the one established by Dutkowski et al. 1212 Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
http://content.wkhealth.com/linkback/ope...
, which was 15 points. Then, it makes it possible to confirm once again the hypotheses that before implanting the score in a different population from where it was first developed, the score should go through some adaptations.

In another study, Feng et al. 1313 Feng S, Goodrich NP, Bragg-Gresham JL, Dykstra DM, Punch JD, DebRoy MA, et al. Characteristics associated with liver graft failure: the concept of a donor risk index. Am J Transplant [Internet]. 2006 Apr [cited 2018 Oct 10];6(4):783-90. Available from: http://www.ncbi.nlm.nih.gov/pubmed/16539636
http://www.ncbi.nlm.nih.gov/pubmed/16539...
established the DRI score, with eight variables exclusive to the donor as relevant to foretell the risk of primary failure of the graft and foretell the survival after three months. When applying this score, Dutkowski et al. 1212 Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
http://content.wkhealth.com/linkback/ope...
verified the area under the ROC curve of only 0.5 to three months. The same was observed by Åberg et al. 2828 Åberg F, Nordin A, Mäkisalo H, Isoniemi H. Who is too healthy and who is too sick for liver transplantation: External validation of prognostic scores and survival-benefit estimation. Scand J Gastroenterol. 2015;50(9):1144-51. that also verified the area between 0.5-0.65 when foretelling the survival in one year. On the sample that was studied here, the DRI score was not able to discriminate the mortality in three months after transplant (p=0.139), making it impossible to calculate the area beneath the ROC curve and define a cutoff point.

Among the three applied scores on the sample, the SOFT score had the biggest accuracy in foretelling death in three months, opposite to Dutkowski et al. 1212 Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
http://content.wkhealth.com/linkback/ope...
, that observed it to be the BAR score. One of the visible disadvantages of the SOFT score is the 22 variables raised in relation to the receiver and donor, compared to the six ones needed on BAR.

It is clear that gathering variables from the receiver as well as from the donor (BAR and SOFT) leads to a best accuracy of the prognosis model in foretelling the survival when compared to the ones that analyze only the donor’s variables (DRI).

When studying the correlation among the three prognosis scores compared to the laboratory MELD score of the patients, all of them are significantly correlated with MELD; however, the best association degree was with BAR (r=0.74), which was also described by Dutkowski et al. 1212 Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
http://content.wkhealth.com/linkback/ope...
.

It was possible to observe a shorter survival after transplant to the female gender variable (p=0.013), differently from obtained by Rana et al. 11 and Dutkowski et al. 1212 Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
http://content.wkhealth.com/linkback/ope...
that dismissed the variable as a risk factor. There was also short survival of previous transplant patients (p=0.003), as established priorly by other studies 1111 Rana A, Hardy MA, Halazun KJ, Woodland DC, Ratner LE, Samstein B, et al. Survival Outcomes Following Liver Transplantation (SOFT) Score: A Novel Method to Predict Patient Survival Following Liver Transplantation. Am J Transplant [Internet]. 2008 Dec [cited 2018 Dec 20];8(12):2537-46. Available from: http://doi.wiley.com/10.1111/j.1600-6143.2008.02400.x
http://doi.wiley.com/10.1111/j.1600-6143...
,1212 Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
http://content.wkhealth.com/linkback/ope...
and laboratory MELD >35 points (p<0.001), which corroborates partially with the literature, that presumes values even smaller than 35 points do increase the risk of death 1111 Rana A, Hardy MA, Halazun KJ, Woodland DC, Ratner LE, Samstein B, et al. Survival Outcomes Following Liver Transplantation (SOFT) Score: A Novel Method to Predict Patient Survival Following Liver Transplantation. Am J Transplant [Internet]. 2008 Dec [cited 2018 Dec 20];8(12):2537-46. Available from: http://doi.wiley.com/10.1111/j.1600-6143.2008.02400.x
http://doi.wiley.com/10.1111/j.1600-6143...
,1212 Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
http://content.wkhealth.com/linkback/ope...
.

CONCLUSION

Among the analyzed prognosis scores, SOFT had greater accuracy in foretelling death in three months’ time, and overcame established demands to be a clinically useful trial. The best cutoff point in the studied population for BAR was 9 points. To SOFT, the cutoff point was 12. When correlating the prognosis scores with the laboratory MELD, the biggest correlation was with BAR. It was verified that the female gender, previous transplant and MELD >35 points are associated with a shorter survival.

REFERENCES

  • 1
    Fox AN, Brown RS. Is the Patient a Candidate for Liver Transplantation? Clin Liver Dis [Internet]. 2012;16(2):435-48. Available from: http://dx.doi.org/10.1016/j.cld.2012.03.014
    » http://dx.doi.org/10.1016/j.cld.2012.03.014
  • 2
    Associação Brasileira de Transplante de Órgãos (ABTO). Registro Brasileiro de Transplantes - Dimensionamento dos Transplantes no Brasil e em cada estado (2011-2018) [Internet]. São Paulo; 2018 [cited 2019 Apr 20]. Available from: http://www.abto.org.br/abtov03/Upload/file/RBT/2018/Lv_RBT-2018.pdf
    » http://www.abto.org.br/abtov03/Upload/file/RBT/2018/Lv_RBT-2018.pdf
  • 3
    Meirelles Júnior RF, Salvalaggio P, Bruno de Rezende M, Silva Evangelista A, Della Guardia B, Eduardo Lourenço Matielo C, et al. Liver transplantation: history, outcomes and perspectives. Einstein. 2015;13(1):149-52.
  • 4
    Associação Brasileira de Transplante de Órgãos (ABTO). Registro Brasileiro de Transplantes - Dimensionamento dos Transplantes no Brasil e em cada estado (2010-2017) [Internet]. São Paulo; 2017 [cited 2018 Jun 20]. Available from: http://www.abto.org.br/abtov03/Upload/file/RBT/2017/rbt-imprensa-leitura-compressed.pdf
    » http://www.abto.org.br/abtov03/Upload/file/RBT/2017/rbt-imprensa-leitura-compressed.pdf
  • 5
    Rocha MB, Boin IFSF, Escanhoela CAF, Leonardi LS. Can the use of marginal liver donors change recipient survival rate? Transplant Proc. 2004;36(4):914-5.
  • 6
    Freitas ACT de, Coelho JCU, Watanabe MR, Lima RL das C. Relationship between donor quality and recipient gravity in liver transplant. Arq Bras Cir Dig. 2020 Jul 8;33(1):e1499.
  • 7
    Silveira F, Silveira FP, Macri MM, Nicoluzzi JEL. Análise da mortalidade na lista de espera de fígado no Paraná, Brasil. O que devemos fazer para enfrentar a escassez de órgãos? ABCD Arq Bras Cir Dig. 2012;25(2):110-3.
  • 8
    Secretaria de Assistência à Saúde do Ministério da Saúde do Brasil. Portaria GM no 3.407 de 5 de agosto de 1998. Diário Oficial da União;
  • 9
    Wiesner R, Edwards E, Freeman R, Harper A, Kim R, Kamath P, et al. Model for end-stage liver disease (MELD) and allocation of donor livers. Gastroenterology [Internet]. 2003 Jan 1 [cited 2019 Feb 13];124(1):91-6. Available from: http://www.ncbi.nlm.nih.gov/pubmed/12512033
    » http://www.ncbi.nlm.nih.gov/pubmed/12512033
  • 10
    Manduca Palmiero HO, Kajikawa P, Boin IFSF, Coria S, Pereira LA. Liver recipient survival rate before and after model for end-stage liver disease implementation and use of donor risk index. In: Transplantation Proceedings. Elsevier; 2010. p. 4113-5.
  • 11
    Rana A, Hardy MA, Halazun KJ, Woodland DC, Ratner LE, Samstein B, et al. Survival Outcomes Following Liver Transplantation (SOFT) Score: A Novel Method to Predict Patient Survival Following Liver Transplantation. Am J Transplant [Internet]. 2008 Dec [cited 2018 Dec 20];8(12):2537-46. Available from: http://doi.wiley.com/10.1111/j.1600-6143.2008.02400.x
    » http://doi.wiley.com/10.1111/j.1600-6143.2008.02400.x
  • 12
    Dutkowski P, Oberkofler CE, Slankamenac K, Puhan MA, Schadde E, Müllhaupt B, et al. Are There Better Guidelines for Allocation in Liver Transplantation? Ann Surg [Internet]. 2011 Nov [cited 2018 Sep 19];254(5):745-54. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
    » http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00000658-201111000-00010
  • 13
    Feng S, Goodrich NP, Bragg-Gresham JL, Dykstra DM, Punch JD, DebRoy MA, et al. Characteristics associated with liver graft failure: the concept of a donor risk index. Am J Transplant [Internet]. 2006 Apr [cited 2018 Oct 10];6(4):783-90. Available from: http://www.ncbi.nlm.nih.gov/pubmed/16539636
    » http://www.ncbi.nlm.nih.gov/pubmed/16539636
  • 14
    Assis BS de, Coelho FF, Jeismann VB, Kruger JAP, Fonseca GM, Cecconello I, et al. Total laparoscopic vs. open liver resection: comparative study with propensity score matching analysis. Arq Bras Cir Dig. 2020;33(1):e1494.
  • 15
    Malinowski EA, Matias JEF, Percicote AP, Nakadomari T, Robes R, Petterle RR, et al. Conservation of both hematocrit and liver regeneration in hepatectomies: A vascular occlusion approach in rats. Arq Bras Cir Dig. 2020;33(1):e1484.
  • 16
    AssesSurgery GmbH. Online BAR Score Calculation [Internet]. 2019 [cited 2018 Oct 2]. Available from: https://www.assessurgery.com/bar-score/bar-score-calculator/
    » https://www.assessurgery.com/bar-score/bar-score-calculator
  • 17
    Feng, S; Goodrich, N P; Bragg-Gresham, J L; Dykstra, D M; Punch, J D; DebRoy, M A; Greenstein, S M; Merion R. Donor Risk Index for Liver Transplantation Calculator [Internet]. Cincinnati Children’s Hospital Medical Center. 2007 [cited 2018 Oct 2]. Available from: https://gastro.cchmc.org/calculators/donor-risk-index/
    » https://gastro.cchmc.org/calculators/donor-risk-index
  • 18
    Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143(1):29-36.
  • 19
    Jacob M, Lewsey JD, Sharpin C, Gimson A, Rela M, van der Meulen JHP, et al. Systematic review and validation of prognostic models in liver transplantation. Liver Transplant. 2004;11(7):814-25.
  • 20
    Pacheco L. Transplante de fígado no Brasil. Revista do Colégio Brasileiro de Cirurgiões. 2016 Jul 1;43(4):223-4.
  • 21
    Boin IDFSF, Leonardi MI, Udo EY, Sevá-Pereira T, Stucchi RSB, Leonardi LS. Aplicação do escore MELD em pacientes submetidos a transplante de fígado: Análise retrospectiva da sobrevida e dos fatores preditivos a curto e longo prazo. Arq Gastroenterol. 2008 Oct;45(4):275-83.
  • 22
    Brandão A, Fuchs SL, Gleisner AL, Marroni C, Zanotelli ML, Cantisani G, et al. MELD and other predictors of survival after liver transplantation. Clin Transplant [Internet]. 2009 [cited 2019 May 14];23(2):220-7. Available from: http://www.ncbi.nlm.nih.gov/pubmed/19210688
    » http://www.ncbi.nlm.nih.gov/pubmed/19210688
  • 23
    Schlitt HJ, Loss M, Scherer MN, Becker T, Jauch KW, Nashan B, et al. Current developments in liver transplantation in Germany: MELD-based organ allocation and incentives for transplant centres. Z Gastroenterol [Internet]. 2011 Jan [cited 2019 Jan 24];49(1):30-8. Available from: http://www.ncbi.nlm.nih.gov/pubmed/21225535
    » http://www.ncbi.nlm.nih.gov/pubmed/21225535
  • 24
    Anastácio LR, Ferreira LG, Ribeiro HS, Diniz KGD, Lima AS, Correia MITD, et al. Sarcopenia, obesity and sarcopenic obesity in liver transplantation: A body composition prospective study. Arq Bras Cir Dig. 2019;32(2):e1434.
  • 25
    Bernardi M, Gitto S, Biselli M. The MELD score in patients awaiting liver transplant: Strengths and weaknesses. Vol. 54, Journal of Hepatology. Elsevier B.V.; 2011. p. 1297-306.
  • 26
    Freitas ACT de, Itikawa WM, Kurogi AS, Stadnik LG, Parolin MB, Coelho JCU. The impact of the model for end-stage liver disease (MELD) on liver transplantation in one center in Brazil. Arq Gastroenterol. 2010 Jul;47(3):233-7.
  • 27
    Campos Junior ID de, Stucchi RSB, Udo EY, Boin I de FSF. Application of the BAR score as a predictor of short- and long-term survival in liver transplantation patients. Hepatol Int. 2015;9(1):113-9.
  • 28
    Åberg F, Nordin A, Mäkisalo H, Isoniemi H. Who is too healthy and who is too sick for liver transplantation: External validation of prognostic scores and survival-benefit estimation. Scand J Gastroenterol. 2015;50(9):1144-51.
  • Financial source:

    none
  • Central Message

    The SOFT score is considered the best way to analyze post-liver transplant survivability, being considered a clinically useful test. A score greater than twelve points was unfavorable for the patient’s survival.
  • Perspective

    The number of liver transplants has grown considerably, which necessarily demands studies that can estimate post-transplant survival. This is the first brazilian study to compare prognosis scores, which are still not very widespread. This study allows verifying the possibility of instituting a prognosis model, enabling greater precision in the indication of each procedure. The soft score may be a resource with a positive result in the future, better indicating each transplant when determining the survival of this patient.

Publication Dates

  • Publication in this collection
    11 June 2021
  • Date of issue
    2021

History

  • Received
    02 July 2020
  • Accepted
    29 Sept 2020
Colégio Brasileiro de Cirurgia Digestiva Av. Brigadeiro Luiz Antonio, 278 - 6° - Salas 10 e 11, 01318-901 São Paulo/SP Brasil, Tel.: (11) 3288-8174/3289-0741 - São Paulo - SP - Brazil
E-mail: revistaabcd@gmail.com