Acessibilidade / Reportar erro

Predictive factors of morbidity in distal pancreatic resections

Abstracts

OBJECTIVE: To evaluate the postoperative morbidity of distal pancreatic resections and to investigate its predictive factors. METHODS: The study was conducted retrospectively from a prospectively database maintained. From 1994 to 2008, 100 consecutive patients underwent left pancreatic resections. The primary variable of interest was postoperative morbidity, and various other characteristics of the population were simultaneously recorded. Later, for the analysis of predictors of postoperative morbidity, the subgroup of patients who underwent distal pancreatectomy with spleen preservation (n = 65) was separately analyzed with regards to the different techniques of section of the pancreatic parenchyma, as well as to other possible predictors of postoperative morbidity. RESULTS: Considering all left pancreatic resections performed, the occurrence of overall, relevant and serious complications was 55%, 42% and 20%, respectively. The factors predictive of postoperative morbidity after distal pancreatectomy with spleen preservation were the technique employed for section of the pancreatic parenchyma, age, body mass index and the performance of concomitant abdominal operations. CONCLUSION: The morbidity associated with pancreatic resections to the left of the superior mesenteric vessels was high. According to the stratification adopted based on the severity of complications, some predictive factors have been identified. Future studies with larger cohorts of patients are needed to confirm these results.

Operative surgical procedures; Pancreatectomy; Postoperative complications; Morbidity; Pancreatic fistula


OBJETIVO: Avaliar a morbidade pós-operatória e investigar a existência de seus fatores preditivos. MÉTODOS: O estudo foi realizado de forma retrospectiva, a partir de uma base de dados mantida de forma prospectiva. De 1994 a 2008, 100 pacientes consecutivos foram submetidos à ressecções pancreaticas esquerdas. A principal variável de interesse foi a morbidade pós-operatória, tendo diversas outras características da população sido registradas simultaneamente. Posteriormente, para a análise de fatores preditivos de morbidade pós-operatória o subgrupo de pacientes que foi submetido aos procedimentos de pancreatectomia distal com preservação do baço (n=65) foi analisado separadamente quanto à relevância das diferentes técnicas de secção do parênquima pancreático, assim como, outros possíveis fatores preditivos à ocorrência de morbidade pós-operatória. RESULTADOS: Considerando-se juntamente todas as ressecções pancreáticas esquerdas realizadas, a ocorrência de complicações globais, de complicações relevantes e graves foi 55%, 42% e 20%, respectivamente. Os fatores que se mostraram preditivos à ocorrência de morbidade pós-operatória após pancreatectomia distal com preservação do baço foram a técnica de secção do parênquima pancreático, idade, índice de massa corporal e a realização de operação abdominal concomitante. CONCLUSÃO: A morbidade associada às ressecções pancreáticas, à esquerda dos vasos mesentéricos superiores, foi importante. De acordo com a estratificação adotada baseada na gravidade das complicações, alguns fatores preditivos foram identificados. Estudos futuros com coortes maiores de pacientes são necessários para confirmar tais resultados.

Procedimentos cirúrgicos operatórios; Pancreatectomia; Complicações pós-operatórias; Morbidade; Fístula pancreática


ORIGINAL ARTICLE

Predictive factors of morbidity in distal pancreatic resections

Fábio Athayde Veloso Madureira, TCBC-RJI; Philippe GrèsII; Rodrigo Rodrigues VasquesIII; Hugues LevardIV; Bruto RandoneIV; Brice GayetIV,V

ISurgeon, Lagoa Federal Hospital (Rio de Janeiro, Brazil)

IISurgeon, Nicolas Pontoux Medical Center, Chalon-Sur-Saône, France

IIISurgeon, Zilberstein Institute. São Paulo, Brazil

IVSurgeon, Simone Veil Hospital, Eaubonne-Montmorency, France; 5. Professor, University Paris Descartes, Paris, France

Correspondence

ABSTRACT

OBJECTIVE: To evaluate the postoperative morbidity of distal pancreatic resections and to investigate its predictive factors.

METHODS: The study was conducted retrospectively from a prospectively maintained database. From 1994 to 2008, 100 consecutive patients underwent left pancreatic resections. The primary variable of interest was postoperative morbidity, and various other characteristics of the population were simultaneously recorded. Later, for the analysis of predictors of postoperative morbidity, the subgroup of patients who underwent distal pancreatectomy with spleen preservation (n = 65) was separately analyzed with regards to the different techniques of section of the pancreatic parenchyma, as well as to other possible predictors of postoperative morbidity.

RESULTS:Considering all left pancreatic resections performed, the occurrence of overall, relevant and serious complications was 55%, 42% and 20%, respectively. The factors predictive of postoperative morbidity after distal pancreatectomy with spleen preservation were the technique employed for section of the pancreatic parenchyma, age, body mass index and the performance of concomitant abdominal operations.

CONCLUSION: The morbidity associated with pancreatic resections to the left of the superior mesenteric vessels was high. According to the stratification adopted based on the severity of complications, some predictive factors have been identified. Future studies with larger cohorts of patients are needed to confirm these results.

Key words: Surgical procedures, operative. Pancreatectomy. Postoperative complications. Morbidity. Pancreatic fistula.

INTRODUCTION

Left pancreatic resections (LPRs) are surgical procedures associated with significant postoperative morbidity, ranging from 4% to 60% in reported series1 12. Different definitions of morbidity have been adopted in these studies, making interpretation of their results difficult13-19. In order to solve this problem, there was a consensus meeting of the International Study Group on Pancreatic Fistula (ISGPF) with the aim of establishing a definition for this which is one of the major complications after pancreatectomy15.

The technical section of the pancreatic parenchyma during pancreatic resections has been cited by several authors as a potential predictive factors of pancreatic fistula (PF)4,8,10,12,20-22. Several techniques are being used, reflecting lack of knowledge about the superiority of a particular technique over another. This fact is mainly due to methodological limitations of the studies (selection bias and morbidity definitions) or the absence of significant differences between results7,11,22.

Motivated by this lack of evidence, with the present study the authors aimed to assess the experience of the Institut Mutualiste Montsouris (Paris, France) in performing left pancreatic resections to the superior mesenteric vessels, with a focus on determining postoperative morbidity and its predictors.

METHODS

The study was conducted retrospectively from a prospectively maintained database. From 1994 to 2008, 100 consecutive patients underwent left pancreatic resections. The primary variable of interest was postoperative morbidity. The LPR procedures included splenopancreatectomy (Spl-Pd), distal pancreatectomy with spleen preservation (Pd) and enucleations of lesions located to the left of the superior mesenteric vessels. Due to the heterogeneity of the group, to investigate predictors of postoperative morbidity we studied only the subgroup of patients who underwent Pd (n = 65). We recorded postoperative morbidity, as well as patient characteristics and variables related to preoperative and postoperative periods in a database, as summarized in table 1.

We standardized morbidity and complications as synonymous, defined as any intra-abdominal adverse event occurring intra or postoperatively. Pancreatic fistula was defined as any volume of fluid rich in amylase (more than three times the normal concentration of serum amylase), obtained from the percutaneous drain, after the third postoperative day. Pancreatic fistulas were then classified according to the consensus of ISGPF15.

Complications were classified as proposed by Dindo18 and adapted by De Oliveira14, where they were divided into five categories according to the severity of events. In this classification, complications types I and II were simple events and did not require invasive treatment ; type III were events requiring invasive treatment approaches, where IIIA required percutaneous drainage under local anesthesia and III-B required reoperation; type IV defines the situation where the patient was in poor condition, with involvement of at least one organic system (respiratory, renal, bone marrow, etc.) and generally sent to the ICU ; and type V, the events that resulted in death occurred before the 30th day after the first surgical procedure. Aiming to investigate potential predictors of postoperative complications, we qualified these five events (I-V) in three types of complications: non-relevant, relevant, and serious, defined as follows: Event Severity below III-a, non-relevant complications (I and II); III-a events: relevant complications ; events of gravity highed than III-a (III-B, IV and V) : serious complications.

For the section of the pancreatic parenchyma different techniques were applied: ultrasonic scissors (Ultracision™) ; scissors aided by "rescue" bipolar coagulation (Gayet bipolar forceps); linear stapler-cutter; and other less common. Regarding the use of stapler to approach the pancreatic parenchyma, stapler loads used were of vascular type and the "staple line" was reinforced with polydioxanona (PDS) stiches. Three models of staplers have been used in the course of the experiment. Until 2006, Endo-GIA™ 30-45mm and ETS 30/45mm. After 2006, Echelon 60mm replaced the previous models. Regarding the technique involving the use of scissors and "rescue" bipolar coagulation, the pancreatic stump was closed with PDS stitches in a fashion termed as "fish mouth" (splaying the edges of the residual pancreatic stump for better approximation).

The splenic preservation was prioritized, even when there was impairment of the splenic artery23. Regarding EN, evaluation by intraoperative ultrasonography was routinely performed in order to estimate the proximity of the lesion with the pancreatic duct. The administration of anti-secretion medication (somatostatin derivatives) was not a routine. At the end of the procedures a chest tube with light suction (Haemovac®-type) was usually positioned near the edge of the residual pancreatic stump. This drain was maintained during the first seven days. After this period, a computed tomography (CT) was routinely performed to exclude the presence of residual fluid collections.

In the statistical analysis, overall, serious and relevant complications were used as independent outcomes in univariate and multivariate analysis of predictive factors. For univariate analyzes, we used the chi-square and Fisher tests for qualitative variables. For multivariate analyzes, we used the logistic regression model. To test the independence (confirm) of predictive factors, variables that showed trends toward significance in univariate analyzes (p = 0.15) were included in the logistic regression models. Some of the variables that entered in the univariate analyzes were: surgical approach (laparotomy vs. Laparoscopic); malignancy vs. benign disaease; tumor size ; gender; age; BMI; duration of surgery; administration of somatostatin derivatives; intraoperative drain placement; splenic preservation; periods in which surgical procedures were performed (1994-2001 vs. 2002-2008); concomitant abdominal operation; elective pancreatic duct ligation ; ASA score; and section techniques of the pancreatic parenchyma.

All tests were two-tailed; p value <0.05 was considered significant.

This study was approved by the Ethics in Research Institutions and the source of origin of data and of the researcher (Protocol 134/08 - CEP-HUCFF).

RESULTS

As for postoperative morbidity, considering LPRs (n = 100), the incidence of overall, non-relevant, relevant and severe complications was 55%, 13%, 42% and 20%, respectively. Considering only Pds (n = 65), the incidence of overall, non-relevant, relevant and severe complications was 59%, 17%, 42% and 18%, respectively. With respect specifically to PF, these incidences were 24%, 4.5%, 4.5% and 20%, respectively. Complications included, in addition to PF, bleeding in 9%, collections in 15% and abscesses in 16%. No deaths intraoperative occurred.

In univariate analysis, age and BMI were predictive for the occurrence of overall complications. In multivariate analysis, these two variables remained as such (p <0.05). The median age was 53 years in those with complications (SD = 15.4) and 61 years in those without complications (SD = 12.8). Likewise, the median BMI was 24kg/m2 in those complications (SD = 3.8) and 20kg/m2 in those with no complications (SD = 2.6).

According to the adopted complications stratification, non-relevant complications occurred in only 16.7% of the procedures. Because they are rare and of no clinical relevance, a more detailed analysis was not performed. For relevant complications univariate analysis results showed greater morbidity when comparing the use of ultrasonic scissors to the use of bipolar scissors (p=0.01 OR=13 ; 95% CI : 1.3-125). These results were confirmed by multivariate analysis (p=0.03 OR=13, 95% CI : 1.2-140). Although the surgical approach (laparoscopic versus laparotomy) has shown borderline statistical significance in univariate analysis, this was not confirmed by multivariate analysis.

In relation to serious complications, univariate analysis suggests a significantly higher morbidity when using stapler compared to bipolar scissors (p=0.01 40% and 5.5%, respectively). These results were confirmed by multivariate analysis (p=0.01 OR=10.9 ; 95% CI : 1.72 to 69.2).

The same occurred with the variable "concomitant abdominal operation", whose results also suggest higher morbidity when these procedures were performed, comparing to when they were not performed (p=0.03 50% and 14%, respectively), which also was confirmed by multivariate analysis (p=0.04 OR=7.6; 95% CI : 1.05-54.7).

Other variables analyzed included surgical approach (laparotomy vs. Laparoscopic) and time of interventions (1994-2001 versus 2002-2008). Although both variables have shown borderline significance in univariate analysis, this was not confirmed by multivariate analysis.

DISCUSSION

The LPR procedures are considered safe, with a mortality rate close to zero in specialized centers1-3,7,11,12,24-29, hampering the studies of predictors of postoperative mortality. Nonetheless, there is important associated postoperative morbidity, especially pancreatic fistulas7,17,28-33, rendering such an assessment of risk factors doable and of great clinical interest.

To conduct these types of analyzes it is essential that you use standardized definitions of morbidity7,10,14-18,21. Before the publication of DeOliveira14, morbidity settings used were the most diverse, explaining results variability. It was only after the adoption of uniform definitions of morbidity that the assessment of these events became more accurate. Some of these previously investigated potential predictors are: underlying pancreatic disease ; the role of spleen preservation12,29,30; use of somatostatin derivatives; different section techniques of the pancreatic parenchyma5,10,21; and others4,8,20.

Goh et al. reported overall morbidity of 47%, including PF in 31% of cases. About PF, pancreatic duct ligation and splenectomy were predictive factors12. Ferrone et al. reported PF rates of 29%. In this series, the pancreatic stump was sectioned with a scalpel blade in 49%, and by stapler in 19%, of cases. Contrary to the section of the pancreatic parenchyma, which in this study was not a predictor of PF, BMI (> 30kg/m2) and the occurrence of concomitant abdominal operation were confirmed as such11.

Regarding the method of parenchymal section, various techniques are described, two of which stand out for being the most frequently used: the stapling (cutting and stapling with mechanical stapler) and cold blade section (scalpel or scissors)5,7,10,11. Kleef et al. showed that the adoption of stapler section as a predictive factor for PF (p = 0.003). These authors reported an incidence of PF after using staplers of approximately twice as the ones with scalpel blade section (OR=2.56 ; 95% CI: 1.18-5.93)21. However, their definition of PF was more selective than the one of ISGPF15. Conversely, a meta-analysis showed results in favor of the stapling technique (lower PF incidence) as compared to the scalpel7. Nevertheless, these results were influenced by the inclusion of small studies and other methodological limitations of the study (selection bias and heterogeneous definitions of morbidity).

In the present study, although 55% of the procedures have resulted in complications, serious events, including severe fistulas, occurred in only 20% and 6%, respectively. The handling of these events was limited to percutaneous drainage in 70% of cases, reaching 80% in the case of fistulas. As justification for the choice of the subgroup of patients undergoing Pd procedures for analysis of predictive factors, we believe that if we included all the LPRs, such results would be hampered by the heterogeneity of surgical procedures and other related confounders. In addition, the Pd group proved to be representative of the LPR total group (Table 1).

Regarding the predictive factors identified, BMI and the performance of concomitant abdominal operation were confirmed as predictors of overall and severe complications, similar to the result reported by Ferrone et al.11.

The results of this study also suggest that the use of ultrasonic scissors correlated with incidence almost ten times greater of complications (general morbidity) than the use of a cold blade. The same is true when comparing the use of the stapler with the use of cold blade in relation to the outcome serious complications. Additionally, performing other abdominal operation resulted in a incidence almost eight times higher of serious complications when compared to only pancreatectomy. To explain these results, some details of the studied cohort of patients should be mentioned (Table 1): approximately half of the procedures were performed laparoscopically; spleen preservation was obtained in about 80% of LPRs (n = 80); 95% of Pds (n = 62) and, when the splenic artery was preserved, in 58.5% of Pds (n = 38). Malignant tumors accounted for approximately 65% of the lesions operated, demonstrating the position of authors in favor of a laparoscopic approach for resection also of malignant pancreatic tumors9,13. This attitude contrasts with most of the other published series, in which the laparoscopic approach has rarely prevailed1,3,11,12,14,21,27-33, there is a lower rate of splenic preservation and malignant tumors do not predominate13.

Regarding study limitations, the retrospective nature inevitably incurs in a selection bias. The small study population prevents identification of small differences in the multivariate analysis (type 2 error). Such error could only be avoided when designing a controlled clinical trial.

Based on the results of this study, it can be concluded that age, BMI and concomitant abdominal operation proved to be predictors of morbidity after distal pancreatectomy with spleen preservation. In addition, the method of section of the pancreatic parenchyma was a relevant predictive factor for serious complications, which allows authors to prefer the use of blade over other techniques. Due to its design methodology, this study should be considered a pilot study, and the analysis of larger, multicenter cohorts should be encouraged to confirm the directions toward which the results of this study point.

REFERENCES

  • 1. Lillemoe KD, Kaushal S, Cameron JL, Sohn TA, Pitt HA, Yeo CJ. Distal pancreatectomy: indications and outcomes in 235 patients. Ann Surg. 1999;229(5):693-8; discussion 698-700.
  • 2. Adam U, Makowiec F, Riediger H, Trzeczak S, Benz S, Hopt UT. Distal pancreatic resectionindications, techniques and complications. Zentralbl Chir. 2001;126(11):908-12.
  • 3. Balcom JH 4th, Rattner DW, Warshaw AL, Chang Y, Fernandez-del Castillo C. Ten-year experience with 733 pancreatic resections: changing indications, older patients, and decreasing length of hospitalization. Arch Surg. 2001;136(4):391-8.
  • 4. Fahy BN, Frey CF, Ho HS, Beckett L, Bold RJ. Morbidity, mortality, and technical factors of distal pancreatectomy. Am J Surg. 2002;183(3):237-41.
  • 5. Takeuchi K, Tsuzuki Y, Ando T, Sekihara M, Hara T, Kori T, et al. Distal pancreatectomy: is staple closure beneficial? ANZ J Surg. 2003;73(11):922-5.
  • 6. Christein JD, Kendrick ML, Iqbal CW, Nagornev DM, Farnell MB. Distal pancreatectomy for resectable adenocarcinoma of the body and tail of the pancreas. J Gastrointest Surg. 2005;9(7):922-7.
  • 7. Knaebel HP, Diener MK, Wente MN, Büchler MW, Seiler CM. Systematic review and meta-analysis of technique for closure of the pancreatic remnant after distal pancreatectomy. Br J Surg. 2005;92(5):539-46.
  • 8. Pannegeon V, Pessaux P, Sauvanet A, Vullierme MP, Kianmanesh R, Belghiti J. Pancreatic fistula after distal pancreatectomy: predictive risk factors and value of conservative treatment. Arch Surg. 2006;141(11):1071-6; discussion 1076
  • 9. Palanivelu C, Shetty R, Jani K, Sendhilkumar K, Rajan PS, Maheshkumar GS. Laparoscopic distal pancreatectomy: results of a prospective non-randomized study from a tertiary center. Surg Endosc. 2007;21(3):373-7.
  • 10. Ridolfini MP, Alfieri S, Gourgiotis S, Di Miceli D, Rotondi F, Quero G, et al. Risk factors associated with pancreatic fistula after distal pancreatectomy, which technique of pancreatic stump closure is more beneficial? World J Gastroenterol. 2007;13(38):5096-100.
  • 11. Ferrone CR, Warshaw AL, Rattner DW, Berger D, Zheng H, Rawal B, et al. Pancreatic fistula rates after 462 distal pancreatectomies: staplers do not decrease fistula rates. J Gastrointest Surg. 2008;12(10):1691-7; discussion 1697-8.
  • 12. Goh BK, Tan YM, Chung YF, Cheow PC, Ong HS, Chan WH, et al. Critical appraisal of 232 consecutive distal pancreatectomies with emphasis on risk factors, outcome, and management of the postoperative pancreatic fistula: a 21-year experience at a single institution. Arch Surg. 2008;143(10):956-65.
  • 13. Briggs CD, Mann CD, Irving GR, Neal CP, Peterson M, Cameron IC, et al. Systematic review of minimally invasive pancreatic resection. J Gastrointest Surg. 2009;13(6):1129-37.
  • 14. DeOliveira ML, Winter JM, Schafer M, Cunningham SC, Cameron JL, Yeo CK, et al. Assessment of complications after pancreatic surgery: A novel grading system applied to 633 patients undergoing pancreaticoduodenectomy. Ann Surg. 2006;244(6):931-7; discussion 937-9.
  • 15. Bassi C, Dervenis C, Butturini G, Fingerhut A, Yeo C, Izbicki J, et al. Postoperative pancreatic fistula: an international study group (ISGPF) definition. Surgery. 2005;138(1):8-13.
  • 16. Bassi C, Butturini G, Molinari E, Mascetta G, Salvia R, Falconi M, et al. Pancreatic fistula rate after pancreatic resection. The importance of definitions. Dig Surg. 2004;21(1):54-9.
  • 17. Behrman SW, Rush BT, Dilawari RA. A modern analysis of morbidity after pancreatic resection. Am Surg. 2004;70(8):675-82; discussion 682-3.
  • 18. Dindo D, Demartines N, Clavien PA. Classification of surgical complications: a new proposal with evaluation in a cohort of 6336 patients and results of a survey. Ann Surg. 2004;240(2):205-13.
  • 19. Martin RC 2nd, Brennan MF, Jaques DP. Quality of complication reporting in the surgical literature. Ann Surg. 2002;235(6):803-13.
  • 20. Sledzianowski JF, Duffas JP, Muscari F, Suc B, Fourtanier F. Risk factors for mortality and intra-abdominal morbidity after distal pancreatectomy. Surgery. 2005;137(2):180-5.
  • 21. Kleeff J, Diener MK, Z'graggen K, Hinz U, Wagner M, Bachmann J, et al. Distal pancreatectomy: risk factors for surgical failure in 302 consecutive cases. Ann Surg. 2007;245(4):573-82.
  • 22. Pierce RA, Spitler JA, Hawkins WG, Strasberg SM, Linehan DC, Halpin VJ, et al. Outcomes analysis of laparoscopic resection of pancreatic neoplasms. Surg Endosc. 2007;21(4):579-86.
  • 23. Fernández-del Castillo C, Rattner DW, Warshaw AL. Standards for pancreatic resection in the 1990s. Arch Surg. 1995;130(3):295-9; discussion 299-300.
  • 24. Büchler MW, Friess H, Wagner M, Kulli C, Wagener V, Z'Graggen K. Pancreatic fistula after pancreatic head resection. Br J Surg. 2000;87(7):883-9.
  • 25. McClusky DA 3rd, Skandalakis LJ, Colborn GL, Skandalakis JE. Harbinger or hermit? Pancreatic anatomy and surgery through the agespart 3. World J Surg. 2002;26(12):1512-24.
  • 26. Büchler MW, Wagner M, Schmied BM, Uhl W, Friess H, Z'graggen K. Changes in morbidity after pancreatic resection: toward the end of completion pancreatectomy. Arch Surg. 2003;138(12):1310-4; discussion 1315.
  • 27. Resnick AS, Drebin JA. Distal pancreatectomy. In: Lowy AM, Leach SD, Philip P, editors. Pancreatic cancer. New York: Springer; 2008. p.341-50.
  • 28. Dimick JB, Welch HG, Birkmeyer JD. Surgical mortality as an indicator of hospital quality: the problem with small sample size. JAMA. 2004;292(7):847-51.
  • 29. Carrère N, Abid S, Julio CH. Spleen-preserving distal pancreatectomy with excision of splenic artery and vein: a case-matched comparison with conventional distal pancreatectomy with splenectomy. World J Surg. 2007;31(2):375-82.
  • 30. Kah Heng CA, Salleh I, San TS, Ying F, Su-Ming T. Pancreatic fistula after distal pancreatectomy: incidence, risk factors and management. ANZ J Surg. 2010;80(9):619-23.
  • 31. Yoshioka R, Saiura A, Koga R, Seki M, Kishi Y, Morimura R, et al. Risk factors for clinical pancreatic fistula after distal pancreatectomy: analysis of consecutive 100 patients. World J Surg. 2010;34(1):121-5.
  • 32. Reeh M, Nentwich MF, Bogoevski D, Koenig AM, Gebauer F, Tachezy M, et al. High surgical morbidity following distal pancreatectomy: still an unsolved problem. World J Surg. 2011;35(5):1110-7.
  • 33. Subhedar PD, Patel SH, Kneuertz PJ, Maithel SK, Staley CA, Sarmiento JM, et al. Risk factors for pancreatic fistula after stapled gland transection. Am Surg. 2011;77(8):965-70.
  • Endereço para correspondência:
    Fábio Athayde Veloso Madureira
    E-mail:
  • Publication Dates

    • Publication in this collection
      21 Jan 2013
    • Date of issue
      Dec 2012

    History

    • Received
      22 Apr 2012
    • Accepted
      06 July 2012
    Colégio Brasileiro de Cirurgiões Rua Visconde de Silva, 52 - 3º andar, 22271- 090 Rio de Janeiro - RJ, Tel.: +55 21 2138-0659, Fax: (55 21) 2286-2595 - Rio de Janeiro - RJ - Brazil
    E-mail: revista@cbc.org.br