SciELO - Scientific Electronic Library Online

 
vol.45 número6Fatores associados a não reconstrução do trânsito intestinal em pacientes com câncer retal submetidos à ressecção anterior do reto e ileostomia de proteção.Papel da ultrassonografia endoscópica na avaliação da fístula perianal na doença de Crohn. índice de autoresíndice de assuntospesquisa de artigos
Home Pagelista alfabética de periódicos  

Serviços Personalizados

Journal

Artigo

Indicadores

Links relacionados

Compartilhar


Revista do Colégio Brasileiro de Cirurgiões

versão impressa ISSN 0100-6991versão On-line ISSN 1809-4546

Rev. Col. Bras. Cir. vol.45 no.6 Rio de Janeiro  2018  Epub 20-Dez-2018

http://dx.doi.org/10.1590/0100-6991e-20181995 

Original Article

Risk factors for elective laparoscopic cholecystectomy morbimortality in elderly.

Andréa Renata Machado Mesquita1 

Antonio Carlos Iglesias, ECBC-RJ2 

1 Federal University of Rio de Janeiro State (UNIRIO), Gaffree e Guinle Universitary Hospital (HUGG), Anesthesiology Service, Rio de Janeiro, RJ, Brazil.

2 Federal University of Rio de Janeiro State (UNIRIO), Gaffree e Guinle Universitary Hospital (HUGG), General and Digestive Surgery Service, Rio de Janeiro, RJ, Brazil.

ABSTRACT

Objective:

to identify risk factors for the occurrence of postoperative complications in laparoscopic cholecystectomies (LC) in elderly patients.

Methods:

an observational study with analysis of medical records of patients aged 60 years and older, submitted to elective LC at Gaffree e Guinle Universitary Hospital, from 2006 to 2018. Surgeries performed on an emergency basis or converted to the conventional technique were excluded from our study.

Results:

a total of 345 patients were included in our study, being 80% females and 62% aged 60-69 years. There were 39 cases of postoperative complications (11.3%), mostly (87%) classified as grades I or II of Clavien-Dindo surgical complication scale. There was only one death. The presence and the number of coexisting diseases and ASA II or III physical status classification of preoperative patients conferred a greater risk for the development of postoperative complications and mortality.

Conclusion:

our study identified the presence of coexisting diseases, as well as their severity, according to ASA classification, as risk factors for the development of postoperative complications of LC in elderly patients. However, LC proved to be a safe technique when used in these patients with low morbidity and mortality rates.

Keywords: Cholecystectomy, Laparoscopic; Health of the Elderly; Cholelithiasis; Gallstones; Postoperative Complications

INTRODUCTION

The world has been undergoing a change in the demographic profile represented by the aging of the population, a phenomenon of great impact for contemporary society. Although scientific and technological advances have increased life expectancy, the cure for many chronic diseases has not been achieved yet. These conditions lead to different degrees of physical incapacity, as well as to the increase in health costs. In Brazil, between 2005 and 2015, there was a population increase from 9.8% to 14.3% in the age range of 60 years and above. According to the projections of the World Health Organization (WHO), Brazil will be the sixth country in the world with the largest number of elderly people by 20251-3.

Cholelithiasis is a common disease whose prevalence increases with age in both sexes4,5. Thus, in the seventh decade of life, 35% of women and 20% of men have gallbladder stones. Due to this high prevalence, cholelithiasis is the most common intra-abdominal disease in the operating room6, among elderly patients.

Despite some initial resistance in the use of laparoscopic technique for cholecystectomy in elderly, nowadays this type of treatment is considered the gold standard7,8. Recent studies have shown that the advantages of the minimally invasive technique are also observed when it is applied in elderly patients9-12. Thus, it is necessary to seek in the group of elderly patients the identification of peculiarities that may interfere on the operative result, when the laparoscopic technique is used.

The present study aims to identify possible risk factors for postoperative morbimortality in patients aged 60 years and older, submitted to laparoscopic cholecystectomy (LC) at a universitary hospital in Rio de Janeiro city, RJ state.

METHODS

Observational study with a case-series analysis of cases recruited between February 2006 and May 2018. The sample was defined by convenience, selecting all the patients that met the inclusion criteria: patients aged 60 years and older, submitted to elective LC which was not converted to conventional laparotomy, and operated by the team of “Clínica Cirúrgica A” (“Surgical Clinic A”) of HUGG (Gaffree e Guinle Universitary Hospital), located in Rio de Janeiro city, RJ state.

The following data were obtained from the medical records: age, gender, physical status classification according to the American Society of Anesthesiologists (ASA), number of coexisting diseases, duration of operation in minutes, time of postoperative hospitalization, presence of postoperative complications and their severity according to Clavien-Dindo Classification (CDC).

For data analysis, the proportion differences in the frequency distributions of categorical variables of interest were performed using the Chi-square test and Fisher’s exact test (two-sided). For continuous variables, measures of central tendency (mean and median) and of dispersion (standard deviation, quartiles, and amplitude) were performed, calculating the statistical differences by means of the Student’s t-test. For graphical presentation, the box-plot graph was chosen. Median differences were statistically evaluated using the non-parametric Mann-Whitney test to compare two groups and the non-parametric Kruskal-Wallis test to compare three groups. Values of p<0.05 were considered statistically significant. The association magnitude was examined by unconventional logistic regression, with odds ratio (OR) and their respective confidence intervals (95% CI) obtained. All analyzes were performed in SPSS 17.0 (Statistical Package for the Social. Sciences, SPSS Inc., Chicago, IL, USA, 2008).

The research was authorized by the Research Ethics Committee of HUGG-UNIRIO, CAAE 54448316.5.0000.5258.

RESULTS

A total of 345 patients underwent LC during the evaluated period. Regarding gender, 80% of the sample were females. The majority of the patients were concentrated in the age group of 60-69 years (62%). The elderly group aged 80 years or above represented only 7.8% of the sample (Table 1).

Table 1 Epidemiological variables of patients submitted to laparoscopic cholecystectomy 

Variable n (%)
Gender
Female 276 (80.0)
Male 69 (20.0)
Age (years)
60-69 214 (62.1)
70-79 104 (30.1)
≥80 27 (7.8)
Number of morbidities
0 53 (15.4)
1 184 (53.3)
2 90 (26.1)
≥3 18 (5.2)
ASA
I 53 (15.4)
II 267 (77.4)
III 25 (7.2)
Surgical complications
No 306 (88.7)
Yes 39 (11.3)
Hospitalization period (days)
1 314 (91.0)
2 23 (6.7)
≥3 8 (2.3)
Surgery duration (minutes)
≤30 1 (0.3)
31-60 79 (22.9)
61-90 137 (39.7)
91-120 66 (19.1)
>120 62 (18.0)

Regarding the presence of coexisting diseases, 292 patients (84.6%) presented, at least, one comorbidity. Present in 259 patients (75%), systemic arterial hypertension (SAH) was the most frequent coexisting disease. Although there had been a high prevalence of comorbidities, most patients were classified as ASA II (77.4%) and no patient was classified as ASA IV. The majority of the patients (91%) were hospitalized for a maximum of 24 hours postoperatively. Only eight patients (2.3%) were hospitalized for three days or more. The group with surgical duration between 61 and 90 minutes concentrated the majority of the patients (39.7%) (Table 1).

The frequency of complications was low, occurring in only 11.3% of the cases. The majority were grades I and II, according to CDC scale. During the study period, there was only one death, caused by acute myocardial infarction. There was no statistically significant difference when comparing patients’ gender and the presence of complications (p=0.73), nor when comparing age and the presence of complications (p=0.36) (Table 2).

Table 2 Comparison between surgical complication and selected variables. 

Variable Surgical complication
No (%) Yes (%) p-value*
Gender
Female 244 (79.7) 32 (82.1) 0.73
Male 62 (20.3) 7 (17.9)
Age (years)
60-69 190 (62.1) 24 (61.5) 0.36
70-79 90 (29.4) 14 (35.9)
≥80 26 (8.5 1 (2.6)
ASA
I 53 (17.4) 0 (0.0) 0.01
II 233 (76.1) 34 (87.2)
III 20 (6.5) 5 (12.8)
Number of morbidities
0 53 (17.3) 0 (0.0) 0.04
1 160 (52.3) 24 (61.5)
2 77 (25.2) 13 (33.3)
≥3 16 (5.3) 2 (5.2)
Hospitalization period (days)
1 292 (95.4) 22 (56.4) <0.001
2 14 (4.6) 9 (23.1)
≥3 0 (0.0) 8 (20.5)
Total 306 (100) 39 (100)

*Chi-square test or Fisher’s exact test. Statistically significant values: p<0.05.

When analyzing patients with coexisting diseases, it was possible to identify a higher prevalence in the group of complications (100%) when compared to the group without complications (82.7%), being this difference statistically significant (p=0.04). It was also possible to observe significant differences between the groups with and without complications and ASA classification (p=0.01) (Table 2).

When the association magnitude was evaluated, we observed a statistically significant increase in complication risk with ASA II patients (OR=7.6; CI:1.02-56.7) and ASA III patients (OR=13.1; CI:1.43-118.3) when compared to ASA I patients (Table 3). Estimates were also positive for the number of comorbidities and the presence of complications, with the chance being increased 7.6 and 8.9 times for the groups of patients with one and two comorbidities, respectively, when compared to the group of patients without coexisting diseases. Surgical duration also presented statistically significant positive risk estimates (Table 3). The median surgical duration of the group with complications was greater (105 minutes) than that of the group without complications, being this difference statistically significant (p=0.02). When comparing the median surgical durations of the age groups, there was no statistically significant difference (p=0.16) among the three evaluated strata (Figure 1).

Table 3 Risk estimates for surgical complication in patients submitted to laparoscopic cholecystectomy. 

Varible Surgical complication
No (%) Yes (%) Gross odds ratio(95% CI)*
ASA
I 53 (17.4) 0 (0.0) 1.00
II 233 (76.1) 34 (87.2) 7.6 (1.02-56.7)
III 20 (6.5) 5 (12.8) 13.1 (1.43-118.3)
Number of morbidities
0 53 (17.3) 0 (0.0) 1.00
1 160 (52.3) 24 (61.5) 7.6 (1.02-57.8)
2 77 (25.2) 13 (33.3) 8.9 (1.14-70.5)
≥3 16 (5.3) 2 (5.2) 6.6 (0.56-77.9)
Hospitalization period (days)
1 292 (95.4) 22 (56.4) 1.00
2 14 (4.6) 9 (23.1) 8.5 (3.31-21.8)
≥3 0 (0.0) 8 (20.5) 105.8 (12.66-884.7)
Total 306 (100) 39 (100)

*Risk estimates calculated through unconditional logistic regression.

Figure 1 Relationship between surgical complication/age and surgical duration in patients submitted to video-laparoscopic cholecystectomy. Sample comparison - non-parametric Mann-Whitney test (p=0.02) for surgical duration x complications and non-parametric Kruskal–Wallis test (p=0.16) for surgical duration x age. 

DISCUSSION

The progressive increase of the elderly population is also reflected in the operating rooms13. Although advanced age in itself has never been considered contraindication for surgical procedures14, it is natural to attribute to the elderly patient an increased risk of perioperative complications. The reduction of physiological reserves, generating or not generating fragility syndrome, as well as the increase in the prevalence and severity of coexisting diseases, turn the elderly patient into a more vulnerable target to stress triggered by acute events and traumas15. Studies demonstrate that the endocrine-metabolic and inflammatory response to surgical trauma is high in the elderly, with a consequent increase in the systemic inflammatory response in the post-LC period16.

A study conducted in Italy4 with patients aged 60 years or older, corroborated other studies17,18, which confirmed the presence of gallstones associated with age increase, being more evident in females when compared to males. In the present study, the majority of individuals were between 60 and 69 years of age, with a predominance of females in the three age groups. Clinical presentation in elderly patients is usually not very symptomatic or even silent, with the elderly seeking medical treatment when cholelithiasis already presents complications, such as biliary pancreatitis or acute cholecystitis. Periods of acute gallbladder inflammation can be catastrophic for elderly patients, generating cases of great intraoperative technical difficulty, many times leading to conversion to traditional surgery, using the conventional technique19. In addition, surgeries in the elderly are associated with higher rates of mortality and length of hospital stay, especially in patients in the older age group20,21.

Surgery is the best form of cholelithiasis treatment, and the laparoscopic technique is currently considered the gold standard7. Two decades ago, when laparoscopic surgeries began to be performed in Brazil, there was some fear of performing this procedure in the elderly. At that time, the need for pneumoperitoneum and the prolonged surgical duration were challenges for these patients. With the diffusion of LC, shortening of surgical time, improvement of the available anesthetic technique, and better knowledge of the physiological changes resulting from this procedure, it was possible to extend the age limits of the patients and the indication for laparoscopy. Antoniou et al.22 performed a meta-analysis that demonstrated a trend towards better outcomes related to morbimortality when LC was the used technique to treat cholelithiasis in the elderly.

In the present study, we sought to identify possible risk factors associated with morbimortality in elderly patients undergoing LC. The prevalence of complications was low (11.3%), following world's statistics5,23-25. Only one death was observed (0.29%), representing a low mortality rate, similar to other studies10,24,26,27. The severity of the complications was assessed using CDC28. Initially described for cholecystectomies, this classification has already been adapted for numerous surgical procedures, proving to be an easy-to-use and understand tool. In this work, 39 cases with complications were identified, of which 34 were classified to grade I (51%) or grade II (36%) in CDC, that is, those represented by episodes such as vomiting, urinary retention, surgical wound infection, and postoperative delirium, among others, and that did not interfere in the patients’ postoperative result. Only four patients (10%) presented complications classified to grade IIIa, none of them requiring treatment under general anesthesia. The death occurred due to acute myocardial infarction in the immediate postoperative period, evolving to a fatal outcome within the first 72 hours (grade V in CDC).

None of the patients classified as ASA I presented complications, that is, all complications occurred in patients with at least one comorbidity. The presence of associated diseases is extremely common in the elderly29. According to the results of a study carried out in our institution30, 87% of the elderly surgical population presented one or more coexisting diseases, a fact also found in our results (84.6%). The majority of participants with complications were assessed as ASA II (87.2%), that is, mild systemic disease, without significant limitations. However, ASA III physical status classification had an even greater chance of complication. In the present study, there was no patient classified as ASA IV, although this had not been an exclusion criterion. Perhaps those patients with worse general health conditions were taken to surgery only in emergency situations, using conventional technique, or were submitted to conservative treatment. The simplicity of ASA classification and its use by other medical specialties besides anesthesiology overlap with its intrinsic subjectivity, expanding its use worldwide, in several studies that seek to evaluate the risk of perioperative morbimortality.

Among the coexisting diseases, SAH is the most frequent one. In the present study, 259 patients (75% of the evaluated individuals) had SAH, an expressive prevalence among patients with and without complications. Among the individuals with complications, 35 (89.7%) presented SAH diagnosis. Massie et al.29 identified that SAH was the most frequent disease in patients undergoing cholecystectomy. Diabetes mellitus was the second most common comorbidity in this study, although present only in seven patients with complications (18%). Since all patients with complications presented some comorbidity, it is suggestive to consider that the presence of coexisting diseases is a risk factor for morbidity23,25. In the results of this study, there was a progressive increase in the chance of complications, with the increase in the number of comorbidities. However, when analyzing the presented complications, it was not possible to necessarily verify the relationship between the occurrence of postoperative complication and the type of comorbidity present. This fact may suggest that the presence of coexisting diseases indicate a fragile organism, more subjected to the effects of the surgical trauma, regardless of the type of associated disease.

After analyzing the data, it was observed that a greater severity, classified as ASA III, and a greater number of associated diseases gave a higher risk for postoperative complications. It is known that the presence of diseases makes the organism of the elderly even more susceptible to imbalances that can be caused by trauma and to the consequent endocrine-metabolic and inflammatory response to surgical trauma. Although LC, due to its minimally invasive characteristics, results in a lower endocrine-metabolic and inflammatory response, the elderly still present high inflammation markers in the immediate postoperative period16.

Another factor that may play a role in the appearance of complications is surgical duration19. In our study, this parameter did not differ among the three age groups. However, the cases with postoperative morbimortality had longer surgical time. One possible explanation is the fact that prolonged surgical duration generates more trauma, what leads to the appearance of complications.

Of the total number of studied cases, most of the patients (91%) required a 24-hour postoperative hospitalization. However, when we observed patients who presented complications, 46.6% had hospitalization time of two or more days. This fact demonstrates the economic importance of tracking patients who are more likely to develop complications in order to avoid them or at least minimize this risk. There are studies already demonstrating the feasibility and safety of LC in aged outpatients25.

In the elderly, morbidity after LC is apparently more associated with the operation and severity degree of previous biliary disease than with chronological age itself12,21. Elderly patients are among those who most benefit from the minimally invasive characteristic of the laparoscopic approach, with its low systemic repercussion, lower potential for pain perception, and faster and more effective return to daily activities. The elderly population submitted to LC in our hospital presented a behavior that did not differ from that found in medical literature12,22.

In view of the results, this study was able to identify the presence and number of coexisting diseases, as well as their severity according to ASA classification, as risk factors for the development of complications in elderly patients after LC. When used in these patients, LC was shown to be a safe technique since the incidence of morbimortality was low and the presented complications were classified as low-severity. Thus, it may be recommended that efforts be aimed at optimizing the control of the associated diseases in the preoperative period, in order to minimize the possibility of developing complications.

Source of funding: none.

REFERENCES

1 Instituto Brasileiro de Geografia e Estatística [Internet]. Rio de Janeiro (RJ): IBGE; 2010. Censo 2010; [citado 2017 out 30]. Disponível em: http://www.ibge.gov.brLinks ]

2 OMS/WHO. Envelhecimento ativo: uma política de saúde. Brasília: Organização Pan-Americana de Saúde; 2005. [ Links ]

3 United Nations, Department of Economic and Social Affairs. World population ageing 2017: highlights. New York: United Nations; 2017. [ Links ]

4 Lirussi F, Nassuato G, Passera D, Toso S, Zawnando B, Monica F, et al. Gallstone disease in an elderly population: the Silea study. Eur J Gastroenterol Hepatol. 1999;11(5):485-91. [ Links ]

5 Rubert CP, Higa RA, Farias FVB. Comparação entre colecistectomia eletiva aberta e laparoscópica em idosos, em um hospital escola. Rev Col Bras Cir. 2016;43(1):2-5. [ Links ]

6 Novello M, Gori D, Di Saverio S, Bianchin M, Maestri L, Mandarino FV, et al. How safe is performing cholecystectomy in the oldest old? A 15-year retrospective study from a single institution. World J Surg. 2018;42(1):73-81. [ Links ]

7 Schirmer BD, Edge SB, Dix J, Hyser MJ, Hanxs JB, Jones RS. Laparoscopic cholecystectomy. Treatment of choice for symptomatic cholelithiasis. Ann Surg. 1991;213(6):665-76; discussion 677. [ Links ]

8 Arthur JDR, Edwards PR, Chagla LS. Management of gallstone disease in the elderly. Ann R Coll Surg Engl. 2003;85(2):91-6. [ Links ]

9 Serband D, Branescu C, Savlovschi C, Purcarea AP, El-Khatib A, Balasescu AS, et al. Laparoscopic cholecystectomy in patients aged 60 years and over - our experience. J Med Life. 2016;9(6):358-62. [ Links ]

10 Irojah B, Bell T, Grim R, Martin J, Ahuja V. Are they too old for surgery? Safety of cholecystectomy in superelderly patients (= Age 90). Perm J. 2017;21. doi: 10.7812/TPP/16-013. [ Links ]

11 Bhandari TR, Shahi S, Bhandari R, Poudel R. Laparoscopic cholecystectomy in the elderly: an experience at a tertiary care hospital in Western Nepal. Surg Res Pract. 2017;2017:8204578. [ Links ]

12 Agrusa A, Romano G, Frazzetta G, Chianetta D, Sorce V, Di Buono G, et al. Role and outcomes of laparoscopic cholecystectomy in the elderly. Int J Surg. 2014;12 Suppl 2:S37-S39. [ Links ]

13 Murthy S, Hepner DL, Cooper Z, Bader AM, Neuman MD. Controversies in anaesthesia for noncardiac surgery in older adults. Br J Anesth. 2015;115 Suppl 2:ii15-25. [ Links ]

14 Cheng EY, Wang-Cheng RM. Impact of aging on preoperative evaluation. J Clin Anesth. 1991;3(4):324-43. [ Links ]

15 Lees MC, Merani S, Tauh K, Khadaroo RG. Perioperative factors predicting poor outcome in elderly patients following emergency general surgery: a multivariate regression analysis. J Can Surg. 2015;58(5):312-7. [ Links ]

16 Fialho L, Cunha-e-Silva JA, Santa-Maria AF, Madureira FA, Iglesias AC. Estudo comparativo da resposta inflamatória sistêmica no pós-operatório precoce entre pacientes idosos e não idosos submetidos à colecistectomia videolaparoscópica. Rev Col Bras Cir. 2018;45(1):e1586. [ Links ]

17 Siegel JH, Kasmin FE. Biliary tract disease in the elderly: management and outcomes. Gut. 1997;41(4):433-5. [ Links ]

18 Bergman S, Sourial N, Vedel I, Hanna WC, Fraser AS, Newman D, et al. Gallstone disease in the elderly: are older patients managed differently? Surg Endosc. 2011;25(1):55-61. [ Links ]

19 Kauvar DS, Brown BD, Braswell AW, Harnisch M. Laparoscopic cholecystectomy in the elderly: increased operative complications and conversions to laparotomy. J Laparoendosc Adv Surg Tech A. 2005;15(4):379-82. [ Links ]

20 Kuy S, Sosa JA, Roman SA, Desai R, Rosenthal RA. Age matters: a study of clinical and economic outcomes following cholecystectomy in the elderly Americans. Am J Surg. 2011;201(6):789-96. [ Links ]

21 Lupinacci RM, Nadal LR, Rego RE, Dias AR, Marcari RS, Lupinacci RA, et al. Surgical management of gallbladder disease in the very elderly: are we operating them at the right time? Eur J Gastroenterol Hepatol. 2013;25(3):380-4. [ Links ]

22 Antoniou SA, Antoniou GA, Koch OO, Pointer R, Granderath FA. Meta-analysis of laparoscopic vs open cholecystectomy in elderly patients. World J Gastroenterol. 2014;20(46):17626-34. [ Links ]

23 Pelavski AD, De Miguel M, Alcaraz Garcia-Tejedor G, Villarino L, Lacasta A, Señas L, et al. Mortality, geriatric, and nongeriatric surgical risk factors among the eldest old: a prospective observational study. Anesth Analg. 2017;125(4):1329-36. [ Links ]

24 Bates AT, Divino C. Laparoscopic surgery in the elderly: a review of the literature. Aging Dis. 2015;6(2):149-55. [ Links ]

25 Rao A, Polanco A, Qiu S, Kim J, Chin EH, Divino CM, et al. Safety of outpatient laparoscopic cholecystectomy in the elderly: analysis of 15,248 patients using NSQIP database. J Am Coll Surg. 2013;217(6):1038-43. [ Links ]

26 Saxe A, Lawson J, Phillips E. Laparoscopic cholecystectomy in patients aged 65 or older. J Laparoendosc Surg. 1993;3(3):215-9. [ Links ]

27 Minossi JG, Picanço HC, Carvalho MA, Paulucci PRV, Vendites S. Morbimortalidade da colecistectomia em pacientes idosos, operados pelas técnicas laparotômica, minilaparotômica e videolaparoscópica. ABCD Arq Bras Cir Dig. 2007;20(2):93-6. [ Links ]

28 Moreira LF, Pessôa MCM, Mattana DS, Schmitz FF, Volkweis BS, Antoniazzi JL, et al. Adaptação cultural e teste da escala de complicações cirúrgicas de Clavien-Dindo traduzida para o Português do Brasil. Rev Col Bras Cir. 2016;43(3):141-8. [ Links ]

29 Massie MT, Massie LB, Marrangoni AG, D’Amico FJ, Sell HW Jr. Advantages of laparoscopic cholecystectomy in the elderly and in patients with high ASA classification. J Laparoendosc Surg. 1993;3(5):467-76. [ Links ]

30 Santos ML, Novaes CO, Iglesias AC. Perfil epidemiológico de pacientes atendidos no ambulatório de avaliação pré-anestésica de um hospital universitário. Rev Bras Anesthesiol. 2017;67(5):457-67. [ Links ]

Received: September 03, 2018; Accepted: October 31, 2018

Mailing address: Andréa Renata Machado Mesquita E-mail: andrearenata2000@yahoo.com.br / iglesiasacrg@gmail.com

Conflict of interest: none.

Creative Commons License Este é um artigo publicado em acesso aberto (Open Access) sob a licença Creative Commons Attribution, que permite uso, distribuição e reprodução em qualquer meio, sem restrições desde que o trabalho original seja corretamente citado.