Acessibilidade / Reportar erro

Determination of inhibition in the enzymatic hydrolysis of cellobiose using hybrid neural modeling

Abstract

Neural networks and hybrid models were used to study substrate and product inhibition observed in the enzymatic hydrolysis of cellobiose at 40ºC, 50ºC and 55ºC, pH 4.8, using cellobiose solutions with or without the addition of exogenous glucose. Firstly, the initial velocity method and nonlinear fitting with Statistica<FONT FACE=Symbol>Ò</FONT> were used to determine the kinetic parameters for either the uncompetitive or the competitive substrate inhibition model at a negligible product concentration and cellobiose from 0.4 to 2.0 g/L. Secondly, for six different models of substrate and product inhibitions and data for low to high cellobiose conversions in a batch reactor, neural networks were used for fitting the product inhibition parameter to the mass balance equations derived for each model. The two models found to be best were: 1) noncompetitive inhibition by substrate and competitive by product and 2) uncompetitive inhibition by substrate and competitive by product; however, these models’ correlation coefficients were quite close. To distinguish between them, hybrid models consisting of neural networks and first principle equations were used to select the best inhibition model based on the smallest norm observed, and the model with noncompetitive inhibition by substrate and competitive inhibition by product was shown to be the best predictor of cellobiose hydrolysis reactor behavior.

Neural networks; Enzymes; Modeling; Product inhibition; Substrate inhibition; Cellobiose


BIOTECHNOLOGY

Determination of inhibition in the enzymatic hydrolysis of cellobiose using hybrid neural modeling

F. C. Corazza* * To whom correspondence should be addressed ; L. P. V. Calsavara; F. F. Moraes; G. M. Zanin; I. Neitzel

Department of Chemical Engineering, Maringá State University, UEM, 5790, Colombo Av, BL D90, ZIP 87020-900, Phone: +(55) (44) 261-4754, Fax: +(55) (44) 263-2652, Maringá - PR, Brazil. E-mail: fernandaccorazza@yahoo.com.br

ABSTRACT

Neural networks and hybrid models were used to study substrate and product inhibition observed in the enzymatic hydrolysis of cellobiose at 40ºC, 50ºC and 55ºC, pH 4.8, using cellobiose solutions with or without the addition of exogenous glucose. Firstly, the initial velocity method and nonlinear fitting with StatisticaÒ were used to determine the kinetic parameters for either the uncompetitive or the competitive substrate inhibition model at a negligible product concentration and cellobiose from 0.4 to 2.0 g/L. Secondly, for six different models of substrate and product inhibitions and data for low to high cellobiose conversions in a batch reactor, neural networks were used for fitting the product inhibition parameter to the mass balance equations derived for each model. The two models found to be best were: 1) noncompetitive inhibition by substrate and competitive by product and 2) uncompetitive inhibition by substrate and competitive by product; however, these models’ correlation coefficients were quite close. To distinguish between them, hybrid models consisting of neural networks and first principle equations were used to select the best inhibition model based on the smallest norm observed, and the model with noncompetitive inhibition by substrate and competitive inhibition by product was shown to be the best predictor of cellobiose hydrolysis reactor behavior.

Key words: Neural networks; Enzymes; Modeling; Product inhibition; Substrate inhibition; Cellobiose.

INTRODUCTION

Because of its abundance and easy renovation, cellulosic waste has recently been receiving lately increasing attention as an alternative energy source and raw material for industries. Cellulose corresponds to about 38% of all agricultural waste and 45% of all municipal waste (Bezerra, 1995).

Cellulose is a linear polymer of D-anhydro-glucose units linked by 1,4-b-D-glucosidic bonds that can be hydrolyzed by cellulosic enzymes or by acids and bases. Cellulosic enzymes catalyze the cellulose hydrolysis at 40 to 50ºC without forming undesirable products. The enzyme system for the conversion of cellulose to glucose comprises endo-1,4-b-glucanase, cellobiohydrolase and b-glucosidase (also called cellobiase), which act sequentially and cooperatively to degrade crystalline cellulose to glucose. Cellobiase hydrolyzes the hydrolysis end dimmer, cellobiose, which as a rate-limiting factor is generally responsible for regulation of the entire cellulose hydrolysis process, because both endoglucanase and cellobiohydrolase activities are often inhibited by cellobiose. Thus, cellobiase produces glucose from cellobiose and also reduces cellobiose inhibition during cellulose hydrolysis, allowing the cellulolytic enzymes to function more efficiently (Saha et al., 1994). Therefore, there is a big incentive to develop suitable modeling for cellobiose hydrolysis that depends on reaction conditions (Aguado et al., 1995).

An important feature in the kinetics of the hydrolysis of cellobiose is the occurrence of substrate and product inhibition. Several alternative models have been used for this kinetics (e.g. Grous et al., 1985; Dekker, 1986; Woodward and Wohlpart, 1982).

The objective of our work was to use neural network modeling to determine which of a set of alternative inhibition models provides the best data fit. The proposal is founded on the capability of artificial neural networks to be used as universal function approximators, and the technique is appropriate because its model structure can be considered generic in the sense that a little knowledge of the system is required for its determination (Willis et al., 1990).

NEURAL NETWORKS AND HYBRID MODELING

Neural networks are parallel-distributed systems formed of several elements, known as neurons or nodes, placed in layers. Generally, neural network processing corresponds to a weighed sum of the neuron input values with their weights, which will be the argument of a function, usually the sigmoid or logistic function, whose value is the neuron's output.

When neural networks are used to model a system, this model is said to be a black-box model. It was given this name due to the absence of any type of information about the system. On the other hand, conventional modeling is known as white-box because it is based on equations that describe the system and demonstrate some of its characteristics. The gray-box or hybrid models are a combination of the black-box and white-box models. In this type of model, system equations and neural networks are used simultaneously to describe the behavior of the system. Generally, in these models, neural networks are employed to approximate the parameters of the first principles balance equations.

In process engineering, neural networks have a wide range of applications, such as process design and simulation, process supervision and control (Norgaard et al., 2000). Specifically, in relation to biotechnological processes, several studies can be found in the literature, such as the description of the a-amilase inactivation (Geeraerd et al., 1998), the prediction of the final concentration of ethanol in a batch fermentation process (Saucedo et at., 1994) and as a soft-sensor (McAvoy et al., 1992).

Recently, neural networks have frequently been used within hybrid models, which provide a better performance for interpolation and extrapolation properties (van Can et al., 1998). Hybrid models have already been applied to bioreactors (Tholudur and Ramirez, 1996; Chen et al., 2000; James et al., 2002; Patnaik, 2003), ethanol production by Sacharomyces cerevisae (Harada et al., 2000), and enzymatic production (Tholudur et al., 1996; Gonçalves, et al., 2002) and other processes.

In this work, neural networks were utilized to describe the behavior of the inhibition parameter ki. The networks had the following inputs: the kinetic parameters, km, Vmax and ks, and initial substrate and product concentrations, S0 and Gi. The response of the neural network, i.e., the ki parameter, was fed into the mass balance equations of different inhibition hydrolysis models for the batch reactor to estimate the substrate conversion.

Considering the available literature on cellobiose hydrolysis inhibition (Dekker, 1986; Grous et al., 1985; Woodward & Wohlpart, 1982; Gong et al., 1977), two types of substrate inhibition, namely uncompetitive and noncompetitive, and three types of product inhibition, namely competitive, uncompetitive and noncompetitive, were considered, yielding a combination of six inhibition models. Our goal was to determine which inhibition model best fits our data.

Low Hydrolysis Conversion Models

At the beginning of the cellobiose hydrolysis reaction, product concentration (glucose, G) is very low and only substrate inhibition needs to be taken into account. Therefore, under this condition, the number of inhibition model alternatives is reduced to two and the reaction rate equations can be written as (Calsavara, 1998)

• Model U: uncompetitive substrate inhibition with G ® 0:

• Model N: noncompetitive substrate inhibition with G ® 0:

where S and ks are the substrate concentration and substrate inhibition constant, V is the initial reaction rate, Vmax the maximum reaction rate and km the Michaelis-Menten constant.

Low to High Hydrolysis Conversion Models

For the whole range of hydrolysis conversions, low to high, both the substrate and the product inhibitions must be taken into account. A mass balance on a hydrolysis batch reactor considering each of the six inhibition model alternatives gives (Calsavara, 1998).

• Model UC: uncompetitive inhibition by substrate and competitive by product:

• Model UN: uncompetitive inhibition by substrate and noncompetitive by product:

• Model UU: uncompetitive inhibition by substrate and product:

• Model NC: noncompetitive inhibition by substrate and competitive by product:

• Model NN: noncompetitive inhibition by substrate and product:

• Model NU: noncompetitive inhibition by substrate and uncompetitive by product:

where ki is the product inhibition parameter, t is the batch reaction time, XA is the substrate conversion, S0 is the substrate initial concentration and Gi is the product initial concentration.

MATERIALS AND METHODS

Experimental System

The neural network modeling technique was employed in the enzymatic hydrolysis of cellobiose, in which the enzyme b-glucosidase (EC 3.2.1.21), also known as cellobiase, hydrolyzes the b-glucosidic bond of cellobiose producing two molecules of glucose (Calsavara et al., 1999b).

The substrate was cellobiose from Sigma and it contained a very low level of glucose contamination (0.133% [w/w]). The enzyme was Novozym 188, a b-glucosidase produced by the microorganism Aspergillus niger, containing 170 mg/mL of protein and a specific activity of 9.5 U/ mg protein. More details about the experimental data utilized in this work, the reactor system and the enzyme can be found in Calsavara (1998) and Calsavara et al (1999a, 1999b).

Two data clusters were used in this work. In the first group, which is associated with low conversions, the effect of substrate concentration on the initial rate of cellobiose hydrolysis at 40ºC, 50ºC and 55ºC, pH 4.8, was studied using cellobiose solutions from 0.4 to 2.0 g/L (1.2 to 58.5 M). The second group is associated with low to high cellobiose conversions and contains data on hydrolysis test runs in a batch reactor for up to very long reaction times under the experimental conditions shown in Table 1.

Training and Validation Data for the Neural Network

The data group used for training and validation had 1198 cases, separated randomly into 1098 training cases and 100 validation cases, as recommended by Statistica Neural Networks (SNN)Ò (StatSoft Inc.). This data group was generated using Equations (3) to (8), having as input the concentrations S0 and Gi under each test condition, and the values of the parameters km, ks and Vmax, determined as described below. The output variable of the training data was the product inhibition parameter, ki.

Neural Network Creation and Training

The architecture and weights of the neural networks built for each hybrid model were determined with the software Statistica Neural Networks (SNN)Ò (StatSoft Inc.). This software determines the best architecture for a neural network by conducting preliminary training in different architectures and comparing their performances. All of the neural networks were multilayer perceptrons (MLP) with one hidden layer. The activation function used in the first layer was linear, while for the hidden and outer layers the logistic (or sigmoid) function was used. The number of hidden neurons was determined by SNN.

Four training algorithms were utilized: back propagation, quasi-Newton, Levenberg-Marquardt and conjugate gradients. All six networks were trained with the four algorithms. Thus, the difference between the six neural networks developed consisted in the number of neurons in the hidden layer and in the selected training algorithm.

RESULTS AND DISCUSSION

Determination of the Kinetic Parameters

From the first data group, on the initial hydrolysis reaction rate (V) vs. cellobiose concentration (S0), the Michaelis-Menten (km) and substrate inhibition (ks) constants and also the maximum rate of reaction (Vmax) can be determined. These data were obtained using the initial velocity method (Dixon and Web, 1979) when the product concentration in the reaction medium is negligible (G ® 0). The reaction rate can be described by Equations (1) and (2) converted into their parabolic form,

• Model U: uncompetitive substrate inhibition with G ® 0:

• Model N: noncompetitive substrate inhibition with G ® 0:

The parabola (Equation 11) was fit to the first group data using the software StatisticaÒ (StatSoft Inc.). From the value of the coefficients a, b and c, the kinetic constants were determined for the two kinds of inhibition (Equations 9 and 10). Figure 1 shows the good fitting obtained for the experimental data at all the temperatures tested.


Table 2 shows the values of the kinetic constants determined by this work and compares them with some values found in the literature. Our results shown in Table 2 are of the same magnitude as those obtained by Grous et al. (1985) and Dekker (1986).

Determination of the Product Inhibition Parameter

After determining the value of the parameters km, ks and Vmax, ki can be obtained from the second experimental data group, which is on low to high cellobiose hydrolysis conversion (XA) vs. batch reaction time (t), obtained at 40, 50 and 55ºC. In this work, the parameter ki was fit as a function of the reaction temperature and initial substrate concentration, working accordance with (Calsavara et al., 1999b; Grous et al., 1985). The software StatisticaÒ (StatSoft Inc.) was used to fit the hydrolysis inhibition model Equations (3) to (8) to the data at each temperature, and the estimated parameter values are shown in Table 3.

The models that gave the best fit were: 1) uncompetitive inhibition by substrate and competitive by product (UC), and 2) noncompetitive inhibition by substrate and competitive by product (NC), whereas for some models, the experimental data could not be fit and this was highlighted by a horizontal bar (- ) placed at the R2 data entry. The calculated values for the product inhibition parameter, ki, are shown in Table 3. It can also be observed that the correlation coefficients obtained for these two models (UC and NC) are quite close. This result makes the choice between these two models more difficult, and the neural hybrid models will be applied in the next section to discriminate between the two best-fit models.

Still, according to the quality of fitting observed, some considerations, such as the following, can be made:

• Product inhibition has more influence on the kinetics of cellobiose hydrolysis; this is confirmed by the similar results shown in Table 3 for the three product inhibition hypothesis independently of the substrate inhibition hypothesis considered.

• Of the three product inhibition types considered, the competitive one seems to be the most adequate, followed by uncompetitive inhibition.

Figures 2 to 4 show the experimental data and fitting results for the NC model (noncompetitive inhibition by substrate and competitive by product). The UC model (uncompetitive inhibition by substrate and competitive by product) gave similar results.


Hybrid Neural Modeling

Six hybrid models were built, one for each combination of substrate and product inhibition hypothesis, for the purpose of comparison. The aim was to use the ability of the neural networks to verify which hybrid model would reproduce the batch reactor data most closely. As mentioned above, hybrid models were composed of a neural network and one of the mass balance equations (Equations (3) to (8)). The inputs and outputs used for these networks were the same as those above and the ki output was also fed to the model equations.

To compare the six hybrid models, the maximum norm was used. According to Willianson et al. (1972), the maximum norm can be defined, for any x = (x1,...,xn), by

As a valuable tool for error analysis, maximum norms are recommended for measuring error in vectors and matrices (Higham, 1986; Anderson et al., 1995). The maximum norm defined by the relation was calculated for each one of the six models for every experimental curve. It measures the maximum absolute discrepancy between the experimental and predicted values, and therefore we should look for the model that gives the lowest maximum norm. In a probabilistic approach the maximum norm is interpreted as a "worst case performance" (Maiorov and Wasilkowski, 1994). The predicted behaviors for the six models were very different, allowing establishment of the most appropriate inhibition model for the enzymatic hydrolysis of cellobiose. Table 4 shows the maximum norm values for every model under all hydrolysis conditions. It can be observed that for any experimental curve, the lowest average value of the calculated maximum norm occurred for the NC model (noncompetitive substrate inhibition and competitive product inhibition).

The trend in model performance observed when ki was determined was also seen with the hybrid models. The hypotheses of noncompetitive inhibition by substrate and competitive by product (NC) and uncompetitive inhibition by substrate and competitive by product (UC) had the best results. But, using the maximum norm criterion, the model that considers noncompetitive inhibition by substrate and competitive by product (NC model) clearly stands out.

Figures 5 to 7 compare the predicted behavior of the NC model with the cellobiose hydrolysis experimental data, and Figures 8 to 10 do the same for the UC model.



CONCLUSIONS

Kinetic parameters were determined for the enzymatic hydrolysis of cellobiose by the initial velocity method, at a negligible product concentration, using either the uncompetitive or the competitive model for substrate inhibition, and the results gave a good fit to the experimental data for both models.

Six models were tested for different combinations of the substrate and product inhibition hypotheses for the enzymatic hydrolysis of cellobiose at low to high conversions in a batch reactor. Through the fitting of the mass balance equations derived for each model, the parameter ki was estimated. The quality of the fitting was different for each model, and the models that considered either noncompetitive inhibition by substrate and competitive by product, or uncompetitive inhibition by substrate and competitive by product showed the highest correlation coefficients (R2).

The six models were then tested using hybrid models. Six hybrid models were used with the same inhibition hypotheses as above, and the ability of the neural networks in approximating functions was used advantageously with the hybrid models, allowing selection of the best inhibition model based on the smallest norm observed. The model that best predicted reactor behavior with the hybrid models was the noncompetitive inhibition by substrate and competitive by product model.

ACKNOWLEDGEMENTS

We would like to thank CAPES (Coordenação de Aperfeiçoamento de Pessoal de Ensino Superior) for the financial support received.

NOMENCLATURE

G product (glucose) concentration in the reaction medium [mM] Gi product initial concentration [mM] ki product inhibition parameter [mM] km Michaelis-Menten constant [mM] ks substrate inhibition constant [mM] NC noncompetitive substrate and competitive product inhibition (-) NN noncompetitive substrate and product inhibition (-) NU noncompetitive substrate and uncompetitive product inhibition (-) S substrate concentration in the reaction medium [mM] SNNÒ Statistica Neural Network (StatSoft Inc.) (-) S0 Initial substrate concentration [mM] t batch reaction time [min] T temperature [ºC] V initial reaction rate [mmol L-1 min-1] Vmax maximum rate of reaction [mmol glucose L-1 min-1 mg protein-1] XA substrate conversion, XA = 1 - S / S0 UU uncompetitive substrate and product inhibition (-) UC uncompetitive substrate and competitive product inhibition (-) UN uncompetitive substrate and noncompetitive product inhibition (-)

Received: June 15, 2003

Accepted: July 26, 2004

  • Anderson, E., Bai, Z., Bischof, C., Demmel, J., Dongarra, J., Du Croz, J., Greenbaum, A., Hammarling, S., McKenney, A., Ostrouchov, S.and Sorensen, D., Laplack User's Guide, Society of Industrial and Applied Mathematics, USA (1995).
  • Aguado, J., Romero, M.D., Rodríguez, L. and Calles J.A., Thermal Deactivation of Free and Immobilized b-Glucosidase from Penicillinum funiculosum, Biotechnology Progress, 11, 4 106 (1995).
  • Baughman, D.R. and Liu, T.A., Neural Networks in Bioprocess and Chemical Engineering, USA (1995).
  • Bezerra, R.M.F., Cinética Enzimática de Hidrólise de Celulose, Ph.D. diss., Universidade de Trás-os-Montes de Alto Dourado, Portugal (1995).
  • Calsavara, L. P. V., Caracterização da Enzima Celobiase com Modelagem da Cinética de Hidrólise da Celobiose, Master's thesis; Universidade Estadual de Maringá, Brazil (1998).
  • Calsavara, L.P.V., Moraes, F.F. de and Zanin, G.M., Modeling Cellobiose Hydrolysis by Cellobiase. VI Seminário de Hidrólise Enzimática de Biomassas. Maringá, Brazil (1999a).
  • Calsavara, L.P.V., Moraes, F.F. de and Zanin, G.M., Modelling Cellobiose Hydrolysis with Integrated Kinetic Models, Applied Biochemistry and Biotechnology, 77, 789 (1999b).
  • Chen, L., Bernard, O., Bastin, G. and Angelov, P., Hybrid Modeling of Biotechnological Process Using Neural Networks, Control Engineering Practice, 8, 821 (2000).
  • Dekker, R.F.H., Kinetic, Inhibition and Stability Properties of a Commercial b-Glucosidase (Cellobiase) Preparation from Aspergillus niger and its Suitability in the Hydrolysis of Lignocellulose, Biotechnology and Bioengineering, 28, 1438 (1986).
  • Dixon, M., Webb and E.C., Enzymes, 3rd edition, London: Longman Group Limited (1979).
  • Geeraerd, A.H., Herremans, C.H., Ludikhuyze, L.R., Hendrickx, M.E. and Impe, J.F.V., Modelling the Kinetics of Isobaric-Isothermal Inactivation of Bacillus subtilis a-amilase with Artificial Neural Networks, Journal of Food Engineering, 36, 263 (1998).
  • Gonçalves, L.R.B., Souza, R. Jr., Fernandez-Lafuente, R., Guisan, J.M., Giordano, R.L.C, and Giordano, R.C., Enzymatic Synthesis of Amoxicillin: Avoiding Limitations of the Mechanistic Approach for Reaction Kinetics, Biotechnology and Bioengineering, 80, 622 (2002).
  • Gong, C.S., Ladisch, M.R.and Tsao, G.T., Cellobiase from Trichoderma viride: Purification, Properties, Kinetics and Mechanism, Biotechnology and Bioengineering, 19, 959 (1977).
  • Grous, W., Converse, A. Grethlein, H. and Lynd, L., Kinetics of Cellobiose Hydrolysis Using Cellobiase Composites from Trichoderma reesei and Aspergillus niger, Biotechnology and Bioengineering, 27, 463 (1985).
  • Harada, L.H.P., Maciel Fş, R. and Costa, A.C., Hybrid Modelling of an Alcoholic Fermentation Process. XIII COBEQ, Natal, Brazil (2000).
  • Higham, N.J., Accuracy and Stability of Numerical Algorithms, Society of Industrial and Applied Mathemathics, USA (1986).
  • James, S., Legge, R.and Budman, H., Comparative Study of Black-box and Hybrid Estimation Methods in Fed-batch Fermentation, Journal of Process Control, 12, 113 (2002).
  • Levenberg, K., A Method for Solution of Certain Nonlinear Problems in Least Squares, Quart. Appl. Mathematics, 2, 164 (1944).
  • Maiorov, V.E. and Wasilkowski, G.W., Probabilistic and Average Linear Widths in L8norm with Respect to r-fold Wiener Measure, J. Approx. Theory, 77,74-88 (1994).
  • Marquardt, D., An Algorithm for Least Squares Estimation of Nonlinear Parameters, SIAM Journal Appl. Mathematics, 11, 164 (1963).
  • McAvoy, T.J., Su, H.T., Wang, N.S., He, M., Horvath, J. and Semerjian, H., A Comparison of Neural Networks and Partial Least Squares for Deconvoluting Florescent Spectra, Biotechnology and Bioengineering, 40, 53 (1992).
  • Norgaard, M., Ravn, O., Poulsen, N.K. and Hansen, L.K., Neural Networks for Modelling and Control of Dynamic Systems A Practitioner's Handbook, Springer-Verlag, Great Britain (2000).
  • Patnaik, P.R., An Integrated Hybrid Neural System for Noise Filtering, Simulation and Control of a Fed-batch Recombinant Fermentation, Biochemical Engineering Journal, 15, 165 (2003).
  • Saha, B.C., Freer, S.N., Bothast and R.J., Applied and Environmental Microbiology, 60, 10, 3774-3780, (1994).
  • Saucedo, V.M., Eikens, B. and Karim, M.N., Identification Techniques for a Recombinant Fed-Batch Fermentation for Ethanol Production, Advances in Bioprocess Engineering, 275 (1994).
  • Tholudur, A. and Ramirez, W.F., Optimization of Fed-Batch Bioreactors Using neural Network Parameter Function Models, Biotechnology Progress, 12, 302 (1996).
  • Tholudur, A., Ramirez, W.F. and McMillan, J.D., Mathematical Modelling and Optimization of Cellulase Protein Production Using Trichoderma reesei RL-P37, Biotechnology and Bioengineering, 66, 1 (1999).
  • van Can, H.J.L., te Braake, H.A.B., Dubbelman, S., Hellinga, C., Luyben, K.C.A.M. and Heijnen, J.J., Understanding and Applying the Extrapolation Properties of Serial Gray-Box Models, AIChE Journal, 44, 1071 (1998).
  • Werbos, P., Beyond Regression: New Tools for Prediction and Analysis in the Behaviorial Sciences. Ph.D. diss., Harvard, Cambridge, MA (1974).
  • Willianson, R.E., Crowell, R.H. and Trotter, H.F., Calculus of Vector Functions, USA (1972).
  • Willis, M.J., Di Massimo, G., Montague, G.A. and Morris, A.J., Artificial Neural Networks in Process Engineering, IEEE Proceedings, 138, nş 3, 256 (1990).
  • Woodward, J. and Wohlpart, D.L., Properties of Native and Immobilized Preparations of b-Glucosidase from Aspergillus niger, Journal of Chemical Techonology and Biotechnology, 32, 547 (1982).
  • *
    To whom correspondence should be addressed
  • Publication Dates

    • Publication in this collection
      15 Mar 2005
    • Date of issue
      Mar 2005

    History

    • Accepted
      26 July 2004
    • Received
      15 June 2003
    Brazilian Society of Chemical Engineering Rua Líbero Badaró, 152 , 11. and., 01008-903 São Paulo SP Brazil, Tel.: +55 11 3107-8747, Fax.: +55 11 3104-4649, Fax: +55 11 3104-4649 - São Paulo - SP - Brazil
    E-mail: rgiudici@usp.br