ABSTRACT
Kale plants are usually sold “in natura” in street markets and malls. Kale leaves can have their appearance compromised by dehydration and discoloration due to increased postharvest time exposure. We aimed to analyze the Global Stability Index (GSI) in kale accessions by means of repeated measurement analysis and curve grouping as a complementary form of superior sample identification with regard to postharvest preservation. Thirty kale accessions were evaluated using a randomized block design with four blocks and five plants per plot. Two commercial leaves per plant were collected, and kept on workbenches in the shade at a temperature of 18 ± 1 °C. Subsequently, the degrees of discoloration and dehydration, total chlorophyll content, and accumulated fresh mass loss were evaluated over a 15day period. From these data, the GSI was calculated for each day of evaluation. In addition, using mixed models, thirteen covariance structures were tested. For graphical analysis, thirteen linear and nonlinear models were assessed followed by curve grouping using multivariate analysis. The GSI was efficient for differentiating accessions, which became an important tool in postharvest studies. GSI values were not equally correlated, therefore the use of mixed models became an important approach. The unstructured matrix was the best fit to model the dependence of error. The Melow I model was the best fit for studying the GSI. The accessions UFVJM10, UFLA1, COM1, UFVJM32, COM3, UFVJM8, UFVJM36 and UFVJM24, belonging to 3 and 5 clusters, are recommended for crop cultivation and as parental material in breeding programs.
Keywords:
Brassica oleracea var. acephala DC; postharvest preservation; repeated measurements; multivariate statistics; curve grouping
Introduction
Several studies were conducted on the kale crop (Brassica oleraceavar. acephala DC) which revealed its health benefits (Ayaz et al., 2008Ayaz, F.A.; HayirliogluAyaz, S.; AlpayKaraoglu, S.; Gruz, J.; Valentova, K.; Ulrichova, J.; Strnad, M. 2008. Phenolic acid contents of kale (Brassica oleracea L. var. acephala DC.) extracts and their antioxidant and antibacterial activities. Food Chemistry 107: 1925.; Sousa et al., 2008Sousa, C.; Taveira, M.; Valentao, P.; Fernandes, F.; Pereira, J.A.; Estevinho, L.; Bento, A.; Ferreres, F.; Seabra, R.M.; Andrade, P.B. 2008. Inflorescences of Brassicacea species as source of bioactive compounds: a comparative study. Food Chemistry 110: 953961.; Lemos et al., 2011Lemos, M.; Santin, J.R.; Júnior, L.C.K.; Niero, R.; Andrade, S.F.D. 2011. Gastroprotective activity of hydroalcoholic extract obtained from the leaves of Brassica oleracea var. acephala DC in different animal models. Journal of Ethnopharmacology 138: 503–507.). The appearance of Kale leaves is compromised by dehydration and discoloration due to postharvest time exposure. Thus, cultivation of varieties resistant to this early dehydration and discoloration is a desirable trait.
Vegetable dehydration over periods of storage is commonly evaluated by water loss measurement (Agüero et al., 2011Agüero, M.V.; Ponce, A.G.; Moreira, M.R.; Roura, S.I. 2011. Lettuce quality loss under conditions that favor the wilting phenomenon. Postharvest Biology and Technology 59: 124131.) and a rating scale. However, discoloration can also be assessed by considering the chlorophyll content, which has also been efficiently evaluated, in some reports, by a rating scale (Agüero et al., 2008Agüero, M.V.; Barg, M.V.; Yommi, A.; Camelo, A.; Roura, S.I. 2008. Postharvest changes in water status and chlorophyll content of lettuce (Lactuca sativa L.) and their relationship with overall visual quality. Journal of Food Science 73: 4755.; Agüero et al., 2011Agüero, M.V.; Ponce, A.G.; Moreira, M.R.; Roura, S.I. 2011. Lettuce quality loss under conditions that favor the wilting phenomenon. Postharvest Biology and Technology 59: 124131.; MartínezSánchez et al., 2011MartínezSánchez, A.; Tudela, J.A.; Luna, C.; Allende, A.; Gil, M.I. 2011. Low oxygen levels and light exposure affect quality of freshcut Romaine lettuce. Postharvest Biology and Technology 59: 3442.; Atkinson et al., 2013aAtkinson, L.D.; Hilton, H.W.; Pink, D.A.C. 2013a. A study of variation in the tendency for postharvest discoloration in a lettuce (Lactuca sativa) diversity set. International Journal of Food Science and Technology 48: 801–807.; Atkinson et al., 2013bAtkinson, L.D.; Mchale, L.K.; Truco, M.J.; Hilton, H.W.; Lynn, J.; Schut, J.W.; Michelmore, R.W.; Hand, P.; Pink, D.A.C. 2013b. An intra–specifc linkage map of lettuce (Lactuca sativa) and genetic analysis of postharvest discolouration traits. Theoretical and AppliedGenetics 126: 2737–2752.). When many characteristics are taken into account in a postharvest study, it becomes difficult to make a decision. Achour (2006)Achour, M. 2006. A new method to assess the quality degradation of food products during storage. Journal of Food Engineering 75: 60564. proposed a method called the Global Stability Index (GSI) that allows for quantifying the stability of vegetable quality throughout a period, and aggregating information about a number of traits into a unique variable.
Along with the GSI approach, the use of mathematical modeling is an interesting tool for predicting shelf life (Ansorena et al., 2009Ansorena, M.R.; Goñi, M.G.; Aguëro, M.V.; Roura, S.I.; Di Scala, K.C. 2009. Application of the general stability index to assess the quality of butter lettuce during postharvest storage by a multiquality indices analysis. Journal of Food Engineering 92: 317323.). Being dimensionless, the index can also be used to compare the relative stability of two different products stored under the same conditions. This methodology showed itself to be efficient in the evaluation of beverages (Achour, 2006Achour, M. 2006. A new method to assess the quality degradation of food products during storage. Journal of Food Engineering 75: 60564.) and lettuce conservation (Ansorena et al., 2009Ansorena, M.R.; Goñi, M.G.; Aguëro, M.V.; Roura, S.I.; Di Scala, K.C. 2009. Application of the general stability index to assess the quality of butter lettuce during postharvest storage by a multiquality indices analysis. Journal of Food Engineering 92: 317323.; Ansorena et al., 2012Ansorena, M.R.; Goñi, M.G.; Aguëro, M.V.; Goni, M.G.; Roura, S.I.; Ponce, A.; Moreira, M R.; Di Scala, K.C. 2012. Assessment of lettuce quality during storage at low relative humidity using Global Stability Index methodology. Ciência e Tecnologia de Alimentos 32: 366373.) as a function of storage time.
Postharvest study is generally performed in a series of successive evaluations for each experimental unit over the course of time. This kind of experiment has been improperly analyzed as split plots must be analyzed by a series of repeated measures. Another approach is graphical methods. With this technique, when a large number of treatments is performed, it becomes feasible to aggregate similar treatments with regard to the curves, i. e. treatments that present similar vectors to the estimates of adjusted model parameters. Thus, this study aimed to analyze the GSI of 30 kale accessions by means of repeated measure analysis with various covariance structures, plotting curve grouping through multivariate analysis as a complement to the identification of superior vegetable material.
Materials and Methods
The experiment was carried out in the municipality of Diamantina, in the state of Minas Gerais, Brazil (18°12′01″ S; 43°34′20″ W, 1387 m.a.s.l.). During the period of the experiment, the average temperature was 18.3 °C and the relative air humidity was 80 % with few oscillations.
Three commercial cultivars and twentyseven kale accessions from the germplasm bank of UFVJM were used. The experimental design was a completely randomized block with four replications and five plants per plot. Nineteen accessions were obtained by collections in rural properties within the region of DiamantinaMG (UFVJM2, UFVJM3, UFVJM4, UFVJM5, UFVJM7, UFVJM8, UFVJM9, UFVJM10, UFVJM13, UFVJM19, UFVJM21, UFVJM22, UFVJM24, UFVJM26, UFVJM27, UFVJM30, UFVJM32, UFVJM34 and UFVJM36) and eight accessions were donated by the Federal University of Lavras (UFLA1, UFLA3, UFLA6, UFLA8, UFLA5, UFLA10, UFLA11 and UFLA12). Three commercial cultivars were also studied (COM1, COM2 and COM3).
On 28 Jul 2011, lateral sprouts were collected to form seedlings through herbaceous cutting propagation by collecting 3 to 4cm high sprouts from motherplants with two leaflets in the bottom third. After the sprout collections, the material was planted into 72cell polystyrene trays filled with commercial substrate. Then, cuttings were transferred into a greenhouse in the Olericulture Sector of the UFVJM for 30 days in order to ensure optimal rooting. When the seedlings were ready, they were transplanted into 7.5 kg vessels filled with soil:manure in a 3:1 ratio. The vessels were kept under greenhouse conditions for a period of 30 days in order to ensure a high seedling survival rate
On 28 Sept 2011, vases were taken into the field where they remained until data collection for agricultural evaluation. Soil and top dressing fertilizations were carried out in accordance with crop recommendations; aphid and caterpillar control were manually administered on alternating days. In addition, old leaves and sprouts were removed weekly to allow for optimum plant development.
On 2 Jan 2012, two commercial leaves were collected from each plant (with absence of defects and leaf limb more than 20cm long). These leaf samples were left on workbenches in the shade at 18 ± 1 °C. The valuations were performed at 0 (collection time), 1, 2, 3, 4, 5, 7, 9, 11, 13 and 15 days after collection. The degrees of discoloration and dehydration, total chlorophyll content and accumulated loss of fresh mass were analyzed. Five previously trained individuals made evaluations according to a rating scale and degrees of discoloration and dehydration were assessed by visual examination. To define the degree of discoloration, the following rating scale was used: 1 (absence of discoloration), 2 (presence of low discoloration), 3 (moderate discoloration), 4 (moderate to severe discoloration) and 5 (severe discoloration). To define the degree of dehydration, the following rating scale was used: 1 (dehydration nonapparent), 2 (low dehydration), 3 (moderate dehydration), 4 (moderate to severe dehydration) and 5 (severe dehydration). Total chlorophyll was evaluated using a portable chlorophyll meter, taking three readings per leaf for each evaluation event. Accumulated fresh mass loss (FML) was obtained by the following equation: FML_{i} (%) = (P_{0} P_{i}) /P_{0}*100, whereFML_{i} is the accumulated fresh mass loss ati time, P_{0} is the weight of the kale head at harvest time and P_{i} is the weight of the head at i time.
Statistical analysis was carried out on a plot by plot basis, taking into account the mean of observed values for leaf evaluation (five plants per plot and two leaves per plant). For the best result in terms of viewing and interpretation, the Global Stability Index (GSI) was used as recommended by Achour (2006)Achour, M. 2006. A new method to assess the quality degradation of food products during storage. Journal of Food Engineering 75: 60564.. For this index, the variation terms(V_{ij}′ s) were initially calculated as follows:V_{ij}=(c_{ij}c_{io})/(L_{i}c_{io}), where C_{ij} is the measured value for thei trait at j time;C_{io} is the initial value of the icriterion at the moment of the first evaluation (time = 0);L_{i} is the threshold value of the itrait, as established by the user. The value of L_{i},which is used for all treatments, was such that the highest value forV_{ij} may be equal to 1, and values should increase in line with prolongations in storage time.
From the value of V_{ij} it is possible to calculate the GSI for any j time by using the expression: j is the jth unit of time, i=1 up to n, in which n is the total number of traits evaluated; V_{ij} is the variation term of the i criterion at j time; and∝_{i} is the weight from the icriterion, as established by the user. In this research study, in order to reach the same weight for each one of the four traits, ∝_{i}= 0.25 was adopted. Thus, as the values of V_{ij} vary from 0 to 1 and the sum of the ∝_{i} must be 1, GSI also will also vary between 0 and 1., where is the addition of
The mathematical model for the analysis of repeated measures of the GSI is given by:y_{ijk}, = μ + t_{i}+a_{j}+ ta_{ij}+ b_{k}+ ε_{ijk}, where y_{ijk} = GSI value at the jevaluation, in k block and i treatment; μ. = global mean; t_{i}= fixed effect of igenotype; a_{j}= fixed effect of jevaluation; (ta)_{ij}= fixed effect of the interaction between genotype and evaluation; b_{k}= random effect of k block; ε_{ijk} = random error, ε_{ijk} ~N (0, V), in which, V is the covariance matrix used to model error dependence that is associated with the GSI at j evaluation, k block, andi genotype. It was assumed that error dependence occurs betweenj^{th} and j′^{th} (j^{th} ≠ j′^{th}) in the evaluation of an identical experimental unit, in an identical block and, consequently covariance matrices feature in Figure 1.
The model was adjusted to the data by the maximum likehood estimate, using the PROC MIXED software (Statistical Analysis System, version 9.2), in which 13 covariance matrices were tested. To identify the best matrix, the Akaike Information Criterion (AIC) and the Bayesian Information Criterion (BIC) were used. When fixing the time effect, mean values of the GSI of accessions were compared for each evaluation using the ScottKnott test (p < 0.05). This test was performed considering changes in adjusted covariance structure by PROC MIXED, similarly toCecon et al. (2008)Cecon, P.R.; Silva, F.F.; Ferreira, A.; Ferrão, R.G.; Carneiro, A.P.S.; Detmann, E.; Faria, P.N.; Morais, T.S. Da S. 2008. Repeated measures analysis in the evaluation of clones 'Conilon' coffee = Análise de medidas repetidas na avaliação de clones de café ‘Conilon’. Pesquisa Agropecuária Brasileira 43: 11711176..
To describe the behavior of the GSI as a function of evaluation time, a statistical method similar to that described by Cecon et al. (2008)Cecon, P.R.; Silva, F.F.; Ferreira, A.; Ferrão, R.G.; Carneiro, A.P.S.; Detmann, E.; Faria, P.N.; Morais, T.S. Da S. 2008. Repeated measures analysis in the evaluation of clones 'Conilon' coffee = Análise de medidas repetidas na avaliação de clones de café ‘Conilon’. Pesquisa Agropecuária Brasileira 43: 11711176. was adopted. In addition to the polynomial models of first degree, second degree and exponential, more complex models were also tested such as the Schnute, Mitscherlich, Richards, Gompertz, Logistics, Meloun I, von Bertalanffy and MichaelisMenten. These models were adjusted for each replication by cultivar using the PROC MODEL from SAS^{®} software (Statistical Analysis System, version 9.2). Afterwards, a multivariate variance analysis was carried out using a PROC GLM (Statistical Analysis System, version 9.2) with MANOVA option, in order to evaluate the accession effect on the estimates of model coefficients. Adjusted means were extracted from coefficients by least square (LSMEANS) and were subjected to clustering analysis in a PROC CLUSTER (Statistical Analysis System, version 9.2) by the centroid method.
In order to identify an optimal number of clusters, root mean squared standard deviation values (RMSSTD) were used. To view the dendrogram and check cultivars that belonged to different groups obtained by statistical discrimination, a PROC TREE (Statistical Analysis System, version 9.2) was used.
Results and Discussion
Verification of variance and covariance matrix adjustments, by the Akaike Information Criterion (AIC) and the Bayesian Information Criterion (BIC) are shown in Table 1. The variance component structure (VC) presented the worst adjustment due to higher values for AIC and BIC, and in this structure, zero covariance among successive evaluations were admitted. This behavior is not expected for similar experiments, once using repeated measurements are taken, the responses of different evaluation times in the same plot, are not equally correlated (Araújo et al., 2009Araújo, S.I.; Regazzi, A.J.; Araújo, C.V.; Cruz, C.D.; Silva, C.H.O; Viana, J.M.S. 2009. Variance component estimation with longitudinal data: a simulation study with alternative methods. Crop Breeding and Applied Biotechnology 9: 202209.) as can be observed in Table 2. For this reason, a good adjustment for the composed symmetrical structure (CS) was not obtained and constant variances and covariance are assumed.
Evaluators of adjustment quality of covariance structures used for modeling the dependence of residuals.
Pearson correlation of Global Stability Index (GSI) values obtained in kale accessions at different storage points.
According to García et al. (2010)García, P.F.; Vallejo, G.; LivacicRojas, P.; Herrero, H.; Cuesta, M. 2010. Comparative robustness of six tests in repeated measures designs with specified departures from sphericity. Quality & Quantity 44: 289301. if the sphericity condition is incorrectly met, which is equivalent to variance homogeneity in ANOVA analysis, apparent significance of difference between treatment means will be coarsely extrapolated and the sensitivity of interaction tests will be seriously reduced. An alternative to test matrix sphericity is to obtain an unstructured matrix (UN) and test it with the HuynhFeldt matrix (HF). Thus, using values of2 Res Log Likelihood, freedom degrees of UN structure (1193.3 and 54), and of HF (1883.4 and 10), the value of X^{2}=1193.31883.4=690.1 with 44 degrees of freedom (5410) was obtained, leading to a pvalue lower than 0.001, indicating nonsphericity.
The unstructured matrix (UN) was the one that presented the best adjustment, with the lowest AIC and BIC values. According to Barnett et al. (2010)Barnett, A.G.; Koper, N.; Dobson, A.J.; Schmiegelow, F.; Manseau, M. 2010. Using information criteria to select the correct variance– covariance structure for longitudinal data in ecology. Methods in Ecology and Evolution 1: 15–24. this covariance matrix assumes that no two pairs of observations are equally correlated, and that there is no ‘structure’ between neighboring values in the matrix. Additionally, it also allows for different variance terms along the diagonal of the matrix. From variance estimates for each evaluation in UN structure, a postanalysis of the interaction was carried out (evaluation date x accession) by using the ScottKnott test for the grouping of means (Table 3). A procedure similar to this was implemented by Cecon et al. (2008)Cecon, P.R.; Silva, F.F.; Ferreira, A.; Ferrão, R.G.; Carneiro, A.P.S.; Detmann, E.; Faria, P.N.; Morais, T.S. Da S. 2008. Repeated measures analysis in the evaluation of clones 'Conilon' coffee = Análise de medidas repetidas na avaliação de clones de café ‘Conilon’. Pesquisa Agropecuária Brasileira 43: 11711176., when assessing the productivity of 50 clonal varieties of coffee over five harvests.
Grouping of mean for the global stability index (GSI) of leaves kale evaluated at different storage points (Days).
The GSI behavior was described with respect to evaluation time by means of the graphical method. For this purpose, adjustments of different linear and nonlinear models are displayed in Table 4. A good fit for the Brody model with the lowest AIC (26.238) was found, with the highest R^{2} value (0.985) and 99 % of convergence; however, The best model was considerd to be the Melow I (yi = β_{1} − β_{2e(−β3xi)} + ɛ_{i}), since in this model there was 100 % convergence with values around 26.285 for AIC and 0.984 for R^{2}.
Evaluators of adjustment quality in models used to describe the Global Stability Index (GSI) in kale leaves submitted in storage under room temperature.
According to Souza et al. (2013)Souza, L.A.; Carneiro, P.L.S.; Malhado, C.H.M.; Silva, F.F.; Silveira, F.G. 2013. Traditional and alternative nonlinear models for estimating the growth of Morada Nova sheep. Revista Brasileira de Zootecnia 42: 651655., the coefficients adjusted by the Melow I model garner greater importance when the biological significance is taken into account, in which, β_{1} reflects the individual final performance, and β_{3}the progress rate of curves. These coefficients were used for multivariate variance analysis, when a significant effect (p small or equal to 0.01) of accessions was detected in vectors of the coefficients studied by Wilks′ lambda, Pillai's trace, HotellingLawley and Roy's root tests. This indicates the need for more than one curve to explain the progress of GSI.Cecon et al. (2008)Cecon, P.R.; Silva, F.F.; Ferreira, A.; Ferrão, R.G.; Carneiro, A.P.S.; Detmann, E.; Faria, P.N.; Morais, T.S. Da S. 2008. Repeated measures analysis in the evaluation of clones 'Conilon' coffee = Análise de medidas repetidas na avaliação de clones de café ‘Conilon’. Pesquisa Agropecuária Brasileira 43: 11711176. found similar results that corroborate the present ones. Therefore, fitted means were justified by the minimum squares of GSI as a function of accessions for grouping analysis by the centroid method.
The ideal number of clusters is presented in Figure 2, which is based on rootmeansquare standard deviation (RMSSTD). The RMSSTD measures the homogeneity of the clusters formed (Liu et al., 2013Liu, Y.; Li, Z.; Xiong, H.; Gao, X.; Wu, J.; Wu, S. 2013. Understanding and enhancement of internal clustering validation measures. IEEE Transactions on Cybernetics 43: 982993.) and enables identification of an optimal number of clusters by means of the maximum curvature method (Cecon et al, 2008Cecon, P.R.; Silva, F.F.; Ferreira, A.; Ferrão, R.G.; Carneiro, A.P.S.; Detmann, E.; Faria, P.N.; Morais, T.S. Da S. 2008. Repeated measures analysis in the evaluation of clones 'Conilon' coffee = Análise de medidas repetidas na avaliação de clones de café ‘Conilon’. Pesquisa Agropecuária Brasileira 43: 11711176.). The use of this method is advantageous, since it allows for nonsubjectivity of the stipulated number of groups in the dendrogram (Liu et al., 2013Liu, Y.; Li, Z.; Xiong, H.; Gao, X.; Wu, J.; Wu, S. 2013. Understanding and enhancement of internal clustering validation measures. IEEE Transactions on Cybernetics 43: 982993.), showing feasibility for the formation of eight clusters (Figure 3). With the GSI means of each evaluation in function of the accessions that compose each cluster, eight curves were plotted and displayed inFigure 4. Using the same technique, Cecon et al. (2008)Cecon, P.R.; Silva, F.F.; Ferreira, A.; Ferrão, R.G.; Carneiro, A.P.S.; Detmann, E.; Faria, P.N.; Morais, T.S. Da S. 2008. Repeated measures analysis in the evaluation of clones 'Conilon' coffee = Análise de medidas repetidas na avaliação de clones de café ‘Conilon’. Pesquisa Agropecuária Brasileira 43: 11711176. explained the behavior of 50 coffee accessions with 10 curves in respect of crop yield.
Statistical behavior of rootmeansquare standard deviation (RMSTSD), and distance between the straight line and the estimated curve (RMSTSD) for verification of optimal number of clusters by maximum curve method.
Dendrogram by the centroid method for classification of genotypes considering the estimates of β_{1} and β_{3} coefficients obtained by the Melow I model for the Global Stability Index (GSI) in kale leaves as a function of storage time.
Curves of global stability index (GSI) behavior for kale leaves in function of storage time (days) for each cluster formed by multivariate analysis.
With respect to the GSI, higher values are undesirable since they indicate lesser stability throughout the postharvest period. In this sense, COM2 presented worse results, the group of accessions having the highest GSI for all evaluation periods (Table 3). Multivariate analysis showed that cluster 7 (Figure 3) was composed of this accession alone. Verification of the same undesired results of this accession are also v shown in Figure 4, in which the curve shows higher values for the GSI during storage.
Clusters 1 and 6 composed of UFVJM5, UFVJM22, UFVJM26, UFLA11, UFVJM9, UFLA12, UFVJM34 and UFLA6 accessions (Figure 3) have also not presented good results in terms of the GSI (Figure 4). All these accessions were among the ones which presented higher GSI values, during the first 9 days of evaluation (Table 3). The best GSI results were found in clusters 3 and 5, when curves are close to the Xaxis (Figure 4); these clusters were composed of the following accessions UFVJM7, UFVJM10, UFLA1, COM1, UFVJM32, COM3, UFVJM8, UFVJM36, UFLA5 and UFVJM24 (Figure 3). Except for UFVJM7 and UFLA5 these accessions have remained in the group of lower GSI values for all evaluation periods (Table 3). Thus, these accessions are recommended for crop cultivation and as parental material in breeding programs.
Conclusions
The accessions UFVJM10, UFLA1, COM1, UFVJM32, COM3, UFVJM8, UFVJM36 and UFVJM24, belonging to clusters 3 and 5, are recommended for crop cultivation and as parental material in breeding programs.
Acknowledgements
The authors thank Brazilian National Council for Scientific and Technological Development (CNPq), Coordination for the Improvement of Higher Level Personnel (CAPES) and Minas Gerais State Foundation for Research Support (FAPEMIG) for providing scholarships and resources to develop this study.
References
 Achour, M. 2006. A new method to assess the quality degradation of food products during storage. Journal of Food Engineering 75: 60564.
 Agüero, M.V.; Barg, M.V.; Yommi, A.; Camelo, A.; Roura, S.I. 2008. Postharvest changes in water status and chlorophyll content of lettuce (Lactuca sativa L.) and their relationship with overall visual quality. Journal of Food Science 73: 4755.
 Agüero, M.V.; Ponce, A.G.; Moreira, M.R.; Roura, S.I. 2011. Lettuce quality loss under conditions that favor the wilting phenomenon. Postharvest Biology and Technology 59: 124131.
 Ansorena, M.R.; Goñi, M.G.; Aguëro, M.V.; Goni, M.G.; Roura, S.I.; Ponce, A.; Moreira, M R.; Di Scala, K.C. 2012. Assessment of lettuce quality during storage at low relative humidity using Global Stability Index methodology. Ciência e Tecnologia de Alimentos 32: 366373.
 Ansorena, M.R.; Goñi, M.G.; Aguëro, M.V.; Roura, S.I.; Di Scala, K.C. 2009. Application of the general stability index to assess the quality of butter lettuce during postharvest storage by a multiquality indices analysis. Journal of Food Engineering 92: 317323.
 Araújo, S.I.; Regazzi, A.J.; Araújo, C.V.; Cruz, C.D.; Silva, C.H.O; Viana, J.M.S. 2009. Variance component estimation with longitudinal data: a simulation study with alternative methods. Crop Breeding and Applied Biotechnology 9: 202209.
 Atkinson, L.D.; Hilton, H.W.; Pink, D.A.C. 2013a. A study of variation in the tendency for postharvest discoloration in a lettuce (Lactuca sativa) diversity set. International Journal of Food Science and Technology 48: 801–807.
 Atkinson, L.D.; Mchale, L.K.; Truco, M.J.; Hilton, H.W.; Lynn, J.; Schut, J.W.; Michelmore, R.W.; Hand, P.; Pink, D.A.C. 2013b. An intra–specifc linkage map of lettuce (Lactuca sativa) and genetic analysis of postharvest discolouration traits. Theoretical and AppliedGenetics 126: 2737–2752.
 Ayaz, F.A.; HayirliogluAyaz, S.; AlpayKaraoglu, S.; Gruz, J.; Valentova, K.; Ulrichova, J.; Strnad, M. 2008. Phenolic acid contents of kale (Brassica oleracea L. var. acephala DC.) extracts and their antioxidant and antibacterial activities. Food Chemistry 107: 1925.
 Barnett, A.G.; Koper, N.; Dobson, A.J.; Schmiegelow, F.; Manseau, M. 2010. Using information criteria to select the correct variance– covariance structure for longitudinal data in ecology. Methods in Ecology and Evolution 1: 15–24.
 Cecon, P.R.; Silva, F.F.; Ferreira, A.; Ferrão, R.G.; Carneiro, A.P.S.; Detmann, E.; Faria, P.N.; Morais, T.S. Da S. 2008. Repeated measures analysis in the evaluation of clones 'Conilon' coffee = Análise de medidas repetidas na avaliação de clones de café ‘Conilon’. Pesquisa Agropecuária Brasileira 43: 11711176.
 García, P.F.; Vallejo, G.; LivacicRojas, P.; Herrero, H.; Cuesta, M. 2010. Comparative robustness of six tests in repeated measures designs with specified departures from sphericity. Quality & Quantity 44: 289301.
 Liu, Y.; Li, Z.; Xiong, H.; Gao, X.; Wu, J.; Wu, S. 2013. Understanding and enhancement of internal clustering validation measures. IEEE Transactions on Cybernetics 43: 982993.
 Lemos, M.; Santin, J.R.; Júnior, L.C.K.; Niero, R.; Andrade, S.F.D. 2011. Gastroprotective activity of hydroalcoholic extract obtained from the leaves of Brassica oleracea var. acephala DC in different animal models. Journal of Ethnopharmacology 138: 503–507.
 MartínezSánchez, A.; Tudela, J.A.; Luna, C.; Allende, A.; Gil, M.I. 2011. Low oxygen levels and light exposure affect quality of freshcut Romaine lettuce. Postharvest Biology and Technology 59: 3442.
 Sousa, C.; Taveira, M.; Valentao, P.; Fernandes, F.; Pereira, J.A.; Estevinho, L.; Bento, A.; Ferreres, F.; Seabra, R.M.; Andrade, P.B. 2008. Inflorescences of Brassicacea species as source of bioactive compounds: a comparative study. Food Chemistry 110: 953961.
 Souza, L.A.; Carneiro, P.L.S.; Malhado, C.H.M.; Silva, F.F.; Silveira, F.G. 2013. Traditional and alternative nonlinear models for estimating the growth of Morada Nova sheep. Revista Brasileira de Zootecnia 42: 651655.
Publication Dates

Publication in this collection
JanFeb 2016
History

Received
22 Sept 2014 
Accepted
14 July 2015