Acessibilidade / Reportar erro

Spirometry reference values in the Brazilian population

Abstract

The aim of the present study was to provide new spirometry reference equations in a sample of the Brazilian population for the following parameters: forced vital capacity (FVC), forced expiratory volume in 1 second (FEV1), FEV1/FVC ratio, peak of expiratory flow (PEF), forced expiratory flow at 50% (FEF50%), 75% average vital capacity (FEF25-75%), and average forced expiratory flow time (FEFT). This was a prospective study using results from chest radiographs, electrocardiograms, and questionnaires to investigate the participants' respiratory symptoms, sedentarism, and comorbidities (Charlson comorbidity index). From December 2010 to July 2014, individuals were randomly selected from various locations in the state of Rio de Janeiro. All individuals were examined by a single technician in the morning at the laboratory, and performed the spirometry with the same spirometer. Spirometry values were tabulated for the creation of three equation models: linear regression, logarithmic regression, and logarithms through a method that incorporates the lambda, median, and coefficient of variation (LMS method). Initially, 7003 individuals from both genders were contacted, and 454 were recruited. The data from the new equations were compared with one Brazilian and eight international equations, resulting in a high correlation (r>0.9). The values derived from the LMS method and linear regression were very similar (P>0.5), and both could be used to acquire the reference values for Brazilian spirometry. Data derived from the equations of this study were different from the current Brazilian equation, which could be justified by the different method used.

Spirometry; Lung function test; Reference values; FVC; FEV1


Introduction

Spirometric measurements can be interpreted by comparing numbers derived from a certain population. Spirometry reference values (or standard numbers) are derived from healthy individuals (11. Sunderman FW Jr. Current concepts of "normal values", "reference values", and "discrimination values" in clinical chemistry. Clin Chem 1975; 21: 1873–1877.). The reference population should represent the general population (22. SBPT. Sociedade Brasileira de Pneumologia e Tisiologia. Diretrizes para Testes de Função Pulmonar. J Pneumol 2002; 28(Suppl 3): S1-S238.,33. Pellegrino R, Viegi G, Brusasco V, Crapo RO, Burgos F, Casaburi R, et al. Standardisation of spirometry. Eur Respir J 2005; 26: 948–968, doi: 10.1183/09031936.05.00035205.
https://doi.org/10.1183/09031936.05.0003...
).

According to the Brazilian Institute of Geography and Statistics (IBGE - Instituto Brasileiro de Geografia e Estatística) (44. IBGE. Brasília: Instituto Brasileiro de Geografia e Estatística [updated 2015 Aug 28; cited 2016 May 3]. http://www.ibge.gov.br/home.
http://www.ibge.gov.br/home...
), Brazil has had many spontaneous migratory flows since 1884, which continue into the present day. Germans, Spaniards, Italians, Japanese, Portuguese, Syrians, Turks, Africans, along with the native indigenous population constitute the Brazilian gene pool (44. IBGE. Brasília: Instituto Brasileiro de Geografia e Estatística [updated 2015 Aug 28; cited 2016 May 3]. http://www.ibge.gov.br/home.
http://www.ibge.gov.br/home...
). Thus, Brazilian spirometric reference values could and should present characteristics similar to other populations around the world.

The aim of this study is to present an equation for the Brazilian population using an alternate method in order to validate the present reference values for spirometry (55. Pereira CAC, Sato T, Rodrigues SC. Novos valores de referência para espirometria forçada em brasileiros adultos de raça branca. J Bras Pneumol 2007; 33: 397–406, doi: 10.1590/S1806-37132007000400008.
https://doi.org/10.1590/S1806-3713200700...
), yield new numbers, or support data from international literature.

Material and Methods

We conducted a cross-sectional study and evaluated healthy individuals (20 to 80 years old) with sedentary lifestyles from December 2010 to July 2014. The study was approved by the Research Ethics Committee of the Universidade do Estado do Rio de Janeiro (UERJ, 2782/2010-CAAE 0226.0.228.00-10). Volunteers were randomly selected from various regions of the state of Rio de Janeiro, in Southeastern Brazil. The locations chosen for pre-selection included the Sports Authority of Rio de Janeiro, Senior Citizens University, Herbert Viana Hemotherapy Unit, Greater Rio Samba Schools (Salgueiro, Vila Isabel, and Mangueira). Volunteers were undergraduate and graduate students from UERJ and Veiga de Almeida University, visitors of patients from Hospital Universitário Pedro Ernesto, and citizens from various neighborhoods in Rio de Janeiro. Ethnicity was self-defined.

Considering a Brazilian population of 190,000,000 at the time this research started in December of 2010 (IBGE) (44. IBGE. Brasília: Instituto Brasileiro de Geografia e Estatística [updated 2015 Aug 28; cited 2016 May 3]. http://www.ibge.gov.br/home.
http://www.ibge.gov.br/home...
), the sample size was calculated to yield a 95% confidence level with a 5% margin of error. Despite the population growth to 204,761,379 (IBGE 2015) from 2011 to 2015, the calculated number of individuals remained the same. Therefore, in order to obtain a representative sample of the Brazilian population, 377 individuals were necessary. The percentage of individuals for each age group was calculated based on IBGE (44. IBGE. Brasília: Instituto Brasileiro de Geografia e Estatística [updated 2015 Aug 28; cited 2016 May 3]. http://www.ibge.gov.br/home.
http://www.ibge.gov.br/home...
) data.

The inclusion criteria were sedentary individuals between 20 and 80 years of age, and absence of a smoking history, and pulmonary, cardiac, and neurological diseases. A sedentary lifestyle was defined as no or irregular physical activity less than 150 min a week according to the World Health Organization (66. WHO. World Health Organization [updated 2016 June; cited 2016 Jul 12]. http://www.who.int/mediacentre/factsheets/fs385/en/.
http://www.who.int/mediacentre/factsheet...
).

The exclusion criteria were smokers and ex-smokers, illegal drug users, and individuals with any of the following: active lifestyles; spirometry results not meeting the criteria for acceptability and reproducibility (22. SBPT. Sociedade Brasileira de Pneumologia e Tisiologia. Diretrizes para Testes de Função Pulmonar. J Pneumol 2002; 28(Suppl 3): S1-S238.); radiographic evidence of pleuropulmonary lesions [including pulmonary masses, hyperinflation pattern (flattened hemidiaphragm) or interstitial disease]; specific abnormal findings on electrocardiograms such as ischemic region, myocardial infarction, tachyarrhythmia, or complete ventricular blockages; respiratory infections of the upper and/or lower airways in the 6 weeks before the spirometry; a Charlson index above 1 (77. Charlson M, Szatrowski TP, Peterson J, Gold J. Validation of a combined comorbidity index. J Clin Epidemiol 1994; 47: 1245–1251, doi: 10.1016/0895-4356(94)90129-5.
https://doi.org/10.1016/0895-4356(94)901...
); cognitive deficit preventing comprehension of the questionnaire and implementation of the pulmonary function test (88. Allen SC, Charlton C, Backen W, Warwick-Sanders M, Yeung P. Performing slow vital capacity in older people with and without cognitive impairment - is it useful? Age Ageing 2010;39: 588–591, doi: 10.1093/ageing/afq084.
https://doi.org/10.1093/ageing/afq084...
); debilitating and chronic diseases, such as cardiopathies, pneumopathies, and neuropathies; unstable angina or arterial hypertension (systolic arterial pressure >200 mmHg or diastolic arterial pressure >110 mmHg) (22. SBPT. Sociedade Brasileira de Pneumologia e Tisiologia. Diretrizes para Testes de Função Pulmonar. J Pneumol 2002; 28(Suppl 3): S1-S238.); a recent history of cardiac arrhythmia or myocardial infarction (22. SBPT. Sociedade Brasileira de Pneumologia e Tisiologia. Diretrizes para Testes de Função Pulmonar. J Pneumol 2002; 28(Suppl 3): S1-S238.,33. Pellegrino R, Viegi G, Brusasco V, Crapo RO, Burgos F, Casaburi R, et al. Standardisation of spirometry. Eur Respir J 2005; 26: 948–968, doi: 10.1183/09031936.05.00035205.
https://doi.org/10.1183/09031936.05.0003...
); medication use for treating cardiopathies (beta-blockers) (99. Salpeter S, Ormiston T, Salpeter E. Cardioselective beta-blockers for reversible airway disease. Cochrane Database Syst Rev 2002; (4): CD002992, doi: 10.1002/14651858.CD002992.
https://doi.org/10.1002/14651858.CD00299...
); respiratory atopies (22. SBPT. Sociedade Brasileira de Pneumologia e Tisiologia. Diretrizes para Testes de Função Pulmonar. J Pneumol 2002; 28(Suppl 3): S1-S238.,33. Pellegrino R, Viegi G, Brusasco V, Crapo RO, Burgos F, Casaburi R, et al. Standardisation of spirometry. Eur Respir J 2005; 26: 948–968, doi: 10.1183/09031936.05.00035205.
https://doi.org/10.1183/09031936.05.0003...
,1010. Knudson RJ, Lebowitz MD, Holberg CJ, Burrows B. Changes in the normal maximal expiratory flow-volume curve with growth and aging. Am Rev Respir Dis 1983;127: 725–734.); and hemoptysis.

All chest radiographs were analyzed by a pulmonologist holding a specialist title from the Brazilian Society of Pneumology and Tisiology (BSPT). The electrocardiogram was performed by the Cardiology Service. The physician responsible for the report was a cardiologist from the Brazilian Society of Cardiology (BSC). Physical therapists received prior training for the administration of the pre-selection questionnaire (22. SBPT. Sociedade Brasileira de Pneumologia e Tisiologia. Diretrizes para Testes de Função Pulmonar. J Pneumol 2002; 28(Suppl 3): S1-S238.), the Charlson index (77. Charlson M, Szatrowski TP, Peterson J, Gold J. Validation of a combined comorbidity index. J Clin Epidemiol 1994; 47: 1245–1251, doi: 10.1016/0895-4356(94)90129-5.
https://doi.org/10.1016/0895-4356(94)901...
), and the International Physical Activity Questionnaire (1111. Craig CL, Marshall AL, Sjostrom M, Bauman AE, Booth Ml, Ainsworth Be, et al. International Physical Activity Questionnaire: 12-Country Reliability and Validity. Med Sci Sports Exerc 2003; 35: 1381–1395, doi: 10.1249/01.MSS.0000078924.61453.FB.
https://doi.org/10.1249/01.MSS.000007892...
).

Spirometry

Spirometry exams were conducted from 8:00 am to 12:00 noon, at the Laboratory of Pulmonary Function of the UERJ, a referral center with 25 years of experience accredited by the BSPT for training professionals in pulmonary function in the state of Rio de Janeiro.

The exams followed the American Thoracic Society (ATS) 1987 protocol (1212. ATS. American Thoracic Society. Standardization of spirometry - 1987 update. Am Rev Respir Dis 1987; 136: 1285–1298, doi: 10.1164/ajrccm/136.5.1285.
https://doi.org/10.1164/ajrccm/136.5.128...
), which was adapted for the Brazilian Guidelines for Pulmonary Function Tests (2002) (22. SBPT. Sociedade Brasileira de Pneumologia e Tisiologia. Diretrizes para Testes de Função Pulmonar. J Pneumol 2002; 28(Suppl 3): S1-S238.).

The device used was the Vitatrace VT 130 SL (Codax Ltda., Brazil) breath spirometer, which was integrated to the Spiromatic 2.0 program (Engelógica, Rio de Janeiro, Brazil). A maximum of 8 breaths (forced spirometry manipulations) and a minimum of 3 were taken in order to meet the acceptability and reproducibility criteria.

The acceptability criteria of the curves adhered to the following criteria proposed by ATS (1212. ATS. American Thoracic Society. Standardization of spirometry - 1987 update. Am Rev Respir Dis 1987; 136: 1285–1298, doi: 10.1164/ajrccm/136.5.1285.
https://doi.org/10.1164/ajrccm/136.5.128...
) and BSPT (22. SBPT. Sociedade Brasileira de Pneumologia e Tisiologia. Diretrizes para Testes de Função Pulmonar. J Pneumol 2002; 28(Suppl 3): S1-S238.): a retroextrapolation volume <5% of the forced vital capacity (FVC) or 150 mL; forced expiration duration of at least 6 s; occurrence of a plateau in the volume-time curve for at least 1 s, after a minimum expiratory time of 6 s, or a volume in the last second lower than 25 mL, and a number of 3 to 8 breaths, with at least 3 acceptable and 2 reproducible curves.

The criteria for curve reproducibility followed those proposed by ATS/ERS (European Respiratory society) (33. Pellegrino R, Viegi G, Brusasco V, Crapo RO, Burgos F, Casaburi R, et al. Standardisation of spirometry. Eur Respir J 2005; 26: 948–968, doi: 10.1183/09031936.05.00035205.
https://doi.org/10.1183/09031936.05.0003...
) and BSPT (22. SBPT. Sociedade Brasileira de Pneumologia e Tisiologia. Diretrizes para Testes de Função Pulmonar. J Pneumol 2002; 28(Suppl 3): S1-S238.): difference in FVC in the best two curves <150 mL, forced expiratory volume in 1 s (FEV1) in the best two curves <150 mL, and difference in the peak of expiratory flow (PEF) in the best curves <10%.

The outcome variables were FVC, FEV1, FEV1/FVC, PEF, 25 to 75% forced expiratory flow from the curve (FEF25-75%), FEF50%, FEF75%, and average forced expiratory flow time (FEFT).

Statistical analysis and derivation of equations

Kolmogorov-Smirnov tests were performed in order to determine whether the study population was homogeneous. Subsequently, parametric tests (Student's t-test and the Pearson correlation equation) were used to analyze values with normal distribution, taking into account the average and standard deviation. Anthropometric and spirometry data are reported as medians and percentages, using number and point graphs. All analyses were carried out in Stata 14 (StataCorp LP, USA). Estimated coefficients with P<0.05 were considered to be significant.

In the univariate regression analysis, the dependent variables were the spirometric indices. Correlation coefficient tests of the functional parameters with anthropometric variables and their transformations were conducted. Variables that had a P<0.10 were selected for inclusion in the multivariate analysis.

After determining the multiple regression equations, residuals were identified and their adherence to the normal curve was graphically confirmed. In addition, the asymmetry of the equation was analyzed by 4 tests: Mardia's asymmetric, Mardia's kurtosis, Henze-Zirkler, and Doornik-Hansen. The one with the greatest value was noted.

The residual method was used to establish the threshold of the reference value, once the regression equation was calculated. The calculated value was subtracted from the average residual value of the equation and corrected by the standard deviation, in order to achieve 95% confidence level (multiplied by the constant 1.645).

The following three equations were calculated for FVC and FEV1: multivariate linear regression, logarithmic regression, and logarithmic regression with the spline variable. This variable is being used for equations of the Global Lung Function Initiative (GLI) (1313. Quanjer PH, Stanojevic S, Cole TJ, Baur X, Hall GL, Culver BH, et al. ERS global lung function initiative. Multi-ethnic reference values for spirometry for the 3-95-yr age range: the global lung function 2012 equations. Eur Respir J 2012; 40: 1324–1343, doi: 10.1183/09031936.00080312.
https://doi.org/10.1183/09031936.0008031...
) and recent Japanese equations (1414. Kubota M, Kobayashi H, Quanjer PH, Omori H, Tatsumi K, Kanazawa M. Clinical Pulmonary Functions Committee of the Japanese Respiratory Society. Reference values for spirometry, including vital capacity, in Japanese adults calculated with the LMS method and compared with previous values. Respir Investig 2014; 52: 242–250, doi: 10.1016/j.resinv.2014.03.003.
https://doi.org/10.1016/j.resinv.2014.03...
).

Logarithmic spline equations were calculated with the lambda-median-coefficient of variation (LMS) method. The purpose of the spline is to turn the dependent variable into a non-linear variable (from parametric to non-parametric), allowing it to be an exploratory parameter that can vary slightly (non-linearly). The spline variable was defined after finding the mean, deviation, and asymmetry of the equation, considering the standard normal distribution:

(1)
where LMS (λ, μ, σ) = λ (asymmetry), μ (mean), σ (deviation).

After the transformation and assuming that the variable (y) features a smooth curve, the Box-Cox method was applied, with age interpolation via the Box-Cox Cole and Green methods.

Regression equations were calculated according to Pereira et al. (55. Pereira CAC, Sato T, Rodrigues SC. Novos valores de referência para espirometria forçada em brasileiros adultos de raça branca. J Bras Pneumol 2007; 33: 397–406, doi: 10.1590/S1806-37132007000400008.
https://doi.org/10.1590/S1806-3713200700...
), Knudson et al. (1010. Knudson RJ, Lebowitz MD, Holberg CJ, Burrows B. Changes in the normal maximal expiratory flow-volume curve with growth and aging. Am Rev Respir Dis 1983;127: 725–734.), Crapo et al. (1515. Crapo RO, Morris AH, Gardner RM. Reference spirometric values using techniques and equipment that meet ATS recommendations. Am Rev Respir Dis 1981; 123: 659–664.), Hankinson et al. (1616. Hankinson JL, Odencrantz JR, Fedan KB. Spirometric reference values from a sample of the general U.S. population. Am J Respir Crit Care Med 1999; 159: 179–187, doi: 10.1164/ajrccm.159.1.9712108.
https://doi.org/10.1164/ajrccm.159.1.971...
), Pérez et al. (1717. Pérez-Padilla R, Valdivia G, Muião A, López MV, Márquez MN, Montes de Oca M, et al. Spirometric reference values in 5 large Latin American cities for subjects aged 40 years or over. Arch Bronconeumol 2006; 42: 317–325, doi: 10.1016/S1579-2129(06)60540-5.
https://doi.org/10.1016/S1579-2129(06)60...
), Falaschetti et al. (1818. Falaschetti E, Laiho J, Primatesta P, Purdon S. Prediction equations for normal and low lung function from the Health Survey for England. Eur Respir J 2004; 23: 456–463.), and Brändli et al. (1919. Brändli O, Schindler C, Künzli N, Keller R, Perruchoud AP. Lung function in healthy never smoking adults: reference values and lower limits of normal of a Swiss population. Chest 1996; 51: 277–283.) and compared with the equations of the present study (referred to as Rufino et al.). The values from Kubota et al. (1414. Kubota M, Kobayashi H, Quanjer PH, Omori H, Tatsumi K, Kanazawa M. Clinical Pulmonary Functions Committee of the Japanese Respiratory Society. Reference values for spirometry, including vital capacity, in Japanese adults calculated with the LMS method and compared with previous values. Respir Investig 2014; 52: 242–250, doi: 10.1016/j.resinv.2014.03.003.
https://doi.org/10.1016/j.resinv.2014.03...
) and GLI (1313. Quanjer PH, Stanojevic S, Cole TJ, Baur X, Hall GL, Culver BH, et al. ERS global lung function initiative. Multi-ethnic reference values for spirometry for the 3-95-yr age range: the global lung function 2012 equations. Eur Respir J 2012; 40: 1324–1343, doi: 10.1183/09031936.00080312.
https://doi.org/10.1183/09031936.0008031...
) were compared using the spline method (or LMS). It was also used the Bland-Altman method with GraphPad Prism 6:04 (USA) for agreement analysis.

Results

From December of 2010 to July of 2014, a total of 454 individuals were recruited, with 55 being excluded (Figure 1). The sample showed homogeneity when grouped according to age and according to gender (Table 1). More women than men were recruited; this is due to the higher frequency of diseases among men, as well as a higher level of physical activity compared to women. The weight (in kg) was higher in men than in women. However, when corrected by height squared to calculate BMI, differences in weight were non-significant. The lack of significant differences between BMI and age demonstrated that male and female groups were homogeneous (Table 1). The age varied between 20 and 74 in males, and between 20 and 80 in females. There were no differences among age groups selected in 20-year intervals, and between African and non-African descent, based on self-defined ethnicity (Figure 2).

Figure 1
Patient recruitment flowchart. A total of 16.73% excluded or abandoned the study (12.11% during the test stage, 4.62% during spirometry); a total of 83.27% completed all phases.
Figure 2
Forced vital capacity (FVC) and forced expiratory volume in 1 second (FEV1) in two Brazilian ethnicities. Horizontal lines indicate mean±SD.

Except for FEV1/FVC ratio, spirometric indices were all higher in males than in females. There was a decrease of approximately 20 mL per year of age in FVC and FEV1 for both genders. The correlations of anthropometric variables were compared with spirometric indices and the r2 value was identified (Tables 2 and 3; Figure 3).

Figure 3
Results of the Bland-Altman test in the forced vital capacity (FVC) in men. Rufino et al. is the present study.

Equation coefficients for men and women are reported in Table 3. The logarithmic spline data calculated through the LMS method are reported in Table 4. Table 5 shows the correlations between the proposed equations and the other eight equations currently used worldwide. The non-significant differences between the findings obtained through the linear equation and the LMS (spline) equation are reported in Table 6.

Discussion

One of the most important tools in the sustainability of equations for reference values in a healthy population is the proper definition of health itself (11. Sunderman FW Jr. Current concepts of "normal values", "reference values", and "discrimination values" in clinical chemistry. Clin Chem 1975; 21: 1873–1877.,2020. Clausen JL. Pulmonary function testing guidelines and controversies: equipment, methods, and normal values. New York: Academic Press; 1982.,2121. Becklake MR. Concepts of normality applied to the measurement of lung function. Am J Med 1986; 80: 1158–1164, doi: 10.1016/0002-9343(86)90678-9.
https://doi.org/10.1016/0002-9343(86)906...
). Being "healthy" means not having a disease or having an effectively controlled disease. However, the drugs used for controlling diseases often change pulmonary function (e.g., beta-blockers) (99. Salpeter S, Ormiston T, Salpeter E. Cardioselective beta-blockers for reversible airway disease. Cochrane Database Syst Rev 2002; (4): CD002992, doi: 10.1002/14651858.CD002992.
https://doi.org/10.1002/14651858.CD00299...
), which in turn decreases the pool of healthy people in lung analysis, as the frequency of diseases increases with age (2222. MacNee W, Rabinovich RA, Choudhury G. Ageing and the border between health and disease. Eur Respir J 2014; 44: 1332–1352, doi: 10.1183/09031936.00134014.
https://doi.org/10.1183/09031936.0013401...
,2323. Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lance. 2012; 380: 37–43, doi: 10.1016/S0140-6736(12)60240-2.
https://doi.org/10.1016/S0140-6736(12)60...
). In a Scottish study (2323. Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lance. 2012; 380: 37–43, doi: 10.1016/S0140-6736(12)60240-2.
https://doi.org/10.1016/S0140-6736(12)60...
) involving 1,751,841 patients, a large proportion of individuals >60 had eight disorders. At the age of 85, all had at least one disorder and almost 10% had eight disorders, including systemic arterial hypertension, diabetes mellitus, osteoporosis, obstructive chronic lung disease, and cancer. In other words, having multiple co-morbidities is a reality in older people. Therefore, to develop equations for the elderly is a challenge. In Brazil, the average life expectancy is about 74 years old (44. IBGE. Brasília: Instituto Brasileiro de Geografia e Estatística [updated 2015 Aug 28; cited 2016 May 3]. http://www.ibge.gov.br/home.
http://www.ibge.gov.br/home...
), which is another limiting factor.

Enright et al. (2424. Enright PL, Adams AB, Boyle PJ, Sherrill DL. Spirometry and maximal respiratory pressure references from healthy Minnesota 65- to 85-year-old women and men. Chest 1995; 108: 663–669, doi: 10.1378/chest.108.3.663.
https://doi.org/10.1378/chest.108.3.663...
) derived regression equations from "healthy" adults aged 65 years or older with a smoking history of up to 5 pack-years, but that quit smoking before turning 50. There were 288 individuals, with 82 below the age of 70 years. The results demonstrated that PEF was greater than expected in 10% of the cases. Part of this finding was attributed to the systemic arterial hypertension in the controlled "healthy" subjects. The higher the arterial pressure, the greater the maximum expiratory flow. The influence from arterial pressure was also a finding in the work of Pereira et al. (55. Pereira CAC, Sato T, Rodrigues SC. Novos valores de referência para espirometria forçada em brasileiros adultos de raça branca. J Bras Pneumol 2007; 33: 397–406, doi: 10.1590/S1806-37132007000400008.
https://doi.org/10.1590/S1806-3713200700...
), which linked lower FVC and FEV1 values to arterial hypertension.

Another analysis included healthy individuals who were physically active. It is well known that physical activity can increase lung volume, especially the practice of water polo, basketball, rowing (e.g., canoeing), handball, and soccer (2525. Mazic S, Lazovic B, Djelic M, Suzic-Lazic J, Djordjevic-Saranovic S, Durmic T, et al. Respiratory parameters in elite athletes-does sport have an influence? Rev Port Pneumol 2015; 21: 192–197.,2626. Durmic T, Lazovic B, Djelic M, Lazic JS, Zikic D, Zugic V, Dekleva M, et al. Sport-specific influences on respiratory patterns in elite athletes. J Bras Pneumol 2015; 41: 516–522, doi: 10.1590/S1806-37562015000000050.
https://doi.org/10.1590/S1806-3756201500...
). The equations developed in this study were generated from a sedentary population. This probably caused the values to be lower in comparison with the other equations.

Brändli et al. (1919. Brändli O, Schindler C, Künzli N, Keller R, Perruchoud AP. Lung function in healthy never smoking adults: reference values and lower limits of normal of a Swiss population. Chest 1996; 51: 277–283.) and Crapo et al. (1515. Crapo RO, Morris AH, Gardner RM. Reference spirometric values using techniques and equipment that meet ATS recommendations. Am Rev Respir Dis 1981; 123: 659–664.) did not exclude smokers or ex-smokers from their sample. Today, smoking is seen as an unhealthy habit, since it is well-known that it can lead to an acute or chronic reduction in pulmonary function (22. SBPT. Sociedade Brasileira de Pneumologia e Tisiologia. Diretrizes para Testes de Função Pulmonar. J Pneumol 2002; 28(Suppl 3): S1-S238.,33. Pellegrino R, Viegi G, Brusasco V, Crapo RO, Burgos F, Casaburi R, et al. Standardisation of spirometry. Eur Respir J 2005; 26: 948–968, doi: 10.1183/09031936.05.00035205.
https://doi.org/10.1183/09031936.05.0003...
,2727. SBPT. I Consenso Brasileiro sobre Espirometria. J Pneumol 1996; 22: 105–164.,2828. Cohen CA, Hudson AR, Clausen JL, Knelson JH. Respiratory symptoms, spirometry, and oxidant air pollution in nonsmoking adults. Am Rev Respir Dis 1972; 105: 251–261.).

The place where the exams are carried out also have a relevant effect on pulmonary function. Values generated with field devices generally use pneumotachographs and are corrected or rendered homogeneous by BTPS (body temperature and pressure, saturated) conditions. However, the environmental pollution factor cannot be corrected and it directly interferes with lung function, especially in cities with high pollution levels (2929. da Silva LF, Saldiva SR, Saldiva PH, Dolhnikoff M, Bandeira Científica Project. Impaired lung function in individuals chronically exposed to biomass combustion. Environ Res 2012; 112: 111–117, doi: 10.1016/j.envres.2011.10.012.
https://doi.org/10.1016/j.envres.2011.10...
). Equations of Crapo et al. (1515. Crapo RO, Morris AH, Gardner RM. Reference spirometric values using techniques and equipment that meet ATS recommendations. Am Rev Respir Dis 1981; 123: 659–664.) and Knudson et al. (1010. Knudson RJ, Lebowitz MD, Holberg CJ, Burrows B. Changes in the normal maximal expiratory flow-volume curve with growth and aging. Am Rev Respir Dis 1983;127: 725–734.) featured this factor.

The values used in our equations were standardized by using only one device, by the same technique, taken in the same laboratory during the morning, which differs from all other equations presented and discussed in this article.

In order to properly represent the population being studied, we enrolled the minimum number required. Quanjer et al. (3030. Quanjer PH, Stocks J, Cole TJ, Hall GL, Stanojevic S; Global Lungs Initiative. Influence of secular trends and sample size on reference equations for lung function tests. Eur Respir J 2011; 37: 658–664, doi: 10.1183/09031936.00110010.
https://doi.org/10.1183/09031936.0011001...
) considered 100 to be the minimum number per gender required for creating an equation. Similar to the study carried out by Knudson et al. (1010. Knudson RJ, Lebowitz MD, Holberg CJ, Burrows B. Changes in the normal maximal expiratory flow-volume curve with growth and aging. Am Rev Respir Dis 1983;127: 725–734.) it took many years to obtain the appropriate sample size for our study. Knudson et al. (1010. Knudson RJ, Lebowitz MD, Holberg CJ, Burrows B. Changes in the normal maximal expiratory flow-volume curve with growth and aging. Am Rev Respir Dis 1983;127: 725–734.) performed a double-triple questionnaire check. We performed a double questionnaire check for morbidity and mortality. The questionnaire by Charlson was also used as a check against the first, which was broader and included questions regarding symptoms. In order to avoid biases regarding "forgotten" diseases or disease denial or impaired respiratory function, chest radiographs were performed in all patients, similarly to Crapo et al. (1515. Crapo RO, Morris AH, Gardner RM. Reference spirometric values using techniques and equipment that meet ATS recommendations. Am Rev Respir Dis 1981; 123: 659–664.), as well as electrocardiograms. These criteria made our sample selection a very rigorous process.

Ethnicity is an important variable of complex identification. In our data, self-declared ethnicity did not differ significantly among the groups from which the reference values were derived. It is understood that ethnicity affects body proportions, such as the Cormic index, which is the relation between the height measured at sitting position (encephalic-trunk height) and standing height. Lung volume would be more correlated with seating height than with standing height (stature). This can occur in up to 53% of African descendants and Caucasian-Americans (3131. Harik-Khan RI, Muller DC, Wise RA. Racial difference in lung function in African-American and White children: effect of anthropometric, socioeconomic, nutritional, and environmental factors. Am J Epidemiol 2004; 160: 893–900, doi: 10.1093/aje/kwh297.
https://doi.org/10.1093/aje/kwh297...
). Our analysis did not confirm differences between ethnicities as it has also been shown in some Brazilian genetic studies (3232. Lins TC, Vieira RG, Abreu BS, Grattapaglia D, Pereira RW. Genetic composition of Brazilian population samples based on a set of twenty eight ancestry informative SNPs. Am J Hum Bio 2010; 22: 187–192, doi: 10.1002/ajhb.20976.
https://doi.org/10.1002/ajhb.20976...
,3333. Friedrich DC, Genro JP, Sortica VA, Suarez-Kurtz G, de Moraes ME, Pena SD, et al. Distribution of CYP2D6 alleles and phenotypes in the Brazilian population. PLoS One 2014; 9: e110691., doi: 10.1371/journal.pone.0110691.
https://doi.org/10.1371/journal.pone.011...
). This might be explained, at least in part, by the broad miscegenation in our population.

Gender can account for up to 30% of pulmonary function variation and the separation of reference equations by gender is common (3434. Collins DV, Cutillo AG, Armstrong JD, Crapo RO, Kanner RE, Tocino I, et al. Large airway size, lung size, and maximal expiratory flow in healthy nonsmokers. Am Rev Respir Dis 1986; 134: 951–955, doi: 10.1164/arrd.1986.134.5.951.
https://doi.org/10.1164/arrd.1986.134.5....
). We found differences of up to 31% in respiratory volumes between genders. It is understood that men’s larger lung size also interferes with all the other airway components (3535. Martin TR, Castile RG, Fredberg JJ, Wohl ME, Mead J. Airway size is related to sex but not lung size in normal adults. J Appl Physiol 1987; 63: 2042–2047.). This partially explains the lower FEV1/FVC in men than women, implying that the airways are more subjected to dynamic compression (2020. Clausen JL. Pulmonary function testing guidelines and controversies: equipment, methods, and normal values. New York: Academic Press; 1982.).

The choice of using a certain reference equation can result in the characterization of a specific respiratory disorder in some individuals (3636. Vaz Fragoso CA, McAvay G, Van Ness PH, Casaburi R, Jensen RL, MacIntyre N, et al. Phenotype of normal spirometry in an aging population. Am J Respir Crit Care Med 2015;192: 817–825, doi: 10.1164/rccm.201503-0463OC.
https://doi.org/10.1164/rccm.201503-0463...
). The GLI (1313. Quanjer PH, Stanojevic S, Cole TJ, Baur X, Hall GL, Culver BH, et al. ERS global lung function initiative. Multi-ethnic reference values for spirometry for the 3-95-yr age range: the global lung function 2012 equations. Eur Respir J 2012; 40: 1324–1343, doi: 10.1183/09031936.00080312.
https://doi.org/10.1183/09031936.0008031...
) used a new statistical model (LMS), which is the transformation of metric data into parametric data. The LMS is a method that can equalize errors. It turns nonparametric samples in parametric samples and it has been used in various parts of the world. Thus, the method can merge data from different parts of the world using the interpolation variables. The ERS task force derived equations for reference values using a bank of 160,000 individuals from 72 pulmonary function laboratories in 33 countries. After applying the exclusion criteria, a significant number of 97,759 "healthy," non-smoking individuals, who were 2.5 to 95 years of age with different ethnicities, were included, such as Caucasians, African-Americans, northern and southeastern Asians, Latin Americans, Native Americans, Polynesians, and Arabs. It is very difficult to obtain homogeneous data with such a mixture of numbers and ethnicities. Therefore, such research should be considered a proposal and not an operational standard, since it was not a prospective and controlled study and data were collected in pulmonary function labs with different quality levels. Despite these contradictory facts, the equations were made using the LMS method (1313. Quanjer PH, Stanojevic S, Cole TJ, Baur X, Hall GL, Culver BH, et al. ERS global lung function initiative. Multi-ethnic reference values for spirometry for the 3-95-yr age range: the global lung function 2012 equations. Eur Respir J 2012; 40: 1324–1343, doi: 10.1183/09031936.00080312.
https://doi.org/10.1183/09031936.0008031...
). When we compared the data from the linear equations for men and women, both FVC and FEV1 did not show statistical differences. In other words, the LMS method or linear regression should yield similar values, which can be beneficial when using the LMS method for international equations in the future.

The linear regression equations featured similar values for the coefficients, residuals, and asymmetry when compared to the logarithmic equations, including those for respiratory flows, which is also accepted by the Knudson et al. (1010. Knudson RJ, Lebowitz MD, Holberg CJ, Burrows B. Changes in the normal maximal expiratory flow-volume curve with growth and aging. Am Rev Respir Dis 1983;127: 725–734.) and Hankinson et al. (1616. Hankinson JL, Odencrantz JR, Fedan KB. Spirometric reference values from a sample of the general U.S. population. Am J Respir Crit Care Med 1999; 159: 179–187, doi: 10.1164/ajrccm.159.1.9712108.
https://doi.org/10.1164/ajrccm.159.1.971...
) equations.

Studies have suggested that FVC and FEV1 are proportional to body size (22. SBPT. Sociedade Brasileira de Pneumologia e Tisiologia. Diretrizes para Testes de Função Pulmonar. J Pneumol 2002; 28(Suppl 3): S1-S238.,2020. Clausen JL. Pulmonary function testing guidelines and controversies: equipment, methods, and normal values. New York: Academic Press; 1982.,3737. Lowery EM, Brubaker AL, Kuhlmann E, Kovacs EJ. The aging lung. Clin Interv Aging 2013; 8: 1489–1496.3939. Quanjer PH, Capderou A, Mazicioglu MM, Aggarwal AN, Banik SD, Popovic S, et al. All-age relationship between arm span and height in different ethnic groups. Eur Respir J 2014; 44: 905–912, doi: 10.1183/09031936.00054014.
https://doi.org/10.1183/09031936.0005401...
). This means that a taller individual, with bigger lungs, would have a greater decrease in pulmonary volumes with age, while smaller individuals would have a smaller decrease (2020. Clausen JL. Pulmonary function testing guidelines and controversies: equipment, methods, and normal values. New York: Academic Press; 1982.,3838. Knudson RJ, Slatin RC, Lebowitz MD, Burrows B. The maximal expiratory flow-volume curve: normal standards, variability, effects of age. Am Rev Respir Dis 1976; 113: 587–599.). In our study, however, both men and women showed similar decreases with age.

The methodology used in our study of Brazilian equations was crucial towards the differences in absolute values obtained in the study by Pereira et al. (55. Pereira CAC, Sato T, Rodrigues SC. Novos valores de referência para espirometria forçada em brasileiros adultos de raça branca. J Bras Pneumol 2007; 33: 397–406, doi: 10.1590/S1806-37132007000400008.
https://doi.org/10.1590/S1806-3713200700...
), whose research generated higher values than ours. The reference values of Knudson et al. (1010. Knudson RJ, Lebowitz MD, Holberg CJ, Burrows B. Changes in the normal maximal expiratory flow-volume curve with growth and aging. Am Rev Respir Dis 1983;127: 725–734.) are still valid for the Brazilian population.

The equations derived from the study by Pereira et al. (55. Pereira CAC, Sato T, Rodrigues SC. Novos valores de referência para espirometria forçada em brasileiros adultos de raça branca. J Bras Pneumol 2007; 33: 397–406, doi: 10.1590/S1806-37132007000400008.
https://doi.org/10.1590/S1806-3713200700...
) are being used in Brazil. However, the authors had not published spirometry equations for Afro-Brazilian ethnicity. Our findings did not differ between self-defined Afro-Brazilian and non-Afro-Brazilian. Thus, the equations presented can also fill this gap. Another aspect to be noted is that there is a tendency in the literature to qualify the Brazilian ethnicity as the same of other Latin America countries. However, the migratory and colonizing currents among Latin American countries were different, which could interfere in spirometry values.

The coefficient of determinations of the spirometric equations were not close to 1. One of the reasons for this could be that the equations have frequently used the same variables (gender, age, height). One of the main advantages of our study is the use of a simple formula without logarithmic scales. Another important positive aspect is that we provide a new Brazilian equation obtained with a different method than previous studies. As in other countries, such as the United States, lung function laboratories may choose which equation is more suitable.

The LMS model for producing equations can be used in the Brazilian population. One of the characteristics of this method is statistical evolution and the potential to have standard spirometry reference values in the future.

Acknowledgments

We thank the Research Support Foundation of the State of Rio de Janeiro (FAPERJ - Fundação de Amparo a Pesquisa do Estado do Rio de Janeiro).

References

  • 1
    Sunderman FW Jr. Current concepts of "normal values", "reference values", and "discrimination values" in clinical chemistry. Clin Chem 1975; 21: 1873–1877.
  • 2
    SBPT. Sociedade Brasileira de Pneumologia e Tisiologia. Diretrizes para Testes de Função Pulmonar. J Pneumol 2002; 28(Suppl 3): S1-S238.
  • 3
    Pellegrino R, Viegi G, Brusasco V, Crapo RO, Burgos F, Casaburi R, et al. Standardisation of spirometry. Eur Respir J 2005; 26: 948–968, doi: 10.1183/09031936.05.00035205.
    » https://doi.org/10.1183/09031936.05.00035205
  • 4
    IBGE. Brasília: Instituto Brasileiro de Geografia e Estatística [updated 2015 Aug 28; cited 2016 May 3]. http://www.ibge.gov.br/home
    » http://www.ibge.gov.br/home
  • 5
    Pereira CAC, Sato T, Rodrigues SC. Novos valores de referência para espirometria forçada em brasileiros adultos de raça branca. J Bras Pneumol 2007; 33: 397–406, doi: 10.1590/S1806-37132007000400008.
    » https://doi.org/10.1590/S1806-37132007000400008
  • 6
    WHO. World Health Organization [updated 2016 June; cited 2016 Jul 12]. http://www.who.int/mediacentre/factsheets/fs385/en/
    » http://www.who.int/mediacentre/factsheets/fs385/en/
  • 7
    Charlson M, Szatrowski TP, Peterson J, Gold J. Validation of a combined comorbidity index. J Clin Epidemiol 1994; 47: 1245–1251, doi: 10.1016/0895-4356(94)90129-5.
    » https://doi.org/10.1016/0895-4356(94)90129-5
  • 8
    Allen SC, Charlton C, Backen W, Warwick-Sanders M, Yeung P. Performing slow vital capacity in older people with and without cognitive impairment - is it useful? Age Ageing 2010;39: 588–591, doi: 10.1093/ageing/afq084.
    » https://doi.org/10.1093/ageing/afq084
  • 9
    Salpeter S, Ormiston T, Salpeter E. Cardioselective beta-blockers for reversible airway disease. Cochrane Database Syst Rev 2002; (4): CD002992, doi: 10.1002/14651858.CD002992.
    » https://doi.org/10.1002/14651858.CD002992
  • 10
    Knudson RJ, Lebowitz MD, Holberg CJ, Burrows B. Changes in the normal maximal expiratory flow-volume curve with growth and aging. Am Rev Respir Dis 1983;127: 725–734.
  • 11
    Craig CL, Marshall AL, Sjostrom M, Bauman AE, Booth Ml, Ainsworth Be, et al. International Physical Activity Questionnaire: 12-Country Reliability and Validity. Med Sci Sports Exerc 2003; 35: 1381–1395, doi: 10.1249/01.MSS.0000078924.61453.FB.
    » https://doi.org/10.1249/01.MSS.0000078924.61453.FB
  • 12
    ATS. American Thoracic Society. Standardization of spirometry - 1987 update. Am Rev Respir Dis 1987; 136: 1285–1298, doi: 10.1164/ajrccm/136.5.1285.
    » https://doi.org/10.1164/ajrccm/136.5.1285
  • 13
    Quanjer PH, Stanojevic S, Cole TJ, Baur X, Hall GL, Culver BH, et al. ERS global lung function initiative. Multi-ethnic reference values for spirometry for the 3-95-yr age range: the global lung function 2012 equations. Eur Respir J 2012; 40: 1324–1343, doi: 10.1183/09031936.00080312.
    » https://doi.org/10.1183/09031936.00080312
  • 14
    Kubota M, Kobayashi H, Quanjer PH, Omori H, Tatsumi K, Kanazawa M. Clinical Pulmonary Functions Committee of the Japanese Respiratory Society. Reference values for spirometry, including vital capacity, in Japanese adults calculated with the LMS method and compared with previous values. Respir Investig 2014; 52: 242–250, doi: 10.1016/j.resinv.2014.03.003.
    » https://doi.org/10.1016/j.resinv.2014.03.003
  • 15
    Crapo RO, Morris AH, Gardner RM. Reference spirometric values using techniques and equipment that meet ATS recommendations. Am Rev Respir Dis 1981; 123: 659–664.
  • 16
    Hankinson JL, Odencrantz JR, Fedan KB. Spirometric reference values from a sample of the general U.S. population. Am J Respir Crit Care Med 1999; 159: 179–187, doi: 10.1164/ajrccm.159.1.9712108.
    » https://doi.org/10.1164/ajrccm.159.1.9712108
  • 17
    Pérez-Padilla R, Valdivia G, Muião A, López MV, Márquez MN, Montes de Oca M, et al. Spirometric reference values in 5 large Latin American cities for subjects aged 40 years or over. Arch Bronconeumol 2006; 42: 317–325, doi: 10.1016/S1579-2129(06)60540-5.
    » https://doi.org/10.1016/S1579-2129(06)60540-5
  • 18
    Falaschetti E, Laiho J, Primatesta P, Purdon S. Prediction equations for normal and low lung function from the Health Survey for England. Eur Respir J 2004; 23: 456–463.
  • 19
    Brändli O, Schindler C, Künzli N, Keller R, Perruchoud AP. Lung function in healthy never smoking adults: reference values and lower limits of normal of a Swiss population. Chest 1996; 51: 277–283.
  • 20
    Clausen JL. Pulmonary function testing guidelines and controversies: equipment, methods, and normal values. New York: Academic Press; 1982.
  • 21
    Becklake MR. Concepts of normality applied to the measurement of lung function. Am J Med 1986; 80: 1158–1164, doi: 10.1016/0002-9343(86)90678-9.
    » https://doi.org/10.1016/0002-9343(86)90678-9
  • 22
    MacNee W, Rabinovich RA, Choudhury G. Ageing and the border between health and disease. Eur Respir J 2014; 44: 1332–1352, doi: 10.1183/09031936.00134014.
    » https://doi.org/10.1183/09031936.00134014
  • 23
    Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lance. 2012; 380: 37–43, doi: 10.1016/S0140-6736(12)60240-2.
    » https://doi.org/10.1016/S0140-6736(12)60240-2
  • 24
    Enright PL, Adams AB, Boyle PJ, Sherrill DL. Spirometry and maximal respiratory pressure references from healthy Minnesota 65- to 85-year-old women and men. Chest 1995; 108: 663–669, doi: 10.1378/chest.108.3.663.
    » https://doi.org/10.1378/chest.108.3.663
  • 25
    Mazic S, Lazovic B, Djelic M, Suzic-Lazic J, Djordjevic-Saranovic S, Durmic T, et al. Respiratory parameters in elite athletes-does sport have an influence? Rev Port Pneumol 2015; 21: 192–197.
  • 26
    Durmic T, Lazovic B, Djelic M, Lazic JS, Zikic D, Zugic V, Dekleva M, et al. Sport-specific influences on respiratory patterns in elite athletes. J Bras Pneumol 2015; 41: 516–522, doi: 10.1590/S1806-37562015000000050.
    » https://doi.org/10.1590/S1806-37562015000000050
  • 27
    SBPT. I Consenso Brasileiro sobre Espirometria. J Pneumol 1996; 22: 105–164.
  • 28
    Cohen CA, Hudson AR, Clausen JL, Knelson JH. Respiratory symptoms, spirometry, and oxidant air pollution in nonsmoking adults. Am Rev Respir Dis 1972; 105: 251–261.
  • 29
    da Silva LF, Saldiva SR, Saldiva PH, Dolhnikoff M, Bandeira Científica Project. Impaired lung function in individuals chronically exposed to biomass combustion. Environ Res 2012; 112: 111–117, doi: 10.1016/j.envres.2011.10.012.
    » https://doi.org/10.1016/j.envres.2011.10.012
  • 30
    Quanjer PH, Stocks J, Cole TJ, Hall GL, Stanojevic S; Global Lungs Initiative. Influence of secular trends and sample size on reference equations for lung function tests. Eur Respir J 2011; 37: 658–664, doi: 10.1183/09031936.00110010.
    » https://doi.org/10.1183/09031936.00110010
  • 31
    Harik-Khan RI, Muller DC, Wise RA. Racial difference in lung function in African-American and White children: effect of anthropometric, socioeconomic, nutritional, and environmental factors. Am J Epidemiol 2004; 160: 893–900, doi: 10.1093/aje/kwh297.
    » https://doi.org/10.1093/aje/kwh297
  • 32
    Lins TC, Vieira RG, Abreu BS, Grattapaglia D, Pereira RW. Genetic composition of Brazilian population samples based on a set of twenty eight ancestry informative SNPs. Am J Hum Bio 2010; 22: 187–192, doi: 10.1002/ajhb.20976.
    » https://doi.org/10.1002/ajhb.20976
  • 33
    Friedrich DC, Genro JP, Sortica VA, Suarez-Kurtz G, de Moraes ME, Pena SD, et al. Distribution of CYP2D6 alleles and phenotypes in the Brazilian population. PLoS One 2014; 9: e110691., doi: 10.1371/journal.pone.0110691.
    » https://doi.org/10.1371/journal.pone.0110691
  • 34
    Collins DV, Cutillo AG, Armstrong JD, Crapo RO, Kanner RE, Tocino I, et al. Large airway size, lung size, and maximal expiratory flow in healthy nonsmokers. Am Rev Respir Dis 1986; 134: 951–955, doi: 10.1164/arrd.1986.134.5.951.
    » https://doi.org/10.1164/arrd.1986.134.5.951
  • 35
    Martin TR, Castile RG, Fredberg JJ, Wohl ME, Mead J. Airway size is related to sex but not lung size in normal adults. J Appl Physiol 1987; 63: 2042–2047.
  • 36
    Vaz Fragoso CA, McAvay G, Van Ness PH, Casaburi R, Jensen RL, MacIntyre N, et al. Phenotype of normal spirometry in an aging population. Am J Respir Crit Care Med 2015;192: 817–825, doi: 10.1164/rccm.201503-0463OC.
    » https://doi.org/10.1164/rccm.201503-0463OC
  • 37
    Lowery EM, Brubaker AL, Kuhlmann E, Kovacs EJ. The aging lung. Clin Interv Aging 2013; 8: 1489–1496.
  • 38
    Knudson RJ, Slatin RC, Lebowitz MD, Burrows B. The maximal expiratory flow-volume curve: normal standards, variability, effects of age. Am Rev Respir Dis 1976; 113: 587–599.
  • 39
    Quanjer PH, Capderou A, Mazicioglu MM, Aggarwal AN, Banik SD, Popovic S, et al. All-age relationship between arm span and height in different ethnic groups. Eur Respir J 2014; 44: 905–912, doi: 10.1183/09031936.00054014.
    » https://doi.org/10.1183/09031936.00054014

Publication Dates

  • Publication in this collection
    2017

History

  • Received
    12 Aug 2016
  • Accepted
    24 Jan 2017
Associação Brasileira de Divulgação Científica Av. Bandeirantes, 3900, 14049-900 Ribeirão Preto SP Brazil, Tel. / Fax: +55 16 3315-9120 - Ribeirão Preto - SP - Brazil
E-mail: bjournal@terra.com.br