Reliability of the Brazilian version of the Physical Activity Checklist Interview in children

Abstracts

OBJETIVO: Avaliar a confiabilidade do questionário Lista de Atividades Físicas em crianças. MÉTODOS: O estudo é parte da adaptação transcultural do questionário, realizado com 83 escolares de sete a dez anos, matriculados do segundo ao quinto ano do ensino fundamental da cidade de São Paulo, SP, em 2008. O questionário foi respondido pela criança por meio de entrevista individual, apresenta lista com 21 atividades físicas moderadas a vigorosas realizadas no dia anterior, é dividido em períodos (antes, durante e após a escola) e possui seção de avaliação da entrevista. O questionário permite quantificar: tempo em atividades físicas e sedentárias; e custos metabólicos total e ponderado. A confiabilidade foi avaliada comparando-se duas entrevistas realizadas com intervalo médio de três horas. Para a seção C (avaliação da entrevista), compararam-se dados da primeira entrevista e de um avaliador externo. Utilizaram-se a proposta de Bland & Altman e os coeficientes de correlação intraclasse e de correlação de concordância de Lin na avaliação da confiabilidade. RESULTADOS: Os limites inferiores dos coeficientes de correlação intraclasse para os desfechos analisados variaram de 0,84 a 0,96. A precisão e concordância variaram, respectivamente, de 0,83 a 0,97 e de 0,99 a 1. A reta estimada a partir de pares de valores obtidos nas duas aplicações para atividade física indica elevada precisão dos dados. O item da entrevista com pior resultado foi a habilidade em estimar tempo (regular em 27,7% das entrevistas). Os itens da seção C apresentaram coeficientes de correlação intraclasse entre 0,60 e 0,70, exceto o nível de cooperação (0,46). CONCLUSÕES: A Lista de Atividades Físicas apresenta alta confiabilidade para aferir atividade física e sedentária do dia anterior em crianças.

Criança; Atividade Motora; Avaliação; Questionários; Reprodutibilidade dos Testes

OBJETIVO: Evaluar la confiabilidad del cuestionario Lista de Actividades Físicas en niños. MÉTODOS: El estudio es parte de la adaptación transcultural del cuestionario, realizado con 83 escolares de siete a diez años, matriculados del 2º al 5º año de enseñanza fundamental de la ciudad de Sao Paulo, Sureste Brasil, en 2008. El cuestionario fue respondido por el niño por medio de entrevista individual, presenta lista con 21 actividades físicas moderadas a vigorosas realizadas en el día anterior, es dividido en períodos (antes, durante y posterior a la escuela) y posee sección de evaluación de la entrevista. El cuestionario permite cuantificar: tiempo en actividades físicas y sedentarias; y costos metabólicos total y ponderado. La confiabilidad fue evaluada comparándose dos entrevistas realizadas con intervalo promedio de tres horas. Para la Sección C (evaluación de la entrevista), se compararon datos de la primera entrevista y de un evaluador externo. Se utilizaron propuesta de Bland y Altman y los coeficientes de correlación intraclase y de correlación de concordancia de Lin en la evaluación de la confiabilidad. RESULTADOS: Los límites inferiores de los coeficientes de correlación intraclase para los resultados analizados variaron de 0,84 a 0,96. La precisión y depuración variaron, respectivamente, de 0,83 a 0,97 y de 0,99 a 1. La recta estimada a partir de pares de valores obtenidos en las dos aplicaciones para actividad física indica elevada precisión de los datos. El ítem de la entrevista con peor resultado fue la habilidad en estimar tiempo (regular en 27,6% de las entrevistas). Los itens de la Sección C presentaron coeficientes de correlación intraclase entre 0,60 y 0,70, excepto el nivel de cooperación (0,46). CONCLUSIONES: La Lista de Actividades Físicas presenta alta confiabilidad para contrastar actividad física y sedentaria del día anterior en niños.

Niño; Actividad Motora; Evaluación; Cuestionario; Reproducibilidad de Resultados

ARTIGO ORIGINAL

Reliability of the Brazilian version of the Physical Activity Checklist Interview in children

Fernando Adami^I; Fernanda Cruciani^I; Michelle Douek^II; Carolina Dumit Sewell^II; Aline Brandão Mariath^III; Patrícia de Fragas Hinnig^III; Silvia Rafaela Mascarenhas Freaza^III; Denise Pimentel Bergamaschi^IV

^IPrograma de Pós-Graduação em Saúde Pública. Faculdade de Saúde Pública (FSP). Universidade São Paulo (USP). São Paulo, SP, Brasil

^IICurso de Graduação em Nutrição. USP. São Paulo, SP, Brasil

^IIIPrograma de Pós-Graduação em Nutrição em Saúde Pública. FSP-USP. São Paulo, SP, Brasil

^IVDepartamento de Epidemiologia. Faculdade de Saúde Pública. Universidade de São Paulo. São Paulo, SP, Brasil

^{Correspondence}

ABSTRACT

OBJECTIVE: To assess the reliability of the Lista de Atividades Físicas (Brazilian version of the Physical Activity Checklist Interview) in children.

METHODS: The study is part of a cross-cultural adaptation of the Physical Activity Checklist Interview, conducted with 83 school children aged between seven and ten years, enrolled between the 2nd and 5th grades of primary education in the city of São Paulo, Southeastern Brazil, in 2008. The questionnaire was responded by children through individual interviews. It is comprised of a list of 21 moderate to vigorous physical activities performed on the previous day, it is divided into periods (before, during and after school) and it has a section for interview assessment. This questionnaire enables the quantification of time spent in physical and sedentary activities and the total and weighed metabolic costs. Reliability was assessed by comparing two interviews conducted with a mean interval of three hours. For the interview assessment, data from the first interview and those from an external evaluator were compared. Bland-Altman's proposal, the intraclass correlation coefficient and Lin's concordance correlation coefficient were used to assess reliability.

RESULTS: The intraclass correlation coefficient lower limits for the outcomes analyzed varied from 0.84 to 0.96. Precision and agreement varied between 0.83 and 0.97 and between 0.99 and 1, respectively. The line estimated from the pairs of values obtained in both interviews indicates high data precision. The interview item showing the poorest result was the ability to estimate time (fair in 27.7% of interviews). Interview assessment items showed intraclass correlation coefficients between 0.60 and 0.70, except for level of cooperation (0.46).

CONCLUSIONS: The Brazilian version of the Physical Activity Checklist Interview shows high reliability to assess physical and sedentary activity on the previous day in children.

Descriptors: Child. Motor Activity. Evaluation. Questionnaires. Reproducibility of Results.

INTRODUCTION

The association between physical activity practice and health outcomes in all ages is well-known, especially in child obesity prevention and treatment.^12,18

Physical activity assessment is a complex process because it is a construct with more than one domain - leisure, household, transportation and occupational - and its quantification depends on the type, intensity, duration and frequency of activity.^4,15 The Physical Activity Checklist Interview (PACI)²³ is a questionnaire used to measure physical activities in children. According to the cross-cultural adaptation procedures proposed by Herdman et al^10,11 (1997, 1998) and operationalization procedures proposed by Reichenheim & Moraes¹⁹ (2007), Cruciani et al⁶ (2011) suggested a Brazilian version known as "Lista de Atividades Físicas" (LAF). The stages of analysis of conceptual, item and semantic equivalences were conducted to achieve this purpose.

The present study aimed to assess LAF reliability in children, as part of the analysis of its psychometric properties.

METHODS

This study was conducted with primary education students from the 2^nd to the 5^th grades, in the city of São Paulo, Southeastern Brazil, in 2008. Total sample size was 83 students, selected according to a simple random sample of the total (N=240), aiming to estimate population intraclass correlation coefficient (r_I) with a one-sided 95% confidence interval, r_o= 0.85, 10% precision and two replicates.²⁴

LAF was administered in an individual interview on a school day and it enabled the assessment of sedentary and physical activities on the previous day. This instrument includes an initial part with general guidance and instructions for the interview (Attachment).

An analog clock and geometrical figures representing 5, 15 and 30 minutes were used to help a child estimate physical activity time. Examples of routine activities were provided to ask the children which lasted more or less than five minutes.

The questionnaire was divided into sections A, B and C. Section A included data such as child's name, grade, start and finish time of interview. Section B was aimed at reporting the engagement time (in minutes) in 21 types of moderate to vigorous activities (for five or more minutes of activity), before, during and after school, in addition to the time of sedentary activities (watching television/videos or DVDs and video/computer game playing before and after school). Section C was aimed at assessing the interview in terms of attentiveness of subject, subject's ability to recall activities and estimate time, level of cooperation, believability of the interview and overall rating of interview, and it should be completed by the interviewer after the end of the interview.

LAF quantifies the following: time (in minutes) of sedentary activities (SA); time (min) of moderate to vigorous physical activities (PA); total metabolic cost of related activities (min x Metabolic Equivalents (MET) of each physical activity - TMC) and total weighed metabolic cost (min x MET value x adjustment for intensity rate - WMC).

The intensity rate for each physical activity was obtained with the following question: "When you <rode a bicycle> for five minutes or more yesterday <before school>, did you feel the body cues 'breathing hard' or 'feeling tired' none, some or most of the time?". If the intensity of physical activity varied between light to moderate (MET of up to 5.9), this was multiplied by 1.1 (sometimes) or 1.25 (usually). Vigorous physical activities (MET > 6) were multiplied by 0.75 (never) or 1.25 (usually).²³ MET values were obtained from the Compendium of Physical Activities by Ainsworth et al¹ (1993).

LAF was applied twice by two interviewers, with a mean interval of three hours between applications (before and after school interval). Sections A, B and C were completed by interviewers; and section C by an external evaluator as well. Interviewers and external evaluators participated in a training course that included an explanation of the research objectives, the LAF study and discussions about the "Interview Instructions".

Data obtained from the questionnaires were double-entered and data entry validity was checked.^a The Stata software, version 10.0, was used for statistical analysis.^b

The values of both interviews (section B) were compared to assess reliability and data from the first interview were compared with those of the external evaluator to assess this interview (section C). Intraclass correlation coefficient (ICC) and respective 95% confidence interval (CI95%),⁸ Bland & Altman's² proposal (1999) and Lin's concordance correlation coefficient^13,14 (1989, 2000) were used in the analysis.

This study was approved by the Research Ethics Committee of the Faculdade de Saúde Pública da Universidade de São Paulo (12/11/2007, Protocol 1598). Adults responsible for the children signed an informed consent form.

RESULTS

Of all 83 participating children, 42 were boys and 41 were girls, with a mean age of 9.3 years (minimum value = 7.1; maximum value = 10.9; standard deviation (sd) = 1.0 years). Due to the occurrence of outliers, identified by the excessive differences in the results between the first and second interviews, three schoolchildren were excluded from the analysis of physical activity and nine from the analysis of sedentary activities, and one who had problems in both activities: basketball before school (1^st interview (I) = 30 min; 2^nd I = 5 min); soccer before school (1^st I = 90 min; 2ⁿ I = 60 min); volleyball before school (1^st I = 60 min; 2ⁿ I = 7 min); games before school (1^st I = 0 min; 2ⁿ I = 90 min); outdoor play before school (1^st I = 30 min; 2ⁿ I = 0 min); jumping rope before school (1^st I = 30 min; 2ⁿ I = 10 min); outdoor chores before school (1^st I = 30 min; 2^nd I = 0 min); outdoor play during school (1^st I = 30 min; 2ⁿ I = 0 min).

There were no differences between sexes for the study variables (Table 1). In both sexes, mean time of moderate to vigorous physical activity (PA) was 88 min (95%CI: 75;101) and that of sedentary activity (SA) was 104 min (95%CI: 80;127). Mean value and 95%CI of TMC was 528.5 MET (445.2;611.7) and that of WMC was 503.1 MET (424.2;582.0).

By comparing PA, SA, TMC and WMC values between both interviews, the lower limit of the ICC was found to vary between 0.84 and 0.96. Precision (r) and accuracy regarding the perfect agreement (C_b) values varied from 0.826 to 0.972 and from 0.985 to 1, respectively (Table 2).

Figure 1 shows that the line originated from the data reveals estimates of inclination and intercept similar to those of the line of 45º, indicating high agreement (precision) of the data originated from the LAF. Figure 2 indicates independence between the magnitude and dispersion of values of PA measures of both interviews.

Mean differences of PA, TMC, WMC and SA were 4.48 min, 17.8 MET, 25.8 MET, and 1.35 min, respectively. Based on agreement limits, the first application was found to underestimate PA in 95% of times in up to 50 minutes; TMC, up to 294.6 MET; WMC, up to 298.4 MET; and SA, up to 47.4 min (Figure 2, Table 2).

Mean duration of interview was 27 minutes (sd = 7 min). In the overall rating of interview of Section C (Table 3), 13.3% of interviews were classified as fair and 86.7% as good, very good or excellent. In 95.2% and 96.4% of cases, "attentiveness of subject" and "level of cooperation" were classified as good, very good or excellent, respectively. Subject's ability to recall activities performed on the previous day and the believability of the interview showed similar results, 14.5% of which were categorized as fair. Subject's ability to estimate time showed a higher percentage of cases classified as fair (27.7%), whereas the remaining cases were good, very good or excellent.

ICC values varied between 0.60 and 0.70, except for "level of cooperation" (ICC = 0.46) (Table 3). Confidence intervals for all items were wide, indicating low precision in the process of estimation of parameters.

The following were mentioned in relation to the "other activities" category: stretching (n = 10), karate (n = 4), skateboarding (n = 2) and handball, yoga, tug-of-war, rollerblading and play fighting (n = 1).

DISCUSSION

The exact estimates of ICC for PA, TMC, WMC and SA were lower than those in the original study:²³ 0.64; 0.65; 0.65 and 0.75 respectively, when compared to the lower limits of estimates per interval in the present study (0.84 to 0.96). Such differences can be justified by the different methodologies used. In the original study, PACI values were obtained from individual interviews and the second application was self-administered by the entire class. In this study, researchers sought to create the same experimental conditions in both applications.

The estimates of reliability in the present study are higher than the majority of results from previous day questionnaires for children, which indicate ICC values of 0.17,²⁷ 0.59,²⁵ 0.60²² and 0.94.²⁰ In the study conducted by Ridley et al²⁰ (2006), this instrument was used in 32 Australian children aged between nine and 13.5 years, with a mean interval of four hours between applications, whereas, for other instruments, these applications were conducted on separate days. According to Patterson¹⁷ (2000), the interval of time between applications in a reliability study should be such that the assessed days overlap, thus preventing variability due to the weekday.

The period of measurement covered by the instrument is the object of studies and previous day questionnaires²⁶ are those most frequently used to assess physical activity in children. According to Cale³ (1994), instruments that require one to remember activities performed in periods such as the previous week, month or year may be inappropriate for children. Thus, a positive aspect of the LAF is that it reduces the chance of memory bias.

The small mean differences found in the values obtained from both applications for PA, TMC, WMC and SA (4.48 min; 17.8 MET; 25.8 MET and 1.35 min, respectively) indicate LAF's good reliability. However, Bland & Altman's agreement limits² (1999) show great amplitude. It is possible that the LAF is more appropriate to characterize physical activity of population groups than individual ones. Similar values of agreement limits, described by Ridley et al²⁰ (2006), support this hypothesis, which showed values of -53.4 and 51.2 minutes according to Bland & Altman's proposal² (1999). Ridley et al²⁰ (2006) argued that, although ICC was high, their results reveal a wide variation in the agreement limits, suggesting that the instrument can be more reliable for group estimates, rather than individual ones.

By comparing the interview assessment results (Section C) of the PACI²³ with those of the present study, the percentages of interviews assessed as very good or excellent were similar (respectively): attentiveness of subject - 67% vs 60.3%; subject's ability to recall activities - 54% vs 56.7%; subject's ability to estimate time - 41% vs 36.1%; level of cooperation - 83% vs 77.1%; believability of the interview - 53% vs 57.8%; and overall rating of interview with subject - 56% vs 57.8%. In both studies, the results indicate that children have a difficulty in estimating time of activities performed on the previous day.

However, LAF's Section C items showed low reliability values. It is recommended that such section be used to identify children with low scores and thus conduct another interview.

Ainsworth et al's Compendium¹ (1993) was used to calculate scores of physical activities (weighted and not weighted), following the original study, which enables the comparison of reliability values between studies to be made. This compendium¹ was proposed for the adult population and, although Ridley et al²¹ (2008) had published one that was specific for children and adolescents, there are not sufficient studies that adopt such compendium to emphasize its use.

LAF's format is based on the school period (before, during and after school), thus not enabling the assessment of physical activities performed on weekends. The school environment is described in the literature as one that promotes a higher physical activity level, because children have the opportunity to participate in playful activities, games and lessons that promote physical activity, including physical education.⁷ This could be one of the reasons for children to seem to be more active during the week, rather than on weekends.^7,9,16 According to the LAF, the effect of quantifying PA only during the week interferes with weekly estimates. However, in association or correlation studies, it is possible that there is no need of a weekly quantification, but rather of identifying more or less active children. It is believed that the analysis of PA during school days can produce sufficient information to qualify population groups in terms of the amount of physical activity performed.

Reporting physical activity depends on the respondent's cognitive maturity,¹⁵ as observed when 11 children were excluded, suggesting that the information provided before the interview would not be sufficient to change this situation. As the majority of exclusions refer to sedentary activities (n = 9), it is supposed that the difficulty in quantification is associated with the low perception of identification of moments when sedentary activities begin and end. Thus, it is necessary that additional studies be performed to explore strategies that reduce the difficulty in assessing this type of activity.

LAF can be applied to children who go to school in the mornings, although the after-school period will be longer than that in the original format. From the point of view of physical activity assessment, this fact does not interfere with the results, because physical activity indicators are originally proposed for the day as a whole, rather than its periods.

LAF has important characteristics for children's physical activity questionnaires:^3,5 administration through interviews, previous day assessment, questionnaire responded by the child itself, questionnaire with a list of physical activities and day divided into periods, and instructions to guide interviewers.

LAF shows high reliability to measure physical activity in children aged seven to ten years. Because it is a cross-cultural adaptation of the instrument validated in the culture of its country of origin, the analysis of its validity in the target culture is recommended.

ACKNOWLEDGEMENTS

Authors would like to thank Director and Professor Vanderlei Pinheiro Bispo and Educational Advisor and Professor Luciana Sedano de Souza for authorizing the present study to be conducted in the Escola de Aplicação da Universidade de São Paulo.

REFERENCES

Received: 4/6/2010

Approved: 9/8/2010

Research funded by the Research Incentive Program of the Universidade de São Paulo (Process: 2006-1.24313.1.4).

This article is part of the Doctoral thesis of Adami F, to be presented to Faculdade de Saúde Pública da Universidade de São Paulo.

The authors declare that there are no conflicts of interest.

• 1. Ainsworth BE, Haskell WL, Leon AS, Jacobs Jr DR, Montoye HJ, Sallis JF, et al. Compendium of physical activities: classification of energy costs of human physical activities. Med Sci Sports Exerc. 1993;25(1):71-80. DOI:10.1249/00005768-199301000-00011
• 2. Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res 1999;8(2):135-60. DOI:10.1191/096228099673819272
• 3. Cale L. Self-report measures of children's physical activity: recommendations for future development and a new alternative measure. Health Educ J. 1994;53(4):439-53. DOI:10.1177/001789699405300408
• 4. Caspersen CJ, Powell KE, Christensen GM. Physical activity, exercise and physical fitness: Definitions and distinction for health-related research. Public Health Rep. 1985;100(2):126-31.
• 5. Corder K, Ekelund U, Steele RM, Wareham NJ, Brage S. Assessment of physical activity in youth. J Appl Physiol. 2008;105(3):977-87. DOI:10.1152/japplphysiol.00094.2008
• 6. Cruciani F, Adami F, Assunção NA, Bergamaschi DP. Equivalência conceitual, de itens e semântica do Physical Activity Checklist Interview (PACI). Cad. Saude Publica. 2011;27(1):19-34. DOI:10.1590/S0102-311X2011000100003
• 7. Deforche B, Bourdeaudhuij ID, D'hondt E, Cardon G. Objectively measured physical activity, physical activity related personality and body mass index in 6-to 10-yr-old children: a cross-sectional study. Int J Behav Nutr Phys Act. 2009;14:6-25.
• 8. Fleiss JL. The design and analysis of clinical experiments. New York: John Wiley & Sons; 1986.
• 9. Gavarry O, Giacomoni M, Bernard T, Seymat M, Falgairette G. Habitual Physical Activity in children and adolescents during school and free days. Med Sci Sports Exerc. 2003;35(3):525-31. DOI:10.1249/01.MSS.0000053655.45022.C5
• 10. Herdman M, Fox-Rushby J, Badia X. "Equivalence" and the translation and adaptation of health-related quality of life questionnaires. Qual Life Res. 1997;6(3):237-47. DOI:10.1023/A:1026410721664
• 11. Herdman M, Fox-Rushby J, Badia X. A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Qual Life Res.1998;7(4):323-35. DOI:10.1023/A:1008846618880
• 12. Katzmarzyk PT, Baur LA, Blair SN, Lambert EV, Oppert JM, Riddoch C. International conference on physical activity and obesity in children: summary statement and recommendations. Int J Pediatr Obes. 2008;3(1):3-21. DOI:10.1080/17477160701789679
• 13. Lin LI. A concordance correlation coefficient to evaluate reproducibility. Biometrics. 1989;45(1):255-68. DOI:10.2307/2532051
• 14. Lin LI. A note on the concordance correlation coefficient. Biometrics. 2000;56(1):324-5.
• 15. Livingstone MBE, Robson PJ, Wallace JMW, McKinley MC. How active are we? Levels of routine physical activity in children and adults. Proc Nutr Soc. 2003;62(3):681-701. DOI:10.1079/PNS2003291
• 16. Nader PR, Bradley RH, Houts RM, McRitchie SL, O'Brien M. Moderate-to-Vigorous Physical Activity From Ages 9 to 15 years. JAMA 2008;300(3):295-305.
• 17. Patterson P. Reliability, Validity and Methodological Response to the Assessment of Physical Activity Via Self-Report. Res Q Exerc Sport. 2000;71(2 Suppl):15-20.
• 18. Pedersen BK, Saltin B. Evidence for prescribing exercise as therapy in chronic disease. Scand J Med Sci Sports. 2006;16(Suppl 1):S3-63. DOI:10.1111/j.1600-0838.2006.00520.x
• 19. Reichenheim ME, Moraes CL. Operacionalização de adaptação transcultural de instrumentos de aferição usados em epidemiologia. Rev Saude Publica. 2007;41(4):665-73. DOI:10.1590/S0034-89102006005000035
• 20. Ridley K, Olds TS, Hill A. The Multimedia activity recall for children and adolescents (MARCA): development and evaluation. Int J Behav Nutr Phys Act. 2006;3:10. DOI:10.1186/1479-5868-3-10
• 21. Ridley K, Ainsworth BE, Olds TS. Development of a compendium of energy expenditures for youth. Int J Behav Nutr Phys Act. 2008;5:5-45. DOI:10.1186/1479-5868-5-45
• 22. Sallis JF, Buono MJ, Roby JJ, Micale FG, Nelson JA. Seven-day recall and other physical activity self-reports in children and adolescents. Med Sci Sports Exerc. 1993;25(1):99-108. DOI:10.1249/00005768-199301000-00014
• 23. Sallis JF, Strikmiller PK, Harsha DW, Feldman HA, Ehlinger S, Stone EJ, et al. Validation of interviewer-and self-administered physical activity checklists for fifth grade students. Med Sci Sports Exerc. 1996; 28(7):840-51. DOI:10.1097/00005768-199607000-00011
• 24. Shoukri MM. Measures of interobserver agreement. Boca Raton: CRC Press; 2004.
• 25. Treuth MS, Sherwood NE, Baranowski T, Butte NF, Jacobs Jr DR, McClanahan B, et al. Physical activity self-report and accelerometry measures from the Girls health Enrichment Multi-site Studies. Prev Med. 2004;38 (Suppl):43-9. DOI:10.1016/j.ypmed.2003.01.001
• 26. Welk GJ, Corbin CB, Dale D. Measurement issues in assessment of physical activity in children. Res Q Exerc Sport. 2000;71(Suppl 2):59-73.
• 27. Welk GJ, Wickel E, Peterson M, Heitzler CD, Fulton JE, Potter LD. Reliability and Validity of Questions on the Youth Media Campaign Longitudinal Survey. Med Sci Sports Exerc. 2007;39(4):612-21. DOI:10.1249/mss.0b013e3180305c59

a

Dean AG, Arner TG, Sunki GG, Friedman R, Lantinga M, Sangam S, et al. Epi Info, a database and statistics program for public health professionals. Atlanta: Centers for Disease Control and Prevention; 2002

b

StataCorp. Stata Statistical Software: Release 7.0. College Station: Stata Corporation; 2001.

Publication Dates

• Publication in this collection
  04 Mar 2011
• Date of issue
  Apr 2011

History

• Received
  06 Apr 2010
• Accepted
  08 Sept 2010