Accessibility / Report Error

Sampling strategy of an epidemiological survey using a satellite image program

ABSTRACT

OBJECTIVE

To describe the sampling strategy of an epidemiological survey with the aid of satellite images, including details of the multistage probability sampling process.

METHODS

A probability sample of individuals living in the rural area of Rosário do Sul, state of Rio Grande do Sul, Brazil, aged 15 years old or more, was evaluated. Participants answered questionnaires (medical history, sociodemographic characteristics, habits, alcohol use, quality of life, stress, rumination, and self-perceived periodontal diseases), and were subjected to clinical oral examinations as well as anthropometric measurements (blood pressure, height, weight, abdominal and waist circumferences). Oral evaluation comprehended a complete periodontal exam at six sites per tooth, including the following assessments: furcation involvement; dental abrasion; tooth decay, including the indexing of missing and filled surfaces; O’Brien index; gingival abrasion; oral cavity and lip lesions; complete periapical radiographic exam, and use of prostheses. Besides this oral clinical approach, subgingival plaque, crevicular gingival fluid, saliva, and blood samples were collected. Examiners were trained and calibrated during previous evaluations. A pilot study allowed the logistic of the performed exams to be adjusted as needed.

RESULTS

Among 1,087 eligible individuals, 688 were examined (63.3%). Age, sex, and skin color data were compared to data from the last demographic census (2010) of the Brazilian Institute of Geography and Statistics, which served to validate the sampling strategy.

CONCLUSIONS

The careful methods used in this study, in which satellite images were used in the delimitation of epidemiological areas, ensure the quality of the estimates obtained and allow for these estimates to be used in oral health surveillance and health policies improvements.

Sampling Studies; Satellite Applications; Dental Health Surveys; Rural Health

INTRODUCTION

Oral disorders remain highly prevalent, affecting 3.5 billion people worldwide 11. GBD2015 and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990-2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet. 2016;388(10053):1545-602. https://doi.org/10.1016/S0140-6736 (16)31678-6
https://doi.org/10.1016/S0140-6736 (16)3...
. Almost 50% of the world’s population suffers from disabilities related to oral conditions 22. Kassebaum NJ, Smith AGC, Bernabé E, Fleming TD, Reynolds AE, Vos T, et al. Global, regional, and national prevalence, incidence, and disability-adjusted life years for oral conditions for 195 countries, 1990-2015: a systematic analysis for the global burden of diseases, injuries, and risk factors. J Dent Res. 2017;96(4):380-7. https://doi.org/10.1177/0022034517693566
https://doi.org/10.1177/0022034517693566...
. Untreated caries in permanent teeth 22. Kassebaum NJ, Smith AGC, Bernabé E, Fleming TD, Reynolds AE, Vos T, et al. Global, regional, and national prevalence, incidence, and disability-adjusted life years for oral conditions for 195 countries, 1990-2015: a systematic analysis for the global burden of diseases, injuries, and risk factors. J Dent Res. 2017;96(4):380-7. https://doi.org/10.1177/0022034517693566
https://doi.org/10.1177/0022034517693566...
are the most prevalent oral illness, and went through an increase of 14.5% between 2005 and 2015 11. GBD2015 and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990-2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet. 2016;388(10053):1545-602. https://doi.org/10.1016/S0140-6736 (16)31678-6
https://doi.org/10.1016/S0140-6736 (16)3...
. In the same period, periodontal disease, edentulism or severe tooth loss, and lip or oral cavity cancer had an increase of 25.4%, 27.3%, and 38.6%, respectively 11. GBD2015 and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990-2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet. 2016;388(10053):1545-602. https://doi.org/10.1016/S0140-6736 (16)31678-6
https://doi.org/10.1016/S0140-6736 (16)3...
. The numbers are more disturbing when the years of healthy life lost due to premature disability (disability-adjusted life years, DALY) are considered. The main cause of DALY related to oral conditions is tooth loss (7.6 million DALY), followed by severe chronic periodontitis (3.5 million DALY) and untreated caries (1.7 million DALY) 22. Kassebaum NJ, Smith AGC, Bernabé E, Fleming TD, Reynolds AE, Vos T, et al. Global, regional, and national prevalence, incidence, and disability-adjusted life years for oral conditions for 195 countries, 1990-2015: a systematic analysis for the global burden of diseases, injuries, and risk factors. J Dent Res. 2017;96(4):380-7. https://doi.org/10.1177/0022034517693566
https://doi.org/10.1177/0022034517693566...
.

Oral health problems affect health-related quality of life 33. Haag DG, Peres KG, Balasubramanian M, Brennan DS. Oral conditions and health-related quality of life: a systematic review. J Dent Res. 2017;96(8):864-74. https://doi.org/10.1177/0022034517709737
https://doi.org/10.1177/0022034517709737...
and are considered a public health issue. In this sense, they must be a priority of the universal health coverage debate, as well as a focus of policy development 44. Mathur MR, Williams DM, Reddy KS, Watt RG. Universal health coverage: a unique policy opportunity for oral health. J Dent Res. 2015;94(3 Suppl):3S-5S. https://doi.org/10.1177/0022034514565648
https://doi.org/10.1177/0022034514565648...
. The formulation of policies and oral health goals might be more effective if based on good-quality descriptive epidemiology 22. Kassebaum NJ, Smith AGC, Bernabé E, Fleming TD, Reynolds AE, Vos T, et al. Global, regional, and national prevalence, incidence, and disability-adjusted life years for oral conditions for 195 countries, 1990-2015: a systematic analysis for the global burden of diseases, injuries, and risk factors. J Dent Res. 2017;96(4):380-7. https://doi.org/10.1177/0022034517693566
https://doi.org/10.1177/0022034517693566...
, 55. Leroy R, Eaton KA, Savage A. Methodological issues in epidemiological studies of periodontitis: how can it be improved? BMC Oral Health. 2010;10:8. https://doi.org/10.1186/1472-6831-10-8
https://doi.org/10.1186/1472-6831-10-8...
. However, researches with probabilistic population-based samples are lacking in some regions, particularly rural areas in Latin America 66. Oppermann RV, Haas AN, Rösing CK, Susin C. Epidemiology of periodontal diseases in adults from Latin America. Periodontol 2000. 2015;67(1):13-33. https://doi.org/10.1111/prd.12061
https://doi.org/10.1111/prd.12061...
. Sampling approaches for evaluating the population living in these regions can differ from the ones used in urban areas, due to the absence of precise territorial divisions, such as squares, neighborhoods, and dwelling numbers. In these cases, satellite images can be useful, since they allow for wide, cost-effective access to different remote areas.

Methodological studies describing these issues in the countryside are severely lacking. The investigation of health conditions of rural inhabitants is necessary especially due to these populations’ difficult access to medical and oral care 77. Skillman SM, Doescher MP, Mouradian WE, Brunson DK. The challenge to delivering oral health services in rural America. J Public Health Dent. 2010;70 Suppl 1:S49-57. https://doi.org/10.1111/j.1752-7325.2010.00178.x
https://doi.org/10.1111/j.1752-7325.2010...
, considering that the improvement of oral conditions is strongly associated with better access to health care systems 88. Ahn S, Burdine JN, Smith ML, Ory MG, Phillips CD. Residential rurality and oral health disparities: influences of contextual and individual factors. J Prim Prev. 2011;32(1):29-41. https://doi.org/10.1007/s10935-011-0233-0
https://doi.org/10.1007/s10935-011-0233-...
. Additionally, more research is needed to evaluate the impact of oral diseases and to explore the determinants of oral health inequalities 44. Mathur MR, Williams DM, Reddy KS, Watt RG. Universal health coverage: a unique policy opportunity for oral health. J Dent Res. 2015;94(3 Suppl):3S-5S. https://doi.org/10.1177/0022034514565648
https://doi.org/10.1177/0022034514565648...
.

Considering the importance of methodological quality for oral health estimates and the lack of a detailed description of strategies for sampling rural populations, this paper aimed to describe the sampling procedures used in an epidemiological survey of a rural population from Southern Brazil.

METHODS

Study Design and Survey Population

This was a population-based cross-sectional survey. The surveyed population was comprised of individuals aged 15 years or older, living in a rural area of Rosário do Sul. Rosário do Sul is a city located at the west border (geographic coordinates 30° 15’ 28” S, 54° 54’ 50” W) of the Brazilian state of Rio Grande do Sul, in Brazil’s South, neighboring Argentina and Uruguay. The city has approximately 4.4 thousand km 22. Kassebaum NJ, Smith AGC, Bernabé E, Fleming TD, Reynolds AE, Vos T, et al. Global, regional, and national prevalence, incidence, and disability-adjusted life years for oral conditions for 195 countries, 1990-2015: a systematic analysis for the global burden of diseases, injuries, and risk factors. J Dent Res. 2017;96(4):380-7. https://doi.org/10.1177/0022034517693566
https://doi.org/10.1177/0022034517693566...
and 40,000 inhabitants, among whom 4,776 live in rural areas 99. Instituto Brasileiro de Geografia e Estatística. Censo demográfico 2010: resultados da amostra, características da população, Rosário do Sul-RS. Rio de Janeiro: IBGE; 2016. [cited 2016 Oct 25]. Available from: http://cidades.ibge.gov.br/xtras/temas.php?lang=&codmun=431640&idtema=90&seasea=rio-grande-do-sul%7Crosario-do-sul%7Ccenso-demografico-2010:-resultados-da-amostra-caracteristicas-da-populacao
http://cidades.ibge.gov.br/xtras/temas.p...
. This is a difficultly accessed population scattered over a wide territorial extension, considering that the rural demographic density of Rosário do Sul is around one inhabitant per kilometer square [unofficial data provided by the Santana do Livramento office of the Brazilian Institute of Geography and Statistics (IBGE), responsible for the Rosário do Sul census]. The majority of its populated rural areas are distant from the urban center, while access roads are usually in precarious conditions. These characteristics can hamper transport to the city, restricting inhabitants’ use of crucial urban services, such as health care.

The IBGE Population Census operation is performed according to the administrative divisions defined by municipal law (i.e., districts, urban and rural areas), which are further subdivided into smaller areas, called census enumeration areas (CEA). Each CEA is a continuous area with borders that are easily identifiable during field operation, and have dimensions and numbers of households (nH) that make it possible for census interviewers to carry out their activities over a feasible timespan, respecting the operation’s overall schedule 1010. Instituto Brasileiro de Geografifa e Estatística. Censo Demográfico 2010. Manual do recenseador [CD-ROM]. Rio de Janeiro: IBGE, 2010 [cited 2016 Oct 25]. CD 1.09. Available from: https://biblioteca.ibge.gov.br/visualizacao/instrumentos_de_coleta/doc2601.pdf
https://biblioteca.ibge.gov.br/visualiza...
.

Rosário do Sul has six districts and 36 rural CEA (RCEA), which vary in area (0.0831–338.034 km 22. Kassebaum NJ, Smith AGC, Bernabé E, Fleming TD, Reynolds AE, Vos T, et al. Global, regional, and national prevalence, incidence, and disability-adjusted life years for oral conditions for 195 countries, 1990-2015: a systematic analysis for the global burden of diseases, injuries, and risk factors. J Dent Res. 2017;96(4):380-7. https://doi.org/10.1177/0022034517693566
https://doi.org/10.1177/0022034517693566...
) and nH [median of 46 (1–189)]. The area’s nH differs considerably from what is usually observed in IBGE RCEA sudvisions, which commonly have 150 to 250 dwellings.

Sampling Strategies

The sample of ≥ 15-years-old dwellers from Rosário do Sul’s rural area was obtained using a multistage probability sampling method, as well as the territorial maps (.kmz format, Google Earth program) provided by IBGE 1111. Instituto Brasileiro de Geografia e Estatística. Organização do território: malhas territoriais: Censo 2010: setores censitários. Rio de Janeiro: IBGE; 2012 [cited 2016 Oct 25]. Available from: http://downloads.ibge.gov.br/downloads_geociencias.htm
http://downloads.ibge.gov.br/downloads_g...
. The municipal government of Rosário do Sul provided additional information for the sampling process.

In order to protect census informers, the IBGE was unable to provide data on individuals from six of the RCEA, which had less than five permanent dwellings 1212. Instituto Brasileiro de Geografia e Estatística, Centro de Documentação e Disseminação de Informações. Base de informações do Censo Demográfico 2010: resultados do universo por setor censitário. Rio de Janeiro: IBGE; 2011. Available from: http://www.ipea.gov.br/redeipea/images/pdfs/base_de_informacoess_por_setor_censitario_universo_censo_2010.pdf
http://www.ipea.gov.br/redeipea/images/p...
. Thus, these territorial units were not included in the study’s sample. The remaining 30 RCEA were divided into three strata (small, medium, and large), according to nH tertiles. Three randomized sequences were generated in Research Randomizer a a Urbaniak GC, Plous S. Research Randomizer (Version 4.0) [Computer software]. Lancaster, Pennsylvania. 2014. Available from: http://www.randomizer.org/ , in order to select 17 RCEA [56.7% (three small, seven medium, and seven large), Figure 1 ]. This enabled the inclusion of all six of the municipality’s districts. In this way, the sampling process accounted for the number of individuals and dwellings registered in each RCEA, according to IBGE data.

Figure 1
The 30 eligible and the 17 randomized (gray color) rural census sectors. The latter appear outlined in yellow.

The OpenEpi program b b Dean AG, Sullivan KM, Soe MM. OpenEpi: Open Source Epidemiologic Statistics for Public Health. Version 3.01. [updated 2013 Apr 06; cited 2014 Aug 8]. Available from: http://www.openepi.com/Menu/OE_Menu.htm was used to calculate sample size, considering a rural population aged ≥ 15 years, amounting to approximately 4,000 inhabitants 99. Instituto Brasileiro de Geografia e Estatística. Censo demográfico 2010: resultados da amostra, características da população, Rosário do Sul-RS. Rio de Janeiro: IBGE; 2016. [cited 2016 Oct 25]. Available from: http://cidades.ibge.gov.br/xtras/temas.php?lang=&codmun=431640&idtema=90&seasea=rio-grande-do-sul%7Crosario-do-sul%7Ccenso-demografico-2010:-resultados-da-amostra-caracteristicas-da-populacao
http://cidades.ibge.gov.br/xtras/temas.p...
, and periodontal disease (50% prevalence) as the worst case scenario for the main outcome. A 4% precision level was used, together with a 1.3 design effect for the 95% confidence interval. The sample size calculation was adjusted for finite populations using a standard formula [n adjusted = n/1+(n/N); in which n is the calculated sample size, and N is the population size]. This resulted in an estimated sample size of 580 individuals. The sample was then increased by 15%, to 667 individuals, so as to account for non-response.

The total nH in each RCEA stratum was obtained from IBGE data. The estimated nH to be visited in each of the 17 randomized RCEA was proportional to sample size and population density. Thus, the nH in each RCEA was estimated considering the mean number of ≥ 15 years old individuals living in each dwelling (n = 3).

Seven randomized RCEA (41.18% of evaluated RCEA) had community health workers who provided us with local lists, allowing for the random selection a a Urbaniak GC, Plous S. Research Randomizer (Version 4.0) [Computer software]. Lancaster, Pennsylvania. 2014. Available from: http://www.randomizer.org/ of eligible dwellings (i.e., dwellings with at least one eligible dweller). In the other RCEA, the most densely populated region was determined according to house clusters viewed on the satellite images provided by IBGE (.kmz format, Google Earth program), which contained pre-delimited RCEA 1111. Instituto Brasileiro de Geografia e Estatística. Organização do território: malhas territoriais: Censo 2010: setores censitários. Rio de Janeiro: IBGE; 2012 [cited 2016 Oct 25]. Available from: http://downloads.ibge.gov.br/downloads_geociencias.htm
http://downloads.ibge.gov.br/downloads_g...
. This region was then confirmed in loco by researchers as the correct starting point for the selection of dwellings. First, dwellings on the right side of the street were visited and, if necessary, the team went back to the starting point in order to visit households on the left side. After establishing the direction, all dwellings at the right and left sides of the road were considered eligible. All dwellings within the RCEA area with at least one dweller from the right and left were accounted for consecutively, in a straight line, until the pre-specified nH or subject number were reached. When these strategies failed to obtain the nH necessary to compose the sample, secondary roads within a radius of five kilometers at the right or left of the main road were also accessed.

All individuals ≥ 15 years living in eligible dwellings were considered eligible to the study. Exclusion criteria were the following: presence of a systemic disease or condition disavowing clinical examination or requiring a prophylactic regimen of antibiotics in preparation for it; diagnosis or family report of psychiatric or mental problems, and alcohol or drug intoxication.

Non-response data

A questionnaire pertaining sex, age, schooling, skin color, family income, tobacco use, and the number of teeth present in the mouth was applied to non-responders.

Data Analysis

Descriptive analysis was done by means of absolute numbers and frequency distributions, adjusted for the complex sample. Sample weights were the inverse of the probability of selection, considering the RCEA size. Thus, the weight was calculated by dividing the RCEA’s population size by the number of individuals sampled in each RCEA. The non-response rate in each RCEA was considered in sample weight calculation (weight = 1 / sample fraction × non-response rate). Data for skin color, sex, and age were compared to data from the 2010 IBGE census, available from its institutional website 1313. Instituto Brasileiro de Geografia e Estatística. Censo Demográfico 2010: resultados do Universo: agregados por setores censitários, RS. Rio de Janeiro: IBGE; 2011 [cited 2016 Oct 25]. Available from: https://downloads.ibge.gov.br/downloads_estatisticas.htm
https://downloads.ibge.gov.br/downloads_...
. These comparisons were performed via chi-square test, adjusted for the complex sample. All analysis employed IBM ® SPSS ® Statistics software, version 21.

Operational Procedures

The data were collected by six dentists between March 2015 and May 2016. Researchers were divided according to their assigned functions: interviewers (TGMF and SCD), clinical examiners (MC and JB), physical examiner (APG), and dental radiographer (JM, CASB, CFW, and FBC). The latter function was assumed by four examiners, who took turns, so that no one would be exposed to radiation for more than one day’s work.

Clinical and radiographic examinations were performed in a mobile unit, consisting of a trailer equipped with a complete dental unit (dental chair, artificial light, compressor, dental x-ray machine, and other basic amenities). The mobile unit was moved to a central point in each RCEA, following the survey schedule. A team of dentists previously visited the households, in order to explain the aims of the study and invite subjects to participate. Individuals who agreed to take part in the study were assigned an examination appointment. In the first visit, dentists collected telephone numbers and numbers of residents in each dwelling. The contact information of a neighbor to be contacted when there was nobody at home was requested. Individuals who failed to attend the examination appointment or were not at home during the first attempt received new home visits or calls to encourage participation. Dwellings with no one present during the first visit received a minimum of three additional visitation attempts, as well as five telephone calls. In RCEA with community health workers, the latter were responsible for scheduling the examinations, according to the list of randomly selected dwellings. In these cases, the aims of the study were explained during the examination appointment itself.

Interviews

Trained dentists conducted face-to-face interviews individually, in order to apply structured questionnaires. The interviews included data on sociodemographic, economic, medical and behavioral factors, as well as alcohol intake 1414. Sobell LC, Sobell MC. Alcohol consumption measures. Rockville (MD): National Institute on Alcohol Abuse and Alcoholism; 2004 [cited 2016 Oct 25]. Available from: https://pubs.niaaa.nih.gov/publications/assessingalcohol/measures.htm
https://pubs.niaaa.nih.gov/publications/...
, oral health impact on quality of life (OHIP-14 1717. Slade GD. Derivation and validation of a short-form oral health impact profile. Community Dent Oral Epidemiol. 1997;25(4):284-90. https://doi.org/10.1111/j.1600-0528.1997.tb00941.x
https://doi.org/10.1111/j.1600-0528.1997...
), stress (PSS 1818. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24(4):385-96. https://doi.org/10.2307/2136404
https://doi.org/10.2307/2136404...
, RRQ 1919. Trapnell PD, Campbell JD. Private self-consciousness and the five-factor model of personality: distinguishing rumination from reflection. J Pers Soc Psychol. 1999;76(2):284-304. https://doi.org/10.1037%2F0022-3514.76.2.284
https://doi.org/10.1037%2F0022-3514.76.2...
), and periodontal disease perception 2020. Cyrino RM, Cota LOM, Lages EJP, Lages EMB, Costa FO. Evaluation of self-reported measures for prediction of periodontitis in a sample of Brazilians. J Periodontol. 2011;82(12):1693-704. https://doi.org/10.1902/jop.2011.110015
https://doi.org/10.1902/jop.2011.110015...
( Figure 2 ).

Figure 2
Questionnaires scheme.

Evaluations

Clinical examination comprehended previous use of prostheses, evaluation of oral cavity soft tissues, as well as lip lesions (description of localization and probable clinical diagnosis), tooth count (are all teeth present in the mouth, including third molars), periodontal exam, dental abrasion, dental caries [index of decayed, missing and filled surfaces (DMFS) 2121. World Health Organization. Oral health surveys: basic methods. 5. ed. Geneva WHO; 2013 [cited 2016 Oct 25]. Available from: http://www.who.int/oral_health/publications/9789241548649/en/
http://www.who.int/oral_health/publicati...
], dental trauma (O’Brien index 2222. O’Brien M. Children’s dental health in the United Kingdom 1993. London: Her Majesty’s Stationery Office; 1994. ), gingival abrasion (Danser et al. 2323. Danser MM, Timmerman MF, IJzerman Y, Bulthuis H, Velden U, Weijden GA. Evaluation of the incidence of gingival abrasion as a result of toothbrushing. J Clin Periodontol. 1998;25(9):701-6. https://doi.org/10.1111/j.1600-051X.1998.tb02510.x
https://doi.org/10.1111/j.1600-051X.1998...
method), and periapical radiograps.

The complete periodontal exam included: visible plaque index 2424. Ainamo J, Bay I. Problems and proposals for recording gingivitis and plaque. Int Dent J. 1975;25(4):229-35. (VPI), retentive plaque factors (presence of supragingival calculus, caries, cavitated lesions, restoration with excess or lack of restorative material, and restorable residual roots), gingival bleeding index 2424. Ainamo J, Bay I. Problems and proposals for recording gingivitis and plaque. Int Dent J. 1975;25(4):229-35. (GBI), pocket probing depth (PPD), bleeding (BoP), and suppuration on probing (dichotomously, after PPD measurement), clinical attachment loss (CAL, defined as the distance from the cementoenamel junction to the bottom of the pocket), and furcation involvement 2525. Hamp SE, Nyman S, Lindhe J. Periodontal treatment of multirooted teeth: results after 5 years. J Clin Periodontol. 1975;2(3):126-35. https://doi.org/10.1111/j.1600-051X.1975.tb01734.x
https://doi.org/10.1111/j.1600-051X.1975...
. Gingival recession was calculated by subtracting the CAL from the PPD during data analysis. All these periodontal parameters were evaluated at six sites per tooth, excluding third molars, with a UNC-15 probe (Neumar ® , São Paulo, Brazil) and dental mirror. In edentulous individuals, only evaluation of oral cavity, lip lesions, and gingival abrasion were performed.

Additionally, biological samples (blood, gingival crevicular fluid, subgingival plaque, and unstimulated saliva), and anthropometric measurements (blood pressure, height, weight, abdominal and waist circumferences) were collected, and the body mass index was calculated.

Training and Calibration

The examiners received training prior to conducting the evaluations. The training comprehended definitions of clinical and physical parameters, measuring instruments, correct measuring techniques, clinical photographs, and questionnaire application. The team also received a manual containing instructions about data collection and instrument management for use in fieldwork. Firstly, there were four one-hour sessions dedicated to theoretical training. Each session was used to discuss the indexes and variables that would be evaluated, and to define diagnostic criteria. In the second stage, the team participated in practical and clinical activities. The examiners practiced the physical measurements (anthropometric and saliva collection) as well as questionnaire application among themselves. A radiology professor trained the examiners responsible for executing radiographic exams in the use of the x-ray machine’s digital sensor, positioner, and software, performing the complete periapical radiographs of three individuals. The practical training for gingival abrasion and O’Brien index was performed using clinical photographs. Training for VPI, GBI, BoP/suppuration and furcation degrees was done in five individuals, with the presence of an experienced examiner.

Calibration for PPD and CAL was performed before data collection procedures, and also during the study. Intra- and inter-examiners reproducibility was tested from repeated measurements, with a minimal interval of one hour, using ≥ 1,000 sites, in approximately seven individuals. In the pre-data collection calibration, one experienced examiner, who gave 14 individuals full-mouth examinations, was considered the gold standard (TGMF). Each additional examiner (MC and JB) evaluated the same subjects’ two crossovered quadrants (n = 14) to obtain the minimal number of sites necessary. Calibration performed during the study involved only two examiners (MC and JB), who collected the study’s clinical data. DMFS calibration was performed prior to fieldwork, in twenty extracted teeth (five surfaces/tooth). The second DMFS evaluation was performed after a two-day interval, with BE being considered the gold standard examiner for inter-examiners reproducibility. The intra- and inter-examiners agreements for PPD and CAL were verified via the intra-class correlation coefficient (ICC). For DMFS, the Kappa coefficient was used. A reproducibility of ICC/Kappa > 0.80 was considered satisfactory.

Pilot Study

Besides the training and calibration process, the research team also participated in a pilot study’s data collection. This pilot was carried out in one day, in a RCEA outside the randomized area. The researchers decided the starting location for data collection, parked the mobile unit, and invited participants from the nearby area. The evaluations were performed on 15 individuals. This experience was crucial for deciding the functions of each group member, and also for finding the most effective sequence of evaluations.

Ethical Considerations

The study was conducted in accordance with the Declaration of Helsinki (1964, revised in 1975, 1983, 1989, 1996, and 2000) and approved by the Ethics Committee in Research of the Universidade Federal de Santa Maria. Participants signed an informed consent form (ICF). Individuals < 18 years old needed the authorization of the person responsible for them, via the signature of a specific ICF. All participants received a written report detailing their oral status and were referred to treatment if any health alteration was identified.

RESULTS

ICC values for intra-examiner reproducibility varied from 0.89 to 0.93 (PPD), and 0.88 to 0.99 (CAL). Inter-examiner ICC values varied from 0.89 to 0.96 (PPD) and 0.84 to 0.97 (CAL). The Kappa coefficient for DMFS (intra- and inter-examiners) varied between 0.81 and 0.88.

Among nearly 4,000 individuals ≥ 15 years old living in the rural area, 1087 met the eligibility criteria, and 399 did not participate of the study. The principal reason for non-participation was refusal (62.4%); other reasons were impossibility to go to the exam unit (16.8%), non-specified reasons (15.5%), absence after several contact attempts (4.8%), and having only completed the answering of questionnaires step (0.5%). Thus, 688 (63.3%) individuals were clinically examined. Among non-responders, 66 (16.5%) refused to answer the specific questionnaire, while 40 individuals (10.0%) failed to provide all the required information (at least one unanswered question).

Table 1 shows the demographic characteristics of the study’s sample, eligible individuals, and non-responders, as well as IBGE data for eligible RCEA. Most individuals (among examined, eligible, and IBGE-evaluated) reported having white skin color. Fifty percent of non-responders were white, while 20.6% did not provide skin color information. In the IBGE and eligible individuals data, there was a slight predominance of men. In the study’s sample, examined individuals were equally divided between males and females. Among non-responders, however, more than 60% were men. According to the IBGE, eligible individuals, and examined individuals data, approximately 70% had between 25 and 64 years of age. Comparisons between the sample and non-responders showed no statistical difference in characteristics other than sex.

Table 1
Demographic characteristics (study’s sample, eligible individuals, non-responders [NR]), and IBGE data).

DISCUSSION

This paper discussed methodological concepts of an epidemiological survey emphasizing oral health in a probability sample of a large rural area of Brazil’s southern region. The latest statistical data 22. Kassebaum NJ, Smith AGC, Bernabé E, Fleming TD, Reynolds AE, Vos T, et al. Global, regional, and national prevalence, incidence, and disability-adjusted life years for oral conditions for 195 countries, 1990-2015: a systematic analysis for the global burden of diseases, injuries, and risk factors. J Dent Res. 2017;96(4):380-7. https://doi.org/10.1177/0022034517693566
https://doi.org/10.1177/0022034517693566...
on global oral health shows the significant burden of untreated dental caries, severe periodontitis, and edentulism. These oral conditions affect 3.5 billion people worldwide, and pose a complex public health challenge to policy makers, indicating the need for greater efforts and different approaches if this scenario is to be improved by 2020 22. Kassebaum NJ, Smith AGC, Bernabé E, Fleming TD, Reynolds AE, Vos T, et al. Global, regional, and national prevalence, incidence, and disability-adjusted life years for oral conditions for 195 countries, 1990-2015: a systematic analysis for the global burden of diseases, injuries, and risk factors. J Dent Res. 2017;96(4):380-7. https://doi.org/10.1177/0022034517693566
https://doi.org/10.1177/0022034517693566...
. Accurate epidemiological surveys such as the one performed in this study provide reliable support for assessing the current oral health status of a population, as well as its future healthcare needs 55. Leroy R, Eaton KA, Savage A. Methodological issues in epidemiological studies of periodontitis: how can it be improved? BMC Oral Health. 2010;10:8. https://doi.org/10.1186/1472-6831-10-8
https://doi.org/10.1186/1472-6831-10-8...
, 2121. World Health Organization. Oral health surveys: basic methods. 5. ed. Geneva WHO; 2013 [cited 2016 Oct 25]. Available from: http://www.who.int/oral_health/publications/9789241548649/en/
http://www.who.int/oral_health/publicati...
. In this sense, this research can be seen as an example among the approaches necessary for the improvement of oral health, since it allows for the identification of healthy and ill individuals in a population-based sample. Data on oral health status are important for the surveillance of disease patterns 2121. World Health Organization. Oral health surveys: basic methods. 5. ed. Geneva WHO; 2013 [cited 2016 Oct 25]. Available from: http://www.who.int/oral_health/publications/9789241548649/en/
http://www.who.int/oral_health/publicati...
, and therefore essential for the definition, implementation, and evaluation of public health actions, which can be direct towards both collectives and individuals, and involve preventive measures or direct care 2121. World Health Organization. Oral health surveys: basic methods. 5. ed. Geneva WHO; 2013 [cited 2016 Oct 25]. Available from: http://www.who.int/oral_health/publications/9789241548649/en/
http://www.who.int/oral_health/publicati...
, 2626. Peres MA, Peres KG. Levantamentos epidemiológicos em saúde bucal: recomendações para os serviços de saúde. In: Antunes JLF, Peres MA, editores. Fundamentos de Odontologia: epidemiologia da saúde bucal. 2. ed. São Paulo: Editora Santos; 2013. p.31-49. .

The careful methods employed here – including well-thought-out, multistage sampling strategies, consideration of the complex sample in the data analysis, training and calibration of examiners, and full-mouth periodontal exams – ensure the quality of the generated estimates and data, making this study a useful health surveillance tool. It is well known that properly designed surveillance studies can assist governments, health authorities, and health professionals in formulating policies and programs for disease prevention. Additionally, these studies contribute to measuring the efficacy of efforts to control prevalent illness and restore the quality of life 2121. World Health Organization. Oral health surveys: basic methods. 5. ed. Geneva WHO; 2013 [cited 2016 Oct 25]. Available from: http://www.who.int/oral_health/publications/9789241548649/en/
http://www.who.int/oral_health/publicati...
.

The sampling strategy used in the study was considered the most adequate to Rosário do Sul, given its huge territorial extension (it is the seventh largest area of the state of Rio Grande do Sul 2727. Fundação de Economia e Estatística. FEEdados. Porto Alegre: FEE; 2015 [cited 2016 Oct 25]. Available from: http://feedados.fee.tche.br/feedados/
http://feedados.fee.tche.br/feedados/...
), low rural demographic density, and its population’s compromised access to urban areas and healthcare. The strategy used to direct and order the sample allocation could be seen as a limitation of this study; however, the same methodology has been applied successfully by IBGE census interviewers in the assessment of RCEA 1010. Instituto Brasileiro de Geografifa e Estatística. Censo Demográfico 2010. Manual do recenseador [CD-ROM]. Rio de Janeiro: IBGE, 2010 [cited 2016 Oct 25]. CD 1.09. Available from: https://biblioteca.ibge.gov.br/visualizacao/instrumentos_de_coleta/doc2601.pdf
https://biblioteca.ibge.gov.br/visualiza...
. RCEA identification needs to account for natural landscapes and imaginary lines that differ from official urban area divisions (squares, neighborhoods and household identification numbers). The Google Earth program was useful for circumventing the difficulties of this sampling strategy, as its images ensure the non-null probability of dwelling selection. The satellite images (maps) from the program enabled the identification of eligible dwellings and RCEA delimitations and, consequently, the sampling framework. Other epidemiology studies have also employed Google Earth images, or similar approaches, in order to construct the sampling framework 2828. Moss WJ, Hamapumbu H, Kobayashi T, Shields T, Kamanga A, Clennon J, et al. Use of remote sensing to identify spatial risk factors for malaria in a region of declining transmission: a cross-sectional and longitudinal community survey. Malar J. 2011;10:163. https://doi.org/10.1186/1475-2875-10-163
https://doi.org/10.1186/1475-2875-10-163...
, especially in situations of limited availability of populational data, as in this study. These new technological tools have been considered useful to investigate infectious disease epidemiology 3232. Carroll LN, Au AP, Detwiler LT, Fu TC, Painter IS, Abernethy NF. Visualization and analytics tools for infectious disease epidemiology: a systematic review. J Biomed Inform. 2014;51:287-98. https://doi.org/10.1016/j.jbi.2014.04.006
https://doi.org/10.1016/j.jbi.2014.04.00...
, and also for health surveillance 3333. Di Pasquale A, McCann RS, Maire N. Assessing the population coverage of a health demographic surveillance system using satellite imagery and crowd-sourcing. PLoS One. 2017;12((8):e0183661. https://doi.org/10.1371/journal.pone.0183661
https://doi.org/10.1371/journal.pone.018...
. The satellite image approach used here has several strengths: it facilitates sampling area delimitation, and provides detailed, high resolution, up-to-date images that are free to use and belong to the public domain. However, there are some disadvantages, such as the considerable time spent in the manual identification of dwellings, as well as the issue of possible changes in dwellings’ actual conditions taking place in the interval between image acquisition and the moment of sampling.

Comparisons between data from the study and from IBGE aimed to validate the strategy used for obtaining the rural area’s probability sample. The compared characteristics appeared in very similar frequencies across the examined sample, eligible individuals, and IBGE data. There was predominance of the white skin color in the three subgroups mentioned above. The slightly higher proportion of the white skin color seen in the IBGE data could be explained partially by the quantity of non-responders, i.e., individuals who failed to report information regarding this variable. This study employed the same skin color choices used in the IBGE census; however, several individuals demonstrated having doubts about this question. In these cases, the interviewers explained each option until the participant completely understood them, and waited for their answer, without considering the interviewer concepts of skin color. We are not sure whether IBGE census interviewers use the same approach, but this could also explain the frequency of white skin color found in our sample.

According to IBGE data, there are slightly more men than women living in the studied rural area; however, the examined sample showed was equally divided among both sexes, which could be justified by a greater quantity of men among non-responders. As Rosário do Sul is driven almost entirely by agriculture, and men are more involved in agricultural activities 3434. Instituto Brasileiro de Geografia e Estatística. Censo agropecuário 2006: Rosário do Sul. Rio de Janeiro: IBGE; 2006 [cited 2016 Oct 25]. Available from: https://cidades.ibge.gov.br/v4/brasil/rs/rosario-do-sul/pesquisa/24/27745?detalhes=true
https://cidades.ibge.gov.br/v4/brasil/rs...
, it is possible that a significant portion of men were unable to participate in the study due to farm work demands.

In regards to age, the slight difference between the IBGE sample and our sample, in regards to eligible individuals belonging to the first age bracket (less than or equal to 24 years of age), could be due to the combination of the ongoing rural exodus and census data lag. The young population in Brazilian rural areas is declining, especially among individuals aged ≤ 25 years 3535. Maia AG, Buainain AM. [The new map of Brazil’s rural population]. Confins. 2015;(25). Portuguese. https://doi.org/10.4000/confins.10548
https://doi.org/10.4000/confins.10548...
.

This study’s data collection process started five years after the last IBGE census (2010), which was used for the comparisons, making population-estimate lag a feasible problem. We were unable to update the dwelling registry of the randomized RCEA sample, which could be considered a further limitation. Nevertheless, there are no official data showing a change in population between the census period and the study period, and in fact the municipal government uses the last available census for its administrative planning. Thus, we believe this limitation had no effect on the external validity of the study, especially since there were no differences between the selected subjects and the demographic characteristics of the reference population. Moreover, possible variations among RCEA were adjusted considering design effect and weight for complex samples.

The two clinical examiners received the minimum reliability score (0.80) previously established in the calibration of intra- and inter-raters for PPD, CAL, and DMFS. Reproducibility values were excellent, considering the cut-off points established in the literature. Kappa values between 0.81 and 1.00 represent an almost perfect agreement strength 3636. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159-74. https://doi.org/10.2307/2529310
https://doi.org/10.2307/2529310...
; an ICC between 0.75 and 0.90 indicates good reliability, while values greater than 0.90 depict excellent reliability 3737. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155-63. https://doi.org/10.1016/j.jcm.2016.02.012
https://doi.org/10.1016/j.jcm.2016.02.01...
.

Due to its multidisciplinary character, this survey allowed for a complete health investigation, and therefore a health status report was delivered to each participant. Copies of these reports will also be delivered to the municipal health service department, accompanied by suggestions and strategies for the management of the main health problems observed. The summary of study results will be available to the general public through a local radio program, which reaches both the urban and the rural area. Apart from the scientific papers resulting from this study, we believe that these procedures may contribute to the development of local health care programs.

Acknowledgements

To Carlos Alexandre Souza Bier (CASB), PhD, Carlos Frederico Wolle (CFW), PhD, and Fernando Broll Centeno (FBC), Endodontist, for their contributions during data collection; to Bruno Emmanuelli (BE), PhD, for his help in training and calibrating the DMFS examiners; and to Mr Sérgio Dantas and the staff of the Rosário do Sul prefecture, for collaborating with the study.

REFERENCES

  • 1
    GBD2015 and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990-2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet. 2016;388(10053):1545-602. https://doi.org/10.1016/S0140-6736 (16)31678-6
    » https://doi.org/10.1016/S0140-6736 (16)31678-6
  • 2
    Kassebaum NJ, Smith AGC, Bernabé E, Fleming TD, Reynolds AE, Vos T, et al. Global, regional, and national prevalence, incidence, and disability-adjusted life years for oral conditions for 195 countries, 1990-2015: a systematic analysis for the global burden of diseases, injuries, and risk factors. J Dent Res. 2017;96(4):380-7. https://doi.org/10.1177/0022034517693566
    » https://doi.org/10.1177/0022034517693566
  • 3
    Haag DG, Peres KG, Balasubramanian M, Brennan DS. Oral conditions and health-related quality of life: a systematic review. J Dent Res. 2017;96(8):864-74. https://doi.org/10.1177/0022034517709737
    » https://doi.org/10.1177/0022034517709737
  • 4
    Mathur MR, Williams DM, Reddy KS, Watt RG. Universal health coverage: a unique policy opportunity for oral health. J Dent Res. 2015;94(3 Suppl):3S-5S. https://doi.org/10.1177/0022034514565648
    » https://doi.org/10.1177/0022034514565648
  • 5
    Leroy R, Eaton KA, Savage A. Methodological issues in epidemiological studies of periodontitis: how can it be improved? BMC Oral Health. 2010;10:8. https://doi.org/10.1186/1472-6831-10-8
    » https://doi.org/10.1186/1472-6831-10-8
  • 6
    Oppermann RV, Haas AN, Rösing CK, Susin C. Epidemiology of periodontal diseases in adults from Latin America. Periodontol 2000. 2015;67(1):13-33. https://doi.org/10.1111/prd.12061
    » https://doi.org/10.1111/prd.12061
  • 7
    Skillman SM, Doescher MP, Mouradian WE, Brunson DK. The challenge to delivering oral health services in rural America. J Public Health Dent. 2010;70 Suppl 1:S49-57. https://doi.org/10.1111/j.1752-7325.2010.00178.x
    » https://doi.org/10.1111/j.1752-7325.2010.00178.x
  • 8
    Ahn S, Burdine JN, Smith ML, Ory MG, Phillips CD. Residential rurality and oral health disparities: influences of contextual and individual factors. J Prim Prev. 2011;32(1):29-41. https://doi.org/10.1007/s10935-011-0233-0
    » https://doi.org/10.1007/s10935-011-0233-0
  • 9
    Instituto Brasileiro de Geografia e Estatística. Censo demográfico 2010: resultados da amostra, características da população, Rosário do Sul-RS. Rio de Janeiro: IBGE; 2016. [cited 2016 Oct 25]. Available from: http://cidades.ibge.gov.br/xtras/temas.php?lang=&codmun=431640&idtema=90&seasea=rio-grande-do-sul%7Crosario-do-sul%7Ccenso-demografico-2010:-resultados-da-amostra-caracteristicas-da-populacao
    » http://cidades.ibge.gov.br/xtras/temas.php?lang=&codmun=431640&idtema=90&seasea=rio-grande-do-sul%7Crosario-do-sul%7Ccenso-demografico-2010:-resultados-da-amostra-caracteristicas-da-populacao
  • 10
    Instituto Brasileiro de Geografifa e Estatística. Censo Demográfico 2010. Manual do recenseador [CD-ROM]. Rio de Janeiro: IBGE, 2010 [cited 2016 Oct 25]. CD 1.09. Available from: https://biblioteca.ibge.gov.br/visualizacao/instrumentos_de_coleta/doc2601.pdf
    » https://biblioteca.ibge.gov.br/visualizacao/instrumentos_de_coleta/doc2601.pdf
  • 11
    Instituto Brasileiro de Geografia e Estatística. Organização do território: malhas territoriais: Censo 2010: setores censitários. Rio de Janeiro: IBGE; 2012 [cited 2016 Oct 25]. Available from: http://downloads.ibge.gov.br/downloads_geociencias.htm
    » http://downloads.ibge.gov.br/downloads_geociencias.htm
  • 12
    Instituto Brasileiro de Geografia e Estatística, Centro de Documentação e Disseminação de Informações. Base de informações do Censo Demográfico 2010: resultados do universo por setor censitário. Rio de Janeiro: IBGE; 2011. Available from: http://www.ipea.gov.br/redeipea/images/pdfs/base_de_informacoess_por_setor_censitario_universo_censo_2010.pdf
    » http://www.ipea.gov.br/redeipea/images/pdfs/base_de_informacoess_por_setor_censitario_universo_censo_2010.pdf
  • 13
    Instituto Brasileiro de Geografia e Estatística. Censo Demográfico 2010: resultados do Universo: agregados por setores censitários, RS. Rio de Janeiro: IBGE; 2011 [cited 2016 Oct 25]. Available from: https://downloads.ibge.gov.br/downloads_estatisticas.htm
    » https://downloads.ibge.gov.br/downloads_estatisticas.htm
  • 14
    Sobell LC, Sobell MC. Alcohol consumption measures. Rockville (MD): National Institute on Alcohol Abuse and Alcoholism; 2004 [cited 2016 Oct 25]. Available from: https://pubs.niaaa.nih.gov/publications/assessingalcohol/measures.htm
    » https://pubs.niaaa.nih.gov/publications/assessingalcohol/measures.htm
  • 15
    Ewing JA. Detecting alcoholism: the CAGE questionnaire. JAMA. 1984;252(14):1905-7. https://doi.org/10.1001/jama.1984.03350140051025
    » https://doi.org/10.1001/jama.1984.03350140051025
  • 16
    Saunders JB, Aasland OG, Babor TF, La Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption--II. Addiction. 1993;88(6):791-804. https://doi.org/10.1111/j.1360-0443.1993.tb02093.x
    » https://doi.org/10.1111/j.1360-0443.1993.tb02093.x
  • 17
    Slade GD. Derivation and validation of a short-form oral health impact profile. Community Dent Oral Epidemiol. 1997;25(4):284-90. https://doi.org/10.1111/j.1600-0528.1997.tb00941.x
    » https://doi.org/10.1111/j.1600-0528.1997.tb00941.x
  • 18
    Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24(4):385-96. https://doi.org/10.2307/2136404
    » https://doi.org/10.2307/2136404
  • 19
    Trapnell PD, Campbell JD. Private self-consciousness and the five-factor model of personality: distinguishing rumination from reflection. J Pers Soc Psychol. 1999;76(2):284-304. https://doi.org/10.1037%2F0022-3514.76.2.284
    » https://doi.org/10.1037%2F0022-3514.76.2.284
  • 20
    Cyrino RM, Cota LOM, Lages EJP, Lages EMB, Costa FO. Evaluation of self-reported measures for prediction of periodontitis in a sample of Brazilians. J Periodontol. 2011;82(12):1693-704. https://doi.org/10.1902/jop.2011.110015
    » https://doi.org/10.1902/jop.2011.110015
  • 21
    World Health Organization. Oral health surveys: basic methods. 5. ed. Geneva WHO; 2013 [cited 2016 Oct 25]. Available from: http://www.who.int/oral_health/publications/9789241548649/en/
    » http://www.who.int/oral_health/publications/9789241548649/en/
  • 22
    O’Brien M. Children’s dental health in the United Kingdom 1993. London: Her Majesty’s Stationery Office; 1994.
  • 23
    Danser MM, Timmerman MF, IJzerman Y, Bulthuis H, Velden U, Weijden GA. Evaluation of the incidence of gingival abrasion as a result of toothbrushing. J Clin Periodontol. 1998;25(9):701-6. https://doi.org/10.1111/j.1600-051X.1998.tb02510.x
    » https://doi.org/10.1111/j.1600-051X.1998.tb02510.x
  • 24
    Ainamo J, Bay I. Problems and proposals for recording gingivitis and plaque. Int Dent J. 1975;25(4):229-35.
  • 25
    Hamp SE, Nyman S, Lindhe J. Periodontal treatment of multirooted teeth: results after 5 years. J Clin Periodontol. 1975;2(3):126-35. https://doi.org/10.1111/j.1600-051X.1975.tb01734.x
    » https://doi.org/10.1111/j.1600-051X.1975.tb01734.x
  • 26
    Peres MA, Peres KG. Levantamentos epidemiológicos em saúde bucal: recomendações para os serviços de saúde. In: Antunes JLF, Peres MA, editores. Fundamentos de Odontologia: epidemiologia da saúde bucal. 2. ed. São Paulo: Editora Santos; 2013. p.31-49.
  • 27
    Fundação de Economia e Estatística. FEEdados. Porto Alegre: FEE; 2015 [cited 2016 Oct 25]. Available from: http://feedados.fee.tche.br/feedados/
    » http://feedados.fee.tche.br/feedados/
  • 28
    Moss WJ, Hamapumbu H, Kobayashi T, Shields T, Kamanga A, Clennon J, et al. Use of remote sensing to identify spatial risk factors for malaria in a region of declining transmission: a cross-sectional and longitudinal community survey. Malar J. 2011;10:163. https://doi.org/10.1186/1475-2875-10-163
    » https://doi.org/10.1186/1475-2875-10-163
  • 29
    Shannon HS, Hutson R, Kolbe A, Stringer B, Haines T. Choosing a survey sample when data on the population are limited: a method using Global Positioning Systems and aerial and satellite photographs. Emerg Themes Epidemiol. 2012;9(1):5. https://doi.org/10.1186/1742-7622-9-5
    » https://doi.org/10.1186/1742-7622-9-5
  • 30
    Wampler PJ, Rediske RR, Molla AR. Using ArcMap, Google Earth, and Global Positioning Systems to select and locate random households in rural Haiti. Int J Health Geogr. 2013;12:3. https://doi.org/10.1186/1476-072X-12-3
    » https://doi.org/10.1186/1476-072X-12-3
  • 31
    Escamilla V, Emch M, Dandalo L, Miller WC, Martinson F, Hoffman I. Sampling at community level by using satellite imagery and geographical analysis. Bull World Health Organ. 2014;92(9):690-4. https://doi.org/10.2471/BLT.14.140756
    » https://doi.org/10.2471/BLT.14.140756
  • 32
    Carroll LN, Au AP, Detwiler LT, Fu TC, Painter IS, Abernethy NF. Visualization and analytics tools for infectious disease epidemiology: a systematic review. J Biomed Inform. 2014;51:287-98. https://doi.org/10.1016/j.jbi.2014.04.006
    » https://doi.org/10.1016/j.jbi.2014.04.006
  • 33
    Di Pasquale A, McCann RS, Maire N. Assessing the population coverage of a health demographic surveillance system using satellite imagery and crowd-sourcing. PLoS One. 2017;12((8):e0183661. https://doi.org/10.1371/journal.pone.0183661
    » https://doi.org/10.1371/journal.pone.0183661
  • 34
    Instituto Brasileiro de Geografia e Estatística. Censo agropecuário 2006: Rosário do Sul. Rio de Janeiro: IBGE; 2006 [cited 2016 Oct 25]. Available from: https://cidades.ibge.gov.br/v4/brasil/rs/rosario-do-sul/pesquisa/24/27745?detalhes=true
    » https://cidades.ibge.gov.br/v4/brasil/rs/rosario-do-sul/pesquisa/24/27745?detalhes=true
  • 35
    Maia AG, Buainain AM. [The new map of Brazil’s rural population]. Confins. 2015;(25). Portuguese. https://doi.org/10.4000/confins.10548
    » https://doi.org/10.4000/confins.10548
  • 36
    Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159-74. https://doi.org/10.2307/2529310
    » https://doi.org/10.2307/2529310
  • 37
    Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155-63. https://doi.org/10.1016/j.jcm.2016.02.012
    » https://doi.org/10.1016/j.jcm.2016.02.012
  • a
    Urbaniak GC, Plous S. Research Randomizer (Version 4.0) [Computer software]. Lancaster, Pennsylvania. 2014. Available from: http://www.randomizer.org/
  • b
    Dean AG, Sullivan KM, Soe MM. OpenEpi: Open Source Epidemiologic Statistics for Public Health. Version 3.01. [updated 2013 Apr 06; cited 2014 Aug 8]. Available from: http://www.openepi.com/Menu/OE_Menu.htm

Publication Dates

  • Publication in this collection
    06 May 2019
  • Date of issue
    2019

History

  • Received
    24 Mar 2018
  • Accepted
    25 July 2018
Faculdade de Saúde Pública da Universidade de São Paulo Avenida Dr. Arnaldo, 715, 01246-904 São Paulo SP Brazil, Tel./Fax: +55 11 3061-7985 - São Paulo - SP - Brazil
E-mail: revsp@usp.br