Reliability of a questionnaire about knowledge concerning exposure to mercury in the production of gold

Abstracts

A principal atividade econômica do município de Poconé, MT, é a produção de ouro. Visando reduzir a exposição ao mercúrio metálico as escolas realizam programas educativos para seus alunos. Foi desenvolvido um questionário para avaliar a eficácia desses programas no conhecimento de adolescentes sobre exposição ao mercúrio, em 2007. O questionário é autoaplicável com 12 perguntas. Foi testada a confiabilidade do instrumento por teste-reteste, conduzido com intervalo de 21 dias, com 128 estudantes da oitava série do ensino fundamental. Avaliou-se a confiabilidade pelo coeficiente kappa e teste do qui-quadrado de McNemar, resultando em concordância "moderada" até "quase perfeita".

Adolescente; Intoxicação por Mercúrio; Exposição Ocupacional; Questionários; Reprodutibilidade dos Testes; Educação em Saúde

BRIEF COMMUNICATION

Reliability of a questionnaire about knowledge concerning exposure to mercury in the production of gold

Confiabilidad de cuestionario de conocimiento sobre exposición al mercurio en la producción de oro

Volney de Magalhães Camara^I; Delma P Oliveira de Souza^II; Maria Izabel Freitas Filhote^I; Ronir Raggio Luiz^I; Camila Oliveira de Souza^III; Armando Meyer^I

^IInstituto de Estudos em Saúde Coletiva. Universidade Federal do Rio de Janeiro. Rio de Janeiro, RJ, Brasil

^IIInstituto de Saúde Coletiva. Universidade Federal de Mato Grosso. Cuiabá, MT, Brasil

^IIIUniversidade de Cuiabá. Cuiabá, MT, Brasil

^{Correspondence}

ABSTRACT

The primary economic activity of the municipality of Poconé, Central-West Brazil, is the production of gold. In an attempt to reduce exposure to metallic mercury, schools in that location conduct educative programs directed towards their students. A questionnaire used to evaluate the efficacy of these programs with respect to adolescents' comprehension concerning exposure to mercury was developed in 2007. This questionnaire is self-applied and has 12 questions. A test-retest reliability study, with a 21-day interval between the two sessions, was performed with this instrument. The sample was comprised of 128 students who were in the 8th grade of elementary school. Reliability was evaluated by Kappa coefficient and McNemar's chi-square test, resulting from "moderate" to "almost perfect" agreement.

Descriptors: Adolescent. Mercury Poisoning. Occupational Exposure. Questionnaires. Reproducibility of Results. Health Education.

RESUMEN

La principal actividad económica del municipio de Poconé (Centro-Oeste de Brasil), es la producción de oro. Con miras a reducir la exposición al mercurio metálico, las escuelas realizan programas educativos para sus alumnos. Fue desarrollado un cuestionario para evaluar la eficacia de esos programas en el conocimiento de adolescentes sobre la exposición al mercurio, en 2007. El cuestionario es autoaplicable con 12 preguntas. Fue evaluada la confiabilidad del instrumento por prueba-retest, conducido con intervalo de 21 días, con 128 estudiantes de la octava serie de la enseñanza fundamental. Se evaluó la confiabilidad por el coeficiente kappa y prueba de Chi-cuadrado de McNemar, resultando en concordancia "moderada" hasta "casi perfecta".

Descriptores: Adolescente. Intoxicación por Mercurio. Exposición Profesional. Cuestionario. Reproducibilidad de Resultados. Educación en Salud.

INTRODUCTION

Metallic mercury presents elevated toxicity² and is utilized in the production of gold to form a gold-mercury amalgam which, after being burned, liberates the mercury into the atmosphere. When it is commercialized, this gold is burned again for "purification", liberating more mercury into the atmosphere.⁴ Metallic mercury may also be transformed into methylmercury in the river sediments by means of a process of methylization, mediated by aquatic microorganisms.⁵

A study conducted in Poconé (Central-West Brazil) indicated that the the mean levels of mercury in the urine (HgU) of 365 residents not exposed occupationally, that is, residents who lived near the stores that commercialize gold, were four times higher than the control group (4.35mg/L versus 1.25mg/L). Among the latter, 14 people (HgU from 7.0 to 102.4 mg/L) reported that they extracted gold from their backyards and burned the amalgam in their kitchens. ¹

The objective of this study was to test the reliability of a questionnaire utilized to evaluate the efficacy of preventive programs in terms of adolescents' knowledge concerning exposure to mercury.

METHODS

This study was conducted in 2007 among 8th grade elementary school students enrolled in public schools in Poconé. The size of the sample of the test-retest reliability study was calculated as 123 pairs, considering that the prevalence of exposure to mercury among students, according to a previous study was 4.5%,¹ with 3% absolute precision, 1% effect of the design and 95% confidence level. Seven schools were randomly selected and when the instrument was applied, a code system was utilized to guarantee the anonymity of the study subjects.

Within this context, a test-retest reliability study was conducted by means of a self-applied questionnaire that was utilized to evaluate the efficacy of a program of the Instituto de Estudos em Saúde Coletiva da Universidade Federal do Rio de Janeiro [Institute of Collective Health Studies of the Federal University of Rio de Janeiro] geared towards the prevention of exposure to mercury among adolescent residents living within areas of gold production.

The questionnaire addresses knowledge acquired by adolescents through an educational program composed of ludic activities concerning accidents and diseases related to the environment in general and specifically with the environment at work. In this study, during the period between the test and the retest, the program was not developed so that it could not interfere in the evaluation of the reliability of the questions.

The questionnaire has three open questions: 1) What is pollution? 2) State some causes of pollution?; 3) What is an occupational accident? Two researchers analyzed if the answers were correct, and, specifically with respect to occupational accidents, some plausible answer which corresponded to adolescents' knowledge concerning this theme, that is, a response which included work and some effect it had on health (for example getting hurt on the job) were taken into consideration. The remaining questions were closed (the answers were either yes or no):

4) Do you work outside your home?

5) Do you work at home?

6) Manuel was going to work on his bicycle and he hit a car. Because of this accident, he broke his arm. In your opinion, did Manuel suffer from an occupational accident?

7) Yesterday it rained a lot while John was at his job on the street fixing a post. Upon his arrival at home, his clothes were soaked and he got a lung disease. Do you believe that John's disease is an occupational accident?

8) Richard and Bruno fought at the bar where they work because of a soccer match. Bruno punched Richard and, as a result, broke two of his teeth. In your opinion did Richard suffer from an occupational accident?

9) Have you ever gotten hurt because of your work?

10) The use of chemical products at home may be harmful to your family's health?

11) Has someone in your home gotten sick due to the use of some chemical product?

12) Is pollution a problem in your city?

The evaluation of test-retest reliability was conducted by means of the Kappa coefficient, which consists of calculating the proportion of matching replies in two applications of the same instrument.³ The values were classified in the following manner: values between 0.81-1.00 (almost perfect); 0.61-0.80 (substantial); 0.41-0.60 (moderate); 0.21-0.40 (weak); 0.00-0.20 (slight) and, <0 poor. McNemar's ÷² test was utilized to verify the equivalence between the proportions of positive responses in the test and retest.

Statistical analysis was conducted utilizing the 9.0 version of the SPSS Program. A favorable report was obtained from the Research Ethics Committee of the Instituto de Estudos em Saúde Coletiva [Institute of Studies in Collective Health] of the Federal University of Rio de Janeiro before the study instrument was applied and all research subjects and their guardians signed Terms of Informed Consent before answering the questionnaire.

RESULTS

The questionnaire was filled out by 207 adolescents, 184 of which participated in the retest. After matching the questionnaires in test-retest pairs, analysis focused on 128 pairs and the 60 remaining questionnaires were considered losses. There was a similar proportion of respondents of each sex (approximately 50%); the mean age for the female sex was 13.9 (sd=0.10) and 16.0 (sd=1.42) for males; according to registration forms, the majority (75%) of students attended school in the morning. Absence from school was the primary cause of losses, being excluded from analysis those that participated only in the test or the retest. It may be presumed that the students who were absent did not differ from the rest of the students, for they were all in the same socioeconomic level that characterizes students attending public schools.

In the open-ended questions, "almost perfect agreement" was obtained in the questions concerning pollution and occupational accidents (respectively k=0.885 95% CI 0.66; 1.00 and 0.820 95% CI: 0.68; 0.97) and "moderate" for the question on the causes of pollution (k=0.580, 95% CI: 0.20; 0.95).

As to the items concerning the working environment, (see Table), it may be observed that the two questions about work "outside" and "inside" the home had almost perfect kappa (respectively: k=0.81, 95% CI: 0.70; 0.93; k=0.91, 95% CI: 0.84; 0.99). For the remaining questions concerning these occupational environments, the values obtained corresponded to "moderate" to "substantial" reliability.

The questions which referred to chemical products and pollution obtained kappa values which correspond to "substantial" and "moderate" respectively, being that the latter was attributed to questions about whether someone in the house had suffered some effect caused by pollution (k=0.571; 95% CI: 0.33; 0.81) and the existence of pollution in the city of Poconé (k=0.551; 95% CI: 0.37; 0.73).

General agreement varied from moderate to high for all items of the questionnaire, with a value of 83.5% (95% CI: 75.8; 89.5) when characterizing disease as an occupational accident to 99.2% (95% CI: 95.6; 99.9) when defining environmental pollution. Except for the question "what is an occupational accident?" (p=0.025), no other question presented significant statistical difference for the marginal proportions (test-retest) according to McNemar's ÷² test.

DISCUSSION

Reliability and reproducibility, measured through internal consistence, were evaluated using kappa coefficient, were evaluated utilizing the weighted kappa coefficient of all items. The reliability obtained varied from "substantial" to "almost perfect" for half the items and the remaining items presented "moderate" kappa coefficients. The 21-day interval between the two sessions (test-retest) was longer than what is recommended by other studies conducted in Brazil³. It may therefore be inferred that if the period between the applications of the questionnaire was smaller, memory biases may have been reduced and, above all, there may have been less probability of changes occurring in the events being measured.

As to the three open questions, it is possible that the concepts concerning occupational accidents and environmental pollution are already part of these students' symbolic repertoire, since they presented "almost perfect" kappa coefficients, despite the small difference in marginal proportions. A plausible explanation for the high value obtained by the concept of environmental pollution may be the diffusion of the results of studies conducted by different institutions that have pointed out the association between use of mercury in the production of gold and the increased exposure of the population to this metal.¹ However, reliability was "moderate" when students were asked to point out the causes of pollution. Knowledge concerning the effects of this pollution on health have not yet been incorporated by participants in the present study because 80.5% were not aware of the fact that the use of chemical products in the house could harm family members.

As to the work setting, "almost perfect" reliability was obtained in the identification of the place of work being "inside" or "outside" the home. This result is relevant, because it indicates that adolescents have incorporated basic concepts concerning work.

The items that equated diseases, aggressions at the work place and accidents on the way to work as occupational accidents, the question on accidents on the way to the work place presented a 0.793 coefficient whereas the other two questions presented rates of 0.591 and 0.558. These are more complex questions that extrapolate the cognitive knowledge of adolescents that are still in the eighth grade. If, on the one hand, the existence of only two alternatives (yes and no) may have induced the student to choose one of these options randomly, on the other, it may be observed (see Table) that for each of these three questions in the questionnaire, respectively 106, 107 and 122 the students maintained the options they chose in both the test and the retest, indicating that these questions were adequately formulated.

As to the other questions in which the kappa was moderate, a high level of agreement was obtained: injuries caused by occupation, the existence of pollution in the city, the use of chemical products at home and the effects of chemical products on the health of someone at home.

Finally, among the limitations of the study, we must mention the losses that occurred due to the number of students that replied only once because he or she were absent from class on the other occasion. Although the instrument presented some questions that obtained moderate kappa values, it expressed adequate reliability. It may therefore be employed in the evaluation of educational programs geared towards adolescents exposed to mercury, in areas of gold production.

REFERENCES

Received: 9/12/2008

Approved: 11/30/2008

VM Câmara and RR Luiz were supported by the CNPq (Scientific Productivity Grant).

This study was financed by the Conselho Nacional de Desenvolvimento Científico e Tecnológico [The National Council for Scientific and Technological Development] (CNPq - Process n.º: 471313/2006-8; Universal Project Grant).

• 1. Câmara VM, Tavares LM, Filhote MI, Malm O, Perez MA. A program for the control of indoor pollution by metallic mercury. Environ Res. 2000;83(2):110-6. DOI: 10.1006/enrs.1999.4034
• 2. Faria MA. Mercuralismo metálico crônico ocupacional. Rev Saude Publica. 2003;37(1):116-27. DOI: 10.1590/S0034-89102003000100017
• 3. Fraga-Maia HS, Santana VS. Concordância de informações de adolescentes e suas mães em inquérito de saúde. Rev Saude Publica. 2005;39(3):430-7. DOI: 10.1590/S0034-89102005000300014
• 4. Hacon SS, Farias RA, Campos RC, Argento RR, Valente J, Wasserman J. Current scenarios of human exposure to mercury in the Northern region of Mato Grosso, Amazon Basin. J Environ Sci. 2003;10(2):121-34.
• 5. Jędrychowski W, Perera F, Rauh V, Flak E, Mróz E, Pac A, et al. Fish intake during pregnancy and mercury level in cord and maternal blood at delivery: an environmental study en Poland. Int J Occup Med Environ Health. 2007;20(1):31-7. DOI: 10.2478/v10001-007-0002-8

Publication Dates

• Publication in this collection
  13 Feb 2009
• Date of issue
  Apr 2009

History

• Accepted
  30 Nov 2008
• Received
  12 Sept 2008