Educational interventions in health services and oral health: systematic review

ABSTRACT

OBJECTIVE  To analyze the effectiveness of educational interventions performed in health services in the improvement of clinical behaviors and outcomes in oral health.

METHODS  We have carried out a systematic review of the literature searching the PubMed, Lilacs, and SciELO databases. We have included studies that have investigated interventions performed by health professionals working in health services and who have used educational actions as main approach to improve behavioral and clinical outcomes in oral health.

RESULTS  The search amounted to 832 articles and 14 of them met all the inclusion criteria. Five studies have only exclusively evaluated the effectiveness of interventions on caries reduction, three have exceptionally evaluated oral health behaviors, and the other articles have evaluated the effectiveness of interventions for both clinical outcomes (dental caries and periodontal conditions) and behaviors in oral health. Most of the studies (n = 9) were based on randomized controlled trials; the other ones have evaluated before and after the intervention. Five studies have reported a significant reduction of dental caries, and five of the six studies evaluating behavioral outcomes have found some positive change.

CONCLUSIONS  Most studies evaluating behavioral and periodontal outcomes have shown significant improvements in favor of interventions. All studies evaluating caries have shown a reduction in new lesions or cases of the disease in the groups receiving the interventions, although only five of the eleven articles have found a statistically significant difference. Educational interventions carried out by health professionals in the context of their practice have the potential to promote oral health in the population.

DESCRIPTORS
Health Education; Dental; Evaluation of the Efficacy-Effectiveness of Interventions; Dental Health Services; Review

RESUMO

OBJETIVO  Analisar a efetividade de intervenções educativas realizadas em serviços de saúde na melhoria de comportamentos e desfechos clínicos em saúde bucal.

MÉTODOS  Foi realizada uma revisão sistemática da literatura com busca nas bases de dados PubMed, Lilacs e SciELO. Foram incluídos estudos que investigaram intervenções realizadas por profissionais de saúde atuantes em serviços de saúde e que utilizaram como principal abordagem ações de educação com a finalidade de melhorar desfechos comportamentais e clínicos em saúde bucal.

RESULTADOS  A busca totalizou 832 artigos e 14 preencheram todos os critérios de inclusão. Cinco estudos verificaram exclusivamente a efetividade das intervenções na redução de cárie, três avaliaram excepcionalmente comportamentos em saúde bucal, os demais artigos julgaram a efetividade das intervenções tanto para desfechos clínicos (cárie dentária e condições periodontais) quanto para comportamentos em saúde bucal. A maioria dos estudos (n = 9) foi baseada em ensaios randomizados e controlados, os demais avaliaram o antes e depois da intervenção. Cinco estudos reportaram redução significativa de cárie dentária, e cinco dos seis estudos que avaliaram desfechos comportamentais encontraram alguma mudança positiva.

CONCLUSÕES  A maioria dos estudos que avaliaram desfechos comportamentais e periodontais mostrou melhorias significativas a favor das intervenções. Todos os estudos que avaliaram cárie mostraram a diminuição de novas lesões ou casos da doença nos grupos que receberam as intervenções, embora apenas cinco dos 11 artigos tenham encontrado uma diferença estatisticamente significativa. As intervenções educativas realizadas por profissionais de saúde no contexto de sua prática apresentam potencial em promover a saúde bucal da população.

DESCRITORES
Educação em Saúde Bucal; Avaliação de Eficácia-Efetividade de Intervenções; Serviços de Saúde Bucal; Revisão

INTRODUCTION

Oral diseases are considered an important public health problem not only because of their high prevalence^22–24 but also because they negatively affect the quality of life of individuals and have high costs for their treatment³¹. Data from the global study “Global Burden of Disease Study 2010” revealed that approximately 3.9 billion persons are affected by oral diseases³⁴. Untreated caries in permanent teeth was the health condition with the highest overall prevalence (35% for all ages combined)³⁴.

The fact that oral diseases are largely preventable and yet present high prevalence is worrying. Healthy behaviors, such as daily tooth brushing, regular contact with fluoride sources³⁵, and controlled consumption of sugar⁴⁹ are the most effective ways to prevent major oral diseases, as well as reduce costs for health services and society⁴⁷. The strong social and behavioral character of these diseases exposes the importance of the implementation of educational interventions for the appropriation of self-knowledge about the health-disease process, stimulating the autonomy and change in health behaviors leading to prevention¹.

Systematic and narrative reviews of studies evaluating the effect of educational interventions on the improvement of oral health, published between 1982 and 2013, have been previously conducted. A narrative review has sought to identify evidence of strategies for the promotion of oral health in its evaluation, including three systematic reviews and two narratives on the effectiveness of educational interventions in improving oral health, based on studies published between 1982 and 1996⁵⁹. The five reviews analyzed present similar results regarding the short-term positive effects in knowledge but which are limited in relation to behaviors and clinical conditions⁵⁹. We highlight that the design, methodology, and evaluation of the studies are criticized as being of low quality⁵⁹.

Twetman⁵⁵ has systematically reviewed 22 studies on several types of intervention for caries prevention in children up to three years of age, published between 1998 and 2007. Educational interventions have been reported in five studies. The author has found that two low quality studies had zero effects, whereas three studies of average quality identified a lower incidence of caries in the group that received health education when compared to the group that did not receive it. The author states that the most effective studies were those conducted in the context of health services or that used motivational interviewing as an educational approach.

Lemkuhl et al.³⁰ have carried out a narrative review of the literature that has analyzed the impact of 37 studies on educational interventions for the improvement of clinical diseases in oral health, published between 2003 and 2013. Inconsistent effects were found for plaque reduction, gingival bleeding, increased caries, and dental calculus. However, studies with more contact with the target public had the greatest magnitudes of positive effect in the investigated outcomes. The methodological quality of the recently published studies is still poor, according to the analysis of the authors. In addition, most of the educational approaches used are essentially based on an individual and traditional pedagogical model. These approaches are criticized for disregarding the social, interpersonal, and context relations of health services.

Studies that evaluate the effect of educational interventions integrated into health services and aimed at improving oral health have not been systematically reviewed. None of the reviews previously presented have classified interventions integrated into health services as an important category of analysis. Only Twetman⁵⁵ has observed that studies of this nature present greater potential for the prevention of caries in children. In the perspective of integrated interventions in health services, different health professionals promote actions that increase the ability to obtain positive effects on the health of individuals and communities⁶². Health education is listed as one of the central elements in the success of this type of intervention in several health areas¹⁴. Regarding oral health, contact with individuals and communities should be viewed by any health professional as an opportunity for educational work, aiming to contribute to the improvement of the oral health conditions of the population, especially in places with restricted access to the dentist.

Knowledge of the effectiveness of educational interventions for oral health helps in the identification of the best strategies to be applied in the context of health practices. Given the – educational – nature of the intervention, the scientific validity of most of the clinical trials analyzed in previous reviews is questionable. Unlike classical clinical interventions, carried out under optimum conditions to produce the expected effect, success in educational interventions depends on a range of players involved in the implementation and evaluation. The desired changes in individuals must be followed up by changes in the professional and organizational practices of health services. Such services should be focused on an integrated perspective and offer continuous support to users, using health education as a tool to achieve this purpose. The understanding on how this type of intervention should work, in the real world, is crucial to achieve improvements in oral health. Given this context, this systematic review was carried out to answer the question: Are the educational interventions integrated into health services effective in modifying oral health behaviors or in preventing oral diseases?

METHODS

The guidelines of the PRISMA protocol were followed for the reporting of this review⁴¹. The review is registered on the PROSPERO platform (CRD42016052112).

We have carried out a systematic review of the literature on the PubMed, Lilacs, and SciELO databases. There were no date or language limits. We checked the gray literature and the references of the selected articles to find additional studies that were not identified in the searches.

The term used in the search combined the following terms in the Medical Subject Headings (MeSH) and their corresponding words in the Health Sciences Descriptors (DeCS): (((“Health Promotion”[Mesh] OR “Health Education, Dental”[Mesh]) OR “Health Education”[Mesh] OR “Community Health Workers/education”[Mesh] OR “Health Personnel/education”[Mesh] OR “Education, Medical, Continuing”[Mesh] OR “Pediatrics/education”[Mesh] OR “Preventive Dentistry”[Mesh])) AND “Oral Health”[All Fields] AND (“Clinical Trial”[Publication Type] OR “Intervention Studies”[All Fields] OR “Evaluation Studies”[Publication Type] OR “Program Evaluation”[Mesh]). We generated a database with the research results using the EndNote X7 tool.

We included in this review: (i) intervention studies, with or without randomization, with or without a control group, covering a population of any age group; (ii) educational interventions, covering general or oral health, performed exclusively by health professionals, who performed their work in public or private health services of any context (e.g.: hospitals, primary health care centers, reference services in universities, medical and dental clinics); (iii) studies evaluating the outcome of improvements in oral health-related behaviors (the main outcomes were: daily brushing at least twice a day, use of baby bottle, consumption of sweets, use of dental services) or evaluating outcomes under clinical conditions of oral health (caries and periodontal conditions were the only ones found).

We excluded the studies: (i) in which preventive or curative treatment was the main intervention, as our focus was to evaluate the effect of educational interventions; (ii) whose objective was to evaluate knowledge acquisition and effects in the practice of students or professionals, after training to exercise health education actions and not their effect on the target population; (iii) in schools, with the exception of those explicitly implemented by health professionals; iv) with very small samples (less than or equal to 20 participants).

The selection of the articles began with the reading of the titles and abstracts carried out independently by two of the authors (AMM and AMC). The final decision was based on a third reviewer in cases of disagreement (AERS). After selection, the following data related to the characteristics of the studies were extracted by two of the authors (AMM and AMC): author, sample, place of the study (developed or developing countries), type of study (randomized and controlled trial or before and after), type of health service (primary care health center, hospitals, medical or dental clinic), target audience, type of educational resource or strategy used, professional who implemented the intervention (dentist, physician, nurse, community health agent, more than one type of professional), dosage of the intervention (1 to 3, 4 to 12 contacts with the target public), maximum evaluation time in months (2 to 6, 7 to 12, 13 to 24, 36 to 60), follow-up rate of more than 80% (no or yes), and type of outcome (clinical, behavioral or clinical, and behavioral), besides the results obtained in the studies.

We presented the results for the outcomes as such in the articles and, subsequently, we calculated an estimate of the relative impact of the interventions on the outcomes, according to an approach previously presented in the literature³⁰. We performed the following calculations in each group: final result of the outcome evaluation (FR) subtracted from the initial result (IR), divided by the initial result and multiplied by one hundred: ((FR - IR) / IR) × 100. When the study had a control group, we compared the percentage values of the intervention group to the control group, using a calculation similar to the one mentioned above. In this way, we estimated the magnitude of the decreases or increases in the outcomes of the intervention group in relation to the control group in percentage terms.

Two of the authors evaluated the quality of the articles (AMM and AMC). The two authors initially discussed the quality evaluation criteria, and the evaluation was done together. The differences were debated and we took the final decision by consensus. We evaluated the quality of the studies with the instrument proposed by Downs and Black¹⁵, originally with 27 questions related to the quality of the information present in the article, external validity, internal validity (bias and confounding), and statistical power, which gives a score ranging from zero to 28. The issue about the attempted to blind the subjects to exposure was excluded, as it does not apply to the type of intervention performed. Therefore, the score of the articles could range from zero to 27. We classified each study according to the quality of the evidence as excellent (24 to 27), good (20 to 23), reasonable (15 to 19), or poor or limited (14 or less), according to criteria used in another review⁷. The quality of the evidence was not an exclusion factor, since we considered it important to evaluate all the available evidence about the subject and relate it to the results found.

All data were tabulated in worksheets of the Excel^® 2013 program. We calculated the absolute and relative frequencies and performed the estimates of the relative impact of interventions.

RESULTS

The searches resulted in a total of 832 articles, which became 830 articles after removing the duplicates. In this first stage, we excluded 800 articles after reading the title and abstract, thus leaving us with 30 articles for the reading of the full text. Subsequently, we excluded one study because it presented a small sample (n = 20)³, nine studies were not implemented by health professionals working in the service^{12,13,17,21,27,28,33,45,51}, four studies had the preventive and curative treatment as the main intervention^16,24,38,44, one study described the protocol and did not evaluate effects⁵³, and one study was a duplicate¹¹. At the end, fourteen studies considered all the criteria (Figure 1) and were included in the qualitative synthesis^{2,8–10,19,22,29,39,42,46,54,57,58,61}.

Figure
Flowchart for the selection of studies Adapted from the PRISMA statement⁴¹.

Table 1 summarizes the main characteristics of the studies included in the review. Half of the studies were carried out in developing countries^{8,19,22,39,42,46,57} and most (n = 9) included parents and their children as target population^{2,10,22,39,46,54,57,58,61}, with age varying from zero to eight years. Most studies (n = 8) were based on randomized controlled trials^{2,8–10,39,46,57,61} and seven were carried out in primary health care centers^{8,10,19,39,46,57,61}. Only one study did not offer verbal advice/guidance as an educational strategy⁹. One study offered only healthy eating guidelines⁸; the others offered, mainly, oral hygiene guidelines. The dosages of the intervention (i.e., the number of times the intervention was performed in a given population in the proposed time period) varied from one to twelve contacts with the target audience, and half of the studies had up to three contacts^{9,19,29,39,57,58,61}. Only five studies had a follow-up rate above 80%^2,9,22,46,54.

Table 1
Description of studies included in the review. (n = 14)

Characteristics of the studies		n	%
Place of the study
	Developed countries	7	50.0
	Developing countries	7	50.0
Type of study
	Randomized and controlled test	9	64.2
	Before and after	5	35.8
Type of health service
	Primary health care center	7	50.0
	Ontological clinic	3	21.4
	Hospital	3	21.4
	Medical clinic	1	7.2
Target audience
	Parents and their children	9	64.2
	Pregnant women	3	21.4
	Children	1	7.2
	Women who use public services	1	7.2
Type of educational resource or strategy used*
	Oral advice/Guidance	13	92.9
	Giving out handouts/Pamphlets	7	50.0
	Giving out toothbrushes and toothpastes	6	42.8
	Posters in health services	2	14.3
	Demonstration of brushing in macromodels	2	14.3
	Sending of postcards by mail	1	7.2
	Video demonstration	1	7.2
	Photo album demonstration	1	7.2
	Giving out sippy cups	1	7.2
	Phone calls	1	7.2
Professional who implemented the intervention
	More than on professional	6	42.8
	Dentist	3	21.4
	Community health agent	3	21.4
	Physician	1	7.2
	Nurse	1	7.2
Dosage of the intervention (number of contacts)
	1 to 3	7	50.0
	4 to 12	5	35.8
	Not informed	2	14.2
Maximum time for evaluation (months)
	2 to 6	3	21.4
	7 to 12	5	35.8
	13 to 24	1	7.2
	36 to 60	3	21.4
	Not informed	2	14.2
Follow-up rate above 80%
	No	7	50.0
	Yes	5	35.8
	Not informed	2	14.2
Outcomes
	Clinical	6	42.8
	Behavioral	3	21.4
	Clinical and behavioral	5	35.8

• ^*
  Some studies have used more than one type of resource; the percentage values shown are individual for each type of resource.

The time of follow-up of the interventions varied greatly, and the most frequent was between seven and 12 months^{9,19,22,46,57}. Five studies have only exclusively evaluated the effectiveness of the intervention on caries reduction ^{8,29,39,42,61}, three have evaluated only oral health behaviors^9,19,54, and the other ones have judged the effectiveness of the interventions for both clinical outcomes (dental caries, dental plaque, periodontal diseases) and behavior^{2,10,22,46,57,58}.

The quality evaluation of the studies is expressed in Table 2. The average total score was 17.6 points (SD = 4.2) according to the instrument of Downs and Black¹⁵. The minimum score was 11 points⁴², and only two studies scored 25 points^8,39, which were considered excellent. Two interventions were considered good^10,57 and seven were considered of reasonable quality^{2,9,19,29,46,54,58}. The evaluation according to the items of the instrument identified greater methodological problems related to confounding, external validity, and reporting.

Table 2
Evaluation of the quality of the interventions, according to the criteria of Downs and Black¹⁵.

Authors, year	Report	External validity	Bias*	Confounding	Power	Sum
	(0 to 10)	(0 to 3)	(0 to 6)	(0 to 6)	(0 to 1)	(0 to 26)
Chaffee et al.8 (2013)	10	3	5	6	1	25
Mohebbi et al.39 (2007)	9	3	6	6	1	25
Vachirarojpsian et al.57 (2005)	8	3	6	5	0	22
Davies et al.10 (2005)	8	3	5	3	1	20
Raj et al.46 (2003)	8	3	5	2	1	19
Blinkhorn et al.2 (2003)	6	1	6	3	1	17
Cibuka et al.9 (2011)	9	0	5	2	1	17
Frazão et al.19 (2009)	7	3	4	2	1	17
Wagner et al.58 (2013)	7	3	3	3	1	17
Strippel et al.54 (2010)	8	0	4	3	1	16
Larsen et al.29 (2016)	8	1	4	1	1	15
Gauba et al.22 (2016)	8	0	4	1	1	13
Whittle et al.61 (2008)	5	0	5	2	1	13
Moskovitz et al.42 (2009)	7	0	2	2	0	11
Average (SD)	7.7 (1.3)	1.6 (1.4)	4.6 (1.2)	2.9 (1.6)	0.9 (0.4)	17.6 (4.2)

• ^*
  Question 14 of the Downs and Black instrument was excluded.

Table 3 includes the results of the interventions on the oral health behaviors analyzed. Six studies evaluated daily brushing at least twice a day and most (n = 5) presented positive results in favor of the interventions^{9,10,46,57,58}, with magnitudes of effect ranging from 11.0%⁹ to 141.5%⁴⁶. We also found significant differences regarding the use of baby bottle and consumption of sweets for most studies; five of the six studies have demonstrated improvement in these outcomes in the groups receiving the interventions^{9,10,22,54,57}, whose magnitudes of effect ranged from 7.6%⁵⁴ to 83.3%¹⁰. Finally, the three studies that proposed the increase in the use of dental services found positive effects for the intervention^9,19,58. In two of the them^9,19, we observed the highest magnitudes of effect in relation to all the behaviors evaluated.

Table 3
Results of the interventions on the main behaviors in oral health.

Authors, year	Control group	Intervention group	p	Relative impact of intervention (%)
Daily brushing at least twice a day
Cibulka et al.9 (2011)	I: NI F:NI	I: average score 1.8 (SD = 0.62) F: average score 2.0 (SD = 0.69)	0.013	11.0
Davies et al.10 (2005)	I: NI F: 34%	I: NI F: 52%	< 0.001	52.9
Frazão et al.19 (2009)	-	I: 73% F: 88%	> 0.05	20.6
Raj et al.46 (2013)	-	I: 4.1% F: 9.9%	< 0.001	141.5
Vachirarojpisan et al.57 (2005)	I: NI F: 26.7%	I: NI F: 41.8%	< 0.001	56.6
Wagner et al.58 (2013)	They conclude that mothers who participated in the intervention started brushing the teeth of their children earlier and more frequently using fluoride toothpaste. Results in numbers are not shown.
Use of baby bottle
Davies et al.10 (2005)	Stopped using baby bottle
	I: NI F: 18%	I: NI F: 33%	0.04	83.3
Strippel et al.54 (2010)	Frequency of bottle feeding with cariogenic content during the day
	I: NI F:41%	I: NI F: 32%	< 0.001	-21.9
Vachirarojpisan et al.57 (2005)	Sleep using a bottle
	I: 44% F: 35.1%	I: 43.7% F: 40.4%	> 0.05	*
Consumption of sweets
Cibulka et al.9 (2011)	Intake of soft drinks more than twice a day
	I: 21% F: 23%	I: 18% F: 11%	< 0.05	-48.7
Gauba et al.22 (2016)	Consumption of a cariogenic diet
	-	I: Average 8.47 (SD = 5.18) F: Average 2.37 (SD = 2.23)	< 0.001	-72.1
Strippel et al.54 (2010)	Introduction of sugars in food at 7 months
	I: NI 32%	I: NI F: 24%	< 0.001	-25.0
Vachirarojpisan et al.57 (2005)	Frequent consumption of sugary drinks during the day at 24 months of age
	I: NI F: 66%	I: NI F: 61%	0.013	-7.6
	Consumption of sweets between meals
	I: 92.1% F: 90.6%	I: 88.3% F: 91.5%	> 0.05	*
Use of dental services
Cibulka et al.9 (2011)	Went to the dentist last year
	I: 30.1% F: 32.9%	I: 27.4% F: 56.9%	0.006	1.061.0
Frazão et al.19 (2009)	Frequent or very frequent use of dental services
	-	I: 25.3% F: 57.1%	< 0.001	125.7
Wagner et al.58 (2013)	They conclude that mothers who participated in the intervention reported more use of dental services in those who received the intervention. Results in numbers are not shown.

• ^*
  The change was greater in the control group than in the intervention group.

The results regarding a decrease in oral diseases and disorders are shown in Table 4. Of the 11 studies evaluating the prevention of new lesions/cases of caries, five presented significant differences at the end of their interventions^{10,22,29,42,58}, with magnitudes of effect varying from 31.6%¹⁰ to 481.6%²². Although most interventions (n = 6) have not presented significant differences for caries disease, all studies have shown a decrease in dental caries in the groups that received the interventions. Furthermore, two other studies^2,46 addressed the clinical outcome of dental plaque and one the outcome of dental calculus⁴⁶, with positive results.

Table 4
Results of the interventions for clinical outcomes

Authors, year	Index	Control group	Intervention group	p	Relative impact of intervention (%)
Dental caries
Blinkhorn et al.2 (2003)	dmft	I: 2.2 (SD 2.3) F: 3.2 (SD 2.8)	I: 2.0 (SD 2.2) F: 2.6 (SD 2.6)	0.21	-33.3
Chaffee et al.8 (2013)	Average dmfs (with white spots)	I: zero F: 3.6 (SD 6.9)	I: zero F: 2.8 (SD 5.4)	0.25	-22.2
	Average of the decayed component of the dmfs	I: zero F: 3.0 (SD 6.8)	I: zero F: 2.1 (SD 5.0)	0.18	-30.0
Davies et al.10 (2005)	Average dmft	I: NI F: 1.7	I: NI F: 1.1	< 0.001	-35.3
	Average dmfs	I: NI F: 3.8	I: NI F: 2.6	0.008	-31.6
Gauba et al.22 (2016)	They have not used the index. They were based on their own criteria and characterized it as “chance to avoid new cavities”	-	I: Average 12.5 (SD 13.5) F: Average 72.7 (SD 14.4)	< 0.001	481.6
Larsen et al.29 (2016)	They have not used the index. Presence or absence of dental caries	I: zero F: 29 children without dental caries (69%)	I: zero F: 19 children without dental caries (39%)	0.015	-43.5
Mohebbi et al.39 (2007)	Average of enamel caries WHO criteria (1997)	I: 0.08 (SD 0.4) F: 0.48 (SD 1.0)	Group A I: 0.25 (SD 0.7) F: 0.15 (SD 0.5)	0.283	Group A -108.0
			Group B I: 0.25 (SD 0.7) F: 0.35 (SD 1.0)		Group B -92.0
	Average of dentin caries WHO criteria (1997)	I: 0.03 (SD 0.25) F: 0.23 (SD 0.95)	Group A I: 0.04 (SD 0.2) F: 0.02 (SD 0.2)	0.719	Group A -107.6
			Group B I: 0.14 (SD 0.8) F: 0.12 (SD 0.3)		Group B -102.1
Moskovitz, et al.42 (2009)	Average of the decayed component of the DMFT	I: NI F: 5.9	I: NI F: 3.2	< 0.001	-45.8
	Average DMFT	I: NI F: 7.5	I: NI F: 6.8	> 0.05	-9.3
Raj et al.46 (2013)	Average dmft	-	I: 2.1 (SD 3.2) F: 1.9 (SD 1.4)	0.060	-9.5
Vachirarojpisan et al.57 (2005)	Cavitated and non-cavitated caries lesions*	I: 1.7 (SD 2.6) F: 7.7 (SD 5.2)	I: 1.9 (SD 2.7) F: 7.8 (SD 5.0)	> 0.05	-11.4
Wagner et al.58 (2013)	Average dmfs	I: zero F: 5.2 (SD 6.4)	I: zero F: 3.2 (SD 7.4)	< 0.05	-38.5
	Average dmft	I: zero F: 2.4 (SD 4.1)	I: zero F: 1.5 (SD 2.5)	< 0.05	-37.5
Whittle et al.61 (2008)	Average dmfs	I: zero F: 2.2 (36 months)	I: zero F: 2.0 (36 months)	> 0.05	-15.2
		I: zero F: 4.8 (60 months)	I: zero F: 4.0 (60 months)
Periodontal conditions
Blinkhorn et al.2 (2003)	Dental plaque - NI Index	I: NI F: 61%	I: NI F: 53%	0.16	-13.1
Raj et al.46 (2013)	Dental plaque - NI Index	-	I: 75.5% F: 66.5%	< 0.001	-11.9
	Gingival bleeding	-	I: 1.7% F: 2.2%	0.671	29.4
	Calculus	-	I: 78.3% F: 54.1%	< 0.001	-30.9

• I: initial exam; F: final exam; NI: not informed; dmfs: surface index of decayed deciduous teeth extracted, and restored due to caries; dmft: index of decayed deciduous teeth extracted, and restored due to caries; DMFT: index of permanent teeth decayed, removed, and restored due to caries
• ^*
  Criteria of Drury et al. (1999).

DISCUSSION

The results of this review show that educational interventions promote changes in behaviors related to oral health. The magnitudes of effect of the interventions for these outcomes were decreasing in the following order: frequent use of dental services, adequate oral hygiene, and reduction in the consumption of sweets. Evidence of effectiveness for some periodontal outcomes, such as dental plaque and calculus, is limited to only two studies^2,46, of reasonable quality, which have identified significant improvements. Although all educational interventions have observed a reduction in new lesions/cases of caries, only five studies, out of a total of 11, have reported these differences as significant. Among these five studies, only one was classified as with good methodological quality¹⁰.

The estimation of the magnitude of effects varied greatly between outcomes of the same category. Unlike other types of intervention, in which the outcome is estimated in terms of mortality rate or well-defined morbidity cut-off points, educational interventions have no ideal target parameter of change or magnitude of desired and relevant effect for public health. Studies could incorporate combined analyses about the benefits and associated costs or define the outcomes that represent the number of individuals to be treated for a favorable outcome. Approaches such as this contribute to reduce the existing limitation in the interpretation of the results of this type of intervention, as well as narrow the gaps between subjectivity and science.

The quality of the evidence of most studies was classified as poor/limited or reasonable. The main problems that led to this classification are related to: the type of design (before and after); insufficient description of the definition and validity of outcomes, especially outcomes of behavioral nature; lack of detail in the description of the interventions; lack of follow-up and fidelity in the implementation of protocols; high loss of follow-up and lack of reporting of the characteristics of the lost participants; lack of description of the population that originated the sample, as well as the criteria used in the selection; and lack of sample calculations and problems in the analysis and presentation of the results.

The positive effect on oral health behaviors may be an indication of the success of these interventions for disease prevention, since the first step in maintaining oral health is to build healthy behaviors. The great effect observed in the use of dental services reflects the result of interventions that linked strategies to facilitate access to the dentist, indicating the importance of interventions integrated to the health services for individuals. In this sense, the use of health services is not only an individual behavior, but a reflection of the context of professional practices and organization of services. Services that have a good organization of access and that work from an integrated health perspective increase the preventive use of the population. Individuals who use health services regularly have a greater opportunity to receive early diagnosis, acquire knowledge, and modify behaviors for their health, reducing the probability of developing health problems^4,56.

The measurement of hygiene behaviors and the consumption of sweets are carried out by self-reported questions, which are liable to errors of information. In addition, such behaviors are usually evaluated with questions that have limited validity⁶. These self-reported questions and the nature of the educational intervention may reflect the knowledge acquired rather than a real change in behavior. The use of measures or instruments valid to measure behaviors, as well as their combination with the evaluation of clinical outcomes, contribute to the understanding of the effects of these types of interventions.

In order to have positive effects on clinical outcomes for oral health, such as caries, some methodological aspects of the studies should be taken into account. The use of insufficient samples, the small number of contacts with the target population, and the follow-up time of less than 12 months may have led to the lack of effect in many of the studies. Evidence indicates that the time for caries progression varies according to age and it can be approximately 6 to 12 months in young children and 24 to 36 months in adults^18,50. However, in order to identify significant differences between groups, an appropriate sample calculation needs to be carried out, considering the number and size of clusters²⁵ in the case of community interventions. The research studies tended to present sample calculations without considering the level of clusters of the participants, limiting the internal validity of the findings^40,48.

The simple comparison of the groups by proportion and average tests does not ensure the significance of the results reported in the studies. With exception⁸, the studies did not present any evaluation of the rates of change and the relative effects of the interventions on the outcomes. The relative impacts of the interventions, calculated by us, are only estimates, in percentage terms, of the magnitude of the effects. The appropriate calculation of the measures of relative risk considers the rates of change in the groups, which depend on the time of follow-up and the number of individuals who started and finished the study. We suggest that future studies should consider these calculations in the evaluation of their results, presenting more real estimates of the effects of the interventions.

The dosage of the intervention, that is, the number of contacts with the target population, is another important factor for success in changing behaviors and consequent reduction of diseases. As discussed previously in the literature, educational interventions with at least four contacts with the target audience have a greater chance of success^7,30. The evidence found in this review does not make clear what would be the minimum number of contacts needed to observe the desired effects. The relation between dosage and effects varied widely and we could not detect these differences among the interventions.

The latest evidence available in the literature on the effectiveness of educational interventions^23,26, as well as this review, suggest the need for stricter scientific standards in monitoring interventions. In the studies evaluated in this review, we observed that the lack of evaluation of the implementation of interventions and the lack of clear theoretical models hindered the understanding of how interventions work or should work. Special attention should be given to the fidelity of the interventions, that is, to the extent to which an intervention adheres to the original model and its evaluation⁵². The greater the fidelity to the protocol of the intervention, the more positive is the result in the outcomes^5,36. The fidelity of an intervention can be measured by different methods: quantitative and qualitative strategies, specific model scales, checklists with the key elements of the intervention, interviews with professionals or patients, focus groups, patient records, video analysis of the intervention, and phone interviews⁵.

In summary, the results included in this systematic review are difficult to compare, i.e., the type of educational intervention that is most effective remains unclear, since protocols differ greatly among the studies. The types of educational approach presented great variability; however, we detected that interventions with more than one associated method (video session, printed leaflet with guidelines, verbal guidance, and brushing practices) showed significant improvements in the reduction of dental caries^10,42,58. However, more important than the pedagogical resource is the quality of the educational approaches, which should be customized according to the sociocultural context and preferably based on behavioral theories⁶⁰.

Educational interventions integrated to health services become relevant to strengthen health systems, as they increase the chance of sustainability and continued support, resulting in beneficial long-term effects⁶². However, to reach these results, educational approaches need to be qualified, as those used by most health professionals have been portrayed as being traditional in many of the studies analyzed. Approaches based only on the transmission of knowledge have been severely criticized, since they transfer to individuals the responsibility for their health, producing no or few effects⁶⁰. Educational approaches need to be appropriate not only to the individual aspects, but also to the social and interpersonal relations of the subjects.

Motivational Interviewing is a technique centered on and customized around the individual, seeking to assist him or her in the resolution of dilemmas and in the achievement of the necessary motivation for the change of health behaviors³⁷. It presents a collaborative, evocative character and it respects the autonomy of the individual. When done effectively, it increases the likelihood of the individual in engaging in behavioral change. It is an alternative to traditional approach, with evidences of effectiveness for several health areas^32,43. Regarding oral health, two systematic reviews have included a total of 18 studies investigating the effects of the Motivational Interviewing on oral health compared to the traditional educational approach (e.g., transmission of knowledge) or no approach^7,20. The evidence is inconclusive, since the studies report controversial results, varying between positive and zero effects for the prevention of caries and periodontal disease. Despite this, the authors optimistically interpreted the potential of this approach, since there is proven effectiveness in other areas. We recommended more methodological care regarding the design, monitoring, and evaluation of these interventions in future studies in order to improve the quality of the evidence^7,20.

The strengths of this review include the selection and evaluation of peer-reviewed articles, the inclusion of a standardized tool to evaluate the methodological quality of intervention studies, and the lack of another published review focusing on educational interventions integrated to health services, which reinforces the relevance of the results for public health. Among the limitations of this review, we can mention the non-inclusion of all existing databases and the impossibility of performing statistical synthesis using the meta-analysis given the methodological heterogeneity and the different target populations of the existing interventions.

We can conclude that the interventions performed by health professionals in the daily routine of their practice resulted in the improvement of behaviors related to oral health in most studies. All studies showed a reduction in new lesions/cases of caries, even if it was not always significant. Most studies were aimed at children; therefore, the evidence of the effectiveness of these interventions for other population groups is still unknown. In order to reinforce the evidence, future studies need to be carried out with adults and older adults, with higher methodological quality and theoretical background on the interventions, and better reporting in the publications and analysis of the results.

REFERENCES

• ¹ Alves GG, Aerts D. As práticas educativas em saúde e a Estratégia Saúde da Família. Cien Saude Colet 2011;16(1):319-25. https://doi.org/10.1590/S1413-81232011000100034
  » https://doi.org/10.1590/S1413-81232011000100034
• ² Blinkhorn AS, Gratrix D, Holloway PJ, Wainwright-Stringer YM, Ward SJ, Worthington HV. A cluster randomised, controlled trial of the value of dental health educators in general dental practice. Br Dent J 2003;195(7):395-400. https://doi.org/10.1038/sj.bdj.4810566
  » https://doi.org/10.1038/sj.bdj.4810566
• ³ Brown RM, Canham D, Cureton VY. An oral health education program for Latino immigrant parents. J Sch Nurs 2005;21(5):266-71. https://doi.org/10.1177/10598405050210050401
  » https://doi.org/10.1177/10598405050210050401
• ⁴ Camargo MB, Dumith SC, Barros AJ. [Regular use of dental care services by adults: patterns of utilization and types of services]. Cad Saude Publica 2009;25(9):1894-906. https://10.1590/S0102-311X2009000900004
  » https://10.1590/S0102-311X2009000900004
• ⁵ Campbell BK. Fidelity in public health clinical trials: considering provider-participant relationship factors in community treatment settings. J Public Health Dent 2011;71(1):64-5. https://doi.org/10.1111/j.1752-7325.2011.00227.x
  » https://doi.org/10.1111/j.1752-7325.2011.00227.x
• ⁶ Cascaes AM, Peres KG, Peres MA, Demarco FF, Santos I, Matijasevich A, et al. Validity of 5-year-old children's oral hygiene pattern referred by mothers. Rev Saude Publica 2011;45(4):668-75. https://doi.org/10.1590/S0034-89102011005000033
  » https://doi.org/10.1590/S0034-89102011005000033
• ⁷ Cascaes AM, Bielemann RM, Clark VL, Barros AJ. Effectiveness of motivational interviewing at improving oral health: a systematic review. Rev Saude Publica 2014;48(1):142-53. https://doi.org/10.1590/S0034-8910.2014048004616
  » https://doi.org/10.1590/S0034-8910.2014048004616
• ⁸ Chaffee BW, Feldens CA, Vitolo MR. Cluster-randomized trial of infant nutrition training for caries prevention. J Dent Res 2013;92(7):29-36. https://doi.org/10.1177/0022034513484331
  » https://doi.org/10.1177/0022034513484331
• ⁹ Cibulka NJ, Forney S, Goodwin K, Lazaroff P, Sarabia R. Improving oral health in low-income pregnant women with a nurse practitioner-directed oral care program. J Am Acad Nurse Pract 2011;23(5):249-57. https://doi.org/10.1111/j.1745-7599.2011.00606.x
  » https://doi.org/10.1111/j.1745-7599.2011.00606.x
• ¹⁰ Davies GM, Duxbury JT, Boothman NJ, Davies RM, Blinkhorn AS. A staged intervention dental health promotion programme to reduce early childhood caries. Community Dent Health 2005;22(2):118-22.
• ¹¹ Davies GM, Duxbury JT, Boothman NJ, Davies RM. Challenges associated with the evaluation of a dental health promotion programme in a deprived urban area. Community Dent Health 2007;24(2):117-21.
• ¹² Dermen KH, Ciancio SG, Fabiano JA. A pilot test of motivational oral health promotion with alcoholdependent inpatients. Health Psychol 2014;33(4):392-5. https://doi.org/10.1037/a0033153
  » https://doi.org/10.1037/a0033153
• ¹³ Dobarganes Coca AM, Lima Álvarez M, López Larquin N, Pérez Cedrón RA, González Vale L. Intervención educativa en salud bucal para gestantes. Arch Med Camaguey 2011;15(3):528-41. Available from: http://scielo.sld.cu/pdf/amc/v15n3/amc100311.pdf
  » http://scielo.sld.cu/pdf/amc/v15n3/amc100311.pdf
• ¹⁴ Dorling G, Fountaine T, McKenna S, Suresh B. Healthcare practice: the evidence for integrated care. McKinsey & Company; 2015.
• ¹⁵ Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health 1998;52(6):377-84. https://doi.org/10.1136/jech.52.6.377
  » https://doi.org/10.1136/jech.52.6.377
• ¹⁶ Ekstrand KR, Kuzmina IN, Kuzmina E, Christiansen ME. Two and a half-year outcome of cariespreventive programs offered to groups of children in the Solntsevsky district of Moscow. Caries Res 2000;34(1):8-19. https://doi.org/10.1159/000016564
  » https://doi.org/10.1159/000016564
• ¹⁷ Farias DG, Leal SC, de Toledo OA, Faber J, Bezerro AC. Effect of oral anticipatory guidance on oral health and oral hygiene practices in preschool children. J Clin Pediatr Dent 2005;30(1):23-7. https://doi.org/10.17796/jcpd.30.1.f09716417v202263
  » https://doi.org/10.17796/jcpd.30.1.f09716417v202263
• ¹⁸ Fejerskov O, Kidd E. Cárie Dentária: A Doença e seu Tratamento Clínico. 2ª ed. São Paulo: Santos; 2013.
• ¹⁹ Frazao P, Marques D. Effectiveness of a community health worker program on oral health promotion. Rev Saude Publica 2009;43(3):463-71. https://doi.org/10.1590/S0034-89102009005000016
  » https://doi.org/10.1590/S0034-89102009005000016
• ²⁰ Gao X, Lo EC, Kot SC, Chan KC. Motivational interviewing in improving oral health: a systematic review of randomized controlled trials. J Periodontol 2014;85(3):426-37. https://doi.org/10.1902/jop.2013.130205
  » https://doi.org/10.1902/jop.2013.130205
• ²¹ Gathece LW, Wang'ombe JK, Ng'ang'a PM, Wanzala PN. Effect of health education on knowledge and oral hygiene practices of persons living with HIV in Nairobi, Kenya. East Afr J Public Health 2011;8(3):207-11.
• ²² Gauba K, Goyal A, Mittal N. A CAMBRA Model For High Caries Risk Indian Children: A Pragmatic Comprehensive Tailored Intervention. J Clin Pediatr Dent 2016;40(1):36-43. https://doi.org/10.17796/1053-4628-40.1.36
  » https://doi.org/10.17796/1053-4628-40.1.36
• ²³ Habbu SG, Krishnappa P. Effectiveness of oral health education in children - a systematic review of current evidence (2005-2011). Int Dent J 2015;65(2):57-64. https://doi.org/10.1111/idj.12137
  » https://doi.org/10.1111/idj.12137
• ²⁴ Harrison RL, MacNab AJ, Duffy DJ, Benton DH. Brighter Smiles: Service learning, interprofessional collaboration and health promotion in a First Nations community. Can J Public Health 2006;97(3):237-40. https://doi.org/10.17269/cjph.97.730
  » https://doi.org/10.17269/cjph.97.730
• ²⁵ Hemming K, Taljaard M. Sample size calculations for stepped wedge and cluster randomised trials: a unified approach. J Clin Epidemiol 2016;69:137-46. https://doi.org/10.1016/j.jclinepi.2015.08.015
  » https://doi.org/10.1016/j.jclinepi.2015.08.015
• ²⁶ Kay EJ, Locker D. Is dental health education effective? A systematic review of current evidence. Community Dent Oral Epidemiol 1996;24(4):231-5. https://doi.org/10.1111/j.1600-0528.1996.tb00850.x
  » https://doi.org/10.1111/j.1600-0528.1996.tb00850.x
• ²⁷ Kowash MB, Pinfield A, Smith J, Curzon ME. Effectiveness on oral health of a long-term health education programme for mothers with young children. Br Dent J 2000;188(4):201-5. https://doi.or/10.1038/sj.bdj.4800431
  » https://doi.or/10.1038/sj.bdj.4800431
• ²⁸ Kuhn E, Wambier DS. Incidência de lesões de cárie em bebês após 15 meses de um programa educativo-preventivo. Pesqui Bras Odontopediatria Clin Integr 2007;7(1):75-81. https://doi.org/10.4034/1519.0501.2007.00711.0011
  » https://doi.org/10.4034/1519.0501.2007.00711.0011
• ²⁹ Larsen CD, Larsen MD, Ambrose T, Degano R, Gallo L, Cardo VA, Jr. Efficacy of a Prenatal Oral Health Program Follow-up with Mothers and their Children. N Y State Dent J 2016;82(3):15-20.
• ³⁰ Lemkuhl I, Souza MVC, Cascaes AM, Bastos JL. A efetividade das intervenções educativas em saúde bucal: revisão de literatura. Cad Saude Colet 2015;23(3):336-46. https://doi.org/10.1590/1414-462X201400030104
  » https://doi.org/10.1590/1414-462X201400030104
• ³¹ Listl S, Galloway J, Mossey PA, Marcenes W. Global Economic Impact of Dental Diseases. J Dent Res 2015;94(10):1355-61. https://doi.org/10.1177/0022034515602879
  » https://doi.org/10.1177/0022034515602879
• ³² Lundahl B, Moleni T, Burke BL, Butters R, Tollefson D, Butler C, et al. Motivational interviewing in medical care settings: a systematic review and meta-analysis of randomized controlled trials. Patient Educ Couns 2013;93(2):157-68. https://doi.org/10.1016/j.pec.2013.07.012
  » https://doi.org/10.1016/j.pec.2013.07.012
• ³³ Machado Ramos S, López Otero E, Torres Garri LI. Intervención educativa para elevar los conocimientos y modificar hábitos sobre salud bucal en embarazadas. Mediciego 2012;18(1):1-7. Available from: http://bvs.sld.cu/revistas/mciego/vol18_01_2012/articulos/t-7.html
  » http://bvs.sld.cu/revistas/mciego/vol18_01_2012/articulos/t-7.html
• ³⁴ Marcenes W, Kassebaum NJ, Bernabe E, Flaxman A, Naghavi M, Lopez A, et al. Global burden of oral conditions in 1990-2010: a systematic analysis. J Dent Res 2013;92(7):592-7. https://doi.org/10.1177/0022034513490168
  » https://doi.org/10.1177/0022034513490168
• ³⁵ Marinho VC, Higgins JP, Logan S, Sheiham A. Topical fluoride (toothpastes, mouthrinses, gels or varnishes) for preventing dental caries in children and adolescents. Cochrane Database Syst Rev 2003(4):CD002782. https://doi.org/10.1002/14651858.CD002782
  » https://doi.org/10.1002/14651858.CD002782
• ³⁶ McHugo GJ, Drake RE, Whitley R, Bond GR, Campbell K, Rapp CA, et al. Fidelity outcomes in the National Implementing Evidence-Based Practices Project. Psychiatr Serv 2007;58(10):1279-84. https://doi.org/10.1176/appi.ps.58.10.1279
  » https://doi.org/10.1176/appi.ps.58.10.1279
• ³⁷ Miller WR, Rose GS. Toward a theory of motivational interviewing. Am Psychol 2009;64(6):527-37. https://doi.org/10.1037/a0016830
  » https://doi.org/10.1037/a0016830
• ³⁸ Minah G, Lin C, Coors S, Rambob I, Tinanoff N, Grossman LK. Evaluation of an early childhood caries prevention program at an urban pediatric clinic. Pediatr Dent 2008;30(6):499-504.
• ³⁹ Mohebbi SZ, Virtanen JI, Vahid-Golpayegani M, Vehkalahti MM. A cluster randomised trial of effectiveness of educational intervention in primary health care on early childhood caries. Caries Res 2009;43(2):110-8. https://doi.org/10.1159/000209343
  » https://doi.org/10.1159/000209343
• ⁴⁰ Moher D, Dulberg CS, Wells GA. Statistical power, sample size, and their reporting in randomized controlled trials. JAMA 1994;272(2):122-4. https://doi.org/10.1001/jama.1994.03520020048013
  » https://doi.org/10.1001/jama.1994.03520020048013
• ⁴¹ Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009;6(7). https://doi.org/10.1371/journal.pmed.1000097
  » https://doi.org/10.1371/journal.pmed.1000097
• ⁴² Moskovitz M, Abud W, Ram D. The influence of an oral health education program provided in a community dental clinic on the prevalence of caries among 12-14 year-old children. J Clin Pediatr Dent 2009;33(3):259-64. https://doi.org/10.17796/jcpd.33.3.r3p7351l5x52737u
  » https://doi.org/10.17796/jcpd.33.3.r3p7351l5x52737u
• ⁴³ Palacio A, Garay D, Langer B, Taylor J, Wood BA, Tamariz L. Motivational Interviewing Improves Medication Adherence: a Systematic Review and Meta-analysis. J Gen Intern Med 2016;31(8):929-40. https://doi.org/10.1007/s11606-016-3685-3
  » https://doi.org/10.1007/s11606-016-3685-3
• ⁴⁴ Pereira MB, do Carmo Matias Freire M. An infant oral health programme in Goiania-GO, Brazil: results after 3 years of establishment. Braz Oral Res 2004;18(1):12-7. https://doi.org/10.1590/S1806-83242004000100003
  » https://doi.org/10.1590/S1806-83242004000100003
• ⁴⁵ Plutzer K, Spencer AJ. Efficacy of an oral health promotion intervention in the prevention of early childhood caries. Community Dent Oral Epidemiol 2008;36(4):335-46. https://doi.org/10.1111/j.1600-0528.2007.00414.x
  » https://doi.org/10.1111/j.1600-0528.2007.00414.x
• ⁴⁶ Raj S, Goel S, Sharma VL, Goel NK. Short-term impact of oral hygiene training package to Anganwadi workers on improving oral hygiene of preschool children in North Indian City. BMC Oral Health 2013;13(67):1472-6831. https://doi.org/10.1186/1472-6831-13-67
  » https://doi.org/10.1186/1472-6831-13-67
• ⁴⁷ Ramos-Gomez FJ, Shepard DS. Cost-effectiveness model for prevention of early childhood caries. J Calif Dent Assoc 1999;27(7):539-44.
• ⁴⁸ Schulz KF, Grimes DA. Sample size calculations in randomised trials: mandatory and mystical. Lancet 2005;365(9467):1348-53. https://doi.org/10.1016/S0140-6736(05)61034-3
  » https://doi.org/10.1016/S0140-6736(05)61034-3
• ⁴⁹ Sheiham A, James WP. A new understanding of the relationship between sugars, dental caries and fluoride use: implications for limits on sugars consumption. Public Health Nutr 2014;17(10):2176-84. https://doi.or/10.1017/S136898001400113X
  » https://doi.or/10.1017/S136898001400113X
• ⁵⁰ Shwartz M, Gröndahl HG, Pliskin JS, Boffa J. A longitudinal analysis from bite-wing radiographs of the rate of progression of approximal carious lesions through human dental enamel. Arch Oral Biol 1984;29(7):529-36. https://doi.org/10.1016/0003-9969(84)90074-8
  » https://doi.org/10.1016/0003-9969(84)90074-8
• ⁵¹ Si Y, Guo Y, Yuan C, Xu T, Zheng SG. Comprehensive Oral Health Care to Reduce the Incidence of Severe Early Childhood Caries (s-ECC) in Urban China. Chin J Dent Res 2016;19(1):55-63. https://doi.org/10.3290/j.cjdr.a35698
  » https://doi.org/10.3290/j.cjdr.a35698
• ⁵² Silva TFC. Assessing fidelity in psychosocial interventions: a systematic literature review. J Bras Psiquiatr 2014;63(3):260-71. https://doi.org/10.1590/0047-2085000000034
  » https://doi.org/10.1590/0047-2085000000034
• ⁵³ Solomon ES, Voinea-Griffin AE. Texas First Dental Home: A Snapshot after Five Years. Tex Dent J 2015;132(6):382-9.
• ⁵⁴ Strippel H. Effectiveness of structured comprehensive paediatric oral health education for parents of children less than two years of age in Germany. Community Dent Health 2010;27(2):74-80. https://doi.org/10.1922/CDH_2223Srtippel07
  » https://doi.org/10.1922/CDH_2223Srtippel07
• ⁵⁵ Twetman S. Prevention of early childhood caries (ECC)--review of literature published 1998-2007. Eur Arch Paediatr Dent 2008;9(1):12-8. https://doi.org/10.1007/BF03321590
  » https://doi.org/10.1007/BF03321590
• ⁵⁶ US Preventive Services Task Force, Grossman D, Bibbins-Domingo K, Curry S, Barry M, Davidson KW ea. Behavioral Counseling to Promote a Healthful Diet and Physical Activity for Cardiovascular Disease Prevention in Adults Without Cardiovascular Risk Factors: US Preventive Services Task Force Recommendation Statement. JAMA 2017;318(2):167-74. https://doi.org/10.1001/jama.2017.7171
  » https://doi.org/10.1001/jama.2017.7171
• ⁵⁷ Vachirarojpisan T, Shinada K, Kawaguchi Y. The process and outcome of a programme for preventing early childhood caries in Thailand. Community Dent Health 2005;22(4):253-9.
• ⁵⁸ Wagner Y, Greiner S, Heinrich-Weltzien R. Evaluation of an oral health promotion program at the time of birth on dental caries in 5-year-old children in Vorarlberg, Austria. Community Dent Oral Epidemiol 2014;42(2):160-9. https://doi.org/10.1111/cdoe.12072
  » https://doi.org/10.1111/cdoe.12072
• ⁵⁹ Watt RG. Strategies and approaches in oral disease prevention and health promotion. Bull World Health Organ 2005;83(9):711-8. https://doi.org/10.1111/j.1600-0528.2007.00348.x
  » https://doi.org/10.1111/j.1600-0528.2007.00348.x
• ⁶⁰ Watt RG. From victim blaming to upstream action: tackling the social determinants of oral health inequalities. Community Dent Oral Epidemiol 2007;35(1):1-11. https://doi.org/S0042-96862005000900018
  » https://doi.org/S0042-96862005000900018
• ⁶¹ Whittle JG, Whitehead HF, Bishop CM. A randomised control trial of oral health education provided by a health visitor to parents of pre-school children. Community Dent Health 2008;25(1):28-32. https://doi.org/10.1922/CDH_2143Whittle05
  » https://doi.org/10.1922/CDH_2143Whittle05
• ⁶² World Health Organization. Integrated health services - what and why. Geneva: WHO; 2008 [cited 2017 Nov 30]. (Technical Brief, 1). Available from: http://www.who.int/healthsystems/service_delivery_techbrief1.pdf
  » http://www.who.int/healthsystems/service_delivery_techbrief1.pdf

Publication Dates

• Publication in this collection
  2018

History

• Received
  09 Aug 2016
• Accepted
  06 Aug 2017