ABSTRACT
Objective
To assess the effect of an educational intervention program focused on health risk conditions, based on an assessment of the hygiene and quality of food sold in school cafeterias.
Methods
This is a controlled, parallel, randomized, two-arm, community study. Public and private schools with cafeterias were invited to participate. This study was conducted in 27 school cafeterias in northern and northwestern Rio Grande do Sul, a state in southern Brazil. Representatives of the school communities in the intervention group received an educational program consisting of 160-hour distance training. The most relevant outcomes were the assessment of the hygienic conditions and composition of the menus sold in school cafeterias. All outcomes were analyzed as intention-to-treat and per-protocol. For the analysis of continuous data with normal distribution, an analysis of covariance and the Generalized Linear Model were used. The level of statistical significance considered was p<0.05 for a 95% CI.
Results
No statistically significant difference was observed between the intervention group and the control group in the studied outcomes. There was a reduction of 76.2 points in the score for hygienic handling conditions (95% CI: -205 to 357; p=0.581). Regarding menu composition, the difference between groups was 0.48% (95% CI: -2.69 to 3.64; p=0.760) for ultra-processed foods, 0.23% (95% CI: -1.13 to 1.60; p=0.740) for processed foods, and 1.02% (95% CI: -2.59 to 4.64; p=0.581) for fresh foods.
Conclusion
There is not enough evidence to conclude that the intervention had a positive impact on any of the outcomes studied.
Keywords
Food and nutrition education; Nutrition policy; School feeding; School health services; Snacks
RESUMO
Objetivo
Avaliar o efeito de um programa de intervenção educacional nas condições de risco à saúde com base na avaliação das condições higiênicas e na qualidade dos alimentos comercializados em cantinas escolares.
Métodos
Este é um estudo comunitário, controlado, paralelo, randomizado, dois braços. As escolas de Ensino Fundamental e Médio, públicas e privadas, que possuíam cantinas, foram convidadas a participar. Este estudo foi realizado em 27 cantinas escolares do norte e noroeste do Rio Grande do Sul, sul do Brasil. Representantes da comunidade escolar das cantinas do grupo intervenção receberam um programa educacional composto por um treinamento a distância de 160 horas. Os principais desfechos avaliados foram avaliação das condições higiênicas e composição dos alimentos vendidos nas cantinas escolares. Todos os resultados foram analisados como intenção de tratar e per protocolo. Para análise dos dados contínuos, com distribuição normal, utilizou-se a análise de covariância e o Modelo Linear Generalizado. O nível de significância estatística considerado foi p<0,05 para um intervalo de confiança de 95%.
Resultados
Não foi observada diferença estatisticamente significativa entre o grupo intervenção e o grupo controle nos desfechos estudados. Houve redução de 76,2 pontos no escore das condições higiênicas de manipulação (IC 95%: -205 a 357; p=0,581). Em relação à composição dos cardápios, a diferença entre os grupos foi de 0,48% (IC 95%: -2,69 a 3,64; p=0,760) para os alimentos ultraprocessados, 0,23% (IC 95%: -1,13 a 1,60; p=0,740) para os alimentos processados e 1,02% (IC 95%: -2,59 a 4,64; p=0,581) para os alimentos in natura.
Conclusão
Não há evidências suficientes para concluir que a intervenção teve impacto positivo em nenhum dos desfechos estudados.
Palavras-chave
Educação alimentar e nutricional; Política nutricional; Alimentação escolar; Serviços de saúde escolar; Lanches
INTRODUCTION
According to data from the Global Burden of Disease Study, the prevalence of obesity doubled in more than 70 countries between 1980 and 2015, with a 112 million increase in overweight children [11 Malta DC, Felisbino-Mendes MS, Machado ÍE, Passos VMA, Abreu DMX, Ishitani LH, et al. Fatores de risco relacionados à carga global de doença do Brasil e Unidades Federadas, 2015. Rev Bras Epidemiol. 2017;217-232. https://doi.org/10.1590/1980-5497201700050018
https://doi.org/10.1590/1980-54972017000...
]. Likewise, in Brazil, evidence from a systematic review indicates that the prevalence of overweight and obesity in children is concerning [22 Pelegrini A, Bim MA, Souza FU, Kilim KSS, Pinto AA. Prevalence of overweight and obesity in Brazilian children and adolescents: a systematic review. Rev Bras Cineantropom. 2021;23:e80352. https://doi.org/10.1590/1980-0037.2021v23e80352
https://doi.org/10.1590/1980-0037.2021v2...
]. According to studies analyzed between 2018 and 2019, the incidence of overweight in children and adolescents grew from 8.8% to 22.2%, while obesity ranged from 3.8% to 24% [22 Pelegrini A, Bim MA, Souza FU, Kilim KSS, Pinto AA. Prevalence of overweight and obesity in Brazilian children and adolescents: a systematic review. Rev Bras Cineantropom. 2021;23:e80352. https://doi.org/10.1590/1980-0037.2021v23e80352
https://doi.org/10.1590/1980-0037.2021v2...
]. Moreover, children’s eating patterns tend to be rooted in diets that are dense in calories and low in nutrients, causing a positive energy imbalance and directly contributing to weight gain [33 Zarei N, Ahmadi A. Nutrition Transition: an intergenerational comparison of dietary habits among women of shiraz. Iran J Public Health. 2015 [cited 2020 Apr 9];44(2):269-275. Available from: https://pubmed.ncbi.nlm.nih.gov/25905062
https://pubmed.ncbi.nlm.nih.gov/25905062...
4 Santiago-Torres M, Adams AK, Carrel AL, LaRowe TL, Schoeller DA. Home food availability, parental dietary intake, and familial eating habits influence the diet quality of urban Hispanic children. Child Obes. 2014;10(5):408-415. https://doi.org/10.1089/chi.2014.0051
https://doi.org/10.1089/chi.2014.0051...
-55 Institute for Health Metrics and Evaluation. Global burden of disease data. Institute for Health Metrics and Evaluation. Seattle; 2015 [cited 2020 Sep 8]. Available from: http://www.healthdata.org/gbd/data
http://www.healthdata.org/gbd/data...
].
It is a consensus that schools are the ideal environment to promote healthy eating behaviors and prevent or reduce weight gain [66 World Health Organization. Report of the Commission on Ending Childhood Obesity. Geneva: Organization; 2016 [cited 2020 Mar 2]. Available from: http://www.who.int/end-childhood-obesity/publications/echo-report/en/
http://www.who.int/end-childhood-obesity...
7 Singh A, Bassi S, Nazar GP, Saluja K, Park M, Kinra S, et al. Impact of school policies on non-communicable disease risk factors: a systematic review. BMC Public Health. 2017;17(1):292. https://doi.org/10.1186/s12889-017-4201-3
https://doi.org/10.1186/s12889-017-4201-...
-88 Foster GD, Sherman S, Borradaile KE, Grundy KM, Vander Veur SS, Nachmani J, et al. A policy-based school intervention to prevent overweight and obesity. Pediatrics. 2008;121(4):e794-802. https://doi.org/10.1542/peds.2007-1365
https://doi.org/10.1542/peds.2007-1365...
]. Considering this appropriate scenario, the World Health Organization (WHO) recommends implementing policies and programs that promote a healthy environment at school, with control of the food sold in school cafeterias [66 World Health Organization. Report of the Commission on Ending Childhood Obesity. Geneva: Organization; 2016 [cited 2020 Mar 2]. Available from: http://www.who.int/end-childhood-obesity/publications/echo-report/en/
http://www.who.int/end-childhood-obesity...
,99 World Health Organization. School policy framework: implementation of the WHO global strategy on diet, physical activity and health. Genebra: Organization; 2008 [cited 2020 Sep 8]. Available from: https://apps.who.int/iris/handle/10665/43923
https://apps.who.int/iris/handle/10665/4...
].
In Brazil, access to food in schools can occur through school meals provided by the Programa Nacional de Alimentação Escolar (PNAE, Brazilian National School Feeding Program) as well as through school cafeterias, facilities within schools that aim at providing food upon payment. Despite the internationally documented constitution of government policies to reduce unhealthy food in school cafeterias [1010 Yoong SL, Nathan NK, Wyse RJ, Preece SJ, Williams CM, Sutherland RL, et al. Assessment of the school nutrition environment: a study in Australian primary school canteens. Am J Prev Med. 2015;49(2):215-222. https://doi.org/10.1016/j.amepre.2015.02.002
https://doi.org/10.1016/j.amepre.2015.02...
11 Chriqui J, Resnick E, Schneider L, Schermbeck R, Adcock T, Carrion V, et al. School District Wellness Policies: evaluating progress and potential for improving children’s health five years after the federal mandate. Chicago: Institute for Health Research and Policy; 2013 [cited 2020 Sep 8]. Available from: https://eric.ed.gov/?id=ED540415
https://eric.ed.gov/?id=ED540415...
-1212 Wolfenden L, Nathan N, Janssen L, Wiggers J, Reilly K, Delaney T, et al. Multi-strategic intervention to enhance implementation of healthy canteen policy: a randomised controlled trial. Implement Sci. 2017;12(1):6. http://dx.doi.org/10.1186/s13012-016-0537-9
https://doi.org/10.1186/s13012-016-0537-...
], their implementation in schools is limited [1212 Wolfenden L, Nathan N, Janssen L, Wiggers J, Reilly K, Delaney T, et al. Multi-strategic intervention to enhance implementation of healthy canteen policy: a randomised controlled trial. Implement Sci. 2017;12(1):6. http://dx.doi.org/10.1186/s13012-016-0537-9
https://doi.org/10.1186/s13012-016-0537-...
13 Fox MK, Gordon A, Nogales R, Wilson A. Availability and consumption of competitive foods in us public schools. J Am Diet Assoc. 2009;109(2):S57-66. https://doi.org/10.1016/j.jada.2008.10.063
https://doi.org/10.1016/j.jada.2008.10.0...
14 Nathan N, Yoong SL, Sutherland R, Reilly K, Delaney T, Janssen L, et al. Effectiveness of a multicomponent intervention to enhance implementation of a healthy canteen policy in Australian primary schools: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):106. http://dx.doi.org/10.1186/s12966-016-0431-5
https://doi.org/10.1186/s12966-016-0431-...
15 Gabriel CG, Vasconcelos FDAG, Andrade DF, Schmitz BAS. First Law regulating school canteens in Brazil: evaluation after seven years of implementation. Arch Latinoam Nutr. 2009 [cited 2020 May 8];59(2):128-138. Available from: http://ve.scielo.org/scielo.php?pid=S0004-06222009000200003&script=sci_abstract&tlng=en
http://ve.scielo.org/scielo.php?pid=S000...
16 Wognski ACP, Ponchek VL, Dibas EES, Orso MR, Vieira LP, Ferreira BGCS, et al. Comercialização de alimentos em cantinas no âmbito escolar. Brazilian J Food Technol. 2019;22:1-12. https://doi.org/10.1590/1981-6723.19818
https://doi.org/10.1590/1981-6723.19818...
-1717 Lawlis T, Knox M, Jamieson M. School canteens: a systematic review of the policy, perceptions and use from an Australian perspective. Nutr Diet. 2016;73(4):389-398. http://doi.wiley.com/10.1111/1747-0080.12279
https://doi.org/10.1111/1747-0080.12279...
].
Even after laws regulating the unhealthy food trade in schools have been approved, cafeterias continue to sell large amounts of ultra-processed foods rich in fat, sugar, and salt, offering fewer options for healthy food [1515 Gabriel CG, Vasconcelos FDAG, Andrade DF, Schmitz BAS. First Law regulating school canteens in Brazil: evaluation after seven years of implementation. Arch Latinoam Nutr. 2009 [cited 2020 May 8];59(2):128-138. Available from: http://ve.scielo.org/scielo.php?pid=S0004-06222009000200003&script=sci_abstract&tlng=en
http://ve.scielo.org/scielo.php?pid=S000...
,1616 Wognski ACP, Ponchek VL, Dibas EES, Orso MR, Vieira LP, Ferreira BGCS, et al. Comercialização de alimentos em cantinas no âmbito escolar. Brazilian J Food Technol. 2019;22:1-12. https://doi.org/10.1590/1981-6723.19818
https://doi.org/10.1590/1981-6723.19818...
,1818 O’Halloran S, Eksteen G, Gebremariam M, Alston L. Measurement methods used to assess the school food environment: a systematic review. Int J Environ Res Public Health. 2020;17(5):14-22. https://doi.org/10.1186/s12966-017-0477-z
https://doi.org/10.1186/s12966-017-0477-...
,1919 Finch M, Sutherland R, Harrison M, Collins C. Canteen purchasing practices of year 1-6 primary school children and association with SES and weight status. Aust N Z J Public Health. 2006;30(3):247-251. http://dx.doi.org/10.1111/j.1467-842X.2006.tb00865.x
https://doi.org/10.1111/j.1467-842X.2006...
]. Ultra-processed foods are very profitable and based on sophisticated marketing strategies designed for ready-to-eat products [2020 Santana MO, Guimarães JS, Leite FHM, Mais LA, Horta PM, Bortoletto Martins AP, et al. Analysing persuasive marketing of ultra-processed foods on Brazilian television. Int J Public Health. 2020;65(7):1067-1077. https://doi.org/10.1007/s00038-020-01456-6
https://doi.org/10.1007/s00038-020-01456...
]. Financial resources seem to limit the implementation of a healthy cafeteria, as owners report that the sale of healthy food items is low and generates little profit [1616 Wognski ACP, Ponchek VL, Dibas EES, Orso MR, Vieira LP, Ferreira BGCS, et al. Comercialização de alimentos em cantinas no âmbito escolar. Brazilian J Food Technol. 2019;22:1-12. https://doi.org/10.1590/1981-6723.19818
https://doi.org/10.1590/1981-6723.19818...
]. This is particularly concerning given that for each increase in the availability of unhealthy foods in school cafeterias by 1%, their purchase by schoolchildren increases by 1.67% [2121 Clinton-McHarg T, Janssen L, Delaney T, Reilly K, Regan T, Nathan N, et al. Availability of food and beverage items on school canteen menus and association with items purchased by children of primary-school age. Public Health Nutr. 2018;21(15):2907-2914. https://doi.org/10.1017/S1368980018001726
https://doi.org/10.1017/S136898001800172...
]. Furthermore, a direct association is observed between the proximity of facilities that sell unhealthy food items to schools and overweight and obesity in children and adolescents [2222 Peres CMC, Gardone DS, Costa BVL, Duarte CK, Pessoa MC, Mendes LL. Retail food environment around schools and overweight: a systematic review. Nutr Rev. 2020;78(10):841-856. https://doi.org/10.1093/nutrit/nuz110
https://doi.org/10.1093/nutrit/nuz110...
].
Food marketing in school cafeterias also requires control and monitoring for good handling practices in food production and sale. According to the Brazilian Ministry of Health, daycare centers and schools rank fifth in terms of the highest occurrence of foodborne disease outbreaks, compromising the safety of marketed food and limiting the potential impact of the implementation of healthy cafeterias [2323 Marinho GA, Oliveiraa GS, Lima JL, Lopes WMA, Nunes GA, Nunes MGA. Perfil epidemiológico das doenças transmitidas por alimentos e seus fatores causais na região da Zona da Mata Sul de Pernambuco. Cient Ciênc Biol Saúde. 2015;17:238-248.,1212 Wolfenden L, Nathan N, Janssen L, Wiggers J, Reilly K, Delaney T, et al. Multi-strategic intervention to enhance implementation of healthy canteen policy: a randomised controlled trial. Implement Sci. 2017;12(1):6. http://dx.doi.org/10.1186/s13012-016-0537-9
https://doi.org/10.1186/s13012-016-0537-...
].
Observational studies have shown an association between overweight children and adolescents and the presence of school cafeterias that promote unhealthy eating practices [11 Malta DC, Felisbino-Mendes MS, Machado ÍE, Passos VMA, Abreu DMX, Ishitani LH, et al. Fatores de risco relacionados à carga global de doença do Brasil e Unidades Federadas, 2015. Rev Bras Epidemiol. 2017;217-232. https://doi.org/10.1590/1980-5497201700050018
https://doi.org/10.1590/1980-54972017000...
,66 World Health Organization. Report of the Commission on Ending Childhood Obesity. Geneva: Organization; 2016 [cited 2020 Mar 2]. Available from: http://www.who.int/end-childhood-obesity/publications/echo-report/en/
http://www.who.int/end-childhood-obesity...
,2424 Food and Agriculture Organization of the United Nations. FAO School Food and Nutrition Framework. Roma: Organization; 2019 [cited 2020 Oct 10]. Available from: http://www.fao.org/3/ca4091en/ca4091en.pdf
http://www.fao.org/3/ca4091en/ca4091en.p...
]. Additionally, school cafeterias seem to facilitate access to industrialized/ultra-processed foods [1515 Gabriel CG, Vasconcelos FDAG, Andrade DF, Schmitz BAS. First Law regulating school canteens in Brazil: evaluation after seven years of implementation. Arch Latinoam Nutr. 2009 [cited 2020 May 8];59(2):128-138. Available from: http://ve.scielo.org/scielo.php?pid=S0004-06222009000200003&script=sci_abstract&tlng=en
http://ve.scielo.org/scielo.php?pid=S000...
,2525 Danelon MAS, Danelon MS, Silva MV. Serviços de alimentação destinados ao público escolar: análise da convivência do Programa de Alimentação Escolar e das cantinas. Seg Aliment Nutr. 2006;1:85-94. https://doi.org/10.20396/SAN.V13I1.1847
https://doi.org/10.20396/SAN.V13I1.1847...
,2626 Sturion GL, Silva MV, Ometto AMH, Furtuoso MCO, Pipitone MAP. Fatores condicionantes da adesão dos alunos ao Programa de Alimentação Escolar no Brasil. Rev Nutr. 2005;18:167-181. https://doi.org/10.1590/0102-311X00061016
https://doi.org/10.1590/0102-311X0006101...
]. Other research indicates that the sale of ultra-processed foods is more frequent in private school cafeterias [2727 Souza LBO, Azevedo ABC, Henrique D, Bandoni, Canella DS. Características do ambiente escolar relativas à alimentação e atividade física: PeNSE 2015. Rev Saude Publica. 2021;55:e115. https://doi.org/10.11606/s1518-8787.2021055003377
https://doi.org/10.11606/s1518-8787.2021...
,2828 Carmo AS, Assis MM, Cunha CF, Oliveira TRPR, Mendes LL. The food environment of Brazilian public and private schools. Cad Saude Publica. 2018;34:e00014918. https://doi.org/10.1590/0102-311x00014918
https://doi.org/10.1590/0102-311x0001491...
], where the most commercialized items were candies, sweets, and the like (76.2%), followed by sweetened beverages (68.0%) and packaged snacks (57.7%) [2727 Souza LBO, Azevedo ABC, Henrique D, Bandoni, Canella DS. Características do ambiente escolar relativas à alimentação e atividade física: PeNSE 2015. Rev Saude Publica. 2021;55:e115. https://doi.org/10.11606/s1518-8787.2021055003377
https://doi.org/10.11606/s1518-8787.2021...
]. Contributing to these studies, Australian research reinforces that the price of food sold in school cafeterias favors the purchase of less healthy foods, which are usually cheaper [2929 Billich N, Adderley M, Ford L, Keeton I, Palermo C, Peeters A, et al. The relative price of healthy and less healthy foods available in Australian school canteens. Health Promot Int. 2018;34(4):677-686. https://doi.org/10.1093/heapro/day025
https://doi.org/10.1093/heapro/day025...
]. Given these findings and the potential contribution of educational intervention programs in school cafeterias for promoting healthy and safe eating habits, this research is justified.
Faced with international calls for the prevention of overweight and the promotion of a healthy environment at schools [66 World Health Organization. Report of the Commission on Ending Childhood Obesity. Geneva: Organization; 2016 [cited 2020 Mar 2]. Available from: http://www.who.int/end-childhood-obesity/publications/echo-report/en/
http://www.who.int/end-childhood-obesity...
,99 World Health Organization. School policy framework: implementation of the WHO global strategy on diet, physical activity and health. Genebra: Organization; 2008 [cited 2020 Sep 8]. Available from: https://apps.who.int/iris/handle/10665/43923
https://apps.who.int/iris/handle/10665/4...
], a review presented by WHO found positive effects for nutrition education interventions using various components and approaches, such as diets, physical activity, education on nutrition, and environmental change. There are also positive results related to actions raising awareness of the entire school community and involving parents. The research also reports that many of the studies are based on cross-sectional data and are unable to measure the effect of the studies [3030 World Health Organization. Nutrition action in schools: a review of the evidence related to the nutrition-friendly schools initiative. Geneve: Organization; 2020. Available from: https://www.who.int/publications/i/item/9789241516969
https://www.who.int/publications/i/item/...
].
As the first randomized controlled trial conducted in Brazilian school cafeterias, this trial presents a new contribution to scientific literature. In this context, we aimed to assess the effect of an educational intervention program on health risks and the quality of food sold in school cafeterias.
METHODS
This is a controlled, parallel, randomized, [1: 1 ratio], two-arm study, conducted in accordance with the recommendations of the Consolidated Standards of Reporting Trials (CONSORT) [3131 Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869. https://doi.org/10.1136/bmj.c869
https://doi.org/10.1136/bmj.c869...
] and the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) [3232 Chan A-W, Tetzlaff JM, Gøtzsche PC, Altman DG, Mann H, Berlin JA, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586. https://doi.org/10.1136/bmj.e7586
https://doi.org/10.1136/bmj.e7586...
]. The protocol details were published in the JMIR Research Protocols [3333 Balestrin M, Brasil CCB, Bellei EA, Kirsten VR, Wagner MB. Program for healthier school cafeterias in Rio Grande do Sul, Brazil: protocol for a community-based randomized trial. JMIR Res Protoc. 2021;10(1):e22680. https://doi.org/10.2196/22680
https://doi.org/10.2196/22680...
].
The study was carried out at school cafeterias in cities in the northern and northwestern regions of Rio Grande do Sul, a state in southern Brazil. The regions comprise 36 municipalities, 17 of which have less than 5,000 inhabitants and are in a situation of social vulnerability [3434 Deckert CT. A Gestão social no território da cidadania noroeste colonial do Rio Grande do Sul [dissertation]. Ijuí: Universidade Regional do Noroeste do Estado do Rio Grande do Sul; 2012 [cited 2020 Aug 5]. Available from: http://bibliodigital.unijui.edu.br:8080/xmlui/handle/123456789/1906
http://bibliodigital.unijui.edu.br:8080/...
35 Deckert CT, Allebrandt SL. A efetividade da cidadania no programa Territórios da Cidadania: um estudo de caso do noroeste colonial do Rio Grande do Sul. Amaz Organ Sustentabilidade. 2013;2(2):8238-8893. http://dx.doi.org/10.17800/2238-8893/aos.v2n2p139-152
https://doi.org/10.17800/2238-8893/aos.v...
-3636 Deckert CT. Configuração do poder no Codeter: uma análise do Território da Cidadania Noroeste Colonial-RS. Redes. 2017;22(1):402-429. https://doi.org/10.17058/redes.v22i1.5259
https://doi.org/10.17058/redes.v22i1.525...
].
The calculation of the sample size was based on primary outcomes. For a significance level of 5% and statistical power of 80% in detecting an effect magnitude (d) of 1.1, 27 cafeterias were estimated (14 for the intervention group and 13 for the control group). The estimated sample needed to achieve the study objectives was based on the study by Nathan et al. [3737 Nathan N, Yoong SL, Sutherland R, Reilly K, Delaney T, Janssen L, et al. Effectiveness of a multicomponent intervention to enhance implementation of a healthy canteen policy in Australian primary schools: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):c106. http://dx.doi.org/10.1186/s12966-016-0431-5
https://doi.org/10.1186/s12966-016-0431-...
]. The sample size was calculated with the program Power and Sample Size Calculations, version 3.1.
The definition of the sample was carried out through the website of the Education Department of Rio Grande do Sul and standardized telephone calls. Public and private schools with cafeterias that accepted to participate in the research by signing the Informed Consent Form were included.
After collecting data at baseline, randomization was performed by minimization in the 1:1 ratio. To maintain a balance between the groups and avoid the occurrence of disproportionate distribution, four predictors of interest for allocation were considered: city; cafeteria administration (self-managed vs. outsourced); scope (public vs. private;) and number of students (less than 500 students vs. greater than or equal to 500 students).
Minimization was performed by an independent researcher with the statistical software IBM®SPSS® Statistics for Windows version 26.0 (IBM Corp., Armonk, NY, USA). The cafeterias were randomly assigned to an intervention group and a control group.
As this is an educational intervention, the researchers responsible for administering the interventions and assessing the outcomes could not be blinded. Thus, to avoid contamination between groups, blinding was performed by a statistician responsible for the data analysis.
The schools in the intervention group were invited to participate in the program Cantina Saudável: a gente apoia essa ideia! (Healthy cafeteria: we support this idea!) in Brazilian Portuguese), which consisted of a 160-hour distance-learning training course. The intervention lasted ten weeks, with a weekly workload of 16 hours. The course was made available on Moodle, with access provided by the Universidade Federal de Santa Maria (Federal University of Santa Maria), and through exclusive groups on WhatsApp®.
The course was prepared in 8 units (Table 1), each with expository classes, texts, videos, practical activities, and discussion forums. The material was based on the Healthy Cafeterias School Manual: promoting healthy eating, developed by the Brazilian Ministry of Health [3838 Ministério da Saúde (Brasil). Manual das cantinas escolares saudáveis: promovendo a alimentação saudável. Brasília: Ministerio; 2010.], updated according to new nutritional recommendations and guiding resolutions for food marketing in school cafeterias [3939 Rio Grande do Sul. Lei no 15.216, de 30 de julho de 2018. Dispõe sobre a promoção da alimentação saudável e proíbe a comercialização de produtos que colaborem para a obesidade, diabetes, hipertensão, em cantinas e similares instalados em escolas públicas e privadas do Estado do Rio Grande do Sul. Porto Alegre: Governo do Estado; 2018 [cited 2020 Aug 5]. Available from: https://leisestaduais.com.br/rs/lei-ordinaria-n-15216-2018-rio-grande-do-sul-dispoe-sobre-a-promocao-da-alimentacao-saudavel-e-proibe-a-comercializacao-de-produtos-que-colaborem-para-a-obesidade-diabetes-hipertensao-em-cantinas-e-similares-instalados-em-e
https://leisestaduais.com.br/rs/lei-ordi...
40 Ministério da Sáide (Brasil). Guia alimentar para a população brasileira. Brasília: Ministério; 2014.-4141 Ministério da Saúde (Brasil). Guia alimentar para a população brasileira: versão resumida. Brasil: Ministério; 2018.]. Details on the components of each unit can be viewed in the study protocol [3333 Balestrin M, Brasil CCB, Bellei EA, Kirsten VR, Wagner MB. Program for healthier school cafeterias in Rio Grande do Sul, Brazil: protocol for a community-based randomized trial. JMIR Res Protoc. 2021;10(1):e22680. https://doi.org/10.2196/22680
https://doi.org/10.2196/22680...
].
Components of the course Healthy cafeteria: we support this idea! Rio Grande do Sul (RS), Brazil, 2019.
This intervention targeted cafeteria owners and managers, food handlers, principals, vice-principals, teachers, pedagogical coordinators, nutritionists, students’ parents, and students over 16 years old. The units became available in stages so that the weekly workload was scheduled as previously planned. In addition, the modules were available until the end of the course, and most course activities did not require meeting fixed hours and deadlines. The flexibility of distance learning allowed participants to adapt their studies according to their routines. No payments or refunds were made for cafeterias and schools to participate in the study, as local law does not allow individuals to participate in research for remuneration.
To minimize the sample’s segment loss, maintain consistency in implementation, and assist in the execution of the agreed actions, the intervention group received two telephone calls (in the 4th and 7th weeks), periodic incentives with weekly motivational messages, and access to a tutor throughout the intervention via Moodle and WhatsApp®.
The control group did not receive the intervention. However, the intervention and control group schools received a printed copy of the Healthy Cafeteria School Manual: promoting healthy eating after collecting baseline data [3838 Ministério da Saúde (Brasil). Manual das cantinas escolares saudáveis: promovendo a alimentação saudável. Brasília: Ministerio; 2010.].
The two groups received feedback two times via email about the results found in data collection (initial and final), with specific details about the cafeterias’ compliance with legislation [3939 Rio Grande do Sul. Lei no 15.216, de 30 de julho de 2018. Dispõe sobre a promoção da alimentação saudável e proíbe a comercialização de produtos que colaborem para a obesidade, diabetes, hipertensão, em cantinas e similares instalados em escolas públicas e privadas do Estado do Rio Grande do Sul. Porto Alegre: Governo do Estado; 2018 [cited 2020 Aug 5]. Available from: https://leisestaduais.com.br/rs/lei-ordinaria-n-15216-2018-rio-grande-do-sul-dispoe-sobre-a-promocao-da-alimentacao-saudavel-e-proibe-a-comercializacao-de-produtos-que-colaborem-para-a-obesidade-diabetes-hipertensao-em-cantinas-e-similares-instalados-em-e
https://leisestaduais.com.br/rs/lei-ordi...
].
The research was developed in three phases. Phase 1 comprised baseline data collection; Phase 2 was the conduction of the program Healthy Cafeteria: we support this idea!, lasting ten weeks; Phase 3 was the final data collection immediately after the end of the intervention. The study took place from March to December 2019.
Baseline data related to school and cafeteria characteristics were collected before randomization. A face-to-face interview, with the aid of a questionnaire with structured questions, was applied to the school principal and/or cafeteria owner. The instrument was elaborated based on studies conducted by Giacomelli (2014) [4242 Giacomelli SC. Avaliação e promoção de boas práticas em cantinas escolares [dissertation]. Santa Maria: Universidade Federal de Santa Maria; 2014 [cited 2020 Jul 8]. Available from: https://repositorio.ufsm.br/handle/1/5763
https://repositorio.ufsm.br/handle/1/576...
] and Porto (2011) [4343 Porto E. Perfil das cantinas escolares do Distrito Federal [dissertation]. Brasília: Universidade de Brasília; 2011 [cited 2020 Aug 9]. Available from: https://repositorio.unb.br/handle/10482/10036
https://repositorio.unb.br/handle/10482/...
].
The researchers responsible for the data collection were trained and received a standardized guidance manual on data collection. Data entry was performed using the Cafeterias Survey mobile application, developed for research, which assisted in information collection, analysis, interpretation, and follow-up. Through the application, data were stored in a database exported to Microsoft Excel®. The National Institute of Industrial Property granted software registration under number BR512019002503-2.
For the data collection regarding hygienic conditions of food handling in school cafeterias, a validated instrument developed from Ordinance 817 of May 10, 2013, was used [4444 Agência Nacional de Vigilância Sanitária. Categorização dos serviços de alimentação: elaboração e avalição da lista de avaliação. Brasília: Agência; 2013.
45 Cunha DT, Saccol ALF, Tondo EC, Oliveira ABA, Ginani VC, Araújo CV, et al. Inspection score and grading system for food services in Brazil: the results of a food safety strategy to reduce the risk of foodborne diseases during the 2014 FIFA World Cup. Front. Microbiol. 2016;7:e614. https://doi.org/10.3389/fmicb.2016.00614
https://doi.org/10.3389/fmicb.2016.00614...
-4646 Cunha DT, Oliveira ABA, Saccol ALF, Tondo EC, Silva EA, Ginani VC, et al. Food safety of food services within the destinations of the 2014 FIFA World Cup in Brazil: development and reliability assessment of the official evaluation instrument. Food Res Int. 2014;57:95-103. https://doi.org/10.1016/j.foodres.2014.01.021
https://doi.org/10.1016/j.foodres.2014.0...
]. The questionnaire scores items based on risk criteria to identify those that directly impact food quality and consumers’ health [4747 Agência Nacional de Vigilância Sanitária. Categorização dos serviços de alimentação: elaboração e avalição da lista de avaliação. Brasília: Agência; 2013.,4848 Ministério da Saúde (Brasil). Portaria no 817, de 10 de maio de 2013. Aprova as diretrizes nacionais para a elaboração e execução do projeto-piloto de categorização dos serviços de alimentação para a Copa do Mundo FIFA 2014. Brasília: Ministério; 2013 [cited 2020 Aug 5]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2013/prt0817_10_05_2013.html
http://bvsms.saude.gov.br/bvs/saudelegis...
].
This legislation is composed of 51 items from 9 categories, namely: water supply; building structure; cleaning of facilities, equipment, furniture, and utensils; control of vectors and urban pests; food handlers; raw material, ingredients, and packaging; food preparation; storage, transport, and display of prepared food; liability, documentation, and registration.
The score is attributed when the assessed facility does not fulfill some of the requested requirements, representing the importance of foodborne diseases prevention. Health risk assessment concerning good handling practices consists of a continuous scoring system ranging from zero (least severe) to 2,498.89 (most severe). The score is awarded when the assessed facility does not meet one or more of the requested requirements. Thus, the higher the score, the greater the number of non-conformities verified and the worse the facility’s performance [4444 Agência Nacional de Vigilância Sanitária. Categorização dos serviços de alimentação: elaboração e avalição da lista de avaliação. Brasília: Agência; 2013.]. The assessment was carried out by a trained nutritionist through on-site observation [4747 Agência Nacional de Vigilância Sanitária. Categorização dos serviços de alimentação: elaboração e avalição da lista de avaliação. Brasília: Agência; 2013.,4949 Verdum DCP, Selva JP, Copatti F, Batista M, Pereira LS, Kirsten VR, et al. Condições higiênico-sanitárias das cantinas escolares da rede estadual de ensino no município de Palmeira das Missões, Rio Grande do Sul. Vigil Sanit Debate. 2017;5(4):17-23. https://doi.org/10.22239/2317-269x.00960
https://doi.org/10.22239/2317-269x.00960...
].
The assessment of menu composition in school cafeterias was determined by the frequency of all items available for sale, which were grouped according to the NOVA food classification [4040 Ministério da Sáide (Brasil). Guia alimentar para a população brasileira. Brasília: Ministério; 2014.,5050 Monteiro CA, Levy RB, Claro RM, Castro IRR, Cannon G. A new classification of foods based on the extent and purpose of their processing. Cad Saude Publica. 2010;26(11):2039-2049. https://doi.org/10.1590/S0102-311X2010001100005
https://doi.org/10.1590/S0102-311X201000...
]. The frequency of foods was assessed according to the NOVA classification (Table 2). Afterward, the percentage of each group was calculated concerning the total foods items in each school cafeteria.
An adapted version of these references was used for this research, as can be seen in Table 2. The assessment was based on similar Australian studies that evaluated menu composition based on the frequency of available items, classified according to food traffic light colors [5151 Williams CM, Nathan N, Delaney T, Yoong SL, Wiggers J, Preece S, et al. CAFE: a multicomponent audit and feedback intervention to improve implementation of healthy food policy in primary school canteens: protocol of a randomised controlled trial. BMJ Open. 2015;5(6):e006969. http://dx.doi.org/10.1136/bmjopen-2014-006969
https://doi.org/10.1136/bmjopen-2014-006...
,5252 Wolfenden L, Nathan N, Williams CM, Delaney T, Reilly KL, Freund M, et al. A randomised controlled trial of an intervention to increase the implementation of a healthy canteen policy in Australian primary schools: study protocol. Implement Sci. 2014;9:147. https://doi.org/10.1186/s13012-014-0147-3
https://doi.org/10.1186/s13012-014-0147-...
].
Classification of menu items according to the NOVA classification. Rio Grande do Sul (RS), Brazil, 2019.
The assessment was carried out by two properly trained nutritionists; in case of divergence, a third nutritionist was consulted. To assist in item classification, for each food or drink present, information such as the name, brand of food or drink sold, production (homemade or industrial), and list of ingredients was also collected.
To assess the impact of the intervention on the quality of the food in school cafeterias, a score was developed for each cafeteria, calculated based on the frequency of each type of food available for sale, according to the NOVA food classification, proposed by Brasil (2014) [4040 Ministério da Sáide (Brasil). Guia alimentar para a população brasileira. Brasília: Ministério; 2014.] and Monteiro et al. (2010) [5050 Monteiro CA, Levy RB, Claro RM, Castro IRR, Cannon G. A new classification of foods based on the extent and purpose of their processing. Cad Saude Publica. 2010;26(11):2039-2049. https://doi.org/10.1590/S0102-311X2010001100005
https://doi.org/10.1590/S0102-311X201000...
]. The score details were published in the JMIR Research Protocols [3333 Balestrin M, Brasil CCB, Bellei EA, Kirsten VR, Wagner MB. Program for healthier school cafeterias in Rio Grande do Sul, Brazil: protocol for a community-based randomized trial. JMIR Res Protoc. 2021;10(1):e22680. https://doi.org/10.2196/22680
https://doi.org/10.2196/22680...
].
An equation (1) was used to calculate the score regarding food quality in school cafeterias. In It, Finnat means the frequency of fresh foods, minimally processed foods, and culinary preparations without the addition of culinary ingredients; Fprocess means the frequency of processed foods and culinary preparations with culinary ingredients; Fultra means the frequency of ultra-processed foods; N means the total number of items sold in the cafeteria. The score ranges from zero to 100 points. Higher scores reflect superior food quality in facilities.
All outcomes were assessed as Intention-To-Treat (ITT) and Per Protocol (PP). The missing results were included in an analysis using the Last Observation Carried Forward approach [3131 Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869. https://doi.org/10.1136/bmj.c869
https://doi.org/10.1136/bmj.c869...
]. For the analysis of continuous data with normal distribution, covariance analysis (ANCOVA) and the Generalized Linear Model with gamma function for variables with asymmetric distribution were used.
The outcomes were evaluated by comparing the differences in scores between groups in the post-test, adjusted by baseline measure. Data were analyzed using IBM®SPSS® Statistics for Windows, version 26.0 (IBM Corp., Armonk, NY, USA). The level of statistical significance considered was P <0.05 for a 95% confidence interval. All the hypotheses and analytic plans were specified before the data collection, the analytic plan was pre-specified, and any data-driven analyses were clearly identified and discussed appropriately.
The Research Ethics Committee of the Universidade Federal do Rio Grande do Sul (UFRGS, Federal University of Rio Grande do Sul) approved this project, under process nº 89504618.9.0000.5347, which was registered with the Brazilian Platform of Clinical Trials under the code RBR-9rrqhk, on April 30, 2018 (U1111 -1213-1614). To carry out the study, participants authorized their participation by signing the Informed Consent Form.
RESULTS
Between June 2018 and February 2019, 337 schools were assessed for eligibility. Of these, 216 schools reported over the phone that they did not have a cafeteria, 83 schools did not respond to three phone call attempts, seven cafeterias had been shut down, and four did not sign the Informed Consent Form. Thus, of the 27 cafeterias included in the sample, 14 were allocated to the intervention group and 13 to the control group, according to the CONSORT flowchart that describes the progress of the participating schools during the study (Figure 1).
CONSORT flowchart describing the progress of participating schools. Rio Grande do Sul (RS), Brazil, 2019.
There were no differences between baseline characteristics of the participating schools and cafeterias in the intervention group and the control group (Table 3).
Baseline characteristics of participating schools and cafeterias by group. Rio Grande do Sul (RS), Brazil, 2019.
The ITT analyses showed that there was no difference between the intervention and the control group regarding any of the studied outcomes. The effect observed in the intervention group was not statistically different from the effect in the control group. Similar results were found in the population that complied with the protocol until the end (PP) (Table 4).
Effect of intervention on the hygienic conditions of food handling, menu composition, and food quality of school cafeterias, intention-to-treat and per protocol analysis. Rio Grande do Sul (RS), Brazil, 2019.
There was an improvement in the performance of school cafeterias concerning hygienic handling conditions, with a slight reduction in the assessed score. However, there was no statistically significant difference in the change in the score of hygienic conditions between groups.
Despite the lack of significant results, a modest reduction in the score of hygienic handling conditions was observed after the intervention. The absolute changes in the categories were calculated and compared between the intervention and control groups, and no statistically significant differences were found. The scores concerning the structures, food preparation and storage, transport, and display of prepared food categories had a reduction, but this difference was not statistically significant (p=0.181; p=0.624 and p=0.678, respectively). The categories with the worst results were food handlers and water supply (p=0.999 and p=0.970, respectively).
Likewise, the assessment of menu composition and food quality scores in school cafeterias did not have a statistically significant effect between groups. However, in general, there was an improvement in the outcomes from pre- to post-intervention, both in the intervention group and in the control group. This improvement, regardless of the Healthy Cafeteria: we support this idea! course, resulted in a non-significant difference.
When assessing food supply according to the type of processing, it was also observed that the two groups had high levels of ultra-processed foods compared to processed and fresh foods, both in baseline assessment and follow-up.
The results show a low quality of the food supply in the assessed school cafeterias, with very high levels of ultra-processed foods compared to processed and fresh foods. There was an improvement in food quality indicators, with a minimal drop in ultra-processed food marketing, a modest increase in fresh food marketing, and a little increase in school cafeterias’ food quality scores.
DISCUSSION
This is the first randomized controlled trial carried out in Brazil that assessed the effect of an educational intervention program on improving hygienic handling conditions and the quality of food offered in Brazilian cafeterias. This study was designed to favor the implementation of healthy school cafeterias in southern Brazil [5353 Rio Grande do Sul. Decreto no 54.994, de 17 de janeiro de 2020. Regulamenta a Lei nº 15.216, de 30 de julho de 2018, que dispõe sobre a promoção da alimentação saudável e proíbe a comercialização de produtos que colaborem para a obesidade, diabetes e hipertensão em cantinas e similares instalados em escolas públicas e privadas do Estado do Rio Grande do Sul. Porto Alegre: Governo do Estado; 2020 [cited 2020 Aug 5]. Available from: http://www.al.rs.gov.br/filerepository/repLegis/arquivos/DEC 54.994.pdf
http://www.al.rs.gov.br/filerepository/r...
,5454 Rio Grande do Sul. Lei no 13.027, de 16 de agosto de 2008. Dispõe sobre a comercialização de lanches e de bebidas em escolas no âmbito do estado do Rio Grande do Sul e dá outras providências. Porto Alegre: Governo do Estado; 2008 [cited 2020 Aug 5]. Available from: https://leisestaduais.com.br/rs/lei-ordinaria-n-13027-2008-rio-grande-do-sul-dispoe-sobre-a-comercializacao-de-lanches-e-de-bebidas-em-escolas-no-ambito-do-estado-do-rio-grande-do-sul-e-da-outras-providencias
https://leisestaduais.com.br/rs/lei-ordi...
].
The results suggest a reduced effect of the distance education intervention involving cafeteria workers and part of the school community, even with the researchers’ monitoring through motivational encouragement and phone and text message support. Although not significant enough to characterize a difference between the groups, there was a modest increase in the hygienic quality indicators of good handling practices, the composition of marketed menus, and food quality in the school cafeterias after the intervention.
This improvement trend, observed in both groups, can be explained by the effect of participation in the study. Going to the schools, visiting, talking to the school community about the topic, and providing feedback and printed technical manuals seem to mobilize and motivate the school community to implement healthier school cafeterias.
The study’s results also suggest the low quality of Brazilian school cafeterias’ food supply, with very high levels of ultra-processed foods compared to processed and fresh foods. Unhealthy food marketing persists in schools in Brazil, and the criteria established in legislation are currently not able to ensure the marketing of adequate and healthy food [5555 Horta RL, Andersen CS, Pinto RO, Horta BL, Oliveira-Campos M, Andreazzi MAR, et al. Health promotion in school environment in Brazil. Rev Saude Publica. 2017;51:e06709. https://doi.org/10.1590/s1518-8787.2017051006709
https://doi.org/10.1590/s1518-8787.20170...
].
Additionally, the study showed low hygienic quality in handling food in the assessed cafeterias. Most facilities were classified as having unacceptable hygiene practices (scores greater than or equal to 1,152.3) pre- and post-intervention. Although training can improve knowledge about the proper procedures, studies show that it does not guarantee a change in practices and behaviors concerning food safety [5656 Clayton ML, Clegg Smith K, Neff RA, Pollack KM, Ensminger M. Listening to food workers: Factors that impact proper health and hygiene practice in food service. Int J Occup Environ Health. 2015;21(4):314-327. https://doi.org/10.1179/2049396715Y.0000000011
https://doi.org/10.1179/2049396715Y.0000...
,5757 Green L, Selman C, Banerjee A, Marcus R, Medus C, Angulo FJ, et al. Food service workers’ self-reported food preparation practices: an EHS-Net study. Int J Hyg Environ Health. 2005;208(1-2):27-35. https://doi.org/10.1016/j.ijheh.2005.01.005
https://doi.org/10.1016/j.ijheh.2005.01....
].
Food handlers’ attitudes are discussed from several perspectives: optimistic bias; cognitive illusions; low-risk perception; and lack of managers to measure practices [5858 Ricke SC, Donaldson JR, Phillips CA. Food safety emerging issues, technologies, and systems. Cambridge: Academic Press; 2015.
59 Freitas RSG, Cunha DT, Stedefeldt E. Food safety knowledge as gateway to cognitive illusions of food handlers and the different degrees of risk perception. Food Res Int. 2019;116:126-134. https://doi.org/10.1016/j.foodres.2018.12.058
https://doi.org/10.1016/j.foodres.2018.1...
-6060 Cunha DT, Rosso VV, Stedefeldt E. Food safety performance and risk of food services from different natures and the role of nutritionist as food safety leader. Cien Saude Colet. 2018;23:4033-4042. https://doi.org/10.1590/1413-812320182312.21042016
https://doi.org/10.1590/1413-81232018231...
]. Optimistic bias is directly linked to a feeling of competence that may prevent the correction of an error, which could have been avoided without the conviction of protection of the error itself [6161 Madeira M, Ferrão MEM. Alimentos conforme a lei. São Paulo: Manole; 2002.].
The course was made available to the 14 schools in the intervention group, with 71 course participants. In 4 schools, there was no participation of other school community representatives in addition to cafeteria owners/managers (principals, vice-principals, food handlers, teachers, pedagogical coordinators, students’ parents, and students over 16 years old), which helps explain the results of the research. The non-standardization of the number of participants per school, which would provide a better understanding of the intervention’s effect, is a limitation of the study. This reinforces the relevance of involving the entire school community (cafeteria owners, food handlers, teachers, principals, students, etc.) to ensure that food safety-related actions are carried out in food services. To the best of our knowledge, no previous study has assessed the effect of interventions on the hygienic conditions of food handling in school cafeterias.
The results of this research are comparable to those of Yoong et al. (2016) [6262 Yoong SL, Nathan N, Wolfenden L, Wiggers J, Reilly K, Oldmeadow C, et al. CAFE: a multicomponent audit and feedback intervention to improve implementation of healthy food policy in primary school canteens: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):126. http://dx.doi.org/10.1136/bmjopen-2014-006969
https://doi.org/10.1136/bmjopen-2014-006...
], which also did not show enough evidence to conclude that the intervention significantly improved compliance in Australian schools with the healthy cafeteria policy. The authors suggest that, in isolation, a 12-month intervention with 72 cafeterias, consisting of menu audits and verbal and written feedback, may not be effective in improving compliance with such a policy. However, for these authors, increasing the intervention dose with more frequent menu audits and feedback could have maximized its effectiveness [6262 Yoong SL, Nathan N, Wolfenden L, Wiggers J, Reilly K, Oldmeadow C, et al. CAFE: a multicomponent audit and feedback intervention to improve implementation of healthy food policy in primary school canteens: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):126. http://dx.doi.org/10.1136/bmjopen-2014-006969
https://doi.org/10.1136/bmjopen-2014-006...
]. Accordingly, these measures are associated with increased compliance with Australian policy, indicating that more frequent feedback is likely to predict the intervention’s effectiveness [6262 Yoong SL, Nathan N, Wolfenden L, Wiggers J, Reilly K, Oldmeadow C, et al. CAFE: a multicomponent audit and feedback intervention to improve implementation of healthy food policy in primary school canteens: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):126. http://dx.doi.org/10.1136/bmjopen-2014-006969
https://doi.org/10.1136/bmjopen-2014-006...
]. It is worth noting that such intervention did not provide training for food handlers, only follow-up through audits, feedback with the results, and initial face-to-face meetings with school principals and cafeteria managers to obtain support [6262 Yoong SL, Nathan N, Wolfenden L, Wiggers J, Reilly K, Oldmeadow C, et al. CAFE: a multicomponent audit and feedback intervention to improve implementation of healthy food policy in primary school canteens: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):126. http://dx.doi.org/10.1136/bmjopen-2014-006969
https://doi.org/10.1136/bmjopen-2014-006...
].
Other studies have had a positive impact on the implementation of a healthy school cafeterias policy, increasing the availability of healthier foods [1212 Wolfenden L, Nathan N, Janssen L, Wiggers J, Reilly K, Delaney T, et al. Multi-strategic intervention to enhance implementation of healthy canteen policy: a randomised controlled trial. Implement Sci. 2017;12(1):6. http://dx.doi.org/10.1186/s13012-016-0537-9
https://doi.org/10.1186/s13012-016-0537-...
,3737 Nathan N, Yoong SL, Sutherland R, Reilly K, Delaney T, Janssen L, et al. Effectiveness of a multicomponent intervention to enhance implementation of a healthy canteen policy in Australian primary schools: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):c106. http://dx.doi.org/10.1186/s12966-016-0431-5
https://doi.org/10.1186/s12966-016-0431-...
,6363 Reilly K, Nathan N, Wiggers J, Yoong SL, Wolfenden L. Scale up of a multi-strategic intervention to increase implementation of a school healthy canteen policy: findings of an intervention trial. BMC Public Health. 2018;18(1):860. https://doi.org/10.1186/s12889-018-5786-x
https://doi.org/10.1186/s12889-018-5786-...
64 Evenhuis IJ, Jacobs SM, Vyth EL, Veldhuis L, Boer MR, Seidell JC, et al. The effect of supportive implementation of healthier canteen guidelines on changes in dutch school canteens and student purchase behaviour. Nutrients. 2020;12(8):2419. https://doi.org/10.3390/nu12082419
https://doi.org/10.3390/nu12082419...
-6565 Reilly K, Nathan N, Wu JHY, Delaney T, Wyse R, Cobcroft M, et al. Assessing the potential impact of a front-of-pack nutritional rating system on food availability in school canteens: a randomised controlled trial. Appetite. 2018;121:309-315. https://doi.org/10.1016/j.appet.2017.11.103
https://doi.org/10.1016/j.appet.2017.11....
]. These studies carried out several strategies, including support from the school community, follow-up, feedback training, action plan, recognition, printed and electronic materials [1212 Wolfenden L, Nathan N, Janssen L, Wiggers J, Reilly K, Delaney T, et al. Multi-strategic intervention to enhance implementation of healthy canteen policy: a randomised controlled trial. Implement Sci. 2017;12(1):6. http://dx.doi.org/10.1186/s13012-016-0537-9
https://doi.org/10.1186/s13012-016-0537-...
,1414 Nathan N, Yoong SL, Sutherland R, Reilly K, Delaney T, Janssen L, et al. Effectiveness of a multicomponent intervention to enhance implementation of a healthy canteen policy in Australian primary schools: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):106. http://dx.doi.org/10.1186/s12966-016-0431-5
https://doi.org/10.1186/s12966-016-0431-...
,6565 Reilly K, Nathan N, Wu JHY, Delaney T, Wyse R, Cobcroft M, et al. Assessing the potential impact of a front-of-pack nutritional rating system on food availability in school canteens: a randomised controlled trial. Appetite. 2018;121:309-315. https://doi.org/10.1016/j.appet.2017.11.103
https://doi.org/10.1016/j.appet.2017.11....
], policy consensus meetings [1212 Wolfenden L, Nathan N, Janssen L, Wiggers J, Reilly K, Delaney T, et al. Multi-strategic intervention to enhance implementation of healthy canteen policy: a randomised controlled trial. Implement Sci. 2017;12(1):6. http://dx.doi.org/10.1186/s13012-016-0537-9
https://doi.org/10.1186/s13012-016-0537-...
,6565 Reilly K, Nathan N, Wu JHY, Delaney T, Wyse R, Cobcroft M, et al. Assessing the potential impact of a front-of-pack nutritional rating system on food availability in school canteens: a randomised controlled trial. Appetite. 2018;121:309-315. https://doi.org/10.1016/j.appet.2017.11.103
https://doi.org/10.1016/j.appet.2017.11....
], financial support for purchasing kitchen equipment, marketing [1212 Wolfenden L, Nathan N, Janssen L, Wiggers J, Reilly K, Delaney T, et al. Multi-strategic intervention to enhance implementation of healthy canteen policy: a randomised controlled trial. Implement Sci. 2017;12(1):6. http://dx.doi.org/10.1186/s13012-016-0537-9
https://doi.org/10.1186/s13012-016-0537-...
,1414 Nathan N, Yoong SL, Sutherland R, Reilly K, Delaney T, Janssen L, et al. Effectiveness of a multicomponent intervention to enhance implementation of a healthy canteen policy in Australian primary schools: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):106. http://dx.doi.org/10.1186/s12966-016-0431-5
https://doi.org/10.1186/s12966-016-0431-...
], continuous support [1414 Nathan N, Yoong SL, Sutherland R, Reilly K, Delaney T, Janssen L, et al. Effectiveness of a multicomponent intervention to enhance implementation of a healthy canteen policy in Australian primary schools: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):106. http://dx.doi.org/10.1186/s12966-016-0431-5
https://doi.org/10.1186/s12966-016-0431-...
,6565 Reilly K, Nathan N, Wu JHY, Delaney T, Wyse R, Cobcroft M, et al. Assessing the potential impact of a front-of-pack nutritional rating system on food availability in school canteens: a randomised controlled trial. Appetite. 2018;121:309-315. https://doi.org/10.1016/j.appet.2017.11.103
https://doi.org/10.1016/j.appet.2017.11....
], among others. In particular, financial support for purchasing kitchen equipment for school cafeterias was a promising reason for the interventions’ positive effect in improving school cafeterias [1212 Wolfenden L, Nathan N, Janssen L, Wiggers J, Reilly K, Delaney T, et al. Multi-strategic intervention to enhance implementation of healthy canteen policy: a randomised controlled trial. Implement Sci. 2017;12(1):6. http://dx.doi.org/10.1186/s13012-016-0537-9
https://doi.org/10.1186/s13012-016-0537-...
,1414 Nathan N, Yoong SL, Sutherland R, Reilly K, Delaney T, Janssen L, et al. Effectiveness of a multicomponent intervention to enhance implementation of a healthy canteen policy in Australian primary schools: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):106. http://dx.doi.org/10.1186/s12966-016-0431-5
https://doi.org/10.1186/s12966-016-0431-...
]. This reality of developed countries like Australia is very distant from that of the schools participating in the present study, most of which were public and had cafeterias with domestic characteristics.
Despite the success of some of the interventions, authors report that 52% of schools continued to include prohibited items on cafeteria menus [3737 Nathan N, Yoong SL, Sutherland R, Reilly K, Delaney T, Janssen L, et al. Effectiveness of a multicomponent intervention to enhance implementation of a healthy canteen policy in Australian primary schools: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):c106. http://dx.doi.org/10.1186/s12966-016-0431-5
https://doi.org/10.1186/s12966-016-0431-...
]. According to Reilly et al. (2018b), there were minor changes in the schools’ policy adoption when principals and cafeteria managers were interviewed regarding their intention to use the Australian policy Fresh Tastes @ School.
Our results can be explained by the difficulty in maintaining and implementing a healthy cafeteria in Brazil, given the country’s present economic situation [1616 Wognski ACP, Ponchek VL, Dibas EES, Orso MR, Vieira LP, Ferreira BGCS, et al. Comercialização de alimentos em cantinas no âmbito escolar. Brazilian J Food Technol. 2019;22:1-12. https://doi.org/10.1590/1981-6723.19818
https://doi.org/10.1590/1981-6723.19818...
]. Healthier diets with high nutritional value, based on unprocessed or minimally processed foods, usually cost more per unit of energy than less healthy diets, generally based on ultra-processed foods. In Brazil, unprocessed or minimally processed foods, such as fresh meat, milk, fruits, and vegetables, tend to cost more per unit of energy than ultra-processed foods [6666 Maia EG, Passos CM, Levy RB, Bortoletto Martins AP, Mais LA, Claro RM. What to expect from the price of healthy and unhealthy foods over time? The case from Brazil. Public Health Nutr. 2020;23(4):579-588. https://doi.org/10.1017/S1368980019003586
https://doi.org/10.1017/S136898001900358...
].
Furthermore, although laws that regulate marketing food in the school environment exist, the lack of supervision aggravates, threatens, and hinders their operation and the implementation of healthy school cafeterias in Brazil [1616 Wognski ACP, Ponchek VL, Dibas EES, Orso MR, Vieira LP, Ferreira BGCS, et al. Comercialização de alimentos em cantinas no âmbito escolar. Brazilian J Food Technol. 2019;22:1-12. https://doi.org/10.1590/1981-6723.19818
https://doi.org/10.1590/1981-6723.19818...
]. In this regard, it is necessary that the city and state executive power, as well as school managers, are also held accountable for complying with the current legislation. The inertia of a national policy that refrains from implementing tax regulations, marketing restrictions, and nutrition labeling, is also noteworthy [6767 O’Halloran S, Lacy K, Woods J, Grimes CA, Campbell KJ, Nowson CA. The provision of ultra-processed foods and their contribution to sodium availability in Australian long day care centres. Public Health Nutr. 2018;21(1):134-141. https://doi.org/10.1017/S136898001700132X
https://doi.org/10.1017/S136898001700132...
,6868 Azeredo CM, Rezende LFM, Canella DS, Claro RM, Peres MFT, Luiz OC, et al. Food environments in schools and in the immediate vicinity are associated with unhealthy food consumption among Brazilian adolescents. Prev Med. 2016;88:73-79. https://doi.org/10.1016/j.ypmed.2016.03.026
https://doi.org/10.1016/j.ypmed.2016.03....
]. Thus, attempts at regulation to reverse this situation and promote healthy eating fall short of creating significant changes [6969 Khandpur N, Neri DA, Monteiro C, Mazur A, Frelut M-L, Boyland E, et al. Ultra-Processed food consumption among the paediatric population: an overview and call to action from the European childhood obesity group. Ann Nutr Metab. 2020;76(2):109-113. https://doi.org/10.1159/000507840
https://doi.org/10.1159/000507840...
].
Media literacy can also help children develop defenses against unhealthy food marketing and reduce its effects on eating behaviors and related health outcomes [7070 Austin EW, Austin B, Kaiser CK, Edwards Z, Parker L, Power TG. A Media literacy-based nutrition program fosters parent–child food marketing discussions, improves home food environment, and youth consumption of fruits and vegetables. Child Obes. 2020;16(S1):S-33-43. https://doi.org/10.1089/chi.2019.0240
https://doi.org/10.1089/chi.2019.0240...
,7171 Sing F, Mackay S, Culpin A, Hughes S, Swinburn B. Food Advertising to Children in New Zealand: a Critical Review of the Performance of a Self-Regulatory Complaints System Using a Public Health Law Framework. Nutrients. 2020;12(5):1278. https://doi.org/10.3390/nu12051278
https://doi.org/10.3390/nu12051278...
]. Parents can also shape their children’s food preferences and behaviors as they play the role of health promoters, role models, and educators in their children’s lives [7272 Yee AZH, Lwin MO, Ho SS. The influence of parental practices on child promotive and preventive food consumption behaviors: a systematic review and meta-analysis. Int J Behav Nutr Phys Act. 2017;14(1):47. https://doi.org/10.1186/s12966-017-0501-3
https://doi.org/10.1186/s12966-017-0501-...
].
For public policies promoting adequate and healthy food in schools to achieve their full benefits, Food and Nutrition Education (FNE) must cross over other areas of knowledge, interacting and approaching different knowledge, subjects, and professionals. That will make practices in the area of food and nutrition effective, consistent, and lasting [7373 Bezerra JAB. Educação alimetar e nutricional: articulação de saberes. Fortaleza: Edições UFC; 2018.].
Schools should focus on building alternatives to increase availability and access to adequate and healthy food, as it seems to be incoherent that the school community, which in theory values healthy eating, provides students with nutritionally inadequate food [7373 Bezerra JAB. Educação alimetar e nutricional: articulação de saberes. Fortaleza: Edições UFC; 2018.
74 Arcan C, Kubik MY, Fulkerson JA, Davey C, Story M. Association between food opportunities during the school day and selected dietary behaviors of alternative high school students, Minneapolis/Saint Paul, Minnesota, 2006. Prev Chronic Dis. 2011 Jan [cited 2020 Nov 2];8(1):A08. Available from: http://www.cdc.gov/pcd/issues/2011/jan/09_0214.htm
http://www.cdc.gov/pcd/issues/2011/jan/0...
-7575 Giacomelli SC, Londero AM, Benedetti FJ, Saccol ALF. Comércio informal e formal de alimentos no âmbito escolar de um município da região central do Rio Grande do Sul. Braz J Food Technol. 2017;20:e2016136. https://doi.org/10.1590/1981-6723.13616
https://doi.org/10.1590/1981-6723.13616...
].
Given the global challenge of combating obesity in children and adolescents, WHO recommends implementing programs that promote a healthy environment in schools. Among the strategies, they highlight eliminating the supply and marketing of unhealthy food, including knowledge about nutrition and health education in the schools’ basic curriculum, promoting physical activity, and reducing sedentary behavior [66 World Health Organization. Report of the Commission on Ending Childhood Obesity. Geneva: Organization; 2016 [cited 2020 Mar 2]. Available from: http://www.who.int/end-childhood-obesity/publications/echo-report/en/
http://www.who.int/end-childhood-obesity...
].
Likewise, the Food and Agriculture Organization of the United Nations (FAO) recommends different governmental pathways for healthier school environments, such as: defining and applying nutritional standards; making nutritious food more accessible; and restricting the marketing and advertising of foods high in fat, sugar, or salt [7676 Food and Agriculture Organization of the United Nations. Healthy food environment and school food. Roma: Organization; 2020 [cited 2020 Aug 5]. Available from: http://www.fao.org/school-food/areas-work/food-environment/en/
http://www.fao.org/school-food/areas-wor...
]. The development of FNE and the participation of the entire school community (children, families, school staff, etc.) in the implementation of actions is also essential to promote adequate and healthy food in the school environment [7676 Food and Agriculture Organization of the United Nations. Healthy food environment and school food. Roma: Organization; 2020 [cited 2020 Aug 5]. Available from: http://www.fao.org/school-food/areas-work/food-environment/en/
http://www.fao.org/school-food/areas-wor...
].
The present study has relevant limitations regarding its population and sample. The lack of statistical significance is justified by the size of the assessed sample. Such a limitation is also reported as a considerable challenge by another study in this field [1212 Wolfenden L, Nathan N, Janssen L, Wiggers J, Reilly K, Delaney T, et al. Multi-strategic intervention to enhance implementation of healthy canteen policy: a randomised controlled trial. Implement Sci. 2017;12(1):6. http://dx.doi.org/10.1186/s13012-016-0537-9
https://doi.org/10.1186/s13012-016-0537-...
]. Another limitation is the loss in the sample’s follow-up (25.92%). The data may have been influenced by Decree 54,994, promulgated on January 17, 2019, and sanctioned in the same year of the intervention. This decree regulates the Healthy Cafeterias Law in Rio Grande do Sul [5353 Rio Grande do Sul. Decreto no 54.994, de 17 de janeiro de 2020. Regulamenta a Lei nº 15.216, de 30 de julho de 2018, que dispõe sobre a promoção da alimentação saudável e proíbe a comercialização de produtos que colaborem para a obesidade, diabetes e hipertensão em cantinas e similares instalados em escolas públicas e privadas do Estado do Rio Grande do Sul. Porto Alegre: Governo do Estado; 2020 [cited 2020 Aug 5]. Available from: http://www.al.rs.gov.br/filerepository/repLegis/arquivos/DEC 54.994.pdf
http://www.al.rs.gov.br/filerepository/r...
]. However, as our ITT and PP analysis revealed similar results, there is confidence in the study results. Furthermore, the impact of the intervention was examined only in a small sample from southern Brazil, possibly in a situation of social vulnerability [3434 Deckert CT. A Gestão social no território da cidadania noroeste colonial do Rio Grande do Sul [dissertation]. Ijuí: Universidade Regional do Noroeste do Estado do Rio Grande do Sul; 2012 [cited 2020 Aug 5]. Available from: http://bibliodigital.unijui.edu.br:8080/xmlui/handle/123456789/1906
http://bibliodigital.unijui.edu.br:8080/...
]. Most of the assessed school cafeterias have the characteristics of domestic kitchens. These conditions can limit the generalization of findings to other contexts.
The size of the intervention effect observed in this study could have been greater if feedback to cafeterias and printed manuals had been provided only to the intervention group during the program. Schools in the control group received these documents after the intervention so as not to interfere with the results. The mechanism explaining certain effects is unclear and this is also an obstacle in other studies [1212 Wolfenden L, Nathan N, Janssen L, Wiggers J, Reilly K, Delaney T, et al. Multi-strategic intervention to enhance implementation of healthy canteen policy: a randomised controlled trial. Implement Sci. 2017;12(1):6. http://dx.doi.org/10.1186/s13012-016-0537-9
https://doi.org/10.1186/s13012-016-0537-...
,3737 Nathan N, Yoong SL, Sutherland R, Reilly K, Delaney T, Janssen L, et al. Effectiveness of a multicomponent intervention to enhance implementation of a healthy canteen policy in Australian primary schools: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):c106. http://dx.doi.org/10.1186/s12966-016-0431-5
https://doi.org/10.1186/s12966-016-0431-...
]. Another limitation that may have interfered with the results is the lack of evaluation of participants’ compliance with the course. In future works, we recommend the assessment of the target audience compliance for a better understanding of the results. The short period may also have contributed to the reduced effect of the intervention. Also, we call attention to the scarcity of nutritionists in the technical school cafeterias assessed. The presence of these professionals could have increased the odds of achieving the desired statistical differences.
This research brings new contributions to a scenario of scarce research [1212 Wolfenden L, Nathan N, Janssen L, Wiggers J, Reilly K, Delaney T, et al. Multi-strategic intervention to enhance implementation of healthy canteen policy: a randomised controlled trial. Implement Sci. 2017;12(1):6. http://dx.doi.org/10.1186/s13012-016-0537-9
https://doi.org/10.1186/s13012-016-0537-...
,1414 Nathan N, Yoong SL, Sutherland R, Reilly K, Delaney T, Janssen L, et al. Effectiveness of a multicomponent intervention to enhance implementation of a healthy canteen policy in Australian primary schools: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):106. http://dx.doi.org/10.1186/s12966-016-0431-5
https://doi.org/10.1186/s12966-016-0431-...
,6262 Yoong SL, Nathan N, Wolfenden L, Wiggers J, Reilly K, Oldmeadow C, et al. CAFE: a multicomponent audit and feedback intervention to improve implementation of healthy food policy in primary school canteens: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):126. http://dx.doi.org/10.1136/bmjopen-2014-006969
https://doi.org/10.1136/bmjopen-2014-006...
,6565 Reilly K, Nathan N, Wu JHY, Delaney T, Wyse R, Cobcroft M, et al. Assessing the potential impact of a front-of-pack nutritional rating system on food availability in school canteens: a randomised controlled trial. Appetite. 2018;121:309-315. https://doi.org/10.1016/j.appet.2017.11.103
https://doi.org/10.1016/j.appet.2017.11....
]. It also provides evidence to improve the implementation of healthy cafeterias in schools through randomized testing, one of the most powerful tools in the search for consistent answers to promote adequate and healthy eating in the school environment, facilitating translation into practice in public health [7777 Koletzko B, Fishbein M, Lee WS, Moreno L, Mouane N, Mouzaki M, et al. Prevention of childhood obesity: a position paper of the Global Federation of International Societies of Paediatric Gastroenterology, Hepatology and Nutrition (FISPGHAN). J Pediatr Gastroenterol Nutr. 2020;70(5):702-710. https://doi.org/10.1097/MPG.0000000000002708
https://doi.org/10.1097/MPG.000000000000...
78 Bleich SN, Vercammen KA, Zatz LY, Frelier JM, Ebbeling CB, Peeters A. Interventions to prevent global childhood overweight and obesity: a systematic review. Lancet Diabetes Endocrinol. 2018;6(4):332-346. https://doi.org/10.1016/S2213-8587(17)30358-3
https://doi.org/10.1016/S2213-8587(17)30...
79 Wolfenden L, Nathan N, Sutherland R, Yoong SL, Hodder R, Wyse RJ, et al. Strategies for enhancing the implementation of school-based policies or practices targeting risk factors for chronic disease. Cochrane Database Syst Rev. 2017;(11):CD011677. https://doi.org//10.1002/14651858.CD011677.pub2
https://doi.org/10.1002/14651858.CD01167...
-8080 Coutinho ESF, Huf G, Bloch KV. Ensaios clínicos pragmáticos: uma opção na construção de evidências em saúde. Cad Saude Publica. 2003;16:1189-1193. https://doi.org/10.1590/S0102-311X2003000400039
https://doi.org/10.1590/S0102-311X200300...
].
CONCLUSION
There is not enough evidence to conclude that the intervention improved the nutritional quality of the food offered in cafeterias and the hygienic aspects of food handling. However, there is a modest improvement in the implementation of healthy cafeterias by decreasing ultra-processed food supply, increasing fresh food supply, and improving the facility’s performance concerning hygienic conditions and food quality.
The existing government legislative guidance and training provision documents do not seem sufficient to achieve the objectives intended by policies to implement healthy school cafeterias, as proposed by the Ministry of Health and Rio Grande do Sul Healthy School Cafeterias Law. Therefore, it is necessary to rethink the implementation of public policies so that there is greater inspection and accountability for compliance with legal requirements, as well as the need for permanent education in health and education on the subject.
How to cite this article
-
Balestrin M, Kirsten VR, Wagner MB. Healthy and Safe School Cafeteria Program: a randomized controlled study. Rev Nutr. 2022;35:e210265. https://doi.org/10.1590/1678-9865202235e210265
-
Support: Conselho Nacional Brasileiro de Desenvolvimento Científico e Tecnológico (CNPq) (Process nº 23078.007037/2019-10) and Ministério da Ciência, Tecnologia, Inovações e Comunicações (MCTIC) (Protocol nº 442730/2016-0).
-
Article based on the thesis of M BALESTRIN, entitled “Efeito de um programa de intervenção na implementação de cantinas escolares saudáveis: um estudo controlado randomizado”. Universidade Federal Do Rio Grande do Sul; 2021.
REFERENCES
-
1Malta DC, Felisbino-Mendes MS, Machado ÍE, Passos VMA, Abreu DMX, Ishitani LH, et al Fatores de risco relacionados à carga global de doença do Brasil e Unidades Federadas, 2015. Rev Bras Epidemiol. 2017;217-232. https://doi.org/10.1590/1980-5497201700050018
» https://doi.org/10.1590/1980-5497201700050018 -
2Pelegrini A, Bim MA, Souza FU, Kilim KSS, Pinto AA. Prevalence of overweight and obesity in Brazilian children and adolescents: a systematic review. Rev Bras Cineantropom. 2021;23:e80352. https://doi.org/10.1590/1980-0037.2021v23e80352
» https://doi.org/10.1590/1980-0037.2021v23e80352 -
3Zarei N, Ahmadi A. Nutrition Transition: an intergenerational comparison of dietary habits among women of shiraz. Iran J Public Health. 2015 [cited 2020 Apr 9];44(2):269-275. Available from: https://pubmed.ncbi.nlm.nih.gov/25905062
» https://pubmed.ncbi.nlm.nih.gov/25905062 -
4Santiago-Torres M, Adams AK, Carrel AL, LaRowe TL, Schoeller DA. Home food availability, parental dietary intake, and familial eating habits influence the diet quality of urban Hispanic children. Child Obes. 2014;10(5):408-415. https://doi.org/10.1089/chi.2014.0051
» https://doi.org/10.1089/chi.2014.0051 -
5Institute for Health Metrics and Evaluation. Global burden of disease data. Institute for Health Metrics and Evaluation. Seattle; 2015 [cited 2020 Sep 8]. Available from: http://www.healthdata.org/gbd/data
» http://www.healthdata.org/gbd/data -
6World Health Organization. Report of the Commission on Ending Childhood Obesity. Geneva: Organization; 2016 [cited 2020 Mar 2]. Available from: http://www.who.int/end-childhood-obesity/publications/echo-report/en/
» http://www.who.int/end-childhood-obesity/publications/echo-report/en/ -
7Singh A, Bassi S, Nazar GP, Saluja K, Park M, Kinra S, et al Impact of school policies on non-communicable disease risk factors: a systematic review. BMC Public Health. 2017;17(1):292. https://doi.org/10.1186/s12889-017-4201-3
» https://doi.org/10.1186/s12889-017-4201-3 -
8Foster GD, Sherman S, Borradaile KE, Grundy KM, Vander Veur SS, Nachmani J, et al A policy-based school intervention to prevent overweight and obesity. Pediatrics. 2008;121(4):e794-802. https://doi.org/10.1542/peds.2007-1365
» https://doi.org/10.1542/peds.2007-1365 -
9World Health Organization. School policy framework: implementation of the WHO global strategy on diet, physical activity and health. Genebra: Organization; 2008 [cited 2020 Sep 8]. Available from: https://apps.who.int/iris/handle/10665/43923
» https://apps.who.int/iris/handle/10665/43923 -
10Yoong SL, Nathan NK, Wyse RJ, Preece SJ, Williams CM, Sutherland RL, et al Assessment of the school nutrition environment: a study in Australian primary school canteens. Am J Prev Med. 2015;49(2):215-222. https://doi.org/10.1016/j.amepre.2015.02.002
» https://doi.org/10.1016/j.amepre.2015.02.002 -
11Chriqui J, Resnick E, Schneider L, Schermbeck R, Adcock T, Carrion V, et al School District Wellness Policies: evaluating progress and potential for improving children’s health five years after the federal mandate. Chicago: Institute for Health Research and Policy; 2013 [cited 2020 Sep 8]. Available from: https://eric.ed.gov/?id=ED540415
» https://eric.ed.gov/?id=ED540415 -
12Wolfenden L, Nathan N, Janssen L, Wiggers J, Reilly K, Delaney T, et al Multi-strategic intervention to enhance implementation of healthy canteen policy: a randomised controlled trial. Implement Sci. 2017;12(1):6. http://dx.doi.org/10.1186/s13012-016-0537-9
» https://doi.org/10.1186/s13012-016-0537-9 -
13Fox MK, Gordon A, Nogales R, Wilson A. Availability and consumption of competitive foods in us public schools. J Am Diet Assoc. 2009;109(2):S57-66. https://doi.org/10.1016/j.jada.2008.10.063
» https://doi.org/10.1016/j.jada.2008.10.063 -
14Nathan N, Yoong SL, Sutherland R, Reilly K, Delaney T, Janssen L, et al Effectiveness of a multicomponent intervention to enhance implementation of a healthy canteen policy in Australian primary schools: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):106. http://dx.doi.org/10.1186/s12966-016-0431-5
» https://doi.org/10.1186/s12966-016-0431-5 -
15Gabriel CG, Vasconcelos FDAG, Andrade DF, Schmitz BAS. First Law regulating school canteens in Brazil: evaluation after seven years of implementation. Arch Latinoam Nutr. 2009 [cited 2020 May 8];59(2):128-138. Available from: http://ve.scielo.org/scielo.php?pid=S0004-06222009000200003&script=sci_abstract&tlng=en
» http://ve.scielo.org/scielo.php?pid=S0004-06222009000200003&script=sci_abstract&tlng=en -
16Wognski ACP, Ponchek VL, Dibas EES, Orso MR, Vieira LP, Ferreira BGCS, et al Comercialização de alimentos em cantinas no âmbito escolar. Brazilian J Food Technol. 2019;22:1-12. https://doi.org/10.1590/1981-6723.19818
» https://doi.org/10.1590/1981-6723.19818 -
17Lawlis T, Knox M, Jamieson M. School canteens: a systematic review of the policy, perceptions and use from an Australian perspective. Nutr Diet. 2016;73(4):389-398. http://doi.wiley.com/10.1111/1747-0080.12279
» https://doi.org/10.1111/1747-0080.12279 -
18O’Halloran S, Eksteen G, Gebremariam M, Alston L. Measurement methods used to assess the school food environment: a systematic review. Int J Environ Res Public Health. 2020;17(5):14-22. https://doi.org/10.1186/s12966-017-0477-z
» https://doi.org/10.1186/s12966-017-0477-z -
19Finch M, Sutherland R, Harrison M, Collins C. Canteen purchasing practices of year 1-6 primary school children and association with SES and weight status. Aust N Z J Public Health. 2006;30(3):247-251. http://dx.doi.org/10.1111/j.1467-842X.2006.tb00865.x
» https://doi.org/10.1111/j.1467-842X.2006.tb00865.x -
20Santana MO, Guimarães JS, Leite FHM, Mais LA, Horta PM, Bortoletto Martins AP, et al Analysing persuasive marketing of ultra-processed foods on Brazilian television. Int J Public Health. 2020;65(7):1067-1077. https://doi.org/10.1007/s00038-020-01456-6
» https://doi.org/10.1007/s00038-020-01456-6 -
21Clinton-McHarg T, Janssen L, Delaney T, Reilly K, Regan T, Nathan N, et al Availability of food and beverage items on school canteen menus and association with items purchased by children of primary-school age. Public Health Nutr. 2018;21(15):2907-2914. https://doi.org/10.1017/S1368980018001726
» https://doi.org/10.1017/S1368980018001726 -
22Peres CMC, Gardone DS, Costa BVL, Duarte CK, Pessoa MC, Mendes LL. Retail food environment around schools and overweight: a systematic review. Nutr Rev. 2020;78(10):841-856. https://doi.org/10.1093/nutrit/nuz110
» https://doi.org/10.1093/nutrit/nuz110 -
23Marinho GA, Oliveiraa GS, Lima JL, Lopes WMA, Nunes GA, Nunes MGA. Perfil epidemiológico das doenças transmitidas por alimentos e seus fatores causais na região da Zona da Mata Sul de Pernambuco. Cient Ciênc Biol Saúde. 2015;17:238-248.
-
24Food and Agriculture Organization of the United Nations. FAO School Food and Nutrition Framework. Roma: Organization; 2019 [cited 2020 Oct 10]. Available from: http://www.fao.org/3/ca4091en/ca4091en.pdf
» http://www.fao.org/3/ca4091en/ca4091en.pdf -
25Danelon MAS, Danelon MS, Silva MV. Serviços de alimentação destinados ao público escolar: análise da convivência do Programa de Alimentação Escolar e das cantinas. Seg Aliment Nutr. 2006;1:85-94. https://doi.org/10.20396/SAN.V13I1.1847
» https://doi.org/10.20396/SAN.V13I1.1847 -
26Sturion GL, Silva MV, Ometto AMH, Furtuoso MCO, Pipitone MAP. Fatores condicionantes da adesão dos alunos ao Programa de Alimentação Escolar no Brasil. Rev Nutr. 2005;18:167-181. https://doi.org/10.1590/0102-311X00061016
» https://doi.org/10.1590/0102-311X00061016 -
27Souza LBO, Azevedo ABC, Henrique D, Bandoni, Canella DS. Características do ambiente escolar relativas à alimentação e atividade física: PeNSE 2015. Rev Saude Publica. 2021;55:e115. https://doi.org/10.11606/s1518-8787.2021055003377
» https://doi.org/10.11606/s1518-8787.2021055003377 -
28Carmo AS, Assis MM, Cunha CF, Oliveira TRPR, Mendes LL. The food environment of Brazilian public and private schools. Cad Saude Publica. 2018;34:e00014918. https://doi.org/10.1590/0102-311x00014918
» https://doi.org/10.1590/0102-311x00014918 -
29Billich N, Adderley M, Ford L, Keeton I, Palermo C, Peeters A, et al The relative price of healthy and less healthy foods available in Australian school canteens. Health Promot Int. 2018;34(4):677-686. https://doi.org/10.1093/heapro/day025
» https://doi.org/10.1093/heapro/day025 -
30World Health Organization. Nutrition action in schools: a review of the evidence related to the nutrition-friendly schools initiative. Geneve: Organization; 2020. Available from: https://www.who.int/publications/i/item/9789241516969
» https://www.who.int/publications/i/item/9789241516969 -
31Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869. https://doi.org/10.1136/bmj.c869
» https://doi.org/10.1136/bmj.c869 -
32Chan A-W, Tetzlaff JM, Gøtzsche PC, Altman DG, Mann H, Berlin JA, et al SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586. https://doi.org/10.1136/bmj.e7586
» https://doi.org/10.1136/bmj.e7586 -
33Balestrin M, Brasil CCB, Bellei EA, Kirsten VR, Wagner MB. Program for healthier school cafeterias in Rio Grande do Sul, Brazil: protocol for a community-based randomized trial. JMIR Res Protoc. 2021;10(1):e22680. https://doi.org/10.2196/22680
» https://doi.org/10.2196/22680 -
34Deckert CT. A Gestão social no território da cidadania noroeste colonial do Rio Grande do Sul [dissertation]. Ijuí: Universidade Regional do Noroeste do Estado do Rio Grande do Sul; 2012 [cited 2020 Aug 5]. Available from: http://bibliodigital.unijui.edu.br:8080/xmlui/handle/123456789/1906
» http://bibliodigital.unijui.edu.br:8080/xmlui/handle/123456789/1906 -
35Deckert CT, Allebrandt SL. A efetividade da cidadania no programa Territórios da Cidadania: um estudo de caso do noroeste colonial do Rio Grande do Sul. Amaz Organ Sustentabilidade. 2013;2(2):8238-8893. http://dx.doi.org/10.17800/2238-8893/aos.v2n2p139-152
» https://doi.org/10.17800/2238-8893/aos.v2n2p139-152 -
36Deckert CT. Configuração do poder no Codeter: uma análise do Território da Cidadania Noroeste Colonial-RS. Redes. 2017;22(1):402-429. https://doi.org/10.17058/redes.v22i1.5259
» https://doi.org/10.17058/redes.v22i1.5259 -
37Nathan N, Yoong SL, Sutherland R, Reilly K, Delaney T, Janssen L, et al Effectiveness of a multicomponent intervention to enhance implementation of a healthy canteen policy in Australian primary schools: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):c106. http://dx.doi.org/10.1186/s12966-016-0431-5
» https://doi.org/10.1186/s12966-016-0431-5 -
38Ministério da Saúde (Brasil). Manual das cantinas escolares saudáveis: promovendo a alimentação saudável. Brasília: Ministerio; 2010.
-
39Rio Grande do Sul. Lei no 15.216, de 30 de julho de 2018. Dispõe sobre a promoção da alimentação saudável e proíbe a comercialização de produtos que colaborem para a obesidade, diabetes, hipertensão, em cantinas e similares instalados em escolas públicas e privadas do Estado do Rio Grande do Sul. Porto Alegre: Governo do Estado; 2018 [cited 2020 Aug 5]. Available from: https://leisestaduais.com.br/rs/lei-ordinaria-n-15216-2018-rio-grande-do-sul-dispoe-sobre-a-promocao-da-alimentacao-saudavel-e-proibe-a-comercializacao-de-produtos-que-colaborem-para-a-obesidade-diabetes-hipertensao-em-cantinas-e-similares-instalados-em-e
» https://leisestaduais.com.br/rs/lei-ordinaria-n-15216-2018-rio-grande-do-sul-dispoe-sobre-a-promocao-da-alimentacao-saudavel-e-proibe-a-comercializacao-de-produtos-que-colaborem-para-a-obesidade-diabetes-hipertensao-em-cantinas-e-similares-instalados-em-e -
40Ministério da Sáide (Brasil). Guia alimentar para a população brasileira. Brasília: Ministério; 2014.
-
41Ministério da Saúde (Brasil). Guia alimentar para a população brasileira: versão resumida. Brasil: Ministério; 2018.
-
42Giacomelli SC. Avaliação e promoção de boas práticas em cantinas escolares [dissertation]. Santa Maria: Universidade Federal de Santa Maria; 2014 [cited 2020 Jul 8]. Available from: https://repositorio.ufsm.br/handle/1/5763
» https://repositorio.ufsm.br/handle/1/5763 -
43Porto E. Perfil das cantinas escolares do Distrito Federal [dissertation]. Brasília: Universidade de Brasília; 2011 [cited 2020 Aug 9]. Available from: https://repositorio.unb.br/handle/10482/10036
» https://repositorio.unb.br/handle/10482/10036 -
44Agência Nacional de Vigilância Sanitária. Categorização dos serviços de alimentação: elaboração e avalição da lista de avaliação. Brasília: Agência; 2013.
-
45Cunha DT, Saccol ALF, Tondo EC, Oliveira ABA, Ginani VC, Araújo CV, et al Inspection score and grading system for food services in Brazil: the results of a food safety strategy to reduce the risk of foodborne diseases during the 2014 FIFA World Cup. Front. Microbiol. 2016;7:e614. https://doi.org/10.3389/fmicb.2016.00614
» https://doi.org/10.3389/fmicb.2016.00614 -
46Cunha DT, Oliveira ABA, Saccol ALF, Tondo EC, Silva EA, Ginani VC, et al Food safety of food services within the destinations of the 2014 FIFA World Cup in Brazil: development and reliability assessment of the official evaluation instrument. Food Res Int. 2014;57:95-103. https://doi.org/10.1016/j.foodres.2014.01.021
» https://doi.org/10.1016/j.foodres.2014.01.021 -
47Agência Nacional de Vigilância Sanitária. Categorização dos serviços de alimentação: elaboração e avalição da lista de avaliação. Brasília: Agência; 2013.
-
48Ministério da Saúde (Brasil). Portaria no 817, de 10 de maio de 2013. Aprova as diretrizes nacionais para a elaboração e execução do projeto-piloto de categorização dos serviços de alimentação para a Copa do Mundo FIFA 2014. Brasília: Ministério; 2013 [cited 2020 Aug 5]. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2013/prt0817_10_05_2013.html
» http://bvsms.saude.gov.br/bvs/saudelegis/gm/2013/prt0817_10_05_2013.html -
49Verdum DCP, Selva JP, Copatti F, Batista M, Pereira LS, Kirsten VR, et al Condições higiênico-sanitárias das cantinas escolares da rede estadual de ensino no município de Palmeira das Missões, Rio Grande do Sul. Vigil Sanit Debate. 2017;5(4):17-23. https://doi.org/10.22239/2317-269x.00960
» https://doi.org/10.22239/2317-269x.00960 -
50Monteiro CA, Levy RB, Claro RM, Castro IRR, Cannon G. A new classification of foods based on the extent and purpose of their processing. Cad Saude Publica. 2010;26(11):2039-2049. https://doi.org/10.1590/S0102-311X2010001100005
» https://doi.org/10.1590/S0102-311X2010001100005 -
51Williams CM, Nathan N, Delaney T, Yoong SL, Wiggers J, Preece S, et al CAFE: a multicomponent audit and feedback intervention to improve implementation of healthy food policy in primary school canteens: protocol of a randomised controlled trial. BMJ Open. 2015;5(6):e006969. http://dx.doi.org/10.1136/bmjopen-2014-006969
» https://doi.org/10.1136/bmjopen-2014-006969 -
52Wolfenden L, Nathan N, Williams CM, Delaney T, Reilly KL, Freund M, et al A randomised controlled trial of an intervention to increase the implementation of a healthy canteen policy in Australian primary schools: study protocol. Implement Sci. 2014;9:147. https://doi.org/10.1186/s13012-014-0147-3
» https://doi.org/10.1186/s13012-014-0147-3 -
53Rio Grande do Sul. Decreto no 54.994, de 17 de janeiro de 2020. Regulamenta a Lei nº 15.216, de 30 de julho de 2018, que dispõe sobre a promoção da alimentação saudável e proíbe a comercialização de produtos que colaborem para a obesidade, diabetes e hipertensão em cantinas e similares instalados em escolas públicas e privadas do Estado do Rio Grande do Sul. Porto Alegre: Governo do Estado; 2020 [cited 2020 Aug 5]. Available from: http://www.al.rs.gov.br/filerepository/repLegis/arquivos/DEC 54.994.pdf
» http://www.al.rs.gov.br/filerepository/repLegis/arquivos/DEC 54.994.pdf -
54Rio Grande do Sul. Lei no 13.027, de 16 de agosto de 2008. Dispõe sobre a comercialização de lanches e de bebidas em escolas no âmbito do estado do Rio Grande do Sul e dá outras providências. Porto Alegre: Governo do Estado; 2008 [cited 2020 Aug 5]. Available from: https://leisestaduais.com.br/rs/lei-ordinaria-n-13027-2008-rio-grande-do-sul-dispoe-sobre-a-comercializacao-de-lanches-e-de-bebidas-em-escolas-no-ambito-do-estado-do-rio-grande-do-sul-e-da-outras-providencias
» https://leisestaduais.com.br/rs/lei-ordinaria-n-13027-2008-rio-grande-do-sul-dispoe-sobre-a-comercializacao-de-lanches-e-de-bebidas-em-escolas-no-ambito-do-estado-do-rio-grande-do-sul-e-da-outras-providencias -
55Horta RL, Andersen CS, Pinto RO, Horta BL, Oliveira-Campos M, Andreazzi MAR, et al Health promotion in school environment in Brazil. Rev Saude Publica. 2017;51:e06709. https://doi.org/10.1590/s1518-8787.2017051006709
» https://doi.org/10.1590/s1518-8787.2017051006709 -
56Clayton ML, Clegg Smith K, Neff RA, Pollack KM, Ensminger M. Listening to food workers: Factors that impact proper health and hygiene practice in food service. Int J Occup Environ Health. 2015;21(4):314-327. https://doi.org/10.1179/2049396715Y.0000000011
» https://doi.org/10.1179/2049396715Y.0000000011 -
57Green L, Selman C, Banerjee A, Marcus R, Medus C, Angulo FJ, et al Food service workers’ self-reported food preparation practices: an EHS-Net study. Int J Hyg Environ Health. 2005;208(1-2):27-35. https://doi.org/10.1016/j.ijheh.2005.01.005
» https://doi.org/10.1016/j.ijheh.2005.01.005 -
58Ricke SC, Donaldson JR, Phillips CA. Food safety emerging issues, technologies, and systems. Cambridge: Academic Press; 2015.
-
59Freitas RSG, Cunha DT, Stedefeldt E. Food safety knowledge as gateway to cognitive illusions of food handlers and the different degrees of risk perception. Food Res Int. 2019;116:126-134. https://doi.org/10.1016/j.foodres.2018.12.058
» https://doi.org/10.1016/j.foodres.2018.12.058 -
60Cunha DT, Rosso VV, Stedefeldt E. Food safety performance and risk of food services from different natures and the role of nutritionist as food safety leader. Cien Saude Colet. 2018;23:4033-4042. https://doi.org/10.1590/1413-812320182312.21042016
» https://doi.org/10.1590/1413-812320182312.21042016 -
61Madeira M, Ferrão MEM. Alimentos conforme a lei. São Paulo: Manole; 2002.
-
62Yoong SL, Nathan N, Wolfenden L, Wiggers J, Reilly K, Oldmeadow C, et al CAFE: a multicomponent audit and feedback intervention to improve implementation of healthy food policy in primary school canteens: a randomised controlled trial. Int J Behav Nutr Phys Act. 2016;13(1):126. http://dx.doi.org/10.1136/bmjopen-2014-006969
» https://doi.org/10.1136/bmjopen-2014-006969 -
63Reilly K, Nathan N, Wiggers J, Yoong SL, Wolfenden L. Scale up of a multi-strategic intervention to increase implementation of a school healthy canteen policy: findings of an intervention trial. BMC Public Health. 2018;18(1):860. https://doi.org/10.1186/s12889-018-5786-x
» https://doi.org/10.1186/s12889-018-5786-x -
64Evenhuis IJ, Jacobs SM, Vyth EL, Veldhuis L, Boer MR, Seidell JC, et al The effect of supportive implementation of healthier canteen guidelines on changes in dutch school canteens and student purchase behaviour. Nutrients. 2020;12(8):2419. https://doi.org/10.3390/nu12082419
» https://doi.org/10.3390/nu12082419 -
65Reilly K, Nathan N, Wu JHY, Delaney T, Wyse R, Cobcroft M, et al Assessing the potential impact of a front-of-pack nutritional rating system on food availability in school canteens: a randomised controlled trial. Appetite. 2018;121:309-315. https://doi.org/10.1016/j.appet.2017.11.103
» https://doi.org/10.1016/j.appet.2017.11.103 -
66Maia EG, Passos CM, Levy RB, Bortoletto Martins AP, Mais LA, Claro RM. What to expect from the price of healthy and unhealthy foods over time? The case from Brazil. Public Health Nutr. 2020;23(4):579-588. https://doi.org/10.1017/S1368980019003586
» https://doi.org/10.1017/S1368980019003586 -
67O’Halloran S, Lacy K, Woods J, Grimes CA, Campbell KJ, Nowson CA. The provision of ultra-processed foods and their contribution to sodium availability in Australian long day care centres. Public Health Nutr. 2018;21(1):134-141. https://doi.org/10.1017/S136898001700132X
» https://doi.org/10.1017/S136898001700132X -
68Azeredo CM, Rezende LFM, Canella DS, Claro RM, Peres MFT, Luiz OC, et al Food environments in schools and in the immediate vicinity are associated with unhealthy food consumption among Brazilian adolescents. Prev Med. 2016;88:73-79. https://doi.org/10.1016/j.ypmed.2016.03.026
» https://doi.org/10.1016/j.ypmed.2016.03.026 -
69Khandpur N, Neri DA, Monteiro C, Mazur A, Frelut M-L, Boyland E, et al Ultra-Processed food consumption among the paediatric population: an overview and call to action from the European childhood obesity group. Ann Nutr Metab. 2020;76(2):109-113. https://doi.org/10.1159/000507840
» https://doi.org/10.1159/000507840 -
70Austin EW, Austin B, Kaiser CK, Edwards Z, Parker L, Power TG. A Media literacy-based nutrition program fosters parent–child food marketing discussions, improves home food environment, and youth consumption of fruits and vegetables. Child Obes. 2020;16(S1):S-33-43. https://doi.org/10.1089/chi.2019.0240
» https://doi.org/10.1089/chi.2019.0240 -
71Sing F, Mackay S, Culpin A, Hughes S, Swinburn B. Food Advertising to Children in New Zealand: a Critical Review of the Performance of a Self-Regulatory Complaints System Using a Public Health Law Framework. Nutrients. 2020;12(5):1278. https://doi.org/10.3390/nu12051278
» https://doi.org/10.3390/nu12051278 -
72Yee AZH, Lwin MO, Ho SS. The influence of parental practices on child promotive and preventive food consumption behaviors: a systematic review and meta-analysis. Int J Behav Nutr Phys Act. 2017;14(1):47. https://doi.org/10.1186/s12966-017-0501-3
» https://doi.org/10.1186/s12966-017-0501-3 -
73Bezerra JAB. Educação alimetar e nutricional: articulação de saberes. Fortaleza: Edições UFC; 2018.
-
74Arcan C, Kubik MY, Fulkerson JA, Davey C, Story M. Association between food opportunities during the school day and selected dietary behaviors of alternative high school students, Minneapolis/Saint Paul, Minnesota, 2006. Prev Chronic Dis. 2011 Jan [cited 2020 Nov 2];8(1):A08. Available from: http://www.cdc.gov/pcd/issues/2011/jan/09_0214.htm
» http://www.cdc.gov/pcd/issues/2011/jan/09_0214.htm -
75Giacomelli SC, Londero AM, Benedetti FJ, Saccol ALF. Comércio informal e formal de alimentos no âmbito escolar de um município da região central do Rio Grande do Sul. Braz J Food Technol. 2017;20:e2016136. https://doi.org/10.1590/1981-6723.13616
» https://doi.org/10.1590/1981-6723.13616 -
76Food and Agriculture Organization of the United Nations. Healthy food environment and school food. Roma: Organization; 2020 [cited 2020 Aug 5]. Available from: http://www.fao.org/school-food/areas-work/food-environment/en/
» http://www.fao.org/school-food/areas-work/food-environment/en/ -
77Koletzko B, Fishbein M, Lee WS, Moreno L, Mouane N, Mouzaki M, et al Prevention of childhood obesity: a position paper of the Global Federation of International Societies of Paediatric Gastroenterology, Hepatology and Nutrition (FISPGHAN). J Pediatr Gastroenterol Nutr. 2020;70(5):702-710. https://doi.org/10.1097/MPG.0000000000002708
» https://doi.org/10.1097/MPG.0000000000002708 -
78Bleich SN, Vercammen KA, Zatz LY, Frelier JM, Ebbeling CB, Peeters A. Interventions to prevent global childhood overweight and obesity: a systematic review. Lancet Diabetes Endocrinol. 2018;6(4):332-346. https://doi.org/10.1016/S2213-8587(17)30358-3
» https://doi.org/10.1016/S2213-8587(17)30358-3 -
79Wolfenden L, Nathan N, Sutherland R, Yoong SL, Hodder R, Wyse RJ, et al Strategies for enhancing the implementation of school-based policies or practices targeting risk factors for chronic disease. Cochrane Database Syst Rev. 2017;(11):CD011677. https://doi.org//10.1002/14651858.CD011677.pub2
» https://doi.org/10.1002/14651858.CD011677.pub2 -
80Coutinho ESF, Huf G, Bloch KV. Ensaios clínicos pragmáticos: uma opção na construção de evidências em saúde. Cad Saude Publica. 2003;16:1189-1193. https://doi.org/10.1590/S0102-311X2003000400039
» https://doi.org/10.1590/S0102-311X2003000400039
Publication Dates
-
Publication in this collection
07 Oct 2022 -
Date of issue
2022
History
-
Received
06 Dec 2021 -
Reviewed
29 June 2022 -
Accepted
11 Aug 2022