Acessibilidade / Reportar erro

“BRUSH UP”: AN INNOVATIVE TECHNOLOGICAL AID FOR PARENTS TO KEEP A CHECK OF THEIR CHILDREN’S ORAL HYGIENE BEHAVIOUR

ABSTRACT

Objective:

To investigate the impact of “Brush Up” - a mobile application, on oral hygiene behaviours of 4-6-year-old children in Bangalore city.

Methods:

In this experimental study, 247 children aged 4-6, were randomly divided into three groups. Considering “Brush Up” is a mobile application, parents of the children in Group 1 (n=82) downloaded the application on their smartphones. Children in Group 2 (n=83) and Group 3 (n=82) received tooth brushing instructions by an educative video and manual demonstration, respectively. Effectiveness of tooth brushing was assessed with plaque scores, which were recorded for all the groups at baseline and one month using Visible Biofilm Index.

Results:

Wilcoxon signed rank test showed a significant improvement in the tooth brushing behaviour for the Brush Up group, which was indicated by a lower plaque score after a follow-up of one month. Kruskal-Wallis test followed by post-hoc test showed that the mean ranks of plaque scores of Brush Up group are consistently lower than those of video demonstration group and manual demonstration group.

Conclusions:

The lower plaque score in subsequent follow-up in Brush Up group suggests that using a smart system can enhance learning a correct tooth brushing method in young children and can also help in implementing the required reinforcement and motivation to brush and aid in better plaque control.

Keywords:
Mobile application; Smartphone; Toothbrushing; Dental plaque

RESUMO

Objetivo:

Investigar o impacto do “Brush Up”, um aplicativo móvel, sobre comportamentos de higiene bucal de crianças de 4 a 6 anos na cidade de Bangalore, na Índia.

Métodos:

Neste estudo experimental, 247 crianças de 4 a 6 anos foram divididas aleatoriamente em 3 grupos. Como “Brush Up” é um aplicativo móvel, os pais das crianças do Grupo 1 (n=82) baixaram o aplicativo em seus smartphones. As crianças do grupo 2 (n=83) e do grupo 3 (n=82) receberam instruções sobre escovação por meio de vídeo educativo e demonstração manual, respectivamente. A efetividade da escovação foi avaliada por meio de escores de placa bacteriana, registrados para todos os grupos antes da intervenção e um mês depois.

Resultados:

O teste de Wilcoxon sinalizou uma melhora significativa na escovação para o grupo “Brush Up”, com uma pontuação mais baixa na placa bacteriana após um mês de acompanhamento. O teste de Kruskal-Wallis, seguido do teste post hoc, mostrou que as classificações médias das pontuações do grupo “Brush Up” foram consistentemente mais baixas do que as do grupo com demonstração em vídeo e demonstração manual.

Conclusões:

Os resultados obtidos no grupo “Brush Up” sugerem que o uso de um sistema inteligente pode melhorar o aprendizado de um método correto de escovação em crianças pequenas e ajudar na implementação do reforço e motivação necessários para escovar e controlar melhor a placa bacteriana.

Palavras-chave:
Aplicativos móveis; Smartphone; Escovação dentária; Placa dentária

INTRODUCTION

The role of microbial plaque in the initiation and progression of dental caries, and periodontal disease is well documented. Mechanical removal of plaque at regular intervals currently offers the safest mode of preventive therapy.11. Hausmann E, Hausmann B. Motivation-key to patient success in mechanical plaque control. J Am Dent Assoc. 1976;92:403-8. https://doi.org/10.14219/jada.archive.1976.0382
https://doi.org/https://doi.org/10.14219...
Thus, tooth brushing continues to be a widely used and effective method for cleaning most of teeth surfaces.22. Leal SC, Bezerra AC, Toledo OA. Effectiveness of teaching methods for toothbrushing in preschool children. Braz Dent J. 2002;13:133-6. https://doi.org/10.1590/S0103-64402002000200011
https://doi.org/https://doi.org/10.1590/...

Tooth brushing is acquired during the social learning process of children. When taught in early childhood, it gets naturally ingrained in their daily routine, and only positive reinforcement is needed later.22. Leal SC, Bezerra AC, Toledo OA. Effectiveness of teaching methods for toothbrushing in preschool children. Braz Dent J. 2002;13:133-6. https://doi.org/10.1590/S0103-64402002000200011
https://doi.org/https://doi.org/10.1590/...
Improper tooth brushing behaviors can result in gingivitis, tooth decay, or, eventually, tooth loss. The primary goal of any brushing technique is to reach all accessible teeth surfaces and enable patients to prevent trauma from brushing.33. Graetz C, Bielfeldt J, Wolff L, Springer C, El-Sayed KM, Sälzer S, et al. Toothbrushing education via a smart software visualization system. J Periodontol. 2013;84:186-95. https://doi.org/10.1902/jop.2012.110675
https://doi.org/https://doi.org/10.1902/...

From all the known brushing techniques, the Modified Bass Technique (MBT) significantly removes supragingival plaque, thereby improving the level of oral hygiene, with little soft tissue damage observed.33. Graetz C, Bielfeldt J, Wolff L, Springer C, El-Sayed KM, Sälzer S, et al. Toothbrushing education via a smart software visualization system. J Periodontol. 2013;84:186-95. https://doi.org/10.1902/jop.2012.110675
https://doi.org/https://doi.org/10.1902/...
Studies report that children have problems with grammatical understanding at their early age, which is reflected in their difficulty to understand verbal instructions regarding tooth brushing given to them in schools. To overcome this barrier, audio-visual aids have been proven to be effective.22. Leal SC, Bezerra AC, Toledo OA. Effectiveness of teaching methods for toothbrushing in preschool children. Braz Dent J. 2002;13:133-6. https://doi.org/10.1590/S0103-64402002000200011
https://doi.org/https://doi.org/10.1590/...

Encouraging new positive behaviors in young children is vital, but turning them into habits becomes a challenge for parents and teachers. As a result, play-based occupational therapy has been developed to induce behavioral change.44. Chang YC, Lo JL, Huang CJ, Hsu NY, Chu HH, Wang HY, et al. Playful toothbrush: ubicomp technology for teaching tooth brushing to kindergarten children. CHI ‘08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems; 2008 Apr; Taiwan, China. p. 363-72. https://doi.org/10.1145/1357054.1357115
https://doi.org/https://doi.org/10.1145/...
Interventions involving automated message systems have shown to improve knowledge and health outcomes in a variety of health areas. Technologies such as cell phones and text messaging, which are already a part of people’s daily lives, have a great potential for improving health by assisting them with behavior modification and disease self-management.55. Krishna S, Boren SA, Balas EA. Healthcare via cell phones: a systematic review. Telemed J E Health. 2009;15:231-40. https://doi.org/10.1089/tmj.2008.0099
https://doi.org/https://doi.org/10.1089/...

Mobile phones have had a considerable impact in developing countries. Across the world, people are gaining access to the internet via mobile phones.66. Cole-Lewis H, Kershaw T. Text messaging as a tool for behavior change in disease prevention and management. Epidemiol Rev. 2010;32:56-69. https://doi.org/10.1093/epirev/mxq004
https://doi.org/https://doi.org/10.1093/...
The number of smartphone users in India alone was found to be about 502.2 million in 2019,77. News18 [homepage on the Internet]. Smartphone Users in India Crossed 500 Million in 2019, States Report [cited 2020 Feb 19]. Available from: Available from: https://www.news18.com/news/tech/smartphone-users-in-india-crossed-500-million-in-2019-states-report-2479529.html
https://www.news18.com/news/tech/smartph...
projected to increase to 829 million by 2022.88. Qz.com [homepage on the Internet]. The number of smartphone users in India will more than double in four years [cited 2020 Feb 19]. Available from: Available from: https://qz.com/india/1483368/indias-smartphone-internet-usage-will-surge-by-2022-cisco-says/
https://qz.com/india/1483368/indias-smar...
Mobile health (mHealth) is the use of mobile phone technology to deliver health care. Mobile phone technologies that have been used for mHealth include text messaging, video messaging, voice calling, and internet connectivity.66. Cole-Lewis H, Kershaw T. Text messaging as a tool for behavior change in disease prevention and management. Epidemiol Rev. 2010;32:56-69. https://doi.org/10.1093/epirev/mxq004
https://doi.org/https://doi.org/10.1093/...

The average 5-year-old child brushes only 25% of all areas of teeth. Considering young children are often deficient in brushing their teeth thoroughly and uniformly, supervision of parents and/or teachers is needed to teach them proper brushing techniques.44. Chang YC, Lo JL, Huang CJ, Hsu NY, Chu HH, Wang HY, et al. Playful toothbrush: ubicomp technology for teaching tooth brushing to kindergarten children. CHI ‘08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems; 2008 Apr; Taiwan, China. p. 363-72. https://doi.org/10.1145/1357054.1357115
https://doi.org/https://doi.org/10.1145/...
Thus, the use of smartphones to promote oral health seems like an interesting and feasible option. Gaming apps running on mobile devices are useful means to deliver health interventions and motivate self-care. Research into the use of apps is starting to emerge in healthcare, but in the oral health area, research is minimal.99. Underwood B, Birdsall J, Kay E. The use of a mobile app to motivate evidence-based oral hygiene behaviour. Br Dent J. 2015;219:E2. https://doi.org/10.1038/sj.bdj.2015.660
https://doi.org/https://doi.org/10.1038/...
Thus, the present study aims to investigate the impact of a mobile application (Brush Up) on oral hygiene behaviors of 4-6 year old children in Bangalore City.

METHOD

This study was conducted with children aged from 4 to 6, attending a private school in Bangalore City, India. Convenience sampling technique was used for selection of study subjects. The study received ethical approval by the institutional review board of the KLE Institute of Dental sciences, Bangalore [KIDS/IEC/NOV-2017/5]. The study was conducted between December 2017 and January 2018. Written informed consent was collected from the school authorities and parents, and verbal consent was obtained from the subjects. Only the subjects who matched the age group of 4-6, who were present on the day of examination, and whose parents were smartphone users were included in the study. Out of 305 subjects, 247 were included in the study.

Before commencing the study, the chief investigator was trained in the Department of Public Health Dentistry, K.L.E Society’s Institute of Dental Sciences, Bangalore, to record plaque score using Modified Visible Biofilm Index.1010. Santos AP, Séllos MC, Ramos ME, Soviero VM. Oral hygiene frequency and presence of visible biofilm in the primary dentition. Braz Oral Res. 2007;21:64-9. https://doi.org/10.1590/s1806-83242007000100011
https://doi.org/https://doi.org/10.1590/...
,1111. Ribeiro AA. Evaluation of an oral health promotion program for HIV + children [master’s thesis]. Rio de Janeiro: Universidade Federal do Rio de Janeiro; 2000.Kappa coefficient value (ƙ) for intra-examiner reliability was 0.89. A self-designed format was used to record data regarding general information (age, gender, frequency of tooth brushing, duration of tooth brushing, cleaning of the lingual surfaces of teeth, and tongue cleaning). This was followed by recording the plaque scores.

After interviewing, the subjects were randomly divided into three groups. Randomization was performed by one investigator, using random number table, whereas another investigator assigned the participants into the three intervention groups. Group 1 (Brush Up Group, n=82) received tooth brushing instructions using the mobile application ‘Brush Up’. Brush Up is a ‘toothbrush training game’ application developed by GamesThatWork. It has a cartoon toothbrush tutor called ‘BUDD’, that motivates children to brush their teeth with him. The app shows BUDD cleaning all the teeth surfaces and it makes use of the phone’s front camera so that children can repeat the action and watch themselves while brushing to make sure they are doing it right. The app also uses an instructional song during the exercise, which lasts approximately three minutes.1212. Jacobson D, Jacobson J, Leong T, Lourenco S, Mancl L, Chi DL. Evaluating child toothbrushing behavior changes associated with a mobile game app: a single arm pre/post pilot study. Pediatr Dent. 2019;41:299-303. Thus, children stop their brushing routine when BUDD stops at the end of the three minutes. The application is freely available on Google play store. The link to it was shared with the parents, and they downloaded the application in the presence of an intern from the Department. Parents were instructed to use the application twice a day for one month. Group 2 (Video demonstration group, n=83) received tooth brushing instructions by an educational video distributed to teachers. The teachers played the video for these subjects after the 1st clinical examination. Group 3 (Manual demonstration group, n=82) was given tooth brushing instructions with manual demonstration, using a model and toothbrush by another trained intern after the 1st clinical examination. Groups 2 and 3 were given instructions in separate classrooms. All the subjects were examined by the chief investigator for plaque status using Modified Visible Biofilm Index1010. Santos AP, Séllos MC, Ramos ME, Soviero VM. Oral hygiene frequency and presence of visible biofilm in the primary dentition. Braz Oral Res. 2007;21:64-9. https://doi.org/10.1590/s1806-83242007000100011
https://doi.org/https://doi.org/10.1590/...
,1111. Ribeiro AA. Evaluation of an oral health promotion program for HIV + children [master’s thesis]. Rio de Janeiro: Universidade Federal do Rio de Janeiro; 2000. at baseline and after one month follow up to assess the effectiveness of the education provided. The instruments used to assess plaque status were mouth mirror, blunt probe, and gauze for drying the teeth. All the investigators performed specific tasks, and blinding was done at each stage. All the teeth surfaces were examined, and teeth were scored accordingly.

Data was analysed using IBM SPSS v.20. Descriptive statistics were computed to summarize the characteristics of the subjects. Since the data was not normal as tested by the Kolmogorov-Smirnov test, Wilcoxon Signed Rank test evaluated the effect of mobile application on toothbrushing behaviours in the Brush Up group using the baseline and follow-up plaque scores. Kruskal-Wallis ANOVA was used for inter-group comparison. Mann-Whitney U test was used as a post-hoc test.

RESULTS

A total of 247 subjects participated in the study. Out of these 80 (32.4%) belonged to the 4 year age group, 88 (35.6%) to 5 year age group and 79 (32%) to 6 year age group. The mean age of the subjects was 4.98 years (SD±0.84). The sample consisted of 126 (51%) males and 121 (49%) females. At baseline, only 80 (32.4%) subjects brushed ≥2times a day, and 184 (74.5%) reported not brushing the lingual teeth surfaces. At follow up of 1 month, a radical improvement was observed, with 166 (67.2%) subjects reporting brushing ≥2times a day and only 74 (30%) reporting about not brushing the lingual surfaces of teeth (Table 1).

Table 1
Baseline characteristics of participants.

Chi-square test revealed that, there was a significant change in the frequency and duration of toothbrushing, cleaning of the lingual surfaces of teeth and tongue cleaning for all groups, post education. However, for Brush Up group, the scores for tongue cleaning did not change much when compared to the other two groups (Table 2). Wilcoxon signed rank test (Table 3) showed that the follow-up plaque score was lower than baseline score for 96.3% of the subjects, and the plaque score was equal for 3.7% of the subjects (p=0.001) indicating a significant improvement in the oral hygiene.

Table 2
Comparison of oral hygiene habits pre- and post-intervention.
Table 3
Comparison between baseline and follow up plaque scores for the Brush Up group.

The comparison of plaque scores between the three groups at baseline and at follow up showed a statistically significant difference for plaque scores at follow up (p=0.001). The mean rank for Brush Up group was significantly lower when compared to the other groups, suggesting lower plaque scores at follow up (Table 4). Post-hoc analysis using Mann-Whitney U test showed that there was a significant difference between plaque levels of all groups; however, the mean rank for Brush Up group was consistently low (Table 4).

Table 4
Comparison between different methods of tooth brushing instructions.

DISCUSSION

The key feature of any mobile health app is its ability to provide social and clinical support for the consumer, and documentation of self-administered readings and symptoms. This provides greater insights into the control and management of medical conditions, and enables the healthcare providers as well as the consumers for the same.1313. Anderson K, Emmerton LM. Contribution of mobile health applications to self-management by consumers: review of published evidence. Aust Health Rev. 2016;40:591-7. https://doi.org/10.1071/AH15162
https://doi.org/https://doi.org/10.1071/...
Because of limited published literature on the use of health apps specifically for oral care; this remains a relatively new research area.

It is already known that mechanical plaque control, despite being the most effective method, is inefficient in young children under 10 years old, due to poor manual dexterity and lack of sufficient motivation.1414. Unkel JH, Fenton SJ, Hobbs Jr G, Frere CL. Toothbrushing ability is related to age in children. ASDC J Dent Child. 1995;62:346-8.,1515. Grossman E, Proskin H. A comparison of the efficacy and safety of an electric and a manual children’s toothbrush. J Am Dent Assoc. 1997;128:469-74. https://doi.org/10.14219/jada.archive.1997.0232
https://doi.org/https://doi.org/10.14219...
Thus, instructions should be given according to the child’s degree of readiness for tooth brushing, and should include systematic training and reinforcement. Although manual dexterity and ability are needed, intensive individual training is essential, and children should be educated in oral self-care according to the status of their psychological development.22. Leal SC, Bezerra AC, Toledo OA. Effectiveness of teaching methods for toothbrushing in preschool children. Braz Dent J. 2002;13:133-6. https://doi.org/10.1590/S0103-64402002000200011
https://doi.org/https://doi.org/10.1590/...

Since our study population was 4-6-year old children, the parents/guardians supervised their tooth brushing routine for all the groups. Teaching tooth brushing and turning it into a habit require that parents create a routine that includes helping their children develop the necessary skills.1616. Hotwani K, Sharma K, Nagpal D, Lamba G, Chaudhari P. Smartphones and tooth brushing: content analysis of the current available mobile health apps for motivation and training. Eur Arch Paediatr Dent. 2020;21:103-8. https://doi.org/10.1007/s40368-019-00457-1
https://doi.org/https://doi.org/10.1007/...
The present study made use of a freely available android application for tooth brushing, called “Brush Up”, which uses this concept by creating an entertaining environment to engage children and motivate them to incorporate tooth brushing into their routine of daily habits.1212. Jacobson D, Jacobson J, Leong T, Lourenco S, Mancl L, Chi DL. Evaluating child toothbrushing behavior changes associated with a mobile game app: a single arm pre/post pilot study. Pediatr Dent. 2019;41:299-303.

Fedele conducted a meta-analysis to determine the effectiveness of mHealth interventions in improving health-related outcomes in young children. Their results indicated that mHealth interventions can be effective in producing meaningful health behavior and associated health outcomes in pediatric patients; when incorporated with parental supervision, the results were more effective than when seen with the pediatric patient alone.1717. Fedele DA, Cushing CC, Fritz A, Amaro CM, Ortega A. Mobile health interventions for improving health outcomes in youth: a meta-analysis. JAMA Pediatr. 2017;171:461-9. https://doi.org/10.1001/jamapediatrics.2017.0042
https://doi.org/https://doi.org/10.1001/...

Health education is a time-tested, well accepted and effective way to enhance oral hygiene procedures, and prevent plaque associated oral diseases.1818. Nakre PD, Harikiran AG. Effectiveness of oral health education programs: a systematic review. J Int Soc Prev Community Dent. 2013;3:103-15. https://doi.org/10.4103/2231-0762.127810
https://doi.org/https://doi.org/10.4103/...
Our findings suggest that all health education aids work positively towards improving tooth brushing behaviors. However, the performance of the mobile application group was consistently better than the other groups in everything, except tongue cleaning. Significant improvements in the scores were observed in the Brush Up group from baseline to follow-up for frequency of tooth brushing, duration of tooth brushing, and cleaning of lingual surfaces. This may be because the children watched BUDD, that brushes alongside them on the screen. There is only one published pilot study, conducted by Jacobson et al., that found similar results.1212. Jacobson D, Jacobson J, Leong T, Lourenco S, Mancl L, Chi DL. Evaluating child toothbrushing behavior changes associated with a mobile game app: a single arm pre/post pilot study. Pediatr Dent. 2019;41:299-303. This is the only study which used “Brush Up” application, to which the results of our study can directly be compared. They found that there was a 61.8% increase in brushing lingual surfaces by children using the app at seven-day follow-up, which increased to 93.3% at 14-day follow-up, which is in agreement with our findings (25.60% at baseline, and 95.12% at one month follow-up). However, for tongue cleaning, there were minimal changes at follow-up. This may be attributed to the lack of tongue cleaning exercise in the tooth brushing routine of the mobile app. The other groups fared better in the tongue cleaning exercise, because regular health education instruction includes explanation of tongue cleaning as one of the important steps for maintaining good oral hygiene. At one-year follow-up without the use of app, Jacobson et al. found that the improvements were not statistically significant, which they attributed to the lack of re-enforcement of the health education. In our study, this re-enforcement can explain the consistent improvement seen in Brush Up group when compared to other groups at one-month follow-up for all factors (with the exception of tongue cleaning), suggesting that routinely using the mobile application for tooth brushing may have inculcated a positive habit that led to the improvement in oral hygiene. Given there was no further follow-up, it is safe to assume that further re-enforcement can lead to sustained maintenance of good oral hygiene.

There are other studies in Orthodontics and other healthcare sciences that used mobile applications and other mobile health interventions and may be used for the comparison of our results to some extent. A study conducted by Alkadhi et al. on 12-year old children undergoing fixed orthodontic treatment, found that the Plaque Index and Gingival Index scores showed significant reductions at four-week follow-up for the group that received mobile application instructions (self-designed application which included video oral hygiene instructions and reminders with push notifications) when compared to the group that received verbal oral hygiene instructions at every visit.1919. Alkadhi OH, Zahid MN, Almanea RS, Althaqeb HK, Alharbi TH, Ajwa NM. The effect of using mobile applications for improving oral hygiene in patients with orthodontic fixed appliances: a randomised controlled trial. J Orthod. 2017;44:157-63. https://doi.org/10.1080/14653125.2017.1346746
https://doi.org/https://doi.org/10.1080/...
This study may be used for comparison considering there is difficulty in practicing proper oral hygiene with the appliance on and decreased compliance by the patients, which is comparable to some extent, to the poor manual dexterity, poor attitudes, and behavior towards oral hygiene among young children aged 4-6. Our findings suggest that the improvement in oral hygiene was better for the Brush Up group, which was followed by the video-demonstration group. This is in accordance with studies conducted by Graetz et al.,33. Graetz C, Bielfeldt J, Wolff L, Springer C, El-Sayed KM, Sälzer S, et al. Toothbrushing education via a smart software visualization system. J Periodontol. 2013;84:186-95. https://doi.org/10.1902/jop.2012.110675
https://doi.org/https://doi.org/10.1902/...
Underwood et al.99. Underwood B, Birdsall J, Kay E. The use of a mobile app to motivate evidence-based oral hygiene behaviour. Br Dent J. 2015;219:E2. https://doi.org/10.1038/sj.bdj.2015.660
https://doi.org/https://doi.org/10.1038/...
, and Alkadhi et al.,1919. Alkadhi OH, Zahid MN, Almanea RS, Althaqeb HK, Alharbi TH, Ajwa NM. The effect of using mobile applications for improving oral hygiene in patients with orthodontic fixed appliances: a randomised controlled trial. J Orthod. 2017;44:157-63. https://doi.org/10.1080/14653125.2017.1346746
https://doi.org/https://doi.org/10.1080/...
who showed that using a smart system to monitor tooth brushing, resulted in more thorough brushing across the dentition because of prolonged learning, leading to an improvement in oral hygiene.

The strength of this study was the reinforcement of the oral hygiene instruction provided daily with the mobile application, which is practically not feasible using the other instruction techniques. Despite promising results, the study had several limitations. The present sample of participants is not representative, because a convenience method of sampling was employed, which provides only partial generalizability. The follow-up period was short, and we recommend future studies with longer follow-up periods to confirm the findings. Because the inclusion criteria required parents using smartphones, the results are restricted to smartphone users. The mobile application used makes use of modified bass technique, which is a complex technique to master, especially by young children. The application only demonstrates tooth brushing, and does not demonstrate tongue cleaning, which is an important part of oral hygiene.

Within the study limitations of, the Brush Up application via mobile technology showed improvement in oral hygiene behaviors of children and can help parents in keeping a check on their children’s hygiene behavior. Moreover, an interactive gaming application can be used to spark interest and motivation regarding tooth brushing in young children. A mobile application is a promising tool to motivate an evidence-based oral hygiene routine by helping in behavioral change, skill development, and, thus, turning an exercise into a habit.

REFERENCES

Funding

  • The study did not receive any funding.

Publication Dates

  • Publication in this collection
    02 Apr 2021
  • Date of issue
    2021

History

  • Received
    04 Feb 2020
  • Accepted
    07 Aug 2020
  • Published
    29 Mar 2021
Sociedade de Pediatria de São Paulo R. Maria Figueiredo, 595 - 10o andar, 04002-003 São Paulo - SP - Brasil, Tel./Fax: (11 55) 3284-0308; 3289-9809; 3284-0051 - São Paulo - SP - Brazil
E-mail: rpp@spsp.org.br