Acessibilidade / Reportar erro

Intervention in social skills and bullying

Intervención en habilidades sociales y acoso escolar (bullying)

ABSTRACT

Objective:

to verify if the improvement of social and emotional skills reduces bullying victimization in 6th grade students 12 months after the end of the intervention.

Method:

Quasi-experimental study with 78 students who were bullying victims. A cognitive behavioral intervention based on social skills was conducted with the intervention group. The eight sessions addressed politeness, making friendships, self-control, emotional expressiveness, empathy, assertiveness and solution of interpersonal problems. Data were analyzed using Poisson regression with random effect.

Results:

Quasi-experimental study with 78 students who were bullying victims. A cognitive behavioral intervention based on social skills was conducted with the intervention group. The eight sessions addressed politeness, making friendships, self-control, emotional expressiveness, empathy, assertiveness and solution of interpersonal problems. Data were analyzed using Poisson regression with random effect.

Conclusion:

Social skills are important in anti-bullying interventions and can be the basis for intersectoral interventions in the health area, aimed at favoring the empowerment of victims by improving their social interactions and quality of life in school.

Descriptors:
Violence; Bullying; Aggression; Social Skills; School Health

RESUMEN

Objetivo:

Comprobar si la mejoría de las habilidades sociales reduce la victimización por acoso escolar (bullying) en estudiantes del 6º año de primaria, después de 12 meses de concluida la intervención.

Método:

Estudio de intervención cuasi-experimental entre 78 estudiantes víctimas de acoso escolar (bullying). Se llevó a cabo una intervención cognitivo-comportamental basada en habilidades sociales con ocho sesiones enfocadas en habilidades de civilidad, hacer amigos, autocontrol y expresividad emocional, empatía, asertividad y solución de problemas interpersonales. Los datos se analizaron a través de la Regresión de Poisson con efecto aleatorio.

Resultado:

El grupo intervención mejoró con respecto a las habilidades sociales; la victimización se redujo significativamente en ambos grupos (intervención y comparación), aunque en mayor cantidad en el grupo intervención.

Conclusión:

las habilidades sociales son importantes en mediaciones contra el acoso escolar y pueden fundamentar intervenciones intersectoriales en el área de la salud, con el fin de favorecer el empoderamiento de las víctimas mediante la mejoría de sus interacciones sociales y de la calidad de vida en la escuela.

Descriptores:
Violencia; Acoso Escolar (Bullying); Agresión; Habilidades Sociales; Salud Escolar

RESUMO

Objetivo:

Verificar se a melhoria de habilidades sociais reduz a vitimização por bullying em estudantes do 6º ano escolar após 12 meses da finalização da intervenção.

Método:

Estudo de intervenção quase-experimental com 78 estudantes vítimas de bullying. Realizou-se uma intervenção cognitivo comportamental baseada em habilidades sociais com o grupo intervenção. As oito sessões realizadas enfocaram habilidades de civilidade, fazer amizades, autocontrole e expressividade emocional, empatia, assertividade e solução de problemas interpessoais. Os dados foram analisados mediante regressão de Poisson com efeito aleatório.

Resultado:

O grupo da intervenção melhorou significativamente as habilidades sociais. A vitimização reduziu-se significativamente em ambos os grupos (intervenção e comparação), porém, em maior quantidade no grupo intervenção.

Conclusão:

As habilidades sociais são importantes em intervenções antibullying e podem fundamentar intervenções intersetoriais na área da saúde, visando favorecer o empoderamento das vítimas mediante a melhoria de suas interações sociais e qualidade de vida na escola.

Descritores:
Violência; Bullying; Agressão; Habilidades Sociais; Saúde Escolar

INTRODUCTION

Over the last decade in Brazil, there has been an increase in research addressing a specific type of school violence called bullying, which involves intentional and repetitive aggression perpetrated in a context of power inequality between victim and bully(11 Silva JL, Oliveira WA, Bono EL, Dib MA, Bazon MR, Silva MAI. Associações entre bullying escolar e conduta infracional: revisão sistemática de estudos longitudinais. Psic Teor e Pesq [Internet]. 2016 [cited 2017 Mar 20]; 32(1):81-90. Available from: http://www.scielo.br/pdf/ptp/v32n1/1806-3446-ptp-32-01-00081.pdf
http://www.scielo.br/pdf/ptp/v32n1/1806-...
-22 Olweus D. School bullying: development and some important challenges. Annu Rev Clin Psychol [Internet]. 2013 [cited 2017 Feb 23]; 9:751-80. Available from: http://www.annualreviews.org/doi/10.1146/annurev-clinpsy-050212-185516
http://www.annualreviews.org/doi/10.1146...
). Aggressions usually happen out of the sight of adults and involve physical, verbal or relational aggressions, such as spreading rumors and socially isolating the victim(33 Sampaio JMC, Santos GV, Oliveira WA, Silva JL, Medeiros M, Silva MAI. Emotions of students involved in cases of bullying. Texto Contexto Enferm [Internet]. 2015 [cited 2016 Dec 13]; 24:344-52. Available from: http://www.scielo.br/pdf/tce/v24n2/0104-0707-tce-24-02-00344.pdf
http://www.scielo.br/pdf/tce/v24n2/0104-...
). The World Health Organization considers bullying as a global problem(44 Matos MMNG. Prevenção da violência interpessoal em meio escolar: os professores, as famílias e a comunidade também marcam uma diferença? J Child Adolesc Psychol [Internet]. 2012 [cited 2017 Jan 12]; 1:65-79. Available from: http://revistas.lis.ulusiada.pt/index.php/rpca/article/view/9/pdf
http://revistas.lis.ulusiada.pt/index.ph...
), with occurrence rates varying from 7% to 43% for victims and from 5% to 44% for bullies(55 Silva JL, Oliveira WA, Sampaio JMC, Farias MS, Alencastro LCS, Silva MAI. How do you feel? Students’ emotions after practicing bullying. Rev Eletr Enferm [Internet]. 2015 [cited 2017 Feb 26]; 17:1-8. Available from: http://dx.doi.org/10.5216/ree.v17i4.32735
http://dx.doi.org/10.5216/ree.v17i4.3273...
-66 Cook CR, Williams KR, Guerra NG, Kim TE. Variability in the prevalence of bullying and victimization: A cross-national and methodological analysis. In: Jimerson SR, Swearer S, Espelage DL, (Eds.). Handbook of bullying in schools: An international perspective. New York: Routledge; 2010.), with an overall mean of 26%(77 Craig W, Harel-Fisch Y, Fogel-Grinvald H, Dostaler S, Hetland J, Simons-Morton B, et al. A cross-national profile of bullying and victimization among adolescents in 40 countries. Int J Public Health [Internet]. 2009[cited 2017 Feb 23];54(Suppl 2):216-224. Available from: http://dx.doi.org/10.1007/s00038-009-5413-9
http://dx.doi.org/10.1007/s00038-009-541...
). In Brazil, the National School-based Student Health Survey indicated a mean occurrence of 28%(88 Oliveira WA, Silva MAI, Silva JL, Mello FCM, Prado RR, Malta DC. Associations between the practice of bullying and individual and contextual variables from the aggressors’ perspective. J Pediatr (Rio J) [Internet]. 2016 [cited 2016 Dec 17]; 92:32-9. Available from: http://www.scielo.br/pdf/jped/v92n1/1678-4782-jped-92-01-00032.pdf
http://www.scielo.br/pdf/jped/v92n1/1678...
).

Identifying bullying can be difficult for the educational team, therefore, it may continue for long periods of time and, thus, negatively affect the education, health and quality of life of the students involved (victims, bullies and witnesses)(99 Haraldstad K, Christophersen KA, Eide H, Nativg GK, Helseth S. Predictors of health-related quality of life in a sample of children and adolescents: a school survey. J Clin Nurs [Internet]. 2011 [cited 2016 Dec 13]; 20(21-22):3048-56. Available from: http://dx.doi.org/10.1111/j.1365-2702.2010.03693.x.
http://dx.doi.org/10.1111/j.1365-2702.20...
). However, victims are part of a more vulnerable group because they suffer directly and indirectly from these aggressions. Consequently, they demand interventions that could put an end to this violence. Some negative consequences for this group of students are feelings of insecurity, poor school performance, depression, insomnia and suicide(1010 Silva JL, Oliveira WA, Braga IF, Farias MS, Lizzi EAS, Fagundes MG, et al. The effects of a skill-based intervention for victims of bullying in Brazil. Int J Environ Res Public Health [Internet]. 2016 [cited 2016 Nov 30]; 13:1042-52. Available from: http://www.mdpi.com/1660-4601/13/11/1042/htm
http://www.mdpi.com/1660-4601/13/11/1042...

11 Murphy S, Murphy J, Shevlin M. Negative evaluations of self and others, and peer victimization as mediators of the relationship between childhood adversity and psychotic experiences in adolescence: the moderating role of loneliness. Br J Clin Psychol [Internet]. 2015 [cited 2017 Jan 18]; 54:326-44. Available from: http://dx.doi.org/10.1111/bjc.12077
http://dx.doi.org/10.1111/bjc.12077 ...
-1212 Almeida LS, Lisboa C. Habilidades sociais e bullying: uma revisão sistemática. Cont Clínicos [Internet]. 2014 [cited 2017 Jan 12]; 7:62-75. Available from: http://pepsic.bvsalud.org/pdf/cclin/v7n1/v7n1a07.pdf
http://pepsic.bvsalud.org/pdf/cclin/v7n1...
).

Most victimized students, known as typical victims, have personal characteristics related to the lack of self-defense skills and difficulty to ask colleagues or teachers for help, such as shyness, anxiety and few friends(1010 Silva JL, Oliveira WA, Braga IF, Farias MS, Lizzi EAS, Fagundes MG, et al. The effects of a skill-based intervention for victims of bullying in Brazil. Int J Environ Res Public Health [Internet]. 2016 [cited 2016 Nov 30]; 13:1042-52. Available from: http://www.mdpi.com/1660-4601/13/11/1042/htm
http://www.mdpi.com/1660-4601/13/11/1042...
,1212 Almeida LS, Lisboa C. Habilidades sociais e bullying: uma revisão sistemática. Cont Clínicos [Internet]. 2014 [cited 2017 Jan 12]; 7:62-75. Available from: http://pepsic.bvsalud.org/pdf/cclin/v7n1/v7n1a07.pdf
http://pepsic.bvsalud.org/pdf/cclin/v7n1...
). Nevertheless, there is still another profile of bully-victims, who are characterized by both victimization and aggression high rates: they have disorganized and impulsive behavior, ineffectively responding to aggressions, and lack conflict resolution skills to solve their relational problems properly. Bully-victims are at greater risk of social rejection and development of psychosocial problems(1313 Hussein MH. The social and emotional skills of bullies, victims, and bully-victims of Egyptian primary school children. Int J Psychol [Internet]. 2013 [cited 2016 Dec 16]; 48:910-21. Available from: http://dx.doi.org/10.1080/00207594.2012.702908
http://dx.doi.org/10.1080/00207594.2012....
).

Both profiles present a common feature: lack of social skills. Social skills are behaviors that allow a person to be judged as competent in social tasks. A socially competent person can make and maintain friends easily, has good emotional control and can solve interpersonal problems without generating more conflict(1414 Del Prette ZAP, Del Prette A. Psicologia das habilidades sociais na infância: teoria e prática. 6th ed. Petrópolis: Vozes; 2013.). The improvement of the social skills of victimized students is important to promote greater social and emotional skills, which can reduce the vulnerability to bullying by facilitating friendships, conflict resolution, emotional self-control and adaptive coping strategies(1010 Silva JL, Oliveira WA, Braga IF, Farias MS, Lizzi EAS, Fagundes MG, et al. The effects of a skill-based intervention for victims of bullying in Brazil. Int J Environ Res Public Health [Internet]. 2016 [cited 2016 Nov 30]; 13:1042-52. Available from: http://www.mdpi.com/1660-4601/13/11/1042/htm
http://www.mdpi.com/1660-4601/13/11/1042...
,1515 Terroso LB, Wendt GW, Oliveira MS, Argimon IIL. Habilidades sociais e bullying em adolescentes. Temas Psicol [Internet]. 2016 [cited 2017 Jan 12]; 24:251-59. Available from: http://pepsic.bvsalud.org/pdf/tp/v24n1/v24n1a13.pdf
http://pepsic.bvsalud.org/pdf/tp/v24n1/v...
).

Interventions based on social skills have been developed in different countries and some of them follow the orientations from the World Health Organization (WHO), which recommends interventions aimed at the prevention and reduction of school violence as an initiative to promote health and improve the students’ quality of life(1616 Espelage DL, Low S, Polanin JR, Brown EC. The impact of a middle school program to reduce aggression, victimization, and sexual violence. J Adolesc Health [Internet]. 2013 [cited 2016 Nov 30]; 53:180-86. Available from: http://dx.doi.org/10.1016/j.jadohealth.2013.02.021
http://dx.doi.org/10.1016/j.jadohealth.2...
-1717 Karasimopoulou S, Zervoudaki VDE. Children’s perception about their health-related quality of life: effects of a health education-social skills program. Health Educ Res [Internet]. 2012 [cited 2016 Nov 30]; 27:780-93. Available from: http://dx.doi.org/10.1093/her/cys089
http://dx.doi.org/10.1093/her/cys089 ...
). This type of intervention was successful in reducing victimization in the United States(1818 Jenson JM, Dieterich WA. Effects of a skills-based prevention program on bullying and bully victimization among elementary school children. Prev Sci [Internet]. 2007 [cited 2017 Jan 14]; 8:285-96. Available from: http://dx.doi.org/10.1007/s11121-007-0076-3
http://dx.doi.org/10.1007/s11121-007-007...
), where most anti-bullying programs have minimal effect. In Australia, there was also a significant reduction in victimization among victims with anxiety symptoms(1919 Berry K, Hunt CJ. Evaluation of an intervention program for anxious adolescent boys who are bullied at school. J Adolesc Health [Internet]. 2009 [cited 2016 Nov 22]; 45:376-82. Available from: http://dx.doi.org/10.1016/j.jadohealth.2009.04.023
http://dx.doi.org/10.1016/j.jadohealth.2...
).

School is often marked by changes that require from the students adaptation efforts that can be facilitated by higher levels of social skills(2020 Farmer TW, Xie H. Aggression and school social dynamics: the good, the bad, and the ordinary. J Sch Psychol [Internet]. 2007 [cited 2016 Dec 20]; 45:461-78. Available from: http://dx.doi.org/10.1016/j.jsp.2007.06.008
http://dx.doi.org/10.1016/j.jsp.2007.06....
). For example, in the transition from elementary to middle school, students need to deal with the change of school, new school subjects, changes in the way they interact with teachers, and are also in contact with a larger number of unknown colleagues(2020 Farmer TW, Xie H. Aggression and school social dynamics: the good, the bad, and the ordinary. J Sch Psychol [Internet]. 2007 [cited 2016 Dec 20]; 45:461-78. Available from: http://dx.doi.org/10.1016/j.jsp.2007.06.008
http://dx.doi.org/10.1016/j.jsp.2007.06....

21 Santos ZA, Soares AB. Habilidades sociais e bullying: um estudo entre agressores e vítimas. Psicol Argum [Internet]. 2016 [cited 2016 Nov 27]; 34:51-64. Available from: http://www2.pucpr.br/reol/pb/index.php/pa?dd1=16327&dd99=view&dd98=pb
http://www2.pucpr.br/reol/pb/index.php/p...
-2222 Silva JL, Oliveira WA, Bazon MR, Cecilio S. Bullying: conhecimentos, atitudes e crenças de professores. Psicol [Internet]. 2014 [cited 2017 Jan 11]; 45(2):147-56. Available from: http://revistaseletronicas.pucrs.br/ojs/index.php/revistapsico/article/view/12683/11704
http://revistaseletronicas.pucrs.br/ojs/...
). In this context, the victim’s lack of social skills can make it difficult to make friendships, defend from aggression and adapt during the transition period.

Literature indicates the need to intervene early in violence, aiming to prevent it and promote healthy behaviors, avoiding the development of school and health problems(2323 Miller S, Williams J, Cutbush S, Gibbs D, Clinton-Sherrod M, Jones S. Evaluation of the Start Strong Initiative: preventing teen dating violence and promoting healthy relationships among middle school students. J Adolesc Health [Internet]. 2015[cited 2017 Feb 19];56(2 Suppl 2):S14-9. Available from: http://dx.doi.org/10.1016/j.jadohealth.2014.11.003
http://dx.doi.org/10.1016/j.jadohealth.2...
). In this context, it is also important to check if the results of the interventions persist over time or are restricted to a short period after their completion. The most effective interventions are those that can maintain their results for long periods after their implementation (1010 Silva JL, Oliveira WA, Braga IF, Farias MS, Lizzi EAS, Fagundes MG, et al. The effects of a skill-based intervention for victims of bullying in Brazil. Int J Environ Res Public Health [Internet]. 2016 [cited 2016 Nov 30]; 13:1042-52. Available from: http://www.mdpi.com/1660-4601/13/11/1042/htm
http://www.mdpi.com/1660-4601/13/11/1042...
).

OBJECTIVE

To verify if the improvement of social and emotional skills reduces bullying victimization in 6th grade students 12 months after the end of the intervention.

METHOD

Ethical aspects

The study was approved by the Research Ethics Committee of the University of São Paulo, Ribeirão Preto Nursing School. The Regional Education Board and school principals also authorized the research. Parents/guardians consented to the participation of the students through the signing of a Consent Form (CF). Adolescents signed an Agreement Term. In all stages of the investigation, the recommendations and guidelines of Resolution 466/2012 of the National Health Council were followed.

Study design, setting and study date

This is an intervention study with quasi-experimental design carried out in six public schools1 1 Public schools in Brazil are fully founded by the government and free of fees for the population. in a city located in the countryside of the state of São Paulo. Pre and post-test evaluations were conducted respectively in March and June 2015 with intervention and control groups. The intervention based on social skills was conducted between March and May, in 2015. The follow-up evaluation occurred one year later, in June 2016.

Study population and inclusion criteria

A total of 522 6th grade students from six public schools were invited to participate in the study, of which 411 accepted to answer the questionnaires. Subsequently, 85 victims were identified, but 5 withdrew participation during the sessions and were excluded from the study. The final sample consisted of 78 participants, 40 (51.3%) typical victims and 38 (48.7%) bully-victims. The inclusion criteria were: having a high frequency of attendance, having authorization from a parent or guardian for participating in the study and being a victim of bullying. Considering the sample with 78 subjects, with a magnitude of effect of 0.22 (between low and medium), we obtain a “sample power” of 64%.

Protocol

Eight weekly sessions were held in the schools, with 50 minutes each. Each group had 8 to 10 participants. The sessions addressed content and activities related to good manners, making friends, empathy, self-control, emotional expressiveness, assertiveness and solution of interpersonal problems(1414 Del Prette ZAP, Del Prette A. Psicologia das habilidades sociais na infância: teoria e prática. 6th ed. Petrópolis: Vozes; 2013.). The intervention was conducted by one of the researchers responsible for the study, and the contents and activities followed specific instructions(1414 Del Prette ZAP, Del Prette A. Psicologia das habilidades sociais na infância: teoria e prática. 6th ed. Petrópolis: Vozes; 2013.), with the objective of ensuring fidelity in the application of the intervention.

The structure of the sessions was based on cognitive-behavioral techniques: role-play, dramatizations, positive reinforcement, modeling, feedback, videos and homework. Each meeting was organized in three moments: 1) beginning - the participants commented about the homework and received feedback, orientation and support from the group and from the coordinator; then, a brief summary of the previous meeting was present; 2) middle - the activities scheduled for the meeting; 3) end - homework assignment and feedback on the meeting from the participants and from the coordinator. Homework assignments were strategies designed to offer support to students in the generalization of social skills in contexts other than the intervention environment. In the intervention process, students not involved in bullying situations were also included as an extra component, aiming to promote an interaction between victims and prosocial peers and to stimulate friendships that increased the social support and the help offered to the victims. However, the results presented in this article refer only to the victims who were the focus of the study.

Participants were allocated in intervention and control groups within the same schools in order to have comparable samples. Thus, the nine classrooms of the intervention group and the nine classrooms of the control group presented similar amounts of victims, bullies and students not involved in bullying situations. All the students not involved and the victims in the classrooms of the intervention group were invited to participate in the intervention. All of them agreed to participate in the intervention proposed. The students were distributed in the groups (intervention and control) in an average proportion of 40-50% of victims and 50-60% of students not involved. The same procedure occurred for gender because there were more girls than boys.

The assessment of the amount of bullying practiced or suffered by the students, as well as the definition of the profile to which they belonged (victims, bully-victims, bullies and not-involved) was obtained by applying the Peer Victimization and Aggression Scale - EVAP(2424 Cunha JM, Weber LND, Steiner Neto P. Escala de Vitimização e Agressão entre Pares (EVAP). In: Weber LND, Dessen MA, (Eds.). Pesquisando a família: instrumentos para coleta e análise de dados. Curitiba: Juruá; 2009. p. 103-14.), which provided the mean of victimization, total aggression, aggression per participant of the groups (intervention and control) and the definition of the profiles. The difficulty in social skills was evaluated by the Social Skills Multimedia System for Children (SMHSC)(2525 Del Prette A, Del Prette ZAP. Sistema multimídia de habilidades sociais de crianças. São Paulo: Casa do Psicólogo; 2005.), which provided standardized scores for each subject and was used to calculate the means of the groups. The Sociometric Scale(2626 Martins MJD. Maus tratos entre adolescentes na escola. Lisboa: Editorial Novembro; 2009.) provided the gross scores of the participants by the sum of the indications received in the variables peer acceptance, few friends, conflict resolution and sympathy. The groups were evaluated with the same instruments before the intervention (pre-test), after the intervention (post-test) and one year later (follow up).

Analysis of results and statistics

The analysis was performed with the SAS program, using the procedure of generalized linear models (PROC GENMOD). Initially, the results were described in mean and standard deviation. Then, the scores of the variables of interest were compared regarding time (pre-test and post-test) and groups (intervention and control). This step was performed using Poisson regression models with a random effect(2727 Cameron C, Trivedi PK. Regression analysis of count data. 2nd ed. London: Cambridge University Press; 2013.). Considering that the standard deviation was higher than the mean for the variables difficulty in social skills, few friends, conflict resolution and sympathy, an over-dispersion component was added to correct the results due to variability. A significance level of 5%, p <0.05 was considered for all analyzes.

RESULTS

The two groups were equivalent in relation to the sociodemographic characteristics. The mean age in the intervention group was 11.28 years old and in the comparison group it was 11.21 years old. The proportion of females was 72.1% in the intervention group and 58.8% in the control group, a non-statistically significant difference (p = 0.07). The skin color was similar in the groups (p=0.566): the intervention group had browns (48.8%), whites (38.4%), blacks (8.1%) and others (4.7%); in the control group, the proportions were browns (43.1%), whites (42.2%), blacks (8.8%) and others (5.8%). There was a sample loss of three subjects from the intervention group (7.3%) between the pre-test evaluation and the follow-up evaluation and two subjects from the control group (4.8%).

Table 1 shows the differences obtained by the Poisson regression model for the variables in relation to the intervention group and the comparison group in the pre-test and the follow up.

Table 1
Comparison of the groups (intervention and control) in relation to the time (pre-test and follow up), via the Poisson regression model, Ribeirão Preto, São Paulo, Brazil

The results indicated a significant reduction in the total victimization in the intervention group (β = 0.276, SE = 0.087, p <0.0001) and in the control group (β = 0.252, SE = 0.062, p<0.0001). Only the control group presented a significant reduction in physical victimization (β = 0.274, SE = 0.056, p = 0.013). Verbal victimization was significantly reduced for both the intervention group (β = 0.266, SE = 0.111, p = 0.0008) and the control group (β = 0.210, SE = 0.065, p = 0.0045). Relational victimization also showed a significant reduction for the victims of the intervention group (β = 0.273, SE = 0.090, p = 0.0024) and the control group (β = 0.297, SE = 0.086, p = 0.0006). There were no significant differences in the aggression variable, but total aggression increased slightly in the control group. Only the intervention group presented a significant reduction in the difficulty in social skills (β = 0.514, SE = 0.231, p = 0.026). Peer acceptance increased in the intervention group and decreased in the control group, but not significantly so. The indication of few friends decreased, not significantly, in the intervention group. Conflict resolution increased for victims in the intervention and control groups, but not significantly so. Sympathy increased for both groups, although not significantly.

DISCUSSION

The objective of this study was to verify if the improvement of social skills reduced bullying victimization in 6th grade students 12 months after an intervention. The results demonstrated that the intervention achieved its goal by significantly reducing the difficulty the victims of bullying had in social skills, a result maintained one year after the intervention. This means that the participants started acting with more politeness, empathy and emotional self-control and could solve interpersonal problems with their peers in a non-violent way, which is essential for making friendships. They also presented an increase in social support and in the capacity to defend themselves from aggressions(1010 Silva JL, Oliveira WA, Braga IF, Farias MS, Lizzi EAS, Fagundes MG, et al. The effects of a skill-based intervention for victims of bullying in Brazil. Int J Environ Res Public Health [Internet]. 2016 [cited 2016 Nov 30]; 13:1042-52. Available from: http://www.mdpi.com/1660-4601/13/11/1042/htm
http://www.mdpi.com/1660-4601/13/11/1042...
,1414 Del Prette ZAP, Del Prette A. Psicologia das habilidades sociais na infância: teoria e prática. 6th ed. Petrópolis: Vozes; 2013.).

Learning assertive coping strategies and a better emotional control can interrupt the cycle of aggression and, thus, increase the quality of social interactions and of the victims’ life(1717 Karasimopoulou S, Zervoudaki VDE. Children’s perception about their health-related quality of life: effects of a health education-social skills program. Health Educ Res [Internet]. 2012 [cited 2016 Nov 30]; 27:780-93. Available from: http://dx.doi.org/10.1093/her/cys089
http://dx.doi.org/10.1093/her/cys089 ...
). This empowerment, related to the improvement of skills that reduce the vulnerability to bullying, also indicates that they will be able to effectively deal with similar situations throughout life. This aspect is important because studies indicate that the lack of social skills can remain unchanged over time and lead to low self-esteem, anxiety, shyness and passivity, characteristics that predispose students to victimization and compromise their healthy development(1212 Almeida LS, Lisboa C. Habilidades sociais e bullying: uma revisão sistemática. Cont Clínicos [Internet]. 2014 [cited 2017 Jan 12]; 7:62-75. Available from: http://pepsic.bvsalud.org/pdf/cclin/v7n1/v7n1a07.pdf
http://pepsic.bvsalud.org/pdf/cclin/v7n1...
,2828 Silva MAI, Silva JL, Pereira BO, Oliveira WA, Medeiros M. The view of teachers on bullying and implications for nursing. Rev Esc Enferm USP [Internet]. 2014 [cited 2017 Jan 16]; 48:723-30. Available from: http://www.scielo.br/pdf/reeusp/v48n4/0080-6234-reeusp-48-04-723.pdf
http://www.scielo.br/pdf/reeusp/v48n4/00...
-2929 Hunt C. Understanding and combating school-based bullying from an individual-level perspective: a review. Aust Psychol [Internet]. 2015 [cited 2017 Jan 18]; 50:182-85. Available from: http://dx.doi.org/10.1111/ap.12093
http://dx.doi.org/10.1111/ap.12093 ...
).

Despite the improvement in social skills acquired by the victims participating in this study, victimization was significantly reduced in both groups (intervention and control), suggesting that other variables, not related to social skills, may have influenced the groups and collaborated to reduce this factor in the participants’ experience. One possible explanation is that the pre-test was performed at the beginning of the school year, during the transition period. Thus, the victimization may have occurred because of the numerous challenges faced by students when making new friendships and adapting to the new school organization(2020 Farmer TW, Xie H. Aggression and school social dynamics: the good, the bad, and the ordinary. J Sch Psychol [Internet]. 2007 [cited 2016 Dec 20]; 45:461-78. Available from: http://dx.doi.org/10.1016/j.jsp.2007.06.008
http://dx.doi.org/10.1016/j.jsp.2007.06....
-2121 Santos ZA, Soares AB. Habilidades sociais e bullying: um estudo entre agressores e vítimas. Psicol Argum [Internet]. 2016 [cited 2016 Nov 27]; 34:51-64. Available from: http://www2.pucpr.br/reol/pb/index.php/pa?dd1=16327&dd99=view&dd98=pb
http://www2.pucpr.br/reol/pb/index.php/p...
). The follow-up evaluation occurred one year later, long enough for students to be more accommodated, to have friendships, and consequently to have fewer situations of violence among their social interactions.

The same explanation, however, does not apply to the variable aggression, which did not show variation in the intervention group and did not significantly increase in the control group. When the victims respond passively to the aggressions suffered (with submission and easy crying, for example), it can reinforce the aggressions by signaling to the bully that they obtained success with their actions(3030 Crawford AM, Manassis K. Anxiety, social skills, friendship quality, and peer victimization: an integrated model. J Anxiety Disord [Internet]. 2011 [cited 2017 Jan 13]; 25:924-31. Available from: http://dx.doi.org/10.1016/j.janxdis.2011.05.005
http://dx.doi.org/10.1016/j.janxdis.2011...
). However, responding aggressively can also increase the frequency of bullying over time (3131 Sentse M, Kretschmer T, Salmivalli C. The longitudinal interplay between bullying, victimization, and social status: age-related and gender differences. Soc Dev [Internet]. 2015 [cited 2017 Jan 13]; 24:659-77. Available from: http://dx.doi.org/10.1111/sode.12115
http://dx.doi.org/10.1111/sode.12115 ...
). The increase in aggression in the control group suggests that this factor may be used as a form of self-defense or conflict resolution. Thus, the best outcome in the intervention group may be related to the improvement in social skills and not to unknown variables, such as victimization. The result of the control group may also have occurred because of students' strive for greater social status or acceptance. Increased concern with social status may encourage aggression as a form of self-assertion and search for popularity(3232 Silva JL, Bazon MR. Educação escolar e conduta infracional em adolescentes: revisão integrativa da literatura. Estud Psicol (Natal) [Internet]. 2015 [cited 2017 Jan 13]; 19:278-87. Available from: http://www.scielo.br/pdf/epsic/v19n4/a05v19n4.pdf
http://www.scielo.br/pdf/epsic/v19n4/a05...
).

The data presented are an interesting result because, even though students bully their colleagues, they also had greater peer acceptance. A similar result was presented in another study in which aggression by boys contributed to greater peer acceptance(3333 Levandoski G, Cardoso F. Imagem corporal e status social de estudantes brasileiros envolvidos em bullying. Rev Latinoam Psicol [Internet]. 2013 [cited 2017 Jan 22]; 45:135-45. Available from: http://www.scielo.org.co/pdf/rlps/v45n1/v45n1a10.pdf
http://www.scielo.org.co/pdf/rlps/v45n1/...
). This may occur in contexts in which violence is considered normative in the peer group or promoter of higher social status for the bullies.

Peer acceptance also increased in the intervention group and the indication of having few friends decreased. There was no significant difference; however, the results show improvements in the social position of the victims in the perception of the peers. The interaction between students not involved and victims during the sessions may have contributed to increase the participants’ peer network. Since social isolation can increase vulnerability to bullying(1010 Silva JL, Oliveira WA, Braga IF, Farias MS, Lizzi EAS, Fagundes MG, et al. The effects of a skill-based intervention for victims of bullying in Brazil. Int J Environ Res Public Health [Internet]. 2016 [cited 2016 Nov 30]; 13:1042-52. Available from: http://www.mdpi.com/1660-4601/13/11/1042/htm
http://www.mdpi.com/1660-4601/13/11/1042...
), every positive result should be valued. It is not possible to attribute the reduction of victimization to the intervention, however, other results attest to the success of the study, such as a significant improvement in social skills and a tendency towards improvement in peer acceptance and reduction in the indication of few friends.

Limitations of the study

The present study has some limitations. Firstly, the instrument used to collect data on bullying does not assess situations of cyber bullying, a type of aggression that has increased due to the wider access to the Internet among students and the greater anonymity that this aggressive practice provides(3434 Lee C, Shin N. Prevalence of cyberbullying and predictors of cyberbullying perpetration among Korean adolescents. Comput Human Behav [Internet]. 2017 [cited 2017 Mar 21]; 68:352-58. Available from: http://dx.doi.org/10.1016/j.chb.2016.11.047
http://dx.doi.org/10.1016/j.chb.2016.11....
). The allocation of the participants in the intervention and control groups occurred by classroom and not by school. It would be more appropriate to distribute the schools, not the classrooms, between the groups, in order to avoid the possibility of the participants in the intervention commenting about the program with colleagues who were in the control group in the same school, but different classrooms. Future research may overcome such limitations by separating intervention and control groups by school and by using instruments that also include cyber bullying in order to assess the occurrence of aggressions through aggressive or vexatious messages disseminated through cell phones, e-mail, social networks or web pages.

Contributions to the area of Nursing and Health

For the nursing area, the study addresses a theme that has not yet been explored in the nurses’ practice and in professional practice scenarios(3535 Silva MAI. Bullying among peers at school: a challenge for primary healthcare nurses. Rev Eletr Enferm [Internet]. 2013 [cited 2016 Dec 14]; 15:603-4. Available from: https://www.fen.ufg.br/fen_revista/v15/n3/pdf/v15n3a01-en.pdf
https://www.fen.ufg.br/fen_revista/v15/n...
). A recent study shows that the performance of Primary Health Care (PHC) professionals in the area of violence against children and adolescents in articulated and intersectoral actions is still a challenge(3636 Carlos DM, Pádua EMM, Silva LMP, Silva MAI, Marques WEU, Leitão MNC, et al. The care network of the families involved in family violence against children and adolescents: the Primary Health Care perspective. J Clin Nurs [Internet]. 2017 [cited 2017 Mar 21]; 27:1-16. Available from: http://dx.doi.org/10.1111/jocn.13692
http://dx.doi.org/10.1111/jocn.13692 ...
). As a result, models addressing potentialities and focusing on health promotion, as an alternative to preventive models focused on problems and diseases, can be essential and coherent to health care and nursing. Nursing professionals are indispensable in this debate, due to their privileged space among the healthcare teams, especially in PHC. Social skills can be associated with Nursing Theories to design systematized assistance for children and adolescents, with actions that foster empowerment and youth protagonism.

This study also provides information to stimulate healthcare teams to reflect upon the importance of adopting active and participative methodologies to favor the development of social skills in bullying victims and to provide care to families when listening and dealing with this issue(3535 Silva MAI. Bullying among peers at school: a challenge for primary healthcare nurses. Rev Eletr Enferm [Internet]. 2013 [cited 2016 Dec 14]; 15:603-4. Available from: https://www.fen.ufg.br/fen_revista/v15/n3/pdf/v15n3a01-en.pdf
https://www.fen.ufg.br/fen_revista/v15/n...
). There are also data that can support intersectoral health teams in the development of practices for preventing and dealing with bullying, in line, for example, with the principles of the School Health Program(3737 Pinto AKP, Motta-Rocha FE. Health relation-school: challenges and perspectives. J Res Spec Educ Needs [Internet]. 2016[cited 2017 Feb 26];16(Suppl-1):945-49. Available from: http://dx.doi.org/10.1111/1471-3802.12237
http://dx.doi.org/10.1111/1471-3802.1223...
), which encourages primary care in the country to develop education and health promotion actions to prevent violence and bullying and to stimulate a peace culture in schools(2828 Silva MAI, Silva JL, Pereira BO, Oliveira WA, Medeiros M. The view of teachers on bullying and implications for nursing. Rev Esc Enferm USP [Internet]. 2014 [cited 2017 Jan 16]; 48:723-30. Available from: http://www.scielo.br/pdf/reeusp/v48n4/0080-6234-reeusp-48-04-723.pdf
http://www.scielo.br/pdf/reeusp/v48n4/00...
).

CONCLUSION

The significant reduction in the difficulty in social skills persisted over time, demonstrating the success of the intervention in relation to this variable, which is an important aspect in the interaction between peers, especially in periods of school transition. Thus, social skills can be the basis for intersectoral interventions in the area of health, aimed at favoring the empowerment of bullying victims by improving their interactions and quality of life in school. On the other hand, since the significant reduction of victimization in the investigated sample could not be attributed exclusively to the improvement in social skills, despite the greater reduction in the intervention group, other intervention models should be tested in the Brazilian reality, aiming to identify the most effective variables related to bullying victimization.

  • FUNDING
    The present study was funded by the São Paulo Research Foundation (FAPESP), Grant 2013/22361-5 and Grant 2015/01794-6.
  • 1
    Public schools in Brazil are fully founded by the government and free of fees for the population.

REFERENCES

  • 1
    Silva JL, Oliveira WA, Bono EL, Dib MA, Bazon MR, Silva MAI. Associações entre bullying escolar e conduta infracional: revisão sistemática de estudos longitudinais. Psic Teor e Pesq [Internet]. 2016 [cited 2017 Mar 20]; 32(1):81-90. Available from: http://www.scielo.br/pdf/ptp/v32n1/1806-3446-ptp-32-01-00081.pdf
    » http://www.scielo.br/pdf/ptp/v32n1/1806-3446-ptp-32-01-00081.pdf
  • 2
    Olweus D. School bullying: development and some important challenges. Annu Rev Clin Psychol [Internet]. 2013 [cited 2017 Feb 23]; 9:751-80. Available from: http://www.annualreviews.org/doi/10.1146/annurev-clinpsy-050212-185516
    » http://www.annualreviews.org/doi/10.1146/annurev-clinpsy-050212-185516
  • 3
    Sampaio JMC, Santos GV, Oliveira WA, Silva JL, Medeiros M, Silva MAI. Emotions of students involved in cases of bullying. Texto Contexto Enferm [Internet]. 2015 [cited 2016 Dec 13]; 24:344-52. Available from: http://www.scielo.br/pdf/tce/v24n2/0104-0707-tce-24-02-00344.pdf
    » http://www.scielo.br/pdf/tce/v24n2/0104-0707-tce-24-02-00344.pdf
  • 4
    Matos MMNG. Prevenção da violência interpessoal em meio escolar: os professores, as famílias e a comunidade também marcam uma diferença? J Child Adolesc Psychol [Internet]. 2012 [cited 2017 Jan 12]; 1:65-79. Available from: http://revistas.lis.ulusiada.pt/index.php/rpca/article/view/9/pdf
    » http://revistas.lis.ulusiada.pt/index.php/rpca/article/view/9/pdf
  • 5
    Silva JL, Oliveira WA, Sampaio JMC, Farias MS, Alencastro LCS, Silva MAI. How do you feel? Students’ emotions after practicing bullying. Rev Eletr Enferm [Internet]. 2015 [cited 2017 Feb 26]; 17:1-8. Available from: http://dx.doi.org/10.5216/ree.v17i4.32735
    » http://dx.doi.org/10.5216/ree.v17i4.32735
  • 6
    Cook CR, Williams KR, Guerra NG, Kim TE. Variability in the prevalence of bullying and victimization: A cross-national and methodological analysis. In: Jimerson SR, Swearer S, Espelage DL, (Eds.). Handbook of bullying in schools: An international perspective. New York: Routledge; 2010.
  • 7
    Craig W, Harel-Fisch Y, Fogel-Grinvald H, Dostaler S, Hetland J, Simons-Morton B, et al. A cross-national profile of bullying and victimization among adolescents in 40 countries. Int J Public Health [Internet]. 2009[cited 2017 Feb 23];54(Suppl 2):216-224. Available from: http://dx.doi.org/10.1007/s00038-009-5413-9
    » http://dx.doi.org/10.1007/s00038-009-5413-9
  • 8
    Oliveira WA, Silva MAI, Silva JL, Mello FCM, Prado RR, Malta DC. Associations between the practice of bullying and individual and contextual variables from the aggressors’ perspective. J Pediatr (Rio J) [Internet]. 2016 [cited 2016 Dec 17]; 92:32-9. Available from: http://www.scielo.br/pdf/jped/v92n1/1678-4782-jped-92-01-00032.pdf
    » http://www.scielo.br/pdf/jped/v92n1/1678-4782-jped-92-01-00032.pdf
  • 9
    Haraldstad K, Christophersen KA, Eide H, Nativg GK, Helseth S. Predictors of health-related quality of life in a sample of children and adolescents: a school survey. J Clin Nurs [Internet]. 2011 [cited 2016 Dec 13]; 20(21-22):3048-56. Available from: http://dx.doi.org/10.1111/j.1365-2702.2010.03693.x.
    » http://dx.doi.org/10.1111/j.1365-2702.2010.03693.x.
  • 10
    Silva JL, Oliveira WA, Braga IF, Farias MS, Lizzi EAS, Fagundes MG, et al. The effects of a skill-based intervention for victims of bullying in Brazil. Int J Environ Res Public Health [Internet]. 2016 [cited 2016 Nov 30]; 13:1042-52. Available from: http://www.mdpi.com/1660-4601/13/11/1042/htm
    » http://www.mdpi.com/1660-4601/13/11/1042/htm
  • 11
    Murphy S, Murphy J, Shevlin M. Negative evaluations of self and others, and peer victimization as mediators of the relationship between childhood adversity and psychotic experiences in adolescence: the moderating role of loneliness. Br J Clin Psychol [Internet]. 2015 [cited 2017 Jan 18]; 54:326-44. Available from: http://dx.doi.org/10.1111/bjc.12077
    » http://dx.doi.org/10.1111/bjc.12077
  • 12
    Almeida LS, Lisboa C. Habilidades sociais e bullying: uma revisão sistemática. Cont Clínicos [Internet]. 2014 [cited 2017 Jan 12]; 7:62-75. Available from: http://pepsic.bvsalud.org/pdf/cclin/v7n1/v7n1a07.pdf
    » http://pepsic.bvsalud.org/pdf/cclin/v7n1/v7n1a07.pdf
  • 13
    Hussein MH. The social and emotional skills of bullies, victims, and bully-victims of Egyptian primary school children. Int J Psychol [Internet]. 2013 [cited 2016 Dec 16]; 48:910-21. Available from: http://dx.doi.org/10.1080/00207594.2012.702908
    » http://dx.doi.org/10.1080/00207594.2012.702908
  • 14
    Del Prette ZAP, Del Prette A. Psicologia das habilidades sociais na infância: teoria e prática. 6th ed. Petrópolis: Vozes; 2013.
  • 15
    Terroso LB, Wendt GW, Oliveira MS, Argimon IIL. Habilidades sociais e bullying em adolescentes. Temas Psicol [Internet]. 2016 [cited 2017 Jan 12]; 24:251-59. Available from: http://pepsic.bvsalud.org/pdf/tp/v24n1/v24n1a13.pdf
    » http://pepsic.bvsalud.org/pdf/tp/v24n1/v24n1a13.pdf
  • 16
    Espelage DL, Low S, Polanin JR, Brown EC. The impact of a middle school program to reduce aggression, victimization, and sexual violence. J Adolesc Health [Internet]. 2013 [cited 2016 Nov 30]; 53:180-86. Available from: http://dx.doi.org/10.1016/j.jadohealth.2013.02.021
    » http://dx.doi.org/10.1016/j.jadohealth.2013.02.021
  • 17
    Karasimopoulou S, Zervoudaki VDE. Children’s perception about their health-related quality of life: effects of a health education-social skills program. Health Educ Res [Internet]. 2012 [cited 2016 Nov 30]; 27:780-93. Available from: http://dx.doi.org/10.1093/her/cys089
    » http://dx.doi.org/10.1093/her/cys089
  • 18
    Jenson JM, Dieterich WA. Effects of a skills-based prevention program on bullying and bully victimization among elementary school children. Prev Sci [Internet]. 2007 [cited 2017 Jan 14]; 8:285-96. Available from: http://dx.doi.org/10.1007/s11121-007-0076-3
    » http://dx.doi.org/10.1007/s11121-007-0076-3
  • 19
    Berry K, Hunt CJ. Evaluation of an intervention program for anxious adolescent boys who are bullied at school. J Adolesc Health [Internet]. 2009 [cited 2016 Nov 22]; 45:376-82. Available from: http://dx.doi.org/10.1016/j.jadohealth.2009.04.023
    » http://dx.doi.org/10.1016/j.jadohealth.2009.04.023
  • 20
    Farmer TW, Xie H. Aggression and school social dynamics: the good, the bad, and the ordinary. J Sch Psychol [Internet]. 2007 [cited 2016 Dec 20]; 45:461-78. Available from: http://dx.doi.org/10.1016/j.jsp.2007.06.008
    » http://dx.doi.org/10.1016/j.jsp.2007.06.008
  • 21
    Santos ZA, Soares AB. Habilidades sociais e bullying: um estudo entre agressores e vítimas. Psicol Argum [Internet]. 2016 [cited 2016 Nov 27]; 34:51-64. Available from: http://www2.pucpr.br/reol/pb/index.php/pa?dd1=16327&dd99=view&dd98=pb
    » http://www2.pucpr.br/reol/pb/index.php/pa?dd1=16327&dd99=view&dd98=pb
  • 22
    Silva JL, Oliveira WA, Bazon MR, Cecilio S. Bullying: conhecimentos, atitudes e crenças de professores. Psicol [Internet]. 2014 [cited 2017 Jan 11]; 45(2):147-56. Available from: http://revistaseletronicas.pucrs.br/ojs/index.php/revistapsico/article/view/12683/11704
    » http://revistaseletronicas.pucrs.br/ojs/index.php/revistapsico/article/view/12683/11704
  • 23
    Miller S, Williams J, Cutbush S, Gibbs D, Clinton-Sherrod M, Jones S. Evaluation of the Start Strong Initiative: preventing teen dating violence and promoting healthy relationships among middle school students. J Adolesc Health [Internet]. 2015[cited 2017 Feb 19];56(2 Suppl 2):S14-9. Available from: http://dx.doi.org/10.1016/j.jadohealth.2014.11.003
    » http://dx.doi.org/10.1016/j.jadohealth.2014.11.003
  • 24
    Cunha JM, Weber LND, Steiner Neto P. Escala de Vitimização e Agressão entre Pares (EVAP). In: Weber LND, Dessen MA, (Eds.). Pesquisando a família: instrumentos para coleta e análise de dados. Curitiba: Juruá; 2009. p. 103-14.
  • 25
    Del Prette A, Del Prette ZAP. Sistema multimídia de habilidades sociais de crianças. São Paulo: Casa do Psicólogo; 2005.
  • 26
    Martins MJD. Maus tratos entre adolescentes na escola. Lisboa: Editorial Novembro; 2009.
  • 27
    Cameron C, Trivedi PK. Regression analysis of count data. 2nd ed. London: Cambridge University Press; 2013.
  • 28
    Silva MAI, Silva JL, Pereira BO, Oliveira WA, Medeiros M. The view of teachers on bullying and implications for nursing. Rev Esc Enferm USP [Internet]. 2014 [cited 2017 Jan 16]; 48:723-30. Available from: http://www.scielo.br/pdf/reeusp/v48n4/0080-6234-reeusp-48-04-723.pdf
    » http://www.scielo.br/pdf/reeusp/v48n4/0080-6234-reeusp-48-04-723.pdf
  • 29
    Hunt C. Understanding and combating school-based bullying from an individual-level perspective: a review. Aust Psychol [Internet]. 2015 [cited 2017 Jan 18]; 50:182-85. Available from: http://dx.doi.org/10.1111/ap.12093
    » http://dx.doi.org/10.1111/ap.12093
  • 30
    Crawford AM, Manassis K. Anxiety, social skills, friendship quality, and peer victimization: an integrated model. J Anxiety Disord [Internet]. 2011 [cited 2017 Jan 13]; 25:924-31. Available from: http://dx.doi.org/10.1016/j.janxdis.2011.05.005
    » http://dx.doi.org/10.1016/j.janxdis.2011.05.005
  • 31
    Sentse M, Kretschmer T, Salmivalli C. The longitudinal interplay between bullying, victimization, and social status: age-related and gender differences. Soc Dev [Internet]. 2015 [cited 2017 Jan 13]; 24:659-77. Available from: http://dx.doi.org/10.1111/sode.12115
    » http://dx.doi.org/10.1111/sode.12115
  • 32
    Silva JL, Bazon MR. Educação escolar e conduta infracional em adolescentes: revisão integrativa da literatura. Estud Psicol (Natal) [Internet]. 2015 [cited 2017 Jan 13]; 19:278-87. Available from: http://www.scielo.br/pdf/epsic/v19n4/a05v19n4.pdf
    » http://www.scielo.br/pdf/epsic/v19n4/a05v19n4.pdf
  • 33
    Levandoski G, Cardoso F. Imagem corporal e status social de estudantes brasileiros envolvidos em bullying. Rev Latinoam Psicol [Internet]. 2013 [cited 2017 Jan 22]; 45:135-45. Available from: http://www.scielo.org.co/pdf/rlps/v45n1/v45n1a10.pdf
    » http://www.scielo.org.co/pdf/rlps/v45n1/v45n1a10.pdf
  • 34
    Lee C, Shin N. Prevalence of cyberbullying and predictors of cyberbullying perpetration among Korean adolescents. Comput Human Behav [Internet]. 2017 [cited 2017 Mar 21]; 68:352-58. Available from: http://dx.doi.org/10.1016/j.chb.2016.11.047
    » http://dx.doi.org/10.1016/j.chb.2016.11.047
  • 35
    Silva MAI. Bullying among peers at school: a challenge for primary healthcare nurses. Rev Eletr Enferm [Internet]. 2013 [cited 2016 Dec 14]; 15:603-4. Available from: https://www.fen.ufg.br/fen_revista/v15/n3/pdf/v15n3a01-en.pdf
    » https://www.fen.ufg.br/fen_revista/v15/n3/pdf/v15n3a01-en.pdf
  • 36
    Carlos DM, Pádua EMM, Silva LMP, Silva MAI, Marques WEU, Leitão MNC, et al. The care network of the families involved in family violence against children and adolescents: the Primary Health Care perspective. J Clin Nurs [Internet]. 2017 [cited 2017 Mar 21]; 27:1-16. Available from: http://dx.doi.org/10.1111/jocn.13692
    » http://dx.doi.org/10.1111/jocn.13692
  • 37
    Pinto AKP, Motta-Rocha FE. Health relation-school: challenges and perspectives. J Res Spec Educ Needs [Internet]. 2016[cited 2017 Feb 26];16(Suppl-1):945-49. Available from: http://dx.doi.org/10.1111/1471-3802.12237
    » http://dx.doi.org/10.1111/1471-3802.12237

Publication Dates

  • Publication in this collection
    May-Jun 2018

History

  • Received
    21 Mar 2017
  • Accepted
    07 June 2017
Associação Brasileira de Enfermagem SGA Norte Quadra 603 Conj. "B" - Av. L2 Norte 70830-102 Brasília, DF, Brasil, Tel.: (55 61) 3226-0653, Fax: (55 61) 3225-4473 - Brasília - DF - Brazil
E-mail: reben@abennacional.org.br