Examining the Effectiveness of School-Bullying Intervention Programs Globally: a Meta-analysis

International Journal of Bullying Prevention - Tập 1 Số 1 - Trang 14-31 - 2019
Hannah Gaffney1, David P. Farrington1, Maria M. Ttofi1
1Institute of Criminology, University of Cambridge, Sidgwick Avenue, Cambridge, CB3 9DA, UK

Tóm tắt

Từ khóa


Tài liệu tham khảo

Ahtola, A., Haataja, A., Kärnä, A., Poskiparta, E., & Salmivalli, C. (2012). For children only? Effects of the KiVa antibullying program on teachers. Teaching and Teacher Education, 28, 851–859. https://doi.org/10.1016/j.tate.2012.03.006 .

Ahtola, A., Haataja, A., Kärnä, A., Poskiparta, E., & Salmivalli, C. (2013). Implementation of anti-bullying lessons in primary classrooms: how important is head teacher support? Educational Research, 55(4), 376–392. https://doi.org/10.1080/00131881.2013.844941 .

Alsaker, F. D., & Valkanover, S. (2001). Early diagnosis and prevention of victimization in kindergarten. In J. Juvonen & S. Graham (Eds.), Peer harassment in school (pp. 175–195). New York: Guilford.

Arsenault, L., Bowes, L., & Shakoor, S. (2010). Bullying victimization in youths and mental health problems: ‘Much ado about nothing’? Psychological Medicine, 40(5), 717–729.

Atria, M., Strohmeier, D., & Spiel, C. (2007). Viennese Social Competence (ViSC) training for pupils: program and evaluation. In J. E. Zins, M. J. Elias, & C. A. Maher (Eds.), Bullying, victimization, and peer harassment: a handbook of prevention and intervention (pp. 179–197). New York: Haworth Press.

Baldry, A. C., Farrington, D. P., & Sorrentino, A. (2015). “Am I at risk of cyberbullying”? A narrative review and conceptual framework for research on risk of cyberbullying and cybervictimization: the risk and needs assessment approach. Aggression and Violent Behavior, 23, 36–51. https://doi.org/10.1016/j.avb.2015.05.014 .

Bandura, A. (1977). Social learning theory. Engleworth Cliffs: Prentice Hall.

Bauman, S. (2013). Why it matters. In S. Bauman, D. Cross, & J. Walker (Eds.), Principles of cyberbullying research: definitions, measures, and methodology (pp. 23–26). New York: Routledge.

Betts, L. R. (2016). Cyberbullying: approaches, consequences, and interventions. In J. Binder (Ed.), Palgrave studies in Cyberpsychology. London: Palgrave Macmillan.

Bonell, C., Fletcher, A., Fitzgerald-Yau, N., Hale, D., Allen, E., Elbourne, D., Jones, R., Bond, L., Wiggins, M., Miners, A., Legood, A., Scott, S., Christie, D., & Viner, R. (2015). Initiating change locally in bullying and aggression through the school environment (INCLUSIVE): a pilot randomised controlled trial. Health Technology Assessment, 19(53), 1–110.

Bronfenbrenner, U. (1979). The ecology of human development: experiments by nature and design. Cambridge: Harvard University Press.

Cantone, E., Piras, A.P., Vellante, M., Preti, A., Daníelsdóttir, S., D’Aloja, E., … & Bhugra, D. (2015). Interventions on bullying and cyberbullying in schools: a systematic review. Clinical Practice and Epidemiology in Mental Health, 11(Suppl 1 M4), 58–76. https://doi.org/10.2174/174501791511010058

Centers for Disease Control and Prevention. (2014). Bullying surveillance among school-aged children: uniform definitions and recommended data elements. Washington, DC: Centers for Disease Control and Prevention (CDC).

Chalamandaris, A., & Piette, D. (2015). School-based anti-bullying interventions: systematic review of the methodology to assess their effectiveness. Aggression and Violent Behavior, 24, 131–174. https://doi.org/10.1016/j.avb.2015.04.004 .

Chester, K. L., Callaghan, M., Cosma, A., Donnelly, P., Craig, W., Walsh, S., & Molcho, M. (2015). Cross-national time trends in bullying victimization in 33 countries among children aged 11, 13, and 15 from 2002 to 2010. European Journal of Public Health, 25(Suppl 2), 61–64. https://doi.org/10.1093/eurpub/ckv029 .

da Silva, J. L., de Oliveira, W. A., Braga, I. F., Farias, M. S., de Silva Lizzi, E. A., et al. (2016). The effects of a skill-based intervention for victims of bullying in Brazil. International Journal of Environmental Research and Public Health, 13, 1042. https://doi.org/10.3390/ijerph13111042 .

Donner, A., Piaggio, G., & Villar, J. (2001). Statistical methods for the meta-analysis of cluster randomized trials. Statistical Methods in Medical Research, 10, 325–338.

Due, P., Holstein, B. E., Lynch, J., Diderichsen, F., Nic Gabhain, S., Scheidt, P., Currie, C., & The Health Behaviour in School-aged Children Bullying working group. (2005). Bullying and symptoms among school-aged children: international comparative cross-sectional study in 28 countries. European Journal of Public Health, 15(2), 128–132. https://doi.org/10.1093/eurpub/cki105 .

Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991). Publication bias in clinical research. The Lancet, 337(8746), 867–872. https://doi.org/10.1016/0140-6736(91)90201-Y .

Elgar, F. J., Craig, W., Boyce, W., Morgan, A., & Vella-Zarb, R. (2009). Income inequality and school bullying: multilevel study of adolescents in 37 countries. Journal of Adolescent Health, 45(4), 351–359.

Elgar, F. J., Pickett, K. E., Pickett, W., Craig, W., Molcho, M., Hurrelmann, K., & Lenzi, M. (2013). School bullying, homicide and income inequality: a cross-national pooled time series analysis. International Journal of Public Health, 58(2), 237–245.

Evans, C. B. R., Fraser, M. W., & Cotter, K. L. (2014). The effectiveness of school-based bullying prevention programs: a systematic review. Aggression and Violent Behavior, 19(5), 532–544. https://doi.org/10.1016/j.avb.2014.07.004 .

Farrington, D. P. (1993). Understanding and preventing bullying. Crime and Justice, 17, 381–458.

Farrington, D. P., & Ttofi, M. M. (2009). School-based programs to reduce bullying and victimization. Campbell Systematic Reviews, 6, 1–148. https://doi.org/10.4073/csr.2009.6 .

Farrington, D. P., & Welsh, B. C. (2013). Measuring effect size in meta-analysis, with special reference to area-based crime prevention programs and the effects of close-circuit television on crime. In A. A. Kuhn, C. Schawarzenegger, P. Margot, A. Donatsch, M. Aebi, & D. Jositsch (Eds.), Criminology, criminal policy and criminal law from an international perspective (pp. 75–89). Berne: Stampfli.

Farrington, D. P., & Koegl, C. J. (2015). Monetary benefits and costs of the Stop Now and Plan program for boys aged 6 - 11, based on the prevention of later offending. Journal of Quantitative Criminology, 31(2), 263–287. https://doi.org/10.1007/s10940-014-9240-7 .

Farrington, D. P., Ttofi, M. M., & Lösel, F. A. (2016). Developmental and social prevention. In D. Weisburd, D. P. Farrington, & C. Gill (Eds.), What works in crime prevention and rehabilitation: lessons from systematic reviews (pp. 15–75). New York: Springer.

Finn, K. O’K. (2009). An evaluation of the Olweus Bullying Prevention Program. Retrieved from ProQuest Dissertations Publishing (3343406).

Fry, D., Fang, X., Elliott, S., Casey, T., Zheng, X., Li, J., Florian, L., & McCluskey, G. (2018). The relationships between violence in childhood and educational outcomes: a global systematic review and meta-analysis. Child Abuse and Neglect, 75, 6–28. https://doi.org/10.1016/j.chiabu.2017.06.021 .

Gaffney, H., Ttofi, M. M., & Farrington, D. P. (2019a). Evaluating the effectiveness of school-bullying prevention programs: an updated meta-analytical review. Aggression and Violent Behavior. https://doi.org/10.1016/j.avb.2018.07.001 .

Gaffney, H., Farrington, D. P., Espelage, D. L., & Ttofi, M. M. (2019b). Are cyberbullying intervention and prevention programs effective?A systematic and meta-analytical review. Aggression and Violent Behavior. https://doi.org/10.1016/j.avb.2018.07.002 .

Garandeau, C. F., Lee, L. A., & Salmivalli, C. (2014a). Differential effects of the KiVa anti-bullying program on popular and unpopular bullies. Journal of Applied Developmental Psychology, 35(1), 44–50. https://doi.org/10.1016/j.appdev.2013.10.004 .

Garandeau, C. F., Poskiparta, E., & Salmivalli, C. (2014b). Tackling acute cases of school bullying in the KiVa anti-bullying program: a comparison of two approaches. Journal of Abnormal Child Psychology, 42, 981–991. https://doi.org/10.1007/s10802-014-9861-1 .

Gollwitzer, M., Eisenbach, K., Atria, M., Strohmeier, D., & Banse, R. (2006). Evaluation of aggression-reducing effects of the ‘Viennese Social Competence Training. Swiss Journal of Psychology, 65, 125–135.

Gradinger, P., Yanagida, T., Strohmeier, D., & Spiel, C. (2015). Prevention of cyberbullying and cyber victimization: evaluation of the ViSC Social Competence program. Journal of School Violence, 14(1), 87–110. https://doi.org/10.1080/15388220.2014.96323 .

Haataja, A., Voeten, M., Boulton, A. J., Poskiparta, E., & Salmivalli, C. (2014). The KiVa antibullying curriculum and outcome: does fidelity matter? Journal of School Psychology, 52, 479–492. https://doi.org/10.1016/j.jsp.2014.07.001 .

Hawker, D. S. J., & Boulton, M. J. (2000). Twenty years’ research on peer victimization and psychosocial maladjustment: a meta-analytic review of cross-sectional studies. Journal of Child Psychology and Psychiatry, 41, 441–455.

Hinduja, S., & Patchin, J. W. (2010). Bullying, cyberbullying, and suicide. Archives of Suicide Research, 14(3), 206–221. https://doi.org/10.1080/13811118.2010..494133 .

Holt, M. K., Vivolo-Kantor, A. M., Polanin, J. R., Holland, K. M., DeGue, S., Matjasko, J. L., Wolfe, M., & Reid, G. (2015). Bullying and suicidal ideation and behavior: a meta-analysis. Pediatrics, 135(2), e496–e509. https://doi.org/10.1542/peds.2014-1864 .

Hutchings, J., & Clarkson, S. (2015). Introducing and piloting the KiVa bullying prevention programme in the UK. Educational and Child Psychology, 32(1), 49–61.

Jiménez-Barbero, J. A., Ruiz Hernández, J. A., Llor-Esteban, B., & Pérez-García, M. (2012). Effectiveness of antibullying school programmes: a systematic review by evidence levels. Children and Youth Services Review, 34(9), 1646–1658. https://doi.org/10.1016/j.childyouth.2012.04.025 .

Jiménez-Barbero, J. A., Ruiz-Hernández, J. A., Llor-Zaragoza, L., Pérez-García, M., & Llor-Esteban, B. (2016). Effectiveness of anti-bullying school programs: a meta-analysis. Children and Youth Services Review, 61, 165–175. https://doi.org/10.1016/j.childyouth.2015.12.015 .

Joinson, A. N., Reips, U.-D., Buchanan, T., & Paine, C. B. (2010). Privacy, trust, and self-disclosure online. Human-Computer Interaction, 25(1), 1–24. https://doi.org/10.1080/0737002090358662 .

Ju, Y., Shuqiong, W., & Wenxin, Z. (2009). Intervention research on school bullying in primary schools. Frontiers of Education in China, 4, 111–122. https://doi.org/10.1007/s11516-009-0007-0 .

Kaljee, L., Zhang, L., Langhaug, L., Munjile, K., Tembo, S., Menon, A., Stanton, B., Li, X., & Malungo, J. (2017). A randomized controlled trial for the teachers’ diploma programme on psychosocial care, support and protection in Zambian government primary schools. Psychology, Health, and Medicine, 22(4), 381–392. https://doi.org/10.1080/13548503.2016.1153682 .

Kärnä, A., Voeten, M., Little, T. D., Alanen, E., Poskiparta, E., & Salmivalli, C. (2011a). Going to scale: a nonrandomized nationwide trial of the KiVa antibullying program for grades 1–9. Journal of Consulting and Clinical Psychology, 79(6), 796–805. https://doi.org/10.1037/a0025740 .

Kärnä, A., Voeten, M., Little, T. D., Alanen, E., Poskiparta, E., & Salmivalli, C. (2011b). A large-scale evaluation of the KiVa antibullying program: grades 4–6. Child Development, 82(1), 311–330. https://doi.org/10.1111/j.1467-8624.2010.01.557.x .

Kärnä, A., Voeten, M., Little, T. D., Alanen, E., Poskiparta, E., & Salmivalli, C. (2013). Effectiveness of the KiVa anti-bullying program: grades 1–3 and 7–9. Journal of Educational Psychology, 105(2), 535–551. https://doi.org/10.1037/a0030417 .

Kaufman, T. M. L., Kretschmer, T., Huitsing, G., & Veenstra, R. (2018). Why does a universal anti-bullying program not help all children? Explaining persistent victimization during an intervention. Prevention Science., 19, 822–832. https://doi.org/10.1007/s11121-018-0906-5 .

Kimber, B., Sandell, R., & Bremberg, S. (2008). Social and emotional training in Swedish classrooms for the promotion of mental health: results from an effectiveness study in Sweden. Health Promotion International, 23(2), 134–143. https://doi.org/10.1093/heapro/dam046 .

Klomek, A. B., Sourander, A., & Gould, M. (2010). The association of suicide and bullying in childhood to young adulthood: a review of cross-sectional and longitudinal research findings. Canadian Journal of Psychiatry, 55(5), 282–288.

Kowalski, R. M., Toth, A., & Morgan, M. (2018). Bullying and cyberbullying in adulthood and the workplace. Journal of Social Psychology, 158(1), 64–81. https://doi.org/10.1080/00224545.2017.1302402 .

Limber, S. P., Olweus, D., Wang, W., Masiello, M., & Breivik, K. (2018). Evaluation of the Olweus Bullying Prevention Program: a large scale study of U.S. students in grades 3–11. Journal of School Psychology, 69, 56–72. https://doi.org/10.1016/j.jsp.2018.04.004 .

Losey, R.A. (2009). An evaluation of the Olweus Bullying Prevention Program’s effectiveness in a high school setting. Unpublished doctoral dissertation, University of Cincinnati, Ohio, U.S.A.

Masiello, M. G., & Schroeder, D. (2013). A public health approach to bullying prevention. Washington, DC: APHA Press.

McAuley, L., Tugwell, P., & Moher, D. (2000). Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analysis? The Lancet, 356(9237), 1228–1231.

Menesini, E., Nocentini, A., & Palladino, B. E. (2012). Empowering students against bullying and cyberbullying: evaluation of an Italian peer-led model. International Journal of Conflict and Violence, 6(2), 314–320.

Meyer, N., & Lesch, E. (2000). An analysis of the limitations of a behavioural programme for bullying boys from a sub-economic environment. Southern African Journal of Child and Adolescent Mental Health, 12(1), 59–69.

Modecki, K. L., Minchin, J., Harbaugh, A. G., Guerra, N. G., & Runions, K. C. (2014). Bullying prevalence across contexts: a meta-analysis measuring cyber and traditional bullying. Journal of Adolescent Health, 55, 602–611. https://doi.org/10.1016/j.jadohealth.2014.06.007 .

Nocentini, A., & Menesini, E. (2016). KiVa antibullying program in Italy: evidence of effectiveness in a randomized control trial. Prevention Science, 17(8), 1012–1023. https://doi.org/10.1007/s11121-016-0690-z .

Noland, B. (2011). Effects of the KiVa anti-bullying program on adolescents’ perceptions of peers, depression, and anxiety. Unpublished doctoral dissertation, Kansas: University of Kansas.

O’Moore, A. M., & Minton, S. J. (2004). Ireland: the Donegal primary school antibullying project. In P. K. Smith, D. Pepler, & K. Rigby (Eds.), Bullying in schools: how successful can interventions be? (pp. 275–288). Cambridge: Cambridge University Press.

Olweus, D. (1992). Bullying among school children: intervention and prevention. In R. D. Peters, R. J. McMahon, & V. L. Quinsey (Eds.), Aggression and violence throughout the lifespan (pp. 100–125). London: Sage.

Olweus, D. (1993a). Bully/victim problems among school children: long-term consequences and an effective intervention program. In S. Hodgins (Ed.), Mental disorder and crime (pp. 317–349). Thousand Oaks: Sage.

Olweus, D. (1993b). Bullying at school: what we know and what we can do. Oxford: Blackwell.

Olweus, D., & Limber, S. (2010). Bullying in school: evaluation and dissemination of the Olweus Bullying Prevention Program. American Journal of Orthopsychiatry, 80(1), 124–134. https://doi.org/10.1111/j.1939-0025.2010.01015.x .

Olweus, D., Limber, S., & Mihalic, S. (1999). Blueprints for violence prevention, vol 9. The Bullying Prevention Program. Boulder: Institute of Behavioral Science, University of Colorado.

Olweus, D., Limber, S. P., Flerx, V., Mullin, N., Riese, J., & Snyder, M. (2007). Olweus Bullying Prevention Program: schoolwide guide. Center City: Hazelden.

Palladino, B. E., Nocentini, A., & Menesini, E. (2012). Online and offline peer led models against bullying and cyberbullying. Psicothema, 24(4), 634–639.

Palladino, B. E., Nocentini, A., & Menesini, E. (2016). Evidence-based intervention against bullying and cyberbullying: evaluation of the NoTrap! program in two independent trials. Aggressive Behavior, 42(2), 194–206. https://doi.org/10.1002/ab.21636 .

Patchin, J., & Hinduja, S. (2016). Bullying today: bullet points and best practices. Thousand Oaks: Corwin Press.

Purugulla, V. (2011). Impact of the Olweus Bullying Prevention Program on a middle school environment. Unpublished doctoral dissertation, Piedmont College. Retrieved from ProQuest (3508170).

Rican, P., Ondrova, K., & Svatos, J. (1996). The effect of a short, intensive intervention upon bullying in four classes in a Czech town. Annals of the New York Academy of Sciences, 794, 399–400.

Rooney, B., Connolly, I., Hurley, O., Kirwan, G., & Power, A. (2015). Social media and networking behaviour. In A. Atrill (Ed.), Cyberpsychology, pp. 88–101.

Sainio, M., Veenstra, R., Huitsing, G., & Salmivalli, C. (2012). Same- and other-sex victimization: are the risk factors similar? Aggressive Behavior, 38, 422–455. https://doi.org/10.1002/ab.21445 .

Salmivalli, C. (2010). Bullying and the peer group: a review. Aggression and Violent Behavior, 15(2), 112–120. https://doi.org/10.1016/j.avb.2015.10.001 .

Salmivalli, C., Kärnä, A., & Poskiparta, E. (2012). Counteracting bullying in Finland: the KiVa program and its effects on different forms of being bullied. International Journal of Behavioral Development, 35(5), 405–411. https://doi.org/10.1177/0165025411407457 .

Sapouna, M., Wolke, D., Vannini, N., Watson, S., Woods, S., Schneider, W., Enz, S., Hall, L., Paiva, A., André, E., Dautenhahn, K., & Aylett, R. (2010). Virtual learning intervention to reduce bullying victimization in primary school: a controlled trial. Journal of Child Psychology and Psychiatry, 51(1), 104–112. https://doi.org/10.1111/j.1469-7610.2009.02137.x .

Smith, P. K. (2010). Cyberbullying: the European perspective. In J. Mora-Merchán & T. Jäger (Eds.), Cyberbullying: a cross-national comparison (pp. 7–19). Landau: Empirische Pädagogik.

Smith, P. K. (2013). Understanding school bullying: its nature and prevention. London: Sage Publications.

Smith, P. K., Salmivalli, C., & Cowie, H. (2012). Effectiveness of school-based programs to reduce bullying: a commentary. Journal of Experimental Criminology, 8, 433–441. https://doi.org/10.1007/s11292-012-9142-3 .

Smith, P. K., Kwak, K., & Toda, Y. (2016). School bullying in different cultures: Eastern and Western perspectives. Cambridge: Cambridge University Press.

Solomontos-Kountouri, O., Gradinger, P., Yanagida, T., & Strohmeier, D. (2016). The implementation and evaluation of the ViSC program in Cyprus: challenges of cross-national dissemination and evaluation results. European Journal of Development Psychology, 13(6), 737–755. https://doi.org/10.1080/17405629.2015.1136618 .

Swearer, S. M., & Espelage, D. L. (2004). Introduction: a socio-ecological framework of bullying among youth. In D. L. Espealge & S. M. Swearer (Eds.), Bullying in American schools: a social-ecological perspective on prevention and intervention (pp. 1–12). Mahwah: Lawrence Erlbaum Associates.

Toda, Y. (2016). Bullying (ijime) and related problems in Japan: history and research. In P. K. Smith, K. Kwak, & Y. Toda (Eds.), School bullying in different cultures: Eastern and Western perspectives (pp. 73–92). Cambridge: Cambridge University Press.

Trip, S., Bora, C., Sipos-Gug, S., Tocai, I., Gradinger, P., Yanagida, T., & Strohmeier, D. (2015). Bullying prevention in schools by targeting cognitions, emotions, and behavior: evaluating the effectiveness of the REBE-ViSC program. Journal of Counselling Psychology, 62(4), 732–740. https://doi.org/10.1037/cou0000084 .

Ttofi, M. M. (2015). Adolescent bullying linked to depression in early adulthood: evidence supports early intervention. British Medical Journal, 350, h2694.

Ttofi, M. M., Farrington, D. P., Lösel, F., & Loeber, R. (2011a). Do the victims of school bullies tend to become depressed later in life? A systematic review and meta-analysis of longitudinal studies. Journal of Aggression, Conflict, and Peace Research, 3, 63–73.

Ttofi, M. M., Farrington, D. P., Lösel, F., & Loeber, R. (2011b). The predictive efficiency of school bullying versus later offending: a systematic/meta-analytic review of longitudinal studies. Criminal Behaviour and Mental Health, 21, 80–89.

Ttofi, M. M., Farrington, D. P., & Lösel, F. (2012). School bullying as a predictor of violence later in life: a systematic review and meta-analysis of prospective longitudinal studies. Aggression and Violent Behavior, 17, 405–418.

Ttofi, M. M., Farrington, D. P., Lösel, F., Crago, R. V., & Theodorakis, N. (2016). School bullying and drug use later in life: a meta-analytic investigation. School Psychology Quarterly, 31(1), 8–27.

Tzani-Pepelasi, C., Iaonnou, M., Synnott, J., & Ashton, S.-A. (2018). Comparing factors related to school-bullying and cyber-bullying. Crime Psychology Review, 4(1), 1–25. https://doi.org/10.1080/23744006.2018.1474029 .

United Nations Educational, Scientific, and Cultural Organisation. (2018). School violence and bullying: global status and trends, drivers and consequences. Paris: UNESCO.

Valdebenito, S., Ttofi, M., & Eisner, M. (2015). Prevalence rates of drug use among school bullies and victims: a systematic review and meta-analysis of cross-sectional studies. Aggression and Violent Behavior, 23, 137–146. https://doi.org/10.1016/j.avb.2015.05.004 .

Valdebenito, S., Ttofi, M. M., Eisner, M., & Gaffney, H. (2017). Weapon carrying in and out of school among pure bullies, pure victims and bully-victims: a systematic review and meta-analysis of cross-sectional and longitudinal studies. Aggression and Violent Behavior, 33, 62–77.

Weisburd, D., Lum, C. M., & Petrosino, A. (2001). Does research design affect study outcomes in criminal justice? Annals of the American Academy of Political and Social Science, 578, 50–70. http://www.jstor.org/stable/1049867 .

Williford, A., Boulton, A., Noland, B., Little, T. D., Kärnä, A., & Salmivalli, C. (2012). Effects of KiVa anti-bullying program on adolescents’ depression, anxiety, and perception of peers. Journal of Abnormal Child Psychology, 40, 289–300. https://doi.org/10.1007/s10802-011-9551-1 .

Williford, A., Elledge, L. C., Boulton, A. J., DePaolis, K. J., Little, T. D., & Salmivalli, C. (2013). Effects of the KiVa anti-bullying program on cyberbullying and cybervictimization frequency among Finnish youth. Journal of Clinical Child and Adolescent Psychology, 42(6), 820–833. https://doi.org/10.1080/15374416.2013.787623 .

Wong, D. S. W., Cheng, C. H. K., Ngan, R. M. H., & Ma, S. K. (2011). Program effectiveness of a restorative whole-school approach for tackling school bullying in Hong Kong. International Journal of Offender Therapy and Comparative Criminology, 55(6), 846–862. https://doi.org/10.1177/0306624X10374638 .

Yaakub, N. F., Haron, F., & Leong, G. C. (2010). Examining the efficacy of the Olweus prevention programme in reducing bullying: the Malaysian experience. Procedia – Social and Behavioral Sciences, 5, 595–598. https://doi.org/10.1016/j.sbspro.2010.07.148 .

Yanagida, T., Strohmeier, D., & Spiel, C. (2016). Dynamic change of aggressive behavior and victimization among adolescents: effectiveness of the ViSC program. Journal of Clinical Child & Adolescent Psychology. https://doi.org/10.1080/15374416.2016.1233498 .

Yang, A., & Salmivalli, C. (2014). Effectiveness of the KiVa antibullying programme on bully-victims, bullies and victims. Educational Research, 57(1), 80–90.

Zych, I., Ortega-Ruiz, R., & del Rey, R. (2015). Systematic review of theoretical studies on bullying and cyberbullying: facts, knowledge, prevention, and intervention. Aggression and Violent Behavior, 23, 1–21. https://doi.org/10.1016/j.avb.2015.10.001 .