Who engaged in the team-based assessment? Leveraging EdTech for a self and intra-team peer-assessment solution to free-riding
Tóm tắt
A STEM-based faculty in an Australian university leveraged online educational technology to help address student and academic concerns associated with team-based assessment. When engagement and contribution of all team members cannot be assured, team-based assessment can become an unfair and inaccurate measure of student competency. This case study explores the design and capacity of an online self and intra-team peer-assessment of teamwork strategy to measure student engagement and enable peers to hold each other accountable during team-based assessments. Analysis of student interactions across 39 subjects that implemented the strategy in 2020, revealed that an average of 94.4% of students completed the self and intra-team peer-assessment task when designed as part of a summative team-based assessment. The analysis also revealed that an average of 10.3% of students were held accountable by their peers, receiving feedback indicating their teamwork skills and behaviours were below the required minimum standard. Furthermore, the strategy was successfully implemented in cohorts ranging from seven to over 700 students, demonstrating scalability. Thus, this online self and intra-team peer-assessment strategy provided teaching teams with evidence of student engagement in a team-based assessment while also enabling students to hold each other accountable for contributing to the team task. Lastly, as the online strategy pairs with any discipline-specific team-based assessment, it provided the faculty with a method that could be used consistently across its schools to support management and engagement in team-based assessments.
Tài liệu tham khảo
Adachi, C., Tai, J.H.-M., & Dawson, P. (2018). Academics’ perceptions of the benefits and challenges of self and peer assessment in higher education. Assessment & Evaluation in Higher Education, 43(2), 294–306. https://doi.org/10.1080/02602938.2017.1339775
Basilotta-Gómez-Pablos, V., Matarranz, M., Casado-Aranda, L.-A., & Otto, A. (2022). Teachers’ digital competencies in higher education: A systematic literature review. International Journal of Educational Technology in Higher Education, 19(1), 1–16. https://doi.org/10.1186/s41239-021-00312-8
Biggs, J. (1996). Enhancing teaching through constructive alignment. Higher Education, 32(3), 347–364. https://doi.org/10.1007/BF00138871
Black, P., & Wiliam, D. (2018). Classroom assessment and pedagogy. Assessment in Education: Principles, Policy & Practice, 25(6), 551–575. https://doi.org/10.1080/0969594X.2018.1441807
Boud, D., & Falchikov, N. (1989). Quantitative studies of student self-assessment in higher education: A critical analysis of findings. Higher Education, 18(5), 529–549. https://doi.org/10.1007/BF00138746
Boud, D., & Falchikov, N. (2006). Aligning assessment with long-term learning. Assessment & Evaluation in Higher Education, 31(4), 399–413. https://doi.org/10.1080/02602930600679050
Bretag, T., Harper, R., Burton, M., Ellis, C., Newton, P., Rozenberg, P., Saddiqui, S., & van Haeringen, K. (2019). Contract cheating: A survey of Australian university students. Studies in Higher Education, 44(11), 1837–1856. https://doi.org/10.1080/03075079.2018.1462788
Deakin eVALUate. (2021). Deakin online student evaluations system. https://apps.deakin.edu.au/evaluate/index.php
Deakin University. (2021). Deakin graduate learning outcomes. https://www.deakin.edu.au/about-deakin/teaching-and-learning/deakin-graduate-learning-outcomes
Dodd, R. H., Dadaczynski, K., Okan, O., McCaffery, K. J., & Pickles, K. (2021). Psychological wellbeing and academic experience of University Students in Australia during COVID-19. International Journal of Environmental Research and Public Health, 18(3), 866. https://doi.org/10.3390/ijerph18030866
Edmondson, A. (1999). Psychological safety and learning behavior in work teams. Administrative Science Quarterly, 44(2), 350–383. https://doi.org/10.2307/2666999
FeedbackFruits GME. (2021). Group member evaluation, setting up group member evaluation. https://help.feedbackfruits.com/en/articles/2080613-setting-up-group-member-evaluation
Fellenz, M. R. (2006). Toward fairness in assessing student groupwork: A protocol for peer evaluation of individual contributions. Journal of Management Education, 30(4), 570–591. https://doi.org/10.1177/1052562906286713
Goldfinch, J., & Raeside, R. (1990). Development of a peer assessment technique for obtaining individual marks on a group project. Assessment and Evaluation in Higher Education, 15(3), 210–231. https://doi.org/10.1080/0260293900150304
Hall, D., & Buzwell, S. (2012). The problem of free-riding in group projects: Looking beyond social loafing as reason for non-contribution. Active Learning in Higher Education, 14(1), 37–49. https://doi.org/10.1177/1469787412467123
Henderson, C., & Dancy, M. H. (2008). Physics faculty and educational researchers: Divergent expectations as barriers to the diffusion of innovations. American Journal of Physics, 76(1), 79–91. https://doi.org/10.1119/1.2800352
Johnston, M. (2020). Online mass exodus: How Australian unis are coping with COVID‐19. ITNews. 20 March 2020. Information Technology News, Next Media Pty Ltd, St Leonards, New South Wales, Australia; https://www.itnews.com.au/news/online-mass-exodus-how-australian-unis-are-coping-with-the-covid-19-pandemic-539630
Jonsson, A. (2014). Rubrics as a way of providing transparency in assessment. Assessment & Evaluation in Higher Education, 39(7), 840–852. https://doi.org/10.1080/02602938.2013.875117
Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology. https://doi.org/10.1037/0022-3514.77.6.1121
Lejk, M., Wyvill, M., & Farrow, S. (1996). A survey of methods of deriving individual grades from group assessments. Assessment & Evaluation in Higher Education, 21(3), 267–280. https://doi.org/10.1080/0260293960210306
Lepine, J. A., Piccolo, R. F., Jackson, C. L., Mathieu, J. E., & Saul, J. R. (2008). A meta-analysis of teamwork processes: Tests of a multidimensional model and relationships with team effectiveness criteria. Personnel Psychology, 61(2), 273–307. https://doi.org/10.1111/j.1744-6570.2008.00114.x
Maiden, B., & Perry, B. (2011). Dealing with free-riders in assessed group work: Results from a study at a UK university. Assessment and Evaluation in Higher Education, 36(4), 451–464. https://doi.org/10.1080/02602930903429302
Marks, M. A., Mathieu, J. E., & Zaccaro, S. J. (2001). A temporally based framework and taxonomy of team processes. Academy of Management Review, 26(3), 356–376. https://doi.org/10.5465/AMR.2001.4845785
Martin, L., & Mahat, M. (2017). The assessment of learning outcomes in Australia: Finding the Holy Grail. AERA Open, 3(1), 2332858416688904. https://doi.org/10.1177/2332858416688904
Meijer, H., Hoekstra, R., Brouwer, J., & Strijbos, J.-W. (2020). Unfolding collaborative learning assessment literacy: A reflection on current assessment methods in higher education. Assessment & Evaluation in Higher Education, 45(8), 1222–1240. https://doi.org/10.1080/02602938.2020.1729696
Molloy, E., Boud, D., & Henderson, M. (2020). Developing a learning-centred framework for feedback literacy. Assessment & Evaluation in Higher Education, 45(4), 527–540. https://doi.org/10.1080/02602938.2019.1667955
Oliver, B. (2015). Redefining graduate employability and work-integrated learning: Proposals for effective higher education in disrupted economies. Journal of Teaching and Learning for Graduate Employability, 6(1), 56–65. https://doi.org/10.21153/jtlge2015vol6no1art573
Panadero, E., Romero, M., & Strijbos, J.-W. (2013). The impact of a rubric and friendship on peer assessment: Effects on construct validity, performance, and perceptions of fairness and comfort. Studies in Educational Evaluation, 39(4), 195–203. https://doi.org/10.1016/j.stueduc.2013.10.005
QS. (2019). Global skills gap. Q. S. Ltd. http://info.qs.com/rs/335-VIN-535/images/2019_Global_Skills_Gap_Report.pdf
Rust, C. (2002). The impact of assessment on student learning: How can the research literature practically help to inform the development of departmental assessment strategies and learner-centred assessment practices? Active Learning in Higher Education, 3(2), 145–158. https://doi.org/10.1177/1469787402003002004
Schultz, M., Young, K., Gunning, T. K., & Harvey, M. L. (2022). Defining and measuring authentic assessment: A case study in the context of tertiary science. Assessment & Evaluation in Higher Education, 47(1), 77–94. https://doi.org/10.1080/02602938.2021.1887811
Sridharan, B., Tai, J., & Boud, D. (2018). Does the use of summative peer assessment in collaborative group work inhibit good judgement? Higher Education, 77(5), 853–870. https://doi.org/10.1007/s10734-018-0305-7
Strijbos, J. W. (2016). Assessment of collaborative learning. In G. T. L. Brown & L. Harris (Eds.), Handbook of social and human conditions in assessment (pp. 302–318). Routledge. https://doi.org/10.4324/9781315749136
Strijbos, J., Engels, N., & Struyven, K. (2015). Criteria and standards of generic competences at bachelor degree level: A review study. Educational Research Review, 14, 18–32. https://doi.org/10.1016/j.edurev.2015.01.001
Tai, J., Ajjawi, R., Boud, D., Dawson, P., & Panadero, E. (2018). Developing evaluative judgement: Enabling students to make decisions about the quality of work. Higher Education, 76(3), 467–481. https://doi.org/10.1007/s10734-017-0220-3
Tucker, R., Fermelis, J., & Palmer, S. (2009). Designing, implementing and evaluating a self-and-peer assessment tool for e-learning environments. In C. Spratt & P. Lajbcygier (Eds.), In e-learning technologies and evidence-based assessment approaches (pp. 170–194). IGI Global. https://doi.org/10.4018/978-1-60566-410-1.ch010
Varela, O., & Mead, E. (2018). Teamwork skill assessment: Development of a measure for academia. Journal of Education for Business, 93(4), 172–182. https://doi.org/10.1080/08832323.2018.1433124
Villarroel, V., Bloxham, S., Bruna, D., Bruna, C., & Herrera-Seda, C. (2018). Authentic assessment: Creating a blueprint for course design. Assessment & Evaluation in Higher Education, 43(5), 840–854. https://doi.org/10.1080/02602938.2017.1412396
WEF. (2015). New vision for education: Unlocking the potential of technology, Retrieved from https://www3.weforum.org/docs/WEFUSA_NewVisionforEducation_Report2015.pdf
Willcoxson, L. E. (2006). “It’s not fair!”: Assessing the dynamics and resourcing of teamwork. Journal of Management Education, 30(6), 798–808. https://doi.org/10.1177/1052562906287964
Willey, K., & Gardner, A. (2009). Improving self- and peer assessment processes with technology. Campus-Wide Information Systems, 26(5), 379–399. https://doi.org/10.1108/10650740911004804
Young, K., Palmer, S., & Campbell, M. (2017). Good WIL hunting: Building capacity for curriculum re-design. Journal of Teaching and Learning for Graduate Employability, 8(1), 215. https://doi.org/10.21153/jtlge2017vol8no1art670