TESTed—An educational testing framework with language-agnostic test suites for programming exercises

Shute, 2008, Focus on formative feedback, Rev Educ. Res, 78, 153, 10.3102/0034654307313795 Orrell, 2006, Feedback on learning achievement: Rhetoric and reality, Teach Higher Educ, 11, 441, 10.1080/13562510600874235 Luxton-Reilly, 2018, Introductory programming: A systematic literature review, 55 Campos, 2012, A multinational case study on using diverse feedback types applied to introductory programming learning, 1 Cheang, 2003, On automated grading of programming assignments in an academic institution, Comput Educ, 41, 121, 10.1016/S0360-1315(03)00030-7 Keuning, 2018, A systematic literature review of automated feedback generation for programming exercises, ACM Trans Comput Educ, 19, 1, 10.1145/3231711 Hao, 2021, Towards understanding the effective design of automated formative feedback for programming assignments, Comput Sci Educ, 1 Zavala, 2018, On the use of semantic-based aig to automatically generate programming exercises, 14 Staubitz T, Teusner R, Meinel C. Towards a repository for open auto-gradable programming exercises. In: 2017 IEEE 6th international conference on teaching, assessment, and learning for engineering. Hong Kong; ISBN: 978-1-5386-0900-2, 2017, p. 66–73. http://dx.doi.org/10.1109/TALE.2017.8252306, URL. Pirttinen, 2018, Crowdsourcing programming assignments with CrowdSorcerer, 326 Gulwani S, Radiček I, Zuleger F. Feedback generation for performance problems in introductory programming assignments. In: Proceedings of the 22nd ACM SIGSOFT international symposium on foundations of software engineering. Hong Kong China; ISBN: 978-1-4503-3056-5, 2014, p. 41–51. http://dx.doi.org/10.1145/2635868.2635912, URL. Tang T, Smith R, Rixner S, Warren J. Data-driven test case generation for automated programming assessment. In: Proceedings of the 2016 ACM conference on innovation and technology in computer science education. Arequipa Peru; ISBN: 978-1-4503-4231-5, 2016, p. 260–5. http://dx.doi.org/10.1145/2899415.2899423, URL. Edwards, 2004, Using software testing to move students from trial-and-error to reflection-in-action, 26 Camp, 2017, Generation CS: The growth of computer science, ACM Inroads, 8, 44, 10.1145/3084362 Sax LJ, Lehman KJ, Zavala C. Examining the enrollment growth: Non-CS majors in CS1 courses. In: Proceedings of the 2017 ACM sigcse technical symposium on computer science education. Seattle Washington USA; ISBN: 978-1-4503-4698-6, 2017, p. 513–8. http://dx.doi.org/10.1145/3017680.3017781, URL. Paiva, 2022, Automated assessment in computer science education: A state-of-the-art review, ACM Trans Comput Educ, 22, 1, 10.1145/3513140 Wasik, 2018, A survey on online judge systems and their applications, ACM Comput Surv, 51, 1, 10.1145/3143560 Paiva, 2020, Yet another programming exercises interoperability language (Short Paper), vol. 83, 14:1 Verhoeff, 2008, Programming task packages: Peach exchange, Olympiads Inform, 192 Edwards, 2008, Developing a common format for sharing programming assignments, SIGCSE Bull, 40, 167, 10.1145/1473195.1473240 Queirós, 2013, BabeLO—An extensible converter of programming exercises formats, IEEE Trans Learn Technol, 6, 38, 10.1109/TLT.2012.21 Queirós, 2011, Pexil: Programming exercises interoperability language, 37 Le, 2013, Operationalizing the continuum between well-defined and ill-defined problems for educational technology, IEEE Trans Learn Technol, 6, 258, 10.1109/TLT.2013.16 Simões, 2020, On the nature of programming exercises, vol. 81, 24:1 Swacha J. SIPE: A domain-specific language for specifying interactive programming exercises. In: Kosiuczenko P, Madeyski L, editors. Towards a synergistic combination of research and practice in software engineering, Vol. 733. Cham; ISBN: 978-3-319-65207-8 978-3-319-65208-5, 2018, p. 15–29. http://dx.doi.org/10.1007/978-3-319-65208-5_2, URL. CS SPLICE PEML Working Group, 2021 Strickroth, 2015, ProFormA: An XML-based exchange format for programming tasks, Eleed, 11 Wright, 2022 Van Petegem, 2022 Claessen, 2000, QuickCheck: A lightweight tool for random testing of Haskell programs, 268 Ward, 2021 Zakas NC, Mills B, Djermanovic M. ESLint. URL https://eslint.org/. Wastl, 2020