iSAT: a visual learning analytics tool for instructors
Tóm tắt
Interactive Stratified Attribute Tracking (iSAT) is a visual analytics tool for cohort analysis. In this paper, we show how instructors can use iSAT to visualize transitions of groups of students during teaching-learning activities. Interactive visual analytics gives the instructor the affordance of understanding the dynamics of the class of students and their activities from the data collected in their own teaching-learning context. We take an example of a peer instruction (PI) activity and describe how iSAT can be used to analyze its clicker responses. During PI, typically instructors only use histograms to visualize the distribution of clicker responses in the pre- and post-discussion phases. We show that the use of iSAT to analyze clicker data in real time to trace transitions of participants’ responses during various voting phases can support them in planning for their post-PI activities. Seven patterns of transitions that emerge are aligned, returns, starburst, slide, attractor, switching, and void. We interpret them in the context of the example. Such transition patterns are neither available in multiple histograms of individual voting phase nor generated in real time to be visualized as a flow diagram. We had conducted two workshops to introduce iSAT to the instructors and demonstrated the workflow of using iSAT with their dataset. Here, we report usefulness and usability data collected from those workshops. In conclusion, we highlight the power of iSAT for instructors to do cohort analysis in their teaching-learning practice.
Từ khóa
Tài liệu tham khảo
Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the system usability scale. International Journal of Human-Computer Interaction, 24(6), 574–594. doi:10.1080/10447310802205776.
Brooke, J. (1996). SUS: a “quick and dirty” usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester, & I. L. McClelland (Eds.), Usability evaluation in industry (pp. 189–194). London: Taylor & Francis.
Crouch, C. H., & Mazur, E. (2001). Peer instruction: ten years of experience and results. American Journal of Physics, 69(9), 970–977.
Duval, E. (2011). Attention please!: learning analytics for visualization and recommendation. In Proceedings of the ACM 1 st International Conference on Learning Analytics and Knowledge (LAK 2011) (pp. 9–17).
Fagen, A. P., Crouch, C., & Mazur, E. (2002). Peer instruction: results from a range of classrooms. The Physics Teacher, 40(4), 206–209.
Hake, R. R. (1998). Interactive-engagement versus traditional methods: a six-thousand-student survey of mechanics test data for introductory physics courses. American Journal of Physics, 66(1), 64–74.
Kothiyal, A., Majumdar, R., Murthy, S., & Iyer, S. (2013). Effect of think-pair-share in a large CS1 class: 83 % sustained engagement. In Proceedings of the ACM 9 th Annual International Conference on International Computing Education Research (ICER 2013) (pp. 137–144).
Kothiyal, A., Murthy, S., & Iyer, S. (2014). Think-pair-share in a large CS1 class: does learning really happen? In Proceedings of the 2014 Conference on Innovation & Technology in Computer Science Education (ITiCSE ’14) (pp. 51–56). New York: ACM.
Majumdar, R., & Iyer, S. (2014). Using Stratified Attribute Tracking (SAT) diagrams for learning analytics. In Proceedings of the IEEE 14 th International Conference on Advanced Learning Technologies (ICALT 2014) (pp. 386–387).
Majumdar, R., & Iyer, S. (2015). Beyond clickers: tracing patterns in students’ response through iSAT. In Procs. of Intnl. Conf on Computers in Education (ICCE 2015), Hangzhou, China.
Majumdar, R., & Warriem, J. M. (2015). iSAT: a visual learning analytics tool to trace educational datasets. In Proceedings of the IEEE 7 th International Conference on Technology for Education (T4E, 2015).
Majumdar, R., Alse, K., & Iyer, S. (2014). Interactive Stratified Attribute Tracking diagram for learning analytics. In Proceedings of the IEEE 6 th International Conference on Technology for Education (T4E, 2014) (pp. 138–139).
Mayer, R. E., Stull, A., DeLeeuw, K., Almeroth, K., Bimber, B., Chun, D., & Zhang, H. (2009). Clickers in college classrooms: fostering learning with questioning methods in large lecture classes. Contemporary Educational Psychology, 34(1), 51–57.
Mazur, E. (1997). Peer instruction: a user’s manual. Upper Saddle River: Prentice Hall.
Mishra, S., & Iyer, S. (2013). Problem Posing Exercises (PPE): an instructional strategy for learning of complex material in introductory programming courses. In Proceedings of the IEEE 6 th International Conference on Technology for Education (T4E, 2013) (pp. 151–158).
Mistry, R., Halkude, S., & Awasekar, D. (2016). APIT: evidences of aligning PjBL with various instructional strategies for enhancing knowledge in automobile engineering. In Proceedings of the IEEE International Conference on Learning and Teaching in Computing and Engineering (LaTiCE, 2016).
Porter, L., Bailey Lee, C., Simon, B., & Zingaro, D. (2011). Peer instruction: do students really learn from peer discussion in computing? In Proceedings of the ACM 7 th International Workshop on Computing Education Research (ICER 2011) (pp. 45–52).
Smith, M. K., Wood, W. B., Adams, W. K., Wieman, C., Knight, J. K., Guild, N., & Su, T. T. (2009). Why peer discussion improves student performance on in-class concept questions. Science, 323(5910), 122–124.
Venkatesh, V., & Davis, F. D. (2000). A theoretical extension of the technology acceptance model: four longitudinal field studies. Management Science, 46(2), (pp. 186–204).
Verbert, K., Govaerts, S., Duval, E., Santos, J. L., Assche, F., Parra, G., & Klerkx, J. (2014). Learning dashboards: an overview and future research opportunities. Personal Ubiquitous Comput., 18, 6(August 2014), 1499–1514. doi:10.1007/s00779-013-0751-2.
Vickrey, T., Rosploch, K., Rahmanian, R., Pilarz, M., & Stains, M. (2015). Research-based implementation of peer instruction: a literature review. CBE-Life Sciences Education, 14(1), es3.
Warriem, J.M. (2015) http://www.et.iitb.ac.in/~jkmadathil/et4et/index.html. Accessed 23 Dec 2015.
Warriem, J. M., Murthy, S., & Iyer, S. (2013). Training in-service teachers to do action research in educational technology. In Proc. IEEE 5th Intnl. Conf. on Technology for Education (T4E) (pp. 192–199). 18-20 Dec. 2013.
Wittmann, M. C., & Black, K. E. (2014). Visualizing changes in pretest and post-test student responses with consistency plots. Physical Review Special Topics-Physics Education Research, 10(1), 010114-1–010114-12.
www.et.iitb.ac.in/iSAT. resources for iSAT tool and the discussed dataset is available as demo