The perceptions of the meaning and value of analytics in New Zealand higher education institutions

Hamidreza Mahroeian1, Ben Daniel1, Russell Butson1
1Higher Education Development Centre, University of Otago, Dunedin, New Zealand

Tóm tắt

This article presents the current perceptions on the value of analytics and their possible contribution to the higher education sector in New Zealand. Seven out of eight research-intensive public universities in New Zealand took part in the study. Participants included senior management and those who have some role associated with decision-making within higher education (N = 82). The study found inconsistent understanding of the meaning of analytics across participants. In particular, three forms of perceptions of analytics were identified: structural; functional and structural-functional. It was evident that some participants viewed analytics in its structural elements such as statistics, metrics, trends, numbers, graph, and any relevant information/data to enhance better decision-making, whereas other participants perceived the notion of analytics in terms of functional aspect; as means to an end, a process to use the data to gain insights and taking action on complex problems, yet a third group viewed analytics from both structural-functional perspectives. These kinds of perceptions have to a larger extent influenced participants’ views on the value of analytics in shaping policy and practice. Also, literature has addressed a number of possible challenges associated with the large-scale institutional implementation of analytics. These challenges were: difficulties in extracting data from multiple databases, maintaining data quality, ethical and privacy issues, and lack of professional development opportunities. This article aims to broadly contribute to a better understanding of current perception and value of analytics in higher education, and in particular within the New Zealand context.

Tài liệu tham khảo

Althubaiti, A., & Alkhazim, M. (2014). Medical colleges in Saudi Arabia: Can we predict graduate numbers? Higher Education Studies, 4(3), 1–8. Armayor, G. M., & Leonard, S. T. (2010). Graphic strategies for analyzing and interpreting curricular mapping data. American Journal of Pharmaceutical Education, 74(5), 81–91. Arnold, K. E., & Pistilli, M. D. (2012). Course signals at Purdue: Using learning analytics to increase student success. In Paper presented at the proceedings of the 2nd international conference on learning analytics and knowledge. Vancouver, British Columbia: Canada Retrieved from http://dl.acm.org/citation.cfm?id=2330666 Bichsel, J. (2012). Analytics in Higher Education: Benefits, Barriers, Progress, and Recommendations (research report). Louisville, CO: EDUCAUSE Center for Applied Research https://library.educause.edu/resources/2012/6/2012-ecar-study-of-analytics-in-higher-education Bottles, K., Begoli, E., & Worley, B. (2014). Understanding the pros and cons of big data analytics. Physician Executive, 40(4), 6–12. Campbell, J. P., & Oblinger, D. G. (2007). Academic analytics. In EDUCAUSE Retrieved 15 October 2007, from https://library.educause.edu/resources/2007/10/academic-analytics Charlton, P., Mavrikis, M., & Katsifli, D. (2013). The potential of learning analytics and big data. In Ariadne Retrieved from http://www.ariadne.ac.uk/issue71/charlton-et-al Chen, H., Chiang, R. H., & Storey, V. C. (2012). Business intelligence and analytics: From big data to big impact. MIS Quarterly: Management Information Systems, 36(4), 1165–1188. Clow, D. (2013). An overview of learning analytics. Teaching in Higher Education, 18(6), 683–695. doi10.1080/13562517.2013.827653. Cox, B. L., & Jantti, M. H. (2012). Discovering the impact of library use and student performance. EDUCAUSE review. no. July 18, pp. 1-9. Retrieved from http://ro.uow.edu.au/cgi/viewcontent.cgi?article=1507&context=asdpapers Daniel, B. K. (2015). Big data and analytics in higher education: Opportunities and challenges. British Journal of Educational Technology, 46(5), 904–920. Daniel B. K., & Butson, R. (2013). Technology Enhanced Analytics (TEA) in Higher Education, Proceedings of the International Conference on Educational Technologies, 29 November–1 December, 2013, Kuala Lumpur, Malaysia,. 89–96. Dawson, S., Bakharia, A., & Heathcote, E. (2010). SNAPP: Realising the affordances of real-time SNA within networked learning environments. Proceedings of the 7th international conference on networked learning. 125-133. Dietz-Uhler, B, & Hurn, J. E. (2013). Using learning analytics to predict (and improve) student success: A faculty perspective. Journal of Interactive Online Learning, 12(1), 17–26. DiCerbo, K. E. (2014). Game-based assessment of persistence. Journal of Educational Technology & Society, 17(1). Ferguson, R. (2012). Learning analytics: Drivers, developments, and challenges. Int J Technol Enhanced Learning, 4(5–6), 304–317. Fowler, F. (2009). Survey research methods (4th ed.). London, UK: Sage Publications. Gantz, J, & Reinsel, D. (2012). The digital universe in 2020: Big data, bigger digital shadows, and biggest growth in the far east. IDC iView: IDC Analyse the future. Retrieved from http://www.emc.com/leadership/digital-universe/index.htm Goldstein, P. J. & Katz, R. N. (2005). Academic Analytics: The Uses of Management Information and Technology in Higher Education, ECAR Research Study Volume 8. Retrieved March 24, 2014, from http://www.educause.edu/ir/library/pdf/ers0508/rs/ers0508w.pdf. Hung, J. L. & Zhang, K. (2012). Examining mobile learning trends 2003–2008: A categorical meta-trend analysis using text mining techniques. Journal of Computing in Higher education, 24(1), 1–17. Jantawan, B., & Tsai, C.-F. (2013). The application of data mining to build a classification model for predicting graduate employment. Int J Comput Sci and Inf Security, 11(10), 1–7. Jantti, M., & Cox, B. (2013). Measuring the value of library resources and student academic performance through relational datasets. Evidence-Based Library and Information Practice, 8(2), 163–171. Johnson, L., Levine, A., Smith, R., & Stone, S. (2010). The 2010 horizon report. Austin, Texas: The New Media Consortium. Jones, S. J. (2012). Technology review: The possibilities of learning analytics to improve learner-centred decision-making. The Community College Enterprise, 18(1), 89–92. Kostoglou, V., Vassilakopoulos, M., & Koilias, C. (2013). Higher technological education specialties and graduates’ vocational status and prospects. Education+ Training, 55(6), 520–537. doi:10.1108/et-03-2012-0026. Mahroeian, H., & Daniel, B. K. (2016). The dynamic landscape of higher education: The role of big data and analytics. In EdMedia: World Conference on Educational Media and Technology (pp. 1320-1325). Association for the Advancement of computing in education (AACE). Manning, C. D.; Raghavan, P.; and Schutze, H. 2008. Introduction to information retrieval. Cambridge University press, 1st edition. Mardikyan, S., & Badur, B. (2011). Analyzing teaching performance of instructors using data mining techniques. Informatics in Education, 10(2), 245. Norris, D., Baer, L., & Offerman, M. (2009, September). A national agenda for action analytics. In National Symposium on Action Analytics (pp. 21-23). Nunn, S., Avella, J., Kanai, T., & Kebritchi, M. (2016). Learning analytics methods, benefits, and challenges in higher education: A systematic literature review. Online Learning, 20(2). Retrieved from https://olj.onlinelearningconsortium.org/index.php/olj/article/view/790 Pardo, A., & Siemens, G. (2014). Ethical and privacy principles for learning analytics. British Journal of Educational Technology, 45(3), 438–450. Picciano, A. G. (2012). The evolution of big data and learning analytics in American higher education. Journal of Asynchronous Learning Networks, 16(3), 9–20. Scholes, V. (2016). The ethics of using learning analytics to categorize students on risk. Educational Technology Research and Development, 64(5), 939–955. Sclater, N. (2014). Code of practice essential for learning analytics. JISC, London. Retrieved from https://analytics.jiscinvolve.org/wp/2014/09/18/code-of-practice-essential-for-learning-analytics/ Sclater, N., & Bailey, P. (2015). Code of practice for learning analytics. London: JISC Retrieved from http://www.jisc.ac.uk/guides/code-of-practice-for-learning-analytics Sharda, R., Asamoah, D. A., & Ponna, N. (2013). Business analytics: Research and teaching perspectives. In Information Technology Interfaces (ITI), Proceedings of the ITI 2013 35th International Conference on (pp. 19-27). IEEE. Siemens, G. (2013). Learning analytics: The emergence of a discipline. American Behavioral Scientist, 57(10), 1380–1400. Siemens, G., & Long, P. (2011). Penetrating the fog: Analytics in learning and education. Educause Review, 46(5), 30–40. Tulasi, B. (2013). Significance of big data and analytics in higher education. International Journal of Computer Applications, 68(14), 23–25. Van Barneveld, A., Arnold, K. E., & Campbell, J. P. (2012). Analytics in higher education: Establishing a common language. EDUCAUSE Learning Initiative, 1, 1–11. West, D. M. (2012). Big data for education: Data mining, data analytics, and web dashboards. Governance Studies at Brookings, 1-10. Retrieved from https://www.brookings.edu/research/big-data-for-education-data-mining-data-analytics-and-web-dashboards/ Xu, B., & Recker, M. (2012). Teaching analytics: A clustering and triangulation study of digital library user data. Journal of Educational Technology & Society, 15(3), 103–115.