Modern international large-scale assessment in education: an integrative review and mapping of the literature
Tóm tắt
Từ khóa
Tài liệu tham khảo
Ababneh, E., Al-Tweissi, A., & Abulibdeh, K. (2016). TIMSS and PISA impact–the case of Jordan. Research Papers in Education, 31(5), 542–555. https://doi.org/10.1080/02671522.2016.1225350
Aboelela, S. W., Larson, E., Bakken, S., Carrasquillo, O., Formicola, A., Glied, S. A., Haas, J., & Gebbie, K. M. (2007). Defining interdisciplinary research: Conclusions from a critical review of the literature. Health Services Research, 42, 329–346. https://doi.org/10.1111/j.1475-6773.2006.00621.x
Abramo, G., D’Angelo, A. C., & Murgia, G. (2017). The relationship among research productivity, research collaboration, and their determinants. Journal of Informetrics, 11(4), 1016–1030. https://doi.org/10.1016/j.joi.2017.09.007
Addey, C., Sellar, S., Steiner-Khamsi, G., Lingard, B., & Verger, A. (2017). The rise of international large-scale assessments and rationales for participation. Compare, 47(3), 434–452. https://doi.org/10.1080/03057925.2017.1301399
Ainley, M., & Ainley, J. (2011). Student engagement with science in early adolescence: The contribution of enjoyment to students’ continuing interest in learning about science. Contemporary Educational Psychology, 36(1), 4–12. https://doi.org/10.1016/j.cedpsych.2010.08.001
Allardt, E. (1990). Challenges for comparative social research. Acta Sociologica, 33(3), 183–193. https://doi.org/10.1177/000169939003300302
Aria, M., & Cuccurullo, C. (2017). Bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of Informetrics, 11(4), 959–975. https://doi.org/10.1016/j.joi.2017.08.007
Australian Council for Educational Research (ACER). (2020). PISA and TIMSS: What’s the Story? Retrieved from https://www.acer.org/files/TIMSSandPISA-backgrounder.pdf
Barrett, A. M., Crossley, M., & Dachi, H. A. (2011). International collaboration and research capacity building: Learning from the EdQual experience. Comparative Education, 47, 25–43. https://doi.org/10.1080/03050068.2011.541674
Bos, K. T. (2002). Benefits and limitations of large-scale international comparative achievement studies: The case of IAE’s TIMSS study. University of Twente. ISBN: 9036517397
Cardoso, M. E. (2020). Policy Evidence by Design: International Large-Scale Assessments and Grade Repetition. Comparative Education Review, 64, 4. https://doi.org/10.1086/710777
CIES. (2021). Topic based SIGs. Comparative & International Education Society. https://www.cies.us/page/TopicSigs
Coccia, M., & Wang, L. (2016). Evolution and convergence of the patterns of international scientific collaboration. Proceedings of the National Academy of Sciences, 113, 2057–2061. https://doi.org/10.1073/pnas.1510820113
Dabi, Y., Darrigues, L., Katsahian, S., Azoulay, D., De Antonio, M., & Lazzati, A. (2016). Publication trends in bariatric surgery: A bibliometric study. Obesity Surgery, 26(11), 2691–2699. https://doi.org/10.1007/s11695-016-2160-x
Dale, R. (2000). Globalization and education: Demonstrating a “common world educational culture” or locating a “globally structured educational agenda”? Educational Theory, 50(4), 427–448. https://doi.org/10.1111/j.1741-5446.2000.00427.x
Ding, Y., Chowdhury, G., & Foo, S. (2000). Journal as markers of intellectual space: Journal co-citation analysis of information retrieval area, 1987–1997. Scientometrics, 47(1), 55–73. https://doi.org/10.1023/A:1005665709109
Domínguez, M., Vieira, M. J., & Vidal, J. (2012). The impact of the Programme for International Student Assessment on academic journals. Assessment in Education: Principles, Policy & Practice, 19(4), 393–409. https://doi.org/10.1080/0969594X.2012.659175
Donnellan, M., Trzesniewski, K., & Lucas, R. (2011). Introduction. In K. Trzewniewski, M. Donnellan, & R. Lucas (Eds.), Secondary Data Analysis: An Introduction for Psychologists (pp. 3–10). American Psychological Association.
Drent, M., Meelissen, M. R., & van der Kleij, F. M. (2013). The contribution of TIMSS to the link between school and classroom factors and student achievement. Journal of Curriculum Studies, 45(2), 198–224. https://doi.org/10.1080/00220272.2012.727872
Else-Quest, N. M., Hyde, J. S., & Linn, M. C. (2010). Cross-national patterns of gender differences in mathematics: A meta-analysis. Psychological Bulletin, 136(1), 103–127. https://doi.org/10.1037/a0018053
Freshwater, D., Sherwood, G., & Drury, V. (2006). International research collaboration: Issues, benefits and challenges of the global network. Journal of Research in Nursing, 11(4), 295–303. https://doi.org/10.1177/1744987106066304
Garfield, E. (2004). Historiographic mapping of knowledge domains literature. Journal of Information Science, 30(2), 119–145. https://doi.org/10.1177/0165551504042802
Gil-Izquierdo, M., & Cordero, J. M. (2018). Guidelines for data fusion with international large scale assessments: Insights from the TALIS-PISA link database. Studies in Educational Evaluation, 59, 10–18. https://doi.org/10.1016/j.stueduc.2018.02.002
Goldstein, H. (2004). International comparisons of student attainment: Some issues arising from the PISA study. Assessment in Education, 11, 319–330. https://doi.org/10.1080/0969594042000304618
Goldstein, H., Bonnet, G., & Rocher, T. (2007). Multilevel Structural Equation Models for the Analysis of Comparative Data on Educational Performance. Journal of Educational and Behavioral Statistics, 32(3), 252–286. https://doi.org/10.3102/1076998606298042
Green Saraisky, N. (2015). The politics of international large-scale assessment: The Programme for International Student Assessment (PISA) and American education discourse, 2000–2012 (Doctoral dissertation, Columbia University).
Grek, S. (2009). Governing by numbers: The PISA “effect” in Europe. Journal of Education Policy, 24(1), 23–37. https://doi.org/10.1080/02680930802412669
Grundmann, R. (2016). The problem of expertise in knowledge societies. Minerva, 55, 25–48. https://doi.org/10.1007/s11024-016-9308-7
Gustafsson, J. -E. (2018). International large scale assessments: Current status and ways forward. Scandinavian Journal of Educational Research, 62(3), 328–332. https://doi.org/10.1080/00313831.2018.1443573
Henriksen, D. (2016). The rise in co-authorship in the social sciences (1980–2013). Scientometrics, 107(2), 455–476. https://doi.org/10.1007/s11192-016-1849-x
Hogrebe, N., & Strietholt, R. (2016). Does non-participation in preschool affect children’s reading achievement? international evidence from propensity score analyses. Large-Scale Assessments in Education, 4(1), 1–22. https://doi.org/10.1186/s40536-016-0017-3
Hopfenbeck, T. N., Lenkeit, J., El Masri, Y., Cantrell, K., Ryan, J., & Baird, J. A. (2018). Lessons learned from PISA: A systematic review of peer-reviewed articles on the programme for international student assessment. Scandinavian Journal of Educational Research, 62(3), 333–353. https://doi.org/10.1080/00313831.2016.1258726
Hopmann, S. T., Brinek, G. & Retzl, M. (Eds) (2007). PISA According to PISA: does PISA keep what it promises? Lit Verlag
Huang, C., Yang, C., Wang, S., Wu, W., Su, J., & Liang, C. (2020). Evolution of topics in education research: A systematic review using bibliometric analysis. Educational Review, 72(3), 281–297. https://doi.org/10.1080/00131911.2019.1566212
Husén, T. (1979). An international research venture in retrospect: The IEA Surveys. Comparative Education Review, 23(3), 371–385. https://doi.org/10.1086/446067
Hyde, J. S., & Mertz, J. E. (2009). Gender, culture, and mathematics performance. Proceedings of the National Academy of Sciences, 106(22), 8801–8807.
IEA. (2013). TIMSS 2015 Assessment Framework. Retrieved from https://timssandpirls.bc.edu/timss2015/downloads/T15_Frameworks_Full_Book.pdf
IEA. (2014). ICILS – Past Cycles. Retrieved from https://www.iea.nl/icils-past-cycles
IEA. (2016). IEA International Civic and Citizenship Education Study 2016 Assessment Framework. Retrieved from https://link.springer.com/content/pdf/10.1007%2F978-3-319-39357-5_2.pdfIEA
IEA. (2018). ICCS 2016 Technical Report. Retrieved from http://archivos.agenciaeducacion.cl/5_Reporte_tecnico_ICCS_2016.pdf
IEA. (2019a). Chapter 4: TIMSS 2019 Assessment Design. Retrieved from http://timss2019.org/wp-content/uploads/frameworks/T19-Assessment-Frameworks-Chapter-4.pdf
IEA. (2019b). IEA International Computer and Information Literacy Study 2018 Assessment Framework. Retrieved from https://www.springer.com/gp/book/9783030193881
IEA. (2020). ICCS 2016. Retrieved from https://www.iea.nl/studies/iea/iccs/2016
Ivanović, L., & Ho, Y. S. (2019). Highly cited articles in the education and educational research category in the social science citation index: A bibliometric analysis. Educational Review, 71(3), 277–286. https://doi.org/10.1080/00131911.2017.1415297
Johansson, S. (2016). International large-scale assessments: What uses, what consequences? Educational Research, 58(2), 139–148. https://doi.org/10.1080/00131881.2016.1165559
Kamens, D. H., & McNeely, C. L. (2010). Globalization and the growth of international educational testing and national assessment. Comparative Education Review, 54(1), 5–25. https://doi.org/10.1086/64847
Kato, M., & Ando, A. (2013). The relationship between research performance and international collaboration in chemistry. Scientometrics, 97(3), 535553. https://doi.org/10.1007/s11192-013-1011-y
Keathley-Herring, H., Van Aken, E., Gonzalez-Aleu, F., Deschamps, F., Letens, G., & Orlandini, P. C. (2016). Assessing the maturity of a research area: Bibliometric review and proposed framework. Scientometrics, 109(2), 927–951. https://doi.org/10.1007/s11192-016-2096-x
Kijima, R. (2010). Why Participate? Cross-National Assessments and Foreign Aid to Education. In A. Wiseman (Ed.), The Impact of International Achievement Studies on National Education Policymaking (pp. 35–61). Emerald Group Publishing.
Kim, K. W. (2006). Measuring international research collaboration of peripheral countries: Taking the context into consideration. Scientometrics, 66(2), 231–240. https://doi.org/10.1007/s11192-006-0017
Kliegl, R., & Bates, D. (2010). International collaboration in psychology is on the rise. Scientometrics, 87(1), 149158. https://doi.org/10.1007/s11192-010-0299-0
Knowles, R. T., Torney-Purta, J., & Barber, C. (2018). Enhancing citizenship learning with international comparative research: Analyses of IEA civic education datasets. Citizenship Teaching & Learning, 13(1), 7–30. https://doi.org/10.1386/ctl.13.1.7_1
Krapp, A., & Prenzel, M. (2011). Research on interest in science: Theories, methods, and findings. International Journal of Science Education, 33(1), 27–50. https://doi.org/10.1080/09500693.2010.518645
Kwiek, M. (in press). What large-scale publication and citation data tell us about international research collaboration in Europe: changing national patterns in global contexts. Studies in Higher Education. https://doi.org/10.1080/03075079.2020.1749254
Kwiek, M. (2018). International research collaboration and international research orientation: Comparative findings about European academics. Journal of Studies in International Education, 22(2), 136–160. https://doi.org/10.1177/1028315317747084
Landahl, J. (2020). The PISA calendar: Temporal governance and international large-scale assessments. Educational Philosophy and Theory, 52(6), 625–639. https://doi.org/10.1080/00131857.2020.1731686
Lee, J. (2009). Universals and specifics of math self-concept, math self-efficacy, and math anxiety across 41 PISA 2003 participating countries. Learning and Individual Differences, 19(3), 355–365. https://doi.org/10.1016/j.lindif.2008.10.009
Lenkeit, J., Chan, J., Hopfenbeck, T. N., & Baird, J. A. (2015). A review of the representation of PIRLS related research in scientific journals. Educational Research Review, 16, 102–115. https://doi.org/10.1016/j.edurev.2015.10.002
Li, J., Burnham, J. F., Lemley, T., & Britton, R. M. (2010). Citation analysis: Comparison of Web of Science®, ScopusTM, SciFinder®, and Google Scholar. Journal of Electronic Resources, 7, 196–217. https://doi.org/10.1080/15424065.2010.505518
Lin, M., Bumgarner, E., & Chatterji, M. (2014). Understanding validity issues in international large scale assessments. Quality Assurance in Education, 22(1), 31–41. https://doi.org/10.1108/QAE-12-2013-0050
Lindblad, S., Pettersson, D., & Popkewitz, T. S. (2015). International comparisons of school results: A systematic review of research on large scale assessments in education. Stockholm: Swedish Research Council.
Linnenluecke, M. K., Marrone, M., & Singh, A. K. (2020). Conducting systematic literature reviews and bibliometric analyses. Australian Journal of Management, 45(2), 175–194. https://doi.org/10.1177/0312896219877678
Liou, P. Y., & Hung, Y. C. (2015). Statistical techniques utilized in analyzing PISA and TIMSS data in science education from 1996 to 2013: A methodological review. International Journal of Science and Mathematics Education, 13(6), 1449–1468. https://doi.org/10.1007/s10763-014-9558-5
Marsh, H. W., & Hau, K. T. (2004). Explaining paradoxical relations between academic self-concepts and achievements: Cross-cultural generalizability of the internal/external frame of reference predictions across 26 countries. Journal of Educational Psychology, 96(1), 56. https://doi.org/10.1037/0022-0663.96.1.56
Maurissen, L., Barber, C., & Claes, E. (2020). Classroom discussions and political tolerance towards immigrants: The importance of mutual respect and responsiveness. Acta Politica, 55, 242–266. https://doi.org/10.1057/s41269-018-0114-0
McVeigh, M. (2009). Citation indexes and the Web of Science. In M. J. Bates & M. N. Maack (Eds.), Encyclopedia of Library and Information Sciences (3rd ed., pp. 1027–1037). Chandos Publishing.
Meho, L. I., & Yang, K. (2007). Impact of data sources on citation counts and rankings of LIS faculty: Web of science versus Scopus and Google scholar. Journal of the American Society of Information Sciences and Technology, 58, 2105–2125. https://doi.org/10.1002/asi.20677
Meyer, J., Kamens, D., Benavot, A., Cha, Y.-K., & Wong, S.-Y. (1992). School Knowledge for the Masses: World Models and National Primary Curricular Categories in the Twentieth Century. Falmer Press.
Michaelides, M. P., & Haertel, E. H. (2004). Sampling of common items: An unrecognized source of error in test linking. Center for the Study of Evaluation (CSE), University of California
Mongeon, P., & Paul-Hus, A. (2016). The journal coverage of Web of Science and Scopus: A comparative analysis. Scientometrics, 106(1), 213–228. https://doi.org/10.1007/s11192-015-1765-5
Mosbah-Natanson, S., & Gingras, Y. (2014). The globalization of social sciences? Evidence from a quantitative analysis of 30 years of production, collaboration and citations in the social sciences (1980–2009). Current Sociology, 62(5), 626–646. https://doi.org/10.1177/0011392113498866
Mullis, I. V. S., & Martin, M. O. (2015). PIRLS 2016 Assessment Framework (2nd ed.). Retrieved from Boston College, TIMSS & PIRLS International Study Center website: http://timssandpirls.bc.edu/pirls2016/framework.html
Neal, J. W., & Neal, Z. P. (2013). Nested or Networked? Future Directions for Ecological Systems Theory. Social Development, 22(4), 722–737. https://doi.org/10.1111/sode.12018
Newman, M. E. (2001). The structure of scientific collaboration networks. Proceedings of the National Academy of Sciences, 98(2), 404–409. https://doi.org/10.1073/pnas.98.2.404
Newman, M. E. (2004). Coauthorship networks and patterns of scientific collaboration. Proceedings of the National Academy of Sciences, 101(suppl 1), 5200–5205. https://doi.org/10.1073/pnas.0307545100
OECD. (2019). Sampling in PISA. Retrieved from https://www.oecd.org/pisa/pisaproducts/SAMPLING-IN-PISA.pdf
Pettersson, D. (2008).“Internationell kunskapsbedömning som inslag i nationell styrning av skolan [International Knowledge Assessments: An Element of National Educational Steering].” PhD dissertation, Uppsala University.
PISA (2020). PISA FAQ. Retrieved from https://www.oecd.org/pisa/pisafaq/
Pizmony-Levy, O. 2013. Testing for All: The Emergence and Development of International Assessments of Student Achievement, 1958–2012. PhD. diss: Indiana University.
Pons, X. (2017). Fifteen years of research on PISA effects on education governance: A critical review. European Journal of Education, 52(2), 131–144. https://doi.org/10.1111/ejed.12213
Rindermann, H. (2007). The g-factor of international cognitive ability comparisons: The homogeneity of results in PISA, TIMSS, PIRLS and IQ-tests across nations. European Journal of Personality, 21(5), 667–706. https://doi.org/10.1002/per.634
Roemer, R. C., & Borchardt, R. (2015). Meaningful metrics: A 21st-century librarian’s guide to bibliometrics, altmetrics, and research impact. Association of College and Research Libraries.
Rolfe, M. K., Bryar, R. M., Hjelm, K., Apelquist, J., Fletcher, M., & Anderson, B. L. (2004). International collaborations to address common problems in healthcare: Processes practicalities and power. International Nursing Review, 51, 140–148. https://doi.org/10.1111/j.1466-7657.2004.00237.x
Rutkowski, D., & Delandshere, G. (2016). Causal inferences with large scale assessment data: Using a validity framework. Large-Scale Assessments in Education, 4(1), 1–18. https://doi.org/10.1186/s40536-016-0019-1
Rutkowski, D., Rutkowski, L., & von Davier, M. (2014). A brief introduction to modern international large scale assessment. In L. Rutkowski, M. von Davier, & D. Rutkowski (Eds.), Handbook of International Large Scale Assessment (pp. 3–10). CRC Press.
Sellar, S. & Lingard, B. (2013). The OECD and global governance in education. Journal of Education Policy, 28(5), 710–725. https://doi.org/10.1080/02680939.2013.779791
Sellar, S., & Lingard, B. (2014). The OECD and the Expansion of PISA: New Global Modes of Governance in Education. British Educational Research Journal, 40(6), 917–936. https://doi.org/10.1086/710777
Simola, H. (2005). The Finnish miracle of PISA: Historical and sociological remarks on teaching and teacher education. Comparative Education, 41(4), 455–470. https://doi.org/10.1080/03050060500317810
Stiggins, R. J. (1982). An analysis of the dimensions of job-related reading. Reading World, 82, 237–247
Torney, J. V., Oppenheim, A. N., & Farnen, R. F. (1975). Civic Education in Ten Countries: An Empirical Study. New York: Almqvist & Wiksell International.
Torney-Purta, J., & Amadeo, J.-A. (2013). International large-scale assessments: challenges in reporting and potentials for secondary analysis. Research in Comparative and International Education, 8(3), 248–258. https://doi.org/10.2304/rcie.2013.8.3.248
Van de Werfhorst, H. G., & Mijs, J. J. (2010). Achievement inequality and the institutional structure of educational systems: A comparative perspective. Annual Review of Sociology, 36, 407–428. https://doi.org/10.1146/annurev.soc.012809.102538
Van Eck, N. J., & Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84(2), 523–538. https://doi.org/10.1007/s11192-009-0146-3
Van Eck, N. J., & Waltman, L. (2014). Visualizing bibliometric networks. In Y. Ding, R. Rousseau, & D. Wolfram (Eds.), Measuring scholarly impact: Methods and practice (pp. 285–320). Springer.
Van Rijsbergen, C. J. (1977). A theoretical basis for the use of co-occurrence data in information retrieval. Journal of Documentation, 33(2), 106–119. https://doi.org/10.1108/eb026637
Vanderstraeten, R., Vandermoere, F., & Hermans, M. (2016). Scholarly communication in AERA journals, 1931 to 2014. Review of Research in Education, 40(1), 38–61. https://doi.org/10.3102/0091732X16678836
von Davier, M., & Sinharay, S. (2013). Analytics in International Large-Scale Assessments: Item Response Theory and Population Models, chapter 7. In L. von Rutkowski, M. Davier, & D. Rutkowski (Eds.), Handbook of International Large-Scale Assessment: Background, Technical Issues, and Methods of Data Analysis. New York: Chapman and Hall/CRC.
Wagemaker, H. (2013). International large-scale assessments: From research to policy. In L. Rutkowsky, M. von Davier, & D. Rutkowsky (Eds.), Handbook of international large-scale assessment: Background, technical issues, and methods of data analysis (pp. 11–36). CRC Press.
Waltman, L., Van Eck, N. J., & Noyons, E. C. (2010). A unified approach to mapping and clustering of bibliometric networks. Journal of Informetrics, 4(4), 629–635. https://doi.org/10.1016/j.joi.2010.07.002
Wang, J., Peters, H. P., & Guan, J. (2006). Factors influencing knowledge productivity in German research groups: Lessons for developing countries. Journal of Knowledge Management, 10, 113–126. https://doi.org/10.1108/13673270610679408
Wang, Q., & Waltman, L. (2016). Large-scale analysis of the accuracy of the journal classification systems of Web of Science and Scopus. Journal of Informetrics, 10(2), 347–364. https://doi.org/10.1016/j.joi.2016.02.003
Wiseman, A. W., Astiz, M. F., & Baker, D. P. (2014). Comparative education research framed by neo-institutional theory: a review of diverse approaches and conflicting assumptions. Compare, 44(5), 688–709. https://doi.org/10.1080/03057925.2013.800783
Wu, M. L. (2009). “A critical comparison of the contents of PISA and TIMSS mathematics assessments.” Paper presented at the NCES “What we can learn from PISA” research conference, Washington, DC, June 2, 2009.
Wu, M. (2010). Measurement, sampling, and equating errors in large-scale assessments. Educational Measurement: Issues and Practice, 29(4), 15–27. https://doi.org/10.1111/j.1745-3992.2010.00190.x
Yemini, M. (2019). International research collaborations as perceived by top-performing scholars. Journal of Studies in International Education. https://doi.org/10.1177/1028315319887392