Alignment analysis of teaching–learning-assessment within the classroom: how teachers implement project-based learning under the curriculum standards

Liu Zhao1, Bo Zhao1, Chunmi Li1
1Department of Physics, Beijing Normal University, Beijing, China

Tóm tắt

This multi-case study examined the strengths and weaknesses of aligning teaching–learning-assessment of classroom project-based learning to curriculum standards and offered suggestions for teacher training and instructional improvement. The study constructed an alignment analysis framework for analyzing the cognitive dimension of classroom project-based learning and analyzed the situation of two junior high schools in Zhejiang Province using deductive and inductive content analysis. According to the results, the cognitive demands of classroom instruction activities and classroom assessments were much higher than those of teaching objectives and curriculum standards. Simultaneously, classroom instruction paid insufficient attention to engineering topics, and all instructional implementation elements exhibited content and cognitive deficiencies. The study suggests that teachers' dearth of engineering knowledge and the characteristics of project-based learning in the classroom are the primary reasons for the lack of alignment among three instructional implementation elements with curriculum standards. Similarly, it was discovered that classroom project-based learning has the characteristics of co-development of physical knowledge and engineering content and that future research can focus on developing more effective forms of classroom content organization and time distribution.

Tài liệu tham khảo

Aksela, M., & Haatainen, O. (2019). Project‐based learning (PBL) in practice: Active Teachers’ Views of Its Advantages and Challenges. Integrated Education for the Real World: 5th International STEM in Education Conference Post-Conference Proceedings. Queensland University of Technology. Alozie, N. M., Moje, E. B., & Krajcik, J. S. (2010). An analysis of the supports and constraints for scientific discussion in high school project-based science. Science Education,94(3), 395–427. https://doi.org/10.1002/sce.20365 American Association for the Advancement of Science. (1993). Benchmarks for science literacy. Oxford University Press. Anderson, L. W., Krathwohl, D. R., Airasian, P. W., et al. (2001). Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. Addison Wesley Longman. Ayaz, M. F., & Söylemez, M. (2015). The Effect of the Project-Based Learning Approach on the Academic Achievements of the Students in Science Classes in Turkey: A Meta-Analysis Study. TED EĞİTİM ve BİLİM, 40(178). https://doi.org/10.15390/eb.2015.4000 Barak, M., & Raz, E. (2000). Hot-air balloons: Project-centered study as a bridge between science and technology education. Science Education,84(1), 27–42. https://doi.org/10.1002/(sici)1098-237x(200001)84:1%3C27::aid-sce3%3E3.0.co;2-8 Bencze, J. L., & Bowen, G. M. (2007). Student-teachers’ Dialectically Developed Motivation for Promoting Student-led Science Projects. International Journal of Science and Mathematics Education,7(1), 133–159. https://doi.org/10.1007/s10763-007-9115-6 Biggs, J. (1996). Enhancing teaching through constructive alignment. Higher Education,32(3), 347–364. https://doi.org/10.1007/bf00138871 Cohen, L., Manion, L., & Morrison, K. (2007). Research methods in education, (6th ed., ). London: Taylor & Francis. https://doi.org/10.4324/9780203029053. Condliffe, B., Quint, J., Visher, M. G., Bangser, M. R., Drohojowska, S., Saco, L., & Nelson, E. (2017). Project-based learning: A literature review. MDRC: Working Paper. Cui, Y. H. (2013). Inquiring “What Students Have Learnt”—— Concurrently Discussing Three-dimensional Object(追问“学生学会了什么”——兼论三维目标). Educational Research,34(07), 98–104. Cui, Y. H., & Lei, H. (2015). Constructing a Three-factor Model of Teaching-Learning-Assessment Alignment (教-学-评一致性三因素理论模型的建构). Journal of East China Normal University(Educational Sciences),33(04), 15–22. Doyle, W. (1983). Academic Work. Review of Educational Research,53(2), 159–199. https://doi.org/10.3102/00346543053002159 Duan, J. M., & Wu, J. S. (1988). Physical educational psychology(物理教学心理学). Beijing Normal University press. Duis, J. M., Schafer, L. L., Nussbaum, S., & Stewart, J. J. (2013). A Process for Developing Introductory Science Laboratory Learning Goals To Enhance Student Learning and Instructional Alignment. Journal of Chemical Education,90(9), 1144–1150. https://doi.org/10.1021/ed4000102 Duncan, R. G., & Hmelo-Silver, C. E. (2009). Learning progressions: Aligning curriculum, instruction, and assessment. Journal of Research in Science Teaching,46(6), 606–609. https://doi.org/10.1002/tea.20316 English, F. W., & Larson, R. L. (1996). Curriculum Management for Educational and Social Service Organizations. Charles C. Thomas Publisher. Goodlad, J. I., Klein, M. F., & Tye, K. A. (1979). The domains of curriculum and their study. In J. I. Goodlad (Ed.), Curriculum inquiry (pp. 43–76). McGrawHill. Guo, P., Saab, N., Post, L. S., & Admiraal, W. (2020). A review of project-based learning in higher education: Student outcomes and measures. International Journal of Educational Research,102, 101586. https://doi.org/10.1016/j.ijer.2020.101586 Guo, Y. X., & Ma, Y. P. (2012). Subject Ability Performance: Significance, Element and Type(学科能力表现:意义、要素与类型). Research in Educational Development,32(Z2), 29–34. https://doi.org/10.14121/j.cnki.1008-3855.2012.z2.016 Guo, Y. Y., Yao, J. X., & Zhang, Y. F. (2017). A study of physics subject competence based on students’ core literacy(基于学生核心素养的物理学科能力研究). Beijing Normal University Press. Guo, Y. Y., Zhang, Y. F., & Yao, J. X. (2016). Composition and Performance of Physics Competency (物理学科能力及其表现研究). Journal of Educational Studies,12(04), 57–63. https://doi.org/10.14082/j.cnki.1673-1298.2016.04.009 Hall, R. (2002). Aligning learning, teaching and assessment using the web: An evaluation of pedagogic approaches. British Journal of Educational Technology,33(2), 149–158. https://doi.org/10.1111/1467-8535.00249 Hargreaves, E. (2005). Assessment for learning? Thinking outside the (black) box. Cambridge Journal of Education,35(2), 213–224. https://doi.org/10.1080/03057640500146880 Harris, C. J., Penuel, W. R., D’Angelo, C. M., DeBarger, A. H., Gallagher, L. P., Kennedy, C. A., Cheng, B. H., & Krajcik, J. S. (2015). Impact of project-based curriculum materials on student learning in science: Results of a randomized controlled trial. Journal of Research in Science Teaching,52(10), 1362–1385. https://doi.org/10.1002/tea.21263 Hasni, A., Bousadra, F., Belletête, V., Benabdallah, A., Nicole, M.-C., & Dumais, N. (2016). Trends in research on project-based science and technology teaching and learning at K–12 levels: A systematic review. Studies in Science Education,52(2), 199–231. https://doi.org/10.1080/03057267.2016.1226573 Holmes, V.-L., & Hwang, Y. (2016). Exploring the effects of project-based learning in secondary mathematics education. The Journal of Educational Research,109(5), 449–463. https://doi.org/10.1080/00220671.2014.979911 Hong, J.-C., Yu, K.-C., & Chen, M.-Y. (2010). Collaborative learning in technological project design. International Journal of Technology and Design Education,21(3), 335–347. https://doi.org/10.1007/s10798-010-9123-7 Hsieh, H.-F., & Shannon, S. E. (2005). Three Approaches to Qualitative Content Analysis. Qualitative Health Research,15(9), 1277–1288. https://doi.org/10.1177/1049732305276687 Jackson, P. W., American Educational Research Association. (1992). Handbook of research on curriculum: A Project of the American Educational Research Association (pp. 402–435). Macmillan Library Reference Usa. Jin, H., Mikeska, J. N., Hokayem, H., & Mavronikolas, E. (2019). Toward coherence in curriculum, instruction, and assessment: A review of learning progression literature. Science Education,103(5), 1206–1234. https://doi.org/10.1002/sce.21525 Kanter, D. E., & Konstantopoulos, S. (2010). The impact of a project-based science curriculum on minority student achievement, attitudes, and careers: The effects of teacher content and pedagogical content knowledge and inquiry-based practices: Impact of Project-Based Science on Minority Students. Science Education,94(5), 855–887. https://doi.org/10.1002/sce.20391 Kennedy, D., Hyland, Á., & Ryan, N. (2007). Writing and Using Learning Outcomes: A Practical Guide. University College Cork. Klahr, D. (2002). Exploring science : the cognition and development of discovery processes . Mit. Krajcik, J. S., & Shin, N. (2014). Project-Based Learning. The Cambridge Handbook of the Learning Sciences, 275–297. https://doi.org/10.1017/cbo9781139519526.018 Krajcik, J. S., & Czerniak, C. M. (2018). Teaching Science in Elementary and Middle School. Routledge. Krajcik, J., McNeill, K. L., & Reiser, B. J. (2007). Learning-goals-driven design model: Developing curriculum materials that align with national standards and incorporate project-based pedagogy. Science Education,92(1), 1–32. https://doi.org/10.1002/sce.20240 Lawson, A. E. (1985). A review of research on formal reasoning and science teaching. Journal of Research in Science Teaching,22(7), 569–617. https://doi.org/10.1002/tea.3660220702 Lee, D., Huh, Y., & Reigeluth, C. M. (2015). Collaboration, intragroup conflict, and social skills in project-based learning. Instructional Science,43(5), 561–590. https://doi.org/10.1007/s11251-015-9348-7 Li, C. M. (2002). The structure model of physics experiment manipulativeability for high school student(物理实验操作能力的结构模型初探). Journal of Educational Studies,06, 39–42. Li, C. M., & Zhang, X. (2022). Analysis of the changes in the Compulsory Education Physics Curriculum Standards (2022 Edition)(《义务教育物理课程标准(2022年版)》的变化分析). Physics Teacher,43(06), 35–44. Liu, H. (2009). The road to excellence in classroom assessment - On classroom assessment that points to the promotion of learning(追求卓越的课堂评价之路——论指向促进学习的课堂评价). Contemporary Education Sciences,24, 25–28. Liu, X., Zhang, B., Liang, L. L., Fulmer, G., Kim, B., & Yuan, H. (2009). Alignment between the physics content standard and the standardized test: A comparison among the United States-New York State, Singapore, and China-Jiangsu: Content Standard and Standardized Test. Science Education,93(5), 777–797. https://doi.org/10.1002/sce.20330 Lu, M., & Jiang, Y. Y. (2022). Implementing the Core Competencies of Curriculum: The Design and Practice of Unit Learning Program(落实学科核心素养: 单元学历案的设计与实践). Global Education,51(04), 71–83. Luo, Y., Xie, X. Y., Han, S. S., & Guo, Y. Y.(2021). New Physics Teaching Model in Middle School: Project-based Instruction(中学物理教学新模式:基于项目的教学). Curriculum, Teaching Material and Method,41(06),103–109. doi:https://doi.org/10.19877/j.cnki.kcjcjf.2021.06.021. Marca, P., Redfield, D. L., & Winter, P. C. (2000). State Standards and State Assessment Systems: A Guide to Alignment. Series on Standards and Assessments. Markula, A., & Aksela, M. (2022). The key characteristics of project-based learning: How teachers implement projects in K-12 science education. Disciplinary and Interdisciplinary Science Education Research,4(1), 2. https://doi.org/10.1186/s43031-021-00042-x Mentzer, G. A., Czerniak, C. M., & Brooks, L. (2017). An Examination of Teacher Understanding of Project Based Science as a Result of Participating in an Extended Professional Development Program: Implications for Implementation: Teacher Extended PBS PD. School Science and Mathematics,117(1–2), 76–86. https://doi.org/10.1111/ssm.12208 Michaels, S., Shouse, A. W., Schweingruber, H. A., & Council, R. (2008). Ready, Set, Science! : Putting Research To Work In K-8 Science Classrooms. National Academies Press. Ministry of Education, & PRC. (2003). The Curriculum Standards for Physics of Senior High School (Experiment)(普通高中物理课程标准 (实验) ). People’s Education Press. Ministry of Education PRC. (2022). Compulsory Education Science Curriculum Standards (2022 Edition)(义务教育科学课程标准 (2022年版) ). Beijing Normal University Press. Näsström, G., & Henriksson, W. (2017). Alignment of Standards and Assessment: A theoretical and empirical study of methods for alignment. Electronic Journal of Research in Education Psychology, 6(16). https://doi.org/10.25115/ejrep.v6i16.1296 NGSS Lead States. (2013). Next Generation Science Standards: For states, by states. The National Academies Press. Novak, A. M., & Krajcik, J. S. (2019). A Case Study of Project‐Based Learning of Middle School Students Exploring Water Quality. The Wiley Handbook of Problem‐Based Learning, 551–572. https://doi.org/10.1002/9781119173243.ch24 OECD. (2013). Assessing scientific, reading and mathematical literay: A framework for PISA 2015. OECD. OECD. (2019). PISA 2018 results (volume III): What school life means for students’ lives. OECD Publishing, Paris. https://doi.org/10.1787/acd78851-en Polikoff, M. S., Gasparian, H., Korn, S., Gamboa, M., Porter, A. C., Smith, T., & Garet, M. S. (2019b). Flexibly Using the Surveys of Enacted Curriculum to Study Alignment. Educational Measurement: Issues and Practice, 39(2). https://doi.org/10.1111/emip.12292 Porter, A. C. (2002). Measuring the Content of Instruction: Uses in Research and Practice. Educational Researcher,31(7), 3–14. https://doi.org/10.3102/0013189X031007003 Porter.(1997). How SEC. Measures Alignment. Educational Researcher ,5(2),12,9,5,8. Rothman, R. (2003). Imperfect Matches: The Alignment of Standards and Tests. National Research Council. Santyasa, I & Rapi, Ni & Sara, I.(2020). Project Based Learning and Academic Procrastination of Students in Learning Physics. International Journal of Instruction, 13(1), 489–508. https://doi.org/10.29333/iji.2020.13132a Sasson, I., Yehuda, I., & Malkinson, N. (2018). Fostering the skills of critical thinking and question-posing in a project-based learning environment. Thinking Skills and Creativity,29, 203–212. https://doi.org/10.1016/j.tsc.2018.08.001 Sawyer, R. K. (Ed.). (2006). The Cambridge handbook of the learning sciences. Cambridge University Press. Sewagegn, A. A. (2020). Learning Objective and Assessment Linkage: Its Contribution to Meaningful Student Learning. Universal Journal of Educational Research,8(11), 5044–5052. https://doi.org/10.13189/ujer.2020.081104 Steele, A. L. (2023). Experiential Learning in Engineering Education. CRC Press. https://doi.org/10.1201/9781003007159 Sweller, J., van Merriënboer, J. J. G., & Paas, F. (2019). Cognitive Architecture and Instructional Design: 20 Years Later. Educational Psychology Review,31(2), 261–292. https://doi.org/10.1007/s10648-019-09465-5 Tal, T., Krajcik, J. S., & Blumenfeld, P. C. (2006). Urban schools’ teachers enacting project-based science. Journal of Research in Science Teaching,43(7), 722–745. https://doi.org/10.1002/tea.20102 Thomas, J. W. (2000). A review of research on project-based learning. Autodesk Foundation. Turan-Özpolat, E., & Bay, E. (2017). Analyzing the Curriculum Alignment of Teachers. Universal Journal of Educational Research,5, 1161–1181. Viro, E., Lehtonen, D., Joutsenlahti, J., & Tahvanainen, V. (2020). Teachers’ perspectives on project-based learning in mathematics and science. European Journal of Science and Mathematics Education,8(1), 12–31. https://doi.org/10.30935/scimath/9544 Wang, L. (2016). Exploring Performance and Intrinsic Composition of Disciplinary CompetenceBased on the Multi-integrative Model of “Learning-Applying-Innovating”(学科能力构成及其表现研究——基于学习理解、应用实践与迁移创新导向的多维整合模型). Educational Research,37(9), 83–92+125. Webb, N. L. (1999). Alignment of Science and Mathematics Standards and Assessments in Four States. Research Monograph No. 18. Wiggins, G. P., & McTighe, J. (2005). Understanding by design (2nd ed.). Association for Supervision and Curriculum Development. Wu, H. Q., & Gao, X. D. (2022). The Deviation, Practical Dilemma and Its Transcendence of the Integrated Concept of “Teaching, Learning, and Evaluation” (“教·学·评”一体化理念偏差与实践困境及其超越). Educational Science Research,02, 54–58+66. Xu, B. Y. (2013). Research on Core Competencies in School Mathematics(数学学科核心能力研究). Global Education,42(06), 67–74+95. Xue, H. X. (2022). Integrated Design and Implementation: Cracking the Practical Misunderstandings of Project Learning(一体化设计与实施: 破解项目学习的实践误区). Primary and secondary school management(中小学管理),06, 37–40. Yan, J. D., Duan, J. M., Xu, P. J., & Huo, L. L. (1991). Physics Teaching Theor. Jiangsu Education press(江苏教育出版社). Yang,J.D.(2020). Research on Competency-Oriented High School Chemistry Teaching-Learning-Assessment Alignment(“素养为本”的高中化学“教、学、评”一致性研究). (Published doctoral dissertation, Central China Normal University). https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CDFDLAST2021&filename=1020140071.nh Yang, X. D. (2017). Competence-based Curriculum Standards Development for Basic Education(基于核心素养的基础教育课程标准研制). Global Education,46(10), 34–48. Yang, X. D. (2022). On the Conceptualization and Standard Development of Competency-based Academic Achievement(素养本位学业质量的内涵及意义). Global Education,51(05), 79–93. Yin, R. K. (2014). Case study research: Design and methods (5th ed.). SAGE Publications. Zhang, H. (2014). The Technique and Features of Flanders Interaction Analysis System(弗兰德斯互动分析系统的方法与特点). Contemporary Education and Culture,6(02), 68–73. https://doi.org/10.13749/j.cnki.cn62-1202/g4.2014.02.012 Zhao, Y., & Wang, L. (2022). A case study of student development across project-based learning units in middle school chemistry. Disciplinary and Interdisciplinary Science Education Research, 4(1). https://doi.org/10.1186/s43031-021-00045-8 Zhen, L., & Lei, H. (2017). Progress and Operation Mechanism of the “Implementation of Course Investigation” Program in the United States –- An Interview with Dr. John Smithson, Director of the SEC Program(美国"实施课程调查"项目进展及运作机制——SEC项目主任约翰·史密森博士专访). Global Education,46(10), 11–23. Zimmerman, C. (2007). The development of scientific thinking skills in elementary and middle school. Developmental Review,27(2), 172–223. https://doi.org/10.1016/j.dr.2006.12.001