NGSS-based teacher professional development to implement engineering practices in STEM instruction

Al-Balushi, S., & Al-Abdali, N. (2015). Using a Moodle-based professional development program to train science teachers to teach for creativity and its effectiveness on their teaching practices. Journal of Science Education and Technology, 24(4), 461–475. https://doi.org/10.1007/s10956-014-9530-8. American Association for the Advancement of Science (1990). Project 2061: Science for all Americans. Oxford University Press. American Association for the Advancement of Science (1994). Benchmarks for science literacy. Oxford University Press. American Society for Engineering Education (2014). Standards for preparation and professional development for teachers of engineering. American Society for Engineering Education. Anthony, A. (2003). Computing education in academia: Toward differentiating the disciplines. In Proceedings of the CITC 2003 4th conference on information technology curriculum, (pp. 1–8). https://doi.org/10.1145/947121.947123. Aschbacher, P. R., Ing, M., & Tsai, S. M. (2014). Is science me? Exploring middle school students’ STE-M career aspirations? Journal of Science Education and Technology, 23(6), 735–743. https://doi.org/10.1007/s10956-014-9504-x. Ashford, S. N., Lanehart, R. E., Kersaint, G. K., Lee, R. S., & Kromrey, J. D. (2016). STEM pathways: Examining persistence in rigorous math and science coursetaking. Journal of Science Education and Technology, 25(6), 961–975. https://doi.org/10.1007/s10956-016-9654-0. Astor-Jack, T., McCallie, E., & Balcerzak, P. (2007). Academic and informal science education practitioner views about professional development in science education. Science Education, 91(4), 604–628. https://doi.org/10.1002/sce.20205. Avraamidou, L. (2015). Reconceptualizing elementary teacher preparation: a case for informal science education. International Journal of Science Education, 37(1), 108–135. https://doi.org/10.1080/09500693.2014.969358. Banilower, E. R., Smith, P. S., Malzahn, K. A., Plumley, C. L., Gordon, E. M., & Hayes, M. L. (2018). Report of the 2018 national survey of science and mathematics education+. Horizon Research, Inc http://www.horizon-research.com/report-of-the-2018-nssme. Brand, B. R. (2020). Integrating science and engineering practices: Outcomes from a collaborative professional development. International Journal of STEM Education, 7(13). https://doi.org/10.1186/s40594-020-00210-x. Bugallo, M. F., & Kelly, A. M. (2014). A pre-college recruitment strategy for electrical and computer engineering study. In Integrated STEM education conference (ISEC), 2014 IEEE 4th, (pp. 1–4). https://doi.org/10.1109/ISECon.2014.6891010. Bybee, R. W. (2011). Scientific and engineering practices in K-12 classrooms. The Science Teacher, 78(9), 34–40. Campbell, J. L., Quincy, C., Osserman, J., & Pedersen, O. K. (2013). Coding in-depth semistructured interviews: Problems of unitization and intercoder reliability and agreement. Sociological Methods & Research, 42(3), 294–320. https://doi.org/10.1177/0049124113500475. Cantrell, P., Pekcan, G., Itani, A., & Velasquez-Bryant, N. (2006). The effects of engineering modules on student learning in middle school science classrooms. Journal of Engineering Education, 95(4), 301–309. https://doi.org/10.1002/j.2168-9830.2006.tb00905.x. Christian, K., Kelly, A. M., Bugallo, M. F., & Sheppard, K. (2018). University-based training of high school science teachers to implement the next generation science standards. In Proceedings of the 2018 American Society for Engineering Education Annual Conference & Exposition https://peer.asee.org/29898. Clarke, D., & Hollingsworth, H. (2002). Elaborating a model of teacher professional growth. Teaching and Teacher Education, 18(8), 947–967. https://doi.org/10.1016/S0742-051X(02)00053-7. Clarke, D. J., & Peter, A. (1993). Modelling teacher change. In Contexts in mathematics education. Proceedings of the Sixteenth Annual Conference of the Mathematics Education Research Group of Australasia (MERGA), (pp. 167–175) https://pub.uni-bielefeld.de/record/2938175. Creswell, J. W., Plano Clark, V. L., Gutmann, M. L., & Hanson, W. E. (2003). Advanced mixed methods research designs. In A. Tashakkori, & C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research, (pp. 209–240). Sage. Cunningham, C. M., & Kelly, G. J. (2017). Epistemic practices of engineering for education. Science Education, 101(3), 486–505. https://doi.org/10.1002/sce.21271. Cunningham, C. M., Knight, M. T., Carlsen, W. S., & Kelly, G. (2007). Integrating engineering in middle and high school classrooms. International Journal of Engineering Education, 23(1), 3–8. Darling-Hammond, L., Hyler, M. E., & Gardner, M. (2017). Effective teacher professional development. Learning Policy Institute https://learningpolicyinstitute.org/product/effective-teacher-professional-development-report. Daugherty, J. L. (2010). Engineering professional development design for secondary school teachers: A multiple case study. Journal of Technology Education, 21(1), 10–24. https://doi.org/10.21061/jte.v21i1.a.1. Daugherty, J. L., & Custer, R. L. (2012). Secondary level engineering professional development: Content, pedagogy, and challenges. International Journal of Technology and Design Education, 22, 51–64. https://doi.org/10.1007/s10798-010-9136-2. Duschl, R. A., & Bybee, R. W. (2014). Planning and carrying out investigations: An entry to learning and to teacher professional development around NGSS science and engineering practices. International Journal of STEM Education, 1(12). https://doi.org/10.1186/s40594-014-0012-6. Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272. Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175–191. https://doi.org/10.3758/BF03193146. Fischer, C. T. (2009). Bracketing in qualitative research: Conceptual and practical matters. Psychotherapy Research Methods, 19(4-5), 583–590. https://doi.org/10.1080/10503300902798375. Fortus, D., Dershimer, R. C., Krajcik, J., Marx, R. W., & Mamlok-Naaman, R. (2004). Design-based science and student learning. Journal of Research in Science Teaching, 41(10), 1081–1110. https://doi.org/10.1002/tea.20040. Fouad, N. (1995). Career linking: An intervention to promote math and science career awareness. Journal of Counseling & Development, 73(5), 527–534. https://doi.org/10.1002/j.1556-6676.1995.tb01789.x. Garet, M. S., Porter, A. C., Desimone, L., Birman, B. F., & Yoon, K. S. (2001). What makes professional development effective? Results from a national sample of teachers. American Educational Research Journal, 38(4), 915–945. https://doi.org/10.3102/00028312038004915. Gearns, R., Kelly, A. M., & Bugallo, M. F. (2018). Professional development for high school guidance counselors to facilitate precollege STEM preparation. In Proceedings of the 2018 American Society for Engineering Education Annual Conference & Exposition https://peer.asee.org/30897. Gibbons, S. J., Hirsch, L. S., Kimmel, H., Rockland, R., & Bloom, J. (2003). Counselors’ attitudes and knowledge about engineering. In Proceedings of the 2003 International Conference on Engineering Education, (pp. 1–7). Guest, G., Bunce, A., & Johnson, L. (2006). How many interviews are enough? An experiment with data saturation and variability. Field Methods, 18(1), 59–82. https://doi.org/10.1177/1525822X05279903. Guzey, S. S., Ring-Whalen, E. A., Harwell, M., & Peralta, Y. (2019). Life STEM: A case study of life science learning through engineering design. International Journal of Science and Mathematics Education, 17(1), 23–42. https://doi.org/10.1007/s10763-017-9860-0. Haag, S., & Megowan-Romanowicz, C. (2015). Next generation science standards: A national mixed-methods study on teacher readiness. School Science and Mathematics, 115(8), 416–426. https://doi.org/10.1111/ssm.12145. Hall, C., Dickerson, J., Batts, D., Kauffman, P., & Bosse, M. (2011). Are we missing opportunities to encourage interest in STEM fields? Journal of Technology Education, 23(1), 32–46 https://eric.ed.gov/?id=EJ965337. Hardré, P. L., Nanny, M., Refai, H., Ling, C., & Slater, J. (2010). Engineering a dynamic science learning environment for K-12 teachers. Teacher Education Quarterly, 37(2), 157–178 https://www.jstor.org/stable/23479594. Harris, D., Black, L., Hernandez-Martinez, P., Pepin, B., & Williams, J. (2015). Mathematics and its value for engineering students: What are the implications for teaching? International Journal of Mathematical Education in Science and Technology, 46(3), 321–336. https://doi.org/10.1080/0020739X.2014.979893. Jick, T. D. (1979). Mixing qualitative and quantitative methods: Triangulation in action. Administrative Science Quarterly, 24(4), 602–611. https://doi.org/10.2307/2392366. Kelley, T. R., Knowles, J. G., Holland, J. D., & Han, J. (2020). Increasing high school teachers self-efficacy for integrated STEM instruction through a collaborative community of practice. International Journal of STEM Education, 7, 1–13. https://doi.org/10.1186/s40594-020-00211-w. Kelly, A. M., & Sheppard, K. (2009). Secondary physics availability in an urban setting: The relationship to academic achievement and course offerings. American Journal of Physics, 77(10), 902–906. https://doi.org/10.1119/1.3191690. Kelly, A. M., & Sheppard, K. (2010). The relationship between the urban small schools movement and access to physics education. Science Educator, 19(1), 14–25 https://eric.ed.gov/?id=EJ874150. Kelly, A. M., & Sheppard, K. (2019). Access to elite urban science schools in the U.S.: Opportunity, disparate impact, and equal protection. Teachers College Record https://www.tcrecord.org/Content.asp?ContentID=22951. Kimmel, H., Carpinelli, J., & Rockland, R. (2007, September). Bringing engineering into K-12 schools: A problem looking for solutions? In Paper presented at the International Conference in Engineering Education. Knapp, M. S. (2003). Chapter 4: Professional development as a policy pathway. Review of Research in Education, 27(1), 109–157. https://doi.org/10.3102/0091732X027001109. Kolmos, A., Mejlgaard, N., Haase, S., & Holgaard, J. E. (2013). Motivational factors, gender and engineering education. European Journal of Engineering Education, 38(3), 340–358. https://doi.org/10.1080/03043797.2013.794198. Krakehl, R., Kelly, A. M., Sheppard, K., & Palermo, M. (2020). Physics teacher isolation, contextual characteristics, and student achievement. Physical Review Physics Education Research, 16(2), 020117. https://doi.org/10.1103/PhysRevPhysEducRes.16.020117. Krayem, Z. N., Kelly, A. M., Bugallo, M. F., Westerfeld, D., Gearns, R., & Westervelt, K. (2018). Precollege electrical engineering outreach: The design of a home security system. In Proceedings of the 2018 American Society for Engineering Education Annual Conference & Exposition https://peer.asee.org/30881. Lauer, P. A., Christopher, D. E., Firpo-Triplett, R., & Buchting, F. (2014). The impact of short-term professional development on participant outcomes: A review of the literature. Professional Development in Education, 40(2), 207–227. https://doi.org/10.1080/19415257.2013.776619. Matusovich, H. M., Streveler, R. A., & Miller, R. L. (2010). Why do students choose engineering? A qualitative, longitudinal investigation of students’ motivational values. Journal of Engineering Education, 99(4), 289–303. https://doi.org/10.1002/j.2168-9830.2010.tb01064.x. May, G. S., & Chubin, D. E. (2003). A retrospective on undergraduate engineering success for underrepresented minority students. Journal of Engineering Education, 92(1), 27–39. https://doi.org/10.1002/j.2168-9830.2003.tb00735.x. McGowan, V., Ventura, M., & Bell, P. (2017). Reverse engineering: How students’ everyday experiences can support science learning through engineering design. Science and Children, 54(8), 68–72. Mehalik, M. M., Doppelt, Y., & Schuun, C. D. (2008). Middle-school science through design-based learning versus scripted inquiry: Better overall science concept learning and equity gap reduction. Journal of Engineering Education, 97(1), 71–85. https://doi.org/10.1002/j.2168-9830.2008.tb00955.x. Messick, S. (1989). Meaning and values in test validation: The science and ethics of assessment. Educational Researcher, 18(2), 5–11. https://doi.org/10.3102/0013189X018002005. Montfort, D. B., Brown, S., & Whritenour, V. (2013). Secondary students’ conceptual understanding of engineering as a field. Journal of Pre-College Engineering Education Research (J-PEER), 3(2), 2. https://doi.org/10.7771/2157-9288.1057. Moore, J. L. (2006). A qualitative investigation of African American males’ career trajectory in engineering: Implications for teachers, school counselors, and parents. Teachers College Record, 108(2), 246–266. Morse, J. M., Barrett, M., Mayan, M., Olson, K., & Spers, J. (2002). Verification strategies for establishing reliability and validity in qualitative research. International Journal of Qualitative Methods, 1(2), 13–22. https://doi.org/10.1177/160940690200100202. Mundfrom, D. J., Shaw, D. G., & Ke, T. L. (2005). Minimum sample size recommendations for conducting factor analyses. International Journal of Testing, 5(2), 159–168. https://doi.org/10.1207/s15327574ijt0502_4. Nathan, M. J., Tran, N. A., Atwood, A. K., Prevost, A. M. Y., & Phelps, L. A. (2010). Beliefs and expectations about engineering preparation exhibited by high school STEM teachers. Journal of Engineering Education, 99(4), 409–426. https://doi.org/10.1002/j.2168-9830.2010.tb01071.x. National Academy of Engineering (2009). Engineering in K-12 education: Understanding the status and improving the prospects. The National Academies Press. https://doi.org/10.17226/12635. National Academy of Engineering and National Research Council (2014). STEM integration in K-12 education: Status, prospects, and an agenda for research. The National Academies Press. National Center for Science and Engineering Statistics (2018). Science and engineering indicators 2018. National Science Foundation https://www.nsf.gov/statistics/2018/nsb20181/. National Research Council (1996). National science education standards. The National Academies Press. https://doi.org/10.17226/4962. National Research Council (2012). A framework for K-12 science education: Practices, crosscutting concepts, and core ideas. The National Academies Press. https://doi.org/10.17226/13165. New York State Education Department (1996). Standard 4 (Science). In Learning standards for MST. New York State Education Department. New York State Education Department (2016). New York State P-12 science learning standards. New York State Education Department. New York State Education Department (2018). New York State school report cards. New York State Education Department. New York State Education Department (2019). New York State P-12 Science Standards development, adoption, and implementation. New York State Education Department. NGSS Lead States (2013). Next generation science standards: For states, by states. The National Academies Press. https://doi.org/10.17226/18290. Nugent, G., Kunz, G., Rilett, L., & Jones, E. (2010). Extending engineering education to K-12. The Technology Teacher, 69(7), 14–20. Packard, B. W. L., & Jeffers, K. C. (2013). Advising and progress in the community college STEM transfer pathway. NACADA Journal, 33(2), 65–76. https://doi.org/10.12930/NACADA-13-015. Padwa, L., Kelly, A. M., & Sheppard, K. (2019). Chemistry teacher isolation, contextual characteristics, and student performance. Journal of Chemical Education, 96(11), 2383–2392. https://doi.org/10.1021/acs.jchemed.9b00392. Peters-Burton, E. E., & Johnson, T. (2018). Cross-case analysis of engineering education experiences in inclusive STEM-focused high schools in the United States. International Journal of Education in Mathematics, Science and Technology, 6(4), 320–342 https://eric.ed.gov/?id=EJ1193468. Porter, T., West, M. E., Kajfez, R. L., Malone, K. L., & Irving, K. E. (2019). The effect of teacher professional development on implementing engineering in elementary schools. Journal of Pre-College Engineering Education Research (J-PEER), 9(2), 5. https://doi.org/10.7771/2157-9288.1246. Purzer, S., Moore, T. J., Baker, D., & Berland, L. (2014). Supporting the implementation of the next generation science standards (NGSS) through research. National Association of Research in Science Teaching https://narst.org/blog/ngss-engineering. Purzer, S., & Quintana-Cifuentes, J. P. (2019). Integrating engineering in K-12 science education: Spelling out the pedagogical, epistemological, and methodological arguments. Disciplinary and Interdisciplinary Science Education Research, 1(13). https://doi.org/10.1186/s43031-019-0010-0. Putnam, R. T., & Borko, H. (2000). What do new views of knowledge and thinking have to say about research on teacher learning? Educational Researcher, 29(1), 4–15. https://doi.org/10.3102/0013189X029001004. Saldaña, J. (2009). The coding manual for qualitative researchers. Sage. Sheppard, K., Padwa, L., Kelly, A. M., & Krakehl, R. (2020). Out-of-field teaching in chemistry and physics: An empirical census study. Journal of Science Teacher Education, 31(7), 746–767. https://doi.org/10.1080/1046560X.2019.1702268. Shernoff, D. J., Sinha, S., Bressler, D. M., & Ginsburg, L. (2017). Assessing teacher education and professional development needs for the implementation of integrated approaches to STEM education. International Journal of STEM Education, 4(13). https://doi.org/10.1186/s40594-017-0068-1. Silk, E. M., Schunn, C. D., & Cary, M. S. (2009). The impact of an engineering design curriculum on science reasoning in an urban setting. Journal of Science Education and Technology, 18(3), 209–223. https://doi.org/10.1007/s10956-009-9144-8. Singer, J. E., Ross, J. M., & Jackson-Lee, Y. (2016). Professional development for the integration of engineering in high school STEM classrooms. Journal of Pre-College Engineering Education Research (J-PEER), 6(1), 3. https://doi.org/10.7771/2157-9288.1130. Smith, P. S. (2020). Obstacles to and progress toward the vision of the NGSS. Horizon Research, Inc. Stevens, J. P. (2012). Applied multivariate statistics for the social sciences. Routledge. Stuart, Z., Kelly, A. M., Westerfeld, D., & Bugallo, M. F. (2021). NGSS engineering practices in physics instruction: Building a night light. The Physics Teacher, 59(3), 171–174. Supovitz, J. A., & Turner, H. M. (2000). The effects of professional development on science teaching practices and classroom culture. Journal of Research in Science Teaching, 37(9), 963–980. https://doi.org/10.1002/1098-2736(200011)37:9<963::AID-TEA6>3.0.CO;2-0. Thatcher, W., & Meyer, H. (2017). Identifying initial conceptions of engineering and teaching engineering. Education Sciences, 7(4), 88. https://doi.org/10.3390/educsci7040088. Thompson, G. (2019). Update on the Next Generation Science Standards (NGSS). Victory/A Pass Education Group https://victoryprd.com/blog/update-on-next-generation-science-standards-ngss/. Tyson, W. (2011). Modeling engineering degree attainment using high school and college physics and calculus coursetaking and achievement. Journal of Engineering Education, 100(4), 760–777. https://doi.org/10.1002/j.2168-9830.2011.tb00035.x. Wang, H., Moore, T. J., Roehrig, G. H., & Park, M. S. (2011). STEM integration: teacher perceptions and practice. Journal of Pre-College Engineering Education Research (J-PEER), 1(2), Article 2. https://doi.org/10.5703/1288284314636. Watkins, J., McCormick, M., Wendell, K. B., Spencer, K., Milto, E., Portsmore, M., & Hammer, D. (2018). Data-based conjectures for supporting responsive teaching in engineering design with elementary teachers. Science Education, 102(3), 548–570. https://doi.org/10.1002/sce.21334. Williams, T., Singer, J., Krikorian, J., Rakes, C., & Ross, J. (2019). Measuring pedagogy and the integration of engineering design in STEM classrooms. Journal of Science Education and Technology, 28(3), 179–194. https://doi.org/10.1007/s10956-018-9756-y. Yaşar, Ş., Baker, D., Robinson-Kurpius, S., Krause, S., & Roberts, C. (2006). Development of a survey to assess K-12 teachers’ perceptions of engineers and familiarity with teaching design, engineering, and technology. Journal of Engineering Education, 95(3), 205–216. https://doi.org/10.1002/j.2168-9830.2006.tb00893.x. Yerrick, R., & Beatty-Adler, D. (2011). Addressing equity and diversity with teachers through informal science institutions and teacher professional development. Journal of Science Teacher Education, 22, 229–253. https://doi.org/10.1007/s10972-011-9226-3. Yoon, K. S., Duncan, T., Lee, S. W. Y., Scarloss, B., & Shapley, K. L. (2007). Reviewing the evidence on how teacher professional development affects student achievement. Issues & answers. REL 2007-No. 033. Regional Educational Laboratory Southwest (NJ1) https://eric.ed.gov/?id=ED498548. Yoon, S., Evans, M. G., & Strobel, J. (2014). Validation of the teaching engineering self-efficacy scale for K-12 teachers: A structural equation modeling approach. Journal of Engineering Education, 103(3), 463–485. https://doi.org/10.1002/jee.20049.