Development and Validation of Scientific Literacy Scale for College Preparedness in STEM with Freshmen from Diverse Institutions
Tóm tắt
Although a major goal of Science, Technology, Engineering, and Mathematics (STEM) education is to develop scientific literacy, prior efforts at measuring scientific literacy have not attempted to link scientific literacy with success in STEM fields. The current Scientific Literacy Survey for College Preparedness in STEM (SLSCP-STEM) scale was specifically developed to predict the academic preparedness of incoming freshman STEM majors. The SLSCP-STEM was developed within the context of utilitarian scientific literacy and allows independent assessment of three dimensions of scientific literacy: (a) attitudinal and behavioral domains of scientific literacy, (b) content knowledge of scientific concepts, and (c) scientific reasoning skills. This paper presents the theoretical framework for the development of the scale along with supporting data on its validity and reliability. The SLSCP-STEM demonstrated reliability including tests of internal consistency [attitude/behavior dimension (α = .86), content knowledge dimension (α = .73), scientific reasoning dimension (α = .72)] and instrument stability over time [attitude/behavior dimension (r = 0.88, p < .01), content knowledge dimension (r = 0.74, p < .01), scientific reasoning dimension (r = 0.80, p < .01)]. Furthermore, content validity, tested with expert science faculty members, demonstrated that the content knowledge sections were relevant for freshman STEM majors. Finally, item analysis verified appropriate item difficulty level and item discrimination.
Tài liệu tham khảo
Boopathiraj, C. & Chellamani, K. (2013). Analysis of test items on difficulty level and discrimination index in the test for research in education. International Journal of Social Science & Interdisciplinary Research, 2(2), 189–193.
Carrier, R. (2001). Test your scientific literacy! Retrieved November 9, 2004 from http://www.infidels.org/library/modern/richard_carrier/SciLit.html
Champagne, A. (1989). Science. Educational Leadership, 47(2), 85–86.
Chemers, M. M., Hu, L. & Garcia, B. F. (2001). Academic self-efficacy and first-year college student performance and adjustment. Journal of Educational Psychology, 93(1), 55–64.
Cohen, L., Manion, L. & Morrison, K. (2011). Research methods in education. London: Routledge.
Cracolice, M. S., Deming, J. C. & Ehlert, B. (2008). Concept learning versus problem solving: A cognitive difference. Journal of Chemical Education, 85(6), 873–878. doi:10.1021/ed085p873.
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 291–334. doi:10.1007/BF02310555.
DeBoer, G. E. (2000). Scientific literacy: Another look at its historical and contemporary meanings and its relationship to science education reform. Journal of Research in Science Teaching, 37, 582–601. doi:10.1002/1098-2736.
Dewey, J. (1925). Experience and nature. Chicago, IL: Open Court Publishing.
Erdoğan, M. N. & Koseoglu, F. (2012). Analysis of high school physics, chemistry and biology curriculums in terms of scientific literacy themes. Educational Sciences: Theory and Practice, 12(4), 2899–2904.
Feyzioglu, B., Demirdag, B., Akyildiz, M. & Altun, E. (2012). Developing a science process skills test for secondary students: Validity and reliability study. Educational Sciences: Theory and Practice, 12(3), 1899–1906.
Frantz, K. J., DeHaan, R. L., Demetrikopoulos, M. K., & Carruth, L. L. (2006). Routes to research for novice undergraduate neuroscientists. Cell Biology Education, 5, 175–187.
Goode, C. T., Britner, S. L., Gagne, P. E., Pecore, J. L., Demetrikopoulos, M. K., Williams, B. A., Frantz, K. J. (2012). Scientific research self-efficacy among undergraduates: Current contexts and approaches for measurement. In S. Britner (Ed.), The psychology of self-efficacy. Hauppauge, NY: Nova Science.
Gormally, C., Brickman, P. & Lutz, M. (2012). Developing a test of scientific literacy skills (TOSLS): Measuring undergraduates’ evaluation of scientific information and arguments. CBE – Life Sciences Education, 11(4), 364–377.
Hathaway, R. S., Nagda, B. A. & Gregerman, S. R. (2002). The relationship of undergraduate research participation to graduate and professional education pursuit: An empirical study. Journal of College Student Development, 43(5), 614–631.
Heiman, G. W. (1998). Correlational research and the correlation coefficient. Understanding research methods and statistics: An integrated introduction for psychology. Boston, MA: Houghton Mifflin.
Hobson, A. (2008). The surprising effectiveness of college scientific literacy courses. The Physics Teachers, 46, 404–406. Retrieved from http://dx.doi.org.ezproxy.auctr.edu:2051/10.1119/1.2981285.
Holbrook, J. & Rannikmae, M. (2009). The meaning of scientific literacy. International Journal of Environmental & Science Education, 4(3), 275–288.
Hurd, P. D. (1958). Science literacy: Its meaning for American schools. Educational Leadership, 16, 13–16.
Laugksch, R. C. & Spargo, P. E. (1999). Scientific literacy of selected South African matriculants entering tertiary education: A baseline survey. South African Journal of Science, 95(10), 427–432.
Lawson, A. E., Clark, B., Cramer-Meldrum, E., Falconer, K. A., Sequist, J., & Kwon, Y. (2000). Development of scientific reasoning in college biology: Do two levels of general hypothesis-testing skills exist? Journal of Research in Science Teaching, 37(1), 81–101. doi:10.1002/(SICI)1098-2736(200001)37:1<81::AIDTEA6>3.0.CO;2-I
Miller, J. D. (1983). Scientific literacy: A conceptual and empirical review. Daedalus, 112(2), 29–48.
Miller, J. D. (1989). Scientific literacy. Paper presented at the annual meeting of the American Association for the Advancement of Science, San Francisco, CA.
Miller, J. D. (1998). The measurement of civic scientific literacy. Public Understanding of Science, 7(3), 203–223.
National Assessment of Educational Progress (2010). NAEP questions tool. Retrieved October 25, 2010 from http://nces.ed.gov/
National Research Council (NRC). (1996). National science education standards. Washington, DC: National Academies Press.
National Research Council (NRC) (2003). National Research Council: Evaluating and improving undergraduate teaching in science, technology, engineering, and mathematics. Washington, DC: Committee on Recognizing, Evaluating, Rewarding, and Developing Excellence in Teaching of Undergraduate Science, Mathematics, Engineering, and Technology, Center for Education, Division of Behavioral & Social Sciences and Education, National Academy Press.
National Science Foundation. (2001). Survey of public attitudes toward and understanding of science and technology. Retrieved March 31, 2006, from http://www.nsf.gov/statistics/srvyattitude/spaquest.pdf
National Science Teachers Association (1991). Position statement. Washington, DC: National Academies Press.
National Science Teachers Association. (2003). Standards for science teacher preparation. Retrieved from http://serc.carleton.edu/resources/20878.html.
Norris, S. P., & Phillips, L. M. (2003). How literacy in its fundamental sense is central to scientific literacy. Science Education, 87(2). doi: 10.1002/sce.10066
Rose, J.D. (2006). Scientific literacy in college freshmen: Student competencies and faculty perceptions (Unpublished master thesis). Emory University, Atlanta, GA.
Shi, J., Wood, W., Martin, J., Guild, N., Vicens, Q. & Knight, J. (2010). A diagnostic assessment for introductory molecular and cell biology. CBE Life Sciences Education, 9(4), 453–461. doi:10.1187/cbe.10-04-0055.
Weinburgh, M. H. & Englehard, G. (1994). Gender, prior academic performance and beliefs as predictors of attitudes toward biology laboratory experiences. School Science & Mathematics, 94, 118–123.
Yuenyong, C. & Narjaikaew, P. (2009). Scientific literacy and Thailand science education. International Journal of Environmental and Science Education, 4(3), 335–349.