Development and Validation of a Rubric for Diagnosing Students’ Experimental Design Knowledge and Difficulties
Tóm tắt
It is essential to teach students about experimental design, as this facilitates their deeper understanding of how most biological knowledge was generated and gives them tools to perform their own investigations. Despite the importance of this area, surprisingly little is known about what students actually learn from designing biological experiments. In this paper, we describe a rubric for experimental design (RED) that can be used to measure knowledge of and diagnose difficulties with experimental design. The development and validation of the RED was informed by a literature review and empirical analysis of undergraduate biology students’ responses to three published assessments. Five areas of difficulty with experimental design were identified: the variable properties of an experimental subject; the manipulated variables; measurement of outcomes; accounting for variability; and the scope of inference appropriate for experimental findings. Our findings revealed that some difficulties, documented some 50 yr ago, still exist among our undergraduate students, while others remain poorly investigated. The RED shows great promise for diagnosing students’ experimental design knowledge in lecture settings, laboratory courses, research internships, and course-based undergraduate research experiences. It also shows potential for guiding the development and selection of assessment and instructional activities that foster experimental design.
Từ khóa
Tài liệu tham khảo
American Association for the Advancement of Science, 2010, Vision and Change: A Call to Action
Association of American Colleges and Universities, 2013, Scientific Thinking and Integrative Reasoning Skills
Association of American Medical Colleges and the Howard Hughes Medical Institute, 2009, Report of Scientific Foundations for Future Physicians Committee
Beck CW, 2012, Ecosphere, 3, 112
Box GE, Hunter JS, Hunter WG (2005). Statistics for Experimenters: Design, Innovation, and Discovery In: 2nd ed Hoboken, NJ: Wiley.
Bullock M, 1999, Individual Development from 3 to 12, 38
Chi MT, 1988, The Nature of Expertise
College Board (2006). AP Statistics Free-Response Questions In: http://apcentral.collegeboard.com/apc/public/repository/_ap06_frq_statistics_51653.pdf (accessed 20 December 2013).
College Board (2009). AP Statistics Free-Response Question Form B In: http://apcentral.collegeboard.com/apc/public/repository/ap09_frq_statistics_formb.pdf (accessed 20 December 2013).
Duschl RA, 2007, Taking Science to School: Learning and Teaching Science in Grades K-8
Fuller RG (ed.), 2002, A Love of Discovery: Science Education—The Second Career of Robert Karplus, 10.1007/978-94-007-0876-1
Gill J, 2010, Encyclopedia of Research Design
Griffith AB, 2007, Teach Issues Exp Ecol, 5, Research #2
Grunwald S, 2010, J Coll Sci Teach, 39, 28
Harker AR, 2009, J Coll Sci Teach, 29, 97
Holmes D, 2011, Research Methods for the Biosciences
Kish L, 1965, Survey Sampling
Kloser M, 2013, J Coll Sci Teach, 42, 72
Laursen S, 2010, Undergraduate Research in the Sciences: Engaging Students in Real Science
Lopatto D, 2003, Counc Undergrad Res Q, 24, 139
Lopatto D, 2008, Creating Effective Undergraduate Research Programs in Science, 112
National Institute of Standards and Technology/SEMATECH (2003). Engineering Statistics Handbook, Section 3.1.3.6 In: www.itl.nist.gov/div898/handbook/ppc/section1/ppc136.htm (accessed 20 December 2013).
National Research Council, 2007, Rising above the gathering storm: energizing and employing America for a brighter economic future
Picone C, 2007, Teach Issues Exp Ecol, 5, Research #1
Purdue University (2010). Second Purdue Symposium on Psychological Sciences—Psychology of Science: Implicit and Explicit Processes In: http://www.purdue.edu/hhs/psy/research/symposium/2ndPSPS2010.php (accessed 20 December 2013).
Ramsey FL, 2012, The Statistical Sleuth: A Course in Methods of Data Analysis
Ruxton GD, 2006, Experimental Design for the Life Sciences
Salangam J (2007). The impact of a prelaboratory discussion on non-biology majors abilities to plan scientific inquiry In: Master's Thesis, Fullerton: California State University.
Shi J, 2011, Int J Sch Teach Learn, 5, 1
Singer S, 2006, America's Lab Report: Investigations in High School Science
Sirum K, 2011, Bioscene, 37, 8
SRI International (2003). Diffusion and Testing a New Drug 1. http://pals.sri.com/tasks/9-12/Testdrug/ (accessed 20 December 2013).
Wuensch KL (2001). When Does Correlation Imply Causation? http://core.ecu.edu/psyc/wuenschk/stathelp/Correlation-Causation.htm (accessed 20 December 2013).