The Instructional Challenge in Improving Teaching Quality: Lessons from a Classroom Observation Protocol
Tóm tắt
Teacher evaluation is a major policy initiative intended to improve the quality of classroom instruction. This study documents a fundamental challenge to using teacher evaluation to improve teaching and learning.
Using an observation instrument (CLASS-S), we evaluate evidence on different aspects of instructional practice in algebra classrooms to consider how much scores vary, how well observers are able to judge practice, and how well teachers are able to evaluate their own practice.
The study includes 82 Algebra I teachers in middle and high schools. Five observers completed almost all observations.
Each classroom was observed 4–5 times over the school year. Each observation was coded and scored live and by video. All videos were coded by two independent observers, as were 36% of the live observations. Observers assigned scores to each of 10 dimensions. Observer scores were also compared with master coders for a subset of videos. Participating teachers also completed a self-report instrument (CLASS-T) to assess their own skills on dimensions of CLASS-S.
For each lesson, data were aggregated into three domain scores, Emotional Support, Classroom Organization, and Instructional Support, and then averaged across lessons to create scores for each classroom.
Classroom Observation scores fell in the high range of the protocol. Scores for Emotional Support were in the midlevel range, and the lowest scores were for Instructional Support. Scores for each domain were clustered in narrow ranges. Observers were more consistent over time and agreed more when judging Classroom Organization than the other two domains. Teacher ratings of their own strengths and weaknesses were positively related to observation scores for Classroom Organization and unrelated to observation scores for Instructional Support.
This study identifies a critical challenge for teacher evaluation policy if it is to improve teaching and learning. Aspects of teaching and learning in the observation protocol that appear most in need of improvement are those that are the hardest for observers to agree on, and teachers and external observers view most differently. Reliability is a marker of common understanding about important constructs and observation protocols are intended to provide a common language and structure to inform teaching practice. This study suggests the need to focus our efforts on the instructional and interactional aspects of classrooms through shared conversations and clear images of what teaching quality looks like.
Từ khóa
Tài liệu tham khảo
Allen J. P., 2013, Journal of School Psychology, 42, 76
Bill and Melinda Gates Foundation, 2012, Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains
Burniske J., 2012, The use of student perceptual data as a measure of teaching effectiveness (Texas Comprehensive Center Briefing Paper)
Doyle W., 1986, Handbook of research on teaching, 4
Glazerman S., 2011, Passing muster: Evaluating teacher evaluation systems
Glazerman S., 2010, Evaluating teachers: The important role of value-added
Goe L., 2008, Approaches to evaluating teacher effectiveness: A research synthesis
Gonzales P., 2008, Highlights from TIMSS 2007: Mathematics and science achievement of U.S. fourth- and eighth-grade students in an international context
Goodlad J., 1984, A place called school: Prospects for the future
Hamre B. K., 2008, My areas of strength and growth
Horizon Research, Inc., 2000, Inside the classroom observation and analytic protocol
Horng E. L., 2009, Principal time-use and school effectiveness
National Commission on Excellence in Education, 1983, A nation at risk: The imperative for educational reform
National Governors Association Center for Best Practices, & Council of Chief State School Officers, 2010, Common core state standards for mathematics
Pianta R. C., 2009, Classroom Assessment Scoring System (CLASS), secondary manual
Rhode Island Department of Education, 2011, The Rhode Island model: Guide to evaluating building administrators and teachers
Ripley A. (2012, October). Why kids should grade teachers. The Atlantic. Retrieved from http://www.theatlantic.com/magazine/archive/2012/10/why-kids-should-grade-teachers/309088/
Sartain L., 2011, Rethinking teacher evaluation in Chicago: Lessons learned from classroom observations, principal-teacher conferences, and district implementation
Sykes G., 2009, Fifty years of federal teacher policy: An appraisal
U.S. Department of Education, 2009, Race to the Top program: Executive summary
Weisberg D., 2009, The widget effect: Our national failure to acknowledge and act on differences in teacher effectiveness
Weiss I. R., 2003, Looking inside the classroom: A study of K–12 mathematics and science education in the United States.
Yoon K. S., 2007, Reviewing the evidence on how teacher professional development affects student achievement