The Instructional Challenge in Improving Teaching Quality: Lessons from a Classroom Observation Protocol

Teachers College Record - Tập 116 Số 6 - Trang 1-32 - 2014
Drew H. Gitomer1, Courtney Bell2, Yi Qi2, Daniel F. McCaffrey2, Bridget K. Hamre3, Robert C. Pianta2,1,3
1Rutgers University
2Educational Testing Service
3University of Virginia

Tóm tắt

Background/Context Teacher evaluation is a major policy initiative intended to improve the quality of classroom instruction. This study documents a fundamental challenge to using teacher evaluation to improve teaching and learning. Purpose Using an observation instrument (CLASS-S), we evaluate evidence on different aspects of instructional practice in algebra classrooms to consider how much scores vary, how well observers are able to judge practice, and how well teachers are able to evaluate their own practice. Participants The study includes 82 Algebra I teachers in middle and high schools. Five observers completed almost all observations. Research Design Each classroom was observed 4–5 times over the school year. Each observation was coded and scored live and by video. All videos were coded by two independent observers, as were 36% of the live observations. Observers assigned scores to each of 10 dimensions. Observer scores were also compared with master coders for a subset of videos. Participating teachers also completed a self-report instrument (CLASS-T) to assess their own skills on dimensions of CLASS-S. Data Collection and Analysis For each lesson, data were aggregated into three domain scores, Emotional Support, Classroom Organization, and Instructional Support, and then averaged across lessons to create scores for each classroom. Findings/Results Classroom Observation scores fell in the high range of the protocol. Scores for Emotional Support were in the midlevel range, and the lowest scores were for Instructional Support. Scores for each domain were clustered in narrow ranges. Observers were more consistent over time and agreed more when judging Classroom Organization than the other two domains. Teacher ratings of their own strengths and weaknesses were positively related to observation scores for Classroom Organization and unrelated to observation scores for Instructional Support. Conclusions/Recommendations This study identifies a critical challenge for teacher evaluation policy if it is to improve teaching and learning. Aspects of teaching and learning in the observation protocol that appear most in need of improvement are those that are the hardest for observers to agree on, and teachers and external observers view most differently. Reliability is a marker of common understanding about important constructs and observation protocols are intended to provide a common language and structure to inform teaching practice. This study suggests the need to focus our efforts on the instructional and interactional aspects of classrooms through shared conversations and clear images of what teaching quality looks like.

Từ khóa


Tài liệu tham khảo

Allen J. P., 2013, Journal of School Psychology, 42, 76

10.1126/science.1207998

10.1080 /10627197.2012.715014

Bill and Melinda Gates Foundation, 2012, Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains

10.1111/j.1467-8624.2007.00995.x

Burniske J., 2012, The use of student perceptual data as a measure of teaching effectiveness (Texas Comprehensive Center Briefing Paper)

10.1177/0013164413486987

10.3102/01623737012003311

10.1001/archpsyc.60.8.837

10.1177/003172171109200616

Doyle W., 1986, Handbook of research on teaching, 4

Glazerman S., 2011, Passing muster: Evaluating teacher evaluation systems

Glazerman S., 2010, Evaluating teachers: The important role of value-added

Goe L., 2008, Approaches to evaluating teacher effectiveness: A research synthesis

Gonzales P., 2008, Highlights from TIMSS 2007: Mathematics and science achievement of U.S. fourth- and eighth-grade students in an international context

Goodlad J., 1984, A place called school: Prospects for the future

10.3102/0002831207312906

Hamre B. K., 2008, My areas of strength and growth

10.1111/j.1467-8624.2005.00889.x

10.1086/669616

10.1111/j.1468-0327.2011.00265.x

Horizon Research, Inc., 2000, Inside the classroom observation and analytic protocol

Horng E. L., 2009, Principal time-use and school effectiveness

10.1086/499760

National Commission on Excellence in Education, 1983, A nation at risk: The imperative for educational reform

National Governors Association Center for Best Practices, & Council of Chief State School Officers, 2010, Common core state standards for mathematics

10.3102/0034654311413609

Pianta R. C., 2009, Classroom Assessment Scoring System (CLASS), secondary manual

10.1207/s1532480xads0903_2

Rhode Island Department of Education, 2011, The Rhode Island model: Guide to evaluating building administrators and teachers

10.1086/429948

Ripley A. (2012, October). Why kids should grade teachers. The Atlantic. Retrieved from http://www.theatlantic.com/magazine/archive/2012/10/why-kids-should-grade-teachers/309088/

10.1086/428812

Sartain L., 2011, Rethinking teacher evaluation in Chicago: Lessons learned from classroom observations, principal-teacher conferences, and district implementation

10.1016/j.tate.2003.08.001

Sykes G., 2009, Fifty years of federal teacher policy: An appraisal

10.3386/w16877

U.S. Department of Education, 2009, Race to the Top program: Executive summary

10.3102/00346543073001089

Weisberg D., 2009, The widget effect: Our national failure to acknowledge and act on differences in teacher effectiveness

Weiss I. R., 2003, Looking inside the classroom: A study of K–12 mathematics and science education in the United States.

Yoon K. S., 2007, Reviewing the evidence on how teacher professional development affects student achievement

Thông tin
Thông tin xuất bản

Teachers College Record

Tập 116 Số 6

1-32

Thông tin tác giả