People, Politics & Business

Scoundrels, Educrats, Rogues and Champions

"Rewarding Teacher Performance? Resist The Temptation To Race To Nowhere"

CJ Westerberg, April 28, 2010 12:30 PM

Apples.two.measure.jpg



The following are excerpts from a recent post from blog Baseline Scenario - What Happened To The Global Economy and What We Can Do About It:


"Rewarding Teacher Performance?
Resist The Temptation To 'Race To Nowhere'"


"This guest post is contributed by Kathryn McDermott and Lisa Keller. McDermott is Associate Professor of Education and Public Policy and Keller is Assistant Professor in the Research and Evaluation Methods Program, both at the University of Massachusetts, Amherst.

On March 29, the U.S. Department of Education announced that Delaware and Tennessee were the first two states to win funding in the "Race to the Top" grant competition.  A key part of the reason why these two states won was their experience with "growth modeling" of student progress measured by standardized test scores, and their plans for incorporating the growth data into evaluation of teachers.  The Department of Education has $3.4 billion remaining in the Race to the Top fund, and other states are now scrutinizing reviewer feedback on their applications and trying to learn from Delaware's and Tennessee's successful applications as they strive to win funds in the next round.

One of the Department's priorities is to link teachers' pay to their students' performance; indeed, states with laws that forbid using student test scores in this way lost points in the Race to the Top competition.  A few months ago, James pointed out some of the general flaws in the pay-for-performance logic; here, our goal is to raise general awareness of some statistical issues that are specific to using test scores to evaluate teachers' performance.

Using students' test scores to evaluate their teachers' performance is a core component of both Delaware's and Tennessee's Race to the Top applications.  The logic seems unassailable: everybody knows that some teachers are more effective than others, and there should be some way of rewarding this effectiveness.  Because students take many more state-mandated tests now than they used to, it seems logical that there should be some way of using those test scores to make the kind of effectiveness judgments that currently get made informally, on less scientific grounds.

The problem is that even if you accept the assumption that standardized tests convey useful information about what students have learned (which we both do, in general), measuring the performance gains (or losses) of students in a particular classroom is far more complicated than subtracting the students' September test scores from their June test scores and averaging out the gains.

The first problem has to do with class sizes..."

" . . .The second general problem has to do with how students end up with particular classmates and particular teachers. . ."

" . . .In both Delaware and Tennessee, students' test-score growth will be combined with other kinds of information to make judgments about teacher performance.  Considering data from multiple sources will help overcome some of the issues we've raised here.  However, looking at "what the numbers say" appeals to policy makers who crave simple indicators of complex phenomena.  Legislators and governors don't have to pass a statistics exam before taking office, and they haven't had an especially good record of listening to educational testing experts before they mandate new uses for test results.  For example, the relevant professional associations have jointly endorsed a set of principles on appropriate uses of tests which, among other things, caution against using a particular test for purposes other than those for which its validity has been studied and confirmed.

Despite this caution, policy makers tend to pile extra uses onto tests once they've required that students take them . . . . . . . . . The tendency has also been for quantitative performance indicators, even if of somewhat dubious quality, to dominate over other forms of evaluation.  We worry that something similar will happen with the use of student performance in determining teachers' pay, promotion, or retention.  "The numbers" look objective to people outside schools, while other measures like analysis of lesson plans or documentation of classroom observations seem by comparison to be imprecise means by which the "education establishment" can continue to protect the incompetent.

Educators have welcomed the Obama administration's willingness to eliminate some of the less logical components of No Child Left Behind, such as the "adequate yearly progress" benchmarks based on unfounded assumptions about how schools improve and on definitions of "proficiency" driven more by political expediency than by an objective definition of what students need to learn in order to succeed in further education and careers.  However, even though we're now "racing to the top" rather than trying to ensure "no child left behind," we still risk basing reasonable-sounding policies on unreasonable assumptions and racing (with apologies to Talking Heads) on a road to nowhere. . ." "

For full post, click here.

 

Post a Comment

For most of my career, I was an awful listener in almost every possible way. I was arrogant throughout my 30s for sure--maybe into my early 40s. My conversations were all about some concept of intellectual winning and "I'm going to prove I'm smarter than you."
Kevin Sharer, Amgen CEO, Why I'm a Listener
Follow The Daily Riff on Follow TDR on Twitter

find us on facebook

bubble test.jpg

Opting Out from Standardized Testing

CJ Westerberg, 04.18.2012

Educator Will Richardson makes a decision to opt his son out of the state test & shares his story

Read Post | Comments

Riffing good stories

algebra.obsolete.jpg

21 Things That Will Become Obsolete in Education by 2020

CJ Westerberg, 04.17.2012

Desks, Language Labs, Computers, Homework, Standardized Tests in College Admissions . . . .

Read Post | Comments
manifest.jpg

The Flipped Class Manifest

CJ Westerberg, 04.16.2012

"The Flipped Classroom is an intentional shift of content which in turn helps move students back to the center of learning rather than the products of schooling."

Read Post | Comments
light-bulb.innovators.tony-wagner.jpg

Parents & Schools : Are we creating innovators? 22 Insights

CJ Westerberg, 04.16.2012

C.J. Westerberg reviews new book by Tony Wagner - "Creating Innovators" Plus Video.

Read Post | Comments
listen.talk.jpg

Why I'm a listener

CJ Westerberg, 04.16.2012

For most of my career, I was an awful listener in almost every possible way. I was arrogant throughout my 30s for sure--maybe into my early 40s. My conversations were all about some concept of intellectual winning and "I'm going to prove I'm smarter than you." -Why I'm a listener, Amgen's CEO, Kevin Sharer

Read Post | Comments
homework.jpg

The Flipped Class = flipped homework

CJ Westerberg, 04.15.2012

flipping a class is also flipping homework. I know, "no kidding, Sherlock" you may be thinking, but the flipped class will have impact on disrupting the concept of homework.

Read Post | Comments
green transformation.jpg

How the Flipped Classroom Is Radically Transforming Learning

CJ Westerberg, 04.15.2012

. . .AND how it changes the way teachers talk with parents - - -

Read Post | Comments
global.tech.jpg

What Students (Really) Need to Know

CJ Westerberg, 04.15.2012

"A good rule of thumb for many things in life holds that things take longer to happen than you think they will, and then happen faster than you thought they could." - Lawrence Summers

Read Post | Comments
flipped.class.abstract.part1.jpg

The Flipped Class: Myths vs. Reality

CJ Westerberg, 04.14.2012

We also realize there is a lot of mis-information about the Flipped Classroom and quite a bit of controversy about whether or not this is a viable instructional methodology.

Read Post | Comments

More Featured Posts