Wit & Wisdom

Game Changers & Tales of Triumph and Woe

Campbell's law in education: test scores vs. accountability

CJ Westerberg, January 5, 2013 8:28 AM

andy-warhol-campbells-soup1.jpg


"A society in which decisions are based solely on numbers
instead of sound judgment
is one in which no one is truly accountable."

- Joe Ganem

Test Scores vs. Accountability

by Joseph Ganem Ph.D.

The problem of cheating on standardized tests that was recently uncovered in the Baltimore City Public Schools is apparently another in a long list of testing scandals that have plagued school districts across the country. Some might argue that these episodes provide further proof of sociologist Donald T. Campbell's observation made more than three decades ago. "Campbell's law," as it is known, states that the more a quantitative measure is used for
social decision-making, the more it will be subject to corruption pressures that distort the social process it is intended to monitor.

While I agree with that assessment, I would go further and argue that testing scandals are symptomatic of a more insidious societal problem: a refusal by its leaders to accept responsibility for the consequences of their decisions. Defining accountability in terms of a quantitative measure - a number - is actually an elaborate hoax perpetrated by the leadership to avoid being accountable.

"Defining accountability in terms of a quantitative measure
- a number -
 is actually an elaborate hoax
perpetrated by the leadership
to avoid being accountable.
"


For example, basing education policy decisions on standardized test scores (numbers) means that the educators in charge are relieved from using professional judgment. Consider all the effort school leaders no longer need to exert and decisions they no longer have to defend.

If the students are judged based on test scores, there is no need to consider their natural abilities and inclinations. Whether B's on a math test result from overachieving C students
who become inspired by a great teacher, or underachieving A students who are bored
with the class, becomes irrelevant.

If the teachers are judged based on their students' test scores, there is no need to go into
the classroom and observe their methods and interactions with students. Whether students
are succeeding in spite of bad teaching or failing despite good teaching becomes irrelevant.

If the schools are judged based on test scores, there is no need to work at improving the schools. All that is necessary is to declare schools with low scores failures, fire the teachers and principals, and give the work of educating the students to others - even if there is no reason to believe that schools with different personnel would do any better.

Test scores are not the only numbers that school officials use in place of judgment. Consider the number zero, as in the "zero tolerance" policies in place for rule infractions. Carry a penknife or lighter to fix your lacrosse stick, as two Easton high school students did recently, and receive a punitive suspension that defies all common sense.

In all of the above examples, the reliance on numbers means that the decisions made are automatic and require no professional judgment. As a result, none of the leaders are accountable for the outcomes.

The field of education is not unique in its use of numbers to avoid accountability. Our
economy is still struggling to recover from an elaborate accountability hoax perpetrated
by the financial system. Home prices were appraised based on inflated comparables, not
on what the market could reasonably support over the long run. Credit scores were assigned based on past payment histories, not on the ability to make future payments. Securities were rated based on mathematical models with faulty assumptions, not on realistic assessments of risk. When the system came crashing down, no one was accountable because everyone's actions were in response to numbers, even though those numbers were meaningless.

Is the kind of wreckage brought on our economy what we desire for our education system?
The obsession with test scores to the exclusion of other educational goals suggests that we
are heading in that direction. The truth is that judging the quality of teachers and schools requires looking at more than just student test scores, that education has more dimensions than just reading and math, and that the single-minded goal of continually improving test
scores is not realistic.

Professionals, whether they are in education, business, law, medicine, science or engineering, are hired because their specialized training and extensive experience endows them with superior judgment. Without the ability to exercise that judgment, there is no point to hiring a professional. There will always be errors in judgment. But do we want a society in which to avoid blame, no one uses judgment?

A society in which decisions are based solely on numbers instead of sound judgment is
one in which no one is truly accountable.
###

Originally published in The Baltimore Sun
Published The Daily Riff July 2011

Joseph Ganem, Ph.D., with link to home page and blog here,  is a professor of physics at Loyola University Maryland, and author of the award-winning book on personal finance: The Two Headed Quarter: How to See Through Deceptive Numbers and Save Money on Everything You Buy. It shows how numbers fool consumers when they make financial decisions.


Related posts The Daily Riff:
And the beat goes on . . . from the Atlanta test score cheating to . . .

Why Testing Fails by Joseph Ganem

The important distinction between feedback and measurement by schools
by Margaret Wheatley

A Complex Web: Student-Teacher Relationships



Enhanced by Zemanta
blog comments powered by Disqus
Now, keeping in mind these fourfold interests - interest in conversation, or communication; in inquiry, or finding out things; in making things or construction; and in artistic expression - we may say they are natural resources, the uninvested capital, upon the exercise of which depends the active growth of the child..
John Dewey, The School and Society, 1900
Follow The Daily Riff on Follow TDR on Twitter

find us on facebook

maui.John-Seely-Brown.JSB.serendipity.jpg

Conversations with John Seely Brown: Shaping Serendipity for Learning

CJ Westerberg, 04.11.2013

photo above: Maui"Conventional wisdom holds that different people learn in different ways.  Something is missing from that idea, however, so we offer a corollary:  Different People, when presented with exactly the same information in exactly the same way, will learn...

Read Post | Comments

Riffing good stories

connected.JSB.John-seely-brown.entrepreneurial learner. jpg.jpg

Cultivating the Entrepreneurial Learner

CJ Westerberg, 04.11.2013

John Seely Brown: Connected and Collective Learning (Part 2)

Read Post | Comments
comics.jpg

Weekend Funnies: "Going through a phase" Video

CJ Westerberg, 04.07.2013

Gabriel Iglesias' smart teenage son doesn't talk to him anymore. 2 Minute Video via Comedy Central

Read Post | Comments
high-school.paul-graham.jpg

High Schoolers: "What You'll Wish You'd Known"

CJ Westerberg, 04.06.2013

It's dangerous to design your life around getting into college

Read Post | Comments
jolt.stanford.car2.vertical.jpg

The Practical University?

CJ Westerberg, 04.06.2013

Musings on college: Visiting with high schoolers, David Brooks and Stanford University's new video series on MOOCs: " . . ."It's the beginning of a wholesale reorganization of teaching and learning in higher education."

Read Post | Comments
harry-potter.jpg

Weekend Light - Daniel Radcliffe Sings the Elements

CJ Westerberg, 04.05.2013

Harry Potter sings the periodic table of elements on the Graham Norton show with Colin Farrell, Rihanna...humor video

Read Post | Comments
HarryPotterBook.jpg

"The Fringe Benefits of Failure, and the Importance of Imagination"

CJ Westerberg, 04.02.2013

JK Rowling, Harry Potter Author, Captivates Crowd With Harvard Commencement Speech

Read Post | Comments
graduation.Kirsten-olson.jpg

High School: Are the Kids Alright?

CJ Westerberg, 04.02.2013

"Long ago my son determined exactly how not to let the institution of school get in the way of his learning, and had explicit plans for choosing courses carefully so that he had ample time to attend local university lectures and participate in arts events."

Read Post | Comments
stop.red.facebook.jpg

"The Little Discussed Dark Side" of Public Education

CJ Westerberg, 04.02.2013

"We've completely distorted learning."

Read Post | Comments

More Featured Posts