Wit & Wisdom

Game Changers & Tales of Triumph and Woe

Campbell's law in education: test scores vs. accountability

CJ Westerberg, September 30, 2013 8:28 AM

andy-warhol-campbells-soup1.jpg


"A society in which decisions are based solely on numbers
instead of sound judgment
is one in which no one is truly accountable."

- Joe Ganem

Test Scores vs. Accountability

by Joseph Ganem Ph.D.

The problem of cheating on standardized tests that was recently uncovered in the Baltimore City Public Schools is apparently another in a long list of testing scandals that have plagued school districts across the country. Some might argue that these episodes provide further proof of sociologist Donald T. Campbell's observation made more than three decades ago. "Campbell's law," as it is known, states that the more a quantitative measure is used for
social decision-making, the more it will be subject to corruption pressures that distort the social process it is intended to monitor.

While I agree with that assessment, I would go further and argue that testing scandals are symptomatic of a more insidious societal problem: a refusal by its leaders to accept responsibility for the consequences of their decisions. Defining accountability in terms of a quantitative measure - a number - is actually an elaborate hoax perpetrated by the leadership to avoid being accountable.

"Defining accountability in terms of a quantitative measure
- a number -
 is actually an elaborate hoax
perpetrated by the leadership
to avoid being accountable.
"


For example, basing education policy decisions on standardized test scores (numbers) means that the educators in charge are relieved from using professional judgment. Consider all the effort school leaders no longer need to exert and decisions they no longer have to defend.

If the students are judged based on test scores, there is no need to consider their natural abilities and inclinations. Whether B's on a math test result from overachieving C students
who become inspired by a great teacher, or underachieving A students who are bored
with the class, becomes irrelevant.

If the teachers are judged based on their students' test scores, there is no need to go into
the classroom and observe their methods and interactions with students. Whether students
are succeeding in spite of bad teaching or failing despite good teaching becomes irrelevant.

If the schools are judged based on test scores, there is no need to work at improving the schools. All that is necessary is to declare schools with low scores failures, fire the teachers and principals, and give the work of educating the students to others - even if there is no reason to believe that schools with different personnel would do any better.

Test scores are not the only numbers that school officials use in place of judgment. Consider the number zero, as in the "zero tolerance" policies in place for rule infractions. Carry a penknife or lighter to fix your lacrosse stick, as two Easton high school students did recently, and receive a punitive suspension that defies all common sense.

In all of the above examples, the reliance on numbers means that the decisions made are automatic and require no professional judgment. As a result, none of the leaders are accountable for the outcomes.

The field of education is not unique in its use of numbers to avoid accountability. Our
economy is still struggling to recover from an elaborate accountability hoax perpetrated
by the financial system. Home prices were appraised based on inflated comparables, not
on what the market could reasonably support over the long run. Credit scores were assigned based on past payment histories, not on the ability to make future payments. Securities were rated based on mathematical models with faulty assumptions, not on realistic assessments of risk. When the system came crashing down, no one was accountable because everyone's actions were in response to numbers, even though those numbers were meaningless.

Is the kind of wreckage brought on our economy what we desire for our education system?
The obsession with test scores to the exclusion of other educational goals suggests that we
are heading in that direction. The truth is that judging the quality of teachers and schools requires looking at more than just student test scores, that education has more dimensions than just reading and math, and that the single-minded goal of continually improving test
scores is not realistic.

Professionals, whether they are in education, business, law, medicine, science or engineering, are hired because their specialized training and extensive experience endows them with superior judgment. Without the ability to exercise that judgment, there is no point to hiring a professional. There will always be errors in judgment. But do we want a society in which to avoid blame, no one uses judgment?

A society in which decisions are based solely on numbers instead of sound judgment is
one in which no one is truly accountable.
###

Originally published in The Baltimore Sun
Published The Daily Riff July 2011

Joseph Ganem, Ph.D., with link to home page and blog here,  is a professor of physics at Loyola University Maryland, and author of the award-winning book on personal finance: The Two Headed Quarter: How to See Through Deceptive Numbers and Save Money on Everything You Buy. It shows how numbers fool consumers when they make financial decisions.


Related posts The Daily Riff:
And the beat goes on . . . from the Atlanta test score cheating to . . .

Why Testing Fails by Joseph Ganem

The important distinction between feedback and measurement by schools
by Margaret Wheatley

A Complex Web: Student-Teacher Relationships



Enhanced by Zemanta
blog comments powered by Disqus
It had long since come to my attention that people of accomplishment rarely sat back and let things happen to them. They went out and happened to things.
Leonardo da Vinci
Follow The Daily Riff on Follow TDR on Twitter

find us on facebook

bill-gates.FT.Financial-Times.jpg

Cool Smart Teen: Changing the conversation about building stuff

SMW, 11.04.2013

Not just building an app to play with . . . but a test for cancer

Read Post | Comments

Riffing good stories

Stanford.design-thinking. innovation.jpg

Video: What is the link between "design-thinking" and creativity?

SMW, 11.03.2013

Creative Confidence: Must-Watch Interview on Charlie Rose

Read Post | Comments
early education.preschool.jpg

How Much Do Early Years Lead to Student Success?

CJ Westerberg, 11.03.2013

"The idea being that wasn't necessarily to create little engineers everywhere, though that would be great for us. The idea was to take advantage of the natural learning process and curiosity that children have at that age . . ." Tamika Lang, Boeing

Read Post | Comments
weekend-reading.jpg

NEW: Weekend Reading

SMW, 11.03.2013

Looking for Intimacy in the Age of Facebook is a higher education course (yes, you heard right). Interestingly, social media may inhibit creativity and innovation

Read Post | Comments
CV.digital.jpg

The New Resume

SMW, 10.31.2013

A picture is worth a thousand words. A video game-like format is worth . . .

Read Post | Comments
red.blue.abstract.jpg

Noam Chomsky: The Purpose of Education

CJ Westerberg, 10.31.2013

"Education is really aimed at helping students get to the point where they can learn on their own. . . "

Read Post | Comments
twitter2BigBird.jpg

Noam Chomsky: In the news again, this time about Twitter and High Schoolers

SMW, 10.31.2013

Noam Chomsky, Professor Emeritus at MIT, "father of linguistics", political commentator.  From bio: "Besides his work in linguistics, Chomsky is internationally recognized as one of the most critically engaged public intellectuals alive today":               ...

Read Post | Comments
CIMG0353.jpg

Choke: Test-taking - - - a different way to look at test-prep?

CJ Westerberg, 10.28.2013

"Most students will not find a steady diet of test-prep drills and worksheets to be particularly meaningful, and accordingly, they will not put forth optimal learning effort."

Read Post | Comments
beehive.bee.jpg

Does your school have a beehive?

CJ Westerberg, 10.27.2013

"If we want children to be inventors, we have to give them opportunities to invent." - 5:00 mark, Mission Hill video

Read Post | Comments