Pages

Thursday, October 27, 2011

The Failure of "Reform" - Standardized Tests

Here's my next post at Blue Jersey about the coming education reform battle.

This was brought on by an exchange with the Star-Ledger's Tom Moran, who has yet to respond to me. I am anxiously waiting to hear his take.


The entire corporate "reform" argument hangs on the use of standardized tests. Reformers insist that these tests are absolutely critical in ensuring "accountability" throughout the teaching profession, and that pay, tenure protections, and even job security should be tied to the tests.

Now, I could tell you that researchers have known for years that bubble tests assess only a fraction of a student's learning.

I could tell you that the error rates on these tests are so high that using them to evaluate teachers is functionally the same as rolling dice (even the reformers acknowledge this; they just don't much seem to care if a teacher's career is destroyed by accident).

I could tell you that the overwhelming consensus among researchers is that these tests should not be used for high-stakes decisions such as firing teachers and determining pay.

I could tell you that the tests themselves are secretive, graded by low-paid temporary workers, and have never been fully vetted.

I could tell you the testing industry is a multi-billion dollar business, and that lobbyists are crisscrossing the country, pushing their expanded use in statehouses everywhere.

But the best argument against using standardized tests to judge educators is very simple:

Standardized tests were never designed to evaluate teachers.

Yes, there are plenty of uses for these tests: program evaluation, curriculum design, research... and yes, they can even help a teacher or principal reflect on his practice. But they are very poor instruments when used in personnel decisions; there is really no debate about this.

And there is no good reason to try to sneak them into evaluation systems by basing only part of a teacher's evaluation on test scores. As Rutgers education researcher Dr. Bruce Baker explains:
The reality of an evaluation that includes a single large, or even significant weight, placed on a single quantified factor is that that specific factor necessarily becomes the tipping point, or trigger mechanism. It may be 45% of the evaluation weight, but it becomes 100% of the decision, because it’s a fixed, clearly defined (though poorly estimated) metric.
Hammers are great for driving nails, but you don't use them to drill holes, flip pancakes, or evaluate teachers. The corporate reformers need to stop insisting that we use the wrong tool for the wrong job.

2 comments:

  1. I hope you and Dr. Baker can make this event:

    Michelle Rhee’s Students First is teaming up with hedge fund billionaire David Tepper’s Better Education for Kids to recruit NJ teachers to support their teacher evaluation agenda. Both well-funded corporate reform groups support the elimination of tenure and seniority rights and the imposition of test-based teacher evaluation ratings. In Washington, D.C, where Rhee was chancellor, her IMPACT evaluation system led to illegal firings, cheating scandals, and sustained turmoil.

    Students First and B4K are offering teachers $100 gift cards to attend “roundtables” to “discuss critical issues regarding teacher evaluation, document their recommendations, and present their collective work to the New Jersey Department of Education.”

    A sign-up form is attached and the list of sessions is here. Teachers interested in defending their rights and profession and responding to the corporate reform agenda are encouraged to attend. (A $100 to tell them what we really think of their proposals—NOT BAD)

    November 12th, 8:30 am - 12:45 pm, Princeton
    November 12th, 8:30am - 12:45 pm, Camden
    November 19th, 8:30 am - 12:45 pm, Tom's River

    We need our voices heard.

    ReplyDelete
  2. I am loathe to post the link to the sign up, but it's on Rhee's company's site.

    ReplyDelete

Sorry, spammers have forced me to turn on comment moderation. I'll publish your comment as soon as I can. Thanks for leaving your thoughts.