ERRATA Summary of Value-Added Forum at 89.3 KPCC

by Tom Louie Sunday, Nov. 14, 2010 at 5:52 PM

I made one factual error about the Times database, which does not change the injustice of how they treated Rigo.

Unfortunately, I made an ERROR in paragraphs 9 and 12. It turns out that you can, indeed, compare individual teachers to each other numerically using the information on the Times database. Dr. Hanushek was right and I was wrong on that particular point. He got his information about Rigo being ranked slightly above average at Miramonte from this blog: http://edobserver.blogspot.com/2010/11/rigo-ruelas-rip-stuck-with-slackers.html

The blog’s author, Anthony Strinsky, who also has an education-related website at http://stoputla.com/, is apparently the first writer to retrieve all the numbers for a single school and compare individual teachers numerically, beyond the Times’ five broad categories. Unfortunately, that innovation is Mr. Strinsky’s only positive contribution to the debate. The rest of Mr. Strinsky’s blog is devoted to using tortured logic to support the bizarre theory that Rigo committed suicide out of frustration with his incompetent fellow teachers!

Mr. Strinsky fancifully speculates about Rigo’s motivations and thought processes to say that his scenario is more “likely” than what we who knew Rigo believe: namely, that Rigo was depressed and humiliated by how the Times treated him.

So far, all of the defenders of the Times have relied on “armchair journalism” to defend the publication of the teachers’ scores and attack our union. None of them has ever actually talked to anyone who knew Rigo. This blog is no exception.

I tried to respond to Mr. Strinsky's blog, but his site wouldn't accept my post, even after I trimmed its length to fit the guidelines.

Even if Rigo is in the 55th percentile of Miramonte teachers according to Value-Added, in terms of the Times' broad categories he was still placed in the second category from the bottom. Also, a VAM ranking in the 55th percentile is not predictive of Rigo's outstanding administrative evaluations. Hopefully, one day even Dr. Hanushek can agree that Rigo did not deserve his treatment by the Times.

Here’s my original summary with errors noted:

“Tonight there was a public forum on "Value-Added" evaluation of teachers at the Southern California Public Radio center in Pasadena. The host was KPCC host Larry Mantle, who was the first to interview Rigo's brother Alex last September 29. (Mantle's assistant, Karen, remembers taking Alex's call.) The panelists were Eric Hanushek, from the Hoover Institute at Stanford, and Richard Rothstein from the Economic Policy Institute. (The Economic Policy Institute did a critical report on Value-Added Measurement, which you can access at utla.net .) I managed to ask a question during the forum and mentioned Rigo.

“The forum will be probably be broadcast on Larry Mantle's regular show on 89.3 KPCC at 11 a.m. next Monday, but unfortunately we won't be able to listen to it live because we'll be busy teaching! But the link to the show's soundfile will probably be made available online. (Larry Mantle's show is on weekdays 10-12.)

“Mantle estimated that the live audience was 60-70% teachers, and he later complimented the audience on the written questions they submitted. "None of you should be fired!" he joked. I was there with Perias Pillay, a community college teacher who takes Miramonte students on Transit People field trips. I didn't see any other UTLA people there except Janet Davis from the Elementary Committee.

“At first the debate seemed to be very agreeable and chummy. Rothstein and Hanushek agreed that Value-Added should not be the only means of evaluation (Rothstein said it should only be a "small part"). They agreed that most teachers do an adequate job. They agreed that the standardized tests that are currently used are not an accurate measure of student achievement. And they agreed that the teacher evaluation system is broken -- many principals simply do not have time to evaluate so many teachers, and Mantle mentioned that he has heard many teachers comment that the principals who evaluate them sometimes don't seem to know anything about instruction.

“However, differences began to emerge later, for example when Hanushek expressed support for Michelle Rhee, the Washington, D. C., schools chief who fired hundreds of teachers and administrators, based at least in part on Value-Added. Hanushek also supported the Los Angeles' Times publication of teachers' names associated with their students' scores, about which more will be said later.

“Dr. Hanushek further said that Value-Added evaluation tends to agree with "subjective" evaluation by administrators, as far as correctly identifying both the best and the worst teachers. (NOTE: This model does NOT work for Rigo, who had great administrative evaluations and poor VAM scores!) With the "middle" teachers, Hanushek admitted that Value-Added has problems.

“From that point on, Hanushek's comments increasingly focused on the importance of getting rid of "bad teachers," and blamed the bottom 6-10% of teachers for ruining everything for the rest. To that, Rothstein retorted that if the bottom teachers were replaced, there would simply be a new worst level. "There is a curve to every occupation, including radio talk show hosts and journalists," he joked to Mantle.

“Then it was question time. I managed to get picked first, and I asked: "In order to be fair, Value-Added must include the possibility for teachers to raise their scores. So, what more could Rigo have done?" Then I managed to list some of Rigo's accomplishments and hard work, even though I was under pressure to keep it short. Mantle, the host, was very much aware of Rigo's case, including how he bought a mattress for a student, and he put the question to the panelists: how is it possible that such a wonderful and dedicated teacher, who was doing so much for his students by all accounts and all subjective measures, could have his career judged by low Value-Added scores?

“Hanushek answered first. He said it was "his understanding" that Rigo's Value-Added scores were "above-average," defending his theoretical model. ERROR[[(It would be impossible to get this information from the Los Angeles Times database, which has only five categories and does not compare teachers within those categories to each other!)]] He further questioned whether a teacher who is humanistically supporting students outside of class is also doing the necessary teaching inside the class.

“Rothstein responded by uncompromisingly condemning the Los Angeles Times. He said they never should have published those scores, because they were publishing only part of the truth. The journalists themselves admitted that Value-Added scores did not show the complete picture, and so they were in effect saying, "We're publishing it, but don't pay attention to it." That brought the only sustained applause of the night.

“During the forum, host Larry Mantle also took some pokes at UTLA President A.J. Duffy on the issue of teacher evaluation reform. Afterwards, I pointed out to Mantle that UTLA has been very supportive of Rigo's family, friends and colleagues.

“Also after the forum, I politely asked Dr. Hanushek where he got the information that Rigo's Value-Added score was above-average, ERROR[[since that information was not available in the Times]]. He responded that he had some inside information that showed the distribution of scores among all teachers, and said he would email me his source. So I'll be waiting for that. :)”

-30-