Thursday, March 29, 2007

Pro-technology

This article slapped me in the face and made me remember why I hate the FCAT writes – Florida’s statewide writing assessment. The article discusses the work of Les Perelman. What he has basically done is found patterns in the higher-scoring SAT essays that have been released as samples, and turned those patterns into an easy-to-follow “recipe” for student success on the exam. Based on the score of the essay from which the paragraph in the article was taken, he must be on to something.

This is a far more discouraging problem than I’ve noted on previous posts decrying many of the unintentional, negative outcomes that occur as a result of educational technology. Here we have the ostensible caretaker of higher education in America, the College Board, giving into the same flaw that other high-stakes, partially hand-scored large-scale assessments help spread: proscriptive writing.

Here’s what happens. Schools are under pressure to perform at certain levels: Certain mean scores must be met in order for schools to receive increased funding and prevent school districts from intervening and removing administrators. So, the effects of gravity being what they are, the pressure (and other less mentionable things) rolls downhill and falls on teachers’ desks. “Increase scores. Increase scores. Increase scores.” Beyond the desire to please those above them, teachers – good teachers – feel an intense desire to help their students achieve at their highest level. Sounds good for the students, right?

Not so much. Teachers look at “quality” samples of “higher-scoring” writing samples, whether they be short- or extended-response or essays. Teachers find the same types of patterns Perelman did and teach those patterns in order to raise students’ scores. Now, for those students who are just poor writers, this might be fine. It’s wrong to assume that every student has the ability to write at a high level, so teaching the skills necessary for these students to perform to the best of their ability is not wrong. What is wrong and what invariably happens is those students who have the ability to write at a high level have this proscriptive writing rammed down their throats, they begrudgingly learn it, but they become so disconcerted with the process that they end up hating writing.

Does this always happen? No. But if it happens once that’s once too often. And I’ve seen it happen to students who are currently in my AP English Language and Composition class. My three best writers received scores on their FCAT essay that fell just above the school average. Copious other students, many of whom could never hope to make it in an AP English class, earned scores that far exceeded those of my best and brightest writers.

FCAT essays are scored from 1 – 6, with six being the highest. I have a student who assists me in the morning to earn service hours. On several occasions this past year, I tutored her because she failed the reading portion of the FCAT.

She earned a 5 on the essay portion.

Something is amiss, and this article proves what it is.

So is educational technology off the hook in my eyes? No. Though, to be honest, I’ve never blamed technology, just the people who misuse it. Proscriptive writing is the virus; educational technology just happens to be one way it is spread.

By the way, I typed all this up once, yesterday, and then AOL closed and I lost it all.

And still I love technology.

4 comments:

Crystal Crozier said...
This comment has been removed by the author.
Crystal Crozier said...

Richard, these patterns that Perelman had discovered are amazingly atrocious. It is sad that such writing tests are negating the minds of young authors, making them feel they are poor writers.

I found several ideas quite disturbing, especially "to include at least one quote from history, regardless of whether it is relevant or accurate." This is utterly unimaginable. Basically, we are telling kids, "just write a bunch of "bs" that sounds good. It doesn't matter if it makes any sense. As long as you have some nice, big words and it sounds intelligent, you will do fine. Oh, and don't worry if those big words are written in context of if any of your factual information is correct. Conformity is the key. Don't think outside the box. For that matter, don't even have an opinion."

I agree with Perelman's "Basic assumption: The essay is a completely artificial and unnatural piece of writing.”

Laine said...

You win the patience award, Richard. I thought I had lost my last post but I was lucky enough to retrieve it successfully, after five or six attempts.

I'm so glad you addressed this issue. It's a frequent visitor to our lunchroom discussions.

First, I must shamefully admit that last year, in my second-year "I'll try anything" phase, I taught formulaic writing to fourth graders. A veteran teacher in the district introduced some of us to the idea during a workshop and raved about the success of her low performing students. She didn't mention the affect on higher writers and we didn't ask. Tsk. Tsk.

I was very pleased with the immediacy of improvement for low performing students but I found that after a short time most students hit a plateau and I was bored out of my mind with their essays.

On the FCAT, two of my very best writers scored a 2 while others earned a 4 or higher. One of the students that earned a two went on to win a county-wide essay competition for fourth and fifth graders. Something definitely amiss.

Sure all students knew some transitions, proper paragraphing, indenting, and some "wow" words, but did they learn why these things were important or how to apply them in other writing assignments? No.

By the end of the year I saw the monster I had created and made every attempt to unleash students from the chain that was holding them to this formulaic junk. It was too late.

This year we work with the 6 traits of writing and I allow much more freedom. In fact, I encourage it.

Writing is a craft, a journey, a piece of art, and this test has the potential to suck the life right out of writing.

As for the technology element, let's just hope that those using technology to spread the word will be exposed to another more convincing argument and stop the spread of this "virus."

Ann V. said...

Richard-

I just read an article in NEA Today last night that relates to the woes of standardized testing. There is a very in depth article called "Testing-How the Sausage is Made" that covers the process of creating high stakes tests. A very interesting read. More in line with your post is a subsection of that article titled "The Chimp, The Chump, and You-Can a dumb machine help students write smart essays" (http://www.nea.org/neatoday/0704/coverstory1.html).

A University of California-Davis writing instructor wrote an essay which earned a 6 out of 6 from the Educational Testing Service. It was scored with software called Criterion. He used a letter of recommendation he had written, substituted the student's name with a writing prompt offered by the software, and replaced every "the" with the word "chimpanzee". The software came back with descriptions of the essay as "cogent" and "well-articulated."

Amazing! By using predictable writing structures any student well-versed enough in the patterns can get a good score-even if the rest is gibberish!

I was also reading in Woman's World magazine...not a source of great scholarly material, but one of those put on grocery end caps to lure women with carts full of junk food into buying them for the "amazing" diet splashed on the cover, something that made me think of you Richard. A small blurb titled "Let 'em text all they want!" indicates that "New research from England reveals that kids who send the most text message slang tend to be the best at writing, reading and even spelling. Experts suggest the abbreviations increase phonetic awareness."

Ann