Daily Archives: January 11, 2012

MLA 2012: When Assessment Goes Bad

[x-posted at http://assessmentforlearning101.wordpress.com/]

On the first day of MLA 2012 I attended “Assessing Assessment(s),” chaired by Jeanne A Follansbee (Harvard), with talks by Donna Heiland (Teagle Foundation), John M. Ulrich (Mansfield University), and Eve Marie Wiederhold (George Mason). Reed Way Dasenbrock was unable to attend, which is a shame because I heard an excellent talk that he gave last year and was looking forward to his perspective on this issue. (I have also taught his essay from Falling into Theory in my “Critical Methods in Literary Study” class.)

All the papers were sharp and interesting, with Heiland considering the role of assessment in cultivating student learning, Ulrich reporting on the highs and lows of his institutional practice, and Wiederhold offering a vigorous critique.

But what really enlightened me at the panel was the Q&A, during which it became clear that there was a lot of really terrible assessment going on out there. One speaker described how an “assessment professional” had been hired at her institution to set the learning outcome goals for all the programs. Another reported that he regularly turned in a series of graphs charting student grades, much to the delight of local assessment administrators.

I had mostly assumed that everyone hated assessment because it is part of the paradigm shift described by Tagg and Barr from “Instruction” to “Learning” (a point discussed by Heiland) which pretty radically goes against the status quo and thus makes people anxious. (Maybe this goes back to Dave’s discussions of “threshold concepts.”) Further, I too hated it at first, as it seemed redundant and intrusive. Now, though, I see it as part of a potential change from counting credit hours (or as my former provost used to say, “butts in seats”) or relying on student evaluations (or, as Roksa calls them, “student satisfaction surveys”) to opening up new ways of emphasizing, appreciating, and thinking about learning itself as the goal, which in turn leads to thinking that there might be better ways to get there than counting up things up, be they credit hours or survey scores. So while assessment has the reputation of bean counting, in fact we are currently wading through heaps of beans (credit hours; evaluation scores; grades; office hours; chairs bolted to the floor; multiple choice tests) without even noticing them as they have become so natural to our environment. In a true “culture of assessment,” there would be fewer beans.

It seems, though, at some institutions assessment has not been part of a larger consideration of student learning, but instead the evil bureaucratic exercise that many feared it would become.

Advertisements