On the Tyranny of the Measurable
Print
By Prof. Ronald Joseph Granieri, August 26, 2011 in Uncategorized

 

The media are full these days of stories discussing the relative value of education. Some detail the political fights in various states, such as Texas and California, over funding and control of state universities, while others discuss the failure of universities in general to educate “academically adrift” students, or the pernicious effects of the tenure system on higher education. Central to many of these discussions are attempts to evaluate education, or individual educators, on the basis of measurable quantities—student scores on standardized tests or average salaries upon graduation on the one hand, number of refereed publications or hours taught on the other.

Frankly, I find these discussions both depressing and unenlightening. Attempts to quantify the value of an education strike me as irrelevant at best and pernicious at worst. Part of my objection is practical. Any quantitative measure of education is susceptible to interpretation and manipulation (literally, if one follows the growing scandal in the Atlanta public schools over cheating on standardized tests). Even if honestly gathered, such data may still not tell us what we think we want to know. Do the GPAs or the starting salaries of graduates really tell us whether those graduates received good educations, or do they just tell us about the relative success of those graduates to manage the practical aspects of life? Should we be surprised that Engineering majors make more on average than English majors? Do the number of refereed publications or the numbers of credit hours taught tell us whether a professor is an effective educator? Surely there are researchers who prolifically produce the irrelevant, just as there are teachers who produce a full load of dull and uninspiring classes every semester. Such scraps of data tell us some things, certainly, but they can only provide insight into narrow aspects of a larger whole; we need to know more if we want to know enough.

The practical objection feeds into the larger philosophical problem. Education is not easily reducible to a single result, either for the teacher or the student. To assume that it can be is, frankly, an insult to the very idea of intellectual pursuit. The actual process of education is just that, a process that extends through an individual’s lifetime. One cannot say completely at any one moment exactly how an education has or has not succeeded in shaping an individual’s life. There is an element of mystery in how it works that can elude even the most assiduous statistician. That is not something to be decried, but something to be treasured by anyone who values knowledge and teaching.

That may not sound like much of an observation to anyone who has spent any time in a classroom, or talking to different people about their memories of and attitudes toward their formal education. But it bears repeating, because in our time educational discussions have been overwhelmed by the tyranny of the measurable. Prospective students try to measure the practical advantages of one course of study over another, politicians seek the data to argue for their policy preferences, and thoughtful critics attempt to advance their arguments about the future of education at all levels by poring over the data. Tenure and promotion decisions are made based on the accumulation of material, and armies of newly minted university administrators spend their well-compensated time obsessing over the various “metrics” that go into the Master Metric—a school’s US News ranking.

Conservatives should be especially careful when it comes to this tyranny, because if we are serious about the ineffable, spiritual aspects of education, we should not be so quick to reach for quantitative measures. Sadly, when self-defined conservatives enter these discussions, they tend to side with the quantifiers—be they Texas officials who want to draw up productivity charts to identify lazy faculty or authors such as Naomi Schaefer Riley, who denounce tenure as an unnecessary luxury and cast aspersions on academic research, claiming that professors should do more “useful” things instead. Many conservatives embrace the argument that educational institutions should be “run like businesses” and that education should be practical and useful.

Here again I have both practical and philosophical objections. Practically, one cannot avoid that different measures of productivity often clash with each other. For example, if the famous Texas spread sheet measures faculty productivity according to how many grants an individual faculty member brings in, or the number of refereed journal articles, how does one square that with Schaefer Riley’s trenchant but occasionally scattershot criticism that faculty spend too much time on specialized research that no one reads? If the only thing that matters is how many scheduled hours a professor teaches, where do we fit in the time a faculty member should spend gaining and creating new knowledge to share with students, not to mention the hours spent advising, discussing, and encouraging outside of the classroom?

The problem, as I see it, is that too many conservatives are wrapped up in the notion that “the enemy of my enemy is my friend.” Since conservatives in general tend to view intellectuals (and especially college professors) as liberals who want to undermine American society (an unfortunate attitude that further alienates and isolates conservative-leaning intellectuals and professors), any arguments that attack college professors in general and that shake up the current university system are welcome, even if the positions are incoherent. Thus conservatives can be seen demanding that professors research less and teach more, and can also be seen decrying the terrible things professors do and say in the classroom as disconnected from real intellectual work.

On an even more fundamental level, conservative insistence on practicality and business models in education undermines what should be an essential conservative value—the pursuit of knowledge as an end in itself, and the importance of cultivating an appreciation for the intellectual treasures of our culture.  Groups such as ISI rightfully emphasize the need for teaching the fundamental texts and ideas of the Humanities, but these are the subjects whose value is least susceptible to measurement on a balance sheet or a list of trade skills, and which are always first in line for the chopping block in the eyes of those who seek to make higher education more businesslike and practical. Conservatives should be more careful that their attacks on what may appear to be the enemy do not end up destroying the foundations of intellectual inquiry and all they mean for our future.

There are plenty of problems in higher education. Chief among them, in my mind, is the growing chasm between the responsibility of educators to introduce students to new material and the relentless pressure to specialize. The best way to deal with that problem, and the many others, however, is not to insist on particular metrics. Conservatives, liberals, and moderates all have their particular blind spots, and they cannot be overcome by a single magic bullet. Rather, we need to expand the possible elements of evaluation, by encouraging serious discussions between and among faculty, students, and the general public about what they expect a college education to provide, what they are willing to sacrifice to get it, and how they expect to preserve the atmosphere of intellectual freedom and creativity necessary for education to happen in the first place. It will require the inclusion of a wide range of variables and principles. It will require discussion and exchange, not simply the collection of surveys. It will also require that all sides be mature enough to manage respectful disagreements without resorting to anti-intellectual posturing. Discussion is hard, and time consuming, not nearly as simple as finding one formula to solve all our problems. Nevertheless, if we are serious about the future of education, we need to overcome the tyranny of the measurable.

Tags: No subjects

3 Comments
Lee Trepanier on Aug 26, 2011 at 6:23 am

This is a great post about the problems that confront faculty in higher education: how to justify in a non-quantifiable way the value of what they are doing. This problem is particularly manifested in American society where we are trained to use empirical evidence to form our judgements.

David Kidd on Aug 27, 2011 at 10:25 am

The problem of how to evaluate the worth of an education is perennial, but it has taken on a new urgency as costs have spiked. Even if one grants that a liberal arts education aims directly at no practical skill and consequently has no measurable value, the fact remains that universities charge enormous sums of money for their offerings. Isn't it reasonable for students and their families to regard an university education as an investment that should yield a measurable return? If not, who but the wealthy can afford a degree in America?

Prof. Ronald Joseph Granieri on Aug 27, 2011 at 2:42 pm

David, that is a legitimate question, but it begs a bigger one: what exactly is a "measurable return" on an education? I am not asking the question to be a smartypants, but because I honestly don't know. If I were to say that the purpose of an education is to create educated people, with a curiosity about the world and an appreciation for its complexity, that sounds too much like a tautology, or a dodge. But I am more comfortable with that than with the assumption that an education's value is only measurable in relation to the average salaries of graduates. I am not sure that the liberal arts and humanities can be evaluated on such a material basis, and actually fear that trying to do so does a disservice to the idea of education.

It is indeed true that a college education costs an awful lot. It is also true that a lot of the young people getting those educations are not sufficiently aware of the sacrifices involved, that many parents who are footing the bills are at best ambivalent about most of the things their children learn, and that many of the professors and administrators do not spend enough time thinking about how their work should relate to the aspirations of the larger community. Many students and parents may consider a liberal arts education to be a luxury they cannot afford. I think that is a tragedy for our common culture, and universities need to do more to work to avert that tragedy. We all need to be aware of our shortcomings, and be willing to discuss them and respect each other's positions. That means looking for ways to value the immaterial, even spiritual benefits of education, and the very real responsibilities of those who aspire to provide it.

about the author

Ronald Granieri
Ronald Granieri

Ronald J. Granieri is Adjunct Assistant Professor of History at Temple University. A native of Niagara Falls, NY, his specialties are European International Politics and Diplomacy, the Cold War, European Integration, and European-American relations, with special attention to the period after 1945. After receiving his A.B. in History (1989) from Harvard, he received an M.A. (1991) and Ph.D. (1996) in History from the University of Chicago, and has also studied at the Universities of Heidelberg and Cologne in Germany. He is the author of The Ambivalent Alliance: Konrad Adenauer, the CDU/CSU, and the West, 1949-1966 (Berghahn Books, 2003) and is currently completing a manuscript entitled German Christian Democracy from Detente to Reunification for Oxford University Press.

 

Prof. Granieri is the 2006 and 2010 winner of the University of Pennsylvania's Department of History's Richard S. Dunn Award for Undergraduate Teaching and Penn's Edmund J. and Louise W. Kahn Award For Distinguished Teaching By An Assistant Professor, as well as the 2008 winner of Penn's College of General Studies Distinguished Teaching Award for Standing Faculty. Fellowships have included a Research Fellowship and a Federal Chancellor Scholarship from the Alexander von Humboldt Foundation, as well as membership in the American Council on Germany's Young Leader Program. In addition to teaching at Penn for several years, he also taught at Furman University, and has served as a Visiting Professor at the University of Tübingen.