The Importance of Good Data
A few people have asked me why I haven't blogged about the census controversy. The main reasons are that I think the subject has been very well covered elsewhere and that I'm pretty sure with respect to my own readership that I'd be preaching to the converted ... you are converted, aren't you?
Good data is crucial for effective social policy; without it you're running government based on anecdotes. To give you a sense of how goofy policy-making can be when you don't have good data, I'd like to relate a story from more than a decade ago: how the student debt-scare of the late 1990s came into being.
You may remember that back in 1994-95, Lloyd Axworthy had an ill-fated attempt to reform social security, which included some proposals on student loans and transfers to provinces for post-secondary education. The exercise was eventually canned in the face of the much more massive redesign of social policy that was imposed government-wide by Paul Martin's 1995 austerity budget, but not before Axworthy and the Liberals had suffered all manner of abuse from students and faculty for the fascist crimes of suggesting that the federal government might give out less in transfers to government and more in transfers to individuals and also that student loans might be income-contingent.
(Fast-forward fifteen years, and we find that the Axworthy scheme has been adopted almost in full without protest. By re-packaging the voucher idea as an eight-fold increase in education tax credits and re-labelling income-contingency in student loans as a "Repayment Assistance Plan", the Government of Canada has now introduced virtually everything foreseen by the Axworthy plan, sometimes with the backing of the very student groups who pelted the man with macaroni all those years ago. But I digress).
Anyway, come early 1996, with power heading to the provinces generally and the Liberals convinced that there was no way that the post-secondary file would ever be a political winner, the government of Canada was about ready to dump the Canada Student Loans Plan (CSLP). They even went so far as to send an ADM round to each of the provinces to inquire how they might divest themselves of CSLP completely and make student aid an exclusively provincial affair. Needless to say, this alarmed the PSE-lobbying crowd in Ottawa. But the brighter among them recognized some of their own culpability; public internecine fighting over a range of files (tuition in particular), had made it impossible for government to create a policy that could be seen as a "winner" by all stakeholders.
It was Robert Giroux, then the President of the Association of Universities and Colleges of Canada, who made the astute call that in order to keep the Government of Canada in the game, the PSE community had to give the government a "win" on this file. That meant finding some policies that everyone could agree on, which seemed unimaginable at the time.
The answer to this problem was miraculously provided by a pair of publications which came out in 1995 and 1996. The first, a publication from Washington's Institute for Higher Education Policy, called College Debt and the American Family, was part of an overall re-positioning of the student aid debate in the U.S. from banging on about the decreasing purchasing power of Pell grants to focus on debt levels (i.e. from inputs to outcomes). Helpfully, it contained information detailing college debt by institution type, and showed that at four-year private institutions, the average was about $20,000 (Canadian) at the time.
The second publication was the Government of Canada's consultation paper for the Ministerial Task Force on Youth, a body which spent much of 1996 touring the country talking about what, at the time, was perceived as a persistent youth unemployment problem. An innocuous-looking sidebar in this document's chapter on student assistance read, "According to Statistics Canada, average student debt among bachelor's graduates in 1990 was $10,000. In 1996, it is $17,000 and it is expected to rise to $25,000 by 1998."
This, to put it mildly, was hooey, and not just because Statistics Canada doesn't do forward projections on student debt. At the time, it was practically impossible to accumulate more than $10,000 in debt as an undergraduate in Quebec or $24,000 in Ontario. So how could the national number be so high? The answer was that the $25,000 figure was essentially a made-up number. First, it excluded Quebec. Second, it was an extrapolation of the growth curve of borrowing under the federal loan program, which took no account of how any of the provincial grant or remission programs worked; rather, it assumed that growth in provincial loans was matching the growth in federal loans. But, having published the figure, the government felt unable to disavow it. In actual fact it is only now, 12 years later, that we are approaching that $25,000 figure, and in real dollars we are still some way off it.
You can probably see where this is leading. Students and university presidents might not agree on tuition fees, but they can unite behind the idea that student debt is a bad thing. Once PSE groups started to point out that, according to the government's own figures, Canadian students were graduating with more debt than students from Harvard and Yale, the Chretien government was shamed into paying attention to the file (there is simply no easier way to get Liberals' attention than to make unflattering social policy comparisons between Canada and the U.S.). Thanks to some sustained lobbying, the fact that demographics were pushing post-secondary education higher on the public agenda (1996 happened to be the year that that first "baby boom echo" kids turned 18) and a remarkable turnaround in public finances, the Government of Canada did a complete U-turn on student financial assistance. Far from abandoning it, they embraced it to the tune of several billion dollars: improving student loans, creating the Canada Millennium Scholarship Foundation and the Canada Education Savings grant and juicing education tax credits.
All because of some bad data.
Now, it's true that much good came of this money. But it's equally true that this money could have been spent a lot more effectively if there had been some basic data available to answer some common-sense policy questions, like, "How much debt is there, really?", "To what extent do finances generally, and debt specifically, affect access to post-secondary education?" and "Do tax credits have any effect, whatsoever, on anything"?
What does all this have to do with the census? Not much, specifically. But the census isn't the only portion of Statistics Canada's budget that's been tampered with. Much of the funding for data collection related to students has either been cut (the five-year Follow-up of Graduates) or allowed to lapse (the Youth in Transition Survey). And that's on top of the disappearance of the Millennium Scholarship Foundation's research program, the Canadian Policy Research Networks and - to a lesser extent - the Canadian Council on Learning, as well.
The Conservative government has a done a great deal in terms of post-secondary funding: research and infrastructure funding, the Canada Student Grants, the dedicated PSE portion of the CST transfer, the tax exemption of scholarships, the changes to immigration law to allow foreign students to work here more easily, etc. They cannot be faulted for inattention to the sector and their generosity to the sector should not be in question.
But it is equally true that they have stood watch over an evisceration of our collective ability to monitor problems and evaluate policy in post-secondary education. For a government that came to power preaching careful stewardship of public finances, it's a baffling course of action. Bad policy decisions are only ever one piece of bad data away; Conservative policy on data collection is guaranteed to increase the frequency of these bad decisions.

ALEX USHER