Into the archives to look at the Tooley Report (1998), ‘Educational Research: A Critique’
The authors examined a sample of papers the four most-cited British educational journals in the mid-nineties and identified four major problems….
Problem 1: Partisanship
Many researchers were partisan in their research and its presentation, often uncritically incorporating contentious political statements into their argument.
Problem 2: Methods
Many papers did not triangulate but took individuals’ statements at face value; they also said nothing about sampling at all! Particularly worrying for the paper with a sample size of one.
Problem 3: Non-empirical research
Some of it valuable, but lots which was not, particularly papers which examine how ‘great’ thinkers’ ideas fit education, uncritically and unproductively.
Problem 4: Utility
Every piece could be argued to have some value (except the reflexive accounts), but not by much. The one paper by a teacher as researcher was thought particularly alarming.
And no replications whatsoever…
Most of the time, the authors go out of their way to demonstrate fair-mindedness. Every now and then, that slips, like this suggestion that, rather than changing a course when students are unhappy about it, you just publish an article analysing it in postmodern terms.
And are the authors biased? Well, they note that despite one being ‘Old Labour’ and another ‘New Right’, they agreed on almost every point of their analysis.