Discussion about this post

User's avatar
Dan Koretz's avatar

This is an excellent post. I'd like to comment on two of your points.

First, your heading "Low barriers to new ideas" understates the problem. You are of course correct that innovations, including very large-scale ones, are often implemented with no real evidence evaluating either their efficacy or their side-effects. But worse, the educational establishment as a whole often even resists evaluating these innovations after they are implemented. Many of the key people want to show they are on board with the latest trend and don't want to be the skeptic demanding evidence. There are always a few exceptions. For example, Ed Reidy, who was Deputy Commissioner in KY during the huge KIRIS program, said publicly that the department owed it to kids to have people evaluate their program, and he allowed independent researchers to conduct evaluations, even evaluations that could produce results threatening to the program as designed. That is not the norm, however. IMHO, this is more than a recipe for failure. It's unethical. Major innovations should not be imposed on kids without evidence.

Second, in your conclusion, you wrote "In short, we need to make competence visible." I could not agree more. The difficult question is HOW. This is a particularly thorny problem in education, and I can't address it adequately in a short post, but I'll make a few points. As everyone knows, the system reflects a distrust of professional judgment, in part for very good reasons. In most districts, most teacher evaluations are pro forma and let poor teaching continue. (An anecdote: in the middle school my kids attended, generally considered one of the best in the state, one English teacher was so incompetent that her corrections actually introduced grammatical errors into kids' texts. She remained, year after year.) As some economists have noted, this is a common problem in the public sector because manager don't have money on the table; keeping a marginal or incompetent teacher often imposes less of a cost than getting rid of them. However, the system's primary responses for decades has been a counterproductive overreliance on objective measures. This is one of the core rationales for test-based accountability, which is premised on the idea that you can improve things by looking only at outputs, not at practice. It works for sulfur dioxide emissions from powerplants, but not for teaching. Yet for years, the people in charge insisted, in the face of persuasive evidence that this isn't true, that increased scores can be trusted without bothering to look to see how scores are raised. The partial retreat from that policy, which was largely but not entirely a failure, was to expand the system to incorporate other objective measures. They can be informative, just as test scores can be, but they are insufficient. For example, there are a number of studies showing that on some of the leading objective measures of classroom practice, US math classes score better than Japanese math classes--despite the fact that Japanese kids are on average far better in math that US kids.

This is a very difficult problem, and there is no silver bullet. IMHO, any good accountability system has to include observations of practice, but how to do that is not entirely clear. There is a good argument for including standardized measures as part of that, but that isn't a sufficient response. Complementing this with potentially more subjective evaluation is tough. For example, the Dutch system relies in part on evaluations by trained inspectors, but some Dutch scholars have found evidence that teachers have found ways to inflate inspection ratings, just as American teachers have found ways to inflate test scores. Some readers here may know that there has been a great deal of controversy in recent years about the practices of Ofsted, the British inspection system. The Singapore system relies on evaluations by both in-school personnel and Ministry personnel, but it isn't clear how well it could be adapted to fit the US context, which has far more fragmented authority.

I think that exploring potentially more effective (and presumably more complex) ways of holding educators accountable should be a priority for education research. However, getting that to happen will require two things beyond the interest of researchers. First, there would have to be funding for this work, which would be a tough row to hoe even before the carnage imposed by the Trump administration. Second, and far more vexing, this sort of work would require the agreement and cooperation of SEAs and LEAs. In my experience, this wouldn't be easy to obtain, in part for reasons in your post.

Douglas Carnine's avatar

From my perspective, Robert is one of the few genuine Renaissance thinkers in education. I have long respected his ability to cut through fashionable rhetoric and name the system’s deeper issues, ranging from the role of family structure to the future of public education to curriculum and instruction. He introduced me to Substack by publishing my first article on his platform. I initially planned to write a direct response to his latest essay, but the issues he raised warranted a closer look at the implications of what he had written, so I published my response as a two-part Substack essay: “Stop Admiring the Problem: Escaping Education’s Groundhog Day” https://substack.com/@douglascarnine/p-193524718 and “Part 2: Start Building the Profession”. https://douglascarnine.substack.com/p/part-2-start-building-the-profession?r=20zkdr&utm_campaign=post&utm_medium=web&showWelcomeOnShare=true

44 more comments...

No posts

Ready for more?