I’ve been thinking quite a bit recently about efficacy in education in light of the Pearson realignment. Is efficacy, a medical concept, a good lens through which to view our current educational technology challenges? Michael Feldstein laid out some reasons it might be in his treatment of the shift, but I’d like to expand on one of them — the “last mile”.
One of the crucial elements of efficacy is that it is *not* solely a lab concept. Certainly you can talk about a drug’s efficacy in research trials, but in general what medical researchers are interested in is how the drug performs in real-world scenarios. And in real-world scenarios, regimen compliance (more recently referred to as “adherence”) is a huge issue. Here’s a good explanation of the problem:
“We’ve got so many great medications out there, but how do you get the patient to take the drops correctly?” said Dr. Tsai. To answer [this] question, he turned to diabetes researchers, who have been at the forefront of the field. “The researchers don’t see the patients as being bad,” Dr. Tsai explained. “They just see barriers to adherence.” On their advice he created a taxonomy, or systematic classification, of all the barriers to adherence.
Through a series of open-ended and specific questions, Dr. Tsai and colleagues described 71 unique reasons for nonadherence, culled from interviews with 48 patients with glaucoma. The number of barriers was higher than expected.
Patients reported the typical reasons, including problems with drop administration, following directions, bottle design, cost and forgetfulness. But nearly 50 percent of the barriers were “situational/environmental,” instances in which some other factors come into play. For example, the patient travels to Europe, forgets his drops and has no way to refill them. Or a loved one is in the hospital and the glaucoma patient feels guilty focusing on her own health.
“Our major finding,” said Dr. Tsai, “was that solutions are going to have to become more innovative and individualized. It’s likely to be different for each patient.”
Medical regimens are simple compared to educational ones. And yet, as the above shows, they are still profoundly complex. The key, however, is in that first paragraph:
“The researchers don’t see the patients as being bad,” Dr. Tsai explained. “They just see barriers to adherence.”
If there is a good lesson to take away from efficacy research, it is this one — no one cares how your drug performs in the lab. While educational technology has run towards the air-drop model of intervention, modern medicine has actually been running away from that model. The “last mile“, the name some epidemiologists give the gap between having effective treatments and staging effective interventions, turns out to be the majority of the journey; and if you are focussed on health instead of pills what you need to look at is the whole ecosystem. You need to see the barriers to use of your medication as being as much a part of your medication as its chemical structure. You need to do crazy things, like actually talk to people on the ground about what their issues are, observe product use, provide support, and customize implementation to address local realities.
As I mentioned above, educational technology implementation is far more complex than taking glaucoma drops; yet, amazingly we treat it with less nuance than the medical community treats its own products. We engage in technology air-drops, listen approvingly to Sugara Mitra’s hole-in-the-wall pitches. We release breathless press releases about projects like ConnectED, the multi-billion dollar project to wire up America’s schools which, as far as I can tell, has not a lick of professional development funds tied to it to help educators figure out how to use that connectivity. We made the pills, problem solved, right?
I remain somewhat ambivalent about Pearson’s corporate re-engineering. And there are many issues with applying the concept of efficacy to education. But I’m willing to deal with them all if we can finally recognize that the last mile is the longest and most important, and ultimately has to be a shared responsibility.