Data Mining for Journalists
Via Slashdot, investigative journalist John Mecklin lays out a way that the Internet revolution is actually helping journalism (crazy, I know):
Now, in the post-Google Age, Allison sees the possibility that computer algorithms can sort through the huge amounts of databased information available on the Internet, providing public interest reporters with sets of potential story leads they otherwise might never have found. The programs could only enhance, not replace, the reporter, who would still have to cultivate the human sources and provide the context and verification needed for quality journalism. But the data-mining programs could make the reporters more efficient — and, perhaps, a less appealing target for media company bean counters looking for someone to lay off.
IMHO, the part about investigative reporters not getting laid off seems increasingly far-fetched. There are problems in the news business that a few new reporting techniques won't solve. But still, increasing the efficiency with which the public can gain from its own data is something worth cheering. As I've tried to stress throughout my posts, the ability to search through massive databases of material like this is still in its infancy. Our ability to collect information has outstripped our ability to make sense of it, and we're still growing into all the things we can do with this data.














I don't completely agree.
I both agree and disagree. I think the point the author was making and the point you are making are somewhat divergent. This is a classic example of the difference between macro-level decisions
(in this case, company wide) and micro-level choices (in this case, individual choices). The author said this:
"But the data-mining programs could make the reporters more efficient — and, perhaps, a less appealing target for media company bean counters looking for
someone to lay off."
A different way to look at this is at the individual level. As with all disruptive technologies, some reporters will be more adaptable to this new technology than others. Later the author quotes Irfan Essa:
"We're talking about a new breed of people," Essa says, "who are midway between technologists and journalists."
I think the author was focusing on the changing environment for the journalists, vis-a-vis this new technology. In this way, his assertion does make sense. If the "bean-counters" are cutting jobs, those with the new skills are less likely to get laid-off than equally capable journalists without these new technological skills.
But I agree with Blue Leader, I don't think a grand database searching system can miraculously heal all of the problems faced by the media conglomerates. The Internet is an incredibly disruptive technology and traditional media outlets will struggle (some will fail) during this period of adjustment. But I do think it can make it a little less painful to the adaptive reporters who embrace the new technology.
Dude, anyone who reads it knows...
that it's /.
DD
Dirty D writes about polling, analytics, data and whatever else may cross his mind as being neat. Feel free to contact him by email : D I R T Y D AT O V E R D E T E R M I N E D DOT N E T.