tag:blogger.com,1999:blog-9073298.post110936915822155843..comments2023-10-16T08:20:47.101-05:00Comments on The Iconic Midwest: Media Bias QuantifiedRich Hortonhttp://www.blogger.com/profile/15561931187909269006noreply@blogger.comBlogger2125tag:blogger.com,1999:blog-9073298.post-1109450766321421992005-02-26T14:46:00.000-06:002005-02-26T14:46:00.000-06:00My quick take on your points:
#1) Is this a chick...My quick take on your points:<br /><br />#1) Is this a chicken & the egg problem? In other words, do Congress members cite studies because the media cites them, or does the media site studies because congress sites them? I'm not sure that causal relationship is important for determining what they want to determine.<br /><br />#2) Yes, their study is not issue specific. I think they tried to get at this by stressing that think tanks tend to be consistently left, center or right across their policy positions. That's why they cut RAND into two sections (Military and Domestic) because otherwise it made RAND sort of schizophrenic. To the degree that think tank are NOT ideologically consistent, it could be a problem.<br /><br />#3) I think you are right. Using ADA scores alone might exaggerate the left bias. But you would have thought it would also have skewed the right wing further RIGHT and not towards the center. Isn't that right?<br /><br />#4) I agree with you. I think they wanted to remove most subjective evaluations from the process. I'd have to re-read the section on how they coded their data to know how to respond to this criticism.<br /><br />#5) They do address this point at least in passing. But they are not comparing media with each other as such, but deriving an ADA score based of who they reference. So I'm unsure it that is too big of a problem for them. <br /><br />#6) I think you are right here. I dont think they explain the differences of time frames involved.Rich Hortonhttps://www.blogger.com/profile/15561931187909269006noreply@blogger.comtag:blogger.com,1999:blog-9073298.post-1109448467513749722005-02-26T14:07:00.000-06:002005-02-26T14:07:00.000-06:00In my exceptionally quick read of this study, seve...In my exceptionally quick read of this study, several things strike me as possible weaknesses to this study, that I don't think they addressed (again, they may have and I might have missed it).<br /><br />1) There may be a serious confound here in that what Senators and Congressmen said during debate may have come from the media outlets they describe. If so, then the bias is not the media's, but that of the Congress. (Though it's fair to say that they may be citing them precisely because the media leans left- I have to think more about this problem.)<br /><br />2) It's important to note, and I don't think that the authors do this, is that they are not measuring media bias as a whole, but only very select policy issues. Congress does not cite the same variety of issue in policy debates that the media cover, and where the media may portray a bias. Example, capital punishment probably has not gotten a lot of attention on the Hill, and probably not much attention by think tanks, but the media covers it alot. This does not suggest that the media isn't more liberal on capital punishment, but that this paper doesn't measure it. It's very design causes the study to be an examination of an extremely narrow slice of media behavior.<br /><br />3) It may be that there is a built in leftist tilt to their study simply by measuring the ADA scores and comparing it. That is, by focusing on ADA scores, they are already heading in that direction. The best way to test that is to use the scoring of conservative group on the same sample of stories. If the findings there are close to a mirror image of the findings they present, that would strengthen their argument. But if they find that the findings are skewed and suggest a conservative bias, than their findings could simply be a product of the measure they use and not a real description of media bias.<br /><br />4) Their operative measure, the number of times a particular think tank is mentioned, is very problematic, as it does not really capture the quality of the comment nor the extent. For example, if I were a reporter who is instituting liberal bias into a story, consciously or not, I am probably more likely to pick quotes from the liberal think tank that are of higher quality than the ones I pick from the conservative think tank. I could pick the same number of quotes, or even more conservative quotes than liberals ones, but the quotes I pick could make the conservatives look like raving lunatics. That is not captured in their measure, and it could skew the findings as more liberal or more conservative, the point being that they just don't know.<br /><br />Also, they don't measure column inches, which strikes me as a more precise measure than the number of times something is quoted (or the length of the citation from the Hill). A reporter could cite a liberal think tank three times to one from a conservative think tank, but the conservative quote could be twice the total length as the others combined. If that were the case, then the findings would skew liberal when it's probably not the case. Again, this could change the findings in either direction, but that authors are not able to tell from the way their study is designed. This would also impact the comparison among media outlets.<br /><br />5) In addition, it's problematic to compare across media outlets because of the nature of reporting. The stories on the network news are likely to be shorter and not as comprehensive as a magazine or newpaper story, so the amount of mentions may be less. They may only go to one source because of time limits (that choice of that source is of course subject to bias). The newspaper (and longer broadcast media) stories will have more opportunity to cite various sources, which could skew the findings.<br /><br />6) I would be far more comfortable if their bias test was done during the exact same time frame for each media sources. During different administrations, different policy oriented groups and think tanks will get diverging amount of attention from the media. Also, the change in party control of the House and Senate will affect what issues are addressed on the floor, and the opportunities the politicians from each party have to speak. In addition, the issues scored by ADA for their measure will change over time. It could be, but I doubt it, that these variations are exogenous to their model and would not affect it, but my strong guess is that they would almost necessarily impact it, and as such, the comparisons across media sources are likely invalid due to the varying time spans. <br /><br />They may have tried to control for these changes in their model, but it would be difficult. Indeed, they may have addressed many of my concerns (in my quick reading, I didn't see them to do so, but I could have missed it).<br /><br />WaltAnonymousnoreply@blogger.com