Tuesday, April 22, 2008

An Embarrassing Performance

Yes, I'm talking about the Pennsylvania primary. No, I'm not talking about Barrack Obama.

I've had running battles (on other sites) about what I viewed as godawful polling practices by an outfit out of North Carolina called Public Policy Polling. Anyone who has had political science training could look at the crosstabs for their polls and see countless red flags. For starters, the weighting that they gave to black voters and to the Philadelphia area seemed all out of proportion to the actual demographics of the state or any historical precedent. Also, the fact they kept the raw numbers hidden from scrutiny was also troubling for anyone trying to gauge them from the perspective of the social sciences. There is nothing wrong with weighting your polls, but you should give people the opportunity to scrutinize them without having to engage in reverse engineering.

There were 39 polls released about the Pennsylvania primary since April 1st. A grand total of three of these polls had Obama in the lead, Clinton led in 35 of the others with one saying it was a tie. All three of the polls that had Obama in front were the handiwork of PPP (last of the three, a massive survey of 2338 likely Democratic voters with a +/- of only 2% -supposedly- here.) In a sense this isn't surprising after you look at the client list for PPP. I conducted searches to see who the majority of PPP clients had endorsed for the Democratic nomination. There were copious Obama endorsements, but not a single Clinton endorsement. Now, this might just be a hell of a coincidence, but given the tightness of the nomination fight that seems a little unlikely. It seems more likely that PPP as an outfit are not simply Democratic pollsters, but pro-Obama (or anti-Clinton) pollsters.

Such a view is confirmed by the actual results in Pennsylvania tonight (at this moment Clinton ahead 10% points with 96% reporting.) PPP's polls, which had Obama ahead by 3%, were not just wrong they were terrible, if the purpose of a poll is to measure a larger population accurately. Of course, if accurate measurement was not the goal of these "polls", well then maybe it is mission accomplished.

No comments: