Showing posts with label Behavior Research Center. Show all posts
Showing posts with label Behavior Research Center. Show all posts

Saturday, October 13, 2012

Speaking of Pollsters ...

... this looks fishy. The Behavior Research Center has Obama ahead of Romney in Arizona 44-42. There are lots of fishy things in this poll and so perhaps it serves as a good jumping off point to discuss what kinds of things jump out at me as not quite right when I'm looking at a poll:

1) Is the poll an outlier (especially compared with pollsters I think are good)? Yeah, to say the least. PPP did a poll in Arizona BEFORE the first debate and had Romney up by 9.

2) Have I ever heard of the pollster? No, I haven't. Every pollster gets some media attention the first time sometime but when there's no track record to say this poll should be believed, it should be read with a skeptical eye.

3) Are there numbers below that topline that seem counterintuitive? Yes. The gender gap is very narrow here for one and the poll has Obama and Romney tied among men. The poll also has Obama ahead 77-10 among Latinos. There's other things that don't feel right but those are the biggest ones.

4) Are the campaigns behaving in a way that is consistent with the polls? You can figure out that Ohio is close in both campaigns' internal polls by the way the two campaigns are behaving (running a million commercials and campaigning there). We don't see the two campaigns behaving as if Arizona is in play.

5) Is it a live-interviewer poll with cell phones or is it a robo-poll or is it an online poll? The order in which I listed them is in descending order of quality and this is an online poll.

So, this poll has all the hallmarks of a poll that I would not tend to believe. It doesn't mean it can't be right. It just means ... it probably isn't right.

Now, compare all that with this PPP poll in Ohio that was just released that has Obama up by 5:

1) Is the poll an outlier? Not too much of an outlier. CNN had Obama ahead by 4 a few days ago and NBC/WSJ had Obama up by 6. Others have it closer and PPP does have a slight Democratic lean in their polls. But this is not a shocking number.

2) Have I heard of PPP? Yeah, and they have a generally good track record.

3) Are there numbers below the topline that seem counterintuitive? Mostly no. For instance, Romney has a 46/51 fav/unfav. That sounds about right, especially in Ohio. Gender gap? Yeah. Obama leads 54-42 among women and trails 50-48 among men. I'd guess the Obama might be a tad more behind in Ohio but this is not a crazy number.

4) Are the campaigns behaving in a way that is consistent with the poll? Oh yeah, to say the least.

5) Live-interviewer or robo-poll or online poll? Robo-poll. Not ideal but at least it isn't online.

This poll mostly passes the smell test. There are a few things I scratch my head on. PPP says 19% of voters have already voted and those voters went 76-24 for Obama. That's hard to believe. If it is true, Romney is in a DEEP hole in Ohio and NBC/WST had a similar finding in their poll though not quite as big a margin. But look, I think it is clear that Obama leads by a little in Ohio (even Rasmussen has Obama ahead by 1 there) and this poll is not far off if it is off.