Friday, November 2, 2012
It's a Close Election ...
... even billionaires are divided. Yesterday, Mike Bloomberg endorsed Obama. But today, Monty Burns endorsed Romney. The average billionaire will have to find their cues elsewhere I guess.
Labels:
Bloomberg
What You Should Worry About
The election is close and so everyone is nervous. Well, everyone except Dick Morris who is convinced that Romney will win in a landslide as Oregon is now in play (I'm not kidding).
Obama is leading according to the polls. It is roughly tied in the national poll averages and Obama has clear leads in the polling averages in enough swing states to put him over the top for re-election.
So, if you're supporting the President, you have just two things to worry about:
1) Something changes
2) The polls are wrong
Are either or both of these things possible? Absolutely. Are they likely? No. But let's take a closer look at each possibility.
Something changes. What could change in the final days? Some argue that nothing is going to change. Sam Wang, for instance, points out that the cake is now fully baked. He provides statistical proof for this and I find the phrase oddly compelling so I figured I'd repeat it. But it is always possible something could change. For one, a jobs report is going to be released in a few hours. Economists expect that the unemployment rate will tick up to 7.9%. That's probably not enough to damage Obama significantly. But it is an awfully close race and what if it ticks up to 8.0%? Are the optics of that sufficiently bad to do damage? Doubtful, but possible. (UPDATE: The jobs report was better than expected with 171,000 jobs added but the unemployment rate did tick up to 7.9% as more workers re-entered the workforce). What about the so-called incumbency effect? Many (mostly Republicans) argue that most of the undecided voters will break for Mitt Rommey because if they were voting for the President, they'd have been with him already. Is this likely? No. Mark Blumenthal picks that argument apart pretty well.
What about some other wildcard? Hurricane Sandy seems like the last, biggest wildcard and that does not seem to have done any damage to President Obama. Arguably, it has made him look good. Mitt Romney seems to think Pennsylvania is in play and he's headed there for a campaign stop on Sunday. Don't get me started on that. Overall, I think the jobs report is Romney's best bet in this category.
The polls are wrong. The polling data is much more clear than it appears to the naked eye. Sam Wang, Simon Jackman, Nate Silver, Drew Linzer, and others have modeled the probability that Obama does, in fact, have a lead according to the polls and the general consensus is ... "YEAH." But the key phrase in all that is "according to the polls." If the polls are all systematically biased in some similar kind of way, that lead would be a mirage. How often does this happen? Not often. But it is important to remember that polling is at least partially an art. In this era of low response rates, it is not quite as easy as before to ensure you have an unbiased sample. If Obama's lead (and he DOES lead in the key state of Ohio in the polls) were bigger, this would be less of a concern. But it is a small lead.
Of course, the possibility of error goes in both directions. If you watched the video of Stan Greenberg I posted a few days ago, you know there are those who believe the pollsters are undersampling Obama voters. In addition, the Obama campaign claims their superior ground game will help them out-perform the polls. Of course, the Romney campaign claims the same things. The reality is that pollsters are smart people and have staked their reputation on what they're doing. The odds are they are right. Systemic polling failure is possible ... but unlikely.
In the end, there is enough uncertainty to worry about both of these things: Something could change. The polls could be wrong. How much should you worry? As of tonight, Nate Silver has Obama as an 81% bet to win.
That's a high point in the post-Denver (first debate) campaign for Obama. And as Nate points out, you'd rather be holding Obama's cards right now than Romney's.
Obama is leading according to the polls. It is roughly tied in the national poll averages and Obama has clear leads in the polling averages in enough swing states to put him over the top for re-election.
So, if you're supporting the President, you have just two things to worry about:
1) Something changes
2) The polls are wrong
Are either or both of these things possible? Absolutely. Are they likely? No. But let's take a closer look at each possibility.
Something changes. What could change in the final days? Some argue that nothing is going to change. Sam Wang, for instance, points out that the cake is now fully baked. He provides statistical proof for this and I find the phrase oddly compelling so I figured I'd repeat it. But it is always possible something could change. For one, a jobs report is going to be released in a few hours. Economists expect that the unemployment rate will tick up to 7.9%. That's probably not enough to damage Obama significantly. But it is an awfully close race and what if it ticks up to 8.0%? Are the optics of that sufficiently bad to do damage? Doubtful, but possible. (UPDATE: The jobs report was better than expected with 171,000 jobs added but the unemployment rate did tick up to 7.9% as more workers re-entered the workforce). What about the so-called incumbency effect? Many (mostly Republicans) argue that most of the undecided voters will break for Mitt Rommey because if they were voting for the President, they'd have been with him already. Is this likely? No. Mark Blumenthal picks that argument apart pretty well.
What about some other wildcard? Hurricane Sandy seems like the last, biggest wildcard and that does not seem to have done any damage to President Obama. Arguably, it has made him look good. Mitt Romney seems to think Pennsylvania is in play and he's headed there for a campaign stop on Sunday. Don't get me started on that. Overall, I think the jobs report is Romney's best bet in this category.
The polls are wrong. The polling data is much more clear than it appears to the naked eye. Sam Wang, Simon Jackman, Nate Silver, Drew Linzer, and others have modeled the probability that Obama does, in fact, have a lead according to the polls and the general consensus is ... "YEAH." But the key phrase in all that is "according to the polls." If the polls are all systematically biased in some similar kind of way, that lead would be a mirage. How often does this happen? Not often. But it is important to remember that polling is at least partially an art. In this era of low response rates, it is not quite as easy as before to ensure you have an unbiased sample. If Obama's lead (and he DOES lead in the key state of Ohio in the polls) were bigger, this would be less of a concern. But it is a small lead.
Of course, the possibility of error goes in both directions. If you watched the video of Stan Greenberg I posted a few days ago, you know there are those who believe the pollsters are undersampling Obama voters. In addition, the Obama campaign claims their superior ground game will help them out-perform the polls. Of course, the Romney campaign claims the same things. The reality is that pollsters are smart people and have staked their reputation on what they're doing. The odds are they are right. Systemic polling failure is possible ... but unlikely.
In the end, there is enough uncertainty to worry about both of these things: Something could change. The polls could be wrong. How much should you worry? As of tonight, Nate Silver has Obama as an 81% bet to win.
That's a high point in the post-Denver (first debate) campaign for Obama. And as Nate points out, you'd rather be holding Obama's cards right now than Romney's.
Labels:
Dick Morris,
Drew Linzer,
Nate Silver,
Pennsylvania,
Sam Wang,
Simon Jackman,
Stan Greenberg
Wednesday, October 31, 2012
National Tracking Polls vs. Full National Polls
A few days ago, I asked, "where are the national polls?" Many have pointed out that the national polls and state polls seem to be saying different things and I suggested that one possible explanation for the difference is that we weren't seeing many full national polls at all. Instead, we were awash in national tracking polls. And I questioned whether there is some difference between these full national polls and the tracking polls that could explain the disconnect between state polls and national polls.
Since then, several full national polls have come out. Let's compare these full national polls with the national tracking polls to see if they tell us something different. I've listed the last 20 national polls (full or tracking) below with the most recent dates in the field on top.
The differences here are not quite as large as they might appear at first ... but there does seem to be a little bit of a difference. If we just take a straight average of the polls on each side of the ledger, Romney leads by an average of 1.1 among the tracking polls and Obama leads by an average of 1.0 on the full national polls. But this is mostly because of a few outliers on each side. Let's throw out the biggest outlier on each side (Gallup among the national tracking polls and National Journal among the full national polls). What do we get then? Among the tracking polls, Romney still leads by 0.6 points on average and, among the full national polls, Obama leads by 0.2 points. It is a 0.8% difference.
That's not a lot but it is something. More notable than that to me is that Obama does not trail in any full national poll. It does seem to me there's something different happening with the tracking polls. If we look at just the full national polls, the split between the national vote and the state polling is just a little less large.
You probably saw that Nate Silver discussed the differences between the state polling and the national polls in a post earlier today. In that piece, he does not consider the issue I'm raising here and expresses some rationale for why he throws his lot in with the state polling. Whether what I'm talking about is a part of this story or not, Silver's argument is a good one and is good reason to think the state polling is more to be believed. But this piece may get us a small distance towards reconciling the two.
Since then, several full national polls have come out. Let's compare these full national polls with the national tracking polls to see if they tell us something different. I've listed the last 20 national polls (full or tracking) below with the most recent dates in the field on top.
The differences here are not quite as large as they might appear at first ... but there does seem to be a little bit of a difference. If we just take a straight average of the polls on each side of the ledger, Romney leads by an average of 1.1 among the tracking polls and Obama leads by an average of 1.0 on the full national polls. But this is mostly because of a few outliers on each side. Let's throw out the biggest outlier on each side (Gallup among the national tracking polls and National Journal among the full national polls). What do we get then? Among the tracking polls, Romney still leads by 0.6 points on average and, among the full national polls, Obama leads by 0.2 points. It is a 0.8% difference.
That's not a lot but it is something. More notable than that to me is that Obama does not trail in any full national poll. It does seem to me there's something different happening with the tracking polls. If we look at just the full national polls, the split between the national vote and the state polling is just a little less large.
You probably saw that Nate Silver discussed the differences between the state polling and the national polls in a post earlier today. In that piece, he does not consider the issue I'm raising here and expresses some rationale for why he throws his lot in with the state polling. Whether what I'm talking about is a part of this story or not, Silver's argument is a good one and is good reason to think the state polling is more to be believed. But this piece may get us a small distance towards reconciling the two.
Labels:
Nate Silver
Romney's Pennsylvania Gambit ...
... is funny.
I woke up this morning to this nonsense about Romney trying to "expand the map" in Pennsylvania. It seemsRomney Romney's super PAC has some extra money to burn so they're burning it in Pennsylvania with a media buys of about $2.6 million. The Obama campaign has responded by spending about $600,000.
In defending the move, the Romney campaign has said they think Pennsylvania is in play and Politico (et tu Politico???) reports that "some polls have shown tightening there." Oy.
I have written more posts railing about how Pennsylvania is not in play than I can count. Here's one. Here's another. You can search the blog for more.
I guess it would be helpful if there were some data that could help us determine whether Pennsylvania is in play:
Oops.
It turns out there's been exactly one poll since February that has showed Romney in the lead. That poll was done by ... the Republican State Committee of Pennsylvania. Interesting. Rasmussen polled Pennsylvania just a week ago and has Obama over 50% and 5 points ahead.
Perhaps you know all this but you worry because Obama spent that $600,000 in Pennsylvania. Believe me folks. The Obama campaign is not sweating Pennsylvania. They can't literally spend every dollar in Ohio. So why not spend a fraction of what the other side is spending to get a little bit of a counterargument on the air.
Let me leave you with this thought. In 2008, Obama beat McCain by just over 10 points in Pennsylvania. The whole nation has shifted a bit back towards the Republicans since then. Has Pennsylvania shifted by 10 points? No. Will $2.6 million in last-minute spending on Romney make it shift 10 points? No.
Romney has one hope for winning Pennsylvania and it is not $2.6 million in ads. Romney's only hope in Pennsylvania is ... systemic polling failure.
I woke up this morning to this nonsense about Romney trying to "expand the map" in Pennsylvania. It seems
In defending the move, the Romney campaign has said they think Pennsylvania is in play and Politico (et tu Politico???) reports that "some polls have shown tightening there." Oy.
I have written more posts railing about how Pennsylvania is not in play than I can count. Here's one. Here's another. You can search the blog for more.
I guess it would be helpful if there were some data that could help us determine whether Pennsylvania is in play:
Oops.
It turns out there's been exactly one poll since February that has showed Romney in the lead. That poll was done by ... the Republican State Committee of Pennsylvania. Interesting. Rasmussen polled Pennsylvania just a week ago and has Obama over 50% and 5 points ahead.
Perhaps you know all this but you worry because Obama spent that $600,000 in Pennsylvania. Believe me folks. The Obama campaign is not sweating Pennsylvania. They can't literally spend every dollar in Ohio. So why not spend a fraction of what the other side is spending to get a little bit of a counterargument on the air.
Let me leave you with this thought. In 2008, Obama beat McCain by just over 10 points in Pennsylvania. The whole nation has shifted a bit back towards the Republicans since then. Has Pennsylvania shifted by 10 points? No. Will $2.6 million in last-minute spending on Romney make it shift 10 points? No.
Romney has one hope for winning Pennsylvania and it is not $2.6 million in ads. Romney's only hope in Pennsylvania is ... systemic polling failure.
Labels:
Pennsylvania,
Politico,
Rasmussen
Monday, October 29, 2012
Rasmussen, Systemic Polling Failure, and "Truth"
There's quite a brouhaha spinning around the interwebs with conservatives complaining that Nate Silver is cooking the books in his polling model because he's a liberal shill. Here's the argument in its original full form. It is pure drivel. Silver himself had this brilliant retort today ...
But, anyway, the whole thing got me to thinking about the state of the polls and the state of the race. Conservatives are reading Rasmussen and Gravis and Gallup and celebrating what is sure to be a big victory for Romney next Tuesday. Liberals are reading ... well, everything else and are sweating the national vote polls that have it close (actually, if you take Gallup and Rasmussen out of the naional poll averages, Obama is very slightly ahead) but feeling pretty comfortable about the state-level polls that show Obama leading in more than enough states to win a majority in the Electoral College.
What is the state of the race and whose polls are right? The truth is we don't really know for sure which set of polls is right. But, if I had to bet, I'd say Rasmussen and Gallup are wrong (for different reasons). Let me lay out the case for each side and explain why I think Rasmussen has it wrong but it is important to acknowledge that ...
Rasmussen could be right. Rasmussen has been identified as a pollster that has a "Republican lean" but this is really a mislabeling of what they are doing. It suggests that the pollster is just putting his thumb on the scale and cooking the books. That's not what Rasmussen is doing. At least I'm pretty sure they're not. What Rasmussen does is to use "dynamic party weighting." They weight their sample of voters so that they get to a designated number of Republicans and Democrats in their sample. The party weighting is "dynamic" because Rasmussen comes up with the relative weights of Republicans and Democrats based on some recent previous period of polling. Effectively, Rasmussen is making an educated guess about what the partisan makeup of the electorate will be (nationally or in a state) and then they make sure their sample looks like that.
So is it possible Rasmussen is right? Absolutely, it is possible. If their dynamic weights are accurate, then their polls will be accurate. And the flipside is also true. If their weights are wrong, they'll be wrong.
So what's the case against Rasmussen? A couple of days ago, Nate Cohn wrote that, if the polls stay where they are up to Election Day, Mitt Romney's only hope will be "systemic polling failure." This means that the vast majority of polls must have done something (question wording, poor sampling, etc.) that led them all to the wrong answer. Nate Cohn is right about this.
Systemic polling failure does happen. To understand why it is unlikely, we have to understand what other pollsters are doing differently than Rasmussen to get such systematically different results. First, other pollsters are not weighting by party ID at all. To most pollsters, party ID is something to be discovered in a poll, not something to use to weight the sample. This is because party ID is a fluid construct. People tend to change their response to a party ID question based on how they feel about the competing presidential candidates or based on how enthused they are to vote for their preferred candidate. Other pollsters simply ask respondents who they are planning to vote for and then use likely voter screens (of different varieties) to determine who is likely to vote and who is a non-voter.
It is entirely possible that this methodology will lead to a sample that is not reflective of the population as a whole. One reason is simply statistical variation. Maybe you just happened to get a disproportionate number of Romney supporters in your sample. This happens but we know the precise likelihood it will happen and this problem is corrected for by the various polling averages out there. Only a very small number of polls will be outliers for this reason and, when they are averaged into the rest, they will not have a substantial effect on the overall average number. A second problem is some kind of problem with the way we are sampling. One problem along these lines is the undersampling of certain kinds of populations like cell phone users or Hispanic voters who do not speak English, either of which may not be called by pollsters for different reasons. Some pollsters do call cell phones and some call Spanish-only voters. Here's Stan Greenberg talking about why undersampling of cell phone voters is causing Obama voters to be under-represented in the public polls we see:
Other pollsters who are good at what they do, use some kind of weighting mechanism to try to get a representative sample without calling them. This is increasingly problematic but is done well by some pollsters (like PPP in my view).
The point is that these pollsters are either getting a truly representative sample or they are using demographic weighting (not partisan ID weighting) to make sure they don't have a problem with their sample. The fact that so many pollsters are coming to basically the same conclusions (for instance, that Barack Obama has a small lead in Ohio) is evidence that they are likely right.
Could Ohio (and other states) still shift? Yes, but it is getting very late.
Could Rasmussen be right and the other polls wrong? Yes. I don't think so but it could happen and, if it did, it would be exactly the kind of "systemic polling failure" Nate Cohn was talking about.
We'll know next Wednesday morning.
But, anyway, the whole thing got me to thinking about the state of the polls and the state of the race. Conservatives are reading Rasmussen and Gravis and Gallup and celebrating what is sure to be a big victory for Romney next Tuesday. Liberals are reading ... well, everything else and are sweating the national vote polls that have it close (actually, if you take Gallup and Rasmussen out of the naional poll averages, Obama is very slightly ahead) but feeling pretty comfortable about the state-level polls that show Obama leading in more than enough states to win a majority in the Electoral College.
What is the state of the race and whose polls are right? The truth is we don't really know for sure which set of polls is right. But, if I had to bet, I'd say Rasmussen and Gallup are wrong (for different reasons). Let me lay out the case for each side and explain why I think Rasmussen has it wrong but it is important to acknowledge that ...
Rasmussen could be right. Rasmussen has been identified as a pollster that has a "Republican lean" but this is really a mislabeling of what they are doing. It suggests that the pollster is just putting his thumb on the scale and cooking the books. That's not what Rasmussen is doing. At least I'm pretty sure they're not. What Rasmussen does is to use "dynamic party weighting." They weight their sample of voters so that they get to a designated number of Republicans and Democrats in their sample. The party weighting is "dynamic" because Rasmussen comes up with the relative weights of Republicans and Democrats based on some recent previous period of polling. Effectively, Rasmussen is making an educated guess about what the partisan makeup of the electorate will be (nationally or in a state) and then they make sure their sample looks like that.
So is it possible Rasmussen is right? Absolutely, it is possible. If their dynamic weights are accurate, then their polls will be accurate. And the flipside is also true. If their weights are wrong, they'll be wrong.
So what's the case against Rasmussen? A couple of days ago, Nate Cohn wrote that, if the polls stay where they are up to Election Day, Mitt Romney's only hope will be "systemic polling failure." This means that the vast majority of polls must have done something (question wording, poor sampling, etc.) that led them all to the wrong answer. Nate Cohn is right about this.
Systemic polling failure does happen. To understand why it is unlikely, we have to understand what other pollsters are doing differently than Rasmussen to get such systematically different results. First, other pollsters are not weighting by party ID at all. To most pollsters, party ID is something to be discovered in a poll, not something to use to weight the sample. This is because party ID is a fluid construct. People tend to change their response to a party ID question based on how they feel about the competing presidential candidates or based on how enthused they are to vote for their preferred candidate. Other pollsters simply ask respondents who they are planning to vote for and then use likely voter screens (of different varieties) to determine who is likely to vote and who is a non-voter.
It is entirely possible that this methodology will lead to a sample that is not reflective of the population as a whole. One reason is simply statistical variation. Maybe you just happened to get a disproportionate number of Romney supporters in your sample. This happens but we know the precise likelihood it will happen and this problem is corrected for by the various polling averages out there. Only a very small number of polls will be outliers for this reason and, when they are averaged into the rest, they will not have a substantial effect on the overall average number. A second problem is some kind of problem with the way we are sampling. One problem along these lines is the undersampling of certain kinds of populations like cell phone users or Hispanic voters who do not speak English, either of which may not be called by pollsters for different reasons. Some pollsters do call cell phones and some call Spanish-only voters. Here's Stan Greenberg talking about why undersampling of cell phone voters is causing Obama voters to be under-represented in the public polls we see:
Other pollsters who are good at what they do, use some kind of weighting mechanism to try to get a representative sample without calling them. This is increasingly problematic but is done well by some pollsters (like PPP in my view).
The point is that these pollsters are either getting a truly representative sample or they are using demographic weighting (not partisan ID weighting) to make sure they don't have a problem with their sample. The fact that so many pollsters are coming to basically the same conclusions (for instance, that Barack Obama has a small lead in Ohio) is evidence that they are likely right.
Could Ohio (and other states) still shift? Yes, but it is getting very late.
Could Rasmussen be right and the other polls wrong? Yes. I don't think so but it could happen and, if it did, it would be exactly the kind of "systemic polling failure" Nate Cohn was talking about.
We'll know next Wednesday morning.
Labels:
Cell phones,
Gallup,
Gravis Marketing,
Nate Cohn,
Nate Silver,
PPP,
Rasmussen,
Stan Greenberg
Sunday, October 28, 2012
Sundays Are Not Always Lazy
Sunday has been a very active day for polls coming out and it has been a very good polling day for the President. There was an Ohio poll that came out late Saturday night that had Obama and Romney tied at 49 and that can be considered bad. But everything else has been either good or trending in the right direction for Obama today.
A PPP poll just came out giving Obama a 4-point lead (51-47) in Ohio. That's not only a good number for the President, it is from a pollster that had him up by just 1 last week. PPP found that 36% of Ohio respondents have already voted and Obama leads 63-36 among them. Democrats are heavily unified in Ohio and there is no enthusiasm gap between Democrats and Republicans. These are all tough, tough numbers for Romney if they are accurate (that's the big "if"). Similarly, PPP had Obama down by 1 in New Hampshire last week and today, they have him up by 2 (49-47). Rasmussen and Gallup each moved a point in the President's direction in their national trackers. Finally, Gravis Marketing has a poll out tonight showing Obama up by 1 in Ohio. This might seem like bad news ... except that Gravis has about as strong a Republican lean as anybody (see Simon Jackman's recent discussion of house effects). Add that house effect in to Gravis and their poll looks a heck of a lot like PPP's.
We'll see how the rest of the day plays out (more polls to come tonight) ... but it is a good day so far for the President.
A PPP poll just came out giving Obama a 4-point lead (51-47) in Ohio. That's not only a good number for the President, it is from a pollster that had him up by just 1 last week. PPP found that 36% of Ohio respondents have already voted and Obama leads 63-36 among them. Democrats are heavily unified in Ohio and there is no enthusiasm gap between Democrats and Republicans. These are all tough, tough numbers for Romney if they are accurate (that's the big "if"). Similarly, PPP had Obama down by 1 in New Hampshire last week and today, they have him up by 2 (49-47). Rasmussen and Gallup each moved a point in the President's direction in their national trackers. Finally, Gravis Marketing has a poll out tonight showing Obama up by 1 in Ohio. This might seem like bad news ... except that Gravis has about as strong a Republican lean as anybody (see Simon Jackman's recent discussion of house effects). Add that house effect in to Gravis and their poll looks a heck of a lot like PPP's.
We'll see how the rest of the day plays out (more polls to come tonight) ... but it is a good day so far for the President.
Labels:
Gallup,
Gravis Marketing,
PPP,
Rasmussen,
Simon Jackman
Saturday, October 27, 2012
Where are the National Polls?
We all see the divergence between the national tracking polls, which generally show Romney with a small lead on average, and the state-level polls, which generally show Obama with small leads in most of the key swing states on average.
How could these two things be true at the same time? There's actually two things going on here:
First, it is entirely possible that the President is winning by narrow margins in swing states like Ohio and Colorado but is losing by more in "solid Romney" states than he is winning in "solid Obama" states. That would translate into a national popular vote deficit but, potentially, an Electoral College victory. Most of the sites that create election-prediction models like Sam Wang's Princeton Election Consortium and Drew Linzer's Votamatic use state-level polls either exclusively or more heavily than national polls because the state-level polls provide more information that is useful. They are generally right to do this in terms of predicting what matters - the Electoral College outcome. But those national tracking polls are still unpleasant to look at ... which brings me to my second point ...
Second, it is really striking to me how few "full" national polls there have been in this campaign, especially in the final weeks of the campaign. There are at least 8 different national "tracking" polls that are released just about every day. But these are not the same as a regular poll. I can't claim perfect expertise on the impact (or not) of this phenomenon but it does seem to me there is some important effect of looking at only tracking polls as opposed to regular "full" national polls. Tracking polls take a smaller sample every night for 3 or 4 or 5 or even 7 (in the case of Gallup) nights. They put these together to create a national polling number. Then, when a new night comes on board, the sample from the oldest night drops out. What you end up with is a "rolling average" of the most recent nights. One potentially problematic aspect of this is that, because each night is a distinct sample and because the pollster wants to keep the demographics in the full sample correct from night to night, you have to weight some very small samples night to night before adding them to the sample. This would seem to introduce some error as opposed to doing a regular 2 or 3-night poll and then weighting the whole sample from there. In effect, you'd need to do less weighting as you'd have stronger sub-samples to work with.
Now, I'm just kind of spit-balling on all that and I could be wrong. But I do think that regardless, it is notable that there have been so few full national polls. Indeed, there has not been one full national poll that I can find since the third debate. I'd be interested to see one of those from a good pollster who does live interviews with cell phones included.
UPDATE: In a post today, Nate Silver speaks to the question of the split between the national tracking polls and the state-level polling. The bottom line is that he says the state-level numbers are suggesting leads for Obama in swing states like Ohio that are statistically very meaningful. Mark Blumenthal makes some similar arguments in Pollster.com
How could these two things be true at the same time? There's actually two things going on here:
First, it is entirely possible that the President is winning by narrow margins in swing states like Ohio and Colorado but is losing by more in "solid Romney" states than he is winning in "solid Obama" states. That would translate into a national popular vote deficit but, potentially, an Electoral College victory. Most of the sites that create election-prediction models like Sam Wang's Princeton Election Consortium and Drew Linzer's Votamatic use state-level polls either exclusively or more heavily than national polls because the state-level polls provide more information that is useful. They are generally right to do this in terms of predicting what matters - the Electoral College outcome. But those national tracking polls are still unpleasant to look at ... which brings me to my second point ...
Second, it is really striking to me how few "full" national polls there have been in this campaign, especially in the final weeks of the campaign. There are at least 8 different national "tracking" polls that are released just about every day. But these are not the same as a regular poll. I can't claim perfect expertise on the impact (or not) of this phenomenon but it does seem to me there is some important effect of looking at only tracking polls as opposed to regular "full" national polls. Tracking polls take a smaller sample every night for 3 or 4 or 5 or even 7 (in the case of Gallup) nights. They put these together to create a national polling number. Then, when a new night comes on board, the sample from the oldest night drops out. What you end up with is a "rolling average" of the most recent nights. One potentially problematic aspect of this is that, because each night is a distinct sample and because the pollster wants to keep the demographics in the full sample correct from night to night, you have to weight some very small samples night to night before adding them to the sample. This would seem to introduce some error as opposed to doing a regular 2 or 3-night poll and then weighting the whole sample from there. In effect, you'd need to do less weighting as you'd have stronger sub-samples to work with.
Now, I'm just kind of spit-balling on all that and I could be wrong. But I do think that regardless, it is notable that there have been so few full national polls. Indeed, there has not been one full national poll that I can find since the third debate. I'd be interested to see one of those from a good pollster who does live interviews with cell phones included.
UPDATE: In a post today, Nate Silver speaks to the question of the split between the national tracking polls and the state-level polling. The bottom line is that he says the state-level numbers are suggesting leads for Obama in swing states like Ohio that are statistically very meaningful. Mark Blumenthal makes some similar arguments in Pollster.com
Labels:
Cell phones,
Drew Linzer,
Mark Blumenthal,
Nate Silver,
Sam Wang
Friday, October 26, 2012
What a Fool Believes
You know that is flat-out the best Michael McDonald song.
Now that you're in a Michael McDonald mood, let's get to his latest work. The "other" Michael McDonald is the foremost expert on early voting and posted this fantastic review of early voting around the country.
There is a lot of discussion of early voting and its impact among pundits and media folks, not to mention pollsters. A lot of the polling, particularly in Iowa, Wisconsin, and Ohio, has found that early-vote respondents are telling pollsters that they are voting very heavily for Obama. This has led some to think the President is running away with the election. It isn't that simple. If you're one of those Obama supporters who thinks early voting is going to singlehandedly crush Romney, McDonald's data is going to disappoint you. But, there is a lot of good news in what McDonald has to say.
His work is worth a full, careful read. But, the summary is this:
What that means is that, while Romney CANNOT win without Ohio, there are paths to victory for Obama that don't include Ohio. Wisconsin is likely going for the President if the polls are to be believed. On cue, the Romney campaign is trying to make a play in Wisconsin ... which is brilliant because, ya know, Mike Dukakis won Wisconsin so why couldn't another Massachusetts Governor do it? Adding Wisconsin, Iowa, and Nevada to the President's "solid" 237 electoral votes means he's at 259 with Florida, Ohio, Virginia, Colorado, and New Hampshire still in play (we'll assume North Carolina is going for Romney for simplicity's sake). At that point, Obama would only need Florida OR Ohio OR Virginia OR the combination of Colorado and New Hampshire. The only state in that list where Obama is not currently ahead in the pollster.com average is Florida.
Polls can be wrong. But, as we get closer to the election, the Romney campaign's hopes are increasingly pinned on that thin thread - hoping the state polls are wrong.
Take us home Michael McDonald ...
Now that you're in a Michael McDonald mood, let's get to his latest work. The "other" Michael McDonald is the foremost expert on early voting and posted this fantastic review of early voting around the country.
There is a lot of discussion of early voting and its impact among pundits and media folks, not to mention pollsters. A lot of the polling, particularly in Iowa, Wisconsin, and Ohio, has found that early-vote respondents are telling pollsters that they are voting very heavily for Obama. This has led some to think the President is running away with the election. It isn't that simple. If you're one of those Obama supporters who thinks early voting is going to singlehandedly crush Romney, McDonald's data is going to disappoint you. But, there is a lot of good news in what McDonald has to say.
His work is worth a full, careful read. But, the summary is this:
Everyone wants to know who is winning. In my commentary below I explain why I conclude Obama has narrow leads in Iowa and Nevada, Romney has a narrow lead in North Carolina, and in the remainder the early vote is not providing a clear direction yet. There is still ample time for conditions to change, but it will be increasingly difficult to do so as more votes pour in.To translate that, there just isn't any clear evidence yet that early voting is helping the Obama campaign in Ohio. BUT, there is clear evidence that the early voting is really hurting Romney in Iowa and Nevada. It is frankly very hard for me to see how Romney wins Nevada at this point and Iowa is looking like a very difficult state for him.
There are instructive patterns other than the horse race. The patterns of early voting in Florida and Ohio suggest that Obama supporters are successfully overcoming limitations in early voting enacted by those states' Republican governments.
What that means is that, while Romney CANNOT win without Ohio, there are paths to victory for Obama that don't include Ohio. Wisconsin is likely going for the President if the polls are to be believed. On cue, the Romney campaign is trying to make a play in Wisconsin ... which is brilliant because, ya know, Mike Dukakis won Wisconsin so why couldn't another Massachusetts Governor do it? Adding Wisconsin, Iowa, and Nevada to the President's "solid" 237 electoral votes means he's at 259 with Florida, Ohio, Virginia, Colorado, and New Hampshire still in play (we'll assume North Carolina is going for Romney for simplicity's sake). At that point, Obama would only need Florida OR Ohio OR Virginia OR the combination of Colorado and New Hampshire. The only state in that list where Obama is not currently ahead in the pollster.com average is Florida.
Polls can be wrong. But, as we get closer to the election, the Romney campaign's hopes are increasingly pinned on that thin thread - hoping the state polls are wrong.
Take us home Michael McDonald ...
Labels:
early voting,
Michael McDonald,
Pollster.com
Charlie Cook is Kinda Wrong
I like Charlie Cook. He's a very smart guy knows as much about congressional elections as just about anybody. But he's just kinda sorta wrong in his read of what the debates did to the race. Here's part of his analysis:
Step back and think about the logic of this. The idea Cook is selling is that Obama had a nice lead before the first debate (this is true but it was already starting to recede) and that he could have just held that lead and coasted if he had "a strong performance." This is just fantasy.
The race was already starting to tighten before the first debate. Contrary to what Cook and others think, Obama did not have a disastrous debate performance. If he did, that would be reflected in the polls with his job approval sinking. It isn't. In fact, his job approval has gone steadily up in October. What happened in the first debate is that Romney looked credible after several months of being bashed by Bain Capital ads, discussion of Romney's tax returns, the conventions, and Romney's 47% comments. In the wake of all that, by the end of September, a certain number of voters (a small number but enough to make a difference) who do not care for President Obama were unsure they could support Governor Romney. When these voters saw Romney in the first debate, where he seemed, in a word, presidential, they simply went where they were likely to go in the first place. Polling says they were moving in that direction already. The first debate accelerated that. But it was underway. Some of you may remember that this is exactly the logic I outlined way back in early March when I asked whether Romney would be a credible alternative.
Importantly, there was no possibility that a "strong performance" by the President in that first debate was going to "close the sale." That's just utterly silly.
And let me add just one point to this. You might ask, why does it matter if Charlie Cook has it wrong? What's at stake in this? For starters, Andrew Sullivan, who spent more than a week on the ledge with some insane ideas about what happened in the debate is going to open that window up again and will start threatening to jump. This is sad because I enjoy reading Sullivan's blog and now I'll have to avoid it for another week or so. Second, and more importantly, this nonsensical meme has now infected some of the smarter, more reasonable minds in the journalist class, like Charlie Cook. Whether Obama wins or loses (though it will be worse if he loses), we'll hear this nonsense about how the President looked down too much during the first debate and that's why Romney caught up. It just isn't true.
A strong performance in that first debate would have probably closed the sale for Obama. Instead, his lackluster showing shifted a bunch of voters who had seemed to be drifting gradually in his direction back into neutral, with some reversing course and moving into Romney’s column. ... But this is a horse race, a very close one that can still go either way, and that was not the case before the first debate. The debates—and I would say all three of them—hit a reset button for Romney and put him back into this contest.The notion that Obama could have "closed the sale" with a strong performance in the first debate is pure nonsense. Similiarly, the notion that "this is a horse race, a very close one that can still go either way, and that was not the case before the first debate" is also nonsense.
Step back and think about the logic of this. The idea Cook is selling is that Obama had a nice lead before the first debate (this is true but it was already starting to recede) and that he could have just held that lead and coasted if he had "a strong performance." This is just fantasy.
The race was already starting to tighten before the first debate. Contrary to what Cook and others think, Obama did not have a disastrous debate performance. If he did, that would be reflected in the polls with his job approval sinking. It isn't. In fact, his job approval has gone steadily up in October. What happened in the first debate is that Romney looked credible after several months of being bashed by Bain Capital ads, discussion of Romney's tax returns, the conventions, and Romney's 47% comments. In the wake of all that, by the end of September, a certain number of voters (a small number but enough to make a difference) who do not care for President Obama were unsure they could support Governor Romney. When these voters saw Romney in the first debate, where he seemed, in a word, presidential, they simply went where they were likely to go in the first place. Polling says they were moving in that direction already. The first debate accelerated that. But it was underway. Some of you may remember that this is exactly the logic I outlined way back in early March when I asked whether Romney would be a credible alternative.
Importantly, there was no possibility that a "strong performance" by the President in that first debate was going to "close the sale." That's just utterly silly.
And let me add just one point to this. You might ask, why does it matter if Charlie Cook has it wrong? What's at stake in this? For starters, Andrew Sullivan, who spent more than a week on the ledge with some insane ideas about what happened in the debate is going to open that window up again and will start threatening to jump. This is sad because I enjoy reading Sullivan's blog and now I'll have to avoid it for another week or so. Second, and more importantly, this nonsensical meme has now infected some of the smarter, more reasonable minds in the journalist class, like Charlie Cook. Whether Obama wins or loses (though it will be worse if he loses), we'll hear this nonsense about how the President looked down too much during the first debate and that's why Romney caught up. It just isn't true.
Labels:
Andrew Sullivan,
Charlie Cook,
debates,
job approval
Subscribe to:
Posts (Atom)


