|
Good write up Mr. Poopy
I think what Mr. Hydrogen discusses is bias. There are signs that it is becoming harder and harder for pollsters to maintain standards regarding bias.
My points are not so much about the stats themselves but with the political assumptions, because those are creating what other signs are strongly suggesting to be very significant bias. An easy example is how the pollsters this cycle typically weight for 2012 demographics, yet no non-stupid assessment of the political landscape would suggest that Clinton can reasonably be expected to get the 2012 turnout. The reason pollsters are doing this appears to be either (1) they don't know what else to do or (2) they're playing their part as a persuasion tool for Her Majesty. If I'm completely honest, I think some of it is the latter (and in subtle ways) but most of it has elements of the former. 2012 demos is the best of the not-hard ways to do it. Since polling is an inherently conservative practice, there is little going outside of the box.
Which brings us to my next point. It's regarding your point yesterday about your concern regarding the USC poll methodology. My interpretation is that they are thinking outside of the box in an attempt to more correctly predict "likely voters." This team's comparative advantage can be thought of as their innovation. They did some things differently in 2012 and got very fantastic results. Many signs are pointing towards the turnout modeling for 2016 likely looking nothing like 2012, so they're trying to predict that best they can.
Another point is that sometimes some pollsters have achieved fantastic results by merely not weighting for some standard variables. Ann Selzer, for example, was lauded as the best pollster alive since her polls blew all the others out of the water in the 2012 primaries. Her brief explanation for why she caught the trends better than anybody else was that she merely reported what the respondents were telling her. Instead of assuming the Iowa caucus would look similar in demos to the previous ones, she reported her poll with as few weights as she could. Lo and behold, this gave her a much more accurate measure of the turnout because it allowed her to catch what could probably be called an enthusiasm shift.
This cycle we have seen several polls with unweighted data showing Trump ahead but then the pollsters weight for 2012 demos and it shows him significantly behind. I do not know why pollsters don't release their polls with various assumptions. They should do something like release each of their polls with one iteration as 2012 demos, one a little closer to response demos, and probably one with predicted demos based on other variables. The latter would be an attempt to include things like the shy Tory effect or evaluating what the change in primary turnout means. Regarding just these two, there are very likely a bunch of blue collar men that typically do not respond to polls and don't vote, yet are going to vote this time; and a state like New Hampshire can be predicted to fall more to the right than polling suggests due to changes in its primary turnout numbers from 2008 to 2016.
My last point is going back to Mr. Hydrogen. Even though he shows that polling accuracy has slightly increased, the reason why includes techniques that create a reduction in predictive power during "off" cycles. Polls are getting more accurate by weighting more accurately, yet they're only able to weight more accurately because there has been little political realignment. We are very likely looking at a political realignment year. New Jersey and Rhode Island have polled within the margin of error ffs iirc. Pennsylvania alone is in a very unique, tip of the iceberg situation. Solid analyses have shown that the state is trending red rather swiftly even though on the surface it went for Obama twice. It just so happens that what Trump targets is exactly where the redness has been coming from. It is quite reasonable to predict that we are looking at a solid probability of the "blue wall" breaking, but as long as pollsters assume that doing the same thing they've always been doing is the way to go, they're not going to catch it before it happens.
|