With the presidential primaries in full swing, we are being inundated with constant political analysis and poll results. Polling is mostly a science, but even when done correctly, the interpretations are often suspect. There are lots of problems with polling, but here are three serious issues to consider when digesting the next one.<\/p>\n
1. Did the pollsters ask questions that respondents could readily answer? <\/em>Most exit polls pass this test because they ask voters how they voted and why. Assuming they tell the truth\u2014or that the lies are evenly distributed among the candidates\u2014polls like this are generally reliable if those sampled are representative of the voters at large. If not, the problems are obvious. For example, a poll of younger Democrats would suggest strong support for Sanders while a poll of older Democrats would favor Clinton. Respectable pollsters usually ensure that this is done correctly, although minor errors can result in inaccurate predictions, especially in close races. This is why results can vary widely in polls deemed to be scientific.<\/p>\n Polls that assess hypothetical head-to-head matchups do not pass this test. Likely voters are asked how they would vote given all of the scenarios and the results are supposed to suggest which candidates have the best chance of winning in November. The problems with this approach are legion. It\u2019s not uncommon for voters with a strong primary preference to claim that they will \u201csit out\u201d the November election if their candidate isn\u2019t the nominee, or possibly crossover to the other party. So much can and will happen in the next eight months that polling hypothetical preferences today is a waste of time.<\/p>\n 2. Are the questions worded properly?<\/em> A pollster with a political ax to grind can modify a word or phrase, or not<\/em> ask a particular question to paint a skewed picture of reality. For example, if you ask Americans if they favor gun control, you\u2019ll likely get some yes answers from largely pro-gun individuals because they support some<\/em>, notion of gun control (perhaps convicted felons or the mentally ill). Ask them if they support gun rights, and some largely pro-gun control individuals will likely answer yes because they favor some<\/em> rights (perhaps hunting rifles). Organizations with a given political position often choose the wording in such instances as a means of influencing public opinion.<\/p>\n 3. Are the responses properly interpreted and reported? <\/em>This isn\u2019t always easy to do, but many reporters and analysts simply don\u2019t understand the science or are willingly misleading their audiences. A simple example is the reporting of gender and ethnicity \u201cgaps\u201d with certain political candidates. Pundits are constantly telling us that Republicans have a problem attracting women voters. Given the rough 50\/50 split between women and men and the general balance of power in Washington, it is just as accurate to say that Democrats have a problem attracting men voters. This is rarely suggested, however, because such a conclusion doesn\u2019t follow a predetermined narrative.<\/p>\n A subtler example can be found in recent polls concerning why Republican primary voters select a particular candidate. We are told that those who are most concerned about winning in November overwhelmingly support Rubio, but the evidence is really weak. Voters are typically asked who they selected (or will select) and why. The fact that Rubio voters are more likely than Trump or Cruz voters to identify prospects for winning the general election as the top reason for their vote doesn\u2019t necessarily<\/em> mean that Trump or Cruz voters aren\u2019t equally convinced that their candidates can win. Indeed, Trump voters are more likely to suggest preference for an outsider as the top reason, but most probably think that their candidate has the best chance of winning in November as well; it\u2019s just not the overriding reason they selected Trump. It could be that Rubio voters don\u2019t really like him very much as a candidate except<\/em> that they think he has the best chance of winning in November. We are supposed to believe that supporting Rubio is the best choice if \u201cwe really want to beat Hillary,\u201d but the alternative explanation I just proposed paints Rubio as a lukewarm choice with a less-than-energetic base of support, thereby making him a less desirable candidate in November. Frankly, I\u2019m not sure which explanation is most accurate, but I\u2019m willing to put both explanations on the table.<\/p>\n I\u2019m not anti polls, but I\u2019m tired of their prominence in lead stories. They are fraught with problems. Most reporters either understand this reality and choose to overlook it or they they don\u2019t fully understand what they\u2019re reporting. Frankly, I think the issue with most is ignorance, but either way we have a serious problem.<\/p>\n","protected":false},"excerpt":{"rendered":" With the presidential primaries in full swing, we are being inundated with constant political analysis and poll results. Polling is mostly a science, but even when done correctly, the interpretations are often suspect. There are lots of problems with polling, but here are three serious issues to consider when digesting the next one. 1. Did […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/battle4liberty.com\/index.php?rest_route=\/wp\/v2\/posts\/978"}],"collection":[{"href":"https:\/\/battle4liberty.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/battle4liberty.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/battle4liberty.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/battle4liberty.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=978"}],"version-history":[{"count":0,"href":"https:\/\/battle4liberty.com\/index.php?rest_route=\/wp\/v2\/posts\/978\/revisions"}],"wp:attachment":[{"href":"https:\/\/battle4liberty.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=978"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/battle4liberty.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=978"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/battle4liberty.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=978"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}