Why are these polls most of the time wrong ?

mapuc · 10-03-16, 01:25 PM

Some days ago I read online in a Danish News paper that a majority in Colombia is for this peace agreement and now today after this referendum the result is quite the opposite-50.2 % against this deal

That made me wonder, why are these polls most of the time wrong ?

Markus

Platapus · 10-03-16, 03:10 PM

First of all, I question your assertions that polls are wrong most of the time.

A properly designed and implemented poll should be representative on the average. That means that there WILL be times when the poll is not representative of the specific population

Since polling almost always involves trying to represent future human action, there is added complexity.

The polls may be constructed and implemented incorrectly (either deliberately or through negligence)

The polling population may not be representative of the desired population (think Dewey beats Truman)

People lie on polls if they believe they can influence future events.

People's opinions may change. If a population is polled six months before an election and the outcome of the actual election differs from the polling results, that may not be the fault of the poll.

Polling and voting are emotionally distinct and separate activities. Voting in done in private, polling is done in front of a person. A person may be reluctant to state their actual opinion face to face, but will not have such inhibitions when voting in private.

Polling and Surveys used to be my job back when I was a govie. It is a hard job designing and populating a survey/poll fairly. Not everyone is willing or capable of doing it correctly.

There are many reasons why a poll/survey can end up not accurately representing an actual future event. Predicting the future is hard.

And I have not even touched on the complexities of analyzing and generating the statistical results. That's a whole different matter.

Personally, I only look at the first number in the results. +/- 10 percent is, to me, probably even. Only if there is a 20-30% difference do I start to consider that there may actually be a difference.

I shake my head ruefully when the news media is comparing decimal percentages as being significant. Yikes!

fireftr18 · 10-03-16, 07:58 PM

I couldn't resist posting a link to this http://www.chicagotribune.com/news/n...ory-story.html

Many years ago, Lexington's local bus company put out a general survey and there were forms placed in the fire stations. All the questions were worded in such a way, that whichever way you answered, it was a positive answer supporting the position the company wanted. The company wanted the city government to increase funding at a time when the city was short on money.

I noticed a lot of polls are skewed to get the result wanted.

Jimbuna · 10-04-16, 05:51 AM

Here is a shining UK example:

The 2015 UK Elections: Why 100% of the Polls Were Wrong.

http://www.ftijournal.com/article/th...lls-were-wrong

10-03-16, 01:25 PM	#1
mapuc CINC Pacific Fleet Join Date: Sep 2003 Location: Denmark Posts: 20,537 Downloads: 37 Uploads: 0	Why are these polls most of the time wrong ? Some days ago I read online in a Danish News paper that a majority in Colombia is for this peace agreement and now today after this referendum the result is quite the opposite-50.2 % against this deal That made me wonder, why are these polls most of the time wrong ? Markus Last edited by mapuc; 10-03-16 at 02:01 PM.

10-03-16, 03:10 PM	#2
Platapus Fleet Admiral Join Date: Oct 2006 Posts: 19,361 Downloads: 63 Uploads: 0	First of all, I question your assertions that polls are wrong most of the time. A properly designed and implemented poll should be representative on the average. That means that there WILL be times when the poll is not representative of the specific population Since polling almost always involves trying to represent future human action, there is added complexity. The polls may be constructed and implemented incorrectly (either deliberately or through negligence) The polling population may not be representative of the desired population (think Dewey beats Truman) People lie on polls if they believe they can influence future events. People's opinions may change. If a population is polled six months before an election and the outcome of the actual election differs from the polling results, that may not be the fault of the poll. Polling and voting are emotionally distinct and separate activities. Voting in done in private, polling is done in front of a person. A person may be reluctant to state their actual opinion face to face, but will not have such inhibitions when voting in private. Polling and Surveys used to be my job back when I was a govie. It is a hard job designing and populating a survey/poll fairly. Not everyone is willing or capable of doing it correctly. There are many reasons why a poll/survey can end up not accurately representing an actual future event. Predicting the future is hard. And I have not even touched on the complexities of analyzing and generating the statistical results. That's a whole different matter. Personally, I only look at the first number in the results. +/- 10 percent is, to me, probably even. Only if there is a 20-30% difference do I start to consider that there may actually be a difference. I shake my head ruefully when the news media is comparing decimal percentages as being significant. Yikes! __________________ abusus non tollit usum - A right should NOT be withheld from people on the basis that some tend to abuse that right.

10-03-16, 07:58 PM	#3
fireftr18 Ocean Warrior Join Date: Feb 2010 Location: Kentucky Posts: 2,528 Downloads: 77 Uploads: 0	I couldn't resist posting a link to this http://www.chicagotribune.com/news/n...ory-story.html Many years ago, Lexington's local bus company put out a general survey and there were forms placed in the fire stations. All the questions were worded in such a way, that whichever way you answered, it was a positive answer supporting the position the company wanted. The company wanted the city government to increase funding at a time when the city was short on money. I noticed a lot of polls are skewed to get the result wanted. __________________ Of all the forms of Martial Arts, Karaoke causes the most pain!

10-04-16, 05:51 AM	#4
Jimbuna Chief of the Boat Join Date: Feb 2006 Location: 250 metres below the surface Posts: 190,500 Downloads: 63 Uploads: 13	Here is a shining UK example: The 2015 UK Elections: Why 100% of the Polls Were Wrong. http://www.ftijournal.com/article/th...lls-were-wrong __________________ Wise men speak because they have something to say; Fools because they have to say something. Oh my God, not again!!