How do I Get Accurate Survey Data?
Posted in Ask the Expert, Info for New Marketers, Main Content on 06/24/2009 07:24 am by adminMany of you have asked us,
How do I make sure respondents are giving me accurate information?
Getting accurate information is critical. The truth is that most of the time, unless you’re asking about really sensitive topics, customers won’t lie. So for most of the topics we’re likely to cover in business surveys, we really don’t have to worry a lot about them deliberately deceiving us, except when it comes to questions such as income.
But there’s a lot more to it than just whether our customers are consciously lying in surveys.
- We have to worry about whether their responses have a “positive skew” or “negative skew:” In other words, whether customers are saying they like a product more than they really do or dislike it more than they really do.
- We have to worry about whether they really READ the question and THOUGHT about an answer, as opposed to just “flying through” the survey and randomly marking things.
- We have to worry about whether they had “response set,” where they keep marking “agree/strongly agree” through a whole run of questions.
The list of ways that inaccuracies creep in goes on and on. And we need to worry about this, because if we don’t get accurate information, we have “bias” in our data. And that can lead to bad decisions that cost us money.
How do we combat these problems? How do we really “get inside our customers’ heads” so we can create and sell the products they want and get the proof we need to convert prospects?
Well, there are LOTS of ways to do that. The best way, bottom line, is to write a good survey.
Here are some more specific tips:
- I think that the absolutely most important thing here is to write good, clear questions and tell them how you’re going to use the data to give them more value.
- Be respectful of their time: One reason people “fly through” a survey without reading it carefully is because it’s too long, too disorganized, or poorly written. Show them you’ve taken the time to write good questions, organize them well, and walk them through it with transitions.
- To avoid “response set,” in which people just keep checking the same answers, vary the way you ask questions. In other words, if you have a series of statements and you’re asking to choose options from strongly agree to strongly disagree, word some of the statements “positively” (“I liked the ___) and some negatively (“I thought the ___ was too long).
- Explain to your customers WHY you need to know something, show them how you’ll put the information to work for THEM, and assure them that the information won’t just be turned into an immediate attempt to sell them something. That will increase cooperation and accuracy dramatically.
- It’s also critical to ensure that their answers are completely confidential; customers are VERY concerned about data encryption in surveys, for good reason.
If you follow these guidelines, you’ll go a long way toward getting data you can use to take your business to the next level.





