Can Anyone Write a Questionnaire?
Two very significant things have happened over the past five years that are affecting the way smaller market research projects get done.
First, with companies constantly doing more with less, one of the departments most strained for human resources is the marketing department, and by association, the market research department -- so there is often an internal lack of expertise.
Also, new free survey websites, survey software or CRM applications give relative novices the capability to "do your own market research survey instantly." But, as so many learn the hard way, nothing in life is that easy.
As a market research supplier that works with clients with varying levels of expertise, what are some of the more
common mistakes we see in the questionnaire development process?
-
Questionnaire language error — the error made when the researcher uses incorrect language (ambiguous, leading, assumptive, etc) in the survey instrument so that respondents are influenced in their answers. Language errors severely limit the validity and usefulness of those questions and can be the cause of misleading analysis and results.
-
Questionnaire structure errors — the error made when the structure and layout of the survey instrument leads to inaccurate responses. For example, designing a brand awareness/perception questionnaire so that brand related questions are asked before unaided recall questions are asked, which will significantly impact unaided recall results. Another example is asking probing questions regarding viewpoints on potentially negative experiences before asking an overall satisfaction question, where overall satisfaction would
be incorrectly affected by the recent recall of potentially bad experience.
-
Questionnaire measurement/scale error
— the error that occurs when improper measurement and scaling techniques are used in the survey instrument. The right type of measurement/scaling question to use will depend upon the information being collected and the analysis that will be performed. A common example of a measurement error is not controlling order bias, which occurs when a list is not randomly rotated for a given question and respondents exhibit a tendency to select the first few answers from a list.
Top 3 Large Business Marketing Research Mistakes
-
Fully leveraging research – Larger businesses particularly are guilty of not fully leveraging their research investment. Simple advice:
get and keep as many people involved in the research as you can find. Don't be afraid to manage up or down and push your research efforts throughout the company. You will do better research, and it will be good for the company and your career.
-
Having a great strategy – If you take the advice above, you are 75 percent of the way there. Great strategy starts with great communication and understanding what your internal customers (coworkers) want and need from your research. Very consciously try to fulfill those wants and needs, and thereby keep everyone engaged and using your work.
-
Overpaying for research – Recent improvements in questionnaire delivery and results distribution can translate into cost savings.
For your ongoing programs, refresh and revise them regularly to make sure they are running as cost efficiently and effectively as possible. While you are doing that, take a moment to realign them to your strategy!
|