January 29, 2004 | Premier Issue
 
 
  Home Services Data Collection Education About Us

Editor's Note

 
 

MR Perspectives is a newsletter providing perspectives on market research topics of interest, best practices, tips, emerging trends, quick case studies, and other useful information.

Subscribe
View Past Issues

   

Events

 
 
February 5-6, 2004 Phoenix, AZ

February 12-13, 2004 San Francisco, CA

Marketing Research BOOT CAMP™

The AMA sponsors these highly interactive programs for seasoned marketers who need a refresher or marketers who are new to the profession. The program covers researching the 4 P’s, conducting and evaluating a research project, alternative research approaches, basics of sampling, questionnaire design and more.  For Details

   
February 19-20, 2004 New York City 
Project Directors Training Conference 

This CASRO training program addresses study design, questionnaire design, sampling, and report writing for project directors and marketing analysts who have less than two years of experience in research. Participants will break down into smaller groups on Day 2.

New at Polaris

 
 
News

Polaris Vice President Lucy Klausner has been elected to a three-year term on the board of directors for the Council of American Survey Research Organizations (CASRO). She is one of two board members selected to represent companies with an annual research volume of under $5 million.
Subscribe 

   
 
 

Can Anyone Write a Questionnaire?

Two very significant things have happened over the past five years that are affecting the way smaller market research projects get done. 

First, with companies constantly doing more with less, one of the departments most strained for human resources is the marketing department, and by association, the market research department -- so there is often an internal lack of expertise. 

Also, new free survey websites, survey software or CRM applications give relative novices the capability to "do your own market research survey instantly." But, as so many learn the hard way, nothing in life is that easy. 

As a market research supplier that works with clients with varying levels of expertise, what are some of the more common mistakes we see in the questionnaire development process? 

  • Questionnaire language error — the error made when the researcher uses incorrect language (ambiguous, leading, assumptive, etc) in the survey instrument so that respondents are influenced in their answers. Language errors severely limit the validity and usefulness of those questions and can be the cause of misleading analysis and results.

  • Questionnaire structure errors — the error made when the structure and layout of the survey instrument leads to inaccurate responses. For example, designing a brand awareness/perception questionnaire so that brand related questions are asked before unaided recall questions are asked, which will significantly impact unaided recall results. Another example is asking probing questions regarding viewpoints on potentially negative experiences before asking an overall satisfaction question, where overall satisfaction would be incorrectly affected by the recent recall of potentially bad experience.

  • Questionnaire measurement/scale error — the error that occurs when improper measurement and scaling techniques are used in the survey instrument. The right type of measurement/scaling question to use will depend upon the information being collected and the analysis that will be performed. A common example of a measurement error is not controlling order bias, which occurs when a list is not randomly rotated for a given question and respondents exhibit a tendency to select the first few answers from a list. 

Top 3 Large Business Marketing Research Mistakes 

  • Fully leveraging research – Larger businesses particularly are guilty of not fully leveraging their research investment. Simple advice: get and keep as many people involved in the research as you can find. Don't be afraid to manage up or down and push your research efforts throughout the company. You will do better research, and it will be good for the company and your career.

  • Having a great strategy – If you take the advice above, you are 75 percent of the way there. Great strategy starts with great communication and understanding what your internal customers (coworkers) want and need from your research. Very consciously try to fulfill those wants and needs, and thereby keep everyone engaged and using your work.

  • Overpaying for research – Recent improvements in questionnaire delivery and results distribution can translate into cost savings. For your ongoing programs, refresh and revise them regularly to make sure they are running as cost efficiently and effectively as possible. While you are doing that, take a moment to realign them to your strategy!