English 202D

Assignment #7: Questionnaires

Instructor: Jim Manis

E-mail: jdm12@psu.eduThis file can be found at http://www2.hn.psu.edu/faculty/assign.htm

The following is important general information on questionnaires; for more detailed instructions on writing questions go to
http://www2.hn.psu.edu/faculty/jmanis/quest_1.htm.

The fifth edition of Successful Writing at Work has, as you know, no section on questionnaires. This was a very important part of earlier editions, and constructing good questionnaires is still an important part of the business writer's repertory. Therefore, I have taken the liberty of reproducing a major portion of this text here. Unless otherwise noted, what follows is taken from the 4th edition of Successful Writing at Work by Philip Kolin, published by D.C. Heath and Company, 1994.
 

Presenting an Attractive Questionnaire

The visual impression your questionnaire makes may determine whether or not respondents complete it. If your questionnaire looks sloppy and is difficult to read and follow, respondents will not bother with it. Therefore, strive to make you questionnaire neat, clear, and easy to read and answer.

One of the best routes to take is to have your questionnaire done using desktop publishing software. It will look like it was typeset by a professional printer. The result may so impress your readers that it could improve your chances of having them respond. Also consider having the questionnaire copied on attractive paper. Undoubtedly, a questionnaire printed on a faded mimeo sheet or on a copying machine that leaves smudges will not invite quick replies, if any. Avoid reducing the size of your questionnaire on a copying machine in an attempt to save space; the small print will be hard to read and also intimidating. Use plenty of white space, which wil be pleasing to the respondents' eyes. Proofread meticulously. Also make sure that your questionnaire contains a title, a place for the respondent's name, if desired, and instructions.

Distributing a Questionnaire

Before submitting your questionnaire to respondents, have someone evaluate it. Ask a student in your major, a teacher or a coworker to read your questionnaire and tell you whether any of your questions are vague, misleading, or irrelevant. You should pretest your questionnaire on a small representative sample of the larger group you want to survey. Have these individuals pay particular attention to the options you list for multiple-choice questions; make sure that the options are reasonable and sufficient. Such screening may take a few days, but in the long run you will save time and energy. If you send out a questionnaire flawed by poorly worded or irrelevant questions, the answers you receive wil be of dubious value. You will have to redo the questionnaire, or you may find yourself busy explaining the questions verbally to respondents who call you for help.

Once you are sure that the questionnaire is right, deliver or mail it to your respondents. Decide which approach is more feasible. Delivering the questionnaire in person may create goodwill and my increase your chances of receiving a completed questionnaire back from these individuals. However, when you think a personal visit might influence the content of a reader's response, mail your questionnaire. In any case, make sure your questionnaire reaches respondents at times convenient for them, not just for you. Do not give questionnaires to respondents when other commitments prevent their answering you. For example, students preparing for final or state board examinations will not postpone their studies to fill out your questionnaire. Some large companies close for two weeks in the summer and give all employees and supervisors a vacation. Sending a questionnaire to anyone just before or during that shutdown would be pointless. Asking for comleted questionnaires around the Christmas holidays is equally ill advised. If you are aware that respondents will be on vacation, busy, or out of town on business, send your questionnaire at another time.

If you mail your questionnaire, send it by first-class mail and include a stamped, self-addressed envelope. Respondents are far more likely to answer when you make it as easy as possible for them. Make certain that the respondents'names and addresses are correct. People will not be inclined to respond if you spell their names incorrectly or if you address someone with a Mr. When that person is a Ms., or vice versa. Some given names (Pat, Leslie, Terry) apply to both men and women. If you are uncertain, omit the courtesy title and write "Dear Pat Hayes" or "Dear Terry Bronti."

When you mail the questionnaire, enclose a cover letter and follow these procedures.

  1. Introduce yourself and tell why you are writing.
  2. Explain the significance of the topic of our questionnaire.
  3. Emphasize how important the respondent's answers are.
  4. Tell what benefits the respondent can gain by answering your questionnaire - the most important function of the letter.
  5. Discuss the kind of questionnaire you have devised.
  6. Ask that the questionnaire be returned by a specified date.
  7. Perhaps promise a gift for returning the questionnaire or even send a gift along with the questionnaire. A coupon, a crisp dollar bill, or a donation to the respondent's favorite charity can improve your rate of return.
  8. Thank the respondent and promise, if practical to do so, to inform him or her of the outcome.
Depending on your topic and the questionnaire you have constructed, you may also want to assure respondents that their answers will remain confidential. Or you might want to romise them anonymity. Not being required to sign their names, respondents will not worry that anyone, including you, knows what they have answered.
 

Tabulating Responses

A new phase of your research begins with the return of your questionnaire. You will have to count the completed questionnaires and keep a record of specific responses. Tallying is an important link between the questionnaire and the report; a mistake here can distort (or defeat) all your other efforts.
 

Tallying by Hand

If you are using a small number of respondents for a school or a civic project, or if you lack access to a computer, you will have to tabulate by hand. Your record keeping will be relatively easy if you follow a consistent and orderly system for listing and categorizing information. One good method is to buy a yellow, legal-size note pad and use a separate tally sheet for each question on your questionnaire. Write the question and its number at the top of the sheet; directly beneath the question, list horizontally the options (the range of choices) that the question offers. For dichotomous questions you will have two columns; for multiple-choice, as many columns as there are choices. Be sure to include the category "no response" in a separate column. If respondents give two contradictory answers to one question, indicate "no response" (N. R.) in your tally since you do not know which answer was intended.

The use of separate tally sheets for each question offers these advantages.

  1. You are better able to tabulate, organize, and summarize responses for each question, since all answers to that question are on one sheet.
  2. You can more easily check responses against individual questionnaires, since each response is coded by identification and question number.
  3. You have the flexibility of comparing responses to various questions by simply pulling tally sheets for these questions and laying the sheets side by side.
  4. You have a record of the number of questionnaires returned by any specific date.
  5. You can conveniently keep a running tally and will not have to wait until all questionnaires are in to begin counting.
With a separate tally sheet for each question, you will be ready to tabulate responses. When a questionnaire comes in, assign it a code number. The first questionnaire to be returned could be labeled 01, the second 02, the third 03 and so forth. List the identifying numbers (and the names of respondents, if requested, after the numbers) vertically on the left-hand side of each tally sheet. Then, as you check each questionnaire in, you can record a respondent's answer to an individual question in the correct column on the appropriate tally sheet.

Coding and tabulating open-ended questions may present problems. You will have to make option columns as you go along, but still impose some type of manageable limits on these comments that most relevantly answer the questions. Those comments may be buried n useless remarks; the highlighter pen will make the most relevant remarks stand out. A different color highlighter pen can be used to identify statements you foresee quoting directly in your report, thus making them easier to find later.

Look for patterns of similar responses so you can count the number of times similar comments are made. An open-ended question completed by all of your respondents might elicit several clusters of closely related responses.
 

Tallying by Computer

If the number of your respondents is large and your employer has decided to tabulate their answers by computer, consult someone in the computer department during the design stage of your questionnaire and before you start to categorize responses. A computer consultant can suggest different ways of coding options to your questionaire so that the computer will help you to assess the responses properly and quickly. Responses may be translated into numerical or alphabetical symbols to represent various responses.

For smaller projects, if you have basic keyboarding skills, access to personal computer, and even a modest knowledge of computer applications, you can use valuable software technology to your advantage.

Two common types of software you can use are spreadsheets and database systems. A spreadsheet allows you to arrange data in rows and columns much like the tally sheet used for manual tabulations. Spreadsheets also enable you to make basic arithmetic calculations from data. These calculations might include totals for such questionnaire items as the number of male and female respondents or the number (and percentage) of respondents who answered "yes" or "no" to a dichotomous question. Where averages are important in your research, spreadsheets can help you to calculate them, too. Spreadsheets do not, however, allow for sophisticated statistical analyses. Yet their "number crunching" capabilities will help you to tabulate even large data sets with ease.

Database programs are computerized filing systems in which you can record separate pieces of information about the individuals who respond to your questionnaire. For example, for each respondent a database could record such characteristics as sex, age, education, as well as responses to specific questions. The database can be useful when your questionnaire relies on open-ended questions. In those cases, each respondent's verbatim response can be stored in his or her own database entry. Database software also allows you to sort through entries. For example, if you wish to examine open-ended responses by males to a particular question, the database application could give you a printout of all the answers by male respondents.

Some software publishers offer integrated applications that include word processor, spreadsheet, and database systems. These integrated packages enable you to move information from one type of application to another. In the case of the database example above, suppose that you wanted to reproduce all of the open-ended responses given by men and women as separate appendices in your report. An integrated software package would allow you to copy information from the database to the word processor.

The software described here is relatively easy to use and can save you much time and effort. It comes in a wide range of prices as well. Some applications are even available free as shareware, or public domain software.

Selecting Respondents

Once you have restricted your topic and have determined who will read the results of your questionnaire and why you will have a better idea about the kinds of individuals you need to question. To receive useful answers, you have to exercise great cae in selecting your respondents; you cannot do it haphazardly. Finding appropriate respondents for extremely technical questionnaires involves sophisticated sampling strategies far beyond [our] · scope. Texts on statistics and audience surveys contain detailed instructions explaining the specialized methods used by pollsters such as George Gallup or Lou Harris; such pollsters can survey small sections of the population and predict outcomes with less than a two percent margin of error. Although not offering this kind of statistical information on sampling techniques, the following discussion does suggest guidlines you can follow when selecting respondents.

To how many people must you send a questionnaire in order to obtain reliable results? The answer depends on your statistics. If you are interested in finding out how technicians in a particular hospital feel about rotating shifts, then your respondents would be all the technicians in that one hospital. Similarly, if you want to determine whether your sorority chapter should have a barbeque or dance at the end of the spring term, you would question every member of your chapter. But your respondents may not always belong to such a limited and easily accessible group. Many times you will have to consider a larger audience whose members could not all be reached and questioned individually. You might want to find out how customers at a certain store feel about a warehouse branch that would sell merchandise at a reduced rate. Certainly you could not question everyone who shops at this store. Or you might be interested in surveying how a certain profession (dairy farmers, dietitians, medical secretaries) would react to a piece of impending legislation. Being unable to question everyone in a particular profession, you would use some form of sampling.
 

Systematic Random Sampling

The most respected, and valid, way of finding respondents is to follow a systematic random sampling technique. Much marketing research is done this way. According to this technique, you choose your target audience or population (all the nurses in your hometown, all the students attending your college, all holders of credit cards from a department store), and from this large target population you obtain a cross section by selecting names at random from the group. A random sampling is not like picking names out of a hat. It is far more systematic and fair. For example, from a college directory listing the names of all students enrolled at your school you can choose by random selection every tenth name or, for a smaller margin of error, every fifth name. Thus all respondents (all students listed in the school directory) have an equal chance of being selected for your sample. This equal chance is the heart of the random sampling technique.

Citing another example, let's say that you wanted to find out the customers' preferences for shopping hours at your store. You could stand outside the store and ask everyone who happens to walk by. However, you might talk to people who are visitors to your town and who never have or never will shop at the store, or you could select residents of the town who just stopped to avoid the rain and who never have shopped at the store. To obtain a cross section of those who in fact are customers of the store, you must select as your target population those who are on record as having purchased goods from the store. Perhaps their names are on recrod as credit card holders. You could then go through the store's list of credit card holders and by random selection pick out names of individuals to whom you will send your questionnaire.

Another way to get a statistically valid sample is to pick names randomly out of the residential listings of your town's telephone book. This selection technique would be a good one if you wanted to find out how a relatively small town or suburb (under 30,000 people felt about a bond proposal or welfare services. The important point to remember is that the selection process must be systematic and allow each member of the population (in this case, all those individuals listed in the telephone book) an equal chance of being selected.
 

Stratified Random Sampling

Another valid sampling technique is known as stratified random sampling. This approach is used when you have a number of different groups or subgroups to question; it means that you survey each group proportionately. For example, say you want to determine opinion about facilities at a college that was formerly for women only. Today the student body is composed of 70percent women and 30 percent men. To obtain a fair cross section of thse two groups, you need to question each group according to the same percentage it occupies in the college population. Accordingly, if you sent questionnaires to 100 students, you would make sure that 70 questionnaires went to women and 30 to men to reflect the enrollment percentages at the college.
 

Quota Sampling

Still another type of sampling technique is know as quota sampling. Use this technique with great care. Here you choose an audience almost as one would select a quota. You might question the first twenty-five males and first twenty-five females you meet. Such a sampling might be helpful if, for example, it consisted of customers in a store who all saw a demonstration of a dishwasher, and you wanted to get their opinions of that dishwasher. The population is chosen arbitrarily and not selected as carefully as it would be with random sampling, but such a group can help answer your questions, since everyone has seen the product. The problem with quota sampling is that it can lead to a distorted sample in many circumstances. If you wanted to poll student opinion about a campus radio station and all you did was ask for the opinion of ten of your friends who you knew did not like the station, your sample would be biased. These ten friends are a homogeneous (presorted) group that may not truly represent the view of the student body.
 

The Ten Commandments for writing good questions, click Ten.

For a discussion on writing a report based on your questionnaire, click here.

For information on writing reports on your questionnaires, go to http://www2.hn.psu.edu/faculty/jmanis/s_report.htm