The following is important general information on questionnaires; for
more detailed instructions on writing questions go to
http://www2.hn.psu.edu/faculty/jmanis/quest_1.htm.
Presenting an Attractive QuestionnaireOne of the best routes to take is to have your questionnaire done using desktop publishing software. It will look like it was typeset by a professional printer. The result may so impress your readers that it could improve your chances of having them respond. Also consider having the questionnaire copied on attractive paper. Undoubtedly, a questionnaire printed on a faded mimeo sheet or on a copying machine that leaves smudges will not invite quick replies, if any. Avoid reducing the size of your questionnaire on a copying machine in an attempt to save space; the small print will be hard to read and also intimidating. Use plenty of white space, which wil be pleasing to the respondents' eyes. Proofread meticulously. Also make sure that your questionnaire contains a title, a place for the respondent's name, if desired, and instructions. Distributing a QuestionnaireOnce you are sure that the questionnaire is right, deliver or mail it to your respondents. Decide which approach is more feasible. Delivering the questionnaire in person may create goodwill and my increase your chances of receiving a completed questionnaire back from these individuals. However, when you think a personal visit might influence the content of a reader's response, mail your questionnaire. In any case, make sure your questionnaire reaches respondents at times convenient for them, not just for you. Do not give questionnaires to respondents when other commitments prevent their answering you. For example, students preparing for final or state board examinations will not postpone their studies to fill out your questionnaire. Some large companies close for two weeks in the summer and give all employees and supervisors a vacation. Sending a questionnaire to anyone just before or during that shutdown would be pointless. Asking for comleted questionnaires around the Christmas holidays is equally ill advised. If you are aware that respondents will be on vacation, busy, or out of town on business, send your questionnaire at another time. If you mail your questionnaire, send it by first-class mail and include a stamped, self-addressed envelope. Respondents are far more likely to answer when you make it as easy as possible for them. Make certain that the respondents'names and addresses are correct. People will not be inclined to respond if you spell their names incorrectly or if you address someone with a Mr. When that person is a Ms., or vice versa. Some given names (Pat, Leslie, Terry) apply to both men and women. If you are uncertain, omit the courtesy title and write "Dear Pat Hayes" or "Dear Terry Bronti." When you mail the questionnaire, enclose a cover letter and follow these procedures.
Tabulating ResponsesTallying by HandIf you are using a small number of respondents for a school or a civic project, or if you lack access to a computer, you will have to tabulate by hand. Your record keeping will be relatively easy if you follow a consistent and orderly system for listing and categorizing information. One good method is to buy a yellow, legal-size note pad and use a separate tally sheet for each question on your questionnaire. Write the question and its number at the top of the sheet; directly beneath the question, list horizontally the options (the range of choices) that the question offers. For dichotomous questions you will have two columns; for multiple-choice, as many columns as there are choices. Be sure to include the category "no response" in a separate column. If respondents give two contradictory answers to one question, indicate "no response" (N. R.) in your tally since you do not know which answer was intended.The use of separate tally sheets for each question offers these advantages.
Coding and tabulating open-ended questions may present problems. You will have to make option columns as you go along, but still impose some type of manageable limits on these comments that most relevantly answer the questions. Those comments may be buried n useless remarks; the highlighter pen will make the most relevant remarks stand out. A different color highlighter pen can be used to identify statements you foresee quoting directly in your report, thus making them easier to find later. Look for patterns of similar responses
so you can count the number of times similar comments are made. An open-ended
question completed by all of your respondents might elicit several clusters
of closely related responses.
Tallying by ComputerIf the number of your respondents is large and your employer has decided to tabulate their answers by computer, consult someone in the computer department during the design stage of your questionnaire and before you start to categorize responses. A computer consultant can suggest different ways of coding options to your questionaire so that the computer will help you to assess the responses properly and quickly. Responses may be translated into numerical or alphabetical symbols to represent various responses.For smaller projects, if you have basic keyboarding skills, access to personal computer, and even a modest knowledge of computer applications, you can use valuable software technology to your advantage. Two common types of software you can use are spreadsheets and database systems. A spreadsheet allows you to arrange data in rows and columns much like the tally sheet used for manual tabulations. Spreadsheets also enable you to make basic arithmetic calculations from data. These calculations might include totals for such questionnaire items as the number of male and female respondents or the number (and percentage) of respondents who answered "yes" or "no" to a dichotomous question. Where averages are important in your research, spreadsheets can help you to calculate them, too. Spreadsheets do not, however, allow for sophisticated statistical analyses. Yet their "number crunching" capabilities will help you to tabulate even large data sets with ease. Database programs are computerized filing systems in which you can record separate pieces of information about the individuals who respond to your questionnaire. For example, for each respondent a database could record such characteristics as sex, age, education, as well as responses to specific questions. The database can be useful when your questionnaire relies on open-ended questions. In those cases, each respondent's verbatim response can be stored in his or her own database entry. Database software also allows you to sort through entries. For example, if you wish to examine open-ended responses by males to a particular question, the database application could give you a printout of all the answers by male respondents. Some software publishers offer integrated applications that include word processor, spreadsheet, and database systems. These integrated packages enable you to move information from one type of application to another. In the case of the database example above, suppose that you wanted to reproduce all of the open-ended responses given by men and women as separate appendices in your report. An integrated software package would allow you to copy information from the database to the word processor. The software described here is relatively easy to use and can save you much time and effort. It comes in a wide range of prices as well. Some applications are even available free as shareware, or public domain software. |
Selecting RespondentsTo how many people must you send a questionnaire
in order to obtain reliable results? The answer depends on your statistics.
If you are interested in finding out how technicians in a particular hospital
feel about rotating shifts, then your respondents would be all the technicians
in that one hospital. Similarly, if you want to determine whether your
sorority chapter should have a barbeque or dance at the end of the spring
term, you would question every member of your chapter. But your respondents
may not always belong to such a limited and easily accessible group. Many
times you will have to consider a larger audience whose members could not
all be reached and questioned individually. You might want to find out
how customers at a certain store feel about a warehouse branch that would
sell merchandise at a reduced rate. Certainly you could not question everyone
who shops at this store. Or you might be interested in surveying how a
certain profession (dairy farmers, dietitians, medical secretaries) would
react to a piece of impending legislation. Being unable to question everyone
in a particular profession, you would use some form of sampling.
Systematic Random SamplingThe most respected, and valid, way of finding respondents is to follow a systematic random sampling technique. Much marketing research is done this way. According to this technique, you choose your target audience or population (all the nurses in your hometown, all the students attending your college, all holders of credit cards from a department store), and from this large target population you obtain a cross section by selecting names at random from the group. A random sampling is not like picking names out of a hat. It is far more systematic and fair. For example, from a college directory listing the names of all students enrolled at your school you can choose by random selection every tenth name or, for a smaller margin of error, every fifth name. Thus all respondents (all students listed in the school directory) have an equal chance of being selected for your sample. This equal chance is the heart of the random sampling technique.Citing another example, let's say that you wanted to find out the customers' preferences for shopping hours at your store. You could stand outside the store and ask everyone who happens to walk by. However, you might talk to people who are visitors to your town and who never have or never will shop at the store, or you could select residents of the town who just stopped to avoid the rain and who never have shopped at the store. To obtain a cross section of those who in fact are customers of the store, you must select as your target population those who are on record as having purchased goods from the store. Perhaps their names are on recrod as credit card holders. You could then go through the store's list of credit card holders and by random selection pick out names of individuals to whom you will send your questionnaire. Another way to get a statistically valid
sample is to pick names randomly out of the residential listings of your
town's telephone book. This selection technique would be a good one if
you wanted to find out how a relatively small town or suburb (under 30,000
people felt about a bond proposal or welfare services. The important point
to remember is that the selection process must be systematic and allow
each member of the population (in this case, all those individuals listed
in the telephone book) an equal chance of being selected.
Stratified Random SamplingAnother valid sampling technique is known as stratified random sampling. This approach is used when you have a number of different groups or subgroups to question; it means that you survey each group proportionately. For example, say you want to determine opinion about facilities at a college that was formerly for women only. Today the student body is composed of 70percent women and 30 percent men. To obtain a fair cross section of thse two groups, you need to question each group according to the same percentage it occupies in the college population. Accordingly, if you sent questionnaires to 100 students, you would make sure that 70 questionnaires went to women and 30 to men to reflect the enrollment percentages at the college.Quota SamplingStill another type of sampling technique is know as quota sampling. Use this technique with great care. Here you choose an audience almost as one would select a quota. You might question the first twenty-five males and first twenty-five females you meet. Such a sampling might be helpful if, for example, it consisted of customers in a store who all saw a demonstration of a dishwasher, and you wanted to get their opinions of that dishwasher. The population is chosen arbitrarily and not selected as carefully as it would be with random sampling, but such a group can help answer your questions, since everyone has seen the product. The problem with quota sampling is that it can lead to a distorted sample in many circumstances. If you wanted to poll student opinion about a campus radio station and all you did was ask for the opinion of ten of your friends who you knew did not like the station, your sample would be biased. These ten friends are a homogeneous (presorted) group that may not truly represent the view of the student body.The Ten Commandments for writing good questions, click Ten. For a discussion on writing a report based on your questionnaire, click here.For information on writing reports on your questionnaires, go to http://www2.hn.psu.edu/faculty/jmanis/s_report.htm |