On This Page:ToggleClosed QuestionsOpen QuestionsQuestionnaire DesignEthical IssuesProblems with Postal QuestionnairesBenefits of a Pilot StudyFrequently Asked Questions
On This Page:Toggle
On This Page:
Questionnaires provide a relatively cheap, quick, and efficient way of obtaining large amounts of information from a large sample of people.
A questionnaire in research is a structured set of questions designed to gather information from respondents. It’s used to collect quantitative or qualitative data on subjects’ opinions, behaviors, or characteristics.
Data can be collected relatively quickly because the researcher would not need to be present when completing the questionnaires. This is useful for large populations when interviews would be impractical.
However, a problem with questionnaires is that respondents may lie due to social desirability. Most people want to present a positive image of themselves, and may lie or bend the truth to look good, e.g., pupils exaggerate revision duration.
Questionnaires can effectively measure relatively large subjects’ behavior, attitudes, preferences, opinions, and intentions more cheaply and quickly than other methods.
Often, a questionnaire uses both open and closed questions to collect data. This is beneficial as it means bothquantitative and qualitative datacan be obtained.
Closed Questions
A closed-ended question requires a specific, limited response, often “yes” or “no” or a choice that fit into pre-decided categories.
Data that can be placed into a category is called nominal data. The category can be restricted to as few as two options, i.e., dichotomous (e.g., “yes” or “no,” “male” or “female”), or include quite complex lists of alternatives from which the respondent can choose (e.g., polytomous).
Closed questions can also provide ordinal data (which can be ranked). This often involves using a continuousrating scaleto measure the strength of attitudes or emotions.
For example, strongly agree / agree / neutral / disagree / strongly disagree / unable to answer.
Closed questions have been used to researchtype A personality(e.g., Friedman & Rosenman, 1974) and also to assesslife events that may cause stress(Holmes & Rahe, 1967) andattachment(Fraley, Waller, & Brennan, 2000).
Strengths
Limitations
Open Questions
Open questions allow for expansive, varied answers without preset options or limitations.
Open questions allow people to express what they think in their own words. Open-ended questions enable the respondent to answer in as much detail as they like in their own words. For example: “can you tell me how happy you feel right now?”
Open questions will work better if you want to gather more in-depth answers from your respondents. These give no pre-set answer options and instead, allow the respondents to put down exactly what they like in their own words.
Open questions are often used for complex questions that cannot be answered in a few simple categories but require more detail and discussion.
Lawrence Kohlbergpresented his participants with moral dilemmas. One of the most famous concerns a character called Heinz, who is faced with the choice between watching his wife die of cancer or stealing the only drug that could help her.
Participants were asked whether Heinz should steal the drug or not and, more importantly, for their reasons why upholding or breaking the law is right.
Questionnaire Design
With some questionnaires suffering from a response rate as low as 5%, a questionnaire must be well designed.
There are several important factors in questionnaire design.
AimsMake sure that all questions are asked to address the research aims. However, use only one feature of the construct you are investigating in per item.Length
Aims
Make sure that all questions are asked to address the research aims. However, use only one feature of the construct you are investigating in per item.
Length
The longer the questionnaire, the less likely people will complete it. Questions should be short, clear, and concise; any unnecessary questions/items should be omitted.
Pilot StudyRun a small-scale practice study to ensure people understand the questions. People can also give detailed, honest feedback on the questionnaire design.
Pilot Study
Run a small-scale practice study to ensure people understand the questions. People can also give detailed, honest feedback on the questionnaire design.
Question Order
Questions should progress logically from the least sensitive to the most sensitive, from the factual and behavioral to the cognitive, and from the more general to the more specific.
The researcher should ensure that previous questions do not influence the answer to a question.
Terminology
PresentationMake sure it looks professional and includes clear and concise instructions. If sent through the post, ensure the envelope does not signify ‘junk mail.’
Presentation
Make sure it looks professional and includes clear and concise instructions. If sent through the post, ensure the envelope does not signify ‘junk mail.’
Ethical Issues
Problems with Postal Questionnaires
That, of course, assumes there is a reply in the first place, and one of the most intractable problems of mailed questionnaires is a low response rate. This diminishes the reliability of the data
Benefits of a Pilot Study
Apilot studyis a practice / small-scale study conducted before the main study.
It allows the researcher to try out the study with a few participants so that adjustments can be made before the main study, saving time and money.
Frequently Asked Questions
How do psychological researchers analyze the data collected from questionnaires?
They calculate things like averages and percentages to see what most people think or feel. They also compare different groups to see if there are any differences between them.
By doing these analyses, researchers can understand how people think, feel, and behave. This helps them make conclusions and learn more about how our minds work.
Are questionnaires effective in gathering accurate data?Yes, questionnaires can be effective in gathering accurate data. When designed well, with clear and understandable questions, they allow individuals to express their thoughts, opinions, and experiences.However, the accuracy of the data depends on factors such as the honesty and accuracy of respondents’ answers, their understanding of the questions, and their willingness to provide accurate information. Researchers strive to create reliable and valid questionnaires to minimize biases and errors.It’s important to remember that while questionnaires can provide valuable insights, they are just one tool among many used in psychological research.
Are questionnaires effective in gathering accurate data?
Yes, questionnaires can be effective in gathering accurate data. When designed well, with clear and understandable questions, they allow individuals to express their thoughts, opinions, and experiences.However, the accuracy of the data depends on factors such as the honesty and accuracy of respondents’ answers, their understanding of the questions, and their willingness to provide accurate information. Researchers strive to create reliable and valid questionnaires to minimize biases and errors.It’s important to remember that while questionnaires can provide valuable insights, they are just one tool among many used in psychological research.
Yes, questionnaires can be effective in gathering accurate data. When designed well, with clear and understandable questions, they allow individuals to express their thoughts, opinions, and experiences.
However, the accuracy of the data depends on factors such as the honesty and accuracy of respondents’ answers, their understanding of the questions, and their willingness to provide accurate information. Researchers strive to create reliable and valid questionnaires to minimize biases and errors.
It’s important to remember that while questionnaires can provide valuable insights, they are just one tool among many used in psychological research.
Can questionnaires be used with diverse populations and cultural contexts?Yes, questionnaires can be used with diverse populations and cultural contexts. Researchers take special care to ensure that questionnaires are culturally sensitive and appropriate for different groups.This means adapting the language, examples, and concepts to match the cultural context. By doing so, questionnaires can capture the unique perspectives and experiences of individuals from various backgrounds.This helps researchers gain a more comprehensive understanding of human behavior and ensures that everyone’s voice is heard and represented in psychological research.
Can questionnaires be used with diverse populations and cultural contexts?
Yes, questionnaires can be used with diverse populations and cultural contexts. Researchers take special care to ensure that questionnaires are culturally sensitive and appropriate for different groups.This means adapting the language, examples, and concepts to match the cultural context. By doing so, questionnaires can capture the unique perspectives and experiences of individuals from various backgrounds.This helps researchers gain a more comprehensive understanding of human behavior and ensures that everyone’s voice is heard and represented in psychological research.
Yes, questionnaires can be used with diverse populations and cultural contexts. Researchers take special care to ensure that questionnaires are culturally sensitive and appropriate for different groups.
This means adapting the language, examples, and concepts to match the cultural context. By doing so, questionnaires can capture the unique perspectives and experiences of individuals from various backgrounds.
This helps researchers gain a more comprehensive understanding of human behavior and ensures that everyone’s voice is heard and represented in psychological research.
Are questionnaires the only method used in psychological research?No, questionnaires are not the only method used in psychological research. Psychologists use a variety of research methods, including interviews,observations,experiments, and psychological tests.Each method has its strengths and limitations, and researchers choose the most appropriate method based on their research question and goals.Questionnaires are valuable for gathering self-report data, but other methods allow researchers to directly observe behavior, study interactions, or manipulate variables to test hypotheses.By using multiple methods, psychologists can gain a more comprehensive understanding of human behavior and mental processes.
Are questionnaires the only method used in psychological research?
No, questionnaires are not the only method used in psychological research. Psychologists use a variety of research methods, including interviews,observations,experiments, and psychological tests.Each method has its strengths and limitations, and researchers choose the most appropriate method based on their research question and goals.Questionnaires are valuable for gathering self-report data, but other methods allow researchers to directly observe behavior, study interactions, or manipulate variables to test hypotheses.By using multiple methods, psychologists can gain a more comprehensive understanding of human behavior and mental processes.
No, questionnaires are not the only method used in psychological research. Psychologists use a variety of research methods, including interviews,observations,experiments, and psychological tests.
Each method has its strengths and limitations, and researchers choose the most appropriate method based on their research question and goals.
Questionnaires are valuable for gathering self-report data, but other methods allow researchers to directly observe behavior, study interactions, or manipulate variables to test hypotheses.
By using multiple methods, psychologists can gain a more comprehensive understanding of human behavior and mental processes.
What is a semantic differential scale?
It presents respondents with a pair of opposite adjectives (e.g., “happy” vs. “sad”) and asks them to mark their position on a scale between them, capturing the intensity of their feelings about a particular subject.
It quantifies subjective qualities, turning them into data that can be statistically analyzed.
References
Ayidiya, S. A., & McClendon, M. J. (1990). Response effects in mail surveys.Public Opinion Quarterly, 54(2), 229–247.https://doi.org/10.1086/269200
Fraley, R. C., Waller, N. G., & Brennan, K. A. (2000). An item-response theory analysis of self-report measures of adult attachment.Journal of Personality and Social Psychology, 78,350-365.
Friedman, M., & Rosenman, R. H. (1974).Type A behavior and your heart. New York: Knopf.
Gold, R. S., & Barclay, A. (2006). Order of question presentation and correlation between judgments of comparative and own risk.Psychological Reports, 99(3), 794–798.https://doi.org/10.2466/PR0.99.3.794-798
Holmes, T. H., & Rahe, R. H. (1967). The social readjustment rating scale.Journal of psychosomatic research, 11(2), 213-218.
Schwarz, N., & Hippler, H.-J. (1995). Subsequent questions may influence answers to preceding questions in mail surveys.Public Opinion Quarterly, 59(1), 93–97.https://doi.org/10.1086/269460
Smith, C. P. (Ed.). (1992).Motivation and personality: Handbook of thematic content analysis. Cambridge University Press.
Further Information
Olivia Guy-Evans, MSc
BSc (Hons) Psychology, MSc Psychology of Education
Olivia Guy-Evans is a writer and associate editor for Simply Psychology. She has previously worked in healthcare and educational sectors.
Saul McLeod, PhD
BSc (Hons) Psychology, MRes, PhD, University of Manchester
Saul McLeod, PhD., is a qualified psychology teacher with over 18 years of experience in further and higher education. He has been published in peer-reviewed journals, including the Journal of Clinical Psychology.
