Self-completion questionnaires

Module items¶

Assignment¶

• Face to face surveying
  • See: [[How to submit an assignment]]

Sample assignment¶

• No sample

Reading¶

Learning outcomes¶

1. Define self-completion questionnaires
2. Compare and contrast (a) paper-based, (b) mobile-based, and (c) online-based self-completion questionnaires
3. Learn the differences between self-completion questionnaires and face to face structured surveys
4. Identify the interviewer effect
5. Identify the advantages and disadvantages of self-completion questionnaires

Ideal research design¶

1. Qualitative Interviews
   1. Capture rich insights
   2. Identify key themes
   3. Inform survey development
2. Develop Survey Questions
   1. Quantify qualitative findings
   2. Reach a wider audience
   3. Statistical validation
3. Revisit the field with Revised Qualitative Interviews
   1. Refine understanding
   2. Dive deeper into specific issues
   3. Enhance validity

What is a self-completion questionnaire?¶

• Definition: Self-completion questionnaires are survey tools completed by respondents without interviewer assistance
• Also called self-administrated and postal questionnaire
• Respondent writes answers on form
• No interviewer present
• Therefore, anonymity encourages more honest and reflective responses
• Returned to researcher or deposited for collection

Types of self-completion questionnaires - (1) Paper-based¶

• Paper-based self-completion questionnaires
• Description: Traditional method, consists of printed questions distributed physically.
• Usage: Used in settings where internet access is limited or for specific demographic groups less familiar with digital tools.
• Advantages: Tangible, can feel more personal; easier for some demographics.
• Challenges: Higher cost and time for distribution and data entry.

Types of self-completion questionnaires - (2) Mobile-based¶

• Mobile-based self-completion questionnaires
• Description: Surveys optimized for mobile devices, accessible through apps or mobile-friendly websites.
• Usage: Increasingly popular due to the widespread use of smartphones.
• Advantages: Convenience for respondents, real-time data collection, geolocation features.
• Challenges: Screen size limitations; need for mobile optimization.

Types of self-completion questionnaires - (3) Online-based¶

• Online-based self-completion questionnaires
• Description: Digital questionnaires distributed via email, social media, or dedicated platforms (e.g., Qualtrics, Google Forms).
• Usage: Ideal for reaching a broad audience quickly and cost-effectively.
• Advantages: Automated data collection and analysis; easy to edit and distribute.
• Challenges: Requires internet access; potential for lower response rates due to survey fatigue.

Comparing self-completion questionnaires and face to face structured surveys¶

• Method of Administration: Self administered vs. interviewer administered.
• Respondent Engagement: Varies from passive (self-completion) to active (structured). Self-completion provides convenience for respondents.
• Data Depth and Quality: Structured surveys offer more control but may introduce interviewer effect; self-completion allows for more candid responses but can suffer from lower engagement. No interviewer variability and absence of interviewer effects.
• Suitability: Choice depends on research objectives, target population, available resources, and the nature of information sought.

Interviewer effect¶

• Characteristics of interviewers (and respondents) may affect the answers that people give.
• Characteristics such as age, gender, race, ethnicity, and the social background of interviewers may combine to bias the answers that respondents provide.
• Since there is no interviewer present when a self-completion questionnaire is being completed, interviewer effects are eliminated.
• People are more likely to exhibit social desirability bias when an interviewer is present.
• The interviewer effect (also called interviewer variance or interviewer error) is the distortion of response to a personal interview which results from differential reactions to the social style and personality of interviewers or to their presentation of particular questions.

Interviewer effect - Impacts on research and minimizing interviewer effect¶

Impacts on research¶

• Response Bias: Respondents may alter their answers to please the interviewer or avoid judgment.
• Social Desirability Bias: Tendency to give socially acceptable answers rather than truthful ones.
• Consistency and Comparability Issues: Variations in interviewer effect can lead to inconsistencies in responses across different interviews.

Minimizing interviewer effect¶

• Training: Thorough training of interviewers to maintain neutrality and consistency.
• Standardization: Using structured interview protocols to limit variation in question delivery.
• Two researchers: Using two researchers for control.
• Two researchers: Some level of interviewer effect is inevitable.

Interviewer effect - Research¶

• Davis, D. (1997). The Direction of Race of Interviewer Effects among African-Americans: Donning the Black Mask. American Journal of Political Science, 41(1), 309-322. doi:10.2307/2111718

Disadvantages of self-completion questionnaires¶

• Cannot probe or prompt
• Can only ask salient questions
• No complex questions
• Respondent can see the whole questionnaire before answering (question order effects)
• Cannot ensure that the ‘right’ person answers
• Respondent fatigue if too many questions
• Excludes people with limited literacy skills
• Greater risk of missing data
• Lower response rates

Tips to improve response rates to self-completion questionnaires¶

• Since response rates are relatively low there is a risk of sample bias; a rate of 60%+ is needed to be acceptable.
• Response rates can be improved by:
  • Writing a good covering letter
  • Including a stamped addressed envelope
  • Issuing reminders
  • Using shorter questionnaires
  • Give clear instructions
  • Using a layout attractive to the respondent
  • Use few open-ended questions (actually, don’t)
  • Providing monetary incentives

Arrange fixed answers vertically¶

• Because this makes the questionnaire less confusing to read.
• Because questions can be distinguished from answers.
• Because the respondent is less likely to make a mistake.
• Because the questionnaire is easier for data entry.