Questionnaire Design: Types, Principles & Best Practices

TAKEAWAYS:

• A well-designed questionnaire is the backbone of reliable data collection, balancing clarity, relevance, and respondent ease.
• Structured vs. unstructured questionnaires serve different research goals: structured for quantitative data, unstructured for qualitative insights.
• Question types (open-ended, closed, Likert scales, etc.) must align with research objectives and analysis methods.
• Avoid bias, ambiguity, and leading questions—these distort responses and invalidate findings.
• Pilot testing is critical to refine questionnaires before full-scale deployment.
• Ethical considerations (privacy, consent) and cultural sensitivity are non-negotiable in questionnaire design.

1. What is a Questionnaire?

A questionnaire is a structured tool used to collect data from respondents systematically. It consists of a set of questions designed to gather information on specific variables of interest. Questionnaires are widely used in surveys, interviews, and experiments to ensure consistency and comparability of responses.

Why is it important?

• Standardizes data collection across respondents.
• Reduces interviewer bias (when self-administered).
• Facilitates quantitative analysis (e.g., statistical testing).
• Saves time and resources compared to open-ended interviews.

2. Types of Questionnaires

Questionnaires can be classified based on their structure and purpose. The choice depends on the research design (exploratory, descriptive, or causal) and data needs (qualitative vs. quantitative).

A. Structured vs. Unstructured Questionnaires

3. Design Principles of Effective Questionnaires

A poorly designed questionnaire leads to invalid data, low response rates, or bias. Follow these principles to ensure reliability and validity:

A. Clarity and Simplicity

• Use simple, unambiguous language. Avoid jargon or complex sentences.
• Example of bad: "To what extent do you agree that our product’s usability is subpar compared to competitors?" Good: "How easy is our app to use? (1 = Very difficult, 5 = Very easy)"

B. Relevance

• Every question should serve a specific research objective.
• Remove irrelevant or redundant questions to avoid respondent fatigue.

C. Avoiding Bias

Bias distorts responses. Common types:

1. Leading Questions: Suggest a desired answer.
   • Bad: "Don’t you think Pathao’s delivery fees are too high?"
   • Good: "How do you feel about Pathao’s delivery fees?"
2. Double-Barreled Questions: Ask two things at once.
   • Bad: "Do you like eSewa’s speed and customer service?"
   • Good: "How satisfied are you with eSewa’s transaction speed?" and "How satisfied are you with eSewa’s customer service?"
3. Loaded Questions: Emotionally charged language.
   • Bad: "Wouldn’t you agree that Ncell’s network is unreliable?"
   • Good: "How would you rate Ncell’s network reliability?"

D. Question Order

• Start with easy, non-sensitive questions to build rapport.
• Place demographic questions last (e.g., age, gender, income).
• Group related questions (e.g., all about "product usage" together).

4. Types of Questions

Choose question types based on the data needed and analysis method.

A. Closed-Ended Questions

Respondents select from predefined options. Best for quantitative data.

• Multiple Choice: Single best answer. Example: "Which payment method do you use most often?" Options: [ ] eSewa | [ ] Khalti | [ ] Credit Card | [ ] Cash
• Dichotomous: Yes/No or True/False. Example: "Have you used Daraz in the last 3 months?" [ ] Yes [ ] No
• Likert Scale: Measures agreement/likelihood on a scale (e.g., 1–5). Example: "How likely are you to recommend Nabil Bank?" 1 (Not at all) | 2 | 3 | 4 | 5 (Extremely likely)

B. Open-Ended Questions

Respondents provide free-text answers. Best for qualitative insights.

• Example: "What challenges do you face when using online banking?"
• Pros: Rich, detailed responses.
• Cons: Hard to analyze; requires manual coding.

C. Scale Questions

Measure intensity or frequency.

• Semantic Differential Scale: Bipolar adjectives (e.g., "Fast" vs. "Slow"). Example: "Rate Toyota’s service speed:" Fast (1) 2 3 4 5 Slow
• Ranking Questions: Order items by preference. Example: "Rank these food delivery apps from best to worst:" [ ] Foodmandu | [ ] Swiggy | [ ] Pathao

D. Matrix Questions

Group related questions with the same scale for efficiency. Example:

5. Real-World Applications

Case Study 1: eSewa’s Customer Satisfaction Survey

Problem: eSewa wanted to improve user experience but lacked structured feedback. Solution: Designed a structured questionnaire with:

• Likert-scale questions (e.g., "How easy was the payment process?").
• Open-ended questions (e.g., "What feature would you like to see added?").
• Demographic filters (age, location, transaction frequency). Outcome:
• Identified high dropout rates during OTP entry → Simplified the process.
• Added voice-based customer support based on qualitative feedback.

Case Study 2: Daraz’s Order Fulfillment Survey

Problem: Daraz noticed delays in order processing but didn’t know the root cause. Solution: Used a matrix questionnaire to compare:

• Warehouse efficiency (Likert scale).
• Delivery partner performance (ranking).
• Customer wait times (open-ended). Findings:
• 70% of delays were due to last-mile delivery bottlenecks.
• Solution: Partnered with Pathao for faster deliveries in urban areas.

Case Study 3: Nabil Bank’s Loan Application Questionnaire

Problem: High loan rejection rates due to incomplete applications. Solution: Redesigned the questionnaire to:

• Use mandatory fields for critical data (income proof, credit score).
• Add clear instructions (e.g., "Upload a scanned copy of your citizenship").
• Include conditional logic (e.g., "If self-employed, provide business details"). Result:
• 30% reduction in incomplete applications.
• Faster processing time due to standardized data.

6. Questionnaire Design Process

Follow this step-by-step approach to create an effective questionnaire:

Step-by-Step Breakdown

1. Define Objectives:

   • What do you want to measure? (e.g., customer satisfaction, market trends).
   • Example: "Measure NEPSE investors’ confidence in 2024."

2. Review Literature:

   • Check existing questionnaires (e.g., Net Promoter Score for customer loyalty).

3. Develop Questions:

   • Start with a draft, then refine based on principles above.

4. Pilot Test:

   • Test on a small group (e.g., 10–20 respondents).
   • Check for:
     • Ambiguity (e.g., "How often do you invest?" → "Weekly/Monthly/Yearly?").
     • Response time (if too long, respondents drop off).

5. Refine:

   • Remove unclear questions.
   • Adjust scales (e.g., change 1–5 to 1–7 for more granularity).

6. Finalize:

   • Ensure logical flow (e.g., start broad, then specific).
   • Include instructions (e.g., "Select only one option").

7. Administer:

   • Choose a delivery method:
     • Online (Google Forms, Typeform).
     • Paper-based (for low-literacy groups).
     • Interviewer-administered (for complex questions).

8. Analyze:

   • Use SPSS/Excel for quantitative data.
   • Use thematic analysis for qualitative data.

7. Common Mistakes and How to Avoid Them

8. Ethical Considerations

• Informed Consent: Respondents must know the purpose and how data will be used.
• Anonymity/Confidentiality: Ensure responses cannot be traced back to individuals.
• Voluntary Participation: Avoid coercion (e.g., "Complete this or lose your discount").
• Cultural Sensitivity: Adapt questions for local contexts (e.g., avoid religious/political bias in Nepal).

Example Consent Statement:

"This survey is part of a research project by TU. Your responses will be kept anonymous and used only for academic purposes. Participation is voluntary."

9. Tools for Questionnaire Design

10. Worked Example: Designing a Questionnaire for "Nepali Students’ Use of Digital Libraries"

Research Objective: "Assess how TU students use digital libraries (e.g., TU Central Library, Google Scholar) and their satisfaction levels."

Step 1: Draft Questions

1. Demographics (last):

   • What is your current semester? [ ] 1st | [ ] 2nd | ... | [ ] 8th
   • Which program are you enrolled in? [ ] BITM | [ ] BBA | [ ] BSc CSIT

2. Frequency of Use (Likert scale):

   • How often do you access digital libraries for assignments? 1 (Never) | 2 | 3 | 4 | 5 (Daily)

3. Satisfaction (Matrix):

   Aspect	Very Dissatisfied (1)	...	Very Satisfied (5)
   Ease of access	[ ]	...	[ ]
   Availability of resources	[ ]	...	[ ]

4. Open-Ended:

   • What is the biggest challenge you face when using digital libraries?

5. Ranking:

   • Rank these sources from most to least useful: [ ] TU Central Library | [ ] Google Scholar | [ ] YouTube | [ ] Other

Step 2: Pilot Test

• Test with 10 BITM students.
• Findings:
  • Question 3’s "Availability of resources" was unclear → Reworded to "How satisfied are you with the variety of books/e-books available?"
  • Some students didn’t know what "digital libraries" included → Added a definition at the start.

Step 3: Final Questionnaire

mindmap
  root((Digital Library Survey))
    Demographics
      Semester
      Program
    Frequency
      Likert Scale: 1-5
    Satisfaction
      Matrix: Access, Resources, Speed
    Challenges
      Open-Ended
    Ranking
      Sources: TU Library, Google Scholar, etc.
    Consent
      "Your responses are anonymous..."

In the Real World

1. eSewa’s Feedback Loop

   • Idea Used: Structured + Open-Ended Questionnaires
   • How: After every transaction, users get a 3-question survey:
     • "How satisfied were you with the transaction? (1–5)" (Likert scale).
     • "What could we improve?" (Open-ended).
     • "Would you recommend eSewa?" (Yes/No).
   • Impact: Identified OTP entry delays → Reduced transaction time by 20%.

2. Pathao’s Driver Satisfaction Survey

   • Idea Used: Matrix Questions for Efficiency
   • How: Drivers rate 5 aspects (payments, app usability, support, safety, earnings) on a 1–5 scale in a single matrix.
   • Impact: Found low earnings in certain cities → Adjusted pay rates dynamically.

3. Nabil Bank’s Loan Approval Process

   • Idea Used: Conditional Logic in Questionnaires
   • How: Applicants answer:
     • "Are you salaried or self-employed?"
       • If salaried: "Upload salary slips for last 6 months."
       • If self-employed: "Upload business registration + profit statements."
   • Impact: Reduced incomplete applications by 35%.

4. Daraz’s "Why Did You Abandon Cart?" Survey

   • Idea Used: Open-Ended + Multiple Choice Hybrid
   • How: After cart abandonment, users see:
     • "Why didn’t you complete your purchase?"
       • Too expensive
       • Delivery time too long
       • Other: _______ (open-ended)
   • Impact: Discovered high shipping costs → Introduced free delivery over $500.

Exam Tip

How This Unit is Tested

1. Theory Questions (30–40%):

   • Define structured vs. unstructured questionnaires.
   • Explain leading questions and how to avoid them.
   • List ethical considerations in questionnaire design.

2. Application Questions (40–50%):

   • Identify flaws in a given questionnaire (e.g., "This question is double-barreled").
   • Redesign a poor question (e.g., turn a leading question into a neutral one).
   • Match question types to research objectives (e.g., "Use a Likert scale for measuring satisfaction").

3. Case Study Analysis (20–30%):

   • Given a real-world scenario (e.g., "NTC wants to survey customer complaints"), design a short questionnaire (3–5 questions).
   • Example Question:

     "A bank wants to improve its mobile app. Draft 3 questions for a satisfaction survey, ensuring no bias and using at least one Likert scale."

4. Visual Interpretation (10–15%):

   • Diagrams: Interpret a flowchart of a questionnaire process.
   • Tables: Compare structured vs. unstructured questionnaires (as shown earlier).

Top 5 Exam Strategies

1. Memorize the 3 Cs: Clarity, Conciseness, and Avoiding Bias.
2. Practice Redesigning Bad Questions: Turn flawed examples into perfect ones.
3. Know Question Types: Be able to name and justify when to use open-ended vs. closed questions.
4. Ethics is Non-Negotiable: Always mention consent, anonymity, and voluntary participation.
5. Real-World Links: Relate to eSewa, Daraz, or Nabil Bank in answers to score extra marks.

Final Checklist Before Submitting

• All questions are clear and unbiased.
• Question types match the research goal (e.g., Likert for satisfaction).
• Pilot testing is mentioned if applicable.
• Ethical considerations are addressed.
• Visuals (tables, flowcharts) are included where needed.