Exploring the Questionnaire Method in User Studies

When a library wants to know whether its students are happy with the e-resources, whether the opening hours suit working professionals, or which sections gather dust, it rarely guesses. It asks. The questionnaire method is the most widely used way of asking, and it sits at the heart of nearly every user study in library and information science. Understanding how it works, where it shines, and where it stumbles is essential for anyone studying informetrics, scientometrics, or research methods in this field.

How the questionnaire method works 🔗

A questionnaire is a structured research tool that uses a pre-formulated set of questions to collect information from a group of respondents. In user studies, it is used to gather data about how people behave, what they prefer, what they need, and how satisfied they are. The strength of the method lies in its standardisation: every respondent answers the same questions in the same format, which makes the responses easy to compare, count, and convert into numbers for analysis.

This is why the questionnaire is treated as a tool for collecting empirical and standardised data from large numbers of people. It belongs to the general or conventional methods of use studies, alongside interviews, diary studies, and observation. Among these, the questionnaire is the most frequently chosen, and there are practical reasons for that.

Why researchers prefer it 🔗

The first reason is cost. Once a questionnaire is designed, it can be sent to a large number of people with very little additional expense. Online survey tools have pushed this advantage even further by removing printing and postage costs altogether. A single well-built form can be circulated to hundreds of students through a college email list at almost no marginal cost.

The second reason is reach. The questionnaire is especially useful when the population is large and spread out geographically. A university with multiple campuses can collect responses from all of them at once. The method is also simple and convenient to administer, which lowers the barrier for both the researcher and the respondent.

The third reason is the nature of the data. Because everyone answers identical questions, the results can be tabulated and analysed using simple descriptive statistics such as frequencies and percentages. This makes questionnaires a natural fit for quantitative studies that track measurable things, like how many users access e-journals versus print journals, or how often the reference desk is approached.

The challenges you cannot ignore 🔗

The most persistent problem with questionnaires is the low response rate. Many people simply do not return them. This matters because non-respondents can differ systematically from respondents, a problem known as nonresponse bias, where the people who skip the survey hold views that never make it into the results. When that happens, the findings stop representing the whole user community and quietly mislead the library.

Length is a known culprit. Long or burdensome questionnaires deter participation, because people are unwilling to invest time when they see little personal benefit. The mode of delivery matters too: an online-only survey can unintentionally exclude users who lack reliable internet access, while a print survey may miss those who prefer digital formats.

There is also the issue of question quality. A questionnaire cannot ask follow-up questions or clarify confusion the way an interviewer can. If a question is poorly worded, the respondent answers the question they think you asked, and the researcher never finds out. This makes careful design not just helpful but necessary.

Designing effective questionnaires 🔗

A good questionnaire begins with a clear purpose. Before writing a single question, the researcher should write down exactly what they need to know and what decision the answers will inform. It is surprisingly easy to forget important questions or to include ones that serve no real purpose, so this step keeps the form focused and short.

Choosing the right type of question 🔗

Questions generally fall into two families. Closed-ended questions give respondents a fixed set of options to choose from, such as yes or no, multiple choice, or a rating scale. They are quick to answer, easy to tabulate, and ideal when the goal is to collect data that can be quantified and analysed statistically. Their limitation is that they can only measure the options the designer thought to include.

Open-ended questions do not provide response options. Instead, respondents reply in their own words, which produces rich qualitative data about experiences and feelings. These questions are powerful for uncovering the “why” behind a behaviour, but they are slower to answer and harder to analyse. A common and effective approach is to blend both types, using closed questions to capture broad patterns and a few open questions to capture explanations. The traditional advice is to keep open-ended questions few and place them early, so respondents are not fatigued by the time they reach them.

Common pitfalls to avoid 🔗

Several wording mistakes can quietly ruin a questionnaire. Leading questions nudge respondents toward a particular answer and bias the results. Double-barreled questions ask about two things at once, such as “Are you satisfied with the library’s collection and staff?”, leaving the respondent unsure which part to answer. Ambiguous wording and jargon confuse people and produce unreliable data. The remedy is plain, direct language and one idea per question.

For closed-ended questions, two principles are worth remembering. The response options should be mutually exclusive and exhaustive, meaning the categories do not overlap and they cover every possible answer. A question that asks how often someone visits the library should not offer overlapping ranges, and it should leave room for those who never visit at all.

Testing before you launch 🔗

A questionnaire should never go out untested. Pilot testing the form on a small group helps catch confusing wording, awkward question order, and missing response options before the real survey begins. This single step prevents the most common errors and saves the researcher from collecting a pile of unusable answers.

Sampling and distribution 🔗

Who answers the questionnaire is as important as what it asks. Probability sampling, where every member of the user population has an equal chance of being selected, allows the researcher to make reliable generalisations about the larger population. Non-probability sampling, such as convenience sampling, is faster and easier but can introduce bias and limits how far the results can be applied. The choice of distribution channel, whether online, by email, in person, or over the phone, should match the habits of the target group.

Real-life examples of questionnaire-based research 🔗

The clearest way to understand the method is to look at how libraries actually use it. User satisfaction surveys are among the most common applications, and academic library studies across the country follow a recognisable pattern: distribute a structured questionnaire, collect the returned forms, and analyse the responses with simple percentages and frequencies.

Measuring user satisfaction in academic libraries 🔗

Consider a study at the central library of the D. Y. Patil College of Engineering and Technology in Kolhapur, Maharashtra. Researchers distributed a structured questionnaire and analysed the results with descriptive statistics. The study found that a majority of respondents visited the library daily and were highly satisfied with the book collection, while also identifying services that needed improvement. The recommendation that emerged was direct: the library should conduct user studies at regular intervals to keep identifying needs as they change.

A study using a modified SERVQUAL questionnaire at the A. C. Joshi Library, Panjab University, Chandigarh, took the analysis a step further. By collecting data on different service attributes, the researchers found that library environment and library services significantly predicted overall user satisfaction, and that satisfaction levels differed across academic disciplines. This shows how a well-designed questionnaire can move beyond simple counts to reveal what actually drives the way users feel.

From survey results to better service 🔗

The point of a questionnaire is not the data itself but the decisions it enables. When a public library learns through a satisfaction survey that users find the online catalogue difficult to navigate, that feedback can prompt a redesign of the interface, followed by usability testing to confirm the new version works better. Surveys also surface practical problems, such as overcrowded study rooms, which can lead a library to expand seating or improve its reservation system.

In other words, the questionnaire closes a loop. It identifies gaps in service, measures whether existing programmes are working, and guides how resources and budgets should be allocated. A library that discovers its users prefer more online databases can shift its collection spending accordingly, and a library that learns certain platforms are hard to use can fix them.

Working around the response-rate problem 🔗

The library studies above achieved high response rates, often above 80 percent, partly because the target population was captive and accessible. When response rates are a concern, research offers tested remedies. Sending advance letters, reminder messages, and replacement questionnaires consistently lifts participation, and a topic that genuinely interests the target group helps as well. Reminders are the most common technique, and keeping the questionnaire short and engaging reduces the drop-off that long forms cause.

Incentives can also work, though the evidence is mixed and depends on context. Some studies find that monetary incentives raise response rates, especially among younger and harder-to-reach respondents, while non-monetary nudges have a more modest effect. For a typical library survey, the most reliable combination remains a short, clear questionnaire, a relevant topic, personalised invitations, and a polite reminder or two.

Putting it together 🔗

The questionnaire method earns its popularity honestly. It is affordable, it reaches large and scattered groups, and it produces the kind of standardised data that libraries can act on. Its weaknesses, mainly low response rates and the risk of poorly worded questions, are real but manageable through careful design, pilot testing, sensible sampling, and steady follow-up. For a field that exists to serve its users well, asking them directly, in a structured and thoughtful way, remains one of the most reliable tools available.

What do you think? If you were designing a questionnaire for your own college library, which two areas of service would you most want to measure, and would you rely more on closed-ended or open-ended questions to capture what students really think?

References

1. https://ebooks.inflibnet.ac.in/lisp15/chapter/methods-and-techniques-of-use-studies-part-1/
2. https://ebooks.inflibnet.ac.in/lisp4/chapter/user-studies-users-education/
3. https://www.geopoll.com/blog/explainer-understanding-nonresponse-bias-in-research-and-how-to-mitigate-it/
4. https://methods.sagepub.com/book/mono/constructing-effective-questionnaires/chpt/open-closedend-questions
5. https://uta.pressbooks.pub/foundationsofsocialworkresearch/chapter/7-4-designing-effective-questions-and-questionnaires/
6. https://www.academia.edu/111532491/LIBRARY_USERS_SATISFACTION_SURVEY_OF_THE_D_Y_PATIL_COLLEGE_OF_ENGINEERING_and_TECHNOLOGY_DYPCET_KOLHAPUR_MAHARASHTRA_A_STUDY
7. https://www.researchgate.net/publication/379119143_User_Satisfaction_with_Library_Resources_Services_and_Facilities_A_Study
8. https://www.nationalacademies.org/read/18293/chapter/6
9. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11737284/