Sheila B Robinson • Kimberly Firth Leonard

DESIGNING QUALITY SURVEY QUESTIONS

Surveys are a cornerstone of social and behavioral research, and with the use of web-based tools, surveys have become an easy and inexpensive means of gathering data. But how researchers ask a question can dramatically influence the answers they receive.

Designing Quality Survey Questions shows readers how to craft high quality, precisely-worded survey questions that will elicit rich, nuanced, and ultimately useful data to help answer their research or evaluation questions. The authors address challenges such as language preferences for standard demographic questions (e.g. How to ask about gender), creative question design to keep respondents engaged and avoid survey fatigue, web-based survey formats, culturally-responsive survey design, and factors that influence survey responses (memory, social desirability, etc.). Numerous examples of questions illustrate each identified principle of question construction.

Get the Book!

Text Features

A number of features help the reader navigate the text, apply the authors’ guidance on designing questions, and accelerate learning.

Stories from the field

Stories From the Field provide even more real-world experiences for the reader collected from practitioners who share lessons learned about survey design.

Mini-Interviews

Mini-Interviews with expert practitioners highlight key survey design topics.

Real World Questions

Real-World Questions are examples of poorly constructed questions and inappropriate or inadequate response options and scales culled from surveys we have taken over the years.

design details

Design Details focus the reader on especially salient topics in the design process.

ADDITIONAL FEATURES

A design thinking framework helps researchers understand and empathize with their potential respondents and be able to build and test survey prototypes before administering surveys.
Direct guidance on potentially difficult aspects of survey writing, including crafting clear question stems and appropriate response options, working with sensitive question types, and understanding how question wording can influence response, address considerations for writing and administering surveys.
Design Drills exercises challenge the reader and support application of the information included.
Discussion Questions designed for group discussion or individual reflection on the content included.
Extended Learning lists include suggested additional readings for further study

Get the Book!

Get your very own copy of Designing Quality Survey Questions! It’s available now at SAGE Publications or on Amazon.

What reviewers said...

This text does a really good job of capturing the current literature on survey research, without getting dragged down into the minutiae.

The examples do an excellent job of illustrating key ideas.

Organization is very clear, follows logically, and concise while being comprehensive.

Real-life examples also are a great strength of the text.

The applied questions and exercises will be particularly valued by students.

References are given to medical, social science and educational research and will appeal to a broad audience.

THE AUTHORS

Sheila B Robinson & Kim F Leonard

Checklist for Quality Question Design

The Checklist for Quality Question Design is a key feature of the text. It’s a comprehensive question design assessment tool that can be used to reflect on the quality of draft survey questions. It’s a handy summary of the guidance outlined in the text and intended to support students and practitioners alike as they compose surveys.

Get the Book!

DQSQ by the numbers

Here’s why Designing Quality Survey Questions will become your go-to text for survey design.

Chapters on various aspects of survey design

Question types discussed in detail in the text

Checklist items on the question assessment tool

Additional resources for extended leaning

Get the Book!

What people are saying…

“BetterEvaluation 2018 Holiday Reading List”

So, true story: I had a tight deadline to re-vamp an evaluation client’s questionnaire, but I also wanted to give myself a quick refresher on survey design by reading this book. I only had a couple of hours while my young daughter was at an event so I sat in my car in the parking lot and read Chapters 4 & 5.

Wow. It was well-written, easy to read, to-the-point, and had lots of great examples. It was such a worthwhile use of my time. I’m looking forward to finishing the rest of it.

-Kylie Hutchinson, Community Solutions Planning & Evaluation, recommendation appearing on Better Evaluation

“The Best of 2018!”

Designing Quality Survey Questions, by Sheila B. Robinson and Kimberly Firth Leonard, is a great read for evaluators and anyone interested in survey instrument design. The value of this manual lies in its ability to “show readers how to craft high quality, precisely-worded survey questions that will elicit rich, nuanced, and ultimately useful data to help answer their research or evaluation questions.” Go forth and survey!

–Innovation Network, December 2018 newsletter

“Three cheers for…”

The strong recommendation to only ask questions you have a clear plan to use, along with solid recommendations on what questions to cut or consolidate. Yes please! Don’t ask about my gender if you don’t need that information. And if you do, this book has thoughtfully addressed how to word survey questions related to sensitive topics like race, ethnicity, gender, income, and religion. We did not address this enough when I was in grad school.

The few times open-ended questions make sense and how to introduce them so people will actually fill them out. Whether to have a midpoint in your Likert scale (I’m team NO). How better questions can help us avoid a “don’t know” response. Clear, detailed, and realistic discussion of what respondents tend to think when presented with common survey issues. Survey design considerations for respondents who have low-vision or blindness. Fun ways to encourage responses.

And the narrative is accompanied by smile-worthy cartoons from the one and only, Chris Lysy, as well as adorable icons that make me jealous I didn’t have those in my book.

I’m cheering so hard because anyone who runs in the survey world needs to read and integrate this stuff and the other good ideas in this book.

-Stephanie Evergreen, review on Evergreen Data blog