Clik here to view.
Sample Size Estimation for NPS Confidence Intervals
Sample size estimation is a critical step in research planning. It can also seem like a mysterious and at times controversial process. But sample size estimation, when done correctly, is based mostly...
View ArticleClik here to view.
Four Types of Potential Survey Errors
When we conduct a survey, we want the truth, even if we can’t handle it. But standing in the way of our dreams of efficiently collected data revealing the unvarnished truth about customers, prospects,...
View ArticleClik here to view.
Do Too Many Response Options Confuse People?
Advice on rating scale construction is ubiquitous on the internet and in the halls of organizations worldwide. The problem is that much of the advice is based not on solid data but rather on...
View ArticleClik here to view.
Classifying Survey Questions into Four Content Types
In architecture, form follows function. In survey design, question format follows content. Earlier we described four classes of survey questions. These four classes are about the form, or format, of...
View ArticleClik here to view.
Statistical Hypothesis Testing: What Can Go Wrong?
Making decisions with data inevitably means working with statistics and one of its most common frameworks: Null Hypothesis Significance Testing (NHST).Hypothesis testing can be confusing (and...
View ArticleClik here to view.
Sample Sizes for Comparing Net Promoter Scores
Sample size estimation is a critical step in research planning, including when you’re trying to detect differences in measures like Net Promoter Scores. Too small of a sample and you risk not being...
View ArticleClik here to view.
Sample Sizes for Comparing Dependent Proportions
Sample size estimation is an important part of study planning. If the sample size is too small, the study will be underpowered, meaning it will be incapable of detecting sufficiently small differences...
View ArticleClik here to view.
Should You Report Numbers or Percentages in Small-Sample Studies?
“Don’t include numbers when reporting the results of small-sample research studies!” “If you must, definitely don’t use percentages!” “And of course, don’t even think about using statistics!” We...
View ArticleClik here to view.
Sample Sizes for Comparing Rating Scale Means
Are customers more satisfied this quarter than last quarter? Do users trust the brand less this year than last year? Did the product changes result in more customers renewing their subscriptions? When...
View ArticleClik here to view.
How Do Changes in Standard Deviation Affect Sample Size Estimation?
The standard deviation is the most common way of measuring variability or “dispersion” in data. The more the data is dispersed, the more measures such as the mean will fluctuate from sample to sample....
View ArticleClik here to view.
Changes to Rating Scale Formats Can Matter, But Usually Not That Much
Few things seem to elicit more opinions, exaggerations, and accusations than rating scale response options. From the “right” number of points, the use (or not) of labels, and the presentation order (to...
View ArticleClik here to view.
Top Box, Top-Two Box, Bottom Box, or Net Box?
One box, two box, red box, blue box … Box scoring isn’t just something they do in baseball. Response options for rating scale data are often referred to as boxes because, historically,...
View ArticleClik here to view.
Sample Sizes for Usability Studies: One Size Does Not Fit All
“How many participants should you run in a usability study?” How many times have you heard that question? How many different answers have you heard? After you sift through the non-helpful ones,...
View ArticleClik here to view.
What You Get with Specific Sample Sizes in UX Problem Discovery Studies
What sample size should you use for a problem discovery (formative) usability study? In practice, the answer is based on both statistics AND logistics. A statistical formula will tell you an optimal...
View Article