There's lots of talk about statistical significance, and it can be really important, but the importance of some user research findings relies more on the size of the effect rather than the size of the sample. Learn what statistical significance really means so you know when you should be aiming for it, and when it isn't necessary.
- It's always nice … to have statistically significant results. … Somehow, that makes everything right with the world. … At least as far as executives … and the product team are concerned. … But there are times when significance is more important … and times when it doesn't matter. … Statistically significant actually means … your results will be unlikely to occur … if the effect you found wasn't real. … You can have different levels of statistical significance. … 5% probability is normally acceptable … in behavioral research. … The significance level is often written as a probability, … using the letter p. … So p less than 0.05. … Here's an example to put this into context. … Say you're working in a company that sells things online. … You might want to see whether changing the color … of the add to cart button makes … a difference in how many people buy something. … Your button is blue right now and a certain proportion … of people who see the button click it and make a purchase. … You decide to make the button red instead …
Author
Updated
3/25/2020Released
5/1/2019Skill Level Beginner
Duration
Views
Related Courses
-
Persuasive UX: Ethics of Persuasive Design
with Chris Nodder17m 31s Intermediate -
UX Design: 1 Overview
with Chris Nodder13m 48s Intermediate -
UX Design: 7 Implementation Planning
with Chris Nodder18m 27s Beginner -
Building and Maintaining Your UX Design Portfolio
with Diane Cronenwett15m 54s Intermediate
-
Introduction
-
Common UX Research Techniques
-
What is a usability test?2m 46s
-
What is a site visit?3m 40s
-
What is a card sort?3m 21s
-
What is a paper prototype?3m 42s
-
-
Specialized Research Techniques
-
What is a diary study?4m 1s
-
What is RITE testing?4m 30s
-
What is a focus group?4m 27s
-
What is eye tracking?4m 31s
-
Usability testing with kids4m 34s
-
What are intercept studies?4m 40s
-
Become a Better UX Researcher
-
What is research bias?3m 56s
-
UX Design Deliverables
-
What is a wireframe?3m 54s
-
What are design comps?3m 44s
-
What are personas used for?3m 21s
-
What is ideation?5m 14s
-
-
UX Job Roles
-
What does a UX writer do?4m 13s
-
Politics and Getting UX Work Done
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.
CancelTake notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.
Share this video
Embed this video
Video: What is a statistically significant result?