What is a statistically significant result?

- It's always nice … to have statistically significant results. … Somehow, that makes everything right with the world. … At least as far as executives … and the product team are concerned. … But there are times when significance is more important … and times when it doesn't matter. … Statistically significant actually means … your results will be unlikely to occur … if the effect you found wasn't real. … You can have different levels of statistical significance. … 5% probability is normally acceptable … in behavioral research. … The significance level is often written as a probability, … using the letter p. … So p less than 0.05. … Here's an example to put this into context. … Say you're working in a company that sells things online. … You might want to see whether changing the color … of the add to cart button makes … a difference in how many people buy something. … Your button is blue right now and a certain proportion … of people who see the button click it and make a purchase. … You decide to make the button red instead …